2023-12-16T04:38:56.810 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-16T04:38:56.810 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493606 --name yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi --owner scheduled_yuriw@teuthology --verbose --description orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493606/orig.config.yaml 2023-12-16T04:38:56.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:38:56.957 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493606 branch: main description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: yweinste@redhat.com first_in_suite: false job_id: '7493606' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 2407 sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 sleep_before_teardown: 0 subset: 111/120000 suite: orch suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 targets: smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOMkydQCkJLkBa3m7klGd46IeIMkjeyvjvTeGZaZ66uu3Ervpm1istTNbW7PasmJLW5qfbgJKI858l9uG+J+MEE= smithi156.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCBKXIbLQws+ln0RSxAZ9MqXuxsUCmPuqqdUJts1uv1ysq9nfXJI01FfCJNfpdeqKKADLLHmDzdSV8IPjYAzKaQ= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-16_00:10:43 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2023-12-16T04:38:56.958 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa; will attempt to use it 2023-12-16T04:38:56.958 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks 2023-12-16T04:38:56.959 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-16T04:38:56.960 INFO:teuthology.task.internal:Checking packages... 2023-12-16T04:38:56.984 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '6d933094a156ec7587742e5aa25fba5ba27ec678' 2023-12-16T04:38:56.984 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T04:38:56.985 INFO:teuthology.packaging:ref: None 2023-12-16T04:38:56.985 INFO:teuthology.packaging:tag: None 2023-12-16T04:38:56.985 INFO:teuthology.packaging:branch: main 2023-12-16T04:38:56.985 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T04:38:56.985 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=main 2023-12-16T04:38:57.339 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-196.g85fe3c65 2023-12-16T04:38:57.340 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-16T04:38:57.348 INFO:teuthology.task.internal:no buildpackages task found 2023-12-16T04:38:57.348 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-16T04:38:57.390 INFO:teuthology.task.internal:Saving configuration 2023-12-16T04:38:57.412 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-16T04:38:57.418 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T04:38:57.444 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493606', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 04:33:27.292889', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOMkydQCkJLkBa3m7klGd46IeIMkjeyvjvTeGZaZ66uu3Ervpm1istTNbW7PasmJLW5qfbgJKI858l9uG+J+MEE='} 2023-12-16T04:38:57.466 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493606', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 04:33:27.294423', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCBKXIbLQws+ln0RSxAZ9MqXuxsUCmPuqqdUJts1uv1ysq9nfXJI01FfCJNfpdeqKKADLLHmDzdSV8IPjYAzKaQ='} 2023-12-16T04:38:57.466 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-16T04:38:57.472 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2023-12-16T04:38:57.472 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2023-12-16T04:38:57.472 INFO:teuthology.run_tasks:Running task console_log... 2023-12-16T04:38:57.561 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8174c72e50>, signals=[15]) 2023-12-16T04:38:57.561 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-16T04:38:57.567 INFO:teuthology.task.internal:Opening connections... 2023-12-16T04:38:57.568 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2023-12-16T04:38:57.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T04:38:57.636 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi156.front.sepia.ceph.com 2023-12-16T04:38:57.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T04:38:57.704 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-16T04:38:57.710 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2023-12-16T04:38:57.733 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2023-12-16T04:38:57.733 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-12-16T04:38:57.794 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2023-12-16T04:38:57.794 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8" 2023-12-16T04:38:57.794 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2023-12-16T04:38:57.794 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2023-12-16T04:38:57.794 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8" 2023-12-16T04:38:57.794 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8" 2023-12-16T04:38:57.794 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-16T04:38:57.794 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-12-16T04:38:57.794 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-16T04:38:57.794 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2023-12-16T04:38:57.794 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T04:38:57.794 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T04:38:57.795 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T04:38:57.795 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-12-16T04:38:57.867 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-12-16T04:38:57.889 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-12-16T04:38:57.889 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-12-16T04:38:57.950 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2023-12-16T04:38:57.950 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8" 2023-12-16T04:38:57.950 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2023-12-16T04:38:57.950 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2023-12-16T04:38:57.951 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8" 2023-12-16T04:38:57.951 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-12-16T04:38:57.951 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-16T04:38:57.951 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-12-16T04:38:57.951 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-16T04:38:57.951 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2023-12-16T04:38:57.951 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T04:38:57.951 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T04:38:57.951 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T04:38:57.951 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-12-16T04:38:57.975 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-16T04:38:57.983 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-16T04:38:58.006 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-16T04:38:58.006 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2023-12-16T04:38:58.009 DEBUG:teuthology.orchestra.run.smithi156:> test '!' -e /home/ubuntu/cephtest 2023-12-16T04:38:58.028 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-16T04:38:58.034 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-16T04:38:58.034 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2023-12-16T04:38:58.070 DEBUG:teuthology.orchestra.run.smithi156:> test -z $(ls -A /var/lib/ceph) 2023-12-16T04:38:58.100 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-16T04:38:58.156 INFO:teuthology.run_tasks:Running task kernel... 2023-12-16T04:38:58.172 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-16T04:38:58.172 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-16T04:38:58.172 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-16T04:38:58.173 DEBUG:teuthology.orchestra.run.smithi156:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-16T04:38:58.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T04:38:58.193 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2023-12-16T04:38:58.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T04:38:58.195 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2023-12-16T04:38:58.254 INFO:teuthology.orchestra.run.smithi156.stdout:4.18.0-489.el8.x86_64 2023-12-16T04:38:58.254 INFO:teuthology.task.kernel:Running kernel on smithi156: 4.18.0-489.el8.x86_64 2023-12-16T04:38:58.254 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum install -y kernel 2023-12-16T04:38:58.256 INFO:teuthology.orchestra.run.smithi155.stdout:4.18.0-489.el8.x86_64 2023-12-16T04:38:58.256 INFO:teuthology.task.kernel:Running kernel on smithi155: 4.18.0-489.el8.x86_64 2023-12-16T04:38:58.256 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum install -y kernel 2023-12-16T04:39:02.225 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - AppStream 24 MB/s | 35 MB 00:01 2023-12-16T04:39:02.388 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - AppStream 24 MB/s | 35 MB 00:01 2023-12-16T04:39:11.124 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - BaseOS 22 MB/s | 56 MB 00:02 2023-12-16T04:39:12.310 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 56 MB 00:03 2023-12-16T04:39:20.041 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - Extras 23 kB/s | 18 kB 00:00 2023-12-16T04:39:20.508 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - Extras common packages 24 kB/s | 6.9 kB 00:00 2023-12-16T04:39:20.818 INFO:teuthology.orchestra.run.smithi155.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-12-16T04:39:21.012 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - Extras 24 kB/s | 18 kB 00:00 2023-12-16T04:39:21.655 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - Extras common packages 15 kB/s | 6.9 kB 00:00 2023-12-16T04:39:21.931 INFO:teuthology.orchestra.run.smithi156.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-12-16T04:39:22.452 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-12-16T04:39:22.707 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 26 MB/s | 16 MB 00:00 2023-12-16T04:39:26.352 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 582 kB/s | 24 kB 00:00 2023-12-16T04:39:26.565 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 461 kB/s | 24 kB 00:00 2023-12-16T04:39:30.001 INFO:teuthology.orchestra.run.smithi155.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-12-16T04:39:30.001 INFO:teuthology.orchestra.run.smithi155.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-12-16T04:39:30.156 INFO:teuthology.orchestra.run.smithi156.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-12-16T04:39:30.157 INFO:teuthology.orchestra.run.smithi156.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-12-16T04:39:30.311 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T04:39:30.312 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T04:39:30.312 INFO:teuthology.orchestra.run.smithi155.stdout: Package Architecture Version Repository Size 2023-12-16T04:39:30.312 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T04:39:30.312 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-12-16T04:39:30.312 INFO:teuthology.orchestra.run.smithi155.stdout: kernel x86_64 4.18.0-527.el8 baseos 10 M 2023-12-16T04:39:30.312 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-12-16T04:39:30.312 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-core x86_64 4.18.0-527.el8 baseos 43 M 2023-12-16T04:39:30.313 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-modules x86_64 4.18.0-527.el8 baseos 36 M 2023-12-16T04:39:30.313 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T04:39:30.313 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-12-16T04:39:30.313 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T04:39:30.313 INFO:teuthology.orchestra.run.smithi155.stdout:Install 3 Packages 2023-12-16T04:39:30.313 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T04:39:30.314 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 90 M 2023-12-16T04:39:30.314 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 96 M 2023-12-16T04:39:30.314 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-12-16T04:39:30.449 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T04:39:30.449 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T04:39:30.450 INFO:teuthology.orchestra.run.smithi156.stdout: Package Architecture Version Repository Size 2023-12-16T04:39:30.450 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T04:39:30.450 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-12-16T04:39:30.450 INFO:teuthology.orchestra.run.smithi156.stdout: kernel x86_64 4.18.0-527.el8 baseos 10 M 2023-12-16T04:39:30.450 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-12-16T04:39:30.450 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-core x86_64 4.18.0-527.el8 baseos 43 M 2023-12-16T04:39:30.450 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-modules x86_64 4.18.0-527.el8 baseos 36 M 2023-12-16T04:39:30.450 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T04:39:30.450 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-12-16T04:39:30.450 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T04:39:30.450 INFO:teuthology.orchestra.run.smithi156.stdout:Install 3 Packages 2023-12-16T04:39:30.450 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T04:39:30.451 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 90 M 2023-12-16T04:39:30.451 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 96 M 2023-12-16T04:39:30.451 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-12-16T04:39:32.119 INFO:teuthology.orchestra.run.smithi155.stdout:(1/3): kernel-4.18.0-527.el8.x86_64.rpm 6.3 MB/s | 10 MB 00:01 2023-12-16T04:39:32.166 INFO:teuthology.orchestra.run.smithi156.stdout:(1/3): kernel-4.18.0-527.el8.x86_64.rpm 6.0 MB/s | 10 MB 00:01 2023-12-16T04:39:32.886 INFO:teuthology.orchestra.run.smithi155.stdout:(2/3): kernel-core-4.18.0-527.el8.x86_64.rpm 18 MB/s | 43 MB 00:02 2023-12-16T04:39:33.275 INFO:teuthology.orchestra.run.smithi156.stdout:(2/3): kernel-modules-4.18.0-527.el8.x86_64.rpm 13 MB/s | 36 MB 00:02 2023-12-16T04:39:33.528 INFO:teuthology.orchestra.run.smithi155.stdout:(3/3): kernel-modules-4.18.0-527.el8.x86_64.rpm 12 MB/s | 36 MB 00:03 2023-12-16T04:39:33.528 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-12-16T04:39:33.529 INFO:teuthology.orchestra.run.smithi155.stdout:Total 28 MB/s | 90 MB 00:03 2023-12-16T04:39:33.800 INFO:teuthology.orchestra.run.smithi156.stdout:(3/3): kernel-core-4.18.0-527.el8.x86_64.rpm 13 MB/s | 43 MB 00:03 2023-12-16T04:39:33.801 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-12-16T04:39:33.801 INFO:teuthology.orchestra.run.smithi156.stdout:Total 27 MB/s | 90 MB 00:03 2023-12-16T04:39:34.211 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-12-16T04:39:34.477 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-12-16T04:39:34.623 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-12-16T04:39:34.623 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-12-16T04:39:34.919 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-12-16T04:39:34.920 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-12-16T04:39:35.853 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-12-16T04:39:35.872 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-12-16T04:39:36.187 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-12-16T04:39:36.207 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-12-16T04:39:38.684 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-12-16T04:39:38.994 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-12-16T04:39:39.260 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : kernel-core-4.18.0-527.el8.x86_64 1/3 2023-12-16T04:39:39.579 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : kernel-core-4.18.0-527.el8.x86_64 1/3 2023-12-16T04:39:42.897 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-core-4.18.0-527.el8.x86_64 1/3 2023-12-16T04:39:43.167 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-core-4.18.0-527.el8.x86_64 1/3 2023-12-16T04:39:43.268 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : kernel-modules-4.18.0-527.el8.x86_64 2/3 2023-12-16T04:39:43.545 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : kernel-modules-4.18.0-527.el8.x86_64 2/3 2023-12-16T04:39:46.697 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-modules-4.18.0-527.el8.x86_64 2/3 2023-12-16T04:39:46.975 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-modules-4.18.0-527.el8.x86_64 2/3 2023-12-16T04:39:47.008 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : kernel-4.18.0-527.el8.x86_64 3/3 2023-12-16T04:39:47.277 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : kernel-4.18.0-527.el8.x86_64 3/3 2023-12-16T04:40:08.877 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-core-4.18.0-527.el8.x86_64 3/3 2023-12-16T04:40:08.901 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-modules-4.18.0-527.el8.x86_64 3/3 2023-12-16T04:40:09.085 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-core-4.18.0-527.el8.x86_64 3/3 2023-12-16T04:40:09.110 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-modules-4.18.0-527.el8.x86_64 3/3 2023-12-16T04:40:09.270 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-4.18.0-527.el8.x86_64 3/3 2023-12-16T04:40:09.270 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : kernel-4.18.0-527.el8.x86_64 1/3 2023-12-16T04:40:09.270 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : kernel-core-4.18.0-527.el8.x86_64 2/3 2023-12-16T04:40:09.490 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-4.18.0-527.el8.x86_64 3/3 2023-12-16T04:40:09.490 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : kernel-4.18.0-527.el8.x86_64 1/3 2023-12-16T04:40:09.490 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : kernel-core-4.18.0-527.el8.x86_64 2/3 2023-12-16T04:40:10.055 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : kernel-modules-4.18.0-527.el8.x86_64 3/3 2023-12-16T04:40:10.056 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T04:40:10.056 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-12-16T04:40:10.056 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-4.18.0-527.el8.x86_64 kernel-core-4.18.0-527.el8.x86_64 2023-12-16T04:40:10.056 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-modules-4.18.0-527.el8.x86_64 2023-12-16T04:40:10.056 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T04:40:10.056 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T04:40:10.219 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T04:40:10.283 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : kernel-modules-4.18.0-527.el8.x86_64 3/3 2023-12-16T04:40:10.283 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T04:40:10.283 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-12-16T04:40:10.284 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-4.18.0-527.el8.x86_64 kernel-core-4.18.0-527.el8.x86_64 2023-12-16T04:40:10.284 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-modules-4.18.0-527.el8.x86_64 2023-12-16T04:40:10.284 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T04:40:10.284 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T04:40:10.437 INFO:teuthology.orchestra.run.smithi155.stdout:kernel-4.18.0-527.el8.x86_64 2023-12-16T04:40:10.437 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-527.el8.x86_64 2023-12-16T04:40:10.438 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-527.el8.x86_64 2023-12-16T04:40:10.438 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-16T04:40:10.438 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-16T04:40:10.438 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2023-12-16T04:40:10.438 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi155.front.sepia.ceph.com, path=None, version=distro) 2023-12-16T04:40:10.438 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T04:40:10.454 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T04:40:10.647 INFO:teuthology.orchestra.run.smithi155.stdout:kernel-4.18.0-527.el8.x86_64 2023-12-16T04:40:10.647 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-527.el8.x86_64 2023-12-16T04:40:10.647 DEBUG:teuthology.orchestra.run.smithi155:> sudo rpm -qi grub2-tools 2023-12-16T04:40:10.666 INFO:teuthology.orchestra.run.smithi156.stdout:kernel-4.18.0-527.el8.x86_64 2023-12-16T04:40:10.667 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-527.el8.x86_64 2023-12-16T04:40:10.667 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-527.el8.x86_64 2023-12-16T04:40:10.667 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-16T04:40:10.667 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-16T04:40:10.667 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2023-12-16T04:40:10.667 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi156.front.sepia.ceph.com, path=None, version=distro) 2023-12-16T04:40:10.667 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T04:40:10.681 INFO:teuthology.orchestra.run.smithi155.stdout:Name : grub2-tools 2023-12-16T04:40:10.681 INFO:teuthology.orchestra.run.smithi155.stdout:Epoch : 1 2023-12-16T04:40:10.681 INFO:teuthology.orchestra.run.smithi155.stdout:Version : 2.02 2023-12-16T04:40:10.681 INFO:teuthology.orchestra.run.smithi155.stdout:Release : 129.el8 2023-12-16T04:40:10.681 INFO:teuthology.orchestra.run.smithi155.stdout:Architecture: x86_64 2023-12-16T04:40:10.681 INFO:teuthology.orchestra.run.smithi155.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-16T04:40:10.681 INFO:teuthology.orchestra.run.smithi155.stdout:Group : System Environment/Base 2023-12-16T04:40:10.681 INFO:teuthology.orchestra.run.smithi155.stdout:Size : 9265586 2023-12-16T04:40:10.681 INFO:teuthology.orchestra.run.smithi155.stdout:License : GPLv3+ 2023-12-16T04:40:10.681 INFO:teuthology.orchestra.run.smithi155.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-16T04:40:10.681 INFO:teuthology.orchestra.run.smithi155.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-16T04:40:10.681 INFO:teuthology.orchestra.run.smithi155.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-16T04:40:10.682 INFO:teuthology.orchestra.run.smithi155.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-16T04:40:10.682 INFO:teuthology.orchestra.run.smithi155.stdout:Relocations : (not relocatable) 2023-12-16T04:40:10.682 INFO:teuthology.orchestra.run.smithi155.stdout:Packager : CentOS BuildSystem 2023-12-16T04:40:10.682 INFO:teuthology.orchestra.run.smithi155.stdout:Vendor : CentOS 2023-12-16T04:40:10.682 INFO:teuthology.orchestra.run.smithi155.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-16T04:40:10.682 INFO:teuthology.orchestra.run.smithi155.stdout:Summary : Support tools for GRUB. 2023-12-16T04:40:10.682 INFO:teuthology.orchestra.run.smithi155.stdout:Description : 2023-12-16T04:40:10.682 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T04:40:10.682 INFO:teuthology.orchestra.run.smithi155.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-16T04:40:10.682 INFO:teuthology.orchestra.run.smithi155.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-16T04:40:10.682 INFO:teuthology.orchestra.run.smithi155.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-16T04:40:10.682 INFO:teuthology.orchestra.run.smithi155.stdout:hardware devices. 2023-12-16T04:40:10.682 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T04:40:10.682 INFO:teuthology.orchestra.run.smithi155.stdout:This subpackage provides tools for support of all platforms. 2023-12-16T04:40:10.683 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-16T04:40:10.683 INFO:teuthology.task.kernel:Updating grub on smithi155 to boot 4.18.0-527.el8.x86_64 2023-12-16T04:40:10.684 DEBUG:teuthology.orchestra.run.smithi155:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-16T04:40:10.879 INFO:teuthology.orchestra.run.smithi156.stdout:kernel-4.18.0-527.el8.x86_64 2023-12-16T04:40:10.879 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-527.el8.x86_64 2023-12-16T04:40:10.880 DEBUG:teuthology.orchestra.run.smithi156:> sudo rpm -qi grub2-tools 2023-12-16T04:40:10.913 INFO:teuthology.orchestra.run.smithi156.stdout:Name : grub2-tools 2023-12-16T04:40:10.914 INFO:teuthology.orchestra.run.smithi156.stdout:Epoch : 1 2023-12-16T04:40:10.914 INFO:teuthology.orchestra.run.smithi156.stdout:Version : 2.02 2023-12-16T04:40:10.914 INFO:teuthology.orchestra.run.smithi156.stdout:Release : 129.el8 2023-12-16T04:40:10.914 INFO:teuthology.orchestra.run.smithi156.stdout:Architecture: x86_64 2023-12-16T04:40:10.914 INFO:teuthology.orchestra.run.smithi156.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-16T04:40:10.914 INFO:teuthology.orchestra.run.smithi156.stdout:Group : System Environment/Base 2023-12-16T04:40:10.914 INFO:teuthology.orchestra.run.smithi156.stdout:Size : 9265586 2023-12-16T04:40:10.914 INFO:teuthology.orchestra.run.smithi156.stdout:License : GPLv3+ 2023-12-16T04:40:10.914 INFO:teuthology.orchestra.run.smithi156.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-16T04:40:10.914 INFO:teuthology.orchestra.run.smithi156.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-16T04:40:10.914 INFO:teuthology.orchestra.run.smithi156.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-16T04:40:10.914 INFO:teuthology.orchestra.run.smithi156.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-16T04:40:10.914 INFO:teuthology.orchestra.run.smithi156.stdout:Relocations : (not relocatable) 2023-12-16T04:40:10.914 INFO:teuthology.orchestra.run.smithi156.stdout:Packager : CentOS BuildSystem 2023-12-16T04:40:10.914 INFO:teuthology.orchestra.run.smithi156.stdout:Vendor : CentOS 2023-12-16T04:40:10.915 INFO:teuthology.orchestra.run.smithi156.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-16T04:40:10.915 INFO:teuthology.orchestra.run.smithi156.stdout:Summary : Support tools for GRUB. 2023-12-16T04:40:10.915 INFO:teuthology.orchestra.run.smithi156.stdout:Description : 2023-12-16T04:40:10.915 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T04:40:10.915 INFO:teuthology.orchestra.run.smithi156.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-16T04:40:10.915 INFO:teuthology.orchestra.run.smithi156.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-16T04:40:10.915 INFO:teuthology.orchestra.run.smithi156.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-16T04:40:10.915 INFO:teuthology.orchestra.run.smithi156.stdout:hardware devices. 2023-12-16T04:40:10.915 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T04:40:10.915 INFO:teuthology.orchestra.run.smithi156.stdout:This subpackage provides tools for support of all platforms. 2023-12-16T04:40:10.916 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-16T04:40:10.916 INFO:teuthology.task.kernel:Updating grub on smithi156 to boot 4.18.0-527.el8.x86_64 2023-12-16T04:40:10.916 DEBUG:teuthology.orchestra.run.smithi156:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-16T04:40:12.438 INFO:teuthology.orchestra.run.smithi156.stderr:Generating grub configuration file ... 2023-12-16T04:40:12.496 INFO:teuthology.orchestra.run.smithi155.stderr:Generating grub configuration file ... 2023-12-16T04:40:14.559 INFO:teuthology.orchestra.run.smithi156.stderr:done 2023-12-16T04:40:14.561 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2023-12-16T04:40:14.583 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.2YwoRpzyks 2023-12-16T04:40:14.584 DEBUG:teuthology.orchestra.run.smithi156:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.2YwoRpzyks 2023-12-16T04:40:14.657 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.2YwoRpzyks 2023-12-16T04:40:14.793 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.2YwoRpzyks is 6KB 2023-12-16T04:40:14.802 INFO:teuthology.orchestra.run.smithi155.stderr:done 2023-12-16T04:40:14.804 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2023-12-16T04:40:14.826 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.t5LUMTZH3g 2023-12-16T04:40:14.826 DEBUG:teuthology.orchestra.run.smithi155:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.t5LUMTZH3g 2023-12-16T04:40:14.842 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.2YwoRpzyks 2023-12-16T04:40:14.859 DEBUG:teuthology.orchestra.run.smithi156:> sudo /bin/ls /boot/loader/entries || true 2023-12-16T04:40:14.900 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.t5LUMTZH3g 2023-12-16T04:40:14.935 INFO:teuthology.orchestra.run.smithi156.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-16T04:40:14.935 INFO:teuthology.orchestra.run.smithi156.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-16T04:40:14.935 INFO:teuthology.orchestra.run.smithi156.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-16T04:40:14.935 INFO:teuthology.orchestra.run.smithi156.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-527.el8.x86_64.conf 2023-12-16T04:40:14.936 DEBUG:teuthology.orchestra.run.smithi156:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-527.el8.x86_64 2023-12-16T04:40:15.052 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.t5LUMTZH3g is 6KB 2023-12-16T04:40:15.096 DEBUG:teuthology.orchestra.run.smithi156:> sudo shutdown -r now 2023-12-16T04:40:15.101 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.t5LUMTZH3g 2023-12-16T04:40:15.118 DEBUG:teuthology.orchestra.run.smithi155:> sudo /bin/ls /boot/loader/entries || true 2023-12-16T04:40:15.206 INFO:teuthology.orchestra.run.smithi155.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-16T04:40:15.206 INFO:teuthology.orchestra.run.smithi155.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-16T04:40:15.206 INFO:teuthology.orchestra.run.smithi155.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-16T04:40:15.206 INFO:teuthology.orchestra.run.smithi155.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-527.el8.x86_64.conf 2023-12-16T04:40:15.207 DEBUG:teuthology.orchestra.run.smithi155:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-527.el8.x86_64 2023-12-16T04:40:15.375 DEBUG:teuthology.orchestra.run.smithi155:> sudo shutdown -r now 2023-12-16T04:40:45.129 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2023-12-16T04:40:45.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-12-16T04:40:45.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T04:40:45.379 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2023-12-16T04:40:45.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-12-16T04:40:45.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T04:41:03.506 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-16T04:41:03.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-12-16T04:41:12.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-12-16T04:41:12.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T04:41:12.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-12-16T04:41:12.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T04:41:15.573 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-16T04:41:15.825 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-12-16T04:41:27.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-12-16T04:41:27.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T04:41:27.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-12-16T04:41:27.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T04:41:59.667 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-12-16T04:41:59.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-12-16T04:41:59.908 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-527.el8.x86_64"... 2023-12-16T04:41:59.909 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2023-12-16T04:41:59.966 INFO:teuthology.orchestra.run.smithi156.stdout:4.18.0-527.el8.x86_64 2023-12-16T04:41:59.967 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-527.el8.x86_64 vs 4.18.0-527.el8.x86_64 2023-12-16T04:41:59.967 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-16T04:41:59.967 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-16T04:42:00.968 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2023-12-16T04:42:00.968 DEBUG:teuthology.orchestra.run.smithi156:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-16T04:42:01.034 INFO:teuthology.orchestra.run.smithi156.stdout:ttyS1 2023-12-16T04:42:01.046 DEBUG:teuthology.parallel:result is None 2023-12-16T04:42:27.829 DEBUG:teuthology.orchestra.remote:timed out 2023-12-16T04:42:42.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-12-16T04:42:42.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T04:42:43.202 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-12-16T04:42:43.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-12-16T04:42:43.523 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-527.el8.x86_64"... 2023-12-16T04:42:43.524 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2023-12-16T04:42:43.543 INFO:teuthology.orchestra.run.smithi155.stdout:4.18.0-527.el8.x86_64 2023-12-16T04:42:43.543 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-527.el8.x86_64 vs 4.18.0-527.el8.x86_64 2023-12-16T04:42:43.543 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-16T04:42:43.543 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-16T04:42:44.545 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2023-12-16T04:42:44.545 DEBUG:teuthology.orchestra.run.smithi155:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-16T04:42:44.612 INFO:teuthology.orchestra.run.smithi155.stdout:ttyS1 2023-12-16T04:42:44.625 DEBUG:teuthology.parallel:result is None 2023-12-16T04:42:44.625 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-16T04:42:44.633 INFO:teuthology.task.internal:Creating test directory... 2023-12-16T04:42:44.633 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-16T04:42:44.635 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-16T04:42:44.658 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-16T04:42:44.676 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-16T04:42:44.710 INFO:teuthology.task.internal:Creating archive directory... 2023-12-16T04:42:44.711 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-16T04:42:44.714 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-16T04:42:44.755 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-16T04:42:44.761 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-16T04:42:44.762 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-16T04:42:44.793 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-16T04:42:44.825 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T04:42:44.831 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T04:42:44.836 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T04:42:44.843 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T04:42:44.844 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-16T04:42:44.851 INFO:teuthology.task.internal:Configuring sudo... 2023-12-16T04:42:44.851 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-16T04:42:44.880 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-16T04:42:44.914 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-16T04:42:44.923 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-16T04:42:44.923 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-16T04:42:44.951 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-16T04:42:44.973 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T04:42:45.049 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T04:42:45.106 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T04:42:45.190 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T04:42:45.233 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-16T04:42:45.234 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-16T04:42:45.301 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T04:42:45.348 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T04:42:45.399 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T04:42:45.484 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T04:42:45.528 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-12-16T04:42:45.528 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-16T04:42:45.595 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2023-12-16T04:42:45.597 DEBUG:teuthology.orchestra.run.smithi156:> sudo service rsyslog restart 2023-12-16T04:42:45.651 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T04:42:45.717 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T04:42:46.086 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-16T04:42:46.094 INFO:teuthology.task.internal:Starting timer... 2023-12-16T04:42:46.094 INFO:teuthology.run_tasks:Running task pcp... 2023-12-16T04:42:46.130 INFO:teuthology.run_tasks:Running task selinux... 2023-12-16T04:42:46.165 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-12-16T04:42:46.166 DEBUG:teuthology.orchestra.run.smithi155:> sudo service auditd rotate 2023-12-16T04:42:46.239 INFO:teuthology.orchestra.run.smithi155.stdout:Rotating logs: 2023-12-16T04:42:46.241 DEBUG:teuthology.orchestra.run.smithi156:> sudo service auditd rotate 2023-12-16T04:42:46.294 INFO:teuthology.orchestra.run.smithi156.stdout:Rotating logs: 2023-12-16T04:42:46.296 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-16T04:42:46.296 DEBUG:teuthology.orchestra.run.smithi155:> /usr/sbin/getenforce 2023-12-16T04:42:46.320 INFO:teuthology.orchestra.run.smithi155.stdout:Permissive 2023-12-16T04:42:46.320 DEBUG:teuthology.orchestra.run.smithi156:> /usr/sbin/getenforce 2023-12-16T04:42:46.390 INFO:teuthology.orchestra.run.smithi156.stdout:Permissive 2023-12-16T04:42:46.390 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi155.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi156.front.sepia.ceph.com': 'permissive'} 2023-12-16T04:42:46.390 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T04:42:46.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T04:42:46.418 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T04:42:46.445 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T04:42:46.445 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-16T04:42:46.445 DEBUG:teuthology.orchestra.run.smithi155:> sudo /usr/sbin/setenforce permissive 2023-12-16T04:42:46.486 DEBUG:teuthology.orchestra.run.smithi156:> sudo /usr/sbin/setenforce permissive 2023-12-16T04:42:46.519 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-16T04:42:46.528 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-16T04:42:46.534 INFO:teuthology.repo_utils:Fetching main from origin 2023-12-16T04:42:46.669 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-16T04:42:46.684 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-16T04:42:46.686 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi155.front.sepia.ceph.com,smithi156.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-16T05:02:53.054 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi155.front.sepia.ceph.com'), Remote(name='ubuntu@smithi156.front.sepia.ceph.com')] 2023-12-16T05:02:53.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-12-16T05:02:53.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T05:02:53.157 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-12-16T05:02:53.228 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-12-16T05:02:53.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-12-16T05:02:53.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T05:02:53.296 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-12-16T05:02:53.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-12-16T05:02:53.366 INFO:teuthology.run_tasks:Running task clock... 2023-12-16T05:02:53.376 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-16T05:02:53.377 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-16T05:02:53.377 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T05:02:53.379 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-16T05:02:53.379 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T05:02:53.411 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-16T05:02:53.426 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-16T05:02:53.440 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-16T05:02:53.455 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-16T05:02:53.492 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: ntpd: command not found 2023-12-16T05:02:53.504 INFO:teuthology.orchestra.run.smithi155.stdout:506 Cannot talk to daemon 2023-12-16T05:02:53.519 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-16T05:02:53.532 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-16T05:02:53.535 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: ntpd: command not found 2023-12-16T05:02:53.546 INFO:teuthology.orchestra.run.smithi156.stdout:506 Cannot talk to daemon 2023-12-16T05:02:53.560 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-16T05:02:53.573 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-16T05:02:53.595 INFO:teuthology.orchestra.run.smithi155.stderr:bash: ntpq: command not found 2023-12-16T05:02:53.598 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T05:02:53.598 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2023-12-16T05:02:53.598 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T05:02:53.598 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T05:02:53.598 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T05:02:53.598 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T05:02:53.639 INFO:teuthology.orchestra.run.smithi156.stderr:bash: ntpq: command not found 2023-12-16T05:02:53.642 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T05:02:53.642 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2023-12-16T05:02:53.643 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T05:02:53.643 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T05:02:53.643 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T05:02:53.643 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T05:02:53.644 INFO:teuthology.run_tasks:Running task pexec... 2023-12-16T05:02:53.653 INFO:teuthology.task.pexec:Executing custom commands... 2023-12-16T05:02:53.653 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi155.front.sepia.ceph.com 2023-12-16T05:02:53.654 DEBUG:teuthology.orchestra.run.smithi155:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-16T05:02:53.654 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi156.front.sepia.ceph.com 2023-12-16T05:02:53.654 DEBUG:teuthology.orchestra.run.smithi156:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-16T05:02:54.528 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:14:22 ago on Sat 16 Dec 2023 04:48:32 AM UTC. 2023-12-16T05:02:54.559 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:14:21 ago on Sat 16 Dec 2023 04:48:33 AM UTC. 2023-12-16T05:02:56.677 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:02:56.678 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:02:56.678 INFO:teuthology.orchestra.run.smithi155.stdout: Package Architecture Version Repository Size 2023-12-16T05:02:56.678 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:02:56.678 INFO:teuthology.orchestra.run.smithi155.stdout:Resetting modules: 2023-12-16T05:02:56.678 INFO:teuthology.orchestra.run.smithi155.stdout: container-tools 2023-12-16T05:02:56.678 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:02:56.678 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-12-16T05:02:56.679 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:02:56.679 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:02:56.724 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:02:56.726 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:02:56.726 INFO:teuthology.orchestra.run.smithi156.stdout: Package Architecture Version Repository Size 2023-12-16T05:02:56.726 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:02:56.726 INFO:teuthology.orchestra.run.smithi156.stdout:Resetting modules: 2023-12-16T05:02:56.726 INFO:teuthology.orchestra.run.smithi156.stdout: container-tools 2023-12-16T05:02:56.726 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:02:56.726 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-12-16T05:02:56.726 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:02:56.726 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:02:56.935 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:02:56.974 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:02:57.874 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:14:25 ago on Sat 16 Dec 2023 04:48:32 AM UTC. 2023-12-16T05:02:57.905 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:14:24 ago on Sat 16 Dec 2023 04:48:33 AM UTC. 2023-12-16T05:03:00.000 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:03:00.023 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:03:00.192 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:03:00.192 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-12-16T05:03:00.192 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:03:00.192 INFO:teuthology.orchestra.run.smithi155.stdout:Installing group/module packages: 2023-12-16T05:03:00.192 INFO:teuthology.orchestra.run.smithi155.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-16T05:03:00.193 INFO:teuthology.orchestra.run.smithi155.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-16T05:03:00.193 INFO:teuthology.orchestra.run.smithi155.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-16T05:03:00.193 INFO:teuthology.orchestra.run.smithi155.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-16T05:03:00.193 INFO:teuthology.orchestra.run.smithi155.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-16T05:03:00.193 INFO:teuthology.orchestra.run.smithi155.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-16T05:03:00.193 INFO:teuthology.orchestra.run.smithi155.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-16T05:03:00.193 INFO:teuthology.orchestra.run.smithi155.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-16T05:03:00.193 INFO:teuthology.orchestra.run.smithi155.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-16T05:03:00.193 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-12-16T05:03:00.193 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-16T05:03:00.193 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-16T05:03:00.193 INFO:teuthology.orchestra.run.smithi155.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-16T05:03:00.193 INFO:teuthology.orchestra.run.smithi155.stdout:Installing weak dependencies: 2023-12-16T05:03:00.193 INFO:teuthology.orchestra.run.smithi155.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-16T05:03:00.193 INFO:teuthology.orchestra.run.smithi155.stdout:Installing module profiles: 2023-12-16T05:03:00.194 INFO:teuthology.orchestra.run.smithi155.stdout: container-tools/common 2023-12-16T05:03:00.194 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:03:00.194 INFO:teuthology.orchestra.run.smithi155.stdout:Enabling module streams: 2023-12-16T05:03:00.194 INFO:teuthology.orchestra.run.smithi155.stdout: container-tools rhel8 2023-12-16T05:03:00.194 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:03:00.194 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-12-16T05:03:00.194 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:03:00.194 INFO:teuthology.orchestra.run.smithi155.stdout:Install 13 Packages 2023-12-16T05:03:00.194 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:03:00.195 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 27 M 2023-12-16T05:03:00.195 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 89 M 2023-12-16T05:03:00.195 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-12-16T05:03:00.211 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:03:00.211 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-12-16T05:03:00.212 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:03:00.212 INFO:teuthology.orchestra.run.smithi156.stdout:Installing group/module packages: 2023-12-16T05:03:00.212 INFO:teuthology.orchestra.run.smithi156.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-16T05:03:00.212 INFO:teuthology.orchestra.run.smithi156.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-16T05:03:00.212 INFO:teuthology.orchestra.run.smithi156.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-16T05:03:00.212 INFO:teuthology.orchestra.run.smithi156.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-16T05:03:00.212 INFO:teuthology.orchestra.run.smithi156.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-16T05:03:00.212 INFO:teuthology.orchestra.run.smithi156.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-16T05:03:00.212 INFO:teuthology.orchestra.run.smithi156.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-16T05:03:00.212 INFO:teuthology.orchestra.run.smithi156.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-16T05:03:00.212 INFO:teuthology.orchestra.run.smithi156.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-16T05:03:00.212 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-12-16T05:03:00.212 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-16T05:03:00.212 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-16T05:03:00.212 INFO:teuthology.orchestra.run.smithi156.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-16T05:03:00.213 INFO:teuthology.orchestra.run.smithi156.stdout:Installing weak dependencies: 2023-12-16T05:03:00.213 INFO:teuthology.orchestra.run.smithi156.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-16T05:03:00.213 INFO:teuthology.orchestra.run.smithi156.stdout:Installing module profiles: 2023-12-16T05:03:00.213 INFO:teuthology.orchestra.run.smithi156.stdout: container-tools/common 2023-12-16T05:03:00.213 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:03:00.213 INFO:teuthology.orchestra.run.smithi156.stdout:Enabling module streams: 2023-12-16T05:03:00.213 INFO:teuthology.orchestra.run.smithi156.stdout: container-tools rhel8 2023-12-16T05:03:00.213 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:03:00.213 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-12-16T05:03:00.213 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:03:00.213 INFO:teuthology.orchestra.run.smithi156.stdout:Install 13 Packages 2023-12-16T05:03:00.213 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:03:00.214 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 27 M 2023-12-16T05:03:00.214 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 89 M 2023-12-16T05:03:00.214 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-12-16T05:07:08.690 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] aardvark-dns-1.8.0-1.module_el8+712+4cd1bd69.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/aardvark-dns-1.8.0-1.module_el8%2b712%2b4cd1bd69.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:07:08.691 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] buildah-1.32.0-1.module_el8+712+4cd1bd69.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/buildah-1.32.0-1.module_el8%2b712%2b4cd1bd69.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:07:08.691 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/cockpit-podman-78-1.module_el8%2b712%2b4cd1bd69.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:07:08.785 INFO:teuthology.orchestra.run.smithi155.stdout:[MIRROR] aardvark-dns-1.8.0-1.module_el8+712+4cd1bd69.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/aardvark-dns-1.8.0-1.module_el8%2b712%2b4cd1bd69.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:07:08.786 INFO:teuthology.orchestra.run.smithi155.stdout:[MIRROR] buildah-1.32.0-1.module_el8+712+4cd1bd69.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/buildah-1.32.0-1.module_el8%2b712%2b4cd1bd69.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:07:08.786 INFO:teuthology.orchestra.run.smithi155.stdout:[MIRROR] cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/cockpit-podman-78-1.module_el8%2b712%2b4cd1bd69.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:07:09.180 INFO:teuthology.orchestra.run.smithi156.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 3.0 kB/s | 750 kB 04:08 2023-12-16T05:07:09.267 INFO:teuthology.orchestra.run.smithi156.stdout:(2/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 4.1 kB/s | 1.0 MB 04:09 2023-12-16T05:07:09.281 INFO:teuthology.orchestra.run.smithi155.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 3.0 kB/s | 750 kB 04:08 2023-12-16T05:07:09.297 INFO:teuthology.orchestra.run.smithi156.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 324 kB/s | 38 kB 00:00 2023-12-16T05:07:09.331 INFO:teuthology.orchestra.run.smithi155.stdout:(2/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 4.1 kB/s | 1.0 MB 04:08 2023-12-16T05:07:09.363 INFO:teuthology.orchestra.run.smithi156.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 2.5 MB/s | 241 kB 00:00 2023-12-16T05:07:09.364 INFO:teuthology.orchestra.run.smithi155.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 454 kB/s | 38 kB 00:00 2023-12-16T05:07:09.423 INFO:teuthology.orchestra.run.smithi155.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 2.6 MB/s | 241 kB 00:00 2023-12-16T05:07:09.456 INFO:teuthology.orchestra.run.smithi156.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 1.9 MB/s | 178 kB 00:00 2023-12-16T05:07:09.515 INFO:teuthology.orchestra.run.smithi155.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 1.9 MB/s | 178 kB 00:00 2023-12-16T05:07:09.556 INFO:teuthology.orchestra.run.smithi156.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 248 kB/s | 25 kB 00:00 2023-12-16T05:07:09.599 INFO:teuthology.orchestra.run.smithi155.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 298 kB/s | 25 kB 00:00 2023-12-16T05:07:09.673 INFO:teuthology.orchestra.run.smithi156.stdout:(7/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 10 MB/s | 3.9 MB 00:00 2023-12-16T05:07:09.698 INFO:teuthology.orchestra.run.smithi156.stdout:(8/13): python3-pyxdg-0.25-16.el8.noarch.rpm 661 kB/s | 94 kB 00:00 2023-12-16T05:07:09.746 INFO:teuthology.orchestra.run.smithi155.stdout:(7/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 10 MB/s | 3.9 MB 00:00 2023-12-16T05:07:09.774 INFO:teuthology.orchestra.run.smithi155.stdout:(8/13): python3-pyxdg-0.25-16.el8.noarch.rpm 535 kB/s | 94 kB 00:00 2023-12-16T05:07:09.815 INFO:teuthology.orchestra.run.smithi156.stdout:(9/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 39 kB/s | 9.6 MB 04:09 2023-12-16T05:07:09.892 INFO:teuthology.orchestra.run.smithi155.stdout:(9/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 39 kB/s | 9.6 MB 04:09 2023-12-16T05:07:09.907 INFO:teuthology.orchestra.run.smithi156.stdout:(10/13): udica-0.2.6-20.module_el8+712+4cd1bd69 575 kB/s | 53 kB 00:00 2023-12-16T05:07:09.949 INFO:teuthology.orchestra.run.smithi156.stdout:(11/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 10 MB/s | 2.5 MB 00:00 2023-12-16T05:07:09.983 INFO:teuthology.orchestra.run.smithi155.stdout:(10/13): udica-0.2.6-20.module_el8+712+4cd1bd69 575 kB/s | 53 kB 00:00 2023-12-16T05:07:10.016 INFO:teuthology.orchestra.run.smithi156.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 377 kB/s | 41 kB 00:00 2023-12-16T05:07:10.034 INFO:teuthology.orchestra.run.smithi155.stdout:(11/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 9.8 MB/s | 2.5 MB 00:00 2023-12-16T05:07:10.067 INFO:teuthology.orchestra.run.smithi155.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 490 kB/s | 41 kB 00:00 2023-12-16T05:07:10.175 INFO:teuthology.orchestra.run.smithi156.stdout:(13/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 16 MB/s | 8.1 MB 00:00 2023-12-16T05:07:10.175 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:07:10.175 INFO:teuthology.orchestra.run.smithi156.stdout:Total 109 kB/s | 27 MB 04:09 2023-12-16T05:07:10.243 INFO:teuthology.orchestra.run.smithi155.stdout:(13/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 16 MB/s | 8.1 MB 00:00 2023-12-16T05:07:10.243 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:07:10.243 INFO:teuthology.orchestra.run.smithi155.stdout:Total 109 kB/s | 27 MB 04:10 2023-12-16T05:07:10.428 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-12-16T05:07:10.449 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-12-16T05:07:10.449 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-12-16T05:07:10.500 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-12-16T05:07:10.521 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-12-16T05:07:10.521 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-12-16T05:07:10.702 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-12-16T05:07:10.705 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-12-16T05:07:10.776 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-12-16T05:07:10.779 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-12-16T05:07:11.421 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-12-16T05:07:11.480 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-12-16T05:07:11.663 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-16T05:07:11.723 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-16T05:07:11.859 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-16T05:07:11.905 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-16T05:07:12.050 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-16T05:07:12.126 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-16T05:07:12.303 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-16T05:07:12.354 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-16T05:07:12.827 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-16T05:07:12.886 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-16T05:07:13.820 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-16T05:07:13.860 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-16T05:07:14.080 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-16T05:07:14.109 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-16T05:07:14.286 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-16T05:07:14.326 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-16T05:07:14.572 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-16T05:07:14.580 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-16T05:07:14.989 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-16T05:07:14.997 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-16T05:07:15.887 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-16T05:07:15.926 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-16T05:07:16.114 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-16T05:07:16.138 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-16T05:07:16.317 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-16T05:07:16.358 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-16T05:07:16.736 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-16T05:07:16.736 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-16T05:07:16.736 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-16T05:07:16.736 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-16T05:07:16.736 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-16T05:07:16.736 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-16T05:07:16.736 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-16T05:07:16.736 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-16T05:07:16.736 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-16T05:07:16.736 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-16T05:07:16.736 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-16T05:07:16.737 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-16T05:07:16.737 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-16T05:07:16.782 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-16T05:07:16.782 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-16T05:07:16.783 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-16T05:07:16.783 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-16T05:07:16.783 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-16T05:07:16.783 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-16T05:07:16.783 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-16T05:07:16.783 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-16T05:07:16.783 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-16T05:07:16.783 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-16T05:07:16.783 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-16T05:07:16.783 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-16T05:07:16.783 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-16T05:07:17.540 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-16T05:07:17.540 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:07:17.541 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-12-16T05:07:17.541 INFO:teuthology.orchestra.run.smithi155.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T05:07:17.541 INFO:teuthology.orchestra.run.smithi155.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T05:07:17.541 INFO:teuthology.orchestra.run.smithi155.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-16T05:07:17.541 INFO:teuthology.orchestra.run.smithi155.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-16T05:07:17.541 INFO:teuthology.orchestra.run.smithi155.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T05:07:17.541 INFO:teuthology.orchestra.run.smithi155.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-16T05:07:17.541 INFO:teuthology.orchestra.run.smithi155.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-16T05:07:17.541 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-16T05:07:17.541 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-16T05:07:17.541 INFO:teuthology.orchestra.run.smithi155.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T05:07:17.541 INFO:teuthology.orchestra.run.smithi155.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-16T05:07:17.541 INFO:teuthology.orchestra.run.smithi155.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-16T05:07:17.542 INFO:teuthology.orchestra.run.smithi155.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-16T05:07:17.542 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:07:17.542 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:07:17.747 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-16T05:07:17.747 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:07:17.747 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-12-16T05:07:17.747 INFO:teuthology.orchestra.run.smithi156.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T05:07:17.747 INFO:teuthology.orchestra.run.smithi156.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T05:07:17.748 INFO:teuthology.orchestra.run.smithi156.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-16T05:07:17.748 INFO:teuthology.orchestra.run.smithi156.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-16T05:07:17.748 INFO:teuthology.orchestra.run.smithi156.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T05:07:17.748 INFO:teuthology.orchestra.run.smithi156.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-16T05:07:17.748 INFO:teuthology.orchestra.run.smithi156.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-16T05:07:17.748 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-16T05:07:17.748 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-16T05:07:17.748 INFO:teuthology.orchestra.run.smithi156.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T05:07:17.748 INFO:teuthology.orchestra.run.smithi156.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-16T05:07:17.748 INFO:teuthology.orchestra.run.smithi156.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-16T05:07:17.748 INFO:teuthology.orchestra.run.smithi156.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-16T05:07:17.748 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:07:17.748 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:07:17.840 DEBUG:teuthology.parallel:result is None 2023-12-16T05:07:18.008 DEBUG:teuthology.parallel:result is None 2023-12-16T05:07:18.008 INFO:teuthology.run_tasks:Running task install... 2023-12-16T05:07:18.018 DEBUG:teuthology.task.install:project ceph 2023-12-16T05:07:18.018 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678'}} 2023-12-16T05:07:18.018 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678'} 2023-12-16T05:07:18.018 INFO:teuthology.task.install:Using flavor: default 2023-12-16T05:07:18.024 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-16T05:07:18.024 INFO:teuthology.task.install:extra packages: [] 2023-12-16T05:07:18.024 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678', 'tag': None, 'wait_for_package': False} 2023-12-16T05:07:18.025 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T05:07:18.025 INFO:teuthology.packaging:ref: None 2023-12-16T05:07:18.025 INFO:teuthology.packaging:tag: None 2023-12-16T05:07:18.025 INFO:teuthology.packaging:branch: quincy 2023-12-16T05:07:18.025 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T05:07:18.025 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-16T05:07:18.027 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678', 'tag': None, 'wait_for_package': False} 2023-12-16T05:07:18.027 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T05:07:18.027 INFO:teuthology.packaging:ref: None 2023-12-16T05:07:18.027 INFO:teuthology.packaging:tag: None 2023-12-16T05:07:18.027 INFO:teuthology.packaging:branch: quincy 2023-12-16T05:07:18.027 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T05:07:18.028 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-16T05:07:18.352 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/ 2023-12-16T05:07:18.352 INFO:teuthology.task.install.rpm:Package version is 17.2.7-125.g1f2f5510 2023-12-16T05:07:18.366 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/ 2023-12-16T05:07:18.366 INFO:teuthology.task.install.rpm:Package version is 17.2.7-125.g1f2f5510 2023-12-16T05:07:18.532 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-16T05:07:18.532 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-16T05:07:18.532 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-16T05:07:18.536 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-16T05:07:18.536 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-12-16T05:07:18.537 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-16T05:07:18.561 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-16T05:07:18.561 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T05:07:18.561 INFO:teuthology.packaging:ref: None 2023-12-16T05:07:18.561 INFO:teuthology.packaging:tag: None 2023-12-16T05:07:18.561 INFO:teuthology.packaging:branch: quincy 2023-12-16T05:07:18.562 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T05:07:18.562 DEBUG:teuthology.orchestra.run.smithi155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-16T05:07:18.566 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-16T05:07:18.566 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T05:07:18.567 INFO:teuthology.packaging:ref: None 2023-12-16T05:07:18.567 INFO:teuthology.packaging:tag: None 2023-12-16T05:07:18.567 INFO:teuthology.packaging:branch: quincy 2023-12-16T05:07:18.567 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T05:07:18.567 DEBUG:teuthology.orchestra.run.smithi156:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-16T05:07:18.629 DEBUG:teuthology.orchestra.run.smithi155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-16T05:07:18.634 DEBUG:teuthology.orchestra.run.smithi156:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-16T05:07:18.706 DEBUG:teuthology.orchestra.run.smithi155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-16T05:07:18.710 DEBUG:teuthology.orchestra.run.smithi156:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-16T05:07:18.772 INFO:teuthology.orchestra.run.smithi155.stdout:check_obsoletes = 1 2023-12-16T05:07:18.774 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum clean all 2023-12-16T05:07:18.777 INFO:teuthology.orchestra.run.smithi156.stdout:check_obsoletes = 1 2023-12-16T05:07:18.778 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum clean all 2023-12-16T05:07:19.041 INFO:teuthology.orchestra.run.smithi155.stdout:76 files removed 2023-12-16T05:07:19.065 INFO:teuthology.orchestra.run.smithi156.stdout:76 files removed 2023-12-16T05:07:19.069 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-radosgw 2023-12-16T05:07:19.093 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-radosgw 2023-12-16T05:07:19.801 INFO:teuthology.orchestra.run.smithi156.stdout:ceph packages for x86_64 260 kB/s | 78 kB 00:00 2023-12-16T05:07:19.878 INFO:teuthology.orchestra.run.smithi155.stdout:ceph packages for x86_64 194 kB/s | 78 kB 00:00 2023-12-16T05:07:20.160 INFO:teuthology.orchestra.run.smithi156.stdout:ceph noarch packages 29 kB/s | 9.1 kB 00:00 2023-12-16T05:07:20.354 INFO:teuthology.orchestra.run.smithi155.stdout:ceph noarch packages 21 kB/s | 9.1 kB 00:00 2023-12-16T05:07:20.494 INFO:teuthology.orchestra.run.smithi156.stdout:ceph source packages 4.8 kB/s | 1.5 kB 00:00 2023-12-16T05:07:20.813 INFO:teuthology.orchestra.run.smithi155.stdout:ceph source packages 3.4 kB/s | 1.5 kB 00:00 2023-12-16T05:15:42.063 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - AppStream 71 kB/s | 35 MB 08:21 2023-12-16T05:15:46.223 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - AppStream 70 kB/s | 35 MB 08:25 2023-12-16T05:15:49.721 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - BaseOS 40 MB/s | 56 MB 00:01 2023-12-16T05:15:55.198 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - BaseOS 21 MB/s | 56 MB 00:02 2023-12-16T05:15:58.429 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - Extras 24 kB/s | 18 kB 00:00 2023-12-16T05:15:58.896 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - Extras common packages 24 kB/s | 6.9 kB 00:00 2023-12-16T05:15:59.956 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - PowerTools 7.3 MB/s | 6.6 MB 00:00 2023-12-16T05:16:01.390 INFO:teuthology.orchestra.run.smithi155.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-12-16T05:16:02.216 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 24 MB/s | 16 MB 00:00 2023-12-16T05:16:03.840 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - Extras 31 kB/s | 18 kB 00:00 2023-12-16T05:16:04.474 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - Extras common packages 15 kB/s | 6.9 kB 00:00 2023-12-16T05:16:05.667 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - PowerTools 6.4 MB/s | 6.6 MB 00:01 2023-12-16T05:16:06.066 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 479 kB/s | 24 kB 00:00 2023-12-16T05:16:07.118 INFO:teuthology.orchestra.run.smithi156.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-12-16T05:16:09.344 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 7.7 MB/s | 16 MB 00:02 2023-12-16T05:16:10.627 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:16:10.629 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:16:10.630 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-12-16T05:16:10.630 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:16:10.630 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-12-16T05:16:10.630 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 17 M 2023-12-16T05:16:10.630 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrading: 2023-12-16T05:16:10.630 INFO:teuthology.orchestra.run.smithi155.stdout: librados2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.5 M 2023-12-16T05:16:10.631 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.6 M 2023-12-16T05:16:10.631 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-12-16T05:16:10.631 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 5.2 M 2023-12-16T05:16:10.631 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 23 M 2023-12-16T05:16:10.631 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 24 k 2023-12-16T05:16:10.631 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-16T05:16:10.631 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 796 k 2023-12-16T05:16:10.631 INFO:teuthology.orchestra.run.smithi155.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-16T05:16:10.632 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-16T05:16:10.632 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 509 k 2023-12-16T05:16:10.632 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2023-12-16T05:16:10.632 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 5.6 M 2023-12-16T05:16:10.632 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-16T05:16:10.632 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-16T05:16:10.632 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 45 k 2023-12-16T05:16:10.632 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 115 k 2023-12-16T05:16:10.632 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 190 k 2023-12-16T05:16:10.633 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-16T05:16:10.633 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 371 k 2023-12-16T05:16:10.633 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 359 k 2023-12-16T05:16:10.633 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 106 k 2023-12-16T05:16:10.633 INFO:teuthology.orchestra.run.smithi155.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-16T05:16:10.633 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:16:10.633 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-12-16T05:16:10.633 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:16:10.633 INFO:teuthology.orchestra.run.smithi155.stdout:Install 21 Packages 2023-12-16T05:16:10.634 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrade 2 Packages 2023-12-16T05:16:10.634 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:16:10.635 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 64 M 2023-12-16T05:16:10.635 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-12-16T05:16:11.859 INFO:teuthology.orchestra.run.smithi155.stdout:(1/23): ceph-base-17.2.7-125.g1f2f5510.el8.x86_ 10 MB/s | 5.2 MB 00:00 2023-12-16T05:16:11.901 INFO:teuthology.orchestra.run.smithi155.stdout:(2/23): ceph-selinux-17.2.7-125.g1f2f5510.el8.x 586 kB/s | 24 kB 00:00 2023-12-16T05:16:12.002 INFO:teuthology.orchestra.run.smithi155.stdout:(3/23): libcephfs2-17.2.7-125.g1f2f5510.el8.x86 7.8 MB/s | 796 kB 00:00 2023-12-16T05:16:12.102 INFO:teuthology.orchestra.run.smithi155.stdout:(4/23): libradosstriper1-17.2.7-125.g1f2f5510.e 5.0 MB/s | 509 kB 00:00 2023-12-16T05:16:12.610 INFO:teuthology.orchestra.run.smithi155.stdout:(5/23): librgw2-17.2.7-125.g1f2f5510.el8.x86_64 11 MB/s | 5.6 MB 00:00 2023-12-16T05:16:12.686 INFO:teuthology.orchestra.run.smithi155.stdout:(6/23): python3-ceph-argparse-17.2.7-125.g1f2f5 597 kB/s | 45 kB 00:00 2023-12-16T05:16:12.786 INFO:teuthology.orchestra.run.smithi155.stdout:(7/23): python3-ceph-common-17.2.7-125.g1f2f551 1.1 MB/s | 115 kB 00:00 2023-12-16T05:16:12.878 INFO:teuthology.orchestra.run.smithi155.stdout:(8/23): python3-cephfs-17.2.7-125.g1f2f5510.el8 2.0 MB/s | 190 kB 00:00 2023-12-16T05:16:12.979 INFO:teuthology.orchestra.run.smithi155.stdout:(9/23): python3-rados-17.2.7-125.g1f2f5510.el8. 3.6 MB/s | 371 kB 00:00 2023-12-16T05:16:13.071 INFO:teuthology.orchestra.run.smithi155.stdout:(10/23): python3-rbd-17.2.7-125.g1f2f5510.el8.x 3.8 MB/s | 359 kB 00:00 2023-12-16T05:16:13.163 INFO:teuthology.orchestra.run.smithi155.stdout:(11/23): python3-rgw-17.2.7-125.g1f2f5510.el8.x 1.1 MB/s | 106 kB 00:00 2023-12-16T05:16:13.252 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 472 kB/s | 24 kB 00:00 2023-12-16T05:16:13.546 INFO:teuthology.orchestra.run.smithi155.stdout:(12/23): ceph-radosgw-17.2.7-125.g1f2f5510.el8. 7.6 MB/s | 17 MB 00:02 2023-12-16T05:16:13.772 INFO:teuthology.orchestra.run.smithi155.stdout:(13/23): ceph-common-17.2.7-125.g1f2f5510.el8.x 9.7 MB/s | 23 MB 00:02 2023-12-16T05:16:17.854 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:16:17.857 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:16:17.857 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-12-16T05:16:17.857 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:16:17.857 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-12-16T05:16:17.857 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 17 M 2023-12-16T05:16:17.857 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrading: 2023-12-16T05:16:17.857 INFO:teuthology.orchestra.run.smithi156.stdout: librados2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.5 M 2023-12-16T05:16:17.857 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.6 M 2023-12-16T05:16:17.858 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-12-16T05:16:17.858 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 5.2 M 2023-12-16T05:16:17.858 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 23 M 2023-12-16T05:16:17.858 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 24 k 2023-12-16T05:16:17.858 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-16T05:16:17.858 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 796 k 2023-12-16T05:16:17.858 INFO:teuthology.orchestra.run.smithi156.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-16T05:16:17.858 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-16T05:16:17.858 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 509 k 2023-12-16T05:16:17.858 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2023-12-16T05:16:17.858 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 5.6 M 2023-12-16T05:16:17.858 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-16T05:16:17.858 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-16T05:16:17.858 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 45 k 2023-12-16T05:16:17.859 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 115 k 2023-12-16T05:16:17.859 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 190 k 2023-12-16T05:16:17.859 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-16T05:16:17.859 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 371 k 2023-12-16T05:16:17.859 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 359 k 2023-12-16T05:16:17.859 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 106 k 2023-12-16T05:16:17.859 INFO:teuthology.orchestra.run.smithi156.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-16T05:16:17.859 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:16:17.859 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-12-16T05:16:17.859 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:16:17.859 INFO:teuthology.orchestra.run.smithi156.stdout:Install 21 Packages 2023-12-16T05:16:17.859 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrade 2 Packages 2023-12-16T05:16:17.859 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:16:17.860 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 64 M 2023-12-16T05:16:17.860 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-12-16T05:16:19.137 INFO:teuthology.orchestra.run.smithi156.stdout:(1/23): ceph-base-17.2.7-125.g1f2f5510.el8.x86_ 4.8 MB/s | 5.2 MB 00:01 2023-12-16T05:16:19.237 INFO:teuthology.orchestra.run.smithi156.stdout:(2/23): ceph-selinux-17.2.7-125.g1f2f5510.el8.x 243 kB/s | 24 kB 00:00 2023-12-16T05:16:19.637 INFO:teuthology.orchestra.run.smithi156.stdout:(3/23): ceph-common-17.2.7-125.g1f2f5510.el8.x8 15 MB/s | 23 MB 00:01 2023-12-16T05:16:19.713 INFO:teuthology.orchestra.run.smithi156.stdout:(4/23): libcephfs2-17.2.7-125.g1f2f5510.el8.x86 1.6 MB/s | 796 kB 00:00 2023-12-16T05:16:19.755 INFO:teuthology.orchestra.run.smithi156.stdout:(5/23): libradosstriper1-17.2.7-125.g1f2f5510.e 4.3 MB/s | 509 kB 00:00 2023-12-16T05:16:19.813 INFO:teuthology.orchestra.run.smithi156.stdout:(6/23): python3-ceph-argparse-17.2.7-125.g1f2f5 770 kB/s | 45 kB 00:00 2023-12-16T05:16:19.864 INFO:teuthology.orchestra.run.smithi156.stdout:(7/23): python3-ceph-common-17.2.7-125.g1f2f551 2.3 MB/s | 115 kB 00:00 2023-12-16T05:16:19.932 INFO:teuthology.orchestra.run.smithi156.stdout:(8/23): python3-cephfs-17.2.7-125.g1f2f5510.el8 2.8 MB/s | 190 kB 00:00 2023-12-16T05:16:19.998 INFO:teuthology.orchestra.run.smithi156.stdout:(9/23): python3-rados-17.2.7-125.g1f2f5510.el8. 5.4 MB/s | 371 kB 00:00 2023-12-16T05:16:20.073 INFO:teuthology.orchestra.run.smithi156.stdout:(10/23): python3-rbd-17.2.7-125.g1f2f5510.el8.x 4.7 MB/s | 359 kB 00:00 2023-12-16T05:16:20.140 INFO:teuthology.orchestra.run.smithi156.stdout:(11/23): python3-rgw-17.2.7-125.g1f2f5510.el8.x 1.6 MB/s | 106 kB 00:00 2023-12-16T05:16:20.432 INFO:teuthology.orchestra.run.smithi156.stdout:(12/23): librgw2-17.2.7-125.g1f2f5510.el8.x86_6 7.7 MB/s | 5.6 MB 00:00 2023-12-16T05:16:20.991 INFO:teuthology.orchestra.run.smithi156.stdout:(13/23): ceph-radosgw-17.2.7-125.g1f2f5510.el8. 5.7 MB/s | 17 MB 00:02 2023-12-16T05:20:22.948 INFO:teuthology.orchestra.run.smithi155.stdout:[MIRROR] librdkafka-1.6.1-1.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/librdkafka-1.6.1-1.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:20:22.948 INFO:teuthology.orchestra.run.smithi155.stdout:[MIRROR] lttng-ust-2.8.1-11.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/lttng-ust-2.8.1-11.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:20:22.949 INFO:teuthology.orchestra.run.smithi155.stdout:[MIRROR] python3-prettytable-0.7.2-14.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-prettytable-0.7.2-14.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:20:23.238 INFO:teuthology.orchestra.run.smithi155.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 180 B/s | 44 kB 04:09 2023-12-16T05:20:23.355 INFO:teuthology.orchestra.run.smithi155.stdout:(15/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.0 kB/s | 259 kB 04:09 2023-12-16T05:20:23.380 INFO:teuthology.orchestra.run.smithi155.stdout:(16/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 331 kB/s | 47 kB 00:00 2023-12-16T05:20:23.430 INFO:teuthology.orchestra.run.smithi155.stdout:(17/23): librdkafka-1.6.1-1.el8.x86_64.rpm 2.7 kB/s | 677 kB 04:10 2023-12-16T05:20:23.530 INFO:teuthology.orchestra.run.smithi155.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 391 kB/s | 59 kB 00:00 2023-12-16T05:20:23.594 INFO:teuthology.orchestra.run.smithi155.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 460 kB/s | 75 kB 00:00 2023-12-16T05:20:23.631 INFO:teuthology.orchestra.run.smithi155.stdout:(20/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-12-16T05:20:23.798 INFO:teuthology.orchestra.run.smithi155.stdout:(21/23): thrift-0.13.0-2.el8.x86_64.rpm 6.5 MB/s | 1.7 MB 00:00 2023-12-16T05:20:24.174 INFO:teuthology.orchestra.run.smithi155.stdout:(22/23): librados2-17.2.7-125.g1f2f5510.el8.x86 6.0 MB/s | 3.5 MB 00:00 2023-12-16T05:20:24.257 INFO:teuthology.orchestra.run.smithi155.stdout:(23/23): librbd1-17.2.7-125.g1f2f5510.el8.x86_6 5.7 MB/s | 3.6 MB 00:00 2023-12-16T05:20:24.259 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:20:24.260 INFO:teuthology.orchestra.run.smithi155.stdout:Total 257 kB/s | 64 MB 04:13 2023-12-16T05:20:24.301 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-12-16T05:20:24.348 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-12-16T05:20:24.348 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-12-16T05:20:24.722 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-12-16T05:20:24.725 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-12-16T05:20:25.776 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-12-16T05:20:25.993 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-16T05:20:26.162 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-16T05:20:26.539 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-16T05:20:26.755 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-16T05:20:26.849 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-16T05:20:27.083 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 4/25 2023-12-16T05:20:27.197 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] librdkafka-1.6.1-1.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/librdkafka-1.6.1-1.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:20:27.197 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] lttng-ust-2.8.1-11.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/lttng-ust-2.8.1-11.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:20:27.197 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] python3-prettytable-0.7.2-14.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-prettytable-0.7.2-14.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:20:27.321 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-16T05:20:27.481 INFO:teuthology.orchestra.run.smithi156.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 182 B/s | 44 kB 04:06 2023-12-16T05:20:27.623 INFO:teuthology.orchestra.run.smithi156.stdout:(15/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.0 kB/s | 259 kB 04:07 2023-12-16T05:20:27.648 INFO:teuthology.orchestra.run.smithi156.stdout:(16/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 281 kB/s | 47 kB 00:00 2023-12-16T05:20:27.682 INFO:teuthology.orchestra.run.smithi156.stdout:(17/23): librdkafka-1.6.1-1.el8.x86_64.rpm 2.7 kB/s | 677 kB 04:07 2023-12-16T05:20:27.702 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-16T05:20:27.912 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-16T05:20:28.015 INFO:teuthology.orchestra.run.smithi156.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 160 kB/s | 59 kB 00:00 2023-12-16T05:20:28.032 INFO:teuthology.orchestra.run.smithi156.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 214 kB/s | 75 kB 00:00 2023-12-16T05:20:28.184 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-16T05:20:28.191 INFO:teuthology.orchestra.run.smithi156.stdout:(20/23): gperftools-libs-2.7-9.el8.x86_64.rpm 539 kB/s | 306 kB 00:00 2023-12-16T05:20:28.359 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-16T05:20:28.408 INFO:teuthology.orchestra.run.smithi156.stdout:(21/23): librados2-17.2.7-125.g1f2f5510.el8.x86 9.2 MB/s | 3.5 MB 00:00 2023-12-16T05:20:28.533 INFO:teuthology.orchestra.run.smithi156.stdout:(22/23): thrift-0.13.0-2.el8.x86_64.rpm 3.4 MB/s | 1.7 MB 00:00 2023-12-16T05:20:28.555 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-16T05:20:29.008 INFO:teuthology.orchestra.run.smithi156.stdout:(23/23): librbd1-17.2.7-125.g1f2f5510.el8.x86_6 4.4 MB/s | 3.6 MB 00:00 2023-12-16T05:20:29.011 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:20:29.011 INFO:teuthology.orchestra.run.smithi156.stdout:Total 260 kB/s | 64 MB 04:11 2023-12-16T05:20:29.053 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-12-16T05:20:29.099 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-12-16T05:20:29.100 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-12-16T05:20:29.185 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/25 2023-12-16T05:20:29.337 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-16T05:20:29.401 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-16T05:20:29.478 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-12-16T05:20:29.481 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-12-16T05:20:29.565 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x 11/25 2023-12-16T05:20:29.735 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 12/25 2023-12-16T05:20:29.938 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 13/25 2023-12-16T05:20:30.150 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 14/25 2023-12-16T05:20:30.337 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 15/25 2023-12-16T05:20:30.415 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 15/25 2023-12-16T05:20:30.578 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-12-16T05:20:30.629 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-16T05:20:30.777 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-16T05:20:30.820 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-16T05:20:30.964 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-16T05:20:30.996 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-16T05:20:31.229 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86 19/25 2023-12-16T05:20:31.349 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-16T05:20:31.589 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-16T05:20:31.684 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-16T05:20:31.952 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 4/25 2023-12-16T05:20:32.227 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-16T05:20:32.620 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-16T05:20:32.789 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-16T05:20:33.008 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-16T05:20:33.185 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-16T05:20:33.431 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-16T05:20:33.882 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-16T05:20:34.096 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/25 2023-12-16T05:20:34.112 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-16T05:20:34.272 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-16T05:20:34.336 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-16T05:20:34.533 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x 11/25 2023-12-16T05:20:34.695 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 12/25 2023-12-16T05:20:34.705 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-16T05:20:34.924 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 13/25 2023-12-16T05:20:34.954 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 21/25 2023-12-16T05:20:35.047 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 21/25 2023-12-16T05:20:35.126 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 14/25 2023-12-16T05:20:35.287 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-16T05:20:35.305 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 15/25 2023-12-16T05:20:35.383 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 15/25 2023-12-16T05:20:35.631 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-16T05:20:35.805 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-16T05:20:36.039 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-16T05:20:36.298 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86 19/25 2023-12-16T05:20:39.045 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-16T05:20:39.313 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-16T05:20:39.894 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-16T05:20:40.157 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 21/25 2023-12-16T05:20:40.300 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 21/25 2023-12-16T05:20:40.496 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-16T05:20:53.724 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-16T05:20:53.724 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /sys 2023-12-16T05:20:53.724 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /proc 2023-12-16T05:20:53.724 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /dev 2023-12-16T05:20:53.724 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /run 2023-12-16T05:20:53.724 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /mnt 2023-12-16T05:20:53.724 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /var/tmp 2023-12-16T05:20:53.724 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /home 2023-12-16T05:20:53.724 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /tmp 2023-12-16T05:20:53.724 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /dev 2023-12-16T05:20:53.725 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:20:55.476 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 23/25 2023-12-16T05:20:55.549 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 23/25 2023-12-16T05:20:55.549 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-16T05:20:55.769 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-16T05:20:55.769 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-16T05:20:56.495 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-16T05:20:56.495 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 1/25 2023-12-16T05:20:56.496 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2/25 2023-12-16T05:20:56.496 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-16T05:20:56.496 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 4/25 2023-12-16T05:20:56.496 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-16T05:20:56.496 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-16T05:20:56.496 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 7/25 2023-12-16T05:20:56.496 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x 8/25 2023-12-16T05:20:56.496 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86 9/25 2023-12-16T05:20:56.496 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-16T05:20:56.496 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 11/25 2023-12-16T05:20:56.496 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 12/25 2023-12-16T05:20:56.496 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 13/25 2023-12-16T05:20:56.497 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2023-12-16T05:20:56.497 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-16T05:20:56.497 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-16T05:20:56.497 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-16T05:20:56.497 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-16T05:20:56.497 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-16T05:20:56.497 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-16T05:20:56.497 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-16T05:20:56.497 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-16T05:20:56.497 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-16T05:20:56.497 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 24/25 2023-12-16T05:20:57.715 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-16T05:20:57.715 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:20:57.715 INFO:teuthology.orchestra.run.smithi155.stdout:Upgraded: 2023-12-16T05:20:57.716 INFO:teuthology.orchestra.run.smithi155.stdout: librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:20:57.716 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:20:57.716 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-12-16T05:20:57.716 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:20:57.716 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:20:57.716 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:20:57.716 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:20:57.716 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-16T05:20:57.716 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:20:57.716 INFO:teuthology.orchestra.run.smithi155.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-16T05:20:57.717 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-16T05:20:57.717 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:20:57.717 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka-1.6.1-1.el8.x86_64 2023-12-16T05:20:57.717 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:20:57.717 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-16T05:20:57.717 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-16T05:20:57.717 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:20:57.717 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:20:57.717 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:20:57.717 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-16T05:20:57.717 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:20:57.717 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:20:57.718 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:20:57.718 INFO:teuthology.orchestra.run.smithi155.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-16T05:20:57.718 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:20:57.718 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:20:57.930 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-test 2023-12-16T05:20:58.782 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:04:52 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:20:59.073 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-16T05:20:59.073 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /sys 2023-12-16T05:20:59.073 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /proc 2023-12-16T05:20:59.073 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /dev 2023-12-16T05:20:59.073 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /run 2023-12-16T05:20:59.073 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /mnt 2023-12-16T05:20:59.073 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /var/tmp 2023-12-16T05:20:59.073 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /home 2023-12-16T05:20:59.073 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /tmp 2023-12-16T05:20:59.073 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /dev 2023-12-16T05:20:59.074 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:21:00.473 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:21:00.474 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:21:00.475 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-12-16T05:21:00.475 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:21:00.475 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-12-16T05:21:00.475 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 52 M 2023-12-16T05:21:00.475 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-12-16T05:21:00.475 INFO:teuthology.orchestra.run.smithi155.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-16T05:21:00.475 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 174 k 2023-12-16T05:21:00.475 INFO:teuthology.orchestra.run.smithi155.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-16T05:21:00.475 INFO:teuthology.orchestra.run.smithi155.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-16T05:21:00.475 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-16T05:21:00.475 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:21:00.475 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-12-16T05:21:00.475 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:21:00.475 INFO:teuthology.orchestra.run.smithi155.stdout:Install 6 Packages 2023-12-16T05:21:00.476 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:21:00.476 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 53 M 2023-12-16T05:21:00.476 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 234 M 2023-12-16T05:21:00.476 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-12-16T05:21:00.708 INFO:teuthology.orchestra.run.smithi155.stdout:(1/6): libcephsqlite-17.2.7-125.g1f2f5510.el8.x 900 kB/s | 174 kB 00:00 2023-12-16T05:21:00.812 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 23/25 2023-12-16T05:21:00.891 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 23/25 2023-12-16T05:21:00.891 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-16T05:21:01.137 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-16T05:21:01.137 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-16T05:21:01.835 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-16T05:21:01.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 1/25 2023-12-16T05:21:01.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2/25 2023-12-16T05:21:01.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-16T05:21:01.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 4/25 2023-12-16T05:21:01.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-16T05:21:01.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-16T05:21:01.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 7/25 2023-12-16T05:21:01.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x 8/25 2023-12-16T05:21:01.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86 9/25 2023-12-16T05:21:01.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-16T05:21:01.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 11/25 2023-12-16T05:21:01.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 12/25 2023-12-16T05:21:01.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 13/25 2023-12-16T05:21:01.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2023-12-16T05:21:01.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-16T05:21:01.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-16T05:21:01.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-16T05:21:01.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-16T05:21:01.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-16T05:21:01.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-16T05:21:01.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-16T05:21:01.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-16T05:21:01.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-16T05:21:01.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 24/25 2023-12-16T05:21:03.021 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-16T05:21:03.022 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:21:03.022 INFO:teuthology.orchestra.run.smithi156.stdout:Upgraded: 2023-12-16T05:21:03.022 INFO:teuthology.orchestra.run.smithi156.stdout: librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:21:03.022 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:21:03.022 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-12-16T05:21:03.022 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:21:03.022 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:21:03.022 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:21:03.022 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:21:03.022 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-16T05:21:03.022 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:21:03.023 INFO:teuthology.orchestra.run.smithi156.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-16T05:21:03.023 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-16T05:21:03.023 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:21:03.023 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka-1.6.1-1.el8.x86_64 2023-12-16T05:21:03.023 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:21:03.023 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-16T05:21:03.023 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-16T05:21:03.023 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:21:03.023 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:21:03.023 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:21:03.023 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-16T05:21:03.023 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:21:03.023 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:21:03.023 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:21:03.023 INFO:teuthology.orchestra.run.smithi156.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-16T05:21:03.024 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:21:03.024 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:21:03.300 INFO:teuthology.orchestra.run.smithi155.stdout:(2/6): ceph-test-17.2.7-125.g1f2f5510.el8.x86_6 19 MB/s | 52 MB 00:02 2023-12-16T05:21:03.352 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-test 2023-12-16T05:21:04.199 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:04:51 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:21:05.893 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:21:05.894 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:21:05.894 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-12-16T05:21:05.894 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:21:05.894 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-12-16T05:21:05.894 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 52 M 2023-12-16T05:21:05.895 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-12-16T05:21:05.895 INFO:teuthology.orchestra.run.smithi156.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-16T05:21:05.895 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 174 k 2023-12-16T05:21:05.895 INFO:teuthology.orchestra.run.smithi156.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-16T05:21:05.895 INFO:teuthology.orchestra.run.smithi156.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-16T05:21:05.895 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-16T05:21:05.895 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:21:05.895 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-12-16T05:21:05.895 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:21:05.895 INFO:teuthology.orchestra.run.smithi156.stdout:Install 6 Packages 2023-12-16T05:21:05.895 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:21:05.896 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 53 M 2023-12-16T05:21:05.896 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 234 M 2023-12-16T05:21:05.896 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-12-16T05:21:06.164 INFO:teuthology.orchestra.run.smithi156.stdout:(1/6): libcephsqlite-17.2.7-125.g1f2f5510.el8.x 760 kB/s | 174 kB 00:00 2023-12-16T05:21:08.783 INFO:teuthology.orchestra.run.smithi156.stdout:(2/6): ceph-test-17.2.7-125.g1f2f5510.el8.x86_6 18 MB/s | 52 MB 00:02 2023-12-16T05:25:09.669 INFO:teuthology.orchestra.run.smithi155.stdout:[MIRROR] jq-1.6-8.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/jq-1.6-8.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:25:09.669 INFO:teuthology.orchestra.run.smithi155.stdout:[MIRROR] socat-1.7.4.1-1.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/socat-1.7.4.1-1.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:25:09.670 INFO:teuthology.orchestra.run.smithi155.stdout:[MIRROR] oniguruma-6.8.2-2.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/oniguruma-6.8.2-2.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:25:10.049 INFO:teuthology.orchestra.run.smithi155.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 769 B/s | 187 kB 04:09 2023-12-16T05:25:10.075 INFO:teuthology.orchestra.run.smithi155.stdout:(4/6): jq-1.6-8.el8.x86_64.rpm 833 B/s | 203 kB 04:09 2023-12-16T05:25:10.125 INFO:teuthology.orchestra.run.smithi155.stdout:(5/6): socat-1.7.4.1-1.el8.x86_64.rpm 1.3 kB/s | 323 kB 04:06 2023-12-16T05:25:10.150 INFO:teuthology.orchestra.run.smithi155.stdout:(6/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 703 kB/s | 71 kB 00:00 2023-12-16T05:25:10.150 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:25:10.150 INFO:teuthology.orchestra.run.smithi155.stdout:Total 216 kB/s | 53 MB 04:09 2023-12-16T05:25:10.191 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-12-16T05:25:10.212 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-12-16T05:25:10.212 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-12-16T05:25:10.496 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-12-16T05:25:10.499 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-12-16T05:25:10.979 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-12-16T05:25:11.229 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-16T05:25:11.430 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-16T05:25:11.561 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-16T05:25:11.647 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-16T05:25:11.868 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-16T05:25:12.020 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 5/6 2023-12-16T05:25:14.014 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] jq-1.6-8.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/jq-1.6-8.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:25:14.014 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] oniguruma-6.8.2-2.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/oniguruma-6.8.2-2.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:25:14.432 INFO:teuthology.orchestra.run.smithi156.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 773 B/s | 187 kB 04:08 2023-12-16T05:25:14.457 INFO:teuthology.orchestra.run.smithi156.stdout:(4/6): jq-1.6-8.el8.x86_64.rpm 836 B/s | 203 kB 04:08 2023-12-16T05:25:16.998 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 5/6 2023-12-16T05:25:17.226 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 6/6 2023-12-16T05:25:17.520 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 6/6 2023-12-16T05:25:17.521 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 1/6 2023-12-16T05:25:17.521 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 2/6 2023-12-16T05:25:17.521 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-16T05:25:17.521 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-16T05:25:17.521 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-16T05:25:18.015 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] socat-1.7.4.1-1.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/socat-1.7.4.1-1.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:25:18.247 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-16T05:25:18.247 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:25:18.247 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-12-16T05:25:18.248 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:25:18.248 INFO:teuthology.orchestra.run.smithi155.stdout: jq-1.6-8.el8.x86_64 2023-12-16T05:25:18.248 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:25:18.248 INFO:teuthology.orchestra.run.smithi155.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-16T05:25:18.248 INFO:teuthology.orchestra.run.smithi155.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-16T05:25:18.248 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-16T05:25:18.248 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:25:18.248 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:25:18.423 INFO:teuthology.orchestra.run.smithi156.stdout:(5/6): socat-1.7.4.1-1.el8.x86_64.rpm 1.3 kB/s | 323 kB 04:09 2023-12-16T05:25:18.455 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph 2023-12-16T05:25:19.303 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:09:13 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:25:20.991 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:25:20.994 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:25:20.995 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-12-16T05:25:20.995 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:25:20.995 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-12-16T05:25:20.995 INFO:teuthology.orchestra.run.smithi155.stdout: ceph x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 6.4 k 2023-12-16T05:25:20.995 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-12-16T05:25:20.995 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 2.3 M 2023-12-16T05:25:20.995 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 1.6 M 2023-12-16T05:25:20.995 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 238 k 2023-12-16T05:25:20.995 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.9 M 2023-12-16T05:25:20.995 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 17 M 2023-12-16T05:25:20.995 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-16T05:25:20.995 INFO:teuthology.orchestra.run.smithi155.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-16T05:25:20.995 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-16T05:25:20.995 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-16T05:25:20.996 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-16T05:25:20.996 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-16T05:25:20.996 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-16T05:25:20.996 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-16T05:25:20.996 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-16T05:25:20.996 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-16T05:25:20.996 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-16T05:25:20.996 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-16T05:25:20.996 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-16T05:25:20.996 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-16T05:25:20.996 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-16T05:25:20.996 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-16T05:25:20.996 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-16T05:25:20.996 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-16T05:25:20.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-16T05:25:20.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-16T05:25:20.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-16T05:25:20.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-16T05:25:20.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-16T05:25:20.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-16T05:25:20.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-16T05:25:20.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-16T05:25:20.997 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:25:20.997 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-12-16T05:25:20.997 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:25:20.997 INFO:teuthology.orchestra.run.smithi155.stdout:Install 32 Packages 2023-12-16T05:25:20.997 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:25:20.998 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 28 M 2023-12-16T05:25:20.998 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 110 M 2023-12-16T05:25:20.998 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-12-16T05:25:21.495 INFO:teuthology.orchestra.run.smithi155.stdout:(1/32): ceph-17.2.7-125.g1f2f5510.el8.x86_64.rp 53 kB/s | 6.4 kB 00:00 2023-12-16T05:25:21.703 INFO:teuthology.orchestra.run.smithi155.stdout:(2/32): ceph-mds-17.2.7-125.g1f2f5510.el8.x86_6 7.0 MB/s | 2.3 MB 00:00 2023-12-16T05:25:22.196 INFO:teuthology.orchestra.run.smithi155.stdout:(3/32): ceph-mgr-17.2.7-125.g1f2f5510.el8.x86_6 1.9 MB/s | 1.6 MB 00:00 2023-12-16T05:25:22.313 INFO:teuthology.orchestra.run.smithi155.stdout:(4/32): ceph-mgr-modules-core-17.2.7-125.g1f2f5 2.0 MB/s | 238 kB 00:00 2023-12-16T05:25:22.405 INFO:teuthology.orchestra.run.smithi155.stdout:(5/32): ceph-mon-17.2.7-125.g1f2f5510.el8.x86_6 4.3 MB/s | 3.9 MB 00:00 2023-12-16T05:25:22.613 INFO:teuthology.orchestra.run.smithi155.stdout:(6/32): ceph-osd-17.2.7-125.g1f2f5510.el8.x86_6 18 MB/s | 17 MB 00:00 2023-12-16T05:29:23.844 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] xmlstarlet-1.6.1-20.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/xmlstarlet-1.6.1-20.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:29:24.201 INFO:teuthology.orchestra.run.smithi156.stdout:(6/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 289 B/s | 71 kB 04:09 2023-12-16T05:29:24.202 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:29:24.202 INFO:teuthology.orchestra.run.smithi156.stdout:Total 108 kB/s | 53 MB 08:18 2023-12-16T05:29:24.241 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-12-16T05:29:24.262 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-12-16T05:29:24.262 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-12-16T05:29:24.546 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-12-16T05:29:24.549 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-12-16T05:29:25.012 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-12-16T05:29:25.239 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-16T05:29:25.432 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-16T05:29:25.554 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-16T05:29:25.631 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-16T05:29:25.819 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-16T05:29:25.996 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 5/6 2023-12-16T05:29:31.032 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 5/6 2023-12-16T05:29:31.261 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 6/6 2023-12-16T05:29:31.549 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 6/6 2023-12-16T05:29:31.550 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 1/6 2023-12-16T05:29:31.550 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 2/6 2023-12-16T05:29:31.550 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-16T05:29:31.550 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-16T05:29:31.550 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-16T05:29:31.813 INFO:teuthology.orchestra.run.smithi155.stdout:[MIRROR] python3-mako-1.0.6-14.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-mako-1.0.6-14.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:29:31.813 INFO:teuthology.orchestra.run.smithi155.stdout:[MIRROR] python3-markupsafe-0.23-19.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-markupsafe-0.23-19.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:29:31.814 INFO:teuthology.orchestra.run.smithi155.stdout:[MIRROR] python3-pyOpenSSL-19.0.0-1.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-pyOpenSSL-19.0.0-1.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:29:32.039 INFO:teuthology.orchestra.run.smithi155.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 159 B/s | 39 kB 04:09 2023-12-16T05:29:32.164 INFO:teuthology.orchestra.run.smithi155.stdout:(8/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 424 B/s | 103 kB 04:09 2023-12-16T05:29:32.189 INFO:teuthology.orchestra.run.smithi155.stdout:(9/32): python3-mako-1.0.6-14.el8.noarch.rpm 643 B/s | 157 kB 04:09 2023-12-16T05:29:32.215 INFO:teuthology.orchestra.run.smithi155.stdout:(10/32): python3-pytz-2017.2-11.el8.noarch.rpm 325 kB/s | 57 kB 00:00 2023-12-16T05:29:32.273 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-16T05:29:32.273 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:29:32.273 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-12-16T05:29:32.273 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:29:32.273 INFO:teuthology.orchestra.run.smithi156.stdout: jq-1.6-8.el8.x86_64 2023-12-16T05:29:32.273 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:29:32.273 INFO:teuthology.orchestra.run.smithi156.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-16T05:29:32.273 INFO:teuthology.orchestra.run.smithi156.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-16T05:29:32.274 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-16T05:29:32.274 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:29:32.274 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:29:32.407 INFO:teuthology.orchestra.run.smithi155.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.8 MB/s | 457 kB 00:00 2023-12-16T05:29:32.432 INFO:teuthology.orchestra.run.smithi155.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.0 MB/s | 249 kB 00:00 2023-12-16T05:29:32.459 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph 2023-12-16T05:29:32.474 INFO:teuthology.orchestra.run.smithi155.stdout:(13/32): python3-cryptography-3.2.1-6.el8.x86_6 2.4 MB/s | 641 kB 00:00 2023-12-16T05:29:32.648 INFO:teuthology.orchestra.run.smithi155.stdout:(14/32): python3-pycparser-2.14-14.el8.noarch.r 454 kB/s | 109 kB 00:00 2023-12-16T05:29:32.674 INFO:teuthology.orchestra.run.smithi155.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 180 kB/s | 44 kB 00:00 2023-12-16T05:29:32.700 INFO:teuthology.orchestra.run.smithi155.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 821 kB/s | 185 kB 00:00 2023-12-16T05:29:32.758 INFO:teuthology.orchestra.run.smithi155.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 207 kB/s | 11 kB 00:00 2023-12-16T05:29:32.792 INFO:teuthology.orchestra.run.smithi155.stdout:(18/32): python3-cherrypy-18.4.0-1.el8.noarch.r 3.2 MB/s | 384 kB 00:00 2023-12-16T05:29:32.817 INFO:teuthology.orchestra.run.smithi155.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 302 kB/s | 18 kB 00:00 2023-12-16T05:29:32.851 INFO:teuthology.orchestra.run.smithi155.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 831 kB/s | 49 kB 00:00 2023-12-16T05:29:32.876 INFO:teuthology.orchestra.run.smithi155.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 1.0 MB/s | 59 kB 00:00 2023-12-16T05:29:32.902 INFO:teuthology.orchestra.run.smithi155.stdout:(22/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 679 kB/s | 173 kB 00:00 2023-12-16T05:29:32.936 INFO:teuthology.orchestra.run.smithi155.stdout:(23/32): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2023-12-16T05:29:32.961 INFO:teuthology.orchestra.run.smithi155.stdout:(24/32): python3-portend-2.6-1.el8.noarch.rpm 185 kB/s | 16 kB 00:00 2023-12-16T05:29:32.986 INFO:teuthology.orchestra.run.smithi155.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 223 kB/s | 19 kB 00:00 2023-12-16T05:29:33.012 INFO:teuthology.orchestra.run.smithi155.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 316 kB/s | 24 kB 00:00 2023-12-16T05:29:33.037 INFO:teuthology.orchestra.run.smithi155.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 386 kB/s | 29 kB 00:00 2023-12-16T05:29:33.062 INFO:teuthology.orchestra.run.smithi155.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 364 kB/s | 27 kB 00:00 2023-12-16T05:29:33.087 INFO:teuthology.orchestra.run.smithi155.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 3.3 MB/s | 255 kB 00:00 2023-12-16T05:29:33.113 INFO:teuthology.orchestra.run.smithi155.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.7 MB/s | 85 kB 00:00 2023-12-16T05:29:33.138 INFO:teuthology.orchestra.run.smithi155.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.4 MB/s | 251 kB 00:00 2023-12-16T05:29:33.163 INFO:teuthology.orchestra.run.smithi155.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 305 kB/s | 23 kB 00:00 2023-12-16T05:29:33.166 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:29:33.166 INFO:teuthology.orchestra.run.smithi155.stdout:Total 115 kB/s | 28 MB 04:12 2023-12-16T05:29:33.241 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-12-16T05:29:33.278 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-12-16T05:29:33.278 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-12-16T05:29:33.310 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:13:20 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:29:33.584 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-12-16T05:29:33.589 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-12-16T05:29:34.695 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-12-16T05:29:34.934 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-16T05:29:34.998 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:29:35.001 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:29:35.001 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-12-16T05:29:35.001 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:29:35.001 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-12-16T05:29:35.001 INFO:teuthology.orchestra.run.smithi156.stdout: ceph x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 6.4 k 2023-12-16T05:29:35.001 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-12-16T05:29:35.002 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 2.3 M 2023-12-16T05:29:35.002 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 1.6 M 2023-12-16T05:29:35.002 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 238 k 2023-12-16T05:29:35.002 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.9 M 2023-12-16T05:29:35.002 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 17 M 2023-12-16T05:29:35.002 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-16T05:29:35.002 INFO:teuthology.orchestra.run.smithi156.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-16T05:29:35.002 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-16T05:29:35.002 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-16T05:29:35.002 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-16T05:29:35.002 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-16T05:29:35.002 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-16T05:29:35.002 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-16T05:29:35.002 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-16T05:29:35.003 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-16T05:29:35.003 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-16T05:29:35.003 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-16T05:29:35.003 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-16T05:29:35.003 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-16T05:29:35.003 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-16T05:29:35.003 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-16T05:29:35.003 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-16T05:29:35.003 INFO:teuthology.orchestra.run.smithi156.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-16T05:29:35.003 INFO:teuthology.orchestra.run.smithi156.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-16T05:29:35.003 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-16T05:29:35.003 INFO:teuthology.orchestra.run.smithi156.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-16T05:29:35.003 INFO:teuthology.orchestra.run.smithi156.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-16T05:29:35.003 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-16T05:29:35.003 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-16T05:29:35.004 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-16T05:29:35.004 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-16T05:29:35.004 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:29:35.004 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-12-16T05:29:35.004 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:29:35.004 INFO:teuthology.orchestra.run.smithi156.stdout:Install 32 Packages 2023-12-16T05:29:35.004 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:29:35.004 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 28 M 2023-12-16T05:29:35.005 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 110 M 2023-12-16T05:29:35.005 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-12-16T05:29:35.190 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-16T05:29:35.387 INFO:teuthology.orchestra.run.smithi156.stdout:(1/32): ceph-17.2.7-125.g1f2f5510.el8.x86_64.rp 53 kB/s | 6.4 kB 00:00 2023-12-16T05:29:35.438 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-16T05:29:35.719 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-16T05:29:35.721 INFO:teuthology.orchestra.run.smithi156.stdout:(2/32): ceph-mon-17.2.7-125.g1f2f5510.el8.x86_6 12 MB/s | 3.9 MB 00:00 2023-12-16T05:29:35.900 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-16T05:29:35.971 INFO:teuthology.orchestra.run.smithi156.stdout:(3/32): ceph-mds-17.2.7-125.g1f2f5510.el8.x86_6 3.3 MB/s | 2.3 MB 00:00 2023-12-16T05:29:36.088 INFO:teuthology.orchestra.run.smithi156.stdout:(4/32): ceph-mgr-modules-core-17.2.7-125.g1f2f5 2.0 MB/s | 238 kB 00:00 2023-12-16T05:29:36.089 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-16T05:29:36.130 INFO:teuthology.orchestra.run.smithi156.stdout:(5/32): ceph-mgr-17.2.7-125.g1f2f5510.el8.x86_6 1.8 MB/s | 1.6 MB 00:00 2023-12-16T05:29:36.282 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-16T05:29:36.510 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-16T05:29:36.564 INFO:teuthology.orchestra.run.smithi156.stdout:(6/32): ceph-osd-17.2.7-125.g1f2f5510.el8.x86_6 20 MB/s | 17 MB 00:00 2023-12-16T05:29:36.736 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-16T05:29:36.949 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-16T05:29:37.169 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-16T05:29:37.443 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-16T05:29:37.825 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-16T05:29:38.123 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-16T05:29:38.320 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-16T05:29:38.595 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-16T05:29:38.822 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-16T05:29:39.158 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-16T05:29:39.418 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-16T05:29:39.582 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-16T05:29:39.759 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-16T05:29:40.015 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-16T05:29:40.284 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-16T05:29:40.553 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-16T05:29:40.903 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-16T05:29:41.227 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-16T05:29:41.617 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.n 27/32 2023-12-16T05:29:41.854 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 28/32 2023-12-16T05:29:43.330 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 28/32 2023-12-16T05:29:43.537 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 29/32 2023-12-16T05:29:43.928 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 29/32 2023-12-16T05:29:44.112 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 30/32 2023-12-16T05:29:44.327 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 30/32 2023-12-16T05:29:44.528 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 31/32 2023-12-16T05:29:44.545 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 31/32 2023-12-16T05:29:44.703 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 32/32 2023-12-16T05:29:45.113 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 32/32 2023-12-16T05:29:45.113 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 1/32 2023-12-16T05:29:45.113 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 2/32 2023-12-16T05:29:45.113 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 3/32 2023-12-16T05:29:45.113 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 4/32 2023-12-16T05:29:45.113 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 5/32 2023-12-16T05:29:45.113 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.n 6/32 2023-12-16T05:29:45.113 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-16T05:29:45.113 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-16T05:29:45.113 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-16T05:29:45.114 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-16T05:29:45.114 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-16T05:29:45.114 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-16T05:29:45.114 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-16T05:29:45.114 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-16T05:29:45.114 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-16T05:29:45.114 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-16T05:29:45.114 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-16T05:29:45.114 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-16T05:29:45.114 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-16T05:29:45.114 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-16T05:29:45.114 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-16T05:29:45.114 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-16T05:29:45.114 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-16T05:29:45.114 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-16T05:29:45.115 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-16T05:29:45.115 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-16T05:29:45.115 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-16T05:29:45.115 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-16T05:29:45.115 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-16T05:29:45.116 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-16T05:29:45.116 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-16T05:29:46.275 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-16T05:29:46.275 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:29:46.275 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-12-16T05:29:46.275 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:29:46.275 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:29:46.275 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:29:46.275 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T05:29:46.275 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:29:46.275 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:29:46.275 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-16T05:29:46.276 INFO:teuthology.orchestra.run.smithi155.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-16T05:29:46.276 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-16T05:29:46.276 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-16T05:29:46.276 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-16T05:29:46.276 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-16T05:29:46.276 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-16T05:29:46.276 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-16T05:29:46.276 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-16T05:29:46.276 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-16T05:29:46.276 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-16T05:29:46.276 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-16T05:29:46.277 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-16T05:29:46.277 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend-2.6-1.el8.noarch 2023-12-16T05:29:46.277 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-16T05:29:46.277 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-16T05:29:46.277 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-16T05:29:46.277 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-16T05:29:46.277 INFO:teuthology.orchestra.run.smithi155.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-16T05:29:46.277 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-16T05:29:46.277 INFO:teuthology.orchestra.run.smithi155.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-16T05:29:46.277 INFO:teuthology.orchestra.run.smithi155.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-16T05:29:46.277 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-16T05:29:46.277 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-16T05:29:46.277 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-16T05:29:46.277 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-16T05:29:46.278 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:29:46.278 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:29:46.431 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-base 2023-12-16T05:29:47.289 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:13:41 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:29:48.737 INFO:teuthology.orchestra.run.smithi155.stdout:Package ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T05:29:48.964 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:29:48.965 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-12-16T05:29:48.965 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:29:49.070 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install cephadm 2023-12-16T05:29:49.924 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:13:43 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:29:51.602 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:29:51.603 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:29:51.603 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-12-16T05:29:51.603 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:29:51.603 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-12-16T05:29:51.603 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 80 k 2023-12-16T05:29:51.603 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:29:51.603 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-12-16T05:29:51.604 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:29:51.604 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2023-12-16T05:29:51.604 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:29:51.604 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 80 k 2023-12-16T05:29:51.604 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 364 k 2023-12-16T05:29:51.604 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-12-16T05:29:51.875 INFO:teuthology.orchestra.run.smithi155.stdout:cephadm-17.2.7-125.g1f2f5510.el8.noarch.rpm 296 kB/s | 80 kB 00:00 2023-12-16T05:29:51.876 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:29:51.876 INFO:teuthology.orchestra.run.smithi155.stdout:Total 294 kB/s | 80 kB 00:00 2023-12-16T05:29:51.876 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-12-16T05:29:51.884 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-12-16T05:29:51.884 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-12-16T05:29:51.886 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-12-16T05:29:51.889 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-12-16T05:29:51.934 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-12-16T05:29:52.402 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T05:29:52.632 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T05:29:52.858 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T05:29:53.553 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T05:29:53.553 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:29:53.553 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-12-16T05:29:53.553 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T05:29:53.553 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:29:53.553 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:29:53.776 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-immutable-object-cache 2023-12-16T05:29:54.637 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:13:48 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:29:56.324 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:29:56.324 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:29:56.325 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repo Size 2023-12-16T05:29:56.325 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:29:56.325 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-12-16T05:29:56.325 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 161 k 2023-12-16T05:29:56.325 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:29:56.325 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-12-16T05:29:56.325 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:29:56.325 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2023-12-16T05:29:56.325 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:29:56.326 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 161 k 2023-12-16T05:29:56.326 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 490 k 2023-12-16T05:29:56.326 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-12-16T05:29:56.515 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-immutable-object-cache-17.2.7-125.g1f2f551 855 kB/s | 161 kB 00:00 2023-12-16T05:29:56.515 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:29:56.516 INFO:teuthology.orchestra.run.smithi155.stdout:Total 849 kB/s | 161 kB 00:00 2023-12-16T05:29:56.516 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-12-16T05:29:56.526 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-12-16T05:29:56.526 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-12-16T05:29:56.573 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-12-16T05:29:56.576 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-12-16T05:29:56.690 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-12-16T05:29:56.868 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T05:29:57.285 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T05:29:57.990 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T05:29:57.990 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:29:57.990 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-12-16T05:29:57.990 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:29:57.990 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:29:57.990 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:29:58.197 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-mgr 2023-12-16T05:29:59.058 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:13:53 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:30:00.504 INFO:teuthology.orchestra.run.smithi155.stdout:Package ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T05:30:00.734 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:30:00.735 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-12-16T05:30:00.735 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:30:00.841 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-mgr-dashboard 2023-12-16T05:30:01.707 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:13:55 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:30:03.422 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:30:03.423 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:30:03.423 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-12-16T05:30:03.423 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:30:03.423 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-12-16T05:30:03.423 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 1.7 M 2023-12-16T05:30:03.423 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-12-16T05:30:03.423 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 23 k 2023-12-16T05:30:03.423 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 14 k 2023-12-16T05:30:03.423 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-16T05:30:03.424 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-16T05:30:03.424 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-16T05:30:03.424 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:30:03.424 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-12-16T05:30:03.424 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:30:03.424 INFO:teuthology.orchestra.run.smithi155.stdout:Install 6 Packages 2023-12-16T05:30:03.424 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:30:03.424 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 2.0 M 2023-12-16T05:30:03.425 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 8.0 M 2023-12-16T05:30:03.425 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-12-16T05:30:19.738 INFO:teuthology.orchestra.run.smithi155.stdout:(1/6): ceph-grafana-dashboards-17.2.7-125.g1f2f 156 kB/s | 23 kB 00:00 2023-12-16T05:30:19.763 INFO:teuthology.orchestra.run.smithi155.stdout:(2/6): ceph-prometheus-alerts-17.2.7-125.g1f2f5 84 kB/s | 14 kB 00:00 2023-12-16T05:30:19.871 INFO:teuthology.orchestra.run.smithi155.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 310 kB/s | 34 kB 00:00 2023-12-16T05:30:19.905 INFO:teuthology.orchestra.run.smithi155.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 255 kB/s | 43 kB 00:00 2023-12-16T05:30:19.955 INFO:teuthology.orchestra.run.smithi155.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 2.3 MB/s | 196 kB 00:00 2023-12-16T05:30:20.064 INFO:teuthology.orchestra.run.smithi155.stdout:(6/6): ceph-mgr-dashboard-17.2.7-125.g1f2f5510. 3.6 MB/s | 1.7 MB 00:00 2023-12-16T05:30:20.067 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:30:20.067 INFO:teuthology.orchestra.run.smithi155.stdout:Total 123 kB/s | 2.0 MB 00:16 2023-12-16T05:30:20.078 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-12-16T05:30:20.088 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-12-16T05:30:20.088 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-12-16T05:30:20.174 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-12-16T05:30:20.177 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-12-16T05:30:20.431 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-12-16T05:30:20.679 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-16T05:30:20.949 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-16T05:30:21.159 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-16T05:30:21.312 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.no 4/6 2023-12-16T05:30:21.652 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.n 5/6 2023-12-16T05:30:21.864 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 6/6 2023-12-16T05:30:22.149 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 6/6 2023-12-16T05:30:22.149 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.n 1/6 2023-12-16T05:30:22.149 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 2/6 2023-12-16T05:30:22.149 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.no 3/6 2023-12-16T05:30:22.149 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-16T05:30:22.150 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-16T05:30:22.828 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-16T05:30:22.829 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:30:22.829 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-12-16T05:30:22.829 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T05:30:22.829 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T05:30:22.829 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T05:30:22.829 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-16T05:30:22.829 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-16T05:30:22.829 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-16T05:30:22.829 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:30:22.829 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:30:22.953 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-16T05:30:23.850 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:14:17 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:30:25.521 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:30:25.523 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================================ 2023-12-16T05:30:25.523 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-12-16T05:30:25.523 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================================ 2023-12-16T05:30:25.523 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-12-16T05:30:25.523 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 7.4 M 2023-12-16T05:30:25.523 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-12-16T05:30:25.524 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-16T05:30:25.524 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-16T05:30:25.524 INFO:teuthology.orchestra.run.smithi155.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-16T05:30:25.524 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-16T05:30:25.524 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-16T05:30:25.524 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-16T05:30:25.524 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2023-12-16T05:30:25.525 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:30:25.525 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-12-16T05:30:25.525 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================================ 2023-12-16T05:30:25.525 INFO:teuthology.orchestra.run.smithi155.stdout:Install 8 Packages 2023-12-16T05:30:25.525 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:30:25.526 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 36 M 2023-12-16T05:30:25.526 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 210 M 2023-12-16T05:30:25.526 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-12-16T05:30:26.271 INFO:teuthology.orchestra.run.smithi155.stdout:(1/8): ceph-mgr-diskprediction-local-17.2.7-125 14 MB/s | 7.4 MB 00:00 2023-12-16T05:33:45.919 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] python3-mako-1.0.6-14.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-mako-1.0.6-14.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:33:45.919 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] python3-markupsafe-0.23-19.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-markupsafe-0.23-19.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:33:45.920 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] python3-pyOpenSSL-19.0.0-1.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-pyOpenSSL-19.0.0-1.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:34:19.804 INFO:teuthology.orchestra.run.smithi156.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 374 B/s | 103 kB 04:43 2023-12-16T05:34:19.821 INFO:teuthology.orchestra.run.smithi156.stdout:(8/32): python3-mako-1.0.6-14.el8.noarch.rpm 566 B/s | 157 kB 04:43 2023-12-16T05:34:20.555 INFO:teuthology.orchestra.run.smithi156.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 76 kB/s | 57 kB 00:00 2023-12-16T05:34:20.738 INFO:teuthology.orchestra.run.smithi156.stdout:(10/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.3 MB/s | 249 kB 00:00 2023-12-16T05:34:20.830 INFO:teuthology.orchestra.run.smithi156.stdout:(11/32): python3-cryptography-3.2.1-6.el8.x86_6 6.8 MB/s | 641 kB 00:00 2023-12-16T05:34:20.880 INFO:teuthology.orchestra.run.smithi156.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 2.1 MB/s | 109 kB 00:00 2023-12-16T05:34:20.981 INFO:teuthology.orchestra.run.smithi156.stdout:(13/32): python3-werkzeug-0.12.2-4.el8.noarch.r 394 kB/s | 457 kB 00:01 2023-12-16T05:34:21.281 INFO:teuthology.orchestra.run.smithi156.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 109 kB/s | 44 kB 00:00 2023-12-16T05:34:21.640 INFO:teuthology.orchestra.run.smithi156.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 281 kB/s | 185 kB 00:00 2023-12-16T05:34:21.815 INFO:teuthology.orchestra.run.smithi156.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 323 kB/s | 173 kB 00:00 2023-12-16T05:34:21.932 INFO:teuthology.orchestra.run.smithi156.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-12-16T05:34:22.049 INFO:teuthology.orchestra.run.smithi156.stdout:(18/32): python3-jaraco-functools-2.0-4.el8.noa 150 kB/s | 18 kB 00:00 2023-12-16T05:34:22.176 INFO:teuthology.orchestra.run.smithi156.stdout:(19/32): python3-logutils-0.3.5-11.el8.noarch.r 384 kB/s | 49 kB 00:00 2023-12-16T05:34:22.260 INFO:teuthology.orchestra.run.smithi156.stdout:(20/32): python3-cherrypy-18.4.0-1.el8.noarch.r 620 kB/s | 384 kB 00:00 2023-12-16T05:34:22.285 INFO:teuthology.orchestra.run.smithi156.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 540 kB/s | 59 kB 00:00 2023-12-16T05:34:22.402 INFO:teuthology.orchestra.run.smithi156.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 134 kB/s | 16 kB 00:00 2023-12-16T05:34:22.519 INFO:teuthology.orchestra.run.smithi156.stdout:(23/32): python3-simplegeneric-0.8.1-17.el8.noa 160 kB/s | 19 kB 00:00 2023-12-16T05:34:22.636 INFO:teuthology.orchestra.run.smithi156.stdout:(24/32): python3-singledispatch-3.4.0.3-18.el8. 205 kB/s | 24 kB 00:00 2023-12-16T05:34:22.661 INFO:teuthology.orchestra.run.smithi156.stdout:(25/32): python3-pecan-1.3.2-9.el8.noarch.rpm 705 kB/s | 283 kB 00:00 2023-12-16T05:34:22.753 INFO:teuthology.orchestra.run.smithi156.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 250 kB/s | 29 kB 00:00 2023-12-16T05:34:22.778 INFO:teuthology.orchestra.run.smithi156.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 235 kB/s | 27 kB 00:00 2023-12-16T05:34:23.137 INFO:teuthology.orchestra.run.smithi156.stdout:(28/32): python3-waitress-1.4.3-1.el8.noarch.rp 666 kB/s | 255 kB 00:00 2023-12-16T05:34:23.162 INFO:teuthology.orchestra.run.smithi156.stdout:(29/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 655 kB/s | 251 kB 00:00 2023-12-16T05:34:23.279 INFO:teuthology.orchestra.run.smithi156.stdout:(30/32): python3-zc-lockfile-2.0-2.el8.noarch.r 196 kB/s | 23 kB 00:00 2023-12-16T05:34:23.347 INFO:teuthology.orchestra.run.smithi156.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 409 kB/s | 85 kB 00:00 2023-12-16T05:34:34.917 INFO:teuthology.orchestra.run.smithi155.stdout:[MIRROR] openblas-0.3.15-4.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/openblas-0.3.15-4.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:34:34.918 INFO:teuthology.orchestra.run.smithi155.stdout:[MIRROR] openblas-threads-0.3.15-4.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/openblas-threads-0.3.15-4.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:34:34.918 INFO:teuthology.orchestra.run.smithi155.stdout:[MIRROR] python3-numpy-1.14.3-10.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-numpy-1.14.3-10.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:34:36.471 INFO:teuthology.orchestra.run.smithi155.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 20 kB/s | 4.9 MB 04:10 2023-12-16T05:34:36.546 INFO:teuthology.orchestra.run.smithi155.stdout:(3/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 15 kB/s | 3.7 MB 04:10 2023-12-16T05:34:36.621 INFO:teuthology.orchestra.run.smithi155.stdout:(4/8): openblas-0.3.15-4.el8.x86_64.rpm 19 kB/s | 4.7 MB 04:10 2023-12-16T05:34:36.863 INFO:teuthology.orchestra.run.smithi155.stdout:(5/8): libgfortran-8.5.0-21.el8.x86_64.rpm 2.6 MB/s | 645 kB 00:00 2023-12-16T05:34:36.913 INFO:teuthology.orchestra.run.smithi155.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 3.4 MB/s | 172 kB 00:00 2023-12-16T05:34:36.980 INFO:teuthology.orchestra.run.smithi155.stdout:(7/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 442 kB/s | 225 kB 00:00 2023-12-16T05:34:38.139 INFO:teuthology.orchestra.run.smithi155.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 8.9 MB/s | 14 MB 00:01 2023-12-16T05:34:38.139 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:34:38.139 INFO:teuthology.orchestra.run.smithi155.stdout:Total 145 kB/s | 36 MB 04:12 2023-12-16T05:34:38.363 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-12-16T05:34:38.382 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-12-16T05:34:38.382 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-12-16T05:34:38.774 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-12-16T05:34:38.777 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-12-16T05:34:39.317 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-12-16T05:34:39.450 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-16T05:34:39.594 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-16T05:34:39.733 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-16T05:34:40.321 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-16T05:34:40.475 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-16T05:34:41.078 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-16T05:34:41.268 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-16T05:34:41.990 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-16T05:34:42.369 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-16T05:34:42.607 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-16T05:34:44.353 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-16T05:34:45.583 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2023-12-16T05:34:45.823 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 8/8 2023-12-16T05:34:46.138 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 8/8 2023-12-16T05:34:46.138 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 1/8 2023-12-16T05:34:46.138 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-16T05:34:46.138 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-16T05:34:46.138 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-16T05:34:46.138 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-16T05:34:46.139 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2023-12-16T05:34:46.139 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-16T05:34:46.851 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-16T05:34:46.851 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:34:46.851 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-12-16T05:34:46.852 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T05:34:46.852 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-16T05:34:46.852 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-16T05:34:46.852 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-16T05:34:46.852 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-16T05:34:46.852 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-16T05:34:46.852 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-16T05:34:46.852 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2023-12-16T05:34:46.852 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:34:46.852 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:34:46.979 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-mgr-rook 2023-12-16T05:34:47.834 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:18:41 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:34:49.522 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:34:49.523 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:34:49.524 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-12-16T05:34:49.524 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:34:49.524 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-12-16T05:34:49.524 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 47 k 2023-12-16T05:34:49.524 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-12-16T05:34:49.524 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-16T05:34:49.524 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-16T05:34:49.524 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-16T05:34:49.524 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-16T05:34:49.524 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-16T05:34:49.524 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-16T05:34:49.524 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-16T05:34:49.524 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-16T05:34:49.525 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-16T05:34:49.525 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-16T05:34:49.525 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-16T05:34:49.525 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-16T05:34:49.525 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:34:49.525 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-12-16T05:34:49.525 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:34:49.525 INFO:teuthology.orchestra.run.smithi155.stdout:Install 13 Packages 2023-12-16T05:34:49.525 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:34:49.526 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 1.9 M 2023-12-16T05:34:49.526 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 25 M 2023-12-16T05:34:49.526 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-12-16T05:34:50.063 INFO:teuthology.orchestra.run.smithi155.stdout:(1/13): ceph-mgr-rook-17.2.7-125.g1f2f5510.el8. 270 kB/s | 47 kB 00:00 2023-12-16T05:34:50.817 INFO:teuthology.orchestra.run.smithi156.stdout:(32/32): python3-markupsafe-0.23-19.el8.x86_64. 126 B/s | 39 kB 05:14 2023-12-16T05:34:50.818 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:34:50.818 INFO:teuthology.orchestra.run.smithi156.stdout:Total 92 kB/s | 28 MB 05:15 2023-12-16T05:34:50.894 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-12-16T05:34:50.931 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-12-16T05:34:50.932 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-12-16T05:34:51.249 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-12-16T05:34:51.252 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-12-16T05:34:52.321 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-12-16T05:34:52.632 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-16T05:34:52.886 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-16T05:34:53.128 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-16T05:34:53.367 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-16T05:34:53.564 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-16T05:34:53.771 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-16T05:34:53.947 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-16T05:34:54.116 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-16T05:34:54.309 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-16T05:34:54.496 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-16T05:34:54.716 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-16T05:34:54.974 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-16T05:34:55.366 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-16T05:34:55.604 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-16T05:34:55.784 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-16T05:34:56.051 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-16T05:34:56.252 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-16T05:34:56.552 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-16T05:34:56.764 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-16T05:34:56.920 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-16T05:34:57.114 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-16T05:34:57.356 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-16T05:34:57.626 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-16T05:34:57.885 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-16T05:34:58.235 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-16T05:34:58.513 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-16T05:34:58.908 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.n 27/32 2023-12-16T05:34:59.157 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 28/32 2023-12-16T05:35:00.636 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 28/32 2023-12-16T05:35:00.853 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 29/32 2023-12-16T05:35:01.244 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 29/32 2023-12-16T05:35:01.418 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 30/32 2023-12-16T05:35:01.634 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 30/32 2023-12-16T05:35:01.809 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 31/32 2023-12-16T05:35:01.826 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 31/32 2023-12-16T05:35:01.959 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 32/32 2023-12-16T05:35:02.364 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 32/32 2023-12-16T05:35:02.365 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 1/32 2023-12-16T05:35:02.365 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 2/32 2023-12-16T05:35:02.365 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 3/32 2023-12-16T05:35:02.365 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 4/32 2023-12-16T05:35:02.365 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 5/32 2023-12-16T05:35:02.365 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.n 6/32 2023-12-16T05:35:02.365 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-16T05:35:02.365 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-16T05:35:02.366 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-16T05:35:02.366 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-16T05:35:02.366 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-16T05:35:02.366 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-16T05:35:02.366 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-16T05:35:02.366 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-16T05:35:02.366 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-16T05:35:02.366 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-16T05:35:02.367 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-16T05:35:02.367 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-16T05:35:02.367 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-16T05:35:02.367 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-16T05:35:02.367 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-16T05:35:02.367 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-16T05:35:02.367 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-16T05:35:02.368 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-16T05:35:02.368 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-16T05:35:02.368 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-16T05:35:02.368 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-16T05:35:02.368 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-16T05:35:02.368 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-16T05:35:02.368 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-16T05:35:02.368 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-16T05:35:03.437 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-16T05:35:03.438 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:35:03.438 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-12-16T05:35:03.438 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:35:03.438 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:35:03.438 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:35:03.438 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T05:35:03.438 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:35:03.438 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:35:03.438 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-16T05:35:03.438 INFO:teuthology.orchestra.run.smithi156.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-16T05:35:03.438 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-16T05:35:03.438 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-16T05:35:03.439 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-16T05:35:03.439 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-16T05:35:03.439 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-16T05:35:03.439 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-16T05:35:03.439 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-16T05:35:03.439 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-16T05:35:03.439 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-16T05:35:03.439 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-16T05:35:03.439 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-16T05:35:03.439 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend-2.6-1.el8.noarch 2023-12-16T05:35:03.439 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-16T05:35:03.439 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-16T05:35:03.439 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-16T05:35:03.440 INFO:teuthology.orchestra.run.smithi156.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-16T05:35:03.440 INFO:teuthology.orchestra.run.smithi156.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-16T05:35:03.440 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-16T05:35:03.440 INFO:teuthology.orchestra.run.smithi156.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-16T05:35:03.440 INFO:teuthology.orchestra.run.smithi156.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-16T05:35:03.440 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-16T05:35:03.440 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-16T05:35:03.440 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-16T05:35:03.440 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-16T05:35:03.440 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:35:03.440 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:35:03.607 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-base 2023-12-16T05:35:04.468 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:18:51 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:35:05.937 INFO:teuthology.orchestra.run.smithi156.stdout:Package ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T05:35:06.165 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:35:06.166 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-12-16T05:35:06.166 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:35:06.276 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install cephadm 2023-12-16T05:35:07.143 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:18:54 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:35:08.832 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:35:08.832 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:35:08.832 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-12-16T05:35:08.832 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:35:08.832 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-12-16T05:35:08.832 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 80 k 2023-12-16T05:35:08.833 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:35:08.833 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-12-16T05:35:08.833 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:35:08.833 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-12-16T05:35:08.833 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:35:08.833 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 80 k 2023-12-16T05:35:08.834 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 364 k 2023-12-16T05:35:08.834 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-12-16T05:35:09.001 INFO:teuthology.orchestra.run.smithi156.stdout:cephadm-17.2.7-125.g1f2f5510.el8.noarch.rpm 481 kB/s | 80 kB 00:00 2023-12-16T05:35:09.002 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:35:09.002 INFO:teuthology.orchestra.run.smithi156.stdout:Total 477 kB/s | 80 kB 00:00 2023-12-16T05:35:09.002 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-12-16T05:35:09.009 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-12-16T05:35:09.009 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-12-16T05:35:09.011 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-12-16T05:35:09.014 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-12-16T05:35:09.055 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-12-16T05:35:09.533 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T05:35:09.690 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T05:35:09.916 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T05:35:10.602 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T05:35:10.603 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:35:10.603 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-12-16T05:35:10.603 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T05:35:10.603 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:35:10.603 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:35:10.799 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-immutable-object-cache 2023-12-16T05:35:11.665 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:18:58 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:35:13.337 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:35:13.337 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:35:13.337 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-12-16T05:35:13.337 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:35:13.337 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-12-16T05:35:13.337 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 161 k 2023-12-16T05:35:13.337 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:35:13.338 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-12-16T05:35:13.338 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:35:13.338 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-12-16T05:35:13.338 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:35:13.338 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 161 k 2023-12-16T05:35:13.338 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 490 k 2023-12-16T05:35:13.338 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-12-16T05:35:13.631 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-immutable-object-cache-17.2.7-125.g1f2f551 552 kB/s | 161 kB 00:00 2023-12-16T05:35:13.632 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:35:13.632 INFO:teuthology.orchestra.run.smithi156.stdout:Total 549 kB/s | 161 kB 00:00 2023-12-16T05:35:13.632 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-12-16T05:35:13.642 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-12-16T05:35:13.642 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-12-16T05:35:13.689 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-12-16T05:35:13.692 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-12-16T05:35:13.802 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-12-16T05:35:14.040 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T05:35:14.452 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T05:35:15.133 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T05:35:15.134 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:35:15.134 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-12-16T05:35:15.134 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:35:15.134 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:35:15.134 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:35:15.335 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr 2023-12-16T05:35:16.197 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:19:03 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:35:17.625 INFO:teuthology.orchestra.run.smithi156.stdout:Package ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T05:35:17.851 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:35:17.852 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-12-16T05:35:17.852 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:35:17.952 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr-dashboard 2023-12-16T05:35:18.806 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:19:05 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:35:20.498 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:35:20.499 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:35:20.500 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-12-16T05:35:20.500 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:35:20.500 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-12-16T05:35:20.500 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 1.7 M 2023-12-16T05:35:20.500 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-12-16T05:35:20.500 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 23 k 2023-12-16T05:35:20.500 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 14 k 2023-12-16T05:35:20.500 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-16T05:35:20.500 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-16T05:35:20.500 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-16T05:35:20.500 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:35:20.500 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-12-16T05:35:20.500 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:35:20.500 INFO:teuthology.orchestra.run.smithi156.stdout:Install 6 Packages 2023-12-16T05:35:20.501 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:35:20.501 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 2.0 M 2023-12-16T05:35:20.501 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 8.0 M 2023-12-16T05:35:20.501 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-12-16T05:35:20.959 INFO:teuthology.orchestra.run.smithi156.stdout:(1/6): ceph-grafana-dashboards-17.2.7-125.g1f2f 102 kB/s | 23 kB 00:00 2023-12-16T05:35:20.976 INFO:teuthology.orchestra.run.smithi156.stdout:(2/6): ceph-prometheus-alerts-17.2.7-125.g1f2f5 59 kB/s | 14 kB 00:00 2023-12-16T05:35:21.019 INFO:teuthology.orchestra.run.smithi156.stdout:(3/6): ceph-mgr-dashboard-17.2.7-125.g1f2f5510. 5.9 MB/s | 1.7 MB 00:00 2023-12-16T05:35:21.119 INFO:teuthology.orchestra.run.smithi156.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 236 kB/s | 34 kB 00:00 2023-12-16T05:35:21.144 INFO:teuthology.orchestra.run.smithi156.stdout:(5/6): python3-jwt-1.6.1-2.el8.noarch.rpm 231 kB/s | 43 kB 00:00 2023-12-16T05:35:21.211 INFO:teuthology.orchestra.run.smithi156.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.0 MB/s | 196 kB 00:00 2023-12-16T05:35:21.213 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:35:21.213 INFO:teuthology.orchestra.run.smithi156.stdout:Total 2.8 MB/s | 2.0 MB 00:00 2023-12-16T05:35:21.223 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-12-16T05:35:21.231 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-12-16T05:35:21.231 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-12-16T05:35:21.312 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-12-16T05:35:21.315 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-12-16T05:35:21.566 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-12-16T05:35:21.745 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-16T05:35:22.015 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-16T05:35:22.216 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-16T05:35:22.345 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.no 4/6 2023-12-16T05:35:22.701 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.n 5/6 2023-12-16T05:35:22.950 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 6/6 2023-12-16T05:35:23.237 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 6/6 2023-12-16T05:35:23.237 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.n 1/6 2023-12-16T05:35:23.237 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 2/6 2023-12-16T05:35:23.237 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.no 3/6 2023-12-16T05:35:23.237 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-16T05:35:23.238 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-16T05:35:24.355 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-16T05:35:24.356 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:35:24.356 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-12-16T05:35:24.356 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T05:35:24.356 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T05:35:24.356 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T05:35:24.356 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-16T05:35:24.356 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-16T05:35:24.356 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-16T05:35:24.356 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:35:24.356 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:35:24.472 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-16T05:35:25.341 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:19:12 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:35:27.008 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:35:27.009 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================================ 2023-12-16T05:35:27.009 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-12-16T05:35:27.009 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================================ 2023-12-16T05:35:27.009 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-12-16T05:35:27.009 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 7.4 M 2023-12-16T05:35:27.009 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-12-16T05:35:27.010 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-16T05:35:27.010 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-16T05:35:27.010 INFO:teuthology.orchestra.run.smithi156.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-16T05:35:27.010 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-16T05:35:27.010 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-16T05:35:27.010 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-16T05:35:27.010 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2023-12-16T05:35:27.010 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:35:27.010 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-12-16T05:35:27.010 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================================ 2023-12-16T05:35:27.010 INFO:teuthology.orchestra.run.smithi156.stdout:Install 8 Packages 2023-12-16T05:35:27.010 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:35:27.011 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 36 M 2023-12-16T05:35:27.011 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 210 M 2023-12-16T05:35:27.011 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-12-16T05:35:27.785 INFO:teuthology.orchestra.run.smithi156.stdout:(1/8): ceph-mgr-diskprediction-local-17.2.7-125 14 MB/s | 7.4 MB 00:00 2023-12-16T05:38:57.157 INFO:teuthology.orchestra.run.smithi155.stdout:[MIRROR] python3-jsonpatch-1.21-2.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-jsonpatch-1.21-2.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:38:57.157 INFO:teuthology.orchestra.run.smithi155.stdout:[MIRROR] python3-jsonpointer-1.10-11.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-jsonpointer-1.10-11.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:38:57.158 INFO:teuthology.orchestra.run.smithi155.stdout:[MIRROR] python3-pyasn1-0.3.7-6.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-pyasn1-0.3.7-6.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:38:57.391 INFO:teuthology.orchestra.run.smithi155.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 82 B/s | 20 kB 04:07 2023-12-16T05:38:57.417 INFO:teuthology.orchestra.run.smithi155.stdout:(3/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 110 B/s | 27 kB 04:07 2023-12-16T05:38:57.575 INFO:teuthology.orchestra.run.smithi155.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 523 B/s | 126 kB 04:07 2023-12-16T05:38:57.601 INFO:teuthology.orchestra.run.smithi155.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 844 kB/s | 155 kB 00:00 2023-12-16T05:38:57.676 INFO:teuthology.orchestra.run.smithi155.stdout:(6/13): python3-cachetools-3.1.1-4.el8.noarch.r 440 kB/s | 33 kB 00:00 2023-12-16T05:38:57.718 INFO:teuthology.orchestra.run.smithi155.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 300 kB/s | 43 kB 00:00 2023-12-16T05:38:57.773 INFO:teuthology.orchestra.run.smithi155.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 168 kB/s | 16 kB 00:00 2023-12-16T05:38:57.810 INFO:teuthology.orchestra.run.smithi155.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 883 kB/s | 81 kB 00:00 2023-12-16T05:38:57.836 INFO:teuthology.orchestra.run.smithi155.stdout:(10/13): python3-pyasn1-modules-0.3.7-6.el8.noa 248 kB/s | 110 kB 00:00 2023-12-16T05:38:57.861 INFO:teuthology.orchestra.run.smithi155.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2023-12-16T05:38:57.944 INFO:teuthology.orchestra.run.smithi155.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 565 kB/s | 61 kB 00:00 2023-12-16T05:38:57.978 INFO:teuthology.orchestra.run.smithi155.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 5.7 MB/s | 1.2 MB 00:00 2023-12-16T05:38:57.978 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:38:57.978 INFO:teuthology.orchestra.run.smithi155.stdout:Total 8.0 kB/s | 1.9 MB 04:08 2023-12-16T05:38:58.031 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-12-16T05:38:58.047 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-12-16T05:38:58.048 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-12-16T05:38:58.136 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-12-16T05:38:58.140 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-12-16T05:38:58.756 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-12-16T05:38:58.979 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-16T05:38:59.168 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-16T05:38:59.437 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-16T05:38:59.691 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-16T05:38:59.890 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-16T05:39:00.172 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-16T05:39:00.456 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-16T05:39:00.697 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-16T05:39:01.788 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-16T05:39:02.049 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-16T05:39:02.308 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-16T05:39:02.518 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-16T05:39:02.684 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 13/13 2023-12-16T05:39:02.982 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 13/13 2023-12-16T05:39:02.982 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 1/13 2023-12-16T05:39:02.982 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-16T05:39:02.983 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-16T05:39:02.983 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-16T05:39:02.983 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-16T05:39:02.983 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-16T05:39:02.983 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-16T05:39:02.983 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-16T05:39:02.983 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-16T05:39:02.983 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-16T05:39:02.983 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-16T05:39:02.984 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-16T05:39:03.750 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-16T05:39:03.750 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:39:03.750 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-12-16T05:39:03.750 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T05:39:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-16T05:39:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-16T05:39:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-16T05:39:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-16T05:39:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-16T05:39:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-16T05:39:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-16T05:39:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-16T05:39:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-16T05:39:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-16T05:39:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-16T05:39:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-16T05:39:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:39:03.751 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:39:03.871 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-mgr-cephadm 2023-12-16T05:39:04.725 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:22:58 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:39:06.388 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:39:06.389 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:39:06.389 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-12-16T05:39:06.389 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:39:06.389 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-12-16T05:39:06.389 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 121 k 2023-12-16T05:39:06.389 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-12-16T05:39:06.389 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-16T05:39:06.390 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-16T05:39:06.390 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-16T05:39:06.390 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-16T05:39:06.390 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:39:06.390 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-12-16T05:39:06.390 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:39:06.390 INFO:teuthology.orchestra.run.smithi155.stdout:Install 5 Packages 2023-12-16T05:39:06.390 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:39:06.390 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 6.0 M 2023-12-16T05:39:06.391 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 26 M 2023-12-16T05:39:06.391 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-12-16T05:39:07.921 INFO:teuthology.orchestra.run.smithi155.stdout:(1/5): ceph-mgr-cephadm-17.2.7-125.g1f2f5510.el 418 kB/s | 121 kB 00:00 2023-12-16T05:39:08.579 INFO:teuthology.orchestra.run.smithi155.stdout:(2/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 723 kB/s | 476 kB 00:00 2023-12-16T05:39:08.730 INFO:teuthology.orchestra.run.smithi155.stdout:(3/5): python3-natsort-7.1.1-2.el8.noarch.rpm 401 kB/s | 60 kB 00:00 2023-12-16T05:39:34.079 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] openblas-0.3.15-4.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/openblas-0.3.15-4.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:39:34.079 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] openblas-threads-0.3.15-4.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/openblas-threads-0.3.15-4.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:39:34.079 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] python3-numpy-1.14.3-10.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-numpy-1.14.3-10.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:39:35.267 INFO:teuthology.orchestra.run.smithi156.stdout:(2/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 15 kB/s | 3.7 MB 04:07 2023-12-16T05:39:35.333 INFO:teuthology.orchestra.run.smithi156.stdout:(3/8): openblas-0.3.15-4.el8.x86_64.rpm 20 kB/s | 4.7 MB 04:08 2023-12-16T05:39:35.534 INFO:teuthology.orchestra.run.smithi156.stdout:(4/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 20 kB/s | 4.9 MB 04:08 2023-12-16T05:39:35.684 INFO:teuthology.orchestra.run.smithi156.stdout:(5/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 540 kB/s | 225 kB 00:00 2023-12-16T05:39:35.776 INFO:teuthology.orchestra.run.smithi156.stdout:(6/8): libgfortran-8.5.0-21.el8.x86_64.rpm 2.6 MB/s | 645 kB 00:00 2023-12-16T05:39:35.851 INFO:teuthology.orchestra.run.smithi156.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 1.0 MB/s | 172 kB 00:00 2023-12-16T05:39:36.718 INFO:teuthology.orchestra.run.smithi156.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 10 MB/s | 14 MB 00:01 2023-12-16T05:39:36.719 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:39:36.719 INFO:teuthology.orchestra.run.smithi156.stdout:Total 147 kB/s | 36 MB 04:09 2023-12-16T05:39:36.945 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-12-16T05:39:36.964 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-12-16T05:39:36.964 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-12-16T05:39:37.338 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-12-16T05:39:37.341 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-12-16T05:39:37.884 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-12-16T05:39:38.014 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-16T05:39:38.152 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-16T05:39:38.289 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-16T05:39:38.875 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-16T05:39:39.006 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-16T05:39:39.625 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-16T05:39:39.797 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-16T05:39:40.497 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-16T05:39:40.809 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-16T05:39:41.056 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-16T05:39:42.824 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-16T05:39:44.034 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2023-12-16T05:39:44.255 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 8/8 2023-12-16T05:39:44.567 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 8/8 2023-12-16T05:39:44.567 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 1/8 2023-12-16T05:39:44.567 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-16T05:39:44.567 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-16T05:39:44.567 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-16T05:39:44.567 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-16T05:39:44.568 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2023-12-16T05:39:44.568 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-16T05:39:45.274 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-16T05:39:45.274 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:39:45.274 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-12-16T05:39:45.274 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T05:39:45.274 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-16T05:39:45.274 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-16T05:39:45.274 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-16T05:39:45.274 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-16T05:39:45.274 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-16T05:39:45.274 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-16T05:39:45.274 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2023-12-16T05:39:45.275 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:39:45.275 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:39:45.397 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr-rook 2023-12-16T05:39:46.253 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:23:33 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:39:47.936 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:39:47.938 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:39:47.938 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-12-16T05:39:47.938 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:39:47.938 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-12-16T05:39:47.938 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 47 k 2023-12-16T05:39:47.938 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-12-16T05:39:47.938 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-16T05:39:47.938 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-16T05:39:47.938 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-16T05:39:47.938 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-16T05:39:47.939 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-16T05:39:47.939 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-16T05:39:47.939 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-16T05:39:47.939 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-16T05:39:47.939 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-16T05:39:47.939 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-16T05:39:47.939 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-16T05:39:47.939 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-16T05:39:47.939 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:39:47.939 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-12-16T05:39:47.939 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:39:47.939 INFO:teuthology.orchestra.run.smithi156.stdout:Install 13 Packages 2023-12-16T05:39:47.939 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:39:47.940 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 1.9 M 2023-12-16T05:39:47.940 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 25 M 2023-12-16T05:39:47.940 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-12-16T05:39:48.717 INFO:teuthology.orchestra.run.smithi156.stdout:(1/13): ceph-mgr-rook-17.2.7-125.g1f2f5510.el8. 145 kB/s | 47 kB 00:00 2023-12-16T05:43:15.111 INFO:teuthology.orchestra.run.smithi155.stdout:[MIRROR] python3-babel-2.5.1-7.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-babel-2.5.1-7.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:43:15.112 INFO:teuthology.orchestra.run.smithi155.stdout:[MIRROR] python3-jinja2-2.10.1-3.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.10.1-3.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:43:15.782 INFO:teuthology.orchestra.run.smithi155.stdout:(4/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 2.2 kB/s | 538 kB 04:08 2023-12-16T05:43:16.249 INFO:teuthology.orchestra.run.smithi155.stdout:(5/5): python3-babel-2.5.1-7.el8.noarch.rpm 20 kB/s | 4.8 MB 04:08 2023-12-16T05:43:16.249 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:43:16.250 INFO:teuthology.orchestra.run.smithi155.stdout:Total 24 kB/s | 6.0 MB 04:09 2023-12-16T05:43:16.302 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-12-16T05:43:16.314 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-12-16T05:43:16.315 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-12-16T05:43:16.420 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-12-16T05:43:16.424 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-12-16T05:43:16.701 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-12-16T05:43:17.039 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-16T05:43:18.050 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-16T05:43:18.391 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-16T05:43:18.697 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-16T05:43:18.886 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 5/5 2023-12-16T05:43:19.153 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 5/5 2023-12-16T05:43:19.154 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/5 2023-12-16T05:43:19.154 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-16T05:43:19.154 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-16T05:43:19.154 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-16T05:43:19.846 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-16T05:43:19.846 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:43:19.846 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-12-16T05:43:19.846 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T05:43:19.846 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-16T05:43:19.846 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-16T05:43:19.846 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-16T05:43:19.846 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-16T05:43:19.846 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:43:19.846 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:43:19.980 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-fuse 2023-12-16T05:43:20.841 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:27:14 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:43:22.517 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:43:22.518 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:43:22.518 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-12-16T05:43:22.518 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:43:22.518 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-12-16T05:43:22.518 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 875 k 2023-12-16T05:43:22.518 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-12-16T05:43:22.518 INFO:teuthology.orchestra.run.smithi155.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-16T05:43:22.518 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:43:22.518 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-12-16T05:43:22.518 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:43:22.519 INFO:teuthology.orchestra.run.smithi155.stdout:Install 2 Packages 2023-12-16T05:43:22.519 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:43:22.519 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 958 k 2023-12-16T05:43:22.519 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 3.0 M 2023-12-16T05:43:22.519 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-12-16T05:43:23.125 INFO:teuthology.orchestra.run.smithi155.stdout:(1/2): ceph-fuse-17.2.7-125.g1f2f5510.el8.x86_6 2.1 MB/s | 875 kB 00:00 2023-12-16T05:43:23.200 INFO:teuthology.orchestra.run.smithi155.stdout:(2/2): fuse-2.9.7-17.el8.x86_64.rpm 169 kB/s | 83 kB 00:00 2023-12-16T05:43:23.200 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:43:23.201 INFO:teuthology.orchestra.run.smithi155.stdout:Total 1.4 MB/s | 958 kB 00:00 2023-12-16T05:43:23.211 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-12-16T05:43:23.231 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-12-16T05:43:23.231 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-12-16T05:43:23.318 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-12-16T05:43:23.321 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-12-16T05:43:23.552 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-12-16T05:43:23.835 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-16T05:43:24.010 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2/2 2023-12-16T05:43:24.411 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2/2 2023-12-16T05:43:24.412 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/2 2023-12-16T05:43:25.124 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-16T05:43:25.124 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:43:25.124 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-12-16T05:43:25.124 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-16T05:43:25.124 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:43:25.124 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:43:25.314 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install librados-devel 2023-12-16T05:43:26.178 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:27:20 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:43:27.866 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:43:27.868 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:43:27.868 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repo Size 2023-12-16T05:43:27.868 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:43:27.868 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-12-16T05:43:27.868 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 130 k 2023-12-16T05:43:27.868 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:43:27.868 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-12-16T05:43:27.868 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:43:27.869 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2023-12-16T05:43:27.869 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:43:27.869 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 130 k 2023-12-16T05:43:27.869 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 464 k 2023-12-16T05:43:27.869 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-12-16T05:43:28.164 INFO:teuthology.orchestra.run.smithi155.stdout:librados-devel-17.2.7-125.g1f2f5510.el8.x86_64. 439 kB/s | 130 kB 00:00 2023-12-16T05:43:28.164 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:43:28.164 INFO:teuthology.orchestra.run.smithi155.stdout:Total 437 kB/s | 130 kB 00:00 2023-12-16T05:43:28.164 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-12-16T05:43:28.170 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-12-16T05:43:28.170 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-12-16T05:43:28.219 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-12-16T05:43:28.223 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-12-16T05:43:28.335 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-12-16T05:43:28.614 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:43:28.903 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:43:29.612 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:43:29.612 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:43:29.612 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-12-16T05:43:29.613 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:43:29.613 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:43:29.613 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:43:29.827 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install libcephfs2 2023-12-16T05:43:30.691 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:27:24 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:43:32.136 INFO:teuthology.orchestra.run.smithi155.stdout:Package libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T05:43:32.367 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:43:32.369 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-12-16T05:43:32.369 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:43:32.481 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install libcephfs-devel 2023-12-16T05:43:33.335 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:27:27 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:43:35.060 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:43:35.061 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:43:35.061 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repo Size 2023-12-16T05:43:35.061 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:43:35.061 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-12-16T05:43:35.061 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 25 k 2023-12-16T05:43:35.061 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:43:35.061 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-12-16T05:43:35.061 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:43:35.061 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2023-12-16T05:43:35.062 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:43:35.062 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 25 k 2023-12-16T05:43:35.062 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 109 k 2023-12-16T05:43:35.062 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-12-16T05:43:35.284 INFO:teuthology.orchestra.run.smithi155.stdout:libcephfs-devel-17.2.7-125.g1f2f5510.el8.x86_64 112 kB/s | 25 kB 00:00 2023-12-16T05:43:35.284 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:43:35.284 INFO:teuthology.orchestra.run.smithi155.stdout:Total 111 kB/s | 25 kB 00:00 2023-12-16T05:43:35.285 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-12-16T05:43:35.288 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-12-16T05:43:35.288 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-12-16T05:43:35.290 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-12-16T05:43:35.293 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-12-16T05:43:35.344 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-12-16T05:43:35.550 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:43:35.816 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:43:36.483 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:43:36.483 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:43:36.483 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-12-16T05:43:36.483 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:43:36.483 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:43:36.484 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:43:36.606 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install librados2 2023-12-16T05:43:37.455 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:27:31 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:43:38.908 INFO:teuthology.orchestra.run.smithi155.stdout:Package librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T05:43:39.135 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:43:39.136 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-12-16T05:43:39.136 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:43:39.246 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install librbd1 2023-12-16T05:43:40.095 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:27:34 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:43:41.560 INFO:teuthology.orchestra.run.smithi155.stdout:Package librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T05:43:41.787 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:43:41.789 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-12-16T05:43:41.789 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:43:41.896 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install python3-rados 2023-12-16T05:43:42.751 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:27:36 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:43:44.195 INFO:teuthology.orchestra.run.smithi155.stdout:Package python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T05:43:44.422 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:43:44.423 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-12-16T05:43:44.423 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:43:44.535 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install python3-rgw 2023-12-16T05:43:45.405 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:27:39 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:43:46.863 INFO:teuthology.orchestra.run.smithi155.stdout:Package python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T05:43:47.090 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:43:47.091 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-12-16T05:43:47.091 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:43:47.193 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install python3-cephfs 2023-12-16T05:43:48.040 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:27:42 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:43:49.513 INFO:teuthology.orchestra.run.smithi155.stdout:Package python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T05:43:49.740 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:43:49.741 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-12-16T05:43:49.741 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:43:49.844 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install python3-rbd 2023-12-16T05:43:50.697 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:27:44 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:43:52.156 INFO:teuthology.orchestra.run.smithi155.stdout:Package python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T05:43:52.382 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:43:52.383 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-12-16T05:43:52.383 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:43:52.494 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install rbd-fuse 2023-12-16T05:43:53.340 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:27:47 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:43:55.048 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:43:55.049 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:43:55.049 INFO:teuthology.orchestra.run.smithi155.stdout: Package Architecture Version Repository Size 2023-12-16T05:43:55.049 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:43:55.049 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-12-16T05:43:55.049 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 90 k 2023-12-16T05:43:55.049 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:43:55.049 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-12-16T05:43:55.050 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:43:55.050 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2023-12-16T05:43:55.050 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:43:55.050 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 90 k 2023-12-16T05:43:55.050 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 264 k 2023-12-16T05:43:55.050 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-12-16T05:43:55.213 INFO:teuthology.orchestra.run.smithi155.stdout:rbd-fuse-17.2.7-125.g1f2f5510.el8.x86_64.rpm 553 kB/s | 90 kB 00:00 2023-12-16T05:43:55.214 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:43:55.214 INFO:teuthology.orchestra.run.smithi155.stdout:Total 549 kB/s | 90 kB 00:00 2023-12-16T05:43:55.214 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-12-16T05:43:55.224 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-12-16T05:43:55.224 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-12-16T05:43:55.272 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-12-16T05:43:55.276 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-12-16T05:43:55.386 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-12-16T05:43:55.613 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:43:55.915 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:43:56.223 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] python3-jsonpointer-1.10-11.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-jsonpointer-1.10-11.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:43:56.223 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] python3-pyasn1-0.3.7-6.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-pyasn1-0.3.7-6.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:43:56.224 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] python3-jsonpatch-1.21-2.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-jsonpatch-1.21-2.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:43:56.500 INFO:teuthology.orchestra.run.smithi156.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 82 B/s | 20 kB 04:08 2023-12-16T05:43:56.525 INFO:teuthology.orchestra.run.smithi156.stdout:(3/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 109 B/s | 27 kB 04:08 2023-12-16T05:43:56.575 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:43:56.575 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:43:56.575 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-12-16T05:43:56.575 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:43:56.575 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:43:56.575 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:43:56.576 INFO:teuthology.orchestra.run.smithi156.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 522 B/s | 126 kB 04:07 2023-12-16T05:43:56.776 INFO:teuthology.orchestra.run.smithi156.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 619 kB/s | 155 kB 00:00 2023-12-16T05:43:56.795 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install rbd-mirror 2023-12-16T05:43:56.801 INFO:teuthology.orchestra.run.smithi156.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 189 kB/s | 43 kB 00:00 2023-12-16T05:43:56.860 INFO:teuthology.orchestra.run.smithi156.stdout:(7/13): python3-pyasn1-modules-0.3.7-6.el8.noar 306 kB/s | 110 kB 00:00 2023-12-16T05:43:56.885 INFO:teuthology.orchestra.run.smithi156.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 195 kB/s | 16 kB 00:00 2023-12-16T05:43:56.910 INFO:teuthology.orchestra.run.smithi156.stdout:(9/13): python3-cachetools-3.1.1-4.el8.noarch.r 246 kB/s | 33 kB 00:00 2023-12-16T05:43:56.960 INFO:teuthology.orchestra.run.smithi156.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 810 kB/s | 81 kB 00:00 2023-12-16T05:43:56.986 INFO:teuthology.orchestra.run.smithi156.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 853 kB/s | 64 kB 00:00 2023-12-16T05:43:57.011 INFO:teuthology.orchestra.run.smithi156.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 1.2 MB/s | 61 kB 00:00 2023-12-16T05:43:57.053 INFO:teuthology.orchestra.run.smithi156.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 7.0 MB/s | 1.2 MB 00:00 2023-12-16T05:43:57.053 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:43:57.053 INFO:teuthology.orchestra.run.smithi156.stdout:Total 7.9 kB/s | 1.9 MB 04:09 2023-12-16T05:43:57.108 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-12-16T05:43:57.125 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-12-16T05:43:57.125 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-12-16T05:43:57.212 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-12-16T05:43:57.215 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-12-16T05:43:57.658 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:27:51 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:43:57.754 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-12-16T05:43:57.975 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-16T05:43:58.156 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-16T05:43:58.375 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-16T05:43:58.587 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-16T05:43:58.796 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-16T05:43:59.036 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-16T05:43:59.324 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-16T05:43:59.354 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:43:59.355 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:43:59.355 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repo Size 2023-12-16T05:43:59.355 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:43:59.355 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-12-16T05:43:59.355 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.5 M 2023-12-16T05:43:59.355 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:43:59.355 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-12-16T05:43:59.356 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:43:59.356 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2023-12-16T05:43:59.356 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:43:59.356 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 3.5 M 2023-12-16T05:43:59.356 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 16 M 2023-12-16T05:43:59.356 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-12-16T05:43:59.574 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-16T05:43:59.717 INFO:teuthology.orchestra.run.smithi155.stdout:rbd-mirror-17.2.7-125.g1f2f5510.el8.x86_64.rpm 9.4 MB/s | 3.5 MB 00:00 2023-12-16T05:43:59.718 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:43:59.718 INFO:teuthology.orchestra.run.smithi155.stdout:Total 9.4 MB/s | 3.5 MB 00:00 2023-12-16T05:43:59.718 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-12-16T05:43:59.729 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-12-16T05:43:59.730 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-12-16T05:43:59.793 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-12-16T05:43:59.796 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-12-16T05:44:00.224 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-12-16T05:44:00.405 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:44:00.571 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-16T05:44:00.814 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:44:00.828 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-16T05:44:01.046 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-16T05:44:01.264 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-16T05:44:01.430 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 13/13 2023-12-16T05:44:01.508 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:44:01.508 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:44:01.508 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-12-16T05:44:01.508 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:44:01.509 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:44:01.509 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:44:01.724 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 13/13 2023-12-16T05:44:01.724 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 1/13 2023-12-16T05:44:01.724 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-16T05:44:01.724 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-16T05:44:01.724 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-16T05:44:01.724 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-16T05:44:01.724 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-16T05:44:01.724 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-16T05:44:01.725 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-16T05:44:01.725 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-16T05:44:01.725 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-16T05:44:01.725 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-16T05:44:01.725 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-16T05:44:01.728 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install rbd-nbd 2023-12-16T05:44:02.497 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-16T05:44:02.497 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:44:02.498 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-12-16T05:44:02.498 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T05:44:02.498 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-16T05:44:02.498 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-16T05:44:02.498 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-16T05:44:02.498 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-16T05:44:02.498 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-16T05:44:02.498 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-16T05:44:02.498 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-16T05:44:02.498 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-16T05:44:02.498 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-16T05:44:02.498 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-16T05:44:02.498 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-16T05:44:02.499 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-16T05:44:02.499 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:44:02.499 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:44:02.590 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:27:56 ago on Sat 16 Dec 2023 05:16:06 AM UTC. 2023-12-16T05:44:02.604 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr-cephadm 2023-12-16T05:44:03.460 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:27:50 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:44:04.257 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-16T05:44:04.257 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:44:04.257 INFO:teuthology.orchestra.run.smithi155.stdout: Package Architecture Version Repository Size 2023-12-16T05:44:04.257 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:44:04.257 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-12-16T05:44:04.257 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 173 k 2023-12-16T05:44:04.258 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:44:04.258 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-12-16T05:44:04.258 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-12-16T05:44:04.258 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2023-12-16T05:44:04.258 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:44:04.259 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 173 k 2023-12-16T05:44:04.259 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 552 k 2023-12-16T05:44:04.259 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-12-16T05:44:04.453 INFO:teuthology.orchestra.run.smithi155.stdout:rbd-nbd-17.2.7-125.g1f2f5510.el8.x86_64.rpm 886 kB/s | 173 kB 00:00 2023-12-16T05:44:04.454 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:44:04.454 INFO:teuthology.orchestra.run.smithi155.stdout:Total 881 kB/s | 173 kB 00:00 2023-12-16T05:44:04.454 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-12-16T05:44:04.465 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-12-16T05:44:04.465 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-12-16T05:44:04.514 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-12-16T05:44:04.517 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-12-16T05:44:04.634 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-12-16T05:44:04.812 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:44:05.111 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:44:05.154 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:44:05.155 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:44:05.155 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-12-16T05:44:05.155 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:44:05.155 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-12-16T05:44:05.155 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 121 k 2023-12-16T05:44:05.155 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-12-16T05:44:05.156 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-16T05:44:05.156 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-16T05:44:05.156 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-16T05:44:05.156 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-16T05:44:05.156 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:44:05.156 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-12-16T05:44:05.156 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:44:05.156 INFO:teuthology.orchestra.run.smithi156.stdout:Install 5 Packages 2023-12-16T05:44:05.156 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:44:05.157 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 6.0 M 2023-12-16T05:44:05.157 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 26 M 2023-12-16T05:44:05.157 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-12-16T05:44:05.661 INFO:teuthology.orchestra.run.smithi156.stdout:(1/5): ceph-mgr-cephadm-17.2.7-125.g1f2f5510.el 629 kB/s | 121 kB 00:00 2023-12-16T05:44:05.803 INFO:teuthology.orchestra.run.smithi156.stdout:(2/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 3.3 MB/s | 476 kB 00:00 2023-12-16T05:44:05.830 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:44:05.830 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:44:05.830 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-12-16T05:44:05.830 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:44:05.830 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:44:05.830 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-16T05:44:05.845 INFO:teuthology.orchestra.run.smithi156.stdout:(3/5): python3-natsort-7.1.1-2.el8.noarch.rpm 1.4 MB/s | 60 kB 00:00 2023-12-16T05:44:06.038 DEBUG:teuthology.parallel:result is None 2023-12-16T05:48:14.272 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] python3-babel-2.5.1-7.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-babel-2.5.1-7.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:48:14.272 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] python3-jinja2-2.10.1-3.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.10.1-3.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-16T05:48:14.818 INFO:teuthology.orchestra.run.smithi156.stdout:(4/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 2.2 kB/s | 538 kB 04:09 2023-12-16T05:48:15.376 INFO:teuthology.orchestra.run.smithi156.stdout:(5/5): python3-babel-2.5.1-7.el8.noarch.rpm 20 kB/s | 4.8 MB 04:09 2023-12-16T05:48:15.377 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:48:15.377 INFO:teuthology.orchestra.run.smithi156.stdout:Total 24 kB/s | 6.0 MB 04:10 2023-12-16T05:48:15.429 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-12-16T05:48:15.441 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-12-16T05:48:15.441 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-12-16T05:48:15.544 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-12-16T05:48:15.547 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-12-16T05:48:15.807 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-12-16T05:48:16.124 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-16T05:48:17.072 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-16T05:48:17.434 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-16T05:48:17.682 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-16T05:48:17.864 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 5/5 2023-12-16T05:48:18.151 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 5/5 2023-12-16T05:48:18.151 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/5 2023-12-16T05:48:18.151 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-16T05:48:18.151 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-16T05:48:18.151 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-16T05:48:18.851 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-16T05:48:18.851 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:48:18.851 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-12-16T05:48:18.851 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T05:48:18.851 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-16T05:48:18.851 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-16T05:48:18.851 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-16T05:48:18.852 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-16T05:48:18.852 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:48:18.852 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:48:18.977 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-fuse 2023-12-16T05:48:19.844 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:32:06 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:48:21.538 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:48:21.538 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:48:21.538 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-12-16T05:48:21.538 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:48:21.539 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-12-16T05:48:21.539 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 875 k 2023-12-16T05:48:21.539 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-12-16T05:48:21.539 INFO:teuthology.orchestra.run.smithi156.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-16T05:48:21.539 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:48:21.539 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-12-16T05:48:21.539 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:48:21.539 INFO:teuthology.orchestra.run.smithi156.stdout:Install 2 Packages 2023-12-16T05:48:21.539 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:48:21.540 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 958 k 2023-12-16T05:48:21.540 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 3.0 M 2023-12-16T05:48:21.540 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-12-16T05:48:22.118 INFO:teuthology.orchestra.run.smithi156.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 209 kB/s | 83 kB 00:00 2023-12-16T05:48:22.185 INFO:teuthology.orchestra.run.smithi156.stdout:(2/2): ceph-fuse-17.2.7-125.g1f2f5510.el8.x86_6 1.8 MB/s | 875 kB 00:00 2023-12-16T05:48:22.185 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:48:22.185 INFO:teuthology.orchestra.run.smithi156.stdout:Total 1.4 MB/s | 958 kB 00:00 2023-12-16T05:48:22.196 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-12-16T05:48:22.218 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-12-16T05:48:22.218 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-12-16T05:48:22.306 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-12-16T05:48:22.309 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-12-16T05:48:22.476 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-12-16T05:48:22.738 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-16T05:48:22.921 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2/2 2023-12-16T05:48:23.325 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2/2 2023-12-16T05:48:23.325 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/2 2023-12-16T05:48:24.019 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-16T05:48:24.019 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:48:24.019 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-12-16T05:48:24.019 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-16T05:48:24.019 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:48:24.019 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:48:24.211 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install librados-devel 2023-12-16T05:48:25.074 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:32:12 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:48:26.758 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:48:26.759 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:48:26.759 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-12-16T05:48:26.759 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:48:26.759 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-12-16T05:48:26.759 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 130 k 2023-12-16T05:48:26.759 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:48:26.759 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-12-16T05:48:26.759 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:48:26.759 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-12-16T05:48:26.759 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:48:26.760 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 130 k 2023-12-16T05:48:26.760 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 464 k 2023-12-16T05:48:26.760 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-12-16T05:48:27.106 INFO:teuthology.orchestra.run.smithi156.stdout:librados-devel-17.2.7-125.g1f2f5510.el8.x86_64. 375 kB/s | 130 kB 00:00 2023-12-16T05:48:27.106 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:48:27.106 INFO:teuthology.orchestra.run.smithi156.stdout:Total 374 kB/s | 130 kB 00:00 2023-12-16T05:48:27.107 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-12-16T05:48:27.112 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-12-16T05:48:27.112 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-12-16T05:48:27.162 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-12-16T05:48:27.165 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-12-16T05:48:27.274 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-12-16T05:48:27.503 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:48:27.797 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:48:28.464 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:48:28.464 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:48:28.464 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-12-16T05:48:28.464 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:48:28.464 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:48:28.464 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:48:28.658 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install libcephfs2 2023-12-16T05:48:29.518 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:32:16 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:48:30.978 INFO:teuthology.orchestra.run.smithi156.stdout:Package libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T05:48:31.205 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:48:31.206 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-12-16T05:48:31.206 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:48:31.372 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install libcephfs-devel 2023-12-16T05:48:32.226 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:32:19 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:48:34.007 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:48:34.007 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:48:34.007 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-12-16T05:48:34.007 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:48:34.008 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-12-16T05:48:34.008 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 25 k 2023-12-16T05:48:34.008 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:48:34.008 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-12-16T05:48:34.008 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:48:34.008 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-12-16T05:48:34.008 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:48:34.008 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 25 k 2023-12-16T05:48:34.009 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 109 k 2023-12-16T05:48:34.009 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-12-16T05:48:34.143 INFO:teuthology.orchestra.run.smithi156.stdout:libcephfs-devel-17.2.7-125.g1f2f5510.el8.x86_64 186 kB/s | 25 kB 00:00 2023-12-16T05:48:34.143 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:48:34.143 INFO:teuthology.orchestra.run.smithi156.stdout:Total 184 kB/s | 25 kB 00:00 2023-12-16T05:48:34.144 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-12-16T05:48:34.149 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-12-16T05:48:34.149 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-12-16T05:48:34.149 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-12-16T05:48:34.152 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-12-16T05:48:34.200 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-12-16T05:48:34.394 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:48:34.657 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:48:35.312 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:48:35.313 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:48:35.313 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-12-16T05:48:35.313 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:48:35.313 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:48:35.313 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:48:35.430 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install librados2 2023-12-16T05:48:36.279 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:32:23 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:48:37.745 INFO:teuthology.orchestra.run.smithi156.stdout:Package librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T05:48:37.978 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:48:37.979 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-12-16T05:48:37.979 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:48:38.083 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install librbd1 2023-12-16T05:48:38.942 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:32:25 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:48:40.420 INFO:teuthology.orchestra.run.smithi156.stdout:Package librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T05:48:40.648 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:48:40.649 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-12-16T05:48:40.650 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:48:40.748 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install python3-rados 2023-12-16T05:48:41.607 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:32:28 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:48:43.064 INFO:teuthology.orchestra.run.smithi156.stdout:Package python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T05:48:43.292 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:48:43.293 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-12-16T05:48:43.293 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:48:43.415 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install python3-rgw 2023-12-16T05:48:44.278 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:32:31 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:48:45.734 INFO:teuthology.orchestra.run.smithi156.stdout:Package python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T05:48:45.966 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:48:45.967 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-12-16T05:48:45.967 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:48:46.070 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install python3-cephfs 2023-12-16T05:48:46.923 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:32:33 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:48:48.388 INFO:teuthology.orchestra.run.smithi156.stdout:Package python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T05:48:48.622 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:48:48.623 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-12-16T05:48:48.623 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:48:48.716 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install python3-rbd 2023-12-16T05:48:49.574 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:32:36 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:48:51.024 INFO:teuthology.orchestra.run.smithi156.stdout:Package python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T05:48:51.253 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:48:51.255 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-12-16T05:48:51.255 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:48:51.364 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install rbd-fuse 2023-12-16T05:48:52.212 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:32:39 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:48:53.918 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:48:53.918 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:48:53.918 INFO:teuthology.orchestra.run.smithi156.stdout: Package Architecture Version Repository Size 2023-12-16T05:48:53.918 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:48:53.918 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-12-16T05:48:53.919 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 90 k 2023-12-16T05:48:53.919 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:48:53.919 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-12-16T05:48:53.919 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:48:53.919 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-12-16T05:48:53.919 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:48:53.919 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 90 k 2023-12-16T05:48:53.920 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 264 k 2023-12-16T05:48:53.920 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-12-16T05:48:54.088 INFO:teuthology.orchestra.run.smithi156.stdout:rbd-fuse-17.2.7-125.g1f2f5510.el8.x86_64.rpm 537 kB/s | 90 kB 00:00 2023-12-16T05:48:54.088 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:48:54.088 INFO:teuthology.orchestra.run.smithi156.stdout:Total 534 kB/s | 90 kB 00:00 2023-12-16T05:48:54.089 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-12-16T05:48:54.098 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-12-16T05:48:54.098 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-12-16T05:48:54.148 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-12-16T05:48:54.150 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-12-16T05:48:54.264 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-12-16T05:48:54.465 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:48:54.754 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:48:55.421 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:48:55.421 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:48:55.421 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-12-16T05:48:55.422 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:48:55.422 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:48:55.422 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:48:55.632 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install rbd-mirror 2023-12-16T05:48:56.500 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:32:43 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:48:58.187 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:48:58.187 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:48:58.187 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-12-16T05:48:58.187 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:48:58.187 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-12-16T05:48:58.187 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.5 M 2023-12-16T05:48:58.187 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:48:58.187 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-12-16T05:48:58.187 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:48:58.188 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-12-16T05:48:58.188 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:48:58.188 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 3.5 M 2023-12-16T05:48:58.188 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 16 M 2023-12-16T05:48:58.188 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-12-16T05:48:58.567 INFO:teuthology.orchestra.run.smithi156.stdout:rbd-mirror-17.2.7-125.g1f2f5510.el8.x86_64.rpm 9.1 MB/s | 3.5 MB 00:00 2023-12-16T05:48:58.567 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:48:58.568 INFO:teuthology.orchestra.run.smithi156.stdout:Total 9.1 MB/s | 3.5 MB 00:00 2023-12-16T05:48:58.568 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-12-16T05:48:58.579 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-12-16T05:48:58.579 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-12-16T05:48:58.642 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-12-16T05:48:58.645 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-12-16T05:48:59.079 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-12-16T05:48:59.274 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:48:59.696 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:49:00.382 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:49:00.382 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:49:00.382 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-12-16T05:49:00.382 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:49:00.382 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:49:00.383 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:49:00.607 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install rbd-nbd 2023-12-16T05:49:01.467 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:32:48 ago on Sat 16 Dec 2023 05:16:13 AM UTC. 2023-12-16T05:49:03.157 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-12-16T05:49:03.158 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:49:03.158 INFO:teuthology.orchestra.run.smithi156.stdout: Package Architecture Version Repository Size 2023-12-16T05:49:03.158 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:49:03.158 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-12-16T05:49:03.158 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 173 k 2023-12-16T05:49:03.158 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:49:03.158 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-12-16T05:49:03.159 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-12-16T05:49:03.159 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-12-16T05:49:03.159 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:49:03.159 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 173 k 2023-12-16T05:49:03.159 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 552 k 2023-12-16T05:49:03.159 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-12-16T05:49:03.345 INFO:teuthology.orchestra.run.smithi156.stdout:rbd-nbd-17.2.7-125.g1f2f5510.el8.x86_64.rpm 931 kB/s | 173 kB 00:00 2023-12-16T05:49:03.345 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:49:03.345 INFO:teuthology.orchestra.run.smithi156.stdout:Total 925 kB/s | 173 kB 00:00 2023-12-16T05:49:03.346 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-12-16T05:49:03.356 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-12-16T05:49:03.356 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-12-16T05:49:03.406 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-12-16T05:49:03.409 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-12-16T05:49:03.524 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-12-16T05:49:03.714 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:49:04.009 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:49:04.718 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T05:49:04.718 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:49:04.718 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-12-16T05:49:04.718 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T05:49:04.718 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:49:04.718 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-12-16T05:49:04.897 DEBUG:teuthology.parallel:result is None 2023-12-16T05:49:04.897 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T05:49:04.898 INFO:teuthology.packaging:ref: None 2023-12-16T05:49:04.898 INFO:teuthology.packaging:tag: None 2023-12-16T05:49:04.898 INFO:teuthology.packaging:branch: quincy 2023-12-16T05:49:04.898 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T05:49:04.898 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-16T05:49:05.250 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-16T05:49:05.278 INFO:teuthology.orchestra.run.smithi155.stdout:17.2.7-125.g1f2f5510.el8 2023-12-16T05:49:05.279 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-125.g1f2f5510.el8 2023-12-16T05:49:05.279 INFO:teuthology.task.install:The correct ceph version 17.2.7-125.g1f2f5510 is installed. 2023-12-16T05:49:05.281 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T05:49:05.281 INFO:teuthology.packaging:ref: None 2023-12-16T05:49:05.281 INFO:teuthology.packaging:tag: None 2023-12-16T05:49:05.281 INFO:teuthology.packaging:branch: quincy 2023-12-16T05:49:05.281 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T05:49:05.281 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-16T05:49:05.661 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-16T05:49:05.687 INFO:teuthology.orchestra.run.smithi156.stdout:17.2.7-125.g1f2f5510.el8 2023-12-16T05:49:05.687 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-125.g1f2f5510.el8 2023-12-16T05:49:05.688 INFO:teuthology.task.install:The correct ceph version 17.2.7-125.g1f2f5510 is installed. 2023-12-16T05:49:05.689 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-16T05:49:05.689 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-16T05:49:05.689 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-16T05:49:05.724 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-12-16T05:49:05.724 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-16T05:49:05.761 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-16T05:49:05.761 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-16T05:49:05.761 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2023-12-16T05:49:05.795 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-16T05:49:05.865 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-12-16T05:49:05.865 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/daemon-helper 2023-12-16T05:49:05.897 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-16T05:49:05.967 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-16T05:49:05.967 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-16T05:49:05.967 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-16T05:49:05.996 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-16T05:49:06.065 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-12-16T05:49:06.065 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-16T05:49:06.095 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-16T05:49:06.164 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-16T05:49:06.164 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-16T05:49:06.164 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2023-12-16T05:49:06.192 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-16T05:49:06.261 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-12-16T05:49:06.261 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/stdin-killer 2023-12-16T05:49:06.290 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-16T05:49:06.359 INFO:teuthology.run_tasks:Running task print... 2023-12-16T05:49:06.374 INFO:teuthology.task.print:**** done install task... 2023-12-16T05:49:06.374 INFO:teuthology.run_tasks:Running task cephadm... 2023-12-16T05:49:06.484 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678'} 2023-12-16T05:49:06.484 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2023-12-16T05:49:06.485 INFO:tasks.cephadm:Cluster fsid is d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:49:06.485 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-12-16T05:49:06.485 INFO:tasks.cephadm:No mon roles; fabricating mons 2023-12-16T05:49:06.485 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi155': '172.21.15.155', 'mon.smithi156': '172.21.15.156'} 2023-12-16T05:49:06.485 INFO:tasks.cephadm:Normalizing hostnames... 2023-12-16T05:49:06.485 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname $(hostname -s) 2023-12-16T05:49:06.514 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname $(hostname -s) 2023-12-16T05:49:06.544 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2023-12-16T05:49:06.545 DEBUG:teuthology.orchestra.run.smithi155:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-16T05:49:06.796 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 16 05:49 /home/ubuntu/cephtest/cephadm 2023-12-16T05:49:06.797 DEBUG:teuthology.orchestra.run.smithi156:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-16T05:49:07.037 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 16 05:49 /home/ubuntu/cephtest/cephadm 2023-12-16T05:49:07.038 DEBUG:teuthology.orchestra.run.smithi155:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-16T05:49:07.058 DEBUG:teuthology.orchestra.run.smithi156:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-16T05:49:07.113 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2023-12-16T05:49:07.113 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-16T05:49:07.115 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-16T05:49:07.968 INFO:teuthology.orchestra.run.smithi155.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-16T05:49:08.207 INFO:teuthology.orchestra.run.smithi156.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-16T05:49:33.271 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-12-16T05:49:33.271 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_version": "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)", 2023-12-16T05:49:33.271 INFO:teuthology.orchestra.run.smithi156.stdout: "image_id": "60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5", 2023-12-16T05:49:33.271 INFO:teuthology.orchestra.run.smithi156.stdout: "repo_digests": [ 2023-12-16T05:49:33.272 INFO:teuthology.orchestra.run.smithi156.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112" 2023-12-16T05:49:33.272 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-12-16T05:49:33.272 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-12-16T05:49:33.689 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T05:49:33.690 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_version": "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)", 2023-12-16T05:49:33.690 INFO:teuthology.orchestra.run.smithi155.stdout: "image_id": "60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5", 2023-12-16T05:49:33.690 INFO:teuthology.orchestra.run.smithi155.stdout: "repo_digests": [ 2023-12-16T05:49:33.690 INFO:teuthology.orchestra.run.smithi155.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112" 2023-12-16T05:49:33.690 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-12-16T05:49:33.690 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T05:49:33.707 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph 2023-12-16T05:49:33.737 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /etc/ceph 2023-12-16T05:49:33.769 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /etc/ceph 2023-12-16T05:49:33.805 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 777 /etc/ceph 2023-12-16T05:49:33.836 INFO:tasks.cephadm:Writing seed config... 2023-12-16T05:49:33.837 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2023-12-16T05:49:33.837 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2023-12-16T05:49:33.837 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-12-16T05:49:33.837 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-12-16T05:49:33.837 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-12-16T05:49:33.838 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-12-16T05:49:33.838 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-12-16T05:49:33.838 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-12-16T05:49:33.838 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-12-16T05:49:33.838 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-12-16T05:49:33.838 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-12-16T05:49:33.838 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-12-16T05:49:33.838 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-12-16T05:49:33.838 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-12-16T05:49:33.838 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-12-16T05:49:33.838 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-12-16T05:49:33.838 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-12-16T05:49:33.838 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-12-16T05:49:33.838 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-12-16T05:49:33.839 INFO:tasks.cephadm: override: [client] debug client = 20 2023-12-16T05:49:33.839 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-12-16T05:49:33.839 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-12-16T05:49:33.839 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-12-16T05:49:33.839 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2023-12-16T05:49:33.839 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-12-16T05:49:33.839 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-12-16T05:49:33.839 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-12-16T05:49:33.839 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-12-16T05:49:33.839 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-12-16T05:49:33.839 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-12-16T05:49:33.839 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-12-16T05:49:33.839 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-12-16T05:49:33.839 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-12-16T05:49:33.840 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-12-16T05:49:33.840 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-12-16T05:49:33.840 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-12-16T05:49:33.840 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-12-16T05:49:33.840 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-12-16T05:49:33.840 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-12-16T05:49:33.840 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-12-16T05:49:33.841 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-16T05:49:33.841 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-12-16T05:49:33.863 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d344784e-9bd6-11ee-95a5-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-12-16T05:49:33.863 DEBUG:teuthology.orchestra.run.smithi155:mon.smithi155> sudo journalctl -f -n 0 -u ceph-d344784e-9bd6-11ee-95a5-87774f69a715@mon.smithi155.service 2023-12-16T05:49:33.906 INFO:tasks.cephadm:Bootstrapping... 2023-12-16T05:49:33.906 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid d344784e-9bd6-11ee-95a5-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.155 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-12-16T05:49:33.932 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:-- Logs begin at Sat 2023-12-16 04:41:47 UTC. -- 2023-12-16T05:49:34.105 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-12-16T05:49:34.105 INFO:teuthology.orchestra.run.smithi155.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', 'd344784e-9bd6-11ee-95a5-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.155', '--skip-admin-label'] 2023-12-16T05:49:34.135 INFO:teuthology.orchestra.run.smithi155.stdout:/bin/podman: stdout 4.6.1 2023-12-16T05:49:34.135 INFO:teuthology.orchestra.run.smithi155.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-12-16T05:49:34.136 INFO:teuthology.orchestra.run.smithi155.stdout:Verifying podman|docker is present... 2023-12-16T05:49:34.171 INFO:teuthology.orchestra.run.smithi155.stdout:/bin/podman: stdout 4.6.1 2023-12-16T05:49:34.171 INFO:teuthology.orchestra.run.smithi155.stdout:Verifying lvm2 is present... 2023-12-16T05:49:34.171 INFO:teuthology.orchestra.run.smithi155.stdout:Verifying time synchronization is in place... 2023-12-16T05:49:34.178 INFO:teuthology.orchestra.run.smithi155.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-16T05:49:34.178 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-16T05:49:34.184 INFO:teuthology.orchestra.run.smithi155.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-16T05:49:34.184 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stdout inactive 2023-12-16T05:49:34.189 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stdout enabled 2023-12-16T05:49:34.195 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stdout active 2023-12-16T05:49:34.195 INFO:teuthology.orchestra.run.smithi155.stdout:Unit chronyd.service is enabled and running 2023-12-16T05:49:34.195 INFO:teuthology.orchestra.run.smithi155.stdout:Repeating the final host check... 2023-12-16T05:49:34.225 INFO:teuthology.orchestra.run.smithi155.stdout:/bin/podman: stdout 4.6.1 2023-12-16T05:49:34.225 INFO:teuthology.orchestra.run.smithi155.stdout:podman (/bin/podman) version 4.6.1 is present 2023-12-16T05:49:34.225 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl is present 2023-12-16T05:49:34.226 INFO:teuthology.orchestra.run.smithi155.stdout:lvcreate is present 2023-12-16T05:49:34.231 INFO:teuthology.orchestra.run.smithi155.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-16T05:49:34.232 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-16T05:49:34.237 INFO:teuthology.orchestra.run.smithi155.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-16T05:49:34.237 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stdout inactive 2023-12-16T05:49:34.243 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stdout enabled 2023-12-16T05:49:34.249 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stdout active 2023-12-16T05:49:34.249 INFO:teuthology.orchestra.run.smithi155.stdout:Unit chronyd.service is enabled and running 2023-12-16T05:49:34.249 INFO:teuthology.orchestra.run.smithi155.stdout:Host looks OK 2023-12-16T05:49:34.249 INFO:teuthology.orchestra.run.smithi155.stdout:Cluster fsid: d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:49:34.249 INFO:teuthology.orchestra.run.smithi155.stdout:Acquiring lock 140046662322664 on /run/cephadm/d344784e-9bd6-11ee-95a5-87774f69a715.lock 2023-12-16T05:49:34.249 INFO:teuthology.orchestra.run.smithi155.stdout:Lock 140046662322664 acquired on /run/cephadm/d344784e-9bd6-11ee-95a5-87774f69a715.lock 2023-12-16T05:49:34.250 INFO:teuthology.orchestra.run.smithi155.stdout:Verifying IP 172.21.15.155 port 3300 ... 2023-12-16T05:49:34.250 INFO:teuthology.orchestra.run.smithi155.stdout:Verifying IP 172.21.15.155 port 6789 ... 2023-12-16T05:49:34.250 INFO:teuthology.orchestra.run.smithi155.stdout:Base mon IP(s) is [172.21.15.155:3300, 172.21.15.155:6789], mon addrv is [v2:172.21.15.155:3300,v1:172.21.15.155:6789] 2023-12-16T05:49:34.254 INFO:teuthology.orchestra.run.smithi155.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.155 metric 100 2023-12-16T05:49:34.254 INFO:teuthology.orchestra.run.smithi155.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.155 metric 100 2023-12-16T05:49:34.257 INFO:teuthology.orchestra.run.smithi155.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-12-16T05:49:34.257 INFO:teuthology.orchestra.run.smithi155.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2023-12-16T05:49:34.257 INFO:teuthology.orchestra.run.smithi155.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1768sec hoplimit 64 pref medium 2023-12-16T05:49:34.260 INFO:teuthology.orchestra.run.smithi155.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-12-16T05:49:34.260 INFO:teuthology.orchestra.run.smithi155.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-12-16T05:49:34.260 INFO:teuthology.orchestra.run.smithi155.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-16T05:49:34.260 INFO:teuthology.orchestra.run.smithi155.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-12-16T05:49:34.260 INFO:teuthology.orchestra.run.smithi155.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2023-12-16T05:49:34.260 INFO:teuthology.orchestra.run.smithi155.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-16T05:49:34.261 INFO:teuthology.orchestra.run.smithi155.stdout:Mon IP `172.21.15.155` is in CIDR network `172.21.0.0/20` 2023-12-16T05:49:34.261 INFO:teuthology.orchestra.run.smithi155.stdout:Mon IP `172.21.15.155` is in CIDR network `172.21.0.0/20` 2023-12-16T05:49:34.261 INFO:teuthology.orchestra.run.smithi155.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-12-16T05:49:34.261 INFO:teuthology.orchestra.run.smithi155.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-12-16T05:49:34.262 INFO:teuthology.orchestra.run.smithi155.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-16T05:49:34.577 INFO:teuthology.orchestra.run.smithi155.stdout:/bin/podman: stdout 60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5 2023-12-16T05:49:34.577 INFO:teuthology.orchestra.run.smithi155.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-16T05:49:34.577 INFO:teuthology.orchestra.run.smithi155.stdout:/bin/podman: stderr Getting image source signatures 2023-12-16T05:49:34.577 INFO:teuthology.orchestra.run.smithi155.stdout:/bin/podman: stderr Copying blob sha256:3c21fa6304a567e69d15522c48775b11468df75d53cc353263c55c753e1a9b4e 2023-12-16T05:49:34.577 INFO:teuthology.orchestra.run.smithi155.stdout:/bin/podman: stderr Copying blob sha256:46af8f5390d4e94fc57efb422ccb97bb53dfe5b948546bfc191b46557eb2dbd9 2023-12-16T05:49:34.577 INFO:teuthology.orchestra.run.smithi155.stdout:/bin/podman: stderr Copying config sha256:60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5 2023-12-16T05:49:34.577 INFO:teuthology.orchestra.run.smithi155.stdout:/bin/podman: stderr Writing manifest to image destination 2023-12-16T05:49:35.261 INFO:teuthology.orchestra.run.smithi155.stdout:ceph: stdout ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable) 2023-12-16T05:49:35.261 INFO:teuthology.orchestra.run.smithi155.stdout:Ceph version: ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable) 2023-12-16T05:49:35.261 INFO:teuthology.orchestra.run.smithi155.stdout:Extracting ceph user uid/gid from container image... 2023-12-16T05:49:35.886 INFO:teuthology.orchestra.run.smithi155.stdout:stat: stdout 167 167 2023-12-16T05:49:35.886 INFO:teuthology.orchestra.run.smithi155.stdout:Creating initial keys... 2023-12-16T05:49:36.516 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph-authtool: stdout AQBwOn1lYBmyCBAAbB1wNR+GU9LnLEZJUC0RbA== 2023-12-16T05:49:37.113 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph-authtool: stdout AQBwOn1l2uzoLBAAtjGNQZbi76b1BkUvrI1MmA== 2023-12-16T05:49:37.696 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph-authtool: stdout AQBxOn1liTYUFRAAxMsyOWzFLFzPkvtQgznqBg== 2023-12-16T05:49:37.697 INFO:teuthology.orchestra.run.smithi155.stdout:Creating initial monmap... 2023-12-16T05:49:38.327 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-16T05:49:38.327 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2023-12-16T05:49:38.327 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:49:38.327 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-16T05:49:38.327 INFO:teuthology.orchestra.run.smithi155.stdout:monmaptool for smithi155 [v2:172.21.15.155:3300,v1:172.21.15.155:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-16T05:49:38.327 INFO:teuthology.orchestra.run.smithi155.stdout:setting min_mon_release = octopus 2023-12-16T05:49:38.327 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/monmaptool: set fsid to d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:49:38.327 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-16T05:49:38.327 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:49:38.327 INFO:teuthology.orchestra.run.smithi155.stdout:Creating mon... 2023-12-16T05:49:38.931 INFO:teuthology.orchestra.run.smithi155.stdout:create mon.smithi155 on 2023-12-16T05:49:39.024 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-12-16T05:49:39.109 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-12-16T05:49:39.200 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d344784e-9bd6-11ee-95a5-87774f69a715.target → /etc/systemd/system/ceph-d344784e-9bd6-11ee-95a5-87774f69a715.target. 2023-12-16T05:49:39.200 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-d344784e-9bd6-11ee-95a5-87774f69a715.target → /etc/systemd/system/ceph-d344784e-9bd6-11ee-95a5-87774f69a715.target. 2023-12-16T05:49:39.319 INFO:teuthology.orchestra.run.smithi155.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d344784e-9bd6-11ee-95a5-87774f69a715@mon.smithi155 2023-12-16T05:49:39.319 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d344784e-9bd6-11ee-95a5-87774f69a715@mon.smithi155.service: Unit ceph-d344784e-9bd6-11ee-95a5-87774f69a715@mon.smithi155.service not loaded. 2023-12-16T05:49:39.409 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d344784e-9bd6-11ee-95a5-87774f69a715.target.wants/ceph-d344784e-9bd6-11ee-95a5-87774f69a715@mon.smithi155.service → /etc/systemd/system/ceph-d344784e-9bd6-11ee-95a5-87774f69a715@.service. 2023-12-16T05:49:39.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:39 smithi155 systemd[1]: Starting Ceph mon.smithi155 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T05:49:39.782 INFO:teuthology.orchestra.run.smithi155.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-16T05:49:39.782 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stdout disabled 2023-12-16T05:49:39.790 INFO:teuthology.orchestra.run.smithi155.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-16T05:49:39.790 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stdout inactive 2023-12-16T05:49:39.790 INFO:teuthology.orchestra.run.smithi155.stdout:firewalld.service is not enabled 2023-12-16T05:49:39.790 INFO:teuthology.orchestra.run.smithi155.stdout:Not possible to enable service . firewalld.service is not available 2023-12-16T05:49:39.791 INFO:teuthology.orchestra.run.smithi155.stdout:Waiting for mon to start... 2023-12-16T05:49:39.791 INFO:teuthology.orchestra.run.smithi155.stdout:Waiting for mon... 2023-12-16T05:49:40.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:39 smithi155 bash[111932]: c9d86e2ad331297d3879c78db5385c9a021b4a13701159f3659b0da499ae38a5 2023-12-16T05:49:40.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:39 smithi155 systemd[1]: Started Ceph mon.smithi155 for d344784e-9bd6-11ee-95a5-87774f69a715. 2023-12-16T05:49:40.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:39 smithi155 ceph-mon[111969]: mkfs d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:49:40.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:39 smithi155 ceph-mon[111969]: mon.smithi155 is new leader, mons smithi155 in quorum (ranks 0) 2023-12-16T05:49:40.596 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout cluster: 2023-12-16T05:49:40.597 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout id: d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:49:40.597 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-12-16T05:49:40.597 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout 2023-12-16T05:49:40.597 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout services: 2023-12-16T05:49:40.602 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi155 (age 0.438587s) 2023-12-16T05:49:40.603 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-12-16T05:49:40.603 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-12-16T05:49:40.603 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout 2023-12-16T05:49:40.603 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout data: 2023-12-16T05:49:40.603 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-12-16T05:49:40.603 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-12-16T05:49:40.603 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-12-16T05:49:40.603 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout pgs: 2023-12-16T05:49:40.603 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout 2023-12-16T05:49:40.603 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.165+0000 7fa02669d700 1 Processor -- start 2023-12-16T05:49:40.603 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.165+0000 7fa02669d700 1 -- start start 2023-12-16T05:49:40.603 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.165+0000 7fa02669d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0201022b0 0x7fa0201026c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:40.604 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.165+0000 7fa02669d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa020102c00 con 0x7fa0201022b0 2023-12-16T05:49:40.604 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.166+0000 7fa01ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0201022b0 0x7fa0201026c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:40.604 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.166+0000 7fa01ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0201022b0 0x7fa0201026c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:57072/0 (socket says 172.21.15.155:57072) 2023-12-16T05:49:40.604 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.166+0000 7fa01ffff700 1 -- 172.21.15.155:0/975602726 learned_addr learned my addr 172.21.15.155:0/975602726 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:49:40.604 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.166+0000 7fa01ffff700 1 -- 172.21.15.155:0/975602726 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa020102d40 con 0x7fa0201022b0 2023-12-16T05:49:40.604 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.166+0000 7fa01ffff700 1 --2- 172.21.15.155:0/975602726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0201022b0 0x7fa0201026c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa0080098e0 tx=0x7fa008009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c48128c0e81c98 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:40.604 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.166+0000 7fa01effd700 1 -- 172.21.15.155:0/975602726 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa00800b860 con 0x7fa0201022b0 2023-12-16T05:49:40.604 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.166+0000 7fa01effd700 1 -- 172.21.15.155:0/975602726 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00800b9c0 con 0x7fa0201022b0 2023-12-16T05:49:40.604 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.166+0000 7fa01effd700 1 -- 172.21.15.155:0/975602726 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa00800bc90 con 0x7fa0201022b0 2023-12-16T05:49:40.604 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.167+0000 7fa02669d700 1 -- 172.21.15.155:0/975602726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0201022b0 msgr2=0x7fa0201026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:40.604 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.167+0000 7fa02669d700 1 --2- 172.21.15.155:0/975602726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0201022b0 0x7fa0201026c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa0080098e0 tx=0x7fa008009250 comp rx=0 tx=0).stop 2023-12-16T05:49:40.604 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.167+0000 7fa02669d700 1 -- 172.21.15.155:0/975602726 shutdown_connections 2023-12-16T05:49:40.604 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.167+0000 7fa02669d700 1 --2- 172.21.15.155:0/975602726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0201022b0 0x7fa0201026c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:40.604 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.167+0000 7fa02669d700 1 -- 172.21.15.155:0/975602726 >> 172.21.15.155:0/975602726 conn(0x7fa0200fda10 msgr2=0x7fa0200ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:49:40.605 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.167+0000 7fa02669d700 1 -- 172.21.15.155:0/975602726 shutdown_connections 2023-12-16T05:49:40.605 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.167+0000 7fa02669d700 1 -- 172.21.15.155:0/975602726 wait complete. 2023-12-16T05:49:40.605 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.168+0000 7fa02669d700 1 Processor -- start 2023-12-16T05:49:40.605 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.168+0000 7fa02669d700 1 -- start start 2023-12-16T05:49:40.605 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.168+0000 7fa02669d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0201022b0 0x7fa0201109b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:40.605 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.168+0000 7fa02669d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa020110ef0 con 0x7fa0201022b0 2023-12-16T05:49:40.605 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.168+0000 7fa01ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0201022b0 0x7fa0201109b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:40.605 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.168+0000 7fa01ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0201022b0 0x7fa0201109b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:57086/0 (socket says 172.21.15.155:57086) 2023-12-16T05:49:40.605 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.168+0000 7fa01ffff700 1 -- 172.21.15.155:0/3296619790 learned_addr learned my addr 172.21.15.155:0/3296619790 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:49:40.605 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.168+0000 7fa01ffff700 1 -- 172.21.15.155:0/3296619790 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0080094f0 con 0x7fa0201022b0 2023-12-16T05:49:40.605 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.169+0000 7fa01ffff700 1 --2- 172.21.15.155:0/3296619790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0201022b0 0x7fa0201109b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa008003080 tx=0x7fa008016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:40.605 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.169+0000 7fa01cff9700 1 -- 172.21.15.155:0/3296619790 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa00801c5c0 con 0x7fa0201022b0 2023-12-16T05:49:40.605 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.169+0000 7fa01cff9700 1 -- 172.21.15.155:0/3296619790 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00801c720 con 0x7fa0201022b0 2023-12-16T05:49:40.605 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.169+0000 7fa02669d700 1 -- 172.21.15.155:0/3296619790 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0201110f0 con 0x7fa0201022b0 2023-12-16T05:49:40.606 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.169+0000 7fa01cff9700 1 -- 172.21.15.155:0/3296619790 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa00801ca30 con 0x7fa0201022b0 2023-12-16T05:49:40.606 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.169+0000 7fa02669d700 1 -- 172.21.15.155:0/3296619790 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa020111500 con 0x7fa0201022b0 2023-12-16T05:49:40.606 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.169+0000 7fa01cff9700 1 -- 172.21.15.155:0/3296619790 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa00801a450 con 0x7fa0201022b0 2023-12-16T05:49:40.606 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.169+0000 7fa01cff9700 1 -- 172.21.15.155:0/3296619790 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa00802e790 con 0x7fa0201022b0 2023-12-16T05:49:40.606 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.170+0000 7fa02669d700 1 -- 172.21.15.155:0/3296619790 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa02004bb80 con 0x7fa0201022b0 2023-12-16T05:49:40.606 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.172+0000 7fa01cff9700 1 -- 172.21.15.155:0/3296619790 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fa00801a890 con 0x7fa0201022b0 2023-12-16T05:49:40.606 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.241+0000 7fa02669d700 1 -- 172.21.15.155:0/3296619790 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fa020109c80 con 0x7fa0201022b0 2023-12-16T05:49:40.606 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.242+0000 7fa01cff9700 1 -- 172.21.15.155:0/3296619790 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7fa00801aa30 con 0x7fa0201022b0 2023-12-16T05:49:40.606 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.243+0000 7fa02669d700 1 -- 172.21.15.155:0/3296619790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0201022b0 msgr2=0x7fa0201109b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:40.606 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.243+0000 7fa02669d700 1 --2- 172.21.15.155:0/3296619790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0201022b0 0x7fa0201109b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa008003080 tx=0x7fa008016000 comp rx=0 tx=0).stop 2023-12-16T05:49:40.606 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.243+0000 7fa02669d700 1 -- 172.21.15.155:0/3296619790 shutdown_connections 2023-12-16T05:49:40.606 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.243+0000 7fa02669d700 1 --2- 172.21.15.155:0/3296619790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0201022b0 0x7fa0201109b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:40.607 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.243+0000 7fa02669d700 1 -- 172.21.15.155:0/3296619790 >> 172.21.15.155:0/3296619790 conn(0x7fa0200fda10 msgr2=0x7fa020105010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:49:40.607 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.243+0000 7fa02669d700 1 -- 172.21.15.155:0/3296619790 shutdown_connections 2023-12-16T05:49:40.607 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:40.243+0000 7fa02669d700 1 -- 172.21.15.155:0/3296619790 wait complete. 2023-12-16T05:49:40.607 INFO:teuthology.orchestra.run.smithi155.stdout:mon is available 2023-12-16T05:49:40.607 INFO:teuthology.orchestra.run.smithi155.stdout:Assimilating anything we can from ceph.conf... 2023-12-16T05:49:41.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:40 smithi155 ceph-mon[111969]: mon.smithi155 is new leader, mons smithi155 in quorum (ranks 0) 2023-12-16T05:49:41.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:40 smithi155 ceph-mon[111969]: monmap e1: 1 mons at {smithi155=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T05:49:41.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:40 smithi155 ceph-mon[111969]: fsmap 2023-12-16T05:49:41.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:40 smithi155 ceph-mon[111969]: osdmap e1: 0 total, 0 up, 0 in 2023-12-16T05:49:41.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:40 smithi155 ceph-mon[111969]: mgrmap e1: no daemons active 2023-12-16T05:49:41.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:40 smithi155 ceph-mon[111969]: from='client.? 172.21.15.155:0/3296619790' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-12-16T05:49:41.479 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout 2023-12-16T05:49:41.479 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout [global] 2023-12-16T05:49:41.480 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout fsid = d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:49:41.480 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.155:3300,v1:172.21.15.155:6789] 2023-12-16T05:49:41.480 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-16T05:49:41.480 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-16T05:49:41.480 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-16T05:49:41.480 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-16T05:49:41.480 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout 2023-12-16T05:49:41.480 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-16T05:49:41.480 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-16T05:49:41.485 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout 2023-12-16T05:49:41.485 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout [osd] 2023-12-16T05:49:41.485 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-16T05:49:41.485 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-16T05:49:41.485 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-16T05:49:41.486 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-16T05:49:41.486 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-16T05:49:41.486 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.045+0000 7fe8b602f700 1 Processor -- start 2023-12-16T05:49:41.486 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.045+0000 7fe8b602f700 1 -- start start 2023-12-16T05:49:41.486 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.045+0000 7fe8b602f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8b0070fc0 0x7fe8b0104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:41.486 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.045+0000 7fe8b602f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b0105420 con 0x7fe8b0070fc0 2023-12-16T05:49:41.486 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.046+0000 7fe8af7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8b0070fc0 0x7fe8b0104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:41.486 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.046+0000 7fe8af7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8b0070fc0 0x7fe8b0104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:57094/0 (socket says 172.21.15.155:57094) 2023-12-16T05:49:41.486 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.046+0000 7fe8af7fe700 1 -- 172.21.15.155:0/2699054711 learned_addr learned my addr 172.21.15.155:0/2699054711 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:49:41.486 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.046+0000 7fe8af7fe700 1 -- 172.21.15.155:0/2699054711 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b0105560 con 0x7fe8b0070fc0 2023-12-16T05:49:41.486 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.046+0000 7fe8af7fe700 1 --2- 172.21.15.155:0/2699054711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8b0070fc0 0x7fe8b0104ee0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40098e0 tx=0x7fe8a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae78df3649458ca server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:41.486 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.046+0000 7fe8ae7fc700 1 -- 172.21.15.155:0/2699054711 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8a400b860 con 0x7fe8b0070fc0 2023-12-16T05:49:41.486 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.046+0000 7fe8ae7fc700 1 -- 172.21.15.155:0/2699054711 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a400b9c0 con 0x7fe8b0070fc0 2023-12-16T05:49:41.486 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.046+0000 7fe8ae7fc700 1 -- 172.21.15.155:0/2699054711 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8a400bc90 con 0x7fe8b0070fc0 2023-12-16T05:49:41.486 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.047+0000 7fe8b602f700 1 -- 172.21.15.155:0/2699054711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8b0070fc0 msgr2=0x7fe8b0104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:41.486 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.047+0000 7fe8b602f700 1 --2- 172.21.15.155:0/2699054711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8b0070fc0 0x7fe8b0104ee0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40098e0 tx=0x7fe8a4009250 comp rx=0 tx=0).stop 2023-12-16T05:49:41.487 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.047+0000 7fe8b602f700 1 -- 172.21.15.155:0/2699054711 shutdown_connections 2023-12-16T05:49:41.487 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.047+0000 7fe8b602f700 1 --2- 172.21.15.155:0/2699054711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8b0070fc0 0x7fe8b0104ee0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:41.487 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.047+0000 7fe8b602f700 1 -- 172.21.15.155:0/2699054711 >> 172.21.15.155:0/2699054711 conn(0x7fe8b00fc970 msgr2=0x7fe8b00fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:49:41.487 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.047+0000 7fe8b602f700 1 -- 172.21.15.155:0/2699054711 shutdown_connections 2023-12-16T05:49:41.487 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.047+0000 7fe8b602f700 1 -- 172.21.15.155:0/2699054711 wait complete. 2023-12-16T05:49:41.487 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.047+0000 7fe8b602f700 1 Processor -- start 2023-12-16T05:49:41.487 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.047+0000 7fe8b602f700 1 -- start start 2023-12-16T05:49:41.487 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.048+0000 7fe8b602f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8b0070fc0 0x7fe8b0102960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:41.487 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.048+0000 7fe8b602f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b0100de0 con 0x7fe8b0070fc0 2023-12-16T05:49:41.487 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.048+0000 7fe8af7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8b0070fc0 0x7fe8b0102960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:41.487 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.048+0000 7fe8af7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8b0070fc0 0x7fe8b0102960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:57108/0 (socket says 172.21.15.155:57108) 2023-12-16T05:49:41.488 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.048+0000 7fe8af7fe700 1 -- 172.21.15.155:0/2610306641 learned_addr learned my addr 172.21.15.155:0/2610306641 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:49:41.488 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.048+0000 7fe8af7fe700 1 -- 172.21.15.155:0/2610306641 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a40094f0 con 0x7fe8b0070fc0 2023-12-16T05:49:41.488 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.048+0000 7fe8af7fe700 1 --2- 172.21.15.155:0/2610306641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8b0070fc0 0x7fe8b0102960 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4009290 tx=0x7fe8a4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:41.488 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.048+0000 7fe897fff700 1 -- 172.21.15.155:0/2610306641 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8a401c5c0 con 0x7fe8b0070fc0 2023-12-16T05:49:41.488 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.048+0000 7fe897fff700 1 -- 172.21.15.155:0/2610306641 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a401c740 con 0x7fe8b0070fc0 2023-12-16T05:49:41.488 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.048+0000 7fe8b602f700 1 -- 172.21.15.155:0/2610306641 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b0100fe0 con 0x7fe8b0070fc0 2023-12-16T05:49:41.488 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.048+0000 7fe897fff700 1 -- 172.21.15.155:0/2610306641 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8a401ca50 con 0x7fe8b0070fc0 2023-12-16T05:49:41.488 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.048+0000 7fe8b602f700 1 -- 172.21.15.155:0/2610306641 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b01013f0 con 0x7fe8b0070fc0 2023-12-16T05:49:41.488 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.049+0000 7fe897fff700 1 -- 172.21.15.155:0/2610306641 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe8a401a450 con 0x7fe8b0070fc0 2023-12-16T05:49:41.488 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.049+0000 7fe897fff700 1 -- 172.21.15.155:0/2610306641 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe8a402e790 con 0x7fe8b0070fc0 2023-12-16T05:49:41.488 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.049+0000 7fe8b602f700 1 -- 172.21.15.155:0/2610306641 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b004bb80 con 0x7fe8b0070fc0 2023-12-16T05:49:41.488 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.052+0000 7fe897fff700 1 -- 172.21.15.155:0/2610306641 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe8a401ce30 con 0x7fe8b0070fc0 2023-12-16T05:49:41.488 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.119+0000 7fe8b602f700 1 -- 172.21.15.155:0/2610306641 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fe8b0105870 con 0x7fe8b0070fc0 2023-12-16T05:49:41.488 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.123+0000 7fe897fff700 1 -- 172.21.15.155:0/2610306641 <== mon.0 v2:172.21.15.155:3300/0 7 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe8a401b3e0 con 0x7fe8b0070fc0 2023-12-16T05:49:41.489 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.123+0000 7fe897fff700 1 -- 172.21.15.155:0/2610306641 <== mon.0 v2:172.21.15.155:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7fe8a402e950 con 0x7fe8b0070fc0 2023-12-16T05:49:41.489 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.124+0000 7fe8b602f700 1 -- 172.21.15.155:0/2610306641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8b0070fc0 msgr2=0x7fe8b0102960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:41.489 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.124+0000 7fe8b602f700 1 --2- 172.21.15.155:0/2610306641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8b0070fc0 0x7fe8b0102960 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4009290 tx=0x7fe8a4016000 comp rx=0 tx=0).stop 2023-12-16T05:49:41.489 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.124+0000 7fe8b602f700 1 -- 172.21.15.155:0/2610306641 shutdown_connections 2023-12-16T05:49:41.489 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.124+0000 7fe8b602f700 1 --2- 172.21.15.155:0/2610306641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8b0070fc0 0x7fe8b0102960 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:41.489 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.124+0000 7fe8b602f700 1 -- 172.21.15.155:0/2610306641 >> 172.21.15.155:0/2610306641 conn(0x7fe8b00fc970 msgr2=0x7fe8b00fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:49:41.489 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.124+0000 7fe8b602f700 1 -- 172.21.15.155:0/2610306641 shutdown_connections 2023-12-16T05:49:41.489 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.124+0000 7fe8b602f700 1 -- 172.21.15.155:0/2610306641 wait complete. 2023-12-16T05:49:41.489 INFO:teuthology.orchestra.run.smithi155.stdout:Generating new minimal ceph.conf... 2023-12-16T05:49:42.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:41 smithi155 ceph-mon[111969]: from='client.? 172.21.15.155:0/2610306641' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-16T05:49:42.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:41 smithi155 ceph-mon[111969]: from='client.? 172.21.15.155:0/2610306641' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-12-16T05:49:42.225 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.803+0000 7f36d409d700 1 Processor -- start 2023-12-16T05:49:42.225 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.804+0000 7f36d409d700 1 -- start start 2023-12-16T05:49:42.225 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.804+0000 7f36d409d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc076c60 0x7f36cc104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:42.225 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.804+0000 7f36d409d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc1053d0 con 0x7f36cc076c60 2023-12-16T05:49:42.225 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.804+0000 7f36d1e39700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc076c60 0x7f36cc104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:42.225 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.804+0000 7f36d1e39700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc076c60 0x7f36cc104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:57112/0 (socket says 172.21.15.155:57112) 2023-12-16T05:49:42.225 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.804+0000 7f36d1e39700 1 -- 172.21.15.155:0/3325216687 learned_addr learned my addr 172.21.15.155:0/3325216687 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:49:42.225 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.804+0000 7f36d1e39700 1 -- 172.21.15.155:0/3325216687 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36cc105510 con 0x7f36cc076c60 2023-12-16T05:49:42.225 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.804+0000 7f36d1e39700 1 --2- 172.21.15.155:0/3325216687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc076c60 0x7f36cc104e90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f36c00098e0 tx=0x7f36c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caacd7f5087c2c34 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:42.225 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.804+0000 7f36d0e37700 1 -- 172.21.15.155:0/3325216687 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f36c000b860 con 0x7f36cc076c60 2023-12-16T05:49:42.225 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.804+0000 7f36d0e37700 1 -- 172.21.15.155:0/3325216687 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f36c000be30 con 0x7f36cc076c60 2023-12-16T05:49:42.226 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.804+0000 7f36d0e37700 1 -- 172.21.15.155:0/3325216687 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f36c0010380 con 0x7f36cc076c60 2023-12-16T05:49:42.226 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.805+0000 7f36d409d700 1 -- 172.21.15.155:0/3325216687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc076c60 msgr2=0x7f36cc104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:42.226 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.805+0000 7f36d409d700 1 --2- 172.21.15.155:0/3325216687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc076c60 0x7f36cc104e90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f36c00098e0 tx=0x7f36c0009250 comp rx=0 tx=0).stop 2023-12-16T05:49:42.226 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.805+0000 7f36d409d700 1 -- 172.21.15.155:0/3325216687 shutdown_connections 2023-12-16T05:49:42.226 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.805+0000 7f36d409d700 1 --2- 172.21.15.155:0/3325216687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc076c60 0x7f36cc104e90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:42.226 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.805+0000 7f36d409d700 1 -- 172.21.15.155:0/3325216687 >> 172.21.15.155:0/3325216687 conn(0x7f36cc0fc980 msgr2=0x7f36cc0fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:49:42.226 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.805+0000 7f36d409d700 1 -- 172.21.15.155:0/3325216687 shutdown_connections 2023-12-16T05:49:42.226 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.805+0000 7f36d409d700 1 -- 172.21.15.155:0/3325216687 wait complete. 2023-12-16T05:49:42.226 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.805+0000 7f36d409d700 1 Processor -- start 2023-12-16T05:49:42.226 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.806+0000 7f36d409d700 1 -- start start 2023-12-16T05:49:42.226 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.806+0000 7f36d409d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc076c60 0x7f36cc111120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:42.226 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.806+0000 7f36d409d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc111660 con 0x7f36cc076c60 2023-12-16T05:49:42.226 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.806+0000 7f36d1e39700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc076c60 0x7f36cc111120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:42.226 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.806+0000 7f36d1e39700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc076c60 0x7f36cc111120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:57116/0 (socket says 172.21.15.155:57116) 2023-12-16T05:49:42.226 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.806+0000 7f36d1e39700 1 -- 172.21.15.155:0/1846188907 learned_addr learned my addr 172.21.15.155:0/1846188907 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:49:42.227 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.806+0000 7f36d1e39700 1 -- 172.21.15.155:0/1846188907 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c00094f0 con 0x7f36cc076c60 2023-12-16T05:49:42.227 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.806+0000 7f36d1e39700 1 --2- 172.21.15.155:0/1846188907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc076c60 0x7f36cc111120 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f36c0006b00 tx=0x7f36c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:42.227 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.806+0000 7f36be7fc700 1 -- 172.21.15.155:0/1846188907 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f36c0010a80 con 0x7f36cc076c60 2023-12-16T05:49:42.227 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.806+0000 7f36be7fc700 1 -- 172.21.15.155:0/1846188907 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f36c001a430 con 0x7f36cc076c60 2023-12-16T05:49:42.227 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.806+0000 7f36d409d700 1 -- 172.21.15.155:0/1846188907 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36cc111860 con 0x7f36cc076c60 2023-12-16T05:49:42.227 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.806+0000 7f36be7fc700 1 -- 172.21.15.155:0/1846188907 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f36c00245b0 con 0x7f36cc076c60 2023-12-16T05:49:42.227 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.806+0000 7f36d409d700 1 -- 172.21.15.155:0/1846188907 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36cc111c70 con 0x7f36cc076c60 2023-12-16T05:49:42.227 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.807+0000 7f36be7fc700 1 -- 172.21.15.155:0/1846188907 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f36c0024a60 con 0x7f36cc076c60 2023-12-16T05:49:42.227 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.807+0000 7f36be7fc700 1 -- 172.21.15.155:0/1846188907 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f36c002eaa0 con 0x7f36cc076c60 2023-12-16T05:49:42.227 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.807+0000 7f36d409d700 1 -- 172.21.15.155:0/1846188907 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36cc04bb80 con 0x7f36cc076c60 2023-12-16T05:49:42.227 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.809+0000 7f36be7fc700 1 -- 172.21.15.155:0/1846188907 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f36c002ed00 con 0x7f36cc076c60 2023-12-16T05:49:42.227 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.877+0000 7f36d409d700 1 -- 172.21.15.155:0/1846188907 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f36cc1062f0 con 0x7f36cc076c60 2023-12-16T05:49:42.228 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.878+0000 7f36be7fc700 1 -- 172.21.15.155:0/1846188907 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f36c0010be0 con 0x7f36cc076c60 2023-12-16T05:49:42.228 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.878+0000 7f36d409d700 1 -- 172.21.15.155:0/1846188907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc076c60 msgr2=0x7f36cc111120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:42.228 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.878+0000 7f36d409d700 1 --2- 172.21.15.155:0/1846188907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc076c60 0x7f36cc111120 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f36c0006b00 tx=0x7f36c0009250 comp rx=0 tx=0).stop 2023-12-16T05:49:42.228 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.878+0000 7f36d409d700 1 -- 172.21.15.155:0/1846188907 shutdown_connections 2023-12-16T05:49:42.228 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.878+0000 7f36d409d700 1 --2- 172.21.15.155:0/1846188907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc076c60 0x7f36cc111120 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:42.228 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.878+0000 7f36d409d700 1 -- 172.21.15.155:0/1846188907 >> 172.21.15.155:0/1846188907 conn(0x7f36cc0fc980 msgr2=0x7f36cc0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:49:42.228 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.878+0000 7f36d409d700 1 -- 172.21.15.155:0/1846188907 shutdown_connections 2023-12-16T05:49:42.228 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:41.878+0000 7f36d409d700 1 -- 172.21.15.155:0/1846188907 wait complete. 2023-12-16T05:49:42.228 INFO:teuthology.orchestra.run.smithi155.stdout:Restarting the monitor... 2023-12-16T05:49:42.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:42 smithi155 systemd[1]: Stopping Ceph mon.smithi155 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T05:49:42.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:42 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-mon-smithi155[111946]: 2023-12-16T05:49:42.387+0000 7f812ab67700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi155 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T05:49:42.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:42 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-mon-smithi155[111946]: 2023-12-16T05:49:42.387+0000 7f812ab67700 -1 mon.smithi155@0(leader) e1 *** Got Signal Terminated *** 2023-12-16T05:49:42.896 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:42 smithi155 bash[112293]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715-mon-smithi155 2023-12-16T05:49:43.181 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:42 smithi155 systemd[1]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715@mon.smithi155.service: Succeeded. 2023-12-16T05:49:43.182 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:42 smithi155 systemd[1]: Stopped Ceph mon.smithi155 for d344784e-9bd6-11ee-95a5-87774f69a715. 2023-12-16T05:49:43.182 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:42 smithi155 systemd[1]: Starting Ceph mon.smithi155 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T05:49:43.254 INFO:teuthology.orchestra.run.smithi155.stdout:Setting mon public_network to 172.21.0.0/20 2023-12-16T05:49:43.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: set uid:gid to 167:167 (ceph:ceph) 2023-12-16T05:49:43.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable), process ceph-mon, pid 7 2023-12-16T05:49:43.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: pidfile_write: ignore empty --pid-file 2023-12-16T05:49:43.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 bash[112413]: 0d0eecfde53b7cd3f8b7b8ab8e4452803a3e7a58c27a67a132b40ab57e0d83a2 2023-12-16T05:49:43.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: load: jerasure load: lrc 2023-12-16T05:49:43.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: RocksDB version: 6.15.5 2023-12-16T05:49:43.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-16T05:49:43.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Compile date Dec 13 2023 2023-12-16T05:49:43.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: DB SUMMARY 2023-12-16T05:49:43.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: DB Session ID: 8DBOYLPACP2TRLXVA5EW 2023-12-16T05:49:43.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: CURRENT file: CURRENT 2023-12-16T05:49:43.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: IDENTITY file: IDENTITY 2023-12-16T05:49:43.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2023-12-16T05:49:43.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi155/store.db dir, Total Num: 1, files: 000008.sst 2023-12-16T05:49:43.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi155/store.db: 000010.log size: 95358 ; 2023-12-16T05:49:43.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.error_if_exists: 0 2023-12-16T05:49:43.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.create_if_missing: 0 2023-12-16T05:49:43.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.paranoid_checks: 1 2023-12-16T05:49:43.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-16T05:49:43.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.env: 0x55604b021a80 2023-12-16T05:49:43.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.fs: Posix File System 2023-12-16T05:49:43.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.info_log: 0x55604d42e780 2023-12-16T05:49:43.579 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_file_opening_threads: 16 2023-12-16T05:49:43.579 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.statistics: (nil) 2023-12-16T05:49:43.579 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.use_fsync: 0 2023-12-16T05:49:43.579 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_log_file_size: 0 2023-12-16T05:49:43.579 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-16T05:49:43.579 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-16T05:49:43.579 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.keep_log_file_num: 1000 2023-12-16T05:49:43.579 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.recycle_log_file_num: 0 2023-12-16T05:49:43.579 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.allow_fallocate: 1 2023-12-16T05:49:43.579 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.allow_mmap_reads: 0 2023-12-16T05:49:43.579 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.allow_mmap_writes: 0 2023-12-16T05:49:43.579 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.use_direct_reads: 0 2023-12-16T05:49:43.579 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-16T05:49:43.579 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.create_missing_column_families: 0 2023-12-16T05:49:43.579 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.db_log_dir: 2023-12-16T05:49:43.580 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi155/store.db 2023-12-16T05:49:43.580 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-16T05:49:43.580 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-16T05:49:43.580 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-16T05:49:43.580 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-16T05:49:43.580 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-16T05:49:43.580 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-16T05:49:43.580 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.advise_random_on_open: 1 2023-12-16T05:49:43.580 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.db_write_buffer_size: 0 2023-12-16T05:49:43.580 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.write_buffer_manager: 0x55604e19e990 2023-12-16T05:49:43.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-16T05:49:43.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-16T05:49:43.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-16T05:49:43.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-16T05:49:43.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.rate_limiter: (nil) 2023-12-16T05:49:43.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-16T05:49:43.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.wal_recovery_mode: 2 2023-12-16T05:49:43.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.enable_thread_tracking: 0 2023-12-16T05:49:43.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.enable_pipelined_write: 0 2023-12-16T05:49:43.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.unordered_write: 0 2023-12-16T05:49:43.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-16T05:49:43.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-16T05:49:43.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-16T05:49:43.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-16T05:49:43.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.row_cache: None 2023-12-16T05:49:43.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.wal_filter: None 2023-12-16T05:49:43.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-16T05:49:43.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.allow_ingest_behind: 0 2023-12-16T05:49:43.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.preserve_deletes: 0 2023-12-16T05:49:43.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.two_write_queues: 0 2023-12-16T05:49:43.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.manual_wal_flush: 0 2023-12-16T05:49:43.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.atomic_flush: 0 2023-12-16T05:49:43.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-16T05:49:43.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-16T05:49:43.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-16T05:49:43.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.log_readahead_size: 0 2023-12-16T05:49:43.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-16T05:49:43.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.best_efforts_recovery: 0 2023-12-16T05:49:43.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-16T05:49:43.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-16T05:49:43.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.allow_data_in_errors: 0 2023-12-16T05:49:43.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.db_host_id: __hostname__ 2023-12-16T05:49:43.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_background_jobs: 2 2023-12-16T05:49:43.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_background_compactions: -1 2023-12-16T05:49:43.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_subcompactions: 1 2023-12-16T05:49:43.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-16T05:49:43.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-16T05:49:43.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-16T05:49:43.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_total_wal_size: 0 2023-12-16T05:49:43.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-16T05:49:43.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-16T05:49:43.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-16T05:49:43.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-16T05:49:43.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_open_files: -1 2023-12-16T05:49:43.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.bytes_per_sync: 0 2023-12-16T05:49:43.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-16T05:49:43.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-16T05:49:43.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compaction_readahead_size: 0 2023-12-16T05:49:43.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_background_flushes: -1 2023-12-16T05:49:43.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Compression algorithms supported: 2023-12-16T05:49:43.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-16T05:49:43.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: kZSTD supported: 0 2023-12-16T05:49:43.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: kXpressCompression supported: 0 2023-12-16T05:49:43.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: kLZ4HCCompression supported: 1 2023-12-16T05:49:43.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: kZlibCompression supported: 1 2023-12-16T05:49:43.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: kSnappyCompression supported: 1 2023-12-16T05:49:43.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: kLZ4Compression supported: 1 2023-12-16T05:49:43.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: kBZip2Compression supported: 0 2023-12-16T05:49:43.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-16T05:49:43.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi155/store.db/MANIFEST-000009 2023-12-16T05:49:43.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-16T05:49:43.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-16T05:49:43.587 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.merge_operator: 2023-12-16T05:49:43.587 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compaction_filter: None 2023-12-16T05:49:43.587 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compaction_filter_factory: None 2023-12-16T05:49:43.587 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.sst_partitioner_factory: None 2023-12-16T05:49:43.587 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-16T05:49:43.587 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-16T05:49:43.587 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55604d47ef90) 2023-12-16T05:49:43.587 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: cache_index_and_filter_blocks: 1 2023-12-16T05:49:43.587 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-16T05:49:43.587 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-16T05:49:43.587 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: pin_top_level_index_and_filter: 1 2023-12-16T05:49:43.587 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: index_type: 0 2023-12-16T05:49:43.588 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: data_block_index_type: 0 2023-12-16T05:49:43.588 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: index_shortening: 1 2023-12-16T05:49:43.588 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-16T05:49:43.588 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: hash_index_allow_collision: 1 2023-12-16T05:49:43.588 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: checksum: 1 2023-12-16T05:49:43.588 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: no_block_cache: 0 2023-12-16T05:49:43.588 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_cache: 0x55604d4b1090 2023-12-16T05:49:43.588 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_cache_name: BinnedLRUCache 2023-12-16T05:49:43.588 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_cache_options: 2023-12-16T05:49:43.588 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: capacity : 536870912 2023-12-16T05:49:43.588 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: num_shard_bits : 4 2023-12-16T05:49:43.588 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: strict_capacity_limit : 0 2023-12-16T05:49:43.589 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: high_pri_pool_ratio: 0.000 2023-12-16T05:49:43.589 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_cache_compressed: (nil) 2023-12-16T05:49:43.589 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: persistent_cache: (nil) 2023-12-16T05:49:43.589 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_size: 4096 2023-12-16T05:49:43.589 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_size_deviation: 10 2023-12-16T05:49:43.589 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_restart_interval: 16 2023-12-16T05:49:43.589 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: index_block_restart_interval: 1 2023-12-16T05:49:43.589 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: metadata_block_size: 4096 2023-12-16T05:49:43.589 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: partition_filters: 0 2023-12-16T05:49:43.589 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: use_delta_encoding: 1 2023-12-16T05:49:43.589 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-16T05:49:43.589 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: whole_key_filtering: 1 2023-12-16T05:49:43.589 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: verify_compression: 0 2023-12-16T05:49:43.589 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: read_amp_bytes_per_bit: 0 2023-12-16T05:49:43.590 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: format_version: 4 2023-12-16T05:49:43.590 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: enable_index_compression: 1 2023-12-16T05:49:43.590 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_align: 0 2023-12-16T05:49:43.590 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.write_buffer_size: 33554432 2023-12-16T05:49:43.590 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_write_buffer_number: 2 2023-12-16T05:49:43.590 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compression: NoCompression 2023-12-16T05:49:43.590 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.bottommost_compression: Disabled 2023-12-16T05:49:43.590 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.prefix_extractor: nullptr 2023-12-16T05:49:43.590 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-16T05:49:43.590 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.num_levels: 7 2023-12-16T05:49:43.590 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-16T05:49:43.591 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-16T05:49:43.591 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-16T05:49:43.591 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-16T05:49:43.591 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-16T05:49:43.591 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-16T05:49:43.591 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-16T05:49:43.591 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-16T05:49:43.591 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-16T05:49:43.591 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-16T05:49:43.591 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-16T05:49:43.592 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compression_opts.level: 32767 2023-12-16T05:49:43.592 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compression_opts.strategy: 0 2023-12-16T05:49:43.592 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-16T05:49:43.592 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-16T05:49:43.592 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-16T05:49:43.592 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compression_opts.enabled: false 2023-12-16T05:49:43.592 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-16T05:49:43.592 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-16T05:49:43.592 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-16T05:49:43.592 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.target_file_size_base: 67108864 2023-12-16T05:49:43.592 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-16T05:49:43.593 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-16T05:49:43.593 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-16T05:49:43.593 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-16T05:49:43.593 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-16T05:49:43.593 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-16T05:49:43.593 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-16T05:49:43.593 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-16T05:49:43.593 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-16T05:49:43.593 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-16T05:49:43.593 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-16T05:49:43.593 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-16T05:49:43.594 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-16T05:49:43.594 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.arena_block_size: 4194304 2023-12-16T05:49:43.594 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-16T05:49:43.594 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-16T05:49:43.594 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-16T05:49:43.594 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.disable_auto_compactions: 0 2023-12-16T05:49:43.594 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-16T05:49:43.594 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-16T05:49:43.594 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-16T05:49:43.594 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-16T05:49:43.594 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-16T05:49:43.594 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-16T05:49:43.594 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-16T05:49:43.594 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-16T05:49:43.594 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-16T05:49:43.595 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-16T05:49:43.595 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.table_properties_collectors: 2023-12-16T05:49:43.595 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.inplace_update_support: 0 2023-12-16T05:49:43.595 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-16T05:49:43.595 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-16T05:49:43.595 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-16T05:49:43.595 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-16T05:49:43.595 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.bloom_locality: 0 2023-12-16T05:49:43.595 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.max_successive_merges: 0 2023-12-16T05:49:43.595 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-16T05:49:43.595 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.paranoid_file_checks: 0 2023-12-16T05:49:43.595 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.force_consistency_checks: 1 2023-12-16T05:49:43.595 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.report_bg_io_stats: 0 2023-12-16T05:49:43.595 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.ttl: 2592000 2023-12-16T05:49:43.595 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-16T05:49:43.595 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.enable_blob_files: false 2023-12-16T05:49:43.596 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.min_blob_size: 0 2023-12-16T05:49:43.596 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.blob_file_size: 268435456 2023-12-16T05:49:43.596 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-16T05:49:43.596 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-16T05:49:43.596 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-16T05:49:43.596 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi155/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-16T05:49:43.596 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2023-12-16T05:49:43.596 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2023-12-16T05:49:43.596 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 systemd[1]: Started Ceph mon.smithi155 for d344784e-9bd6-11ee-95a5-87774f69a715. 2023-12-16T05:49:43.596 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702705783252077, "job": 1, "event": "recovery_started", "wal_files": [10]} 2023-12-16T05:49:43.596 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2023-12-16T05:49:43.596 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-16T05:49:43.596 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702705783252936, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 90884, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 88979, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13169, "raw_average_key_size": 49, "raw_value_size": 81757, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 264, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1702705783, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "f94ff1fa-3b1e-4698-9559-19fb733f8acc", "db_session_id": "8DBOYLPACP2TRLXVA5EW"}} 2023-12-16T05:49:43.596 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2023-12-16T05:49:43.596 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702705783253297, "job": 1, "event": "recovery_finished"} 2023-12-16T05:49:43.597 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi155/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-16T05:49:43.597 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55604d445180 2023-12-16T05:49:43.597 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: DB pointer 0x55604d51a000 2023-12-16T05:49:43.597 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-16T05:49:43.597 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-16T05:49:43.597 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ** DB Stats ** 2023-12-16T05:49:43.597 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T05:49:43.597 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-16T05:49:43.597 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T05:49:43.597 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T05:49:43.597 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-16T05:49:43.597 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-16T05:49:43.597 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T05:49:43.597 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2023-12-16T05:49:43.597 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ** Compaction Stats [default] ** 2023-12-16T05:49:43.598 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T05:49:43.598 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T05:49:43.598 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: L0 2/0 90.55 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.5 0.00 0.00 1 0.001 0 0 2023-12-16T05:49:43.598 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Sum 2/0 90.55 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.5 0.00 0.00 1 0.001 0 0 2023-12-16T05:49:43.598 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.5 0.00 0.00 1 0.001 0 0 2023-12-16T05:49:43.598 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2023-12-16T05:49:43.598 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ** Compaction Stats [default] ** 2023-12-16T05:49:43.598 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T05:49:43.598 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T05:49:43.598 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 151.5 0.00 0.00 1 0.001 0 0 2023-12-16T05:49:43.598 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T05:49:43.598 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-16T05:49:43.598 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T05:49:43.598 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T05:49:43.598 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T05:49:43.598 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T05:49:43.599 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Cumulative compaction: 0.00 GB write, 27.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T05:49:43.599 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Interval compaction: 0.00 GB write, 27.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T05:49:43.599 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T05:49:43.599 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2023-12-16T05:49:43.599 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T05:49:43.599 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2023-12-16T05:49:43.599 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ** Compaction Stats [default] ** 2023-12-16T05:49:43.599 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T05:49:43.599 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T05:49:43.599 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: L0 2/0 90.55 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.5 0.00 0.00 1 0.001 0 0 2023-12-16T05:49:43.599 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Sum 2/0 90.55 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.5 0.00 0.00 1 0.001 0 0 2023-12-16T05:49:43.599 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-16T05:49:43.599 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2023-12-16T05:49:43.599 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ** Compaction Stats [default] ** 2023-12-16T05:49:43.600 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T05:49:43.600 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T05:49:43.600 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 151.5 0.00 0.00 1 0.001 0 0 2023-12-16T05:49:43.600 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T05:49:43.600 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-16T05:49:43.600 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T05:49:43.600 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T05:49:43.600 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T05:49:43.600 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T05:49:43.600 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Cumulative compaction: 0.00 GB write, 26.86 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T05:49:43.600 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T05:49:43.600 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T05:49:43.600 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2023-12-16T05:49:43.600 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T05:49:43.600 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: starting mon.smithi155 rank 0 at public addrs [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] at bind addrs [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi155 fsid d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:49:43.601 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: mon.smithi155@-1(???) e1 preinit fsid d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:49:43.601 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: mon.smithi155@-1(???).mds e1 new map 2023-12-16T05:49:43.601 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: mon.smithi155@-1(???).mds e1 print_map 2023-12-16T05:49:43.601 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: e1 2023-12-16T05:49:43.601 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T05:49:43.601 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T05:49:43.601 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: legacy client fscid: -1 2023-12-16T05:49:43.601 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2023-12-16T05:49:43.601 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: No filesystems configured 2023-12-16T05:49:43.601 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: mon.smithi155@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-16T05:49:43.601 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: mon.smithi155@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T05:49:43.601 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: mon.smithi155@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T05:49:43.601 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: mon.smithi155@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T05:49:43.601 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: mon.smithi155@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-12-16T05:49:43.602 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: mon.smithi155 is new leader, mons smithi155 in quorum (ranks 0) 2023-12-16T05:49:43.602 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: monmap e1: 1 mons at {smithi155=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T05:49:43.602 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: fsmap 2023-12-16T05:49:43.602 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: osdmap e1: 0 total, 0 up, 0 in 2023-12-16T05:49:43.602 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:43 smithi155 ceph-mon[112451]: mgrmap e1: no daemons active 2023-12-16T05:49:45.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:44 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2098998281' entity='client.admin' 2023-12-16T05:49:45.204 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.576+0000 7ffaec59a700 1 Processor -- start 2023-12-16T05:49:45.209 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.576+0000 7ffaec59a700 1 -- start start 2023-12-16T05:49:45.209 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.576+0000 7ffaec59a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffae41011d0 0x7ffae41015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:45.209 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.576+0000 7ffaec59a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae4101b20 con 0x7ffae41011d0 2023-12-16T05:49:45.209 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.577+0000 7ffaea336700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffae41011d0 0x7ffae41015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:45.209 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.577+0000 7ffaea336700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffae41011d0 0x7ffae41015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:57118/0 (socket says 172.21.15.155:57118) 2023-12-16T05:49:45.209 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.577+0000 7ffaea336700 1 -- 172.21.15.155:0/1137779789 learned_addr learned my addr 172.21.15.155:0/1137779789 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:49:45.209 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.577+0000 7ffaea336700 1 -- 172.21.15.155:0/1137779789 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae4101c60 con 0x7ffae41011d0 2023-12-16T05:49:45.209 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.577+0000 7ffaea336700 1 --2- 172.21.15.155:0/1137779789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffae41011d0 0x7ffae41015e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ffae000bb80 tx=0x7ffae000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=962ae1d6d9f8b2ba server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:45.209 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.577+0000 7ffae9334700 1 -- 172.21.15.155:0/1137779789 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffae000dd00 con 0x7ffae41011d0 2023-12-16T05:49:45.210 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.577+0000 7ffae9334700 1 -- 172.21.15.155:0/1137779789 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7ffae000de60 con 0x7ffae41011d0 2023-12-16T05:49:45.210 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.577+0000 7ffae9334700 1 -- 172.21.15.155:0/1137779789 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffae0018840 con 0x7ffae41011d0 2023-12-16T05:49:45.210 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.578+0000 7ffaec59a700 1 -- 172.21.15.155:0/1137779789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffae41011d0 msgr2=0x7ffae41015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:45.210 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.578+0000 7ffaec59a700 1 --2- 172.21.15.155:0/1137779789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffae41011d0 0x7ffae41015e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ffae000bb80 tx=0x7ffae000b4f0 comp rx=0 tx=0).stop 2023-12-16T05:49:45.210 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.578+0000 7ffaec59a700 1 -- 172.21.15.155:0/1137779789 shutdown_connections 2023-12-16T05:49:45.210 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.578+0000 7ffaec59a700 1 --2- 172.21.15.155:0/1137779789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffae41011d0 0x7ffae41015e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:45.210 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.578+0000 7ffaec59a700 1 -- 172.21.15.155:0/1137779789 >> 172.21.15.155:0/1137779789 conn(0x7ffae40fc950 msgr2=0x7ffae40fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:49:45.210 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.578+0000 7ffaec59a700 1 -- 172.21.15.155:0/1137779789 shutdown_connections 2023-12-16T05:49:45.210 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.578+0000 7ffaec59a700 1 -- 172.21.15.155:0/1137779789 wait complete. 2023-12-16T05:49:45.210 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.578+0000 7ffaec59a700 1 Processor -- start 2023-12-16T05:49:45.210 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.579+0000 7ffaec59a700 1 -- start start 2023-12-16T05:49:45.210 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.579+0000 7ffaec59a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffae41011d0 0x7ffae41132f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:45.210 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.579+0000 7ffaec59a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae4113830 con 0x7ffae41011d0 2023-12-16T05:49:45.210 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.579+0000 7ffaea336700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffae41011d0 0x7ffae41132f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:45.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.579+0000 7ffaea336700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffae41011d0 0x7ffae41132f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:57124/0 (socket says 172.21.15.155:57124) 2023-12-16T05:49:45.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.579+0000 7ffaea336700 1 -- 172.21.15.155:0/2098998281 learned_addr learned my addr 172.21.15.155:0/2098998281 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:49:45.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.579+0000 7ffaea336700 1 -- 172.21.15.155:0/2098998281 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae000b790 con 0x7ffae41011d0 2023-12-16T05:49:45.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.579+0000 7ffaea336700 1 --2- 172.21.15.155:0/2098998281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffae41011d0 0x7ffae41132f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ffae0000c00 tx=0x7ffae000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:45.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.579+0000 7ffadaffd700 1 -- 172.21.15.155:0/2098998281 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffae00109c0 con 0x7ffae41011d0 2023-12-16T05:49:45.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.580+0000 7ffadaffd700 1 -- 172.21.15.155:0/2098998281 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7ffae0010b20 con 0x7ffae41011d0 2023-12-16T05:49:45.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.580+0000 7ffaec59a700 1 -- 172.21.15.155:0/2098998281 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae4113a30 con 0x7ffae41011d0 2023-12-16T05:49:45.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.580+0000 7ffadaffd700 1 -- 172.21.15.155:0/2098998281 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffae0021390 con 0x7ffae41011d0 2023-12-16T05:49:45.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.580+0000 7ffaec59a700 1 -- 172.21.15.155:0/2098998281 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae4113e40 con 0x7ffae41011d0 2023-12-16T05:49:45.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.580+0000 7ffadaffd700 1 -- 172.21.15.155:0/2098998281 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ffae0021600 con 0x7ffae41011d0 2023-12-16T05:49:45.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.580+0000 7ffadaffd700 1 -- 172.21.15.155:0/2098998281 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ffae0014070 con 0x7ffae41011d0 2023-12-16T05:49:45.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.581+0000 7ffaec59a700 1 -- 172.21.15.155:0/2098998281 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae404bb80 con 0x7ffae41011d0 2023-12-16T05:49:45.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.583+0000 7ffadaffd700 1 -- 172.21.15.155:0/2098998281 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ffae0031060 con 0x7ffae41011d0 2023-12-16T05:49:45.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.649+0000 7ffaec59a700 1 -- 172.21.15.155:0/2098998281 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7ffae4102fe0 con 0x7ffae41011d0 2023-12-16T05:49:45.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.653+0000 7ffadaffd700 1 -- 172.21.15.155:0/2098998281 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7ffae4102fe0 con 0x7ffae41011d0 2023-12-16T05:49:45.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.653+0000 7ffaec59a700 1 -- 172.21.15.155:0/2098998281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffae41011d0 msgr2=0x7ffae41132f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:45.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.653+0000 7ffaec59a700 1 --2- 172.21.15.155:0/2098998281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffae41011d0 0x7ffae41132f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ffae0000c00 tx=0x7ffae000b4f0 comp rx=0 tx=0).stop 2023-12-16T05:49:45.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.653+0000 7ffaec59a700 1 -- 172.21.15.155:0/2098998281 shutdown_connections 2023-12-16T05:49:45.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.653+0000 7ffaec59a700 1 --2- 172.21.15.155:0/2098998281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffae41011d0 0x7ffae41132f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:45.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.653+0000 7ffaec59a700 1 -- 172.21.15.155:0/2098998281 >> 172.21.15.155:0/2098998281 conn(0x7ffae40fc950 msgr2=0x7ffae4105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:49:45.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.653+0000 7ffaec59a700 1 -- 172.21.15.155:0/2098998281 shutdown_connections 2023-12-16T05:49:45.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:43.653+0000 7ffaec59a700 1 -- 172.21.15.155:0/2098998281 wait complete. 2023-12-16T05:49:45.212 INFO:teuthology.orchestra.run.smithi155.stdout:Wrote config to /etc/ceph/ceph.conf 2023-12-16T05:49:45.212 INFO:teuthology.orchestra.run.smithi155.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-12-16T05:49:45.212 INFO:teuthology.orchestra.run.smithi155.stdout:Creating mgr... 2023-12-16T05:49:45.213 INFO:teuthology.orchestra.run.smithi155.stdout:Verifying port 9283 ... 2023-12-16T05:49:45.341 INFO:teuthology.orchestra.run.smithi155.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d344784e-9bd6-11ee-95a5-87774f69a715@mgr.smithi155.maowdn 2023-12-16T05:49:45.342 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d344784e-9bd6-11ee-95a5-87774f69a715@mgr.smithi155.maowdn.service: Unit ceph-d344784e-9bd6-11ee-95a5-87774f69a715@mgr.smithi155.maowdn.service not loaded. 2023-12-16T05:49:45.431 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d344784e-9bd6-11ee-95a5-87774f69a715.target.wants/ceph-d344784e-9bd6-11ee-95a5-87774f69a715@mgr.smithi155.maowdn.service → /etc/systemd/system/ceph-d344784e-9bd6-11ee-95a5-87774f69a715@.service. 2023-12-16T05:49:46.340 INFO:teuthology.orchestra.run.smithi155.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-16T05:49:46.340 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stdout disabled 2023-12-16T05:49:46.350 INFO:teuthology.orchestra.run.smithi155.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-16T05:49:46.350 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stdout inactive 2023-12-16T05:49:46.350 INFO:teuthology.orchestra.run.smithi155.stdout:firewalld.service is not enabled 2023-12-16T05:49:46.350 INFO:teuthology.orchestra.run.smithi155.stdout:Not possible to enable service . firewalld.service is not available 2023-12-16T05:49:46.359 INFO:teuthology.orchestra.run.smithi155.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-16T05:49:46.360 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stdout disabled 2023-12-16T05:49:46.369 INFO:teuthology.orchestra.run.smithi155.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-16T05:49:46.369 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stdout inactive 2023-12-16T05:49:46.369 INFO:teuthology.orchestra.run.smithi155.stdout:firewalld.service is not enabled 2023-12-16T05:49:46.369 INFO:teuthology.orchestra.run.smithi155.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2023-12-16T05:49:46.369 INFO:teuthology.orchestra.run.smithi155.stdout:Waiting for mgr to start... 2023-12-16T05:49:46.369 INFO:teuthology.orchestra.run.smithi155.stdout:Waiting for mgr... 2023-12-16T05:49:47.138 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:46 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2040149760' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-16T05:49:47.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout 2023-12-16T05:49:47.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout { 2023-12-16T05:49:47.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "fsid": "d344784e-9bd6-11ee-95a5-87774f69a715", 2023-12-16T05:49:47.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "health": { 2023-12-16T05:49:47.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-16T05:49:47.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-16T05:49:47.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-16T05:49:47.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:47.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-16T05:49:47.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-16T05:49:47.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout 0 2023-12-16T05:49:47.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout ], 2023-12-16T05:49:47.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-16T05:49:47.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "smithi155" 2023-12-16T05:49:47.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout ], 2023-12-16T05:49:47.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2023-12-16T05:49:47.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-16T05:49:47.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T05:49:47.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-16T05:49:47.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-16T05:49:47.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:47.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-16T05:49:47.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T05:49:47.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-16T05:49:47.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-16T05:49:47.197 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-16T05:49:47.197 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-16T05:49:47.197 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-16T05:49:47.197 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-16T05:49:47.197 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:47.197 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-16T05:49:47.197 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-16T05:49:47.197 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-16T05:49:47.197 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-16T05:49:47.197 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-16T05:49:47.197 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-16T05:49:47.198 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-16T05:49:47.198 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-16T05:49:47.198 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-16T05:49:47.198 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:47.198 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-16T05:49:47.198 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T05:49:47.198 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-16T05:49:47.198 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-16T05:49:47.198 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:47.198 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-16T05:49:47.198 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-16T05:49:47.198 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-16T05:49:47.198 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-16T05:49:47.198 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-16T05:49:47.198 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-16T05:49:47.199 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "restful" 2023-12-16T05:49:47.199 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout ], 2023-12-16T05:49:47.199 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T05:49:47.199 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:47.199 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-16T05:49:47.199 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T05:49:47.199 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "modified": "2023-12-16T05:49:39.806166+0000", 2023-12-16T05:49:47.199 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T05:49:47.199 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:47.199 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-16T05:49:47.199 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout } 2023-12-16T05:49:47.199 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.759+0000 7f0cf1342700 1 Processor -- start 2023-12-16T05:49:47.199 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.759+0000 7f0cf1342700 1 -- start start 2023-12-16T05:49:47.199 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.759+0000 7f0cf1342700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec071000 0x7f0cec102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:47.199 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.759+0000 7f0cf1342700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec1031d0 con 0x7f0cec071000 2023-12-16T05:49:47.199 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.760+0000 7f0ceaffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec071000 0x7f0cec102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:47.200 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.760+0000 7f0ceaffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec071000 0x7f0cec102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40024/0 (socket says 172.21.15.155:40024) 2023-12-16T05:49:47.200 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.760+0000 7f0ceaffd700 1 -- 172.21.15.155:0/4003582801 learned_addr learned my addr 172.21.15.155:0/4003582801 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:49:47.200 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.760+0000 7f0ceaffd700 1 -- 172.21.15.155:0/4003582801 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec103310 con 0x7f0cec071000 2023-12-16T05:49:47.200 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.760+0000 7f0ceaffd700 1 --2- 172.21.15.155:0/4003582801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec071000 0x7f0cec102c90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0098e0 tx=0x7f0cdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d24e8792fa37a4c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:47.200 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.760+0000 7f0ce9ffb700 1 -- 172.21.15.155:0/4003582801 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cdc00b860 con 0x7f0cec071000 2023-12-16T05:49:47.200 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.760+0000 7f0ce9ffb700 1 -- 172.21.15.155:0/4003582801 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f0cdc00be30 con 0x7f0cec071000 2023-12-16T05:49:47.200 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.760+0000 7f0ce9ffb700 1 -- 172.21.15.155:0/4003582801 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cdc010380 con 0x7f0cec071000 2023-12-16T05:49:47.200 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.761+0000 7f0cf1342700 1 -- 172.21.15.155:0/4003582801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec071000 msgr2=0x7f0cec102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:47.200 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.761+0000 7f0cf1342700 1 --2- 172.21.15.155:0/4003582801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec071000 0x7f0cec102c90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0098e0 tx=0x7f0cdc009250 comp rx=0 tx=0).stop 2023-12-16T05:49:47.200 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.761+0000 7f0cf1342700 1 -- 172.21.15.155:0/4003582801 shutdown_connections 2023-12-16T05:49:47.200 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.761+0000 7f0cf1342700 1 --2- 172.21.15.155:0/4003582801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec071000 0x7f0cec102c90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:47.200 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.761+0000 7f0cf1342700 1 -- 172.21.15.155:0/4003582801 >> 172.21.15.155:0/4003582801 conn(0x7f0cec0fc970 msgr2=0x7f0cec0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:49:47.200 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.761+0000 7f0cf1342700 1 -- 172.21.15.155:0/4003582801 shutdown_connections 2023-12-16T05:49:47.200 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.761+0000 7f0cf1342700 1 -- 172.21.15.155:0/4003582801 wait complete. 2023-12-16T05:49:47.200 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.762+0000 7f0cf1342700 1 Processor -- start 2023-12-16T05:49:47.201 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.762+0000 7f0cf1342700 1 -- start start 2023-12-16T05:49:47.201 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.762+0000 7f0cf1342700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec071000 0x7f0cec117770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:47.201 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.762+0000 7f0cf1342700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec117cb0 con 0x7f0cec071000 2023-12-16T05:49:47.201 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.762+0000 7f0ceaffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec071000 0x7f0cec117770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:47.201 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.762+0000 7f0ceaffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec071000 0x7f0cec117770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40036/0 (socket says 172.21.15.155:40036) 2023-12-16T05:49:47.201 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.762+0000 7f0ceaffd700 1 -- 172.21.15.155:0/2040149760 learned_addr learned my addr 172.21.15.155:0/2040149760 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:49:47.201 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.762+0000 7f0ceaffd700 1 -- 172.21.15.155:0/2040149760 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc0094f0 con 0x7f0cec071000 2023-12-16T05:49:47.201 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.762+0000 7f0ceaffd700 1 --2- 172.21.15.155:0/2040149760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec071000 0x7f0cec117770 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc006d40 tx=0x7f0cdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:47.201 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.763+0000 7f0cd37fe700 1 -- 172.21.15.155:0/2040149760 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cdc0109b0 con 0x7f0cec071000 2023-12-16T05:49:47.201 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.763+0000 7f0cd37fe700 1 -- 172.21.15.155:0/2040149760 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f0cdc024440 con 0x7f0cec071000 2023-12-16T05:49:47.201 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.763+0000 7f0cf1342700 1 -- 172.21.15.155:0/2040149760 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cec117eb0 con 0x7f0cec071000 2023-12-16T05:49:47.201 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.763+0000 7f0cd37fe700 1 -- 172.21.15.155:0/2040149760 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cdc01a5f0 con 0x7f0cec071000 2023-12-16T05:49:47.201 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.763+0000 7f0cf1342700 1 -- 172.21.15.155:0/2040149760 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cec1182c0 con 0x7f0cec071000 2023-12-16T05:49:47.201 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.763+0000 7f0cd37fe700 1 -- 172.21.15.155:0/2040149760 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0cdc01aaf0 con 0x7f0cec071000 2023-12-16T05:49:47.202 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.763+0000 7f0cd37fe700 1 -- 172.21.15.155:0/2040149760 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f0cdc02da60 con 0x7f0cec071000 2023-12-16T05:49:47.202 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.764+0000 7f0cf1342700 1 -- 172.21.15.155:0/2040149760 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cec04bb80 con 0x7f0cec071000 2023-12-16T05:49:47.202 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.766+0000 7f0cd37fe700 1 -- 172.21.15.155:0/2040149760 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0cdc024970 con 0x7f0cec071000 2023-12-16T05:49:47.202 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.838+0000 7f0cf1342700 1 -- 172.21.15.155:0/2040149760 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f0cec104120 con 0x7f0cec071000 2023-12-16T05:49:47.202 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.838+0000 7f0cd37fe700 1 -- 172.21.15.155:0/2040149760 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f0cec104120 con 0x7f0cec071000 2023-12-16T05:49:47.202 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.839+0000 7f0cf1342700 1 -- 172.21.15.155:0/2040149760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec071000 msgr2=0x7f0cec117770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:47.202 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.839+0000 7f0cf1342700 1 --2- 172.21.15.155:0/2040149760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec071000 0x7f0cec117770 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc006d40 tx=0x7f0cdc009250 comp rx=0 tx=0).stop 2023-12-16T05:49:47.202 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.839+0000 7f0cf1342700 1 -- 172.21.15.155:0/2040149760 shutdown_connections 2023-12-16T05:49:47.202 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.839+0000 7f0cf1342700 1 --2- 172.21.15.155:0/2040149760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec071000 0x7f0cec117770 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:47.202 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.839+0000 7f0cf1342700 1 -- 172.21.15.155:0/2040149760 >> 172.21.15.155:0/2040149760 conn(0x7f0cec0fc970 msgr2=0x7f0cec0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:49:47.202 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.839+0000 7f0cf1342700 1 -- 172.21.15.155:0/2040149760 shutdown_connections 2023-12-16T05:49:47.202 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:46.839+0000 7f0cf1342700 1 -- 172.21.15.155:0/2040149760 wait complete. 2023-12-16T05:49:47.202 INFO:teuthology.orchestra.run.smithi155.stdout:mgr not available, waiting (1/15)... 2023-12-16T05:49:49.921 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:49 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/4058585749' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-16T05:49:50.012 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout 2023-12-16T05:49:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout { 2023-12-16T05:49:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "fsid": "d344784e-9bd6-11ee-95a5-87774f69a715", 2023-12-16T05:49:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "health": { 2023-12-16T05:49:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-16T05:49:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-16T05:49:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-16T05:49:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-16T05:49:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-16T05:49:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout 0 2023-12-16T05:49:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout ], 2023-12-16T05:49:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-16T05:49:50.013 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "smithi155" 2023-12-16T05:49:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout ], 2023-12-16T05:49:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2023-12-16T05:49:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-16T05:49:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T05:49:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-16T05:49:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-16T05:49:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-16T05:49:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T05:49:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-16T05:49:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-16T05:49:50.014 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-16T05:49:50.021 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-16T05:49:50.022 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-16T05:49:50.022 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-16T05:49:50.022 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:50.022 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-16T05:49:50.022 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-16T05:49:50.022 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-16T05:49:50.022 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-16T05:49:50.022 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-16T05:49:50.022 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-16T05:49:50.022 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-16T05:49:50.022 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-16T05:49:50.022 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-16T05:49:50.022 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:50.022 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-16T05:49:50.023 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T05:49:50.023 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-16T05:49:50.023 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-16T05:49:50.023 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:50.023 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-16T05:49:50.023 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-16T05:49:50.023 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-16T05:49:50.023 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-16T05:49:50.023 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-16T05:49:50.023 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-16T05:49:50.023 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "restful" 2023-12-16T05:49:50.023 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout ], 2023-12-16T05:49:50.023 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T05:49:50.023 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:50.023 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-16T05:49:50.023 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T05:49:50.024 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "modified": "2023-12-16T05:49:39.806166+0000", 2023-12-16T05:49:50.024 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T05:49:50.024 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:50.024 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-16T05:49:50.024 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout } 2023-12-16T05:49:50.024 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.557+0000 7f107688e700 1 Processor -- start 2023-12-16T05:49:50.024 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.557+0000 7f107688e700 1 -- start start 2023-12-16T05:49:50.024 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.558+0000 7f107688e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1070070fa0 0x7f1070104f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:50.024 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.558+0000 7f107688e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1070105440 con 0x7f1070070fa0 2023-12-16T05:49:50.024 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.558+0000 7f106ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1070070fa0 0x7f1070104f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:50.024 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.558+0000 7f106ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1070070fa0 0x7f1070104f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40046/0 (socket says 172.21.15.155:40046) 2023-12-16T05:49:50.024 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.558+0000 7f106ffff700 1 -- 172.21.15.155:0/3655536879 learned_addr learned my addr 172.21.15.155:0/3655536879 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:49:50.024 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.558+0000 7f106ffff700 1 -- 172.21.15.155:0/3655536879 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1070105580 con 0x7f1070070fa0 2023-12-16T05:49:50.024 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.558+0000 7f106ffff700 1 --2- 172.21.15.155:0/3655536879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1070070fa0 0x7f1070104f00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f10600098e0 tx=0x7f1060009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c851ef045501811f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:50.025 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.559+0000 7f106effd700 1 -- 172.21.15.155:0/3655536879 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f106000b860 con 0x7f1070070fa0 2023-12-16T05:49:50.025 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.559+0000 7f106effd700 1 -- 172.21.15.155:0/3655536879 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f106000be30 con 0x7f1070070fa0 2023-12-16T05:49:50.025 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.559+0000 7f106effd700 1 -- 172.21.15.155:0/3655536879 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1060010380 con 0x7f1070070fa0 2023-12-16T05:49:50.025 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.559+0000 7f107688e700 1 -- 172.21.15.155:0/3655536879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1070070fa0 msgr2=0x7f1070104f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:50.025 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.559+0000 7f107688e700 1 --2- 172.21.15.155:0/3655536879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1070070fa0 0x7f1070104f00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f10600098e0 tx=0x7f1060009250 comp rx=0 tx=0).stop 2023-12-16T05:49:50.025 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.559+0000 7f107688e700 1 -- 172.21.15.155:0/3655536879 shutdown_connections 2023-12-16T05:49:50.025 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.559+0000 7f107688e700 1 --2- 172.21.15.155:0/3655536879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1070070fa0 0x7f1070104f00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:50.025 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.559+0000 7f107688e700 1 -- 172.21.15.155:0/3655536879 >> 172.21.15.155:0/3655536879 conn(0x7f10700fc970 msgr2=0x7f10700fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:49:50.025 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.559+0000 7f107688e700 1 -- 172.21.15.155:0/3655536879 shutdown_connections 2023-12-16T05:49:50.025 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.559+0000 7f107688e700 1 -- 172.21.15.155:0/3655536879 wait complete. 2023-12-16T05:49:50.025 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.560+0000 7f107688e700 1 Processor -- start 2023-12-16T05:49:50.025 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.560+0000 7f107688e700 1 -- start start 2023-12-16T05:49:50.025 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.560+0000 7f107688e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1070070fa0 0x7f10701111a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:50.025 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.560+0000 7f107688e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10701116e0 con 0x7f1070070fa0 2023-12-16T05:49:50.025 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.561+0000 7f106ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1070070fa0 0x7f10701111a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:50.026 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.561+0000 7f106ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1070070fa0 0x7f10701111a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40048/0 (socket says 172.21.15.155:40048) 2023-12-16T05:49:50.026 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.561+0000 7f106ffff700 1 -- 172.21.15.155:0/4058585749 learned_addr learned my addr 172.21.15.155:0/4058585749 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:49:50.026 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.561+0000 7f106ffff700 1 -- 172.21.15.155:0/4058585749 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10600094f0 con 0x7f1070070fa0 2023-12-16T05:49:50.026 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.561+0000 7f106ffff700 1 --2- 172.21.15.155:0/4058585749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1070070fa0 0x7f10701111a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1060006b00 tx=0x7f1060009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:50.026 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.561+0000 7f106cff9700 1 -- 172.21.15.155:0/4058585749 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1060010a80 con 0x7f1070070fa0 2023-12-16T05:49:50.026 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.561+0000 7f107688e700 1 -- 172.21.15.155:0/4058585749 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10701118e0 con 0x7f1070070fa0 2023-12-16T05:49:50.026 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.561+0000 7f106cff9700 1 -- 172.21.15.155:0/4058585749 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f106001a430 con 0x7f1070070fa0 2023-12-16T05:49:50.026 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.561+0000 7f106cff9700 1 -- 172.21.15.155:0/4058585749 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f10600245b0 con 0x7f1070070fa0 2023-12-16T05:49:50.026 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.561+0000 7f107688e700 1 -- 172.21.15.155:0/4058585749 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1070111cf0 con 0x7f1070070fa0 2023-12-16T05:49:50.026 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.561+0000 7f106cff9700 1 -- 172.21.15.155:0/4058585749 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1060024ab0 con 0x7f1070070fa0 2023-12-16T05:49:50.026 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.561+0000 7f106cff9700 1 -- 172.21.15.155:0/4058585749 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f106002ec80 con 0x7f1070070fa0 2023-12-16T05:49:50.026 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.562+0000 7f10567fc700 1 -- 172.21.15.155:0/4058585749 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10500052b0 con 0x7f1070070fa0 2023-12-16T05:49:50.026 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.565+0000 7f106cff9700 1 -- 172.21.15.155:0/4058585749 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f106002e440 con 0x7f1070070fa0 2023-12-16T05:49:50.026 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.637+0000 7f10567fc700 1 -- 172.21.15.155:0/4058585749 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f1050005830 con 0x7f1070070fa0 2023-12-16T05:49:50.027 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.638+0000 7f106cff9700 1 -- 172.21.15.155:0/4058585749 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f1060010be0 con 0x7f1070070fa0 2023-12-16T05:49:50.027 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.639+0000 7f10567fc700 1 -- 172.21.15.155:0/4058585749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1070070fa0 msgr2=0x7f10701111a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:50.027 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.639+0000 7f10567fc700 1 --2- 172.21.15.155:0/4058585749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1070070fa0 0x7f10701111a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1060006b00 tx=0x7f1060009250 comp rx=0 tx=0).stop 2023-12-16T05:49:50.027 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.639+0000 7f10567fc700 1 -- 172.21.15.155:0/4058585749 shutdown_connections 2023-12-16T05:49:50.027 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.639+0000 7f10567fc700 1 --2- 172.21.15.155:0/4058585749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1070070fa0 0x7f10701111a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:50.027 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.639+0000 7f10567fc700 1 -- 172.21.15.155:0/4058585749 >> 172.21.15.155:0/4058585749 conn(0x7f10700fc970 msgr2=0x7f10700fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:49:50.027 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.639+0000 7f10567fc700 1 -- 172.21.15.155:0/4058585749 shutdown_connections 2023-12-16T05:49:50.027 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:49.639+0000 7f10567fc700 1 -- 172.21.15.155:0/4058585749 wait complete. 2023-12-16T05:49:50.027 INFO:teuthology.orchestra.run.smithi155.stdout:mgr not available, waiting (2/15)... 2023-12-16T05:49:52.737 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:52 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/3133135808' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-16T05:49:52.804 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout 2023-12-16T05:49:52.805 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout { 2023-12-16T05:49:52.805 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "fsid": "d344784e-9bd6-11ee-95a5-87774f69a715", 2023-12-16T05:49:52.805 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "health": { 2023-12-16T05:49:52.805 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-16T05:49:52.805 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-16T05:49:52.805 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-16T05:49:52.805 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:52.805 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-16T05:49:52.805 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-16T05:49:52.805 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout 0 2023-12-16T05:49:52.805 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout ], 2023-12-16T05:49:52.805 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-16T05:49:52.805 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "smithi155" 2023-12-16T05:49:52.805 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout ], 2023-12-16T05:49:52.806 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2023-12-16T05:49:52.806 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-16T05:49:52.806 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T05:49:52.806 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-16T05:49:52.806 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-16T05:49:52.806 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:52.806 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-16T05:49:52.806 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T05:49:52.806 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-16T05:49:52.806 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-16T05:49:52.806 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-16T05:49:52.813 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-16T05:49:52.814 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-16T05:49:52.814 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-16T05:49:52.814 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:52.814 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-16T05:49:52.814 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-16T05:49:52.814 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-16T05:49:52.814 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-16T05:49:52.814 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-16T05:49:52.814 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-16T05:49:52.814 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-16T05:49:52.814 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-16T05:49:52.814 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-16T05:49:52.815 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:52.815 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-16T05:49:52.815 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T05:49:52.815 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-16T05:49:52.815 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-16T05:49:52.815 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:52.815 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-16T05:49:52.815 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-16T05:49:52.815 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-16T05:49:52.815 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-16T05:49:52.815 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-16T05:49:52.815 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-16T05:49:52.816 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "restful" 2023-12-16T05:49:52.816 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout ], 2023-12-16T05:49:52.816 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T05:49:52.816 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:52.816 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-16T05:49:52.816 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T05:49:52.816 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "modified": "2023-12-16T05:49:39.806166+0000", 2023-12-16T05:49:52.816 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T05:49:52.816 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:52.816 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-16T05:49:52.816 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout } 2023-12-16T05:49:52.816 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.368+0000 7fb7d05f9700 1 Processor -- start 2023-12-16T05:49:52.816 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.368+0000 7fb7d05f9700 1 -- start start 2023-12-16T05:49:52.816 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.368+0000 7fb7d05f9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7c8071000 0x7fb7c8104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:52.816 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.368+0000 7fb7d05f9700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c81053e0 con 0x7fb7c8071000 2023-12-16T05:49:52.817 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.368+0000 7fb7ce395700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7c8071000 0x7fb7c8104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:52.817 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.368+0000 7fb7ce395700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7c8071000 0x7fb7c8104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40060/0 (socket says 172.21.15.155:40060) 2023-12-16T05:49:52.817 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.368+0000 7fb7ce395700 1 -- 172.21.15.155:0/2844121970 learned_addr learned my addr 172.21.15.155:0/2844121970 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:49:52.817 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.369+0000 7fb7ce395700 1 -- 172.21.15.155:0/2844121970 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c8105520 con 0x7fb7c8071000 2023-12-16T05:49:52.817 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.369+0000 7fb7ce395700 1 --2- 172.21.15.155:0/2844121970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7c8071000 0x7fb7c8104ea0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40098e0 tx=0x7fb7c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f861325d08e1f6cb server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:52.817 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.369+0000 7fb7cd393700 1 -- 172.21.15.155:0/2844121970 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7c400b860 con 0x7fb7c8071000 2023-12-16T05:49:52.817 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.369+0000 7fb7cd393700 1 -- 172.21.15.155:0/2844121970 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fb7c400be30 con 0x7fb7c8071000 2023-12-16T05:49:52.817 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.369+0000 7fb7cd393700 1 -- 172.21.15.155:0/2844121970 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7c4010380 con 0x7fb7c8071000 2023-12-16T05:49:52.817 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.369+0000 7fb7d05f9700 1 -- 172.21.15.155:0/2844121970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7c8071000 msgr2=0x7fb7c8104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:52.817 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.369+0000 7fb7d05f9700 1 --2- 172.21.15.155:0/2844121970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7c8071000 0x7fb7c8104ea0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40098e0 tx=0x7fb7c4009250 comp rx=0 tx=0).stop 2023-12-16T05:49:52.817 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.370+0000 7fb7d05f9700 1 -- 172.21.15.155:0/2844121970 shutdown_connections 2023-12-16T05:49:52.817 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.370+0000 7fb7d05f9700 1 --2- 172.21.15.155:0/2844121970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7c8071000 0x7fb7c8104ea0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:52.817 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.370+0000 7fb7d05f9700 1 -- 172.21.15.155:0/2844121970 >> 172.21.15.155:0/2844121970 conn(0x7fb7c80fc970 msgr2=0x7fb7c80fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:49:52.817 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.370+0000 7fb7d05f9700 1 -- 172.21.15.155:0/2844121970 shutdown_connections 2023-12-16T05:49:52.818 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.370+0000 7fb7d05f9700 1 -- 172.21.15.155:0/2844121970 wait complete. 2023-12-16T05:49:52.818 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.370+0000 7fb7d05f9700 1 Processor -- start 2023-12-16T05:49:52.818 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.370+0000 7fb7d05f9700 1 -- start start 2023-12-16T05:49:52.818 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.370+0000 7fb7d05f9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7c8071000 0x7fb7c8111160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:52.818 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.370+0000 7fb7d05f9700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c81116a0 con 0x7fb7c8071000 2023-12-16T05:49:52.818 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.370+0000 7fb7ce395700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7c8071000 0x7fb7c8111160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:52.818 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.370+0000 7fb7ce395700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7c8071000 0x7fb7c8111160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40066/0 (socket says 172.21.15.155:40066) 2023-12-16T05:49:52.818 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.370+0000 7fb7ce395700 1 -- 172.21.15.155:0/3133135808 learned_addr learned my addr 172.21.15.155:0/3133135808 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:49:52.818 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.371+0000 7fb7ce395700 1 -- 172.21.15.155:0/3133135808 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c40094f0 con 0x7fb7c8071000 2023-12-16T05:49:52.818 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.371+0000 7fb7ce395700 1 --2- 172.21.15.155:0/3133135808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7c8071000 0x7fb7c8111160 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4006b00 tx=0x7fb7c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:52.818 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.371+0000 7fb7beffd700 1 -- 172.21.15.155:0/3133135808 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7c4010a80 con 0x7fb7c8071000 2023-12-16T05:49:52.818 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.371+0000 7fb7beffd700 1 -- 172.21.15.155:0/3133135808 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fb7c401a430 con 0x7fb7c8071000 2023-12-16T05:49:52.818 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.371+0000 7fb7d05f9700 1 -- 172.21.15.155:0/3133135808 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c81118a0 con 0x7fb7c8071000 2023-12-16T05:49:52.818 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.371+0000 7fb7beffd700 1 -- 172.21.15.155:0/3133135808 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7c40245b0 con 0x7fb7c8071000 2023-12-16T05:49:52.819 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.371+0000 7fb7d05f9700 1 -- 172.21.15.155:0/3133135808 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c8111cb0 con 0x7fb7c8071000 2023-12-16T05:49:52.819 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.371+0000 7fb7beffd700 1 -- 172.21.15.155:0/3133135808 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb7c4024a60 con 0x7fb7c8071000 2023-12-16T05:49:52.819 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.371+0000 7fb7beffd700 1 -- 172.21.15.155:0/3133135808 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb7c402eab0 con 0x7fb7c8071000 2023-12-16T05:49:52.819 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.372+0000 7fb7d05f9700 1 -- 172.21.15.155:0/3133135808 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c804bb80 con 0x7fb7c8071000 2023-12-16T05:49:52.819 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.376+0000 7fb7beffd700 1 -- 172.21.15.155:0/3133135808 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb7c402ed10 con 0x7fb7c8071000 2023-12-16T05:49:52.819 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.448+0000 7fb7d05f9700 1 -- 172.21.15.155:0/3133135808 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb7c8106300 con 0x7fb7c8071000 2023-12-16T05:49:52.819 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.448+0000 7fb7beffd700 1 -- 172.21.15.155:0/3133135808 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fb7c4010be0 con 0x7fb7c8071000 2023-12-16T05:49:52.819 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.449+0000 7fb7d05f9700 1 -- 172.21.15.155:0/3133135808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7c8071000 msgr2=0x7fb7c8111160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:52.819 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.449+0000 7fb7d05f9700 1 --2- 172.21.15.155:0/3133135808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7c8071000 0x7fb7c8111160 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4006b00 tx=0x7fb7c4009250 comp rx=0 tx=0).stop 2023-12-16T05:49:52.819 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.449+0000 7fb7d05f9700 1 -- 172.21.15.155:0/3133135808 shutdown_connections 2023-12-16T05:49:52.819 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.449+0000 7fb7d05f9700 1 --2- 172.21.15.155:0/3133135808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7c8071000 0x7fb7c8111160 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:52.819 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.449+0000 7fb7d05f9700 1 -- 172.21.15.155:0/3133135808 >> 172.21.15.155:0/3133135808 conn(0x7fb7c80fc970 msgr2=0x7fb7c80fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:49:52.819 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.449+0000 7fb7d05f9700 1 -- 172.21.15.155:0/3133135808 shutdown_connections 2023-12-16T05:49:52.819 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:52.449+0000 7fb7d05f9700 1 -- 172.21.15.155:0/3133135808 wait complete. 2023-12-16T05:49:52.819 INFO:teuthology.orchestra.run.smithi155.stdout:mgr not available, waiting (3/15)... 2023-12-16T05:49:53.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:53 smithi155 ceph-mon[112451]: Activating manager daemon smithi155.maowdn 2023-12-16T05:49:53.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:53 smithi155 ceph-mon[112451]: mgrmap e2: smithi155.maowdn(active, starting, since 0.00279532s) 2023-12-16T05:49:53.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:53 smithi155 ceph-mon[112451]: from='mgr.14100 172.21.15.155:0/2537688402' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T05:49:53.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:53 smithi155 ceph-mon[112451]: from='mgr.14100 172.21.15.155:0/2537688402' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T05:49:53.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:53 smithi155 ceph-mon[112451]: from='mgr.14100 172.21.15.155:0/2537688402' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T05:49:53.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:53 smithi155 ceph-mon[112451]: from='mgr.14100 172.21.15.155:0/2537688402' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:49:53.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:53 smithi155 ceph-mon[112451]: from='mgr.14100 172.21.15.155:0/2537688402' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr metadata", "who": "smithi155.maowdn", "id": "smithi155.maowdn"}]: dispatch 2023-12-16T05:49:53.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:53 smithi155 ceph-mon[112451]: Manager daemon smithi155.maowdn is now available 2023-12-16T05:49:53.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:53 smithi155 ceph-mon[112451]: from='mgr.14100 172.21.15.155:0/2537688402' entity='mgr.smithi155.maowdn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.maowdn/mirror_snapshot_schedule"}]: dispatch 2023-12-16T05:49:53.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:53 smithi155 ceph-mon[112451]: from='mgr.14100 172.21.15.155:0/2537688402' entity='mgr.smithi155.maowdn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.maowdn/trash_purge_schedule"}]: dispatch 2023-12-16T05:49:53.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:53 smithi155 ceph-mon[112451]: from='mgr.14100 172.21.15.155:0/2537688402' entity='mgr.smithi155.maowdn' 2023-12-16T05:49:53.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:53 smithi155 ceph-mon[112451]: from='mgr.14100 172.21.15.155:0/2537688402' entity='mgr.smithi155.maowdn' 2023-12-16T05:49:53.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:53 smithi155 ceph-mon[112451]: from='mgr.14100 172.21.15.155:0/2537688402' entity='mgr.smithi155.maowdn' 2023-12-16T05:49:55.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:54 smithi155 ceph-mon[112451]: mgrmap e3: smithi155.maowdn(active, since 1.0088s) 2023-12-16T05:49:55.771 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout 2023-12-16T05:49:55.771 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout { 2023-12-16T05:49:55.771 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "fsid": "d344784e-9bd6-11ee-95a5-87774f69a715", 2023-12-16T05:49:55.771 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "health": { 2023-12-16T05:49:55.771 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-16T05:49:55.771 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-16T05:49:55.771 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-16T05:49:55.771 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:55.771 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-16T05:49:55.771 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-16T05:49:55.771 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout 0 2023-12-16T05:49:55.771 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout ], 2023-12-16T05:49:55.771 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-16T05:49:55.772 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "smithi155" 2023-12-16T05:49:55.772 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout ], 2023-12-16T05:49:55.772 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2023-12-16T05:49:55.772 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-16T05:49:55.772 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T05:49:55.772 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-16T05:49:55.772 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-16T05:49:55.772 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:55.772 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-16T05:49:55.772 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T05:49:55.772 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-16T05:49:55.772 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-16T05:49:55.772 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-16T05:49:55.780 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-16T05:49:55.780 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-16T05:49:55.780 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-16T05:49:55.780 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:55.781 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-16T05:49:55.781 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-16T05:49:55.781 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-16T05:49:55.781 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-16T05:49:55.781 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-16T05:49:55.781 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-16T05:49:55.781 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-16T05:49:55.781 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-16T05:49:55.781 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-16T05:49:55.781 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:55.781 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-16T05:49:55.781 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T05:49:55.781 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-16T05:49:55.781 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-16T05:49:55.781 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:55.782 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-16T05:49:55.782 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-16T05:49:55.782 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-16T05:49:55.782 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-16T05:49:55.782 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-16T05:49:55.782 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-16T05:49:55.782 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "restful" 2023-12-16T05:49:55.782 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout ], 2023-12-16T05:49:55.782 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T05:49:55.782 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:55.782 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-16T05:49:55.782 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T05:49:55.782 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "modified": "2023-12-16T05:49:39.806166+0000", 2023-12-16T05:49:55.782 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T05:49:55.782 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout }, 2023-12-16T05:49:55.783 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-16T05:49:55.783 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout } 2023-12-16T05:49:55.783 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.149+0000 7f4f80633700 1 Processor -- start 2023-12-16T05:49:55.783 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.149+0000 7f4f80633700 1 -- start start 2023-12-16T05:49:55.783 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.149+0000 7f4f80633700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f78077bb0 0x7f4f780760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:55.783 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.149+0000 7f4f80633700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f78077fc0 con 0x7f4f78077bb0 2023-12-16T05:49:55.783 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.149+0000 7f4f7e3cf700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f78077bb0 0x7f4f780760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:55.783 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.149+0000 7f4f7e3cf700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f78077bb0 0x7f4f780760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40136/0 (socket says 172.21.15.155:40136) 2023-12-16T05:49:55.783 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.149+0000 7f4f7e3cf700 1 -- 172.21.15.155:0/3216269311 learned_addr learned my addr 172.21.15.155:0/3216269311 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:49:55.783 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.149+0000 7f4f7e3cf700 1 -- 172.21.15.155:0/3216269311 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f78076600 con 0x7f4f78077bb0 2023-12-16T05:49:55.783 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.150+0000 7f4f7e3cf700 1 --2- 172.21.15.155:0/3216269311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f78077bb0 0x7f4f780760c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4f680098e0 tx=0x7f4f68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fca6e02c6d1c551 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:55.783 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.150+0000 7f4f7d3cd700 1 -- 172.21.15.155:0/3216269311 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f6800b860 con 0x7f4f78077bb0 2023-12-16T05:49:55.783 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.150+0000 7f4f7d3cd700 1 -- 172.21.15.155:0/3216269311 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f4f6800be30 con 0x7f4f78077bb0 2023-12-16T05:49:55.783 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.150+0000 7f4f7d3cd700 1 -- 172.21.15.155:0/3216269311 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f68010380 con 0x7f4f78077bb0 2023-12-16T05:49:55.783 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.150+0000 7f4f80633700 1 -- 172.21.15.155:0/3216269311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f78077bb0 msgr2=0x7f4f780760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:55.784 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.150+0000 7f4f80633700 1 --2- 172.21.15.155:0/3216269311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f78077bb0 0x7f4f780760c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4f680098e0 tx=0x7f4f68009250 comp rx=0 tx=0).stop 2023-12-16T05:49:55.784 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.150+0000 7f4f80633700 1 -- 172.21.15.155:0/3216269311 shutdown_connections 2023-12-16T05:49:55.784 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.150+0000 7f4f80633700 1 --2- 172.21.15.155:0/3216269311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f78077bb0 0x7f4f780760c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:55.784 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.150+0000 7f4f80633700 1 -- 172.21.15.155:0/3216269311 >> 172.21.15.155:0/3216269311 conn(0x7f4f780fda50 msgr2=0x7f4f780ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:49:55.784 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.150+0000 7f4f80633700 1 -- 172.21.15.155:0/3216269311 shutdown_connections 2023-12-16T05:49:55.784 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.150+0000 7f4f80633700 1 -- 172.21.15.155:0/3216269311 wait complete. 2023-12-16T05:49:55.784 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.151+0000 7f4f80633700 1 Processor -- start 2023-12-16T05:49:55.784 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.151+0000 7f4f80633700 1 -- start start 2023-12-16T05:49:55.784 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.151+0000 7f4f80633700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f78077bb0 0x7f4f781133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:55.784 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.151+0000 7f4f80633700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f78113910 con 0x7f4f78077bb0 2023-12-16T05:49:55.784 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.151+0000 7f4f7e3cf700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f78077bb0 0x7f4f781133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:55.784 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.151+0000 7f4f7e3cf700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f78077bb0 0x7f4f781133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40142/0 (socket says 172.21.15.155:40142) 2023-12-16T05:49:55.784 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.151+0000 7f4f7e3cf700 1 -- 172.21.15.155:0/4111287381 learned_addr learned my addr 172.21.15.155:0/4111287381 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:49:55.784 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.152+0000 7f4f7e3cf700 1 -- 172.21.15.155:0/4111287381 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f680094f0 con 0x7f4f78077bb0 2023-12-16T05:49:55.784 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.152+0000 7f4f7e3cf700 1 --2- 172.21.15.155:0/4111287381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f78077bb0 0x7f4f781133d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800b440 tx=0x7f4f68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:55.785 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.152+0000 7f4f6effd700 1 -- 172.21.15.155:0/4111287381 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f680107a0 con 0x7f4f78077bb0 2023-12-16T05:49:55.785 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.152+0000 7f4f6effd700 1 -- 172.21.15.155:0/4111287381 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f4f68010d70 con 0x7f4f78077bb0 2023-12-16T05:49:55.785 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.152+0000 7f4f80633700 1 -- 172.21.15.155:0/4111287381 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f78113b10 con 0x7f4f78077bb0 2023-12-16T05:49:55.785 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.152+0000 7f4f6effd700 1 -- 172.21.15.155:0/4111287381 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f6801adc0 con 0x7f4f78077bb0 2023-12-16T05:49:55.785 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.152+0000 7f4f80633700 1 -- 172.21.15.155:0/4111287381 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f78113f20 con 0x7f4f78077bb0 2023-12-16T05:49:55.785 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.153+0000 7f4f6effd700 1 -- 172.21.15.155:0/4111287381 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 3) v1 ==== 43164+0+0 (secure 0 0 0) 0x7f4f68010900 con 0x7f4f78077bb0 2023-12-16T05:49:55.785 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.153+0000 7f4f6effd700 1 --2- 172.21.15.155:0/4111287381 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7f4f640364c0 0x7f4f64038970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:55.785 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.153+0000 7f4f6effd700 1 -- 172.21.15.155:0/4111287381 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4f680499e0 con 0x7f4f78077bb0 2023-12-16T05:49:55.785 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.153+0000 7f4f80633700 1 -- 172.21.15.155:0/4111287381 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f7804bb80 con 0x7f4f78077bb0 2023-12-16T05:49:55.785 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.153+0000 7f4f7dbce700 1 --2- 172.21.15.155:0/4111287381 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7f4f640364c0 0x7f4f64038970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:55.785 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.153+0000 7f4f7dbce700 1 --2- 172.21.15.155:0/4111287381 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7f4f640364c0 0x7f4f64038970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009990 tx=0x7f4f74006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:55.785 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.158+0000 7f4f6effd700 1 -- 172.21.15.155:0/4111287381 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4f6802c350 con 0x7f4f78077bb0 2023-12-16T05:49:55.785 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.415+0000 7f4f80633700 1 -- 172.21.15.155:0/4111287381 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f4f7810cf90 con 0x7f4f78077bb0 2023-12-16T05:49:55.786 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.416+0000 7f4f6effd700 1 -- 172.21.15.155:0/4111287381 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f4f68006d70 con 0x7f4f78077bb0 2023-12-16T05:49:55.786 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.418+0000 7f4f80633700 1 -- 172.21.15.155:0/4111287381 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7f4f640364c0 msgr2=0x7f4f64038970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:55.786 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.418+0000 7f4f80633700 1 --2- 172.21.15.155:0/4111287381 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7f4f640364c0 0x7f4f64038970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009990 tx=0x7f4f74006e40 comp rx=0 tx=0).stop 2023-12-16T05:49:55.786 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.418+0000 7f4f80633700 1 -- 172.21.15.155:0/4111287381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f78077bb0 msgr2=0x7f4f781133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:55.786 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.418+0000 7f4f80633700 1 --2- 172.21.15.155:0/4111287381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f78077bb0 0x7f4f781133d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800b440 tx=0x7f4f68009250 comp rx=0 tx=0).stop 2023-12-16T05:49:55.786 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.418+0000 7f4f80633700 1 -- 172.21.15.155:0/4111287381 shutdown_connections 2023-12-16T05:49:55.786 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.418+0000 7f4f80633700 1 --2- 172.21.15.155:0/4111287381 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7f4f640364c0 0x7f4f64038970 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:55.786 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.418+0000 7f4f80633700 1 --2- 172.21.15.155:0/4111287381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f78077bb0 0x7f4f781133d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:55.786 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.418+0000 7f4f80633700 1 -- 172.21.15.155:0/4111287381 >> 172.21.15.155:0/4111287381 conn(0x7f4f780fda50 msgr2=0x7f4f780ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:49:55.786 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.418+0000 7f4f80633700 1 -- 172.21.15.155:0/4111287381 shutdown_connections 2023-12-16T05:49:55.786 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:55.418+0000 7f4f80633700 1 -- 172.21.15.155:0/4111287381 wait complete. 2023-12-16T05:49:55.786 INFO:teuthology.orchestra.run.smithi155.stdout:mgr is available 2023-12-16T05:49:56.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:55 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/4111287381' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-16T05:49:56.652 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout 2023-12-16T05:49:56.658 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout [global] 2023-12-16T05:49:56.658 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout fsid = d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:49:56.658 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-16T05:49:56.658 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-16T05:49:56.658 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-16T05:49:56.658 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-16T05:49:56.658 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout 2023-12-16T05:49:56.658 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-16T05:49:56.659 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-16T05:49:56.659 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout 2023-12-16T05:49:56.659 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout [osd] 2023-12-16T05:49:56.659 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-16T05:49:56.659 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-16T05:49:56.659 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-16T05:49:56.659 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-16T05:49:56.659 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-16T05:49:56.659 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.110+0000 7f65c35f9700 1 Processor -- start 2023-12-16T05:49:56.659 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.110+0000 7f65c35f9700 1 -- start start 2023-12-16T05:49:56.659 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.111+0000 7f65c35f9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65bc1038f0 0x7f65bc103d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:56.659 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.111+0000 7f65c35f9700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc104240 con 0x7f65bc1038f0 2023-12-16T05:49:56.659 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.111+0000 7f65c1395700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65bc1038f0 0x7f65bc103d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:56.659 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.111+0000 7f65c1395700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65bc1038f0 0x7f65bc103d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40144/0 (socket says 172.21.15.155:40144) 2023-12-16T05:49:56.659 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.111+0000 7f65c1395700 1 -- 172.21.15.155:0/841802666 learned_addr learned my addr 172.21.15.155:0/841802666 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:49:56.660 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.111+0000 7f65c1395700 1 -- 172.21.15.155:0/841802666 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc104380 con 0x7f65bc1038f0 2023-12-16T05:49:56.660 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.111+0000 7f65c1395700 1 --2- 172.21.15.155:0/841802666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65bc1038f0 0x7f65bc103d00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f65b00098e0 tx=0x7f65b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac107b422c118f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:56.660 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.111+0000 7f65affff700 1 -- 172.21.15.155:0/841802666 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65b000b860 con 0x7f65bc1038f0 2023-12-16T05:49:56.660 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.111+0000 7f65affff700 1 -- 172.21.15.155:0/841802666 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f65b000be30 con 0x7f65bc1038f0 2023-12-16T05:49:56.660 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.111+0000 7f65affff700 1 -- 172.21.15.155:0/841802666 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65b0010380 con 0x7f65bc1038f0 2023-12-16T05:49:56.660 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.112+0000 7f65c35f9700 1 -- 172.21.15.155:0/841802666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65bc1038f0 msgr2=0x7f65bc103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:56.660 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.112+0000 7f65c35f9700 1 --2- 172.21.15.155:0/841802666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65bc1038f0 0x7f65bc103d00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f65b00098e0 tx=0x7f65b0009250 comp rx=0 tx=0).stop 2023-12-16T05:49:56.660 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.112+0000 7f65c35f9700 1 -- 172.21.15.155:0/841802666 shutdown_connections 2023-12-16T05:49:56.660 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.112+0000 7f65c35f9700 1 --2- 172.21.15.155:0/841802666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65bc1038f0 0x7f65bc103d00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:56.660 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.112+0000 7f65c35f9700 1 -- 172.21.15.155:0/841802666 >> 172.21.15.155:0/841802666 conn(0x7f65bc0fc0b0 msgr2=0x7f65bc0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:49:56.660 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.112+0000 7f65c35f9700 1 -- 172.21.15.155:0/841802666 shutdown_connections 2023-12-16T05:49:56.660 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.112+0000 7f65c35f9700 1 -- 172.21.15.155:0/841802666 wait complete. 2023-12-16T05:49:56.660 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.112+0000 7f65c35f9700 1 Processor -- start 2023-12-16T05:49:56.660 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.113+0000 7f65c35f9700 1 -- start start 2023-12-16T05:49:56.660 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.113+0000 7f65c35f9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65bc1038f0 0x7f65bc111100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:56.661 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.113+0000 7f65c35f9700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc111640 con 0x7f65bc1038f0 2023-12-16T05:49:56.661 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.113+0000 7f65c1395700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65bc1038f0 0x7f65bc111100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:56.661 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.113+0000 7f65c1395700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65bc1038f0 0x7f65bc111100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40150/0 (socket says 172.21.15.155:40150) 2023-12-16T05:49:56.661 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.113+0000 7f65c1395700 1 -- 172.21.15.155:0/335774750 learned_addr learned my addr 172.21.15.155:0/335774750 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:49:56.661 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.113+0000 7f65c1395700 1 -- 172.21.15.155:0/335774750 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b00094f0 con 0x7f65bc1038f0 2023-12-16T05:49:56.661 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.113+0000 7f65c1395700 1 --2- 172.21.15.155:0/335774750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65bc1038f0 0x7f65bc111100 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f65b0000c00 tx=0x7f65b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:56.661 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.113+0000 7f65adffb700 1 -- 172.21.15.155:0/335774750 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65b0010a80 con 0x7f65bc1038f0 2023-12-16T05:49:56.661 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.113+0000 7f65adffb700 1 -- 172.21.15.155:0/335774750 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f65b001a430 con 0x7f65bc1038f0 2023-12-16T05:49:56.661 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.113+0000 7f65c35f9700 1 -- 172.21.15.155:0/335774750 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65bc111840 con 0x7f65bc1038f0 2023-12-16T05:49:56.661 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.113+0000 7f65adffb700 1 -- 172.21.15.155:0/335774750 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65b00245b0 con 0x7f65bc1038f0 2023-12-16T05:49:56.661 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.114+0000 7f65c35f9700 1 -- 172.21.15.155:0/335774750 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65bc111c50 con 0x7f65bc1038f0 2023-12-16T05:49:56.661 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.114+0000 7f65adffb700 1 -- 172.21.15.155:0/335774750 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f65b00247f0 con 0x7f65bc1038f0 2023-12-16T05:49:56.661 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.114+0000 7f65c35f9700 1 -- 172.21.15.155:0/335774750 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65bc04bb80 con 0x7f65bc1038f0 2023-12-16T05:49:56.661 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.114+0000 7f65adffb700 1 --2- 172.21.15.155:0/335774750 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7f65a80365a0 0x7f65a8038a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:56.662 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.115+0000 7f65adffb700 1 -- 172.21.15.155:0/335774750 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f65b004aad0 con 0x7f65bc1038f0 2023-12-16T05:49:56.662 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.115+0000 7f65c0b94700 1 --2- 172.21.15.155:0/335774750 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7f65a80365a0 0x7f65a8038a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:56.662 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.115+0000 7f65c0b94700 1 --2- 172.21.15.155:0/335774750 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7f65a80365a0 0x7f65a8038a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f65b8009990 tx=0x7f65b8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:56.662 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.119+0000 7f65adffb700 1 -- 172.21.15.155:0/335774750 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f65b0018350 con 0x7f65bc1038f0 2023-12-16T05:49:56.662 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.300+0000 7f65c35f9700 1 -- 172.21.15.155:0/335774750 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f65bc100dd0 con 0x7f65bc1038f0 2023-12-16T05:49:56.662 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.301+0000 7f65adffb700 1 -- 172.21.15.155:0/335774750 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f65b0023b80 con 0x7f65bc1038f0 2023-12-16T05:49:56.662 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.303+0000 7f65c35f9700 1 -- 172.21.15.155:0/335774750 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7f65a80365a0 msgr2=0x7f65a8038a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:56.662 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.303+0000 7f65c35f9700 1 --2- 172.21.15.155:0/335774750 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7f65a80365a0 0x7f65a8038a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f65b8009990 tx=0x7f65b8006e40 comp rx=0 tx=0).stop 2023-12-16T05:49:56.662 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.303+0000 7f65c35f9700 1 -- 172.21.15.155:0/335774750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65bc1038f0 msgr2=0x7f65bc111100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:56.662 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.303+0000 7f65c35f9700 1 --2- 172.21.15.155:0/335774750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65bc1038f0 0x7f65bc111100 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f65b0000c00 tx=0x7f65b0009250 comp rx=0 tx=0).stop 2023-12-16T05:49:56.662 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.303+0000 7f65c35f9700 1 -- 172.21.15.155:0/335774750 shutdown_connections 2023-12-16T05:49:56.662 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.303+0000 7f65c35f9700 1 --2- 172.21.15.155:0/335774750 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7f65a80365a0 0x7f65a8038a50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:56.662 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.303+0000 7f65c35f9700 1 --2- 172.21.15.155:0/335774750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65bc1038f0 0x7f65bc111100 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:56.662 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.303+0000 7f65c35f9700 1 -- 172.21.15.155:0/335774750 >> 172.21.15.155:0/335774750 conn(0x7f65bc0fc0b0 msgr2=0x7f65bc0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:49:56.662 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.303+0000 7f65c35f9700 1 -- 172.21.15.155:0/335774750 shutdown_connections 2023-12-16T05:49:56.663 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:56.303+0000 7f65c35f9700 1 -- 172.21.15.155:0/335774750 wait complete. 2023-12-16T05:49:56.663 INFO:teuthology.orchestra.run.smithi155.stdout:Enabling cephadm module... 2023-12-16T05:49:57.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:56 smithi155 ceph-mon[112451]: mgrmap e4: smithi155.maowdn(active, since 3s) 2023-12-16T05:49:57.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:56 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/335774750' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-16T05:49:58.234 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:57 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2610971551' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-12-16T05:49:59.217 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:58 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2610971551' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-12-16T05:49:59.217 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:49:58 smithi155 ceph-mon[112451]: mgrmap e5: smithi155.maowdn(active, since 5s) 2023-12-16T05:49:59.739 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.002+0000 7fa1f8acd700 1 Processor -- start 2023-12-16T05:49:59.739 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.002+0000 7fa1f8acd700 1 -- start start 2023-12-16T05:49:59.740 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.003+0000 7fa1f8acd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f4076c20 0x7fa1f4104ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:59.740 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.003+0000 7fa1f8acd700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f4105410 con 0x7fa1f4076c20 2023-12-16T05:49:59.740 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.003+0000 7fa1f259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f4076c20 0x7fa1f4104ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:59.740 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.003+0000 7fa1f259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f4076c20 0x7fa1f4104ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:36994/0 (socket says 172.21.15.155:36994) 2023-12-16T05:49:59.740 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.003+0000 7fa1f259c700 1 -- 172.21.15.155:0/627418403 learned_addr learned my addr 172.21.15.155:0/627418403 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:49:59.740 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.003+0000 7fa1f259c700 1 -- 172.21.15.155:0/627418403 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f4105550 con 0x7fa1f4076c20 2023-12-16T05:49:59.740 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.003+0000 7fa1f259c700 1 --2- 172.21.15.155:0/627418403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f4076c20 0x7fa1f4104ed0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa1e80098e0 tx=0x7fa1e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2970b6acac10be server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:59.740 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.003+0000 7fa1f159a700 1 -- 172.21.15.155:0/627418403 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1e800b860 con 0x7fa1f4076c20 2023-12-16T05:49:59.740 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.003+0000 7fa1f159a700 1 -- 172.21.15.155:0/627418403 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa1e800be30 con 0x7fa1f4076c20 2023-12-16T05:49:59.740 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.003+0000 7fa1f159a700 1 -- 172.21.15.155:0/627418403 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1e8010380 con 0x7fa1f4076c20 2023-12-16T05:49:59.740 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.004+0000 7fa1f8acd700 1 -- 172.21.15.155:0/627418403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f4076c20 msgr2=0x7fa1f4104ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:59.740 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.004+0000 7fa1f8acd700 1 --2- 172.21.15.155:0/627418403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f4076c20 0x7fa1f4104ed0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa1e80098e0 tx=0x7fa1e8009250 comp rx=0 tx=0).stop 2023-12-16T05:49:59.740 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.004+0000 7fa1f8acd700 1 -- 172.21.15.155:0/627418403 shutdown_connections 2023-12-16T05:49:59.740 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.004+0000 7fa1f8acd700 1 --2- 172.21.15.155:0/627418403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f4076c20 0x7fa1f4104ed0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:59.741 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.004+0000 7fa1f8acd700 1 -- 172.21.15.155:0/627418403 >> 172.21.15.155:0/627418403 conn(0x7fa1f40fc980 msgr2=0x7fa1f40fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:49:59.741 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.004+0000 7fa1f8acd700 1 -- 172.21.15.155:0/627418403 shutdown_connections 2023-12-16T05:49:59.741 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.004+0000 7fa1f8acd700 1 -- 172.21.15.155:0/627418403 wait complete. 2023-12-16T05:49:59.741 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.005+0000 7fa1f8acd700 1 Processor -- start 2023-12-16T05:49:59.741 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.005+0000 7fa1f8acd700 1 -- start start 2023-12-16T05:49:59.741 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.005+0000 7fa1f8acd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f4076c20 0x7fa1f4102950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:59.741 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.005+0000 7fa1f8acd700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f4100dd0 con 0x7fa1f4076c20 2023-12-16T05:49:59.741 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.005+0000 7fa1f259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f4076c20 0x7fa1f4102950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:59.741 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.005+0000 7fa1f259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f4076c20 0x7fa1f4102950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37008/0 (socket says 172.21.15.155:37008) 2023-12-16T05:49:59.741 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.005+0000 7fa1f259c700 1 -- 172.21.15.155:0/2610971551 learned_addr learned my addr 172.21.15.155:0/2610971551 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:49:59.741 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.005+0000 7fa1f259c700 1 -- 172.21.15.155:0/2610971551 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e80094f0 con 0x7fa1f4076c20 2023-12-16T05:49:59.741 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.005+0000 7fa1f259c700 1 --2- 172.21.15.155:0/2610971551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f4076c20 0x7fa1f4102950 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8006d40 tx=0x7fa1e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:59.741 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.005+0000 7fa1e2ffd700 1 -- 172.21.15.155:0/2610971551 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1e80109b0 con 0x7fa1f4076c20 2023-12-16T05:49:59.741 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.005+0000 7fa1e2ffd700 1 -- 172.21.15.155:0/2610971551 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa1e8024440 con 0x7fa1f4076c20 2023-12-16T05:49:59.742 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.005+0000 7fa1f8acd700 1 -- 172.21.15.155:0/2610971551 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f4100fd0 con 0x7fa1f4076c20 2023-12-16T05:49:59.742 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.005+0000 7fa1e2ffd700 1 -- 172.21.15.155:0/2610971551 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1e801a5f0 con 0x7fa1f4076c20 2023-12-16T05:49:59.742 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.005+0000 7fa1f8acd700 1 -- 172.21.15.155:0/2610971551 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f41013e0 con 0x7fa1f4076c20 2023-12-16T05:49:59.742 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.006+0000 7fa1e2ffd700 1 -- 172.21.15.155:0/2610971551 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7fa1e801a870 con 0x7fa1f4076c20 2023-12-16T05:49:59.742 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.006+0000 7fa1f8acd700 1 -- 172.21.15.155:0/2610971551 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f404bb80 con 0x7fa1f4076c20 2023-12-16T05:49:59.742 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.006+0000 7fa1e2ffd700 1 --2- 172.21.15.155:0/2610971551 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7fa1dc0365a0 0x7fa1dc038a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:49:59.742 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.006+0000 7fa1e2ffd700 1 -- 172.21.15.155:0/2610971551 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa1e804a5a0 con 0x7fa1f4076c20 2023-12-16T05:49:59.742 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.007+0000 7fa1f1d9b700 1 --2- 172.21.15.155:0/2610971551 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7fa1dc0365a0 0x7fa1dc038a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:49:59.742 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.007+0000 7fa1f1d9b700 1 --2- 172.21.15.155:0/2610971551 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7fa1dc0365a0 0x7fa1dc038a50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009990 tx=0x7fa1e4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:49:59.742 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.011+0000 7fa1e2ffd700 1 -- 172.21.15.155:0/2610971551 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa1e8018350 con 0x7fa1f4076c20 2023-12-16T05:49:59.742 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.250+0000 7fa1f8acd700 1 -- 172.21.15.155:0/2610971551 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fa1f4106300 con 0x7fa1f4076c20 2023-12-16T05:49:59.742 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.911+0000 7fa1e2ffd700 1 -- 172.21.15.155:0/2610971551 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fa1e8024970 con 0x7fa1f4076c20 2023-12-16T05:49:59.742 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.912+0000 7fa1e2ffd700 1 -- 172.21.15.155:0/2610971551 <== mon.0 v2:172.21.15.155:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fa1e802ca80 con 0x7fa1f4076c20 2023-12-16T05:49:59.742 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.915+0000 7fa1f8acd700 1 -- 172.21.15.155:0/2610971551 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7fa1dc0365a0 msgr2=0x7fa1dc038a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:59.743 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.915+0000 7fa1f8acd700 1 --2- 172.21.15.155:0/2610971551 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7fa1dc0365a0 0x7fa1dc038a50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009990 tx=0x7fa1e4006e40 comp rx=0 tx=0).stop 2023-12-16T05:49:59.743 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.915+0000 7fa1f8acd700 1 -- 172.21.15.155:0/2610971551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f4076c20 msgr2=0x7fa1f4102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:49:59.743 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.915+0000 7fa1f8acd700 1 --2- 172.21.15.155:0/2610971551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f4076c20 0x7fa1f4102950 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8006d40 tx=0x7fa1e8009250 comp rx=0 tx=0).stop 2023-12-16T05:49:59.743 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.915+0000 7fa1f8acd700 1 -- 172.21.15.155:0/2610971551 shutdown_connections 2023-12-16T05:49:59.743 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.915+0000 7fa1f8acd700 1 --2- 172.21.15.155:0/2610971551 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7fa1dc0365a0 0x7fa1dc038a50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:59.743 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.915+0000 7fa1f8acd700 1 --2- 172.21.15.155:0/2610971551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f4076c20 0x7fa1f4102950 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:49:59.743 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.915+0000 7fa1f8acd700 1 -- 172.21.15.155:0/2610971551 >> 172.21.15.155:0/2610971551 conn(0x7fa1f40fc980 msgr2=0x7fa1f40fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:49:59.743 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.915+0000 7fa1f8acd700 1 -- 172.21.15.155:0/2610971551 shutdown_connections 2023-12-16T05:49:59.743 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:49:57.915+0000 7fa1f8acd700 1 -- 172.21.15.155:0/2610971551 wait complete. 2023-12-16T05:50:01.358 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:01 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/569927701' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-16T05:50:03.281 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout { 2023-12-16T05:50:03.281 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-12-16T05:50:03.281 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-16T05:50:03.281 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "active_name": "smithi155.maowdn", 2023-12-16T05:50:03.281 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-16T05:50:03.282 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout } 2023-12-16T05:50:03.282 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.914+0000 7fc62715a700 1 Processor -- start 2023-12-16T05:50:03.282 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.914+0000 7fc62715a700 1 -- start start 2023-12-16T05:50:03.282 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.914+0000 7fc62715a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6201011d0 0x7fc6201015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:03.282 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.914+0000 7fc62715a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc620101b20 con 0x7fc6201011d0 2023-12-16T05:50:03.282 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.914+0000 7fc624ef6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6201011d0 0x7fc6201015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:03.282 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.914+0000 7fc624ef6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6201011d0 0x7fc6201015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37030/0 (socket says 172.21.15.155:37030) 2023-12-16T05:50:03.282 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.914+0000 7fc624ef6700 1 -- 172.21.15.155:0/1109525042 learned_addr learned my addr 172.21.15.155:0/1109525042 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:03.282 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.914+0000 7fc624ef6700 1 -- 172.21.15.155:0/1109525042 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc620101c60 con 0x7fc6201011d0 2023-12-16T05:50:03.282 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.915+0000 7fc624ef6700 1 --2- 172.21.15.155:0/1109525042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6201011d0 0x7fc6201015e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc6140098e0 tx=0x7fc614009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597dad512e063074 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:03.282 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.915+0000 7fc61f7fe700 1 -- 172.21.15.155:0/1109525042 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc61400b860 con 0x7fc6201011d0 2023-12-16T05:50:03.282 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.915+0000 7fc61f7fe700 1 -- 172.21.15.155:0/1109525042 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fc61400be30 con 0x7fc6201011d0 2023-12-16T05:50:03.282 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.915+0000 7fc61f7fe700 1 -- 172.21.15.155:0/1109525042 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc614010380 con 0x7fc6201011d0 2023-12-16T05:50:03.282 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.915+0000 7fc62715a700 1 -- 172.21.15.155:0/1109525042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6201011d0 msgr2=0x7fc6201015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:03.282 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.915+0000 7fc62715a700 1 --2- 172.21.15.155:0/1109525042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6201011d0 0x7fc6201015e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc6140098e0 tx=0x7fc614009250 comp rx=0 tx=0).stop 2023-12-16T05:50:03.283 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.915+0000 7fc62715a700 1 -- 172.21.15.155:0/1109525042 shutdown_connections 2023-12-16T05:50:03.283 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.915+0000 7fc62715a700 1 --2- 172.21.15.155:0/1109525042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6201011d0 0x7fc6201015e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:03.283 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.915+0000 7fc62715a700 1 -- 172.21.15.155:0/1109525042 >> 172.21.15.155:0/1109525042 conn(0x7fc6200fc970 msgr2=0x7fc6200fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:03.283 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.915+0000 7fc62715a700 1 -- 172.21.15.155:0/1109525042 shutdown_connections 2023-12-16T05:50:03.283 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.915+0000 7fc62715a700 1 -- 172.21.15.155:0/1109525042 wait complete. 2023-12-16T05:50:03.283 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.916+0000 7fc62715a700 1 Processor -- start 2023-12-16T05:50:03.283 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.916+0000 7fc62715a700 1 -- start start 2023-12-16T05:50:03.283 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.916+0000 7fc62715a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6201011d0 0x7fc620113e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:03.283 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.916+0000 7fc62715a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc620070f90 con 0x7fc6201011d0 2023-12-16T05:50:03.283 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.916+0000 7fc624ef6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6201011d0 0x7fc620113e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:03.283 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.916+0000 7fc624ef6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6201011d0 0x7fc620113e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37044/0 (socket says 172.21.15.155:37044) 2023-12-16T05:50:03.283 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.917+0000 7fc624ef6700 1 -- 172.21.15.155:0/569927701 learned_addr learned my addr 172.21.15.155:0/569927701 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:03.283 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.917+0000 7fc624ef6700 1 -- 172.21.15.155:0/569927701 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6140094f0 con 0x7fc6201011d0 2023-12-16T05:50:03.283 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.917+0000 7fc624ef6700 1 --2- 172.21.15.155:0/569927701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6201011d0 0x7fc620113e50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc614006b00 tx=0x7fc614009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:03.283 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.917+0000 7fc61d7fa700 1 -- 172.21.15.155:0/569927701 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc6140109b0 con 0x7fc6201011d0 2023-12-16T05:50:03.284 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.917+0000 7fc61d7fa700 1 -- 172.21.15.155:0/569927701 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fc614024440 con 0x7fc6201011d0 2023-12-16T05:50:03.284 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.917+0000 7fc62715a700 1 -- 172.21.15.155:0/569927701 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc620071190 con 0x7fc6201011d0 2023-12-16T05:50:03.284 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.917+0000 7fc61d7fa700 1 -- 172.21.15.155:0/569927701 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc61401a5f0 con 0x7fc6201011d0 2023-12-16T05:50:03.284 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.917+0000 7fc62715a700 1 -- 172.21.15.155:0/569927701 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc620114550 con 0x7fc6201011d0 2023-12-16T05:50:03.284 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.918+0000 7fc62715a700 1 -- 172.21.15.155:0/569927701 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62010a050 con 0x7fc6201011d0 2023-12-16T05:50:03.284 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.918+0000 7fc61d7fa700 1 -- 172.21.15.155:0/569927701 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fc61401a860 con 0x7fc6201011d0 2023-12-16T05:50:03.284 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.918+0000 7fc61d7fa700 1 --2- 172.21.15.155:0/569927701 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7fc610036640 0x7fc610038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:03.284 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.918+0000 7fc61d7fa700 1 -- 172.21.15.155:0/569927701 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc61404a590 con 0x7fc6201011d0 2023-12-16T05:50:03.284 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.918+0000 7fc61ffff700 1 -- 172.21.15.155:0/569927701 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7fc610036640 msgr2=0x7fc610038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6800/291007537 2023-12-16T05:50:03.284 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.918+0000 7fc61ffff700 1 --2- 172.21.15.155:0/569927701 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7fc610036640 0x7fc610038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T05:50:03.284 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:00.923+0000 7fc61d7fa700 1 -- 172.21.15.155:0/569927701 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc614022340 con 0x7fc6201011d0 2023-12-16T05:50:03.284 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:01.119+0000 7fc61ffff700 1 -- 172.21.15.155:0/569927701 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7fc610036640 msgr2=0x7fc610038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6800/291007537 2023-12-16T05:50:03.284 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:01.119+0000 7fc61ffff700 1 --2- 172.21.15.155:0/569927701 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7fc610036640 0x7fc610038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T05:50:03.284 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:01.164+0000 7fc62715a700 1 -- 172.21.15.155:0/569927701 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fc62002b1b0 con 0x7fc6201011d0 2023-12-16T05:50:03.284 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:01.165+0000 7fc61d7fa700 1 -- 172.21.15.155:0/569927701 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fc614020e90 con 0x7fc6201011d0 2023-12-16T05:50:03.285 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:01.167+0000 7fc62715a700 1 -- 172.21.15.155:0/569927701 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7fc610036640 msgr2=0x7fc610038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T05:50:03.285 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:01.167+0000 7fc62715a700 1 --2- 172.21.15.155:0/569927701 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7fc610036640 0x7fc610038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:03.285 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:01.167+0000 7fc62715a700 1 -- 172.21.15.155:0/569927701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6201011d0 msgr2=0x7fc620113e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:03.285 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:01.167+0000 7fc62715a700 1 --2- 172.21.15.155:0/569927701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6201011d0 0x7fc620113e50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc614006b00 tx=0x7fc614009250 comp rx=0 tx=0).stop 2023-12-16T05:50:03.285 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:01.167+0000 7fc62715a700 1 -- 172.21.15.155:0/569927701 shutdown_connections 2023-12-16T05:50:03.285 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:01.167+0000 7fc62715a700 1 --2- 172.21.15.155:0/569927701 >> [v2:172.21.15.155:6800/291007537,v1:172.21.15.155:6801/291007537] conn(0x7fc610036640 0x7fc610038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:03.285 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:01.167+0000 7fc62715a700 1 --2- 172.21.15.155:0/569927701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6201011d0 0x7fc620113e50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:03.285 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:01.167+0000 7fc62715a700 1 -- 172.21.15.155:0/569927701 >> 172.21.15.155:0/569927701 conn(0x7fc6200fc970 msgr2=0x7fc6200fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:03.285 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:01.167+0000 7fc62715a700 1 -- 172.21.15.155:0/569927701 shutdown_connections 2023-12-16T05:50:03.285 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:01.167+0000 7fc62715a700 1 -- 172.21.15.155:0/569927701 wait complete. 2023-12-16T05:50:03.285 INFO:teuthology.orchestra.run.smithi155.stdout:Waiting for the mgr to restart... 2023-12-16T05:50:03.285 INFO:teuthology.orchestra.run.smithi155.stdout:Waiting for mgr epoch 5... 2023-12-16T05:50:04.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:04 smithi155 ceph-mon[112451]: Active manager daemon smithi155.maowdn restarted 2023-12-16T05:50:04.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:04 smithi155 ceph-mon[112451]: Activating manager daemon smithi155.maowdn 2023-12-16T05:50:04.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:04 smithi155 ceph-mon[112451]: osdmap e2: 0 total, 0 up, 0 in 2023-12-16T05:50:04.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:04 smithi155 ceph-mon[112451]: mgrmap e6: smithi155.maowdn(active, starting, since 0.00299821s) 2023-12-16T05:50:04.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:04 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:50:04.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:04 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr metadata", "who": "smithi155.maowdn", "id": "smithi155.maowdn"}]: dispatch 2023-12-16T05:50:04.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:04 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T05:50:04.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:04 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T05:50:04.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:04 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T05:50:04.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:04 smithi155 ceph-mon[112451]: Manager daemon smithi155.maowdn is now available 2023-12-16T05:50:04.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:04 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:04.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:04 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:04.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:04 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:50:04.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:04 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:50:04.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:04 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:50:05.752 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:05 smithi155 ceph-mon[112451]: Found migration_current of "None". Setting to last migration. 2023-12-16T05:50:05.752 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:05 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.maowdn/mirror_snapshot_schedule"}]: dispatch 2023-12-16T05:50:05.752 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:05 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.maowdn/trash_purge_schedule"}]: dispatch 2023-12-16T05:50:05.753 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:05 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:05.753 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:05 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:50:05.753 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:05 smithi155 ceph-mon[112451]: mgrmap e7: smithi155.maowdn(active, since 1.00813s) 2023-12-16T05:50:05.831 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout { 2023-12-16T05:50:05.831 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-12-16T05:50:05.831 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-16T05:50:05.831 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout } 2023-12-16T05:50:05.831 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.554+0000 7f09cb2ef700 1 Processor -- start 2023-12-16T05:50:05.831 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.555+0000 7f09cb2ef700 1 -- start start 2023-12-16T05:50:05.831 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.555+0000 7f09cb2ef700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c41011d0 0x7f09c41015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:05.831 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.555+0000 7f09cb2ef700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c4101b20 con 0x7f09c41011d0 2023-12-16T05:50:05.831 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.555+0000 7f09c908b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c41011d0 0x7f09c41015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:05.831 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.555+0000 7f09c908b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c41011d0 0x7f09c41015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37140/0 (socket says 172.21.15.155:37140) 2023-12-16T05:50:05.831 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.555+0000 7f09c908b700 1 -- 172.21.15.155:0/15747261 learned_addr learned my addr 172.21.15.155:0/15747261 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:05.831 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.555+0000 7f09c908b700 1 -- 172.21.15.155:0/15747261 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c4101c60 con 0x7f09c41011d0 2023-12-16T05:50:05.832 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.556+0000 7f09c908b700 1 --2- 172.21.15.155:0/15747261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c41011d0 0x7f09c41015e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f09b40098e0 tx=0x7f09b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77220dc7dce71642 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:05.832 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.556+0000 7f09bbfff700 1 -- 172.21.15.155:0/15747261 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09b400b860 con 0x7f09c41011d0 2023-12-16T05:50:05.832 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.556+0000 7f09bbfff700 1 -- 172.21.15.155:0/15747261 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f09b400be30 con 0x7f09c41011d0 2023-12-16T05:50:05.832 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.556+0000 7f09bbfff700 1 -- 172.21.15.155:0/15747261 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09b4010380 con 0x7f09c41011d0 2023-12-16T05:50:05.832 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.556+0000 7f09cb2ef700 1 -- 172.21.15.155:0/15747261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c41011d0 msgr2=0x7f09c41015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:05.832 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.556+0000 7f09cb2ef700 1 --2- 172.21.15.155:0/15747261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c41011d0 0x7f09c41015e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f09b40098e0 tx=0x7f09b4009250 comp rx=0 tx=0).stop 2023-12-16T05:50:05.832 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.556+0000 7f09cb2ef700 1 -- 172.21.15.155:0/15747261 shutdown_connections 2023-12-16T05:50:05.832 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.556+0000 7f09cb2ef700 1 --2- 172.21.15.155:0/15747261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c41011d0 0x7f09c41015e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:05.832 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.556+0000 7f09cb2ef700 1 -- 172.21.15.155:0/15747261 >> 172.21.15.155:0/15747261 conn(0x7f09c40fc970 msgr2=0x7f09c40fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:05.832 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.556+0000 7f09cb2ef700 1 -- 172.21.15.155:0/15747261 shutdown_connections 2023-12-16T05:50:05.832 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.556+0000 7f09cb2ef700 1 -- 172.21.15.155:0/15747261 wait complete. 2023-12-16T05:50:05.832 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.557+0000 7f09cb2ef700 1 Processor -- start 2023-12-16T05:50:05.832 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.557+0000 7f09cb2ef700 1 -- start start 2023-12-16T05:50:05.832 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.557+0000 7f09cb2ef700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c41011d0 0x7f09c4113e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:05.832 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.557+0000 7f09cb2ef700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c4070fb0 con 0x7f09c41011d0 2023-12-16T05:50:05.832 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.557+0000 7f09c908b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c41011d0 0x7f09c4113e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:05.833 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.557+0000 7f09c908b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c41011d0 0x7f09c4113e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37142/0 (socket says 172.21.15.155:37142) 2023-12-16T05:50:05.833 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.558+0000 7f09c908b700 1 -- 172.21.15.155:0/3051888618 learned_addr learned my addr 172.21.15.155:0/3051888618 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:05.833 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.558+0000 7f09c908b700 1 -- 172.21.15.155:0/3051888618 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b40094f0 con 0x7f09c41011d0 2023-12-16T05:50:05.833 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.558+0000 7f09c908b700 1 --2- 172.21.15.155:0/3051888618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c41011d0 0x7f09c4113e30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f09b4000c00 tx=0x7f09b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:05.833 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.558+0000 7f09b9ffb700 1 -- 172.21.15.155:0/3051888618 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09b4010a80 con 0x7f09c41011d0 2023-12-16T05:50:05.833 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.558+0000 7f09b9ffb700 1 -- 172.21.15.155:0/3051888618 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f09b401a430 con 0x7f09c41011d0 2023-12-16T05:50:05.833 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.558+0000 7f09cb2ef700 1 -- 172.21.15.155:0/3051888618 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c40711b0 con 0x7f09c41011d0 2023-12-16T05:50:05.833 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.558+0000 7f09b9ffb700 1 -- 172.21.15.155:0/3051888618 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09b40245b0 con 0x7f09c41011d0 2023-12-16T05:50:05.833 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.558+0000 7f09cb2ef700 1 -- 172.21.15.155:0/3051888618 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c4114530 con 0x7f09c41011d0 2023-12-16T05:50:05.833 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.559+0000 7f09b9ffb700 1 -- 172.21.15.155:0/3051888618 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 6) v1 ==== 43048+0+0 (secure 0 0 0) 0x7f09b40247a0 con 0x7f09c41011d0 2023-12-16T05:50:05.833 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:04.559+0000 7f09b9ffb700 1 -- 172.21.15.155:0/3051888618 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f09b404a8f0 con 0x7f09c41011d0 2023-12-16T05:50:05.834 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:05.447+0000 7f09b9ffb700 1 -- 172.21.15.155:0/3051888618 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7f09b4049d00 con 0x7f09c41011d0 2023-12-16T05:50:05.834 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:05.447+0000 7f09b9ffb700 1 --2- 172.21.15.155:0/3051888618 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f09b0037180 0x7f09b0039560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:05.834 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:05.447+0000 7f09b9ffb700 1 -- 172.21.15.155:0/3051888618 --> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09b0039aa0 con 0x7f09b0037180 2023-12-16T05:50:05.834 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:05.447+0000 7f09c888a700 1 --2- 172.21.15.155:0/3051888618 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f09b0037180 0x7f09b0039560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:05.834 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:05.448+0000 7f09c888a700 1 --2- 172.21.15.155:0/3051888618 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f09b0037180 0x7f09b0039560 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f09c0009990 tx=0x7f09c0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:05.834 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:05.448+0000 7f09b9ffb700 1 -- 172.21.15.155:0/3051888618 <== mgr.14120 v2:172.21.15.155:6800/1287353594 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f09b0039aa0 con 0x7f09b0037180 2023-12-16T05:50:05.834 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:05.454+0000 7f09cb2ef700 1 -- 172.21.15.155:0/3051888618 --> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f09c404bb80 con 0x7f09b0037180 2023-12-16T05:50:05.834 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:05.454+0000 7f09b9ffb700 1 -- 172.21.15.155:0/3051888618 <== mgr.14120 v2:172.21.15.155:6800/1287353594 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f09c404bb80 con 0x7f09b0037180 2023-12-16T05:50:05.834 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:05.455+0000 7f09cb2ef700 1 -- 172.21.15.155:0/3051888618 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f09b0037180 msgr2=0x7f09b0039560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:05.834 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:05.455+0000 7f09cb2ef700 1 --2- 172.21.15.155:0/3051888618 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f09b0037180 0x7f09b0039560 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f09c0009990 tx=0x7f09c0006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:05.835 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:05.455+0000 7f09cb2ef700 1 -- 172.21.15.155:0/3051888618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c41011d0 msgr2=0x7f09c4113e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:05.835 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:05.455+0000 7f09cb2ef700 1 --2- 172.21.15.155:0/3051888618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c41011d0 0x7f09c4113e30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f09b4000c00 tx=0x7f09b4009250 comp rx=0 tx=0).stop 2023-12-16T05:50:05.835 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:05.455+0000 7f09cb2ef700 1 -- 172.21.15.155:0/3051888618 shutdown_connections 2023-12-16T05:50:05.835 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:05.455+0000 7f09cb2ef700 1 --2- 172.21.15.155:0/3051888618 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f09b0037180 0x7f09b0039560 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:05.835 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:05.455+0000 7f09cb2ef700 1 --2- 172.21.15.155:0/3051888618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c41011d0 0x7f09c4113e30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:05.835 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:05.455+0000 7f09cb2ef700 1 -- 172.21.15.155:0/3051888618 >> 172.21.15.155:0/3051888618 conn(0x7f09c40fc970 msgr2=0x7f09c40fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:05.835 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:05.455+0000 7f09cb2ef700 1 -- 172.21.15.155:0/3051888618 shutdown_connections 2023-12-16T05:50:05.835 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:05.455+0000 7f09cb2ef700 1 -- 172.21.15.155:0/3051888618 wait complete. 2023-12-16T05:50:05.835 INFO:teuthology.orchestra.run.smithi155.stdout:mgr epoch 5 is available 2023-12-16T05:50:05.835 INFO:teuthology.orchestra.run.smithi155.stdout:Setting orchestrator backend to cephadm... 2023-12-16T05:50:06.725 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.160+0000 7fe7557d0700 1 Processor -- start 2023-12-16T05:50:06.730 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.160+0000 7fe7557d0700 1 -- start start 2023-12-16T05:50:06.730 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.160+0000 7fe7557d0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe750103990 0x7fe750103da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:06.730 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.160+0000 7fe7557d0700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7501042e0 con 0x7fe750103990 2023-12-16T05:50:06.730 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.160+0000 7fe74effd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe750103990 0x7fe750103da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:06.730 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.160+0000 7fe74effd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe750103990 0x7fe750103da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37146/0 (socket says 172.21.15.155:37146) 2023-12-16T05:50:06.730 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.160+0000 7fe74effd700 1 -- 172.21.15.155:0/3779056356 learned_addr learned my addr 172.21.15.155:0/3779056356 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:06.731 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.161+0000 7fe74effd700 1 -- 172.21.15.155:0/3779056356 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe750104420 con 0x7fe750103990 2023-12-16T05:50:06.731 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.161+0000 7fe74effd700 1 --2- 172.21.15.155:0/3779056356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe750103990 0x7fe750103da0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe7440098e0 tx=0x7fe744009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff6c57f2468dbfd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:06.731 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.161+0000 7fe74dffb700 1 -- 172.21.15.155:0/3779056356 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe74400b860 con 0x7fe750103990 2023-12-16T05:50:06.731 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.161+0000 7fe74dffb700 1 -- 172.21.15.155:0/3779056356 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe74400be30 con 0x7fe750103990 2023-12-16T05:50:06.731 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.161+0000 7fe74dffb700 1 -- 172.21.15.155:0/3779056356 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe744010380 con 0x7fe750103990 2023-12-16T05:50:06.731 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.161+0000 7fe7557d0700 1 -- 172.21.15.155:0/3779056356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe750103990 msgr2=0x7fe750103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:06.731 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.161+0000 7fe7557d0700 1 --2- 172.21.15.155:0/3779056356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe750103990 0x7fe750103da0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe7440098e0 tx=0x7fe744009250 comp rx=0 tx=0).stop 2023-12-16T05:50:06.731 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.161+0000 7fe7557d0700 1 -- 172.21.15.155:0/3779056356 shutdown_connections 2023-12-16T05:50:06.731 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.161+0000 7fe7557d0700 1 --2- 172.21.15.155:0/3779056356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe750103990 0x7fe750103da0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:06.731 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.161+0000 7fe7557d0700 1 -- 172.21.15.155:0/3779056356 >> 172.21.15.155:0/3779056356 conn(0x7fe7500fc0b0 msgr2=0x7fe7500fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:06.731 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.161+0000 7fe7557d0700 1 -- 172.21.15.155:0/3779056356 shutdown_connections 2023-12-16T05:50:06.731 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.161+0000 7fe7557d0700 1 -- 172.21.15.155:0/3779056356 wait complete. 2023-12-16T05:50:06.731 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.162+0000 7fe7557d0700 1 Processor -- start 2023-12-16T05:50:06.731 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.162+0000 7fe7557d0700 1 -- start start 2023-12-16T05:50:06.731 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.162+0000 7fe7557d0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe750103990 0x7fe750111110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:06.732 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.162+0000 7fe7557d0700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe750111650 con 0x7fe750103990 2023-12-16T05:50:06.732 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.162+0000 7fe74effd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe750103990 0x7fe750111110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:06.732 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.162+0000 7fe74effd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe750103990 0x7fe750111110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37160/0 (socket says 172.21.15.155:37160) 2023-12-16T05:50:06.732 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.162+0000 7fe74effd700 1 -- 172.21.15.155:0/2322822311 learned_addr learned my addr 172.21.15.155:0/2322822311 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:06.732 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.163+0000 7fe74effd700 1 -- 172.21.15.155:0/2322822311 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7440094f0 con 0x7fe750103990 2023-12-16T05:50:06.732 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.163+0000 7fe74effd700 1 --2- 172.21.15.155:0/2322822311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe750103990 0x7fe750111110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe744006b00 tx=0x7fe744009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:06.732 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.163+0000 7fe7377fe700 1 -- 172.21.15.155:0/2322822311 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7440109b0 con 0x7fe750103990 2023-12-16T05:50:06.732 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.163+0000 7fe7377fe700 1 -- 172.21.15.155:0/2322822311 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe744024440 con 0x7fe750103990 2023-12-16T05:50:06.732 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.163+0000 7fe7377fe700 1 -- 172.21.15.155:0/2322822311 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe74401a5f0 con 0x7fe750103990 2023-12-16T05:50:06.732 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.163+0000 7fe7557d0700 1 -- 172.21.15.155:0/2322822311 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe750111850 con 0x7fe750103990 2023-12-16T05:50:06.732 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.163+0000 7fe7557d0700 1 -- 172.21.15.155:0/2322822311 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe750111c60 con 0x7fe750103990 2023-12-16T05:50:06.732 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.164+0000 7fe7557d0700 1 -- 172.21.15.155:0/2322822311 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75004bb80 con 0x7fe750103990 2023-12-16T05:50:06.732 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.164+0000 7fe7377fe700 1 -- 172.21.15.155:0/2322822311 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7fe744024990 con 0x7fe750103990 2023-12-16T05:50:06.732 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.164+0000 7fe7377fe700 1 --2- 172.21.15.155:0/2322822311 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fe7380364c0 0x7fe738038970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:06.733 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.165+0000 7fe7377fe700 1 -- 172.21.15.155:0/2322822311 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe74404a4d0 con 0x7fe750103990 2023-12-16T05:50:06.733 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.165+0000 7fe74e7fc700 1 --2- 172.21.15.155:0/2322822311 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fe7380364c0 0x7fe738038970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:06.733 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.165+0000 7fe74e7fc700 1 --2- 172.21.15.155:0/2322822311 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fe7380364c0 0x7fe738038970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe740009990 tx=0x7fe740006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:06.733 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.169+0000 7fe7377fe700 1 -- 172.21.15.155:0/2322822311 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe744006d70 con 0x7fe750103990 2023-12-16T05:50:06.733 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.367+0000 7fe7557d0700 1 -- 172.21.15.155:0/2322822311 --> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fe75010afe0 con 0x7fe7380364c0 2023-12-16T05:50:06.733 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.372+0000 7fe7377fe700 1 -- 172.21.15.155:0/2322822311 <== mgr.14120 v2:172.21.15.155:6800/1287353594 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe75010afe0 con 0x7fe7380364c0 2023-12-16T05:50:06.733 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.375+0000 7fe7557d0700 1 -- 172.21.15.155:0/2322822311 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fe7380364c0 msgr2=0x7fe738038970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:06.733 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.375+0000 7fe7557d0700 1 --2- 172.21.15.155:0/2322822311 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fe7380364c0 0x7fe738038970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe740009990 tx=0x7fe740006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:06.733 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.375+0000 7fe7557d0700 1 -- 172.21.15.155:0/2322822311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe750103990 msgr2=0x7fe750111110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:06.733 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.375+0000 7fe7557d0700 1 --2- 172.21.15.155:0/2322822311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe750103990 0x7fe750111110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe744006b00 tx=0x7fe744009250 comp rx=0 tx=0).stop 2023-12-16T05:50:06.733 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.375+0000 7fe7557d0700 1 -- 172.21.15.155:0/2322822311 shutdown_connections 2023-12-16T05:50:06.733 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.375+0000 7fe7557d0700 1 --2- 172.21.15.155:0/2322822311 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fe7380364c0 0x7fe738038970 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:06.733 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.375+0000 7fe7557d0700 1 --2- 172.21.15.155:0/2322822311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe750103990 0x7fe750111110 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:06.733 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.375+0000 7fe7557d0700 1 -- 172.21.15.155:0/2322822311 >> 172.21.15.155:0/2322822311 conn(0x7fe7500fc0b0 msgr2=0x7fe7500fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:06.733 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.375+0000 7fe7557d0700 1 -- 172.21.15.155:0/2322822311 shutdown_connections 2023-12-16T05:50:06.734 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:06.375+0000 7fe7557d0700 1 -- 172.21.15.155:0/2322822311 wait complete. 2023-12-16T05:50:06.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:06 smithi155 ceph-mon[112451]: [16/Dec/2023:05:50:05] ENGINE Bus STARTING 2023-12-16T05:50:06.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:06 smithi155 ceph-mon[112451]: [16/Dec/2023:05:50:05] ENGINE Serving on https://172.21.15.155:7150 2023-12-16T05:50:06.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:06 smithi155 ceph-mon[112451]: [16/Dec/2023:05:50:05] ENGINE Bus STARTED 2023-12-16T05:50:06.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:06 smithi155 ceph-mon[112451]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-16T05:50:06.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:06 smithi155 ceph-mon[112451]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-16T05:50:06.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:06 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:06.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:06 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:50:07.654 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout value unchanged 2023-12-16T05:50:07.654 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.103+0000 7f72b72f4700 1 Processor -- start 2023-12-16T05:50:07.654 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.104+0000 7f72b72f4700 1 -- start start 2023-12-16T05:50:07.654 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.104+0000 7f72b72f4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b01011d0 0x7f72b01015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:07.654 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.104+0000 7f72b72f4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b0101b20 con 0x7f72b01011d0 2023-12-16T05:50:07.654 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.104+0000 7f72b5090700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b01011d0 0x7f72b01015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:07.654 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.104+0000 7f72b5090700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b01011d0 0x7f72b01015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54492/0 (socket says 172.21.15.155:54492) 2023-12-16T05:50:07.655 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.104+0000 7f72b5090700 1 -- 172.21.15.155:0/3624094358 learned_addr learned my addr 172.21.15.155:0/3624094358 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:07.655 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.104+0000 7f72b5090700 1 -- 172.21.15.155:0/3624094358 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b0101c60 con 0x7f72b01011d0 2023-12-16T05:50:07.655 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.104+0000 7f72b5090700 1 --2- 172.21.15.155:0/3624094358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b01011d0 0x7f72b01015e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f72a40098e0 tx=0x7f72a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169238fd596e8a95 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:07.655 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.104+0000 7f72a3fff700 1 -- 172.21.15.155:0/3624094358 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72a400b860 con 0x7f72b01011d0 2023-12-16T05:50:07.655 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.104+0000 7f72a3fff700 1 -- 172.21.15.155:0/3624094358 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f72a400be30 con 0x7f72b01011d0 2023-12-16T05:50:07.655 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.104+0000 7f72a3fff700 1 -- 172.21.15.155:0/3624094358 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72a4010380 con 0x7f72b01011d0 2023-12-16T05:50:07.655 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.105+0000 7f72b72f4700 1 -- 172.21.15.155:0/3624094358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b01011d0 msgr2=0x7f72b01015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:07.655 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.105+0000 7f72b72f4700 1 --2- 172.21.15.155:0/3624094358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b01011d0 0x7f72b01015e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f72a40098e0 tx=0x7f72a4009250 comp rx=0 tx=0).stop 2023-12-16T05:50:07.655 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.105+0000 7f72b72f4700 1 -- 172.21.15.155:0/3624094358 shutdown_connections 2023-12-16T05:50:07.655 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.105+0000 7f72b72f4700 1 --2- 172.21.15.155:0/3624094358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b01011d0 0x7f72b01015e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:07.655 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.105+0000 7f72b72f4700 1 -- 172.21.15.155:0/3624094358 >> 172.21.15.155:0/3624094358 conn(0x7f72b00fc970 msgr2=0x7f72b00fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:07.655 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.105+0000 7f72b72f4700 1 -- 172.21.15.155:0/3624094358 shutdown_connections 2023-12-16T05:50:07.655 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.105+0000 7f72b72f4700 1 -- 172.21.15.155:0/3624094358 wait complete. 2023-12-16T05:50:07.655 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.106+0000 7f72b72f4700 1 Processor -- start 2023-12-16T05:50:07.656 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.106+0000 7f72b72f4700 1 -- start start 2023-12-16T05:50:07.656 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.106+0000 7f72b72f4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b01011d0 0x7f72b0111150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:07.656 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.106+0000 7f72b72f4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b0111690 con 0x7f72b01011d0 2023-12-16T05:50:07.656 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.106+0000 7f72b5090700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b01011d0 0x7f72b0111150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:07.656 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.106+0000 7f72b5090700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b01011d0 0x7f72b0111150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54496/0 (socket says 172.21.15.155:54496) 2023-12-16T05:50:07.656 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.106+0000 7f72b5090700 1 -- 172.21.15.155:0/2189082145 learned_addr learned my addr 172.21.15.155:0/2189082145 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:07.656 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.106+0000 7f72b5090700 1 -- 172.21.15.155:0/2189082145 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a40094f0 con 0x7f72b01011d0 2023-12-16T05:50:07.656 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.106+0000 7f72b5090700 1 --2- 172.21.15.155:0/2189082145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b01011d0 0x7f72b0111150 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f72a4000c00 tx=0x7f72a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:07.656 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.106+0000 7f72a1ffb700 1 -- 172.21.15.155:0/2189082145 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72a4010a80 con 0x7f72b01011d0 2023-12-16T05:50:07.656 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.106+0000 7f72a1ffb700 1 -- 172.21.15.155:0/2189082145 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f72a401a430 con 0x7f72b01011d0 2023-12-16T05:50:07.656 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.106+0000 7f72b72f4700 1 -- 172.21.15.155:0/2189082145 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b0111890 con 0x7f72b01011d0 2023-12-16T05:50:07.656 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.106+0000 7f72a1ffb700 1 -- 172.21.15.155:0/2189082145 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72a40245b0 con 0x7f72b01011d0 2023-12-16T05:50:07.656 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.107+0000 7f72b72f4700 1 -- 172.21.15.155:0/2189082145 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b0111ca0 con 0x7f72b01011d0 2023-12-16T05:50:07.656 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.107+0000 7f72a1ffb700 1 -- 172.21.15.155:0/2189082145 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7f72a40247f0 con 0x7f72b01011d0 2023-12-16T05:50:07.656 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.108+0000 7f72a1ffb700 1 --2- 172.21.15.155:0/2189082145 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f729c0364c0 0x7f729c038970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:07.657 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.108+0000 7f72a1ffb700 1 -- 172.21.15.155:0/2189082145 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f72a404aa40 con 0x7f72b01011d0 2023-12-16T05:50:07.657 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.108+0000 7f72b72f4700 1 -- 172.21.15.155:0/2189082145 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b004bb80 con 0x7f72b01011d0 2023-12-16T05:50:07.657 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.108+0000 7f72b488f700 1 --2- 172.21.15.155:0/2189082145 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f729c0364c0 0x7f729c038970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:07.657 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.108+0000 7f72b488f700 1 --2- 172.21.15.155:0/2189082145 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f729c0364c0 0x7f729c038970 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f72ac009990 tx=0x7f72ac006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:07.657 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.112+0000 7f72a1ffb700 1 -- 172.21.15.155:0/2189082145 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f72a4018350 con 0x7f72b01011d0 2023-12-16T05:50:07.657 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.297+0000 7f72b72f4700 1 -- 172.21.15.155:0/2189082145 --> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f72b00febe0 con 0x7f729c0364c0 2023-12-16T05:50:07.657 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.297+0000 7f72a1ffb700 1 -- 172.21.15.155:0/2189082145 <== mgr.14120 v2:172.21.15.155:6800/1287353594 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f72b00febe0 con 0x7f729c0364c0 2023-12-16T05:50:07.657 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.299+0000 7f72b72f4700 1 -- 172.21.15.155:0/2189082145 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f729c0364c0 msgr2=0x7f729c038970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:07.657 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.299+0000 7f72b72f4700 1 --2- 172.21.15.155:0/2189082145 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f729c0364c0 0x7f729c038970 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f72ac009990 tx=0x7f72ac006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:07.657 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.299+0000 7f72b72f4700 1 -- 172.21.15.155:0/2189082145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b01011d0 msgr2=0x7f72b0111150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:07.657 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.299+0000 7f72b72f4700 1 --2- 172.21.15.155:0/2189082145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b01011d0 0x7f72b0111150 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f72a4000c00 tx=0x7f72a4009250 comp rx=0 tx=0).stop 2023-12-16T05:50:07.657 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.299+0000 7f72b72f4700 1 -- 172.21.15.155:0/2189082145 shutdown_connections 2023-12-16T05:50:07.657 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.299+0000 7f72b72f4700 1 --2- 172.21.15.155:0/2189082145 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f729c0364c0 0x7f729c038970 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:07.657 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.299+0000 7f72b72f4700 1 --2- 172.21.15.155:0/2189082145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b01011d0 0x7f72b0111150 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:07.658 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.299+0000 7f72b72f4700 1 -- 172.21.15.155:0/2189082145 >> 172.21.15.155:0/2189082145 conn(0x7f72b00fc970 msgr2=0x7f72b0070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:07.658 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.300+0000 7f72b72f4700 1 -- 172.21.15.155:0/2189082145 shutdown_connections 2023-12-16T05:50:07.658 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.300+0000 7f72b72f4700 1 -- 172.21.15.155:0/2189082145 wait complete. 2023-12-16T05:50:07.658 INFO:teuthology.orchestra.run.smithi155.stdout:Generating ssh key... 2023-12-16T05:50:07.746 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:07 smithi155 ceph-mon[112451]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:50:07.746 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:07 smithi155 ceph-mon[112451]: mgrmap e8: smithi155.maowdn(active, since 2s) 2023-12-16T05:50:08.627 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:08 smithi155 ceph-mon[112451]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:50:08.627 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:08 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:08.627 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:08 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:08.713 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.970+0000 7f32ea582700 1 Processor -- start 2023-12-16T05:50:08.714 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.970+0000 7f32ea582700 1 -- start start 2023-12-16T05:50:08.714 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.970+0000 7f32ea582700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32e4078dc0 0x7f32e40771d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:08.714 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.970+0000 7f32ea582700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e4077710 con 0x7f32e4078dc0 2023-12-16T05:50:08.714 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.970+0000 7f32e3fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32e4078dc0 0x7f32e40771d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:08.714 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.970+0000 7f32e3fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32e4078dc0 0x7f32e40771d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54504/0 (socket says 172.21.15.155:54504) 2023-12-16T05:50:08.714 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.970+0000 7f32e3fff700 1 -- 172.21.15.155:0/3347730253 learned_addr learned my addr 172.21.15.155:0/3347730253 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:08.714 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.971+0000 7f32e3fff700 1 -- 172.21.15.155:0/3347730253 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e4077850 con 0x7f32e4078dc0 2023-12-16T05:50:08.714 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.971+0000 7f32e3fff700 1 --2- 172.21.15.155:0/3347730253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32e4078dc0 0x7f32e40771d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f32d40098e0 tx=0x7f32d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82cd2d9dcda919bd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:08.714 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.971+0000 7f32e2ffd700 1 -- 172.21.15.155:0/3347730253 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32d400b860 con 0x7f32e4078dc0 2023-12-16T05:50:08.714 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.971+0000 7f32e2ffd700 1 -- 172.21.15.155:0/3347730253 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f32d400be30 con 0x7f32e4078dc0 2023-12-16T05:50:08.714 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.971+0000 7f32e2ffd700 1 -- 172.21.15.155:0/3347730253 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32d4010380 con 0x7f32e4078dc0 2023-12-16T05:50:08.714 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.971+0000 7f32ea582700 1 -- 172.21.15.155:0/3347730253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32e4078dc0 msgr2=0x7f32e40771d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:08.714 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.971+0000 7f32ea582700 1 --2- 172.21.15.155:0/3347730253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32e4078dc0 0x7f32e40771d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f32d40098e0 tx=0x7f32d4009250 comp rx=0 tx=0).stop 2023-12-16T05:50:08.714 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.971+0000 7f32ea582700 1 -- 172.21.15.155:0/3347730253 shutdown_connections 2023-12-16T05:50:08.714 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.971+0000 7f32ea582700 1 --2- 172.21.15.155:0/3347730253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32e4078dc0 0x7f32e40771d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:08.715 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.971+0000 7f32ea582700 1 -- 172.21.15.155:0/3347730253 >> 172.21.15.155:0/3347730253 conn(0x7f32e40fda40 msgr2=0x7f32e40ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:08.715 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.971+0000 7f32ea582700 1 -- 172.21.15.155:0/3347730253 shutdown_connections 2023-12-16T05:50:08.715 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.971+0000 7f32ea582700 1 -- 172.21.15.155:0/3347730253 wait complete. 2023-12-16T05:50:08.715 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.972+0000 7f32ea582700 1 Processor -- start 2023-12-16T05:50:08.715 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.972+0000 7f32ea582700 1 -- start start 2023-12-16T05:50:08.715 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.972+0000 7f32ea582700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32e4078dc0 0x7f32e4113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:08.715 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.972+0000 7f32ea582700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e4113870 con 0x7f32e4078dc0 2023-12-16T05:50:08.715 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.972+0000 7f32e3fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32e4078dc0 0x7f32e4113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:08.715 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.972+0000 7f32e3fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32e4078dc0 0x7f32e4113330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54508/0 (socket says 172.21.15.155:54508) 2023-12-16T05:50:08.715 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.972+0000 7f32e3fff700 1 -- 172.21.15.155:0/2500272172 learned_addr learned my addr 172.21.15.155:0/2500272172 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:08.715 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.973+0000 7f32e3fff700 1 -- 172.21.15.155:0/2500272172 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d40094f0 con 0x7f32e4078dc0 2023-12-16T05:50:08.715 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.973+0000 7f32e3fff700 1 --2- 172.21.15.155:0/2500272172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32e4078dc0 0x7f32e4113330 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f32d40090b0 tx=0x7f32d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:08.715 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.973+0000 7f32e0ff9700 1 -- 172.21.15.155:0/2500272172 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32d40109b0 con 0x7f32e4078dc0 2023-12-16T05:50:08.715 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.973+0000 7f32e0ff9700 1 -- 172.21.15.155:0/2500272172 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f32d401a430 con 0x7f32e4078dc0 2023-12-16T05:50:08.716 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.973+0000 7f32ea582700 1 -- 172.21.15.155:0/2500272172 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e4113a70 con 0x7f32e4078dc0 2023-12-16T05:50:08.716 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.973+0000 7f32e0ff9700 1 -- 172.21.15.155:0/2500272172 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32d40245b0 con 0x7f32e4078dc0 2023-12-16T05:50:08.716 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.973+0000 7f32ea582700 1 -- 172.21.15.155:0/2500272172 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e4113e80 con 0x7f32e4078dc0 2023-12-16T05:50:08.716 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.974+0000 7f32e0ff9700 1 -- 172.21.15.155:0/2500272172 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f32d4024870 con 0x7f32e4078dc0 2023-12-16T05:50:08.716 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.974+0000 7f32ea582700 1 -- 172.21.15.155:0/2500272172 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e4108620 con 0x7f32e4078dc0 2023-12-16T05:50:08.716 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.974+0000 7f32e0ff9700 1 --2- 172.21.15.155:0/2500272172 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f32cc0365a0 0x7f32cc038a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:08.716 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.974+0000 7f32e0ff9700 1 -- 172.21.15.155:0/2500272172 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f32d404a910 con 0x7f32e4078dc0 2023-12-16T05:50:08.716 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.974+0000 7f32e37fe700 1 --2- 172.21.15.155:0/2500272172 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f32cc0365a0 0x7f32cc038a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:08.716 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.975+0000 7f32e37fe700 1 --2- 172.21.15.155:0/2500272172 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f32cc0365a0 0x7f32cc038a50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f32d8009990 tx=0x7f32d8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:08.716 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:07.979+0000 7f32e0ff9700 1 -- 172.21.15.155:0/2500272172 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f32d402c340 con 0x7f32e4078dc0 2023-12-16T05:50:08.716 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:08.164+0000 7f32ea582700 1 -- 172.21.15.155:0/2500272172 --> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f32e410d260 con 0x7f32cc0365a0 2023-12-16T05:50:08.716 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:08.359+0000 7f32e0ff9700 1 -- 172.21.15.155:0/2500272172 <== mgr.14120 v2:172.21.15.155:6800/1287353594 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f32e410d260 con 0x7f32cc0365a0 2023-12-16T05:50:08.716 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:08.361+0000 7f32ea582700 1 -- 172.21.15.155:0/2500272172 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f32cc0365a0 msgr2=0x7f32cc038a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:08.716 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:08.361+0000 7f32ea582700 1 --2- 172.21.15.155:0/2500272172 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f32cc0365a0 0x7f32cc038a50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f32d8009990 tx=0x7f32d8006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:08.717 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:08.361+0000 7f32ea582700 1 -- 172.21.15.155:0/2500272172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32e4078dc0 msgr2=0x7f32e4113330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:08.717 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:08.361+0000 7f32ea582700 1 --2- 172.21.15.155:0/2500272172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32e4078dc0 0x7f32e4113330 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f32d40090b0 tx=0x7f32d4009250 comp rx=0 tx=0).stop 2023-12-16T05:50:08.717 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:08.361+0000 7f32ea582700 1 -- 172.21.15.155:0/2500272172 shutdown_connections 2023-12-16T05:50:08.717 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:08.361+0000 7f32ea582700 1 --2- 172.21.15.155:0/2500272172 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f32cc0365a0 0x7f32cc038a50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:08.717 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:08.361+0000 7f32ea582700 1 --2- 172.21.15.155:0/2500272172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32e4078dc0 0x7f32e4113330 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:08.717 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:08.361+0000 7f32ea582700 1 -- 172.21.15.155:0/2500272172 >> 172.21.15.155:0/2500272172 conn(0x7f32e40fda40 msgr2=0x7f32e40ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:08.717 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:08.361+0000 7f32ea582700 1 -- 172.21.15.155:0/2500272172 shutdown_connections 2023-12-16T05:50:08.717 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:08.361+0000 7f32ea582700 1 -- 172.21.15.155:0/2500272172 wait complete. 2023-12-16T05:50:09.643 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:09 smithi155 ceph-mon[112451]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:50:09.643 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:09 smithi155 ceph-mon[112451]: Generating ssh key... 2023-12-16T05:50:09.671 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcH2J/kv8sU2FVaZgiDx6Fu5zPKSXDdxA+sjzppale/9ONXDSn3YROr7+GykSIDgQtV/kxQk39kpZMUq5+SVx3aovR63PHct5AwoDgfI1PFB5UXa3epLlhckJuW0KPHUh8VD74YIjxgS3cF7vv1vZb+yNf7/d1XdSvzd5WHQYoNWcfqeZJ7Wvu4B/jN9qddAmADQcqhBS8ndz/QE3kSsTjC7W3i7iwuRXAUxbjglS6woMmjneTeT5LaoGtvbShj41cc4Olip603nR8PQuRdVI29w+hu5ibs9Wh2OyGGkwiUWpFEg1XSr/6AG2nFifUPfCQzkZJ2glv6d+mE/ycZTeQurz2hQ+QxHwczJxY35pKsA0RfgLPID+4xqY+qFexZ9S4qHR5wt/vJ51AD9giIP0mzlAeXBz/cExkTT2Gqub97+0xbBEiv0wggFNK9vXZAut13xBDs0wvqFJeqGfUqHu2pR4NLZaWH+KYIkH5ASgvez6vtqmpmKlcbFrUbop8KzM= ceph-d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:50:09.671 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.127+0000 7f597e5e6700 1 Processor -- start 2023-12-16T05:50:09.671 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.127+0000 7f597e5e6700 1 -- start start 2023-12-16T05:50:09.671 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.127+0000 7f597e5e6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59781011c0 0x7f59781015d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:09.671 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.127+0000 7f597e5e6700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5978101b10 con 0x7f59781011c0 2023-12-16T05:50:09.671 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.127+0000 7f5977fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59781011c0 0x7f59781015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:09.672 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.127+0000 7f5977fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59781011c0 0x7f59781015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54520/0 (socket says 172.21.15.155:54520) 2023-12-16T05:50:09.672 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.127+0000 7f5977fff700 1 -- 172.21.15.155:0/4101642662 learned_addr learned my addr 172.21.15.155:0/4101642662 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:09.672 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.127+0000 7f5977fff700 1 -- 172.21.15.155:0/4101642662 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5978101c50 con 0x7f59781011c0 2023-12-16T05:50:09.672 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.127+0000 7f5977fff700 1 --2- 172.21.15.155:0/4101642662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59781011c0 0x7f59781015d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f59680098e0 tx=0x7f5968009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86ce71929bff64d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:09.672 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.128+0000 7f5976ffd700 1 -- 172.21.15.155:0/4101642662 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f596800b860 con 0x7f59781011c0 2023-12-16T05:50:09.672 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.128+0000 7f5976ffd700 1 -- 172.21.15.155:0/4101642662 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f596800be30 con 0x7f59781011c0 2023-12-16T05:50:09.672 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.128+0000 7f5976ffd700 1 -- 172.21.15.155:0/4101642662 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5968010380 con 0x7f59781011c0 2023-12-16T05:50:09.672 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.128+0000 7f597e5e6700 1 -- 172.21.15.155:0/4101642662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59781011c0 msgr2=0x7f59781015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:09.672 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.128+0000 7f597e5e6700 1 --2- 172.21.15.155:0/4101642662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59781011c0 0x7f59781015d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f59680098e0 tx=0x7f5968009250 comp rx=0 tx=0).stop 2023-12-16T05:50:09.672 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.128+0000 7f597e5e6700 1 -- 172.21.15.155:0/4101642662 shutdown_connections 2023-12-16T05:50:09.672 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.128+0000 7f597e5e6700 1 --2- 172.21.15.155:0/4101642662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59781011c0 0x7f59781015d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:09.672 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.128+0000 7f597e5e6700 1 -- 172.21.15.155:0/4101642662 >> 172.21.15.155:0/4101642662 conn(0x7f59780fc980 msgr2=0x7f59780fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:09.672 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.128+0000 7f597e5e6700 1 -- 172.21.15.155:0/4101642662 shutdown_connections 2023-12-16T05:50:09.673 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.128+0000 7f597e5e6700 1 -- 172.21.15.155:0/4101642662 wait complete. 2023-12-16T05:50:09.673 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.129+0000 7f597e5e6700 1 Processor -- start 2023-12-16T05:50:09.673 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.129+0000 7f597e5e6700 1 -- start start 2023-12-16T05:50:09.673 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.129+0000 7f597e5e6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59781011c0 0x7f5978113e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:09.673 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.129+0000 7f597e5e6700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5978076c10 con 0x7f59781011c0 2023-12-16T05:50:09.673 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.130+0000 7f5977fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59781011c0 0x7f5978113e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:09.673 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.130+0000 7f5977fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59781011c0 0x7f5978113e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54536/0 (socket says 172.21.15.155:54536) 2023-12-16T05:50:09.673 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.130+0000 7f5977fff700 1 -- 172.21.15.155:0/224543454 learned_addr learned my addr 172.21.15.155:0/224543454 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:09.673 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.130+0000 7f5977fff700 1 -- 172.21.15.155:0/224543454 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59680094f0 con 0x7f59781011c0 2023-12-16T05:50:09.673 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.130+0000 7f5977fff700 1 --2- 172.21.15.155:0/224543454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59781011c0 0x7f5978113e40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5968006b00 tx=0x7f5968009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:09.673 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.130+0000 7f5974ff9700 1 -- 172.21.15.155:0/224543454 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59680109b0 con 0x7f59781011c0 2023-12-16T05:50:09.673 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.130+0000 7f5974ff9700 1 -- 172.21.15.155:0/224543454 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f5968024440 con 0x7f59781011c0 2023-12-16T05:50:09.673 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.130+0000 7f597e5e6700 1 -- 172.21.15.155:0/224543454 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5978076e10 con 0x7f59781011c0 2023-12-16T05:50:09.673 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.130+0000 7f5974ff9700 1 -- 172.21.15.155:0/224543454 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f596801a5f0 con 0x7f59781011c0 2023-12-16T05:50:09.673 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.130+0000 7f597e5e6700 1 -- 172.21.15.155:0/224543454 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5978114540 con 0x7f59781011c0 2023-12-16T05:50:09.674 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.131+0000 7f5974ff9700 1 -- 172.21.15.155:0/224543454 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f596801a860 con 0x7f59781011c0 2023-12-16T05:50:09.674 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.131+0000 7f5974ff9700 1 --2- 172.21.15.155:0/224543454 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f5960036640 0x7f5960038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:09.674 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.131+0000 7f597e5e6700 1 -- 172.21.15.155:0/224543454 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597810a040 con 0x7f59781011c0 2023-12-16T05:50:09.674 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.131+0000 7f5974ff9700 1 -- 172.21.15.155:0/224543454 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f596804a670 con 0x7f59781011c0 2023-12-16T05:50:09.674 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.131+0000 7f59777fe700 1 --2- 172.21.15.155:0/224543454 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f5960036640 0x7f5960038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:09.674 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.132+0000 7f59777fe700 1 --2- 172.21.15.155:0/224543454 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f5960036640 0x7f5960038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f596c009990 tx=0x7f596c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:09.674 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.136+0000 7f5974ff9700 1 -- 172.21.15.155:0/224543454 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5968022340 con 0x7f59781011c0 2023-12-16T05:50:09.674 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.320+0000 7f597e5e6700 1 -- 172.21.15.155:0/224543454 --> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f597802b290 con 0x7f5960036640 2023-12-16T05:50:09.674 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.320+0000 7f5974ff9700 1 -- 172.21.15.155:0/224543454 <== mgr.14120 v2:172.21.15.155:6800/1287353594 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f597802b290 con 0x7f5960036640 2023-12-16T05:50:09.674 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.322+0000 7f597e5e6700 1 -- 172.21.15.155:0/224543454 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f5960036640 msgr2=0x7f5960038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:09.674 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.322+0000 7f597e5e6700 1 --2- 172.21.15.155:0/224543454 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f5960036640 0x7f5960038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f596c009990 tx=0x7f596c006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:09.674 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.322+0000 7f597e5e6700 1 -- 172.21.15.155:0/224543454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59781011c0 msgr2=0x7f5978113e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:09.674 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.322+0000 7f597e5e6700 1 --2- 172.21.15.155:0/224543454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59781011c0 0x7f5978113e40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5968006b00 tx=0x7f5968009250 comp rx=0 tx=0).stop 2023-12-16T05:50:09.674 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.322+0000 7f597e5e6700 1 -- 172.21.15.155:0/224543454 shutdown_connections 2023-12-16T05:50:09.675 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.322+0000 7f597e5e6700 1 --2- 172.21.15.155:0/224543454 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f5960036640 0x7f5960038af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:09.675 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.322+0000 7f597e5e6700 1 --2- 172.21.15.155:0/224543454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59781011c0 0x7f5978113e40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:09.675 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.322+0000 7f597e5e6700 1 -- 172.21.15.155:0/224543454 >> 172.21.15.155:0/224543454 conn(0x7f59780fc980 msgr2=0x7f59780fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:09.675 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.322+0000 7f597e5e6700 1 -- 172.21.15.155:0/224543454 shutdown_connections 2023-12-16T05:50:09.675 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:09.322+0000 7f597e5e6700 1 -- 172.21.15.155:0/224543454 wait complete. 2023-12-16T05:50:09.675 INFO:teuthology.orchestra.run.smithi155.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-12-16T05:50:09.675 INFO:teuthology.orchestra.run.smithi155.stdout:Adding key to root@localhost authorized_keys... 2023-12-16T05:50:09.675 INFO:teuthology.orchestra.run.smithi155.stdout:Adding host smithi155... 2023-12-16T05:50:10.756 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:10 smithi155 ceph-mon[112451]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:50:11.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:11 smithi155 ceph-mon[112451]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi155", "addr": "172.21.15.155", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:50:11.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:11 smithi155 ceph-mon[112451]: Deploying cephadm binary to smithi155 2023-12-16T05:50:12.205 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout Added host 'smithi155' with addr '172.21.15.155' 2023-12-16T05:50:12.205 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.021+0000 7fb7189a1700 1 Processor -- start 2023-12-16T05:50:12.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.021+0000 7fb7189a1700 1 -- start start 2023-12-16T05:50:12.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.021+0000 7fb7189a1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb714070fc0 0x7fb714104d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:12.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.021+0000 7fb7189a1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb714105270 con 0x7fb714070fc0 2023-12-16T05:50:12.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.021+0000 7fb7137fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb714070fc0 0x7fb714104d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:12.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.021+0000 7fb7137fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb714070fc0 0x7fb714104d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54546/0 (socket says 172.21.15.155:54546) 2023-12-16T05:50:12.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.022+0000 7fb7137fe700 1 -- 172.21.15.155:0/2923808410 learned_addr learned my addr 172.21.15.155:0/2923808410 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:12.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.022+0000 7fb7137fe700 1 -- 172.21.15.155:0/2923808410 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7141053b0 con 0x7fb714070fc0 2023-12-16T05:50:12.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.022+0000 7fb7137fe700 1 --2- 172.21.15.155:0/2923808410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb714070fc0 0x7fb714104d30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb7080098e0 tx=0x7fb708009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6e856b463c062c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:12.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.022+0000 7fb7127fc700 1 -- 172.21.15.155:0/2923808410 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb70800b860 con 0x7fb714070fc0 2023-12-16T05:50:12.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.022+0000 7fb7127fc700 1 -- 172.21.15.155:0/2923808410 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fb70800be30 con 0x7fb714070fc0 2023-12-16T05:50:12.211 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.022+0000 7fb7127fc700 1 -- 172.21.15.155:0/2923808410 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb708010380 con 0x7fb714070fc0 2023-12-16T05:50:12.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.023+0000 7fb7189a1700 1 -- 172.21.15.155:0/2923808410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb714070fc0 msgr2=0x7fb714104d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:12.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.023+0000 7fb7189a1700 1 --2- 172.21.15.155:0/2923808410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb714070fc0 0x7fb714104d30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb7080098e0 tx=0x7fb708009250 comp rx=0 tx=0).stop 2023-12-16T05:50:12.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.023+0000 7fb7189a1700 1 -- 172.21.15.155:0/2923808410 shutdown_connections 2023-12-16T05:50:12.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.023+0000 7fb7189a1700 1 --2- 172.21.15.155:0/2923808410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb714070fc0 0x7fb714104d30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:12.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.023+0000 7fb7189a1700 1 -- 172.21.15.155:0/2923808410 >> 172.21.15.155:0/2923808410 conn(0x7fb7140fc760 msgr2=0x7fb7140febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:12.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.023+0000 7fb7189a1700 1 -- 172.21.15.155:0/2923808410 shutdown_connections 2023-12-16T05:50:12.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.023+0000 7fb7189a1700 1 -- 172.21.15.155:0/2923808410 wait complete. 2023-12-16T05:50:12.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.023+0000 7fb7189a1700 1 Processor -- start 2023-12-16T05:50:12.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.023+0000 7fb7189a1700 1 -- start start 2023-12-16T05:50:12.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.024+0000 7fb7189a1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb714070fc0 0x7fb7141027b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:12.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.024+0000 7fb7189a1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb714100c30 con 0x7fb714070fc0 2023-12-16T05:50:12.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.024+0000 7fb7137fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb714070fc0 0x7fb7141027b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:12.212 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.024+0000 7fb7137fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb714070fc0 0x7fb7141027b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54552/0 (socket says 172.21.15.155:54552) 2023-12-16T05:50:12.213 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.024+0000 7fb7137fe700 1 -- 172.21.15.155:0/302721930 learned_addr learned my addr 172.21.15.155:0/302721930 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:12.213 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.024+0000 7fb7137fe700 1 -- 172.21.15.155:0/302721930 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7080094f0 con 0x7fb714070fc0 2023-12-16T05:50:12.213 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.024+0000 7fb7137fe700 1 --2- 172.21.15.155:0/302721930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb714070fc0 0x7fb7141027b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb708006d40 tx=0x7fb708009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:12.213 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.024+0000 7fb6fbfff700 1 -- 172.21.15.155:0/302721930 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7080109b0 con 0x7fb714070fc0 2023-12-16T05:50:12.213 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.024+0000 7fb6fbfff700 1 -- 172.21.15.155:0/302721930 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fb708024440 con 0x7fb714070fc0 2023-12-16T05:50:12.213 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.024+0000 7fb7189a1700 1 -- 172.21.15.155:0/302721930 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb714100e30 con 0x7fb714070fc0 2023-12-16T05:50:12.213 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.024+0000 7fb6fbfff700 1 -- 172.21.15.155:0/302721930 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb70801a5f0 con 0x7fb714070fc0 2023-12-16T05:50:12.213 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.024+0000 7fb7189a1700 1 -- 172.21.15.155:0/302721930 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb714101240 con 0x7fb714070fc0 2023-12-16T05:50:12.213 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.025+0000 7fb6fbfff700 1 -- 172.21.15.155:0/302721930 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fb70801a870 con 0x7fb714070fc0 2023-12-16T05:50:12.213 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.025+0000 7fb6fbfff700 1 --2- 172.21.15.155:0/302721930 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fb6fc0365f0 0x7fb6fc038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:12.213 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.025+0000 7fb7189a1700 1 -- 172.21.15.155:0/302721930 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71404bb80 con 0x7fb714070fc0 2023-12-16T05:50:12.213 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.025+0000 7fb6fbfff700 1 -- 172.21.15.155:0/302721930 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb70804a5b0 con 0x7fb714070fc0 2023-12-16T05:50:12.214 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.025+0000 7fb712ffd700 1 --2- 172.21.15.155:0/302721930 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fb6fc0365f0 0x7fb6fc038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:12.214 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.026+0000 7fb712ffd700 1 --2- 172.21.15.155:0/302721930 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fb6fc0365f0 0x7fb6fc038aa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb704009990 tx=0x7fb704006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:12.214 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.030+0000 7fb6fbfff700 1 -- 172.21.15.155:0/302721930 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb708018af0 con 0x7fb714070fc0 2023-12-16T05:50:12.214 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:10.217+0000 7fb7189a1700 1 -- 172.21.15.155:0/302721930 --> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi155", "addr": "172.21.15.155", "target": ["mon-mgr", ""]}) v1 -- 0x7fb71410ac00 con 0x7fb6fc0365f0 2023-12-16T05:50:12.214 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:11.900+0000 7fb6fbfff700 1 -- 172.21.15.155:0/302721930 <== mgr.14120 v2:172.21.15.155:6800/1287353594 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fb71410ac00 con 0x7fb6fc0365f0 2023-12-16T05:50:12.214 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:11.903+0000 7fb7189a1700 1 -- 172.21.15.155:0/302721930 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fb6fc0365f0 msgr2=0x7fb6fc038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:12.214 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:11.903+0000 7fb7189a1700 1 --2- 172.21.15.155:0/302721930 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fb6fc0365f0 0x7fb6fc038aa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb704009990 tx=0x7fb704006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:12.214 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:11.903+0000 7fb7189a1700 1 -- 172.21.15.155:0/302721930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb714070fc0 msgr2=0x7fb7141027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:12.214 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:11.903+0000 7fb7189a1700 1 --2- 172.21.15.155:0/302721930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb714070fc0 0x7fb7141027b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb708006d40 tx=0x7fb708009250 comp rx=0 tx=0).stop 2023-12-16T05:50:12.214 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:11.903+0000 7fb7189a1700 1 -- 172.21.15.155:0/302721930 shutdown_connections 2023-12-16T05:50:12.214 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:11.903+0000 7fb7189a1700 1 --2- 172.21.15.155:0/302721930 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fb6fc0365f0 0x7fb6fc038aa0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:12.214 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:11.903+0000 7fb7189a1700 1 --2- 172.21.15.155:0/302721930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb714070fc0 0x7fb7141027b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:12.215 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:11.903+0000 7fb7189a1700 1 -- 172.21.15.155:0/302721930 >> 172.21.15.155:0/302721930 conn(0x7fb7140fc760 msgr2=0x7fb7140feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:12.215 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:11.903+0000 7fb7189a1700 1 -- 172.21.15.155:0/302721930 shutdown_connections 2023-12-16T05:50:12.215 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:11.903+0000 7fb7189a1700 1 -- 172.21.15.155:0/302721930 wait complete. 2023-12-16T05:50:12.215 INFO:teuthology.orchestra.run.smithi155.stdout:Deploying mon service with default placement... 2023-12-16T05:50:13.005 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:12 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:13.005 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:12 smithi155 ceph-mon[112451]: Added host smithi155 2023-12-16T05:50:13.005 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:12 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:50:13.005 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:12 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:13.204 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-12-16T05:50:13.204 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.567+0000 7fc2e2184700 1 Processor -- start 2023-12-16T05:50:13.204 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.567+0000 7fc2e2184700 1 -- start start 2023-12-16T05:50:13.204 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.567+0000 7fc2e2184700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc1022d0 0x7fc2dc1026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:13.204 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.567+0000 7fc2e2184700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc102c20 con 0x7fc2dc1022d0 2023-12-16T05:50:13.204 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.567+0000 7fc2db7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc1022d0 0x7fc2dc1026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:13.204 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.567+0000 7fc2db7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc1022d0 0x7fc2dc1026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54560/0 (socket says 172.21.15.155:54560) 2023-12-16T05:50:13.204 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.567+0000 7fc2db7fe700 1 -- 172.21.15.155:0/1357104719 learned_addr learned my addr 172.21.15.155:0/1357104719 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:13.204 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.567+0000 7fc2db7fe700 1 -- 172.21.15.155:0/1357104719 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc102d60 con 0x7fc2dc1022d0 2023-12-16T05:50:13.204 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.568+0000 7fc2db7fe700 1 --2- 172.21.15.155:0/1357104719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc1022d0 0x7fc2dc1026e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0098e0 tx=0x7fc2cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ceb1969ca3284d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:13.204 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.568+0000 7fc2da7fc700 1 -- 172.21.15.155:0/1357104719 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2cc00b860 con 0x7fc2dc1022d0 2023-12-16T05:50:13.204 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.568+0000 7fc2da7fc700 1 -- 172.21.15.155:0/1357104719 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fc2cc00be30 con 0x7fc2dc1022d0 2023-12-16T05:50:13.205 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.568+0000 7fc2da7fc700 1 -- 172.21.15.155:0/1357104719 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2cc010380 con 0x7fc2dc1022d0 2023-12-16T05:50:13.205 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.568+0000 7fc2e2184700 1 -- 172.21.15.155:0/1357104719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc1022d0 msgr2=0x7fc2dc1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:13.205 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.568+0000 7fc2e2184700 1 --2- 172.21.15.155:0/1357104719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc1022d0 0x7fc2dc1026e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0098e0 tx=0x7fc2cc009250 comp rx=0 tx=0).stop 2023-12-16T05:50:13.205 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.568+0000 7fc2e2184700 1 -- 172.21.15.155:0/1357104719 shutdown_connections 2023-12-16T05:50:13.205 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.568+0000 7fc2e2184700 1 --2- 172.21.15.155:0/1357104719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc1022d0 0x7fc2dc1026e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:13.205 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.568+0000 7fc2e2184700 1 -- 172.21.15.155:0/1357104719 >> 172.21.15.155:0/1357104719 conn(0x7fc2dc0fda50 msgr2=0x7fc2dc0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:13.205 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.568+0000 7fc2e2184700 1 -- 172.21.15.155:0/1357104719 shutdown_connections 2023-12-16T05:50:13.205 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.568+0000 7fc2e2184700 1 -- 172.21.15.155:0/1357104719 wait complete. 2023-12-16T05:50:13.205 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.569+0000 7fc2e2184700 1 Processor -- start 2023-12-16T05:50:13.205 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.569+0000 7fc2e2184700 1 -- start start 2023-12-16T05:50:13.205 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.569+0000 7fc2e2184700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc1022d0 0x7fc2dc077c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:13.205 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.569+0000 7fc2e2184700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc076080 con 0x7fc2dc1022d0 2023-12-16T05:50:13.205 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.569+0000 7fc2db7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc1022d0 0x7fc2dc077c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:13.205 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.569+0000 7fc2db7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc1022d0 0x7fc2dc077c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54566/0 (socket says 172.21.15.155:54566) 2023-12-16T05:50:13.206 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.569+0000 7fc2db7fe700 1 -- 172.21.15.155:0/2976316432 learned_addr learned my addr 172.21.15.155:0/2976316432 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:13.206 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.570+0000 7fc2db7fe700 1 -- 172.21.15.155:0/2976316432 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc0094f0 con 0x7fc2dc1022d0 2023-12-16T05:50:13.206 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.570+0000 7fc2db7fe700 1 --2- 172.21.15.155:0/2976316432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc1022d0 0x7fc2dc077c00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc000c00 tx=0x7fc2cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:13.206 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.570+0000 7fc2c3fff700 1 -- 172.21.15.155:0/2976316432 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2cc010a80 con 0x7fc2dc1022d0 2023-12-16T05:50:13.206 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.570+0000 7fc2c3fff700 1 -- 172.21.15.155:0/2976316432 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fc2cc01a430 con 0x7fc2dc1022d0 2023-12-16T05:50:13.206 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.570+0000 7fc2e2184700 1 -- 172.21.15.155:0/2976316432 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2dc076280 con 0x7fc2dc1022d0 2023-12-16T05:50:13.206 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.570+0000 7fc2c3fff700 1 -- 172.21.15.155:0/2976316432 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2cc0245b0 con 0x7fc2dc1022d0 2023-12-16T05:50:13.206 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.570+0000 7fc2e2184700 1 -- 172.21.15.155:0/2976316432 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2dc076690 con 0x7fc2dc1022d0 2023-12-16T05:50:13.206 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.571+0000 7fc2c3fff700 1 -- 172.21.15.155:0/2976316432 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fc2cc0247a0 con 0x7fc2dc1022d0 2023-12-16T05:50:13.206 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.571+0000 7fc2c3fff700 1 --2- 172.21.15.155:0/2976316432 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fc2c4036640 0x7fc2c4038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:13.206 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.571+0000 7fc2c3fff700 1 -- 172.21.15.155:0/2976316432 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc2cc04baa0 con 0x7fc2dc1022d0 2023-12-16T05:50:13.206 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.571+0000 7fc2daffd700 1 --2- 172.21.15.155:0/2976316432 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fc2c4036640 0x7fc2c4038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:13.206 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.571+0000 7fc2e2184700 1 -- 172.21.15.155:0/2976316432 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2dc05f270 con 0x7fc2dc1022d0 2023-12-16T05:50:13.206 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.572+0000 7fc2daffd700 1 --2- 172.21.15.155:0/2976316432 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fc2c4036640 0x7fc2c4038af0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009990 tx=0x7fc2d0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:13.207 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.576+0000 7fc2c3fff700 1 -- 172.21.15.155:0/2976316432 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc2cc018350 con 0x7fc2dc1022d0 2023-12-16T05:50:13.207 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.796+0000 7fc2e2184700 1 -- 172.21.15.155:0/2976316432 --> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2dc10ac80 con 0x7fc2c4036640 2023-12-16T05:50:13.207 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.801+0000 7fc2c3fff700 1 -- 172.21.15.155:0/2976316432 <== mgr.14120 v2:172.21.15.155:6800/1287353594 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc2dc10ac80 con 0x7fc2c4036640 2023-12-16T05:50:13.207 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.803+0000 7fc2e2184700 1 -- 172.21.15.155:0/2976316432 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fc2c4036640 msgr2=0x7fc2c4038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:13.207 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.803+0000 7fc2e2184700 1 --2- 172.21.15.155:0/2976316432 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fc2c4036640 0x7fc2c4038af0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009990 tx=0x7fc2d0006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:13.207 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.803+0000 7fc2e2184700 1 -- 172.21.15.155:0/2976316432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc1022d0 msgr2=0x7fc2dc077c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:13.207 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.803+0000 7fc2e2184700 1 --2- 172.21.15.155:0/2976316432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc1022d0 0x7fc2dc077c00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc000c00 tx=0x7fc2cc009250 comp rx=0 tx=0).stop 2023-12-16T05:50:13.207 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.803+0000 7fc2e2184700 1 -- 172.21.15.155:0/2976316432 shutdown_connections 2023-12-16T05:50:13.207 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.803+0000 7fc2e2184700 1 --2- 172.21.15.155:0/2976316432 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fc2c4036640 0x7fc2c4038af0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:13.207 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.803+0000 7fc2e2184700 1 --2- 172.21.15.155:0/2976316432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc1022d0 0x7fc2dc077c00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:13.207 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.803+0000 7fc2e2184700 1 -- 172.21.15.155:0/2976316432 >> 172.21.15.155:0/2976316432 conn(0x7fc2dc0fda50 msgr2=0x7fc2dc0ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:13.207 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.803+0000 7fc2e2184700 1 -- 172.21.15.155:0/2976316432 shutdown_connections 2023-12-16T05:50:13.207 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:12.803+0000 7fc2e2184700 1 -- 172.21.15.155:0/2976316432 wait complete. 2023-12-16T05:50:13.207 INFO:teuthology.orchestra.run.smithi155.stdout:Deploying mgr service with default placement... 2023-12-16T05:50:14.145 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-12-16T05:50:14.146 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.544+0000 7f676f7c6700 1 Processor -- start 2023-12-16T05:50:14.146 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.544+0000 7f676f7c6700 1 -- start start 2023-12-16T05:50:14.146 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.544+0000 7f676f7c6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6768070fc0 0x7f6768104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:14.146 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.544+0000 7f676f7c6700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6768105420 con 0x7f6768070fc0 2023-12-16T05:50:14.146 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.544+0000 7f676d562700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6768070fc0 0x7f6768104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:14.146 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.545+0000 7f676d562700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6768070fc0 0x7f6768104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54576/0 (socket says 172.21.15.155:54576) 2023-12-16T05:50:14.146 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.545+0000 7f676d562700 1 -- 172.21.15.155:0/2757293497 learned_addr learned my addr 172.21.15.155:0/2757293497 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:14.146 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.545+0000 7f676d562700 1 -- 172.21.15.155:0/2757293497 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6768105560 con 0x7f6768070fc0 2023-12-16T05:50:14.146 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.545+0000 7f676d562700 1 --2- 172.21.15.155:0/2757293497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6768070fc0 0x7f6768104ee0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f67640098e0 tx=0x7f6764009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31aaf36455f77ecc server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:14.146 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.545+0000 7f675ffff700 1 -- 172.21.15.155:0/2757293497 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f676400b860 con 0x7f6768070fc0 2023-12-16T05:50:14.146 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.545+0000 7f675ffff700 1 -- 172.21.15.155:0/2757293497 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f676400be30 con 0x7f6768070fc0 2023-12-16T05:50:14.146 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.545+0000 7f675ffff700 1 -- 172.21.15.155:0/2757293497 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6764010380 con 0x7f6768070fc0 2023-12-16T05:50:14.147 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.546+0000 7f676f7c6700 1 -- 172.21.15.155:0/2757293497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6768070fc0 msgr2=0x7f6768104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:14.147 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.546+0000 7f676f7c6700 1 --2- 172.21.15.155:0/2757293497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6768070fc0 0x7f6768104ee0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f67640098e0 tx=0x7f6764009250 comp rx=0 tx=0).stop 2023-12-16T05:50:14.147 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.546+0000 7f676f7c6700 1 -- 172.21.15.155:0/2757293497 shutdown_connections 2023-12-16T05:50:14.147 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.546+0000 7f676f7c6700 1 --2- 172.21.15.155:0/2757293497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6768070fc0 0x7f6768104ee0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:14.147 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.546+0000 7f676f7c6700 1 -- 172.21.15.155:0/2757293497 >> 172.21.15.155:0/2757293497 conn(0x7f67680fc970 msgr2=0x7f67680fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:14.147 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.546+0000 7f676f7c6700 1 -- 172.21.15.155:0/2757293497 shutdown_connections 2023-12-16T05:50:14.147 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.546+0000 7f676f7c6700 1 -- 172.21.15.155:0/2757293497 wait complete. 2023-12-16T05:50:14.147 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.546+0000 7f676f7c6700 1 Processor -- start 2023-12-16T05:50:14.147 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.546+0000 7f676f7c6700 1 -- start start 2023-12-16T05:50:14.147 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.546+0000 7f676f7c6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6768070fc0 0x7f6768113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:14.147 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.546+0000 7f676f7c6700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67681138c0 con 0x7f6768070fc0 2023-12-16T05:50:14.147 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.547+0000 7f676d562700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6768070fc0 0x7f6768113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:14.147 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.547+0000 7f676d562700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6768070fc0 0x7f6768113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54592/0 (socket says 172.21.15.155:54592) 2023-12-16T05:50:14.147 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.547+0000 7f676d562700 1 -- 172.21.15.155:0/1306701663 learned_addr learned my addr 172.21.15.155:0/1306701663 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:14.147 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.547+0000 7f676d562700 1 -- 172.21.15.155:0/1306701663 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67640094f0 con 0x7f6768070fc0 2023-12-16T05:50:14.148 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.547+0000 7f676d562700 1 --2- 172.21.15.155:0/1306701663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6768070fc0 0x7f6768113380 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6764006d40 tx=0x7f6764009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:14.148 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.547+0000 7f675dffb700 1 -- 172.21.15.155:0/1306701663 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f67640109b0 con 0x7f6768070fc0 2023-12-16T05:50:14.148 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.547+0000 7f676f7c6700 1 -- 172.21.15.155:0/1306701663 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6768113ac0 con 0x7f6768070fc0 2023-12-16T05:50:14.148 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.547+0000 7f675dffb700 1 -- 172.21.15.155:0/1306701663 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f6764024440 con 0x7f6768070fc0 2023-12-16T05:50:14.148 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.547+0000 7f675dffb700 1 -- 172.21.15.155:0/1306701663 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f676401a5f0 con 0x7f6768070fc0 2023-12-16T05:50:14.148 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.547+0000 7f676f7c6700 1 -- 172.21.15.155:0/1306701663 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6768113ed0 con 0x7f6768070fc0 2023-12-16T05:50:14.148 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.548+0000 7f675dffb700 1 -- 172.21.15.155:0/1306701663 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f676401a870 con 0x7f6768070fc0 2023-12-16T05:50:14.148 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.548+0000 7f675dffb700 1 --2- 172.21.15.155:0/1306701663 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f67540365f0 0x7f6754038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:14.148 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.548+0000 7f675dffb700 1 -- 172.21.15.155:0/1306701663 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f676404a450 con 0x7f6768070fc0 2023-12-16T05:50:14.148 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.548+0000 7f676f7c6700 1 -- 172.21.15.155:0/1306701663 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f676804bb80 con 0x7f6768070fc0 2023-12-16T05:50:14.148 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.548+0000 7f676cd61700 1 --2- 172.21.15.155:0/1306701663 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f67540365f0 0x7f6754038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:14.148 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.549+0000 7f676cd61700 1 --2- 172.21.15.155:0/1306701663 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f67540365f0 0x7f6754038aa0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6758009990 tx=0x7f6758006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:14.148 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.553+0000 7f675dffb700 1 -- 172.21.15.155:0/1306701663 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6764018af0 con 0x7f6768070fc0 2023-12-16T05:50:14.148 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.677+0000 7f675dffb700 1 -- 172.21.15.155:0/1306701663 <== mon.0 v2:172.21.15.155:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f676402ce70 con 0x7f6768070fc0 2023-12-16T05:50:14.149 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.777+0000 7f676f7c6700 1 -- 172.21.15.155:0/1306701663 --> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f676810d1b0 con 0x7f67540365f0 2023-12-16T05:50:14.149 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.782+0000 7f675dffb700 1 -- 172.21.15.155:0/1306701663 <== mgr.14120 v2:172.21.15.155:6800/1287353594 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f676810d1b0 con 0x7f67540365f0 2023-12-16T05:50:14.149 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.784+0000 7f676f7c6700 1 -- 172.21.15.155:0/1306701663 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f67540365f0 msgr2=0x7f6754038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:14.149 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.784+0000 7f676f7c6700 1 --2- 172.21.15.155:0/1306701663 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f67540365f0 0x7f6754038aa0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6758009990 tx=0x7f6758006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:14.149 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.784+0000 7f676f7c6700 1 -- 172.21.15.155:0/1306701663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6768070fc0 msgr2=0x7f6768113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:14.149 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.784+0000 7f676f7c6700 1 --2- 172.21.15.155:0/1306701663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6768070fc0 0x7f6768113380 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6764006d40 tx=0x7f6764009250 comp rx=0 tx=0).stop 2023-12-16T05:50:14.149 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.784+0000 7f676f7c6700 1 -- 172.21.15.155:0/1306701663 shutdown_connections 2023-12-16T05:50:14.149 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.784+0000 7f676f7c6700 1 --2- 172.21.15.155:0/1306701663 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f67540365f0 0x7f6754038aa0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:14.149 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.784+0000 7f676f7c6700 1 --2- 172.21.15.155:0/1306701663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6768070fc0 0x7f6768113380 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:14.149 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.784+0000 7f676f7c6700 1 -- 172.21.15.155:0/1306701663 >> 172.21.15.155:0/1306701663 conn(0x7f67680fc970 msgr2=0x7f67681031b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:14.149 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.784+0000 7f676f7c6700 1 -- 172.21.15.155:0/1306701663 shutdown_connections 2023-12-16T05:50:14.149 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:13.784+0000 7f676f7c6700 1 -- 172.21.15.155:0/1306701663 wait complete. 2023-12-16T05:50:14.149 INFO:teuthology.orchestra.run.smithi155.stdout:Deploying crash service with default placement... 2023-12-16T05:50:14.249 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:13 smithi155 ceph-mon[112451]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:50:14.250 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:13 smithi155 ceph-mon[112451]: Saving service mon spec with placement count:5 2023-12-16T05:50:14.250 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:13 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:14.250 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:13 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:15.065 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:14 smithi155 ceph-mon[112451]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:50:15.065 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:14 smithi155 ceph-mon[112451]: Saving service mgr spec with placement count:2 2023-12-16T05:50:15.065 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:14 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:15.065 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:14 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:15.187 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2023-12-16T05:50:15.187 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.500+0000 7f77b59f7700 1 Processor -- start 2023-12-16T05:50:15.187 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.500+0000 7f77b59f7700 1 -- start start 2023-12-16T05:50:15.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.500+0000 7f77b59f7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77b01011d0 0x7f77b01015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:15.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.500+0000 7f77b59f7700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b0101b20 con 0x7f77b01011d0 2023-12-16T05:50:15.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.500+0000 7f77aeffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77b01011d0 0x7f77b01015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:15.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.501+0000 7f77aeffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77b01011d0 0x7f77b01015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54598/0 (socket says 172.21.15.155:54598) 2023-12-16T05:50:15.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.501+0000 7f77aeffd700 1 -- 172.21.15.155:0/3718641588 learned_addr learned my addr 172.21.15.155:0/3718641588 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:15.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.501+0000 7f77aeffd700 1 -- 172.21.15.155:0/3718641588 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b0101c60 con 0x7f77b01011d0 2023-12-16T05:50:15.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.501+0000 7f77aeffd700 1 --2- 172.21.15.155:0/3718641588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77b01011d0 0x7f77b01015e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f77a00098e0 tx=0x7f77a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ec95c45b09f437 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:15.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.501+0000 7f77adffb700 1 -- 172.21.15.155:0/3718641588 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77a000b860 con 0x7f77b01011d0 2023-12-16T05:50:15.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.501+0000 7f77adffb700 1 -- 172.21.15.155:0/3718641588 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f77a000be70 con 0x7f77b01011d0 2023-12-16T05:50:15.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.501+0000 7f77adffb700 1 -- 172.21.15.155:0/3718641588 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77a0010380 con 0x7f77b01011d0 2023-12-16T05:50:15.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.502+0000 7f77b59f7700 1 -- 172.21.15.155:0/3718641588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77b01011d0 msgr2=0x7f77b01015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:15.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.502+0000 7f77b59f7700 1 --2- 172.21.15.155:0/3718641588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77b01011d0 0x7f77b01015e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f77a00098e0 tx=0x7f77a0009250 comp rx=0 tx=0).stop 2023-12-16T05:50:15.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.502+0000 7f77b59f7700 1 -- 172.21.15.155:0/3718641588 shutdown_connections 2023-12-16T05:50:15.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.502+0000 7f77b59f7700 1 --2- 172.21.15.155:0/3718641588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77b01011d0 0x7f77b01015e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:15.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.502+0000 7f77b59f7700 1 -- 172.21.15.155:0/3718641588 >> 172.21.15.155:0/3718641588 conn(0x7f77b00fc970 msgr2=0x7f77b00fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:15.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.502+0000 7f77b59f7700 1 -- 172.21.15.155:0/3718641588 shutdown_connections 2023-12-16T05:50:15.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.502+0000 7f77b59f7700 1 -- 172.21.15.155:0/3718641588 wait complete. 2023-12-16T05:50:15.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.503+0000 7f77b59f7700 1 Processor -- start 2023-12-16T05:50:15.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.503+0000 7f77b59f7700 1 -- start start 2023-12-16T05:50:15.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.503+0000 7f77b59f7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77b01011d0 0x7f77b01075b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:15.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.503+0000 7f77b59f7700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b0105a30 con 0x7f77b01011d0 2023-12-16T05:50:15.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.503+0000 7f77aeffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77b01011d0 0x7f77b01075b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:15.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.503+0000 7f77aeffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77b01011d0 0x7f77b01075b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54612/0 (socket says 172.21.15.155:54612) 2023-12-16T05:50:15.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.503+0000 7f77aeffd700 1 -- 172.21.15.155:0/1969095333 learned_addr learned my addr 172.21.15.155:0/1969095333 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:15.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.503+0000 7f77aeffd700 1 -- 172.21.15.155:0/1969095333 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a00094f0 con 0x7f77b01011d0 2023-12-16T05:50:15.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.503+0000 7f77aeffd700 1 --2- 172.21.15.155:0/1969095333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77b01011d0 0x7f77b01075b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f77a0011b60 tx=0x7f77a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:15.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.503+0000 7f77977fe700 1 -- 172.21.15.155:0/1969095333 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77a0010850 con 0x7f77b01011d0 2023-12-16T05:50:15.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.503+0000 7f77977fe700 1 -- 172.21.15.155:0/1969095333 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f77a0010e60 con 0x7f77b01011d0 2023-12-16T05:50:15.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.503+0000 7f77b59f7700 1 -- 172.21.15.155:0/1969095333 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b0105c30 con 0x7f77b01011d0 2023-12-16T05:50:15.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.503+0000 7f77977fe700 1 -- 172.21.15.155:0/1969095333 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77a001ae20 con 0x7f77b01011d0 2023-12-16T05:50:15.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.503+0000 7f77b59f7700 1 -- 172.21.15.155:0/1969095333 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b0106040 con 0x7f77b01011d0 2023-12-16T05:50:15.190 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.504+0000 7f77977fe700 1 -- 172.21.15.155:0/1969095333 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f77a002d3f0 con 0x7f77b01011d0 2023-12-16T05:50:15.190 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.504+0000 7f77977fe700 1 --2- 172.21.15.155:0/1969095333 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f7798036640 0x7f7798038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:15.190 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.504+0000 7f77977fe700 1 -- 172.21.15.155:0/1969095333 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f77a004b0d0 con 0x7f77b01011d0 2023-12-16T05:50:15.190 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.504+0000 7f77ae7fc700 1 --2- 172.21.15.155:0/1969095333 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f7798036640 0x7f7798038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:15.190 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.505+0000 7f77b59f7700 1 -- 172.21.15.155:0/1969095333 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b004bb80 con 0x7f77b01011d0 2023-12-16T05:50:15.190 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.505+0000 7f77ae7fc700 1 --2- 172.21.15.155:0/1969095333 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f7798036640 0x7f7798038af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f77a4009990 tx=0x7f77a4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:15.190 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.510+0000 7f77977fe700 1 -- 172.21.15.155:0/1969095333 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f77a002b8e0 con 0x7f77b01011d0 2023-12-16T05:50:15.190 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.724+0000 7f77b59f7700 1 -- 172.21.15.155:0/1969095333 --> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f77b01064b0 con 0x7f7798036640 2023-12-16T05:50:15.190 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.729+0000 7f77977fe700 1 -- 172.21.15.155:0/1969095333 <== mgr.14120 v2:172.21.15.155:6800/1287353594 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f77b01064b0 con 0x7f7798036640 2023-12-16T05:50:15.190 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.731+0000 7f77b59f7700 1 -- 172.21.15.155:0/1969095333 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f7798036640 msgr2=0x7f7798038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:15.190 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.731+0000 7f77b59f7700 1 --2- 172.21.15.155:0/1969095333 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f7798036640 0x7f7798038af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f77a4009990 tx=0x7f77a4006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:15.190 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.731+0000 7f77b59f7700 1 -- 172.21.15.155:0/1969095333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77b01011d0 msgr2=0x7f77b01075b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:15.190 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.731+0000 7f77b59f7700 1 --2- 172.21.15.155:0/1969095333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77b01011d0 0x7f77b01075b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f77a0011b60 tx=0x7f77a0009250 comp rx=0 tx=0).stop 2023-12-16T05:50:15.190 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.731+0000 7f77b59f7700 1 -- 172.21.15.155:0/1969095333 shutdown_connections 2023-12-16T05:50:15.190 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.731+0000 7f77b59f7700 1 --2- 172.21.15.155:0/1969095333 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f7798036640 0x7f7798038af0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:15.191 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.731+0000 7f77b59f7700 1 --2- 172.21.15.155:0/1969095333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77b01011d0 0x7f77b01075b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:15.191 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.731+0000 7f77b59f7700 1 -- 172.21.15.155:0/1969095333 >> 172.21.15.155:0/1969095333 conn(0x7f77b00fc970 msgr2=0x7f77b0070bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:15.191 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.731+0000 7f77b59f7700 1 -- 172.21.15.155:0/1969095333 shutdown_connections 2023-12-16T05:50:15.191 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:14.731+0000 7f77b59f7700 1 -- 172.21.15.155:0/1969095333 wait complete. 2023-12-16T05:50:15.191 INFO:teuthology.orchestra.run.smithi155.stdout:Deploying prometheus service with default placement... 2023-12-16T05:50:16.127 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:15 smithi155 ceph-mon[112451]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:50:16.127 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:15 smithi155 ceph-mon[112451]: Saving service crash spec with placement * 2023-12-16T05:50:16.127 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:15 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:16.127 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:15 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:16.127 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:15 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:16.295 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2023-12-16T05:50:16.295 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.610+0000 7fab609ee700 1 Processor -- start 2023-12-16T05:50:16.295 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.610+0000 7fab609ee700 1 -- start start 2023-12-16T05:50:16.295 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.610+0000 7fab609ee700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c1011d0 0x7fab5c1015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:16.295 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.610+0000 7fab609ee700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c101b20 con 0x7fab5c1011d0 2023-12-16T05:50:16.295 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.611+0000 7fab5a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c1011d0 0x7fab5c1015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:16.295 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.611+0000 7fab5a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c1011d0 0x7fab5c1015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54626/0 (socket says 172.21.15.155:54626) 2023-12-16T05:50:16.295 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.611+0000 7fab5a59c700 1 -- 172.21.15.155:0/1317587024 learned_addr learned my addr 172.21.15.155:0/1317587024 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:16.295 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.611+0000 7fab5a59c700 1 -- 172.21.15.155:0/1317587024 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c101c60 con 0x7fab5c1011d0 2023-12-16T05:50:16.295 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.611+0000 7fab5a59c700 1 --2- 172.21.15.155:0/1317587024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c1011d0 0x7fab5c1015e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0098e0 tx=0x7fab4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b464134a5acf7943 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:16.296 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.611+0000 7fab5959a700 1 -- 172.21.15.155:0/1317587024 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab4c00b860 con 0x7fab5c1011d0 2023-12-16T05:50:16.296 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.611+0000 7fab5959a700 1 -- 172.21.15.155:0/1317587024 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fab4c00be70 con 0x7fab5c1011d0 2023-12-16T05:50:16.296 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.611+0000 7fab5959a700 1 -- 172.21.15.155:0/1317587024 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab4c010380 con 0x7fab5c1011d0 2023-12-16T05:50:16.296 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.612+0000 7fab609ee700 1 -- 172.21.15.155:0/1317587024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c1011d0 msgr2=0x7fab5c1015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:16.296 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.612+0000 7fab609ee700 1 --2- 172.21.15.155:0/1317587024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c1011d0 0x7fab5c1015e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0098e0 tx=0x7fab4c009250 comp rx=0 tx=0).stop 2023-12-16T05:50:16.296 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.612+0000 7fab609ee700 1 -- 172.21.15.155:0/1317587024 shutdown_connections 2023-12-16T05:50:16.296 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.612+0000 7fab609ee700 1 --2- 172.21.15.155:0/1317587024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c1011d0 0x7fab5c1015e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:16.296 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.612+0000 7fab609ee700 1 -- 172.21.15.155:0/1317587024 >> 172.21.15.155:0/1317587024 conn(0x7fab5c0fc970 msgr2=0x7fab5c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:16.296 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.612+0000 7fab609ee700 1 -- 172.21.15.155:0/1317587024 shutdown_connections 2023-12-16T05:50:16.296 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.612+0000 7fab609ee700 1 -- 172.21.15.155:0/1317587024 wait complete. 2023-12-16T05:50:16.296 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.613+0000 7fab609ee700 1 Processor -- start 2023-12-16T05:50:16.296 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.613+0000 7fab609ee700 1 -- start start 2023-12-16T05:50:16.296 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.613+0000 7fab609ee700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c1011d0 0x7fab5c110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:16.296 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.613+0000 7fab609ee700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c1105b0 con 0x7fab5c1011d0 2023-12-16T05:50:16.296 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.613+0000 7fab5a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c1011d0 0x7fab5c110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:16.297 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.613+0000 7fab5a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c1011d0 0x7fab5c110070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54632/0 (socket says 172.21.15.155:54632) 2023-12-16T05:50:16.297 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.613+0000 7fab5a59c700 1 -- 172.21.15.155:0/1074338238 learned_addr learned my addr 172.21.15.155:0/1074338238 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:16.297 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.614+0000 7fab5a59c700 1 -- 172.21.15.155:0/1074338238 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c0094f0 con 0x7fab5c1011d0 2023-12-16T05:50:16.297 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.614+0000 7fab5a59c700 1 --2- 172.21.15.155:0/1074338238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c1011d0 0x7fab5c110070 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00c010 tx=0x7fab4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:16.297 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.614+0000 7fab4affd700 1 -- 172.21.15.155:0/1074338238 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab4c010960 con 0x7fab5c1011d0 2023-12-16T05:50:16.297 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.614+0000 7fab4affd700 1 -- 172.21.15.155:0/1074338238 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fab4c01a430 con 0x7fab5c1011d0 2023-12-16T05:50:16.297 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.614+0000 7fab609ee700 1 -- 172.21.15.155:0/1074338238 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5c1107b0 con 0x7fab5c1011d0 2023-12-16T05:50:16.297 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.614+0000 7fab4affd700 1 -- 172.21.15.155:0/1074338238 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab4c019580 con 0x7fab5c1011d0 2023-12-16T05:50:16.297 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.614+0000 7fab609ee700 1 -- 172.21.15.155:0/1074338238 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5c110bc0 con 0x7fab5c1011d0 2023-12-16T05:50:16.297 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.615+0000 7fab4affd700 1 -- 172.21.15.155:0/1074338238 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fab4c0197b0 con 0x7fab5c1011d0 2023-12-16T05:50:16.297 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.615+0000 7fab4affd700 1 --2- 172.21.15.155:0/1074338238 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fab44036640 0x7fab44038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:16.297 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.615+0000 7fab609ee700 1 -- 172.21.15.155:0/1074338238 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab5c04bb80 con 0x7fab5c1011d0 2023-12-16T05:50:16.297 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.615+0000 7fab4affd700 1 -- 172.21.15.155:0/1074338238 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fab4c01a980 con 0x7fab5c1011d0 2023-12-16T05:50:16.297 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.615+0000 7fab59d9b700 1 --2- 172.21.15.155:0/1074338238 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fab44036640 0x7fab44038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:16.298 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.616+0000 7fab59d9b700 1 --2- 172.21.15.155:0/1074338238 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fab44036640 0x7fab44038af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fab50009990 tx=0x7fab50006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:16.298 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.620+0000 7fab4affd700 1 -- 172.21.15.155:0/1074338238 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fab4c019b00 con 0x7fab5c1011d0 2023-12-16T05:50:16.298 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.826+0000 7fab609ee700 1 -- 172.21.15.155:0/1074338238 --> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fab5c109f00 con 0x7fab44036640 2023-12-16T05:50:16.298 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.835+0000 7fab4affd700 1 -- 172.21.15.155:0/1074338238 <== mgr.14120 v2:172.21.15.155:6800/1287353594 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fab5c109f00 con 0x7fab44036640 2023-12-16T05:50:16.298 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.837+0000 7fab609ee700 1 -- 172.21.15.155:0/1074338238 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fab44036640 msgr2=0x7fab44038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:16.298 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.837+0000 7fab609ee700 1 --2- 172.21.15.155:0/1074338238 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fab44036640 0x7fab44038af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fab50009990 tx=0x7fab50006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:16.298 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.837+0000 7fab609ee700 1 -- 172.21.15.155:0/1074338238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c1011d0 msgr2=0x7fab5c110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:16.298 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.837+0000 7fab609ee700 1 --2- 172.21.15.155:0/1074338238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c1011d0 0x7fab5c110070 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00c010 tx=0x7fab4c009250 comp rx=0 tx=0).stop 2023-12-16T05:50:16.298 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.837+0000 7fab609ee700 1 -- 172.21.15.155:0/1074338238 shutdown_connections 2023-12-16T05:50:16.298 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.837+0000 7fab609ee700 1 --2- 172.21.15.155:0/1074338238 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fab44036640 0x7fab44038af0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:16.298 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.837+0000 7fab609ee700 1 --2- 172.21.15.155:0/1074338238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c1011d0 0x7fab5c110070 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:16.298 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.837+0000 7fab609ee700 1 -- 172.21.15.155:0/1074338238 >> 172.21.15.155:0/1074338238 conn(0x7fab5c0fc970 msgr2=0x7fab5c0fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:16.298 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.837+0000 7fab609ee700 1 -- 172.21.15.155:0/1074338238 shutdown_connections 2023-12-16T05:50:16.298 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:15.837+0000 7fab609ee700 1 -- 172.21.15.155:0/1074338238 wait complete. 2023-12-16T05:50:16.298 INFO:teuthology.orchestra.run.smithi155.stdout:Deploying grafana service with default placement... 2023-12-16T05:50:17.107 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:16 smithi155 ceph-mon[112451]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:50:17.107 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:16 smithi155 ceph-mon[112451]: Saving service prometheus spec with placement count:1 2023-12-16T05:50:17.286 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2023-12-16T05:50:17.286 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.712+0000 7f7d1d48f700 1 Processor -- start 2023-12-16T05:50:17.286 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.712+0000 7f7d1d48f700 1 -- start start 2023-12-16T05:50:17.287 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.712+0000 7f7d1d48f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d18076c00 0x7f7d18107300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:17.287 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.712+0000 7f7d1d48f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d18102cf0 con 0x7f7d18076c00 2023-12-16T05:50:17.287 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.712+0000 7f7d16ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d18076c00 0x7f7d18107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:17.287 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.712+0000 7f7d16ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d18076c00 0x7f7d18107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59550/0 (socket says 172.21.15.155:59550) 2023-12-16T05:50:17.287 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.712+0000 7f7d16ffd700 1 -- 172.21.15.155:0/2887413544 learned_addr learned my addr 172.21.15.155:0/2887413544 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:17.287 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.713+0000 7f7d16ffd700 1 -- 172.21.15.155:0/2887413544 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d18107840 con 0x7f7d18076c00 2023-12-16T05:50:17.287 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.713+0000 7f7d16ffd700 1 --2- 172.21.15.155:0/2887413544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d18076c00 0x7f7d18107300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0098e0 tx=0x7f7d0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b060e42990c5f29b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:17.287 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.713+0000 7f7d15ffb700 1 -- 172.21.15.155:0/2887413544 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d0c00b860 con 0x7f7d18076c00 2023-12-16T05:50:17.287 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.713+0000 7f7d15ffb700 1 -- 172.21.15.155:0/2887413544 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7d0c00be70 con 0x7f7d18076c00 2023-12-16T05:50:17.287 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.713+0000 7f7d15ffb700 1 -- 172.21.15.155:0/2887413544 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d0c010380 con 0x7f7d18076c00 2023-12-16T05:50:17.287 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.713+0000 7f7d1d48f700 1 -- 172.21.15.155:0/2887413544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d18076c00 msgr2=0x7f7d18107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:17.287 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.713+0000 7f7d1d48f700 1 --2- 172.21.15.155:0/2887413544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d18076c00 0x7f7d18107300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0098e0 tx=0x7f7d0c009250 comp rx=0 tx=0).stop 2023-12-16T05:50:17.287 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.714+0000 7f7d1d48f700 1 -- 172.21.15.155:0/2887413544 shutdown_connections 2023-12-16T05:50:17.287 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.714+0000 7f7d1d48f700 1 --2- 172.21.15.155:0/2887413544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d18076c00 0x7f7d18107300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:17.288 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.714+0000 7f7d1d48f700 1 -- 172.21.15.155:0/2887413544 >> 172.21.15.155:0/2887413544 conn(0x7f7d180fc950 msgr2=0x7f7d180fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:17.288 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.714+0000 7f7d1d48f700 1 -- 172.21.15.155:0/2887413544 shutdown_connections 2023-12-16T05:50:17.288 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.714+0000 7f7d1d48f700 1 -- 172.21.15.155:0/2887413544 wait complete. 2023-12-16T05:50:17.288 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.714+0000 7f7d1d48f700 1 Processor -- start 2023-12-16T05:50:17.288 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.714+0000 7f7d1d48f700 1 -- start start 2023-12-16T05:50:17.288 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.714+0000 7f7d1d48f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d18076c00 0x7f7d181133b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:17.288 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.714+0000 7f7d1d48f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d181138f0 con 0x7f7d18076c00 2023-12-16T05:50:17.288 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.715+0000 7f7d16ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d18076c00 0x7f7d181133b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:17.288 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.715+0000 7f7d16ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d18076c00 0x7f7d181133b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59552/0 (socket says 172.21.15.155:59552) 2023-12-16T05:50:17.288 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.715+0000 7f7d16ffd700 1 -- 172.21.15.155:0/4107629863 learned_addr learned my addr 172.21.15.155:0/4107629863 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:17.288 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.715+0000 7f7d16ffd700 1 -- 172.21.15.155:0/4107629863 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c0094f0 con 0x7f7d18076c00 2023-12-16T05:50:17.289 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.715+0000 7f7d16ffd700 1 --2- 172.21.15.155:0/4107629863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d18076c00 0x7f7d181133b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0094c0 tx=0x7f7d0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:17.289 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.715+0000 7f7cff7fe700 1 -- 172.21.15.155:0/4107629863 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d0c010850 con 0x7f7d18076c00 2023-12-16T05:50:17.289 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.715+0000 7f7cff7fe700 1 -- 172.21.15.155:0/4107629863 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7d0c010e60 con 0x7f7d18076c00 2023-12-16T05:50:17.289 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.715+0000 7f7d1d48f700 1 -- 172.21.15.155:0/4107629863 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d18113af0 con 0x7f7d18076c00 2023-12-16T05:50:17.289 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.715+0000 7f7cff7fe700 1 -- 172.21.15.155:0/4107629863 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d0c01a430 con 0x7f7d18076c00 2023-12-16T05:50:17.289 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.715+0000 7f7d1d48f700 1 -- 172.21.15.155:0/4107629863 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d18113f00 con 0x7f7d18076c00 2023-12-16T05:50:17.289 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.716+0000 7f7cff7fe700 1 -- 172.21.15.155:0/4107629863 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f7d0c01a660 con 0x7f7d18076c00 2023-12-16T05:50:17.289 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.716+0000 7f7cff7fe700 1 --2- 172.21.15.155:0/4107629863 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f7d00036640 0x7f7d00038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:17.289 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.716+0000 7f7cff7fe700 1 -- 172.21.15.155:0/4107629863 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f7d0c04a3c0 con 0x7f7d18076c00 2023-12-16T05:50:17.289 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.716+0000 7f7d167fc700 1 --2- 172.21.15.155:0/4107629863 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f7d00036640 0x7f7d00038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:17.289 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.716+0000 7f7d1d48f700 1 -- 172.21.15.155:0/4107629863 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d1804bb80 con 0x7f7d18076c00 2023-12-16T05:50:17.289 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.717+0000 7f7d167fc700 1 --2- 172.21.15.155:0/4107629863 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f7d00036640 0x7f7d00038af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009990 tx=0x7f7d08006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:17.289 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.721+0000 7f7cff7fe700 1 -- 172.21.15.155:0/4107629863 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7d0c02d3f0 con 0x7f7d18076c00 2023-12-16T05:50:17.289 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.922+0000 7f7d1d48f700 1 -- 172.21.15.155:0/4107629863 --> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d1810cf10 con 0x7f7d00036640 2023-12-16T05:50:17.290 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.927+0000 7f7cff7fe700 1 -- 172.21.15.155:0/4107629863 <== mgr.14120 v2:172.21.15.155:6800/1287353594 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f7d1810cf10 con 0x7f7d00036640 2023-12-16T05:50:17.290 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.929+0000 7f7d1d48f700 1 -- 172.21.15.155:0/4107629863 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f7d00036640 msgr2=0x7f7d00038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:17.290 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.929+0000 7f7d1d48f700 1 --2- 172.21.15.155:0/4107629863 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f7d00036640 0x7f7d00038af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009990 tx=0x7f7d08006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:17.290 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.929+0000 7f7d1d48f700 1 -- 172.21.15.155:0/4107629863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d18076c00 msgr2=0x7f7d181133b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:17.290 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.929+0000 7f7d1d48f700 1 --2- 172.21.15.155:0/4107629863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d18076c00 0x7f7d181133b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0094c0 tx=0x7f7d0c009250 comp rx=0 tx=0).stop 2023-12-16T05:50:17.290 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.929+0000 7f7d1d48f700 1 -- 172.21.15.155:0/4107629863 shutdown_connections 2023-12-16T05:50:17.290 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.929+0000 7f7d1d48f700 1 --2- 172.21.15.155:0/4107629863 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f7d00036640 0x7f7d00038af0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:17.290 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.929+0000 7f7d1d48f700 1 --2- 172.21.15.155:0/4107629863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d18076c00 0x7f7d181133b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:17.290 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.929+0000 7f7d1d48f700 1 -- 172.21.15.155:0/4107629863 >> 172.21.15.155:0/4107629863 conn(0x7f7d180fc950 msgr2=0x7f7d180fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:17.290 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.929+0000 7f7d1d48f700 1 -- 172.21.15.155:0/4107629863 shutdown_connections 2023-12-16T05:50:17.290 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:16.929+0000 7f7d1d48f700 1 -- 172.21.15.155:0/4107629863 wait complete. 2023-12-16T05:50:17.290 INFO:teuthology.orchestra.run.smithi155.stdout:Deploying node-exporter service with default placement... 2023-12-16T05:50:18.186 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2023-12-16T05:50:18.186 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.617+0000 7fd49a144700 1 Processor -- start 2023-12-16T05:50:18.186 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.617+0000 7fd49a144700 1 -- start start 2023-12-16T05:50:18.186 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.617+0000 7fd49a144700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd494077bd0 0x7fd4940760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:18.187 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.617+0000 7fd49a144700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd494077fe0 con 0x7fd494077bd0 2023-12-16T05:50:18.187 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.617+0000 7fd4937fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd494077bd0 0x7fd4940760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:18.187 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.617+0000 7fd4937fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd494077bd0 0x7fd4940760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59558/0 (socket says 172.21.15.155:59558) 2023-12-16T05:50:18.187 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.617+0000 7fd4937fe700 1 -- 172.21.15.155:0/2581860164 learned_addr learned my addr 172.21.15.155:0/2581860164 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:18.187 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.618+0000 7fd4937fe700 1 -- 172.21.15.155:0/2581860164 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd494076620 con 0x7fd494077bd0 2023-12-16T05:50:18.187 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.618+0000 7fd4937fe700 1 --2- 172.21.15.155:0/2581860164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd494077bd0 0x7fd4940760e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd4880098e0 tx=0x7fd488009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9323f631ef9bcf4 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:18.187 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.618+0000 7fd4927fc700 1 -- 172.21.15.155:0/2581860164 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd48800b860 con 0x7fd494077bd0 2023-12-16T05:50:18.187 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.618+0000 7fd4927fc700 1 -- 172.21.15.155:0/2581860164 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd48800be70 con 0x7fd494077bd0 2023-12-16T05:50:18.187 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.618+0000 7fd4927fc700 1 -- 172.21.15.155:0/2581860164 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd488010380 con 0x7fd494077bd0 2023-12-16T05:50:18.187 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.618+0000 7fd49a144700 1 -- 172.21.15.155:0/2581860164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd494077bd0 msgr2=0x7fd4940760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:18.187 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.618+0000 7fd49a144700 1 --2- 172.21.15.155:0/2581860164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd494077bd0 0x7fd4940760e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd4880098e0 tx=0x7fd488009250 comp rx=0 tx=0).stop 2023-12-16T05:50:18.187 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.619+0000 7fd49a144700 1 -- 172.21.15.155:0/2581860164 shutdown_connections 2023-12-16T05:50:18.187 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.619+0000 7fd49a144700 1 --2- 172.21.15.155:0/2581860164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd494077bd0 0x7fd4940760e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:18.187 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.619+0000 7fd49a144700 1 -- 172.21.15.155:0/2581860164 >> 172.21.15.155:0/2581860164 conn(0x7fd4940fda50 msgr2=0x7fd4940ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:18.187 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.619+0000 7fd49a144700 1 -- 172.21.15.155:0/2581860164 shutdown_connections 2023-12-16T05:50:18.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.619+0000 7fd49a144700 1 -- 172.21.15.155:0/2581860164 wait complete. 2023-12-16T05:50:18.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.619+0000 7fd49a144700 1 Processor -- start 2023-12-16T05:50:18.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.620+0000 7fd49a144700 1 -- start start 2023-12-16T05:50:18.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.620+0000 7fd49a144700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd494077bd0 0x7fd4941133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:18.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.620+0000 7fd49a144700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd494113900 con 0x7fd494077bd0 2023-12-16T05:50:18.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.620+0000 7fd4937fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd494077bd0 0x7fd4941133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:18.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.620+0000 7fd4937fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd494077bd0 0x7fd4941133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59564/0 (socket says 172.21.15.155:59564) 2023-12-16T05:50:18.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.620+0000 7fd4937fe700 1 -- 172.21.15.155:0/3276390270 learned_addr learned my addr 172.21.15.155:0/3276390270 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:18.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.620+0000 7fd4937fe700 1 -- 172.21.15.155:0/3276390270 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4880094f0 con 0x7fd494077bd0 2023-12-16T05:50:18.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.620+0000 7fd4937fe700 1 --2- 172.21.15.155:0/3276390270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd494077bd0 0x7fd4941133c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd4880094c0 tx=0x7fd488009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:18.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.620+0000 7fd47bfff700 1 -- 172.21.15.155:0/3276390270 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd488010850 con 0x7fd494077bd0 2023-12-16T05:50:18.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.620+0000 7fd49a144700 1 -- 172.21.15.155:0/3276390270 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd494113b00 con 0x7fd494077bd0 2023-12-16T05:50:18.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.620+0000 7fd47bfff700 1 -- 172.21.15.155:0/3276390270 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd488010e60 con 0x7fd494077bd0 2023-12-16T05:50:18.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.620+0000 7fd47bfff700 1 -- 172.21.15.155:0/3276390270 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd48801a430 con 0x7fd494077bd0 2023-12-16T05:50:18.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.620+0000 7fd49a144700 1 -- 172.21.15.155:0/3276390270 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd494113f10 con 0x7fd494077bd0 2023-12-16T05:50:18.188 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.621+0000 7fd47bfff700 1 -- 172.21.15.155:0/3276390270 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fd48801a6b0 con 0x7fd494077bd0 2023-12-16T05:50:18.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.621+0000 7fd47bfff700 1 --2- 172.21.15.155:0/3276390270 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fd47c0365f0 0x7fd47c038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:18.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.621+0000 7fd49a144700 1 -- 172.21.15.155:0/3276390270 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd49404bb80 con 0x7fd494077bd0 2023-12-16T05:50:18.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.621+0000 7fd47bfff700 1 -- 172.21.15.155:0/3276390270 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd48804a530 con 0x7fd494077bd0 2023-12-16T05:50:18.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.622+0000 7fd492ffd700 1 --2- 172.21.15.155:0/3276390270 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fd47c0365f0 0x7fd47c038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:18.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.622+0000 7fd492ffd700 1 --2- 172.21.15.155:0/3276390270 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fd47c0365f0 0x7fd47c038aa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd484009990 tx=0x7fd484006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:18.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.626+0000 7fd47bfff700 1 -- 172.21.15.155:0/3276390270 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd488018d90 con 0x7fd494077bd0 2023-12-16T05:50:18.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.820+0000 7fd49a144700 1 -- 172.21.15.155:0/3276390270 --> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fd49410d1f0 con 0x7fd47c0365f0 2023-12-16T05:50:18.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.825+0000 7fd47bfff700 1 -- 172.21.15.155:0/3276390270 <== mgr.14120 v2:172.21.15.155:6800/1287353594 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fd49410d1f0 con 0x7fd47c0365f0 2023-12-16T05:50:18.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.827+0000 7fd49a144700 1 -- 172.21.15.155:0/3276390270 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fd47c0365f0 msgr2=0x7fd47c038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:18.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.827+0000 7fd49a144700 1 --2- 172.21.15.155:0/3276390270 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fd47c0365f0 0x7fd47c038aa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd484009990 tx=0x7fd484006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:18.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.827+0000 7fd49a144700 1 -- 172.21.15.155:0/3276390270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd494077bd0 msgr2=0x7fd4941133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:18.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.827+0000 7fd49a144700 1 --2- 172.21.15.155:0/3276390270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd494077bd0 0x7fd4941133c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd4880094c0 tx=0x7fd488009250 comp rx=0 tx=0).stop 2023-12-16T05:50:18.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.827+0000 7fd49a144700 1 -- 172.21.15.155:0/3276390270 shutdown_connections 2023-12-16T05:50:18.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.827+0000 7fd49a144700 1 --2- 172.21.15.155:0/3276390270 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7fd47c0365f0 0x7fd47c038aa0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:18.189 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.827+0000 7fd49a144700 1 --2- 172.21.15.155:0/3276390270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd494077bd0 0x7fd4941133c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:18.190 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.827+0000 7fd49a144700 1 -- 172.21.15.155:0/3276390270 >> 172.21.15.155:0/3276390270 conn(0x7fd4940fda50 msgr2=0x7fd4940ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:18.190 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.827+0000 7fd49a144700 1 -- 172.21.15.155:0/3276390270 shutdown_connections 2023-12-16T05:50:18.190 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:17.827+0000 7fd49a144700 1 -- 172.21.15.155:0/3276390270 wait complete. 2023-12-16T05:50:18.190 INFO:teuthology.orchestra.run.smithi155.stdout:Deploying alertmanager service with default placement... 2023-12-16T05:50:18.302 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:17 smithi155 ceph-mon[112451]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:50:18.303 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:17 smithi155 ceph-mon[112451]: Saving service grafana spec with placement count:1 2023-12-16T05:50:18.303 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:17 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:18.303 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:17 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:19.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:18 smithi155 ceph-mon[112451]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:50:19.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:18 smithi155 ceph-mon[112451]: Saving service node-exporter spec with placement * 2023-12-16T05:50:19.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:18 smithi155 ceph-mon[112451]: from='mgr.14120 172.21.15.155:0/861209840' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:19.154 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2023-12-16T05:50:19.155 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.553+0000 7f2165209700 1 Processor -- start 2023-12-16T05:50:19.155 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.553+0000 7f2165209700 1 -- start start 2023-12-16T05:50:19.155 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.553+0000 7f2165209700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2160078d00 0x7f2160077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:19.155 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.553+0000 7f2165209700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2160079110 con 0x7f2160078d00 2023-12-16T05:50:19.155 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.553+0000 7f215ed9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2160078d00 0x7f2160077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:19.155 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.554+0000 7f215ed9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2160078d00 0x7f2160077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59566/0 (socket says 172.21.15.155:59566) 2023-12-16T05:50:19.155 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.554+0000 7f215ed9d700 1 -- 172.21.15.155:0/2259892454 learned_addr learned my addr 172.21.15.155:0/2259892454 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:19.155 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.554+0000 7f215ed9d700 1 -- 172.21.15.155:0/2259892454 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2160077750 con 0x7f2160078d00 2023-12-16T05:50:19.155 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.554+0000 7f215ed9d700 1 --2- 172.21.15.155:0/2259892454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2160078d00 0x7f2160077210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f21540098e0 tx=0x7f2154009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1c3139d75a5c0f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:19.155 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.554+0000 7f215dd9b700 1 -- 172.21.15.155:0/2259892454 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f215400b860 con 0x7f2160078d00 2023-12-16T05:50:19.155 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.554+0000 7f215dd9b700 1 -- 172.21.15.155:0/2259892454 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f215400be70 con 0x7f2160078d00 2023-12-16T05:50:19.156 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.554+0000 7f215dd9b700 1 -- 172.21.15.155:0/2259892454 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2154010380 con 0x7f2160078d00 2023-12-16T05:50:19.156 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.555+0000 7f2165209700 1 -- 172.21.15.155:0/2259892454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2160078d00 msgr2=0x7f2160077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:19.156 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.555+0000 7f2165209700 1 --2- 172.21.15.155:0/2259892454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2160078d00 0x7f2160077210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f21540098e0 tx=0x7f2154009250 comp rx=0 tx=0).stop 2023-12-16T05:50:19.156 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.555+0000 7f2165209700 1 -- 172.21.15.155:0/2259892454 shutdown_connections 2023-12-16T05:50:19.156 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.555+0000 7f2165209700 1 --2- 172.21.15.155:0/2259892454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2160078d00 0x7f2160077210 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:19.156 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.555+0000 7f2165209700 1 -- 172.21.15.155:0/2259892454 >> 172.21.15.155:0/2259892454 conn(0x7f21600fda10 msgr2=0x7f21600ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:19.156 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.555+0000 7f2165209700 1 -- 172.21.15.155:0/2259892454 shutdown_connections 2023-12-16T05:50:19.156 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.555+0000 7f2165209700 1 -- 172.21.15.155:0/2259892454 wait complete. 2023-12-16T05:50:19.156 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.555+0000 7f2165209700 1 Processor -- start 2023-12-16T05:50:19.156 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.555+0000 7f2165209700 1 -- start start 2023-12-16T05:50:19.156 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.555+0000 7f2165209700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2160078d00 0x7f2160113350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:19.157 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.555+0000 7f2165209700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2160113890 con 0x7f2160078d00 2023-12-16T05:50:19.157 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.556+0000 7f215ed9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2160078d00 0x7f2160113350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:19.157 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.556+0000 7f215ed9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2160078d00 0x7f2160113350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59578/0 (socket says 172.21.15.155:59578) 2023-12-16T05:50:19.157 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.556+0000 7f215ed9d700 1 -- 172.21.15.155:0/1114835575 learned_addr learned my addr 172.21.15.155:0/1114835575 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:19.157 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.556+0000 7f215ed9d700 1 -- 172.21.15.155:0/1114835575 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21540094f0 con 0x7f2160078d00 2023-12-16T05:50:19.157 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.556+0000 7f215ed9d700 1 --2- 172.21.15.155:0/1114835575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2160078d00 0x7f2160113350 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f21540094c0 tx=0x7f2154009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:19.157 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.556+0000 7f21477fe700 1 -- 172.21.15.155:0/1114835575 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2154010850 con 0x7f2160078d00 2023-12-16T05:50:19.157 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.556+0000 7f21477fe700 1 -- 172.21.15.155:0/1114835575 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2154010e60 con 0x7f2160078d00 2023-12-16T05:50:19.157 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.556+0000 7f21477fe700 1 -- 172.21.15.155:0/1114835575 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f21540243f0 con 0x7f2160078d00 2023-12-16T05:50:19.157 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.556+0000 7f2165209700 1 -- 172.21.15.155:0/1114835575 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2160113a90 con 0x7f2160078d00 2023-12-16T05:50:19.157 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.556+0000 7f2165209700 1 -- 172.21.15.155:0/1114835575 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2160113ea0 con 0x7f2160078d00 2023-12-16T05:50:19.157 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.557+0000 7f21477fe700 1 -- 172.21.15.155:0/1114835575 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f2154024660 con 0x7f2160078d00 2023-12-16T05:50:19.157 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.557+0000 7f21477fe700 1 --2- 172.21.15.155:0/1114835575 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f2148036640 0x7f2148038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:19.158 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.557+0000 7f21477fe700 1 -- 172.21.15.155:0/1114835575 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f215404a5c0 con 0x7f2160078d00 2023-12-16T05:50:19.158 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.557+0000 7f215e59c700 1 --2- 172.21.15.155:0/1114835575 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f2148036640 0x7f2148038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:19.158 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.557+0000 7f2165209700 1 -- 172.21.15.155:0/1114835575 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216004bb80 con 0x7f2160078d00 2023-12-16T05:50:19.158 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.558+0000 7f215e59c700 1 --2- 172.21.15.155:0/1114835575 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f2148036640 0x7f2148038af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2150009990 tx=0x7f2150006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:19.158 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.562+0000 7f21477fe700 1 -- 172.21.15.155:0/1114835575 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f215402e440 con 0x7f2160078d00 2023-12-16T05:50:19.158 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.754+0000 7f2165209700 1 -- 172.21.15.155:0/1114835575 --> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f216010cef0 con 0x7f2148036640 2023-12-16T05:50:19.158 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.758+0000 7f21477fe700 1 -- 172.21.15.155:0/1114835575 <== mgr.14120 v2:172.21.15.155:6800/1287353594 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f216010cef0 con 0x7f2148036640 2023-12-16T05:50:19.158 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.760+0000 7f2165209700 1 -- 172.21.15.155:0/1114835575 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f2148036640 msgr2=0x7f2148038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:19.158 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.760+0000 7f2165209700 1 --2- 172.21.15.155:0/1114835575 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f2148036640 0x7f2148038af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2150009990 tx=0x7f2150006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:19.158 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.760+0000 7f2165209700 1 -- 172.21.15.155:0/1114835575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2160078d00 msgr2=0x7f2160113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:19.158 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.760+0000 7f2165209700 1 --2- 172.21.15.155:0/1114835575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2160078d00 0x7f2160113350 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f21540094c0 tx=0x7f2154009250 comp rx=0 tx=0).stop 2023-12-16T05:50:19.158 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.760+0000 7f2165209700 1 -- 172.21.15.155:0/1114835575 shutdown_connections 2023-12-16T05:50:19.158 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.760+0000 7f2165209700 1 --2- 172.21.15.155:0/1114835575 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f2148036640 0x7f2148038af0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:19.158 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.760+0000 7f2165209700 1 --2- 172.21.15.155:0/1114835575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2160078d00 0x7f2160113350 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:19.159 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.760+0000 7f2165209700 1 -- 172.21.15.155:0/1114835575 >> 172.21.15.155:0/1114835575 conn(0x7f21600fda10 msgr2=0x7f21600ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:19.159 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.761+0000 7f2165209700 1 -- 172.21.15.155:0/1114835575 shutdown_connections 2023-12-16T05:50:19.159 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:18.761+0000 7f2165209700 1 -- 172.21.15.155:0/1114835575 wait complete. 2023-12-16T05:50:20.032 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.467+0000 7f6a40168700 1 Processor -- start 2023-12-16T05:50:20.033 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.468+0000 7f6a40168700 1 -- start start 2023-12-16T05:50:20.033 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.468+0000 7f6a40168700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a38078d00 0x7f6a38077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:20.033 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.468+0000 7f6a40168700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a38079110 con 0x7f6a38078d00 2023-12-16T05:50:20.033 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.468+0000 7f6a3df04700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a38078d00 0x7f6a38077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:20.033 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.468+0000 7f6a3df04700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a38078d00 0x7f6a38077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59580/0 (socket says 172.21.15.155:59580) 2023-12-16T05:50:20.034 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.468+0000 7f6a3df04700 1 -- 172.21.15.155:0/798319444 learned_addr learned my addr 172.21.15.155:0/798319444 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:20.034 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.468+0000 7f6a3df04700 1 -- 172.21.15.155:0/798319444 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a38077750 con 0x7f6a38078d00 2023-12-16T05:50:20.034 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.469+0000 7f6a3df04700 1 --2- 172.21.15.155:0/798319444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a38078d00 0x7f6a38077210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6a340098e0 tx=0x7f6a34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3503286ef09b36c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:20.034 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.469+0000 7f6a3cf02700 1 -- 172.21.15.155:0/798319444 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a3400b860 con 0x7f6a38078d00 2023-12-16T05:50:20.034 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.469+0000 7f6a3cf02700 1 -- 172.21.15.155:0/798319444 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6a3400be70 con 0x7f6a38078d00 2023-12-16T05:50:20.034 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.469+0000 7f6a3cf02700 1 -- 172.21.15.155:0/798319444 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a34010380 con 0x7f6a38078d00 2023-12-16T05:50:20.034 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.469+0000 7f6a40168700 1 -- 172.21.15.155:0/798319444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a38078d00 msgr2=0x7f6a38077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:20.035 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.469+0000 7f6a40168700 1 --2- 172.21.15.155:0/798319444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a38078d00 0x7f6a38077210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6a340098e0 tx=0x7f6a34009250 comp rx=0 tx=0).stop 2023-12-16T05:50:20.035 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.469+0000 7f6a40168700 1 -- 172.21.15.155:0/798319444 shutdown_connections 2023-12-16T05:50:20.035 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.469+0000 7f6a40168700 1 --2- 172.21.15.155:0/798319444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a38078d00 0x7f6a38077210 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:20.035 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.469+0000 7f6a40168700 1 -- 172.21.15.155:0/798319444 >> 172.21.15.155:0/798319444 conn(0x7f6a380fda10 msgr2=0x7f6a380ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:20.035 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.469+0000 7f6a40168700 1 -- 172.21.15.155:0/798319444 shutdown_connections 2023-12-16T05:50:20.035 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.469+0000 7f6a40168700 1 -- 172.21.15.155:0/798319444 wait complete. 2023-12-16T05:50:20.036 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.470+0000 7f6a40168700 1 Processor -- start 2023-12-16T05:50:20.036 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.470+0000 7f6a40168700 1 -- start start 2023-12-16T05:50:20.036 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.470+0000 7f6a40168700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a38078d00 0x7f6a381133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:20.036 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.470+0000 7f6a40168700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a38113900 con 0x7f6a38078d00 2023-12-16T05:50:20.036 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.470+0000 7f6a3df04700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a38078d00 0x7f6a381133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:20.037 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.470+0000 7f6a3df04700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a38078d00 0x7f6a381133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59590/0 (socket says 172.21.15.155:59590) 2023-12-16T05:50:20.037 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.470+0000 7f6a3df04700 1 -- 172.21.15.155:0/3073830405 learned_addr learned my addr 172.21.15.155:0/3073830405 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:20.037 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.470+0000 7f6a3df04700 1 -- 172.21.15.155:0/3073830405 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a340094f0 con 0x7f6a38078d00 2023-12-16T05:50:20.037 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.471+0000 7f6a3df04700 1 --2- 172.21.15.155:0/3073830405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a38078d00 0x7f6a381133c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a34006d40 tx=0x7f6a34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:20.037 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.471+0000 7f6a2e7fc700 1 -- 172.21.15.155:0/3073830405 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a34010960 con 0x7f6a38078d00 2023-12-16T05:50:20.037 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.471+0000 7f6a2e7fc700 1 -- 172.21.15.155:0/3073830405 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6a3401a430 con 0x7f6a38078d00 2023-12-16T05:50:20.038 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.471+0000 7f6a40168700 1 -- 172.21.15.155:0/3073830405 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a38113b00 con 0x7f6a38078d00 2023-12-16T05:50:20.038 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.471+0000 7f6a2e7fc700 1 -- 172.21.15.155:0/3073830405 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a340245b0 con 0x7f6a38078d00 2023-12-16T05:50:20.038 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.471+0000 7f6a40168700 1 -- 172.21.15.155:0/3073830405 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a38113f10 con 0x7f6a38078d00 2023-12-16T05:50:20.038 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.471+0000 7f6a2e7fc700 1 -- 172.21.15.155:0/3073830405 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f6a3402d3f0 con 0x7f6a38078d00 2023-12-16T05:50:20.038 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.472+0000 7f6a2e7fc700 1 --2- 172.21.15.155:0/3073830405 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f6a240365f0 0x7f6a24038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:20.038 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.472+0000 7f6a2e7fc700 1 -- 172.21.15.155:0/3073830405 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6a3404a320 con 0x7f6a38078d00 2023-12-16T05:50:20.038 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.472+0000 7f6a3d703700 1 --2- 172.21.15.155:0/3073830405 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f6a240365f0 0x7f6a24038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:20.039 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.472+0000 7f6a40168700 1 -- 172.21.15.155:0/3073830405 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3804bb80 con 0x7f6a38078d00 2023-12-16T05:50:20.039 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.472+0000 7f6a3d703700 1 --2- 172.21.15.155:0/3073830405 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f6a240365f0 0x7f6a24038aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009990 tx=0x7f6a28006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:20.039 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.476+0000 7f6a2e7fc700 1 -- 172.21.15.155:0/3073830405 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6a34018b00 con 0x7f6a38078d00 2023-12-16T05:50:20.039 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.660+0000 7f6a40168700 1 -- 172.21.15.155:0/3073830405 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f6a38108550 con 0x7f6a38078d00 2023-12-16T05:50:20.039 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.663+0000 7f6a2e7fc700 1 -- 172.21.15.155:0/3073830405 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f6a34018b00 con 0x7f6a38078d00 2023-12-16T05:50:20.039 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.665+0000 7f6a40168700 1 -- 172.21.15.155:0/3073830405 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f6a240365f0 msgr2=0x7f6a24038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:20.039 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.665+0000 7f6a40168700 1 --2- 172.21.15.155:0/3073830405 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f6a240365f0 0x7f6a24038aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009990 tx=0x7f6a28006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:20.040 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.665+0000 7f6a40168700 1 -- 172.21.15.155:0/3073830405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a38078d00 msgr2=0x7f6a381133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:20.040 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.665+0000 7f6a40168700 1 --2- 172.21.15.155:0/3073830405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a38078d00 0x7f6a381133c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a34006d40 tx=0x7f6a34009250 comp rx=0 tx=0).stop 2023-12-16T05:50:20.040 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.665+0000 7f6a40168700 1 -- 172.21.15.155:0/3073830405 shutdown_connections 2023-12-16T05:50:20.040 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.665+0000 7f6a40168700 1 --2- 172.21.15.155:0/3073830405 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f6a240365f0 0x7f6a24038aa0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:20.040 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.665+0000 7f6a40168700 1 --2- 172.21.15.155:0/3073830405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a38078d00 0x7f6a381133c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:20.040 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.665+0000 7f6a40168700 1 -- 172.21.15.155:0/3073830405 >> 172.21.15.155:0/3073830405 conn(0x7f6a380fda10 msgr2=0x7f6a380ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:20.040 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.665+0000 7f6a40168700 1 -- 172.21.15.155:0/3073830405 shutdown_connections 2023-12-16T05:50:20.041 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:19.665+0000 7f6a40168700 1 -- 172.21.15.155:0/3073830405 wait complete. 2023-12-16T05:50:20.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:19 smithi155 ceph-mon[112451]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:50:20.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:19 smithi155 ceph-mon[112451]: Saving service alertmanager spec with placement count:1 2023-12-16T05:50:20.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:19 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/3073830405' entity='client.admin' 2023-12-16T05:50:20.919 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.358+0000 7f763d04e700 1 Processor -- start 2023-12-16T05:50:20.920 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.358+0000 7f763d04e700 1 -- start start 2023-12-16T05:50:20.920 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.359+0000 7f763d04e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7638102780 0x7f7638102b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:20.920 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.359+0000 7f763d04e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76381030d0 con 0x7f7638102780 2023-12-16T05:50:20.920 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.359+0000 7f7636d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7638102780 0x7f7638102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:20.920 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.359+0000 7f7636d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7638102780 0x7f7638102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59596/0 (socket says 172.21.15.155:59596) 2023-12-16T05:50:20.920 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.359+0000 7f7636d9d700 1 -- 172.21.15.155:0/437670665 learned_addr learned my addr 172.21.15.155:0/437670665 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:20.920 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.359+0000 7f7636d9d700 1 -- 172.21.15.155:0/437670665 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7638103210 con 0x7f7638102780 2023-12-16T05:50:20.920 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.359+0000 7f7636d9d700 1 --2- 172.21.15.155:0/437670665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7638102780 0x7f7638102b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f762c0098e0 tx=0x7f762c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d35e56b86291d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:20.920 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.359+0000 7f7635d9b700 1 -- 172.21.15.155:0/437670665 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f762c00b860 con 0x7f7638102780 2023-12-16T05:50:20.920 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.359+0000 7f7635d9b700 1 -- 172.21.15.155:0/437670665 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f762c00be70 con 0x7f7638102780 2023-12-16T05:50:20.920 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.359+0000 7f7635d9b700 1 -- 172.21.15.155:0/437670665 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f762c010380 con 0x7f7638102780 2023-12-16T05:50:20.920 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.360+0000 7f763d04e700 1 -- 172.21.15.155:0/437670665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7638102780 msgr2=0x7f7638102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:20.920 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.360+0000 7f763d04e700 1 --2- 172.21.15.155:0/437670665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7638102780 0x7f7638102b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f762c0098e0 tx=0x7f762c009250 comp rx=0 tx=0).stop 2023-12-16T05:50:20.920 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.360+0000 7f763d04e700 1 -- 172.21.15.155:0/437670665 shutdown_connections 2023-12-16T05:50:20.921 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.360+0000 7f763d04e700 1 --2- 172.21.15.155:0/437670665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7638102780 0x7f7638102b90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:20.921 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.360+0000 7f763d04e700 1 -- 172.21.15.155:0/437670665 >> 172.21.15.155:0/437670665 conn(0x7f76380fc0b0 msgr2=0x7f76380fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:20.921 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.360+0000 7f763d04e700 1 -- 172.21.15.155:0/437670665 shutdown_connections 2023-12-16T05:50:20.921 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.360+0000 7f763d04e700 1 -- 172.21.15.155:0/437670665 wait complete. 2023-12-16T05:50:20.921 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.361+0000 7f763d04e700 1 Processor -- start 2023-12-16T05:50:20.921 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.361+0000 7f763d04e700 1 -- start start 2023-12-16T05:50:20.921 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.361+0000 7f763d04e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7638102780 0x7f7638113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:20.921 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.361+0000 7f763d04e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7638101010 con 0x7f7638102780 2023-12-16T05:50:20.921 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.361+0000 7f7636d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7638102780 0x7f7638113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:20.921 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.361+0000 7f7636d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7638102780 0x7f7638113ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59610/0 (socket says 172.21.15.155:59610) 2023-12-16T05:50:20.921 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.361+0000 7f7636d9d700 1 -- 172.21.15.155:0/4279543569 learned_addr learned my addr 172.21.15.155:0/4279543569 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:20.921 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.361+0000 7f7636d9d700 1 -- 172.21.15.155:0/4279543569 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c0094f0 con 0x7f7638102780 2023-12-16T05:50:20.921 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.361+0000 7f7636d9d700 1 --2- 172.21.15.155:0/4279543569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7638102780 0x7f7638113ec0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f762c006d40 tx=0x7f762c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:20.921 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.361+0000 7f761f7fe700 1 -- 172.21.15.155:0/4279543569 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f762c010960 con 0x7f7638102780 2023-12-16T05:50:20.922 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.361+0000 7f761f7fe700 1 -- 172.21.15.155:0/4279543569 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f762c01a430 con 0x7f7638102780 2023-12-16T05:50:20.922 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.361+0000 7f763d04e700 1 -- 172.21.15.155:0/4279543569 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7638101210 con 0x7f7638102780 2023-12-16T05:50:20.922 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.361+0000 7f761f7fe700 1 -- 172.21.15.155:0/4279543569 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f762c0245b0 con 0x7f7638102780 2023-12-16T05:50:20.922 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.361+0000 7f763d04e700 1 -- 172.21.15.155:0/4279543569 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76381145c0 con 0x7f7638102780 2023-12-16T05:50:20.922 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.362+0000 7f761f7fe700 1 -- 172.21.15.155:0/4279543569 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f762c02d3f0 con 0x7f7638102780 2023-12-16T05:50:20.922 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.362+0000 7f763d04e700 1 -- 172.21.15.155:0/4279543569 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763810a0b0 con 0x7f7638102780 2023-12-16T05:50:20.922 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.362+0000 7f761f7fe700 1 --2- 172.21.15.155:0/4279543569 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f76200365f0 0x7f7620038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:20.922 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.362+0000 7f761f7fe700 1 -- 172.21.15.155:0/4279543569 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f762c04a2a0 con 0x7f7638102780 2023-12-16T05:50:20.922 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.363+0000 7f763659c700 1 --2- 172.21.15.155:0/4279543569 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f76200365f0 0x7f7620038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:20.922 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.363+0000 7f763659c700 1 --2- 172.21.15.155:0/4279543569 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f76200365f0 0x7f7620038aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7628009990 tx=0x7f7628006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:20.922 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.367+0000 7f761f7fe700 1 -- 172.21.15.155:0/4279543569 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f762c018b00 con 0x7f7638102780 2023-12-16T05:50:20.922 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.552+0000 7f763d04e700 1 -- 172.21.15.155:0/4279543569 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f763804bb80 con 0x7f7638102780 2023-12-16T05:50:20.922 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.555+0000 7f761f7fe700 1 -- 172.21.15.155:0/4279543569 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f762c018b00 con 0x7f7638102780 2023-12-16T05:50:20.922 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.557+0000 7f763d04e700 1 -- 172.21.15.155:0/4279543569 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f76200365f0 msgr2=0x7f7620038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:20.922 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.557+0000 7f763d04e700 1 --2- 172.21.15.155:0/4279543569 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f76200365f0 0x7f7620038aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7628009990 tx=0x7f7628006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:20.923 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.557+0000 7f763d04e700 1 -- 172.21.15.155:0/4279543569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7638102780 msgr2=0x7f7638113ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:20.923 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.557+0000 7f763d04e700 1 --2- 172.21.15.155:0/4279543569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7638102780 0x7f7638113ec0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f762c006d40 tx=0x7f762c009250 comp rx=0 tx=0).stop 2023-12-16T05:50:20.923 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.557+0000 7f763d04e700 1 -- 172.21.15.155:0/4279543569 shutdown_connections 2023-12-16T05:50:20.923 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.557+0000 7f763d04e700 1 --2- 172.21.15.155:0/4279543569 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f76200365f0 0x7f7620038aa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:20.923 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.557+0000 7f763d04e700 1 --2- 172.21.15.155:0/4279543569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7638102780 0x7f7638113ec0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:20.923 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.557+0000 7f763d04e700 1 -- 172.21.15.155:0/4279543569 >> 172.21.15.155:0/4279543569 conn(0x7f76380fc0b0 msgr2=0x7f76380fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:20.923 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.558+0000 7f763d04e700 1 -- 172.21.15.155:0/4279543569 shutdown_connections 2023-12-16T05:50:20.923 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:20.558+0000 7f763d04e700 1 -- 172.21.15.155:0/4279543569 wait complete. 2023-12-16T05:50:20.923 INFO:teuthology.orchestra.run.smithi155.stdout:Enabling the dashboard module... 2023-12-16T05:50:21.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:21 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/4279543569' entity='client.admin' 2023-12-16T05:50:21.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:21 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/3706446092' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-12-16T05:50:21.947 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.302+0000 7f1cbfc4a700 1 Processor -- start 2023-12-16T05:50:21.953 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.302+0000 7f1cbfc4a700 1 -- start start 2023-12-16T05:50:21.953 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.302+0000 7f1cbfc4a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cb8076c60 0x7f1cb8104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:21.953 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.302+0000 7f1cbfc4a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb81053d0 con 0x7f1cb8076c60 2023-12-16T05:50:21.953 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.303+0000 7f1cbd9e6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cb8076c60 0x7f1cb8104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:21.953 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.303+0000 7f1cbd9e6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cb8076c60 0x7f1cb8104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59612/0 (socket says 172.21.15.155:59612) 2023-12-16T05:50:21.953 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.303+0000 7f1cbd9e6700 1 -- 172.21.15.155:0/921760137 learned_addr learned my addr 172.21.15.155:0/921760137 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:21.953 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.303+0000 7f1cbd9e6700 1 -- 172.21.15.155:0/921760137 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb8105510 con 0x7f1cb8076c60 2023-12-16T05:50:21.953 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.303+0000 7f1cbd9e6700 1 --2- 172.21.15.155:0/921760137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cb8076c60 0x7f1cb8104e90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0098e0 tx=0x7f1cac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85bed45d5003288 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:21.953 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.303+0000 7f1cbc9e4700 1 -- 172.21.15.155:0/921760137 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1cac00b860 con 0x7f1cb8076c60 2023-12-16T05:50:21.953 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.303+0000 7f1cbc9e4700 1 -- 172.21.15.155:0/921760137 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1cac00be70 con 0x7f1cb8076c60 2023-12-16T05:50:21.953 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.303+0000 7f1cbc9e4700 1 -- 172.21.15.155:0/921760137 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1cac010380 con 0x7f1cb8076c60 2023-12-16T05:50:21.953 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.304+0000 7f1cbfc4a700 1 -- 172.21.15.155:0/921760137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cb8076c60 msgr2=0x7f1cb8104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:21.953 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.304+0000 7f1cbfc4a700 1 --2- 172.21.15.155:0/921760137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cb8076c60 0x7f1cb8104e90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0098e0 tx=0x7f1cac009250 comp rx=0 tx=0).stop 2023-12-16T05:50:21.953 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.304+0000 7f1cbfc4a700 1 -- 172.21.15.155:0/921760137 shutdown_connections 2023-12-16T05:50:21.954 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.304+0000 7f1cbfc4a700 1 --2- 172.21.15.155:0/921760137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cb8076c60 0x7f1cb8104e90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:21.954 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.304+0000 7f1cbfc4a700 1 -- 172.21.15.155:0/921760137 >> 172.21.15.155:0/921760137 conn(0x7f1cb80fc980 msgr2=0x7f1cb80fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:21.954 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.304+0000 7f1cbfc4a700 1 -- 172.21.15.155:0/921760137 shutdown_connections 2023-12-16T05:50:21.954 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.304+0000 7f1cbfc4a700 1 -- 172.21.15.155:0/921760137 wait complete. 2023-12-16T05:50:21.954 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.304+0000 7f1cbfc4a700 1 Processor -- start 2023-12-16T05:50:21.954 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.305+0000 7f1cbfc4a700 1 -- start start 2023-12-16T05:50:21.954 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.305+0000 7f1cbfc4a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cb8076c60 0x7f1cb8111160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:21.954 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.305+0000 7f1cbfc4a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb81116a0 con 0x7f1cb8076c60 2023-12-16T05:50:21.954 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.305+0000 7f1cbd9e6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cb8076c60 0x7f1cb8111160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:21.954 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.305+0000 7f1cbd9e6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cb8076c60 0x7f1cb8111160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59618/0 (socket says 172.21.15.155:59618) 2023-12-16T05:50:21.954 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.305+0000 7f1cbd9e6700 1 -- 172.21.15.155:0/3706446092 learned_addr learned my addr 172.21.15.155:0/3706446092 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:21.954 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.305+0000 7f1cbd9e6700 1 -- 172.21.15.155:0/3706446092 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac0094f0 con 0x7f1cb8076c60 2023-12-16T05:50:21.954 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.305+0000 7f1cbd9e6700 1 --2- 172.21.15.155:0/3706446092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cb8076c60 0x7f1cb8111160 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1cac006d40 tx=0x7f1cac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:21.954 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.305+0000 7f1caa7fc700 1 -- 172.21.15.155:0/3706446092 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1cac010960 con 0x7f1cb8076c60 2023-12-16T05:50:21.954 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.305+0000 7f1caa7fc700 1 -- 172.21.15.155:0/3706446092 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1cac01a430 con 0x7f1cb8076c60 2023-12-16T05:50:21.955 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.305+0000 7f1cbfc4a700 1 -- 172.21.15.155:0/3706446092 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb81118a0 con 0x7f1cb8076c60 2023-12-16T05:50:21.955 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.305+0000 7f1caa7fc700 1 -- 172.21.15.155:0/3706446092 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1cac0245b0 con 0x7f1cb8076c60 2023-12-16T05:50:21.955 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.305+0000 7f1cbfc4a700 1 -- 172.21.15.155:0/3706446092 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb8111cb0 con 0x7f1cb8076c60 2023-12-16T05:50:21.955 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.306+0000 7f1caa7fc700 1 -- 172.21.15.155:0/3706446092 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f1cac02d3f0 con 0x7f1cb8076c60 2023-12-16T05:50:21.955 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.306+0000 7f1cbfc4a700 1 -- 172.21.15.155:0/3706446092 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb804bb80 con 0x7f1cb8076c60 2023-12-16T05:50:21.955 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.307+0000 7f1caa7fc700 1 --2- 172.21.15.155:0/3706446092 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f1ca4036640 0x7f1ca4038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:21.955 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.307+0000 7f1caa7fc700 1 -- 172.21.15.155:0/3706446092 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1cac04a220 con 0x7f1cb8076c60 2023-12-16T05:50:21.955 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.307+0000 7f1cbd1e5700 1 --2- 172.21.15.155:0/3706446092 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f1ca4036640 0x7f1ca4038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:21.955 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.307+0000 7f1cbd1e5700 1 --2- 172.21.15.155:0/3706446092 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f1ca4036640 0x7f1ca4038af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4009990 tx=0x7f1cb4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:21.955 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.311+0000 7f1caa7fc700 1 -- 172.21.15.155:0/3706446092 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1cac018d20 con 0x7f1cb8076c60 2023-12-16T05:50:21.955 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.546+0000 7f1cbfc4a700 1 -- 172.21.15.155:0/3706446092 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f1cb810af70 con 0x7f1cb8076c60 2023-12-16T05:50:21.955 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.555+0000 7f1caa7fc700 1 -- 172.21.15.155:0/3706446092 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f1cac01a9f0 con 0x7f1cb8076c60 2023-12-16T05:50:21.955 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.556+0000 7f1caa7fc700 1 -- 172.21.15.155:0/3706446092 <== mon.0 v2:172.21.15.155:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f1cac007440 con 0x7f1cb8076c60 2023-12-16T05:50:21.955 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.559+0000 7f1cbfc4a700 1 -- 172.21.15.155:0/3706446092 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f1ca4036640 msgr2=0x7f1ca4038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:21.955 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.559+0000 7f1cbfc4a700 1 --2- 172.21.15.155:0/3706446092 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f1ca4036640 0x7f1ca4038af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4009990 tx=0x7f1cb4006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:21.956 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.559+0000 7f1cbfc4a700 1 -- 172.21.15.155:0/3706446092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cb8076c60 msgr2=0x7f1cb8111160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:21.956 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.559+0000 7f1cbfc4a700 1 --2- 172.21.15.155:0/3706446092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cb8076c60 0x7f1cb8111160 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1cac006d40 tx=0x7f1cac009250 comp rx=0 tx=0).stop 2023-12-16T05:50:21.956 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.559+0000 7f1cbfc4a700 1 -- 172.21.15.155:0/3706446092 shutdown_connections 2023-12-16T05:50:21.956 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.559+0000 7f1cbfc4a700 1 --2- 172.21.15.155:0/3706446092 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f1ca4036640 0x7f1ca4038af0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:21.956 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.560+0000 7f1cbfc4a700 1 --2- 172.21.15.155:0/3706446092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cb8076c60 0x7f1cb8111160 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:21.956 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.560+0000 7f1cbfc4a700 1 -- 172.21.15.155:0/3706446092 >> 172.21.15.155:0/3706446092 conn(0x7f1cb80fc980 msgr2=0x7f1cb80fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:21.956 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.560+0000 7f1cbfc4a700 1 -- 172.21.15.155:0/3706446092 shutdown_connections 2023-12-16T05:50:21.956 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:21.560+0000 7f1cbfc4a700 1 -- 172.21.15.155:0/3706446092 wait complete. 2023-12-16T05:50:22.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:22 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/3706446092' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-12-16T05:50:22.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:22 smithi155 ceph-mon[112451]: mgrmap e9: smithi155.maowdn(active, since 17s) 2023-12-16T05:50:22.945 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout { 2023-12-16T05:50:22.946 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-12-16T05:50:22.946 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-16T05:50:22.946 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "active_name": "smithi155.maowdn", 2023-12-16T05:50:22.946 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-16T05:50:22.946 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout } 2023-12-16T05:50:22.946 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.331+0000 7efdd7c91700 1 Processor -- start 2023-12-16T05:50:22.946 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.331+0000 7efdd7c91700 1 -- start start 2023-12-16T05:50:22.946 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.332+0000 7efdd7c91700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd01011d0 0x7efdd01015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:22.946 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.332+0000 7efdd7c91700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd0101b20 con 0x7efdd01011d0 2023-12-16T05:50:22.946 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.332+0000 7efdd5a2d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd01011d0 0x7efdd01015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:22.946 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.332+0000 7efdd5a2d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd01011d0 0x7efdd01015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59648/0 (socket says 172.21.15.155:59648) 2023-12-16T05:50:22.946 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.332+0000 7efdd5a2d700 1 -- 172.21.15.155:0/3256816683 learned_addr learned my addr 172.21.15.155:0/3256816683 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:22.946 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.332+0000 7efdd5a2d700 1 -- 172.21.15.155:0/3256816683 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd0101c60 con 0x7efdd01011d0 2023-12-16T05:50:22.946 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.332+0000 7efdd5a2d700 1 --2- 172.21.15.155:0/3256816683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd01011d0 0x7efdd01015e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00bb80 tx=0x7efdcc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710a2ae0e0e3443c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:22.947 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.332+0000 7efdd4a2b700 1 -- 172.21.15.155:0/3256816683 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdcc00dd00 con 0x7efdd01011d0 2023-12-16T05:50:22.947 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.332+0000 7efdd4a2b700 1 -- 172.21.15.155:0/3256816683 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efdcc00de60 con 0x7efdd01011d0 2023-12-16T05:50:22.947 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.332+0000 7efdd4a2b700 1 -- 172.21.15.155:0/3256816683 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdcc0188d0 con 0x7efdd01011d0 2023-12-16T05:50:22.947 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.333+0000 7efdd7c91700 1 -- 172.21.15.155:0/3256816683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd01011d0 msgr2=0x7efdd01015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:22.947 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.333+0000 7efdd7c91700 1 --2- 172.21.15.155:0/3256816683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd01011d0 0x7efdd01015e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00bb80 tx=0x7efdcc00b4f0 comp rx=0 tx=0).stop 2023-12-16T05:50:22.947 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.333+0000 7efdd7c91700 1 -- 172.21.15.155:0/3256816683 shutdown_connections 2023-12-16T05:50:22.947 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.333+0000 7efdd7c91700 1 --2- 172.21.15.155:0/3256816683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd01011d0 0x7efdd01015e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:22.947 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.333+0000 7efdd7c91700 1 -- 172.21.15.155:0/3256816683 >> 172.21.15.155:0/3256816683 conn(0x7efdd00fc970 msgr2=0x7efdd00fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:22.947 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.333+0000 7efdd7c91700 1 -- 172.21.15.155:0/3256816683 shutdown_connections 2023-12-16T05:50:22.947 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.333+0000 7efdd7c91700 1 -- 172.21.15.155:0/3256816683 wait complete. 2023-12-16T05:50:22.947 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.334+0000 7efdd7c91700 1 Processor -- start 2023-12-16T05:50:22.947 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.334+0000 7efdd7c91700 1 -- start start 2023-12-16T05:50:22.947 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.334+0000 7efdd7c91700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd01011d0 0x7efdd010ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:22.947 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.334+0000 7efdd7c91700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd010f4a0 con 0x7efdd01011d0 2023-12-16T05:50:22.947 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.334+0000 7efdd5a2d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd01011d0 0x7efdd010ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:22.948 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.334+0000 7efdd5a2d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd01011d0 0x7efdd010ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59650/0 (socket says 172.21.15.155:59650) 2023-12-16T05:50:22.948 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.334+0000 7efdd5a2d700 1 -- 172.21.15.155:0/4292152471 learned_addr learned my addr 172.21.15.155:0/4292152471 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:22.948 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.335+0000 7efdd5a2d700 1 -- 172.21.15.155:0/4292152471 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc00b790 con 0x7efdd01011d0 2023-12-16T05:50:22.948 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.335+0000 7efdd5a2d700 1 --2- 172.21.15.155:0/4292152471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd01011d0 0x7efdd010ef60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0184f0 tx=0x7efdcc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:22.948 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.335+0000 7efdc67fc700 1 -- 172.21.15.155:0/4292152471 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdcc010bd0 con 0x7efdd01011d0 2023-12-16T05:50:22.948 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.335+0000 7efdc67fc700 1 -- 172.21.15.155:0/4292152471 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efdcc01d050 con 0x7efdd01011d0 2023-12-16T05:50:22.948 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.335+0000 7efdc67fc700 1 -- 172.21.15.155:0/4292152471 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdcc022590 con 0x7efdd01011d0 2023-12-16T05:50:22.948 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.335+0000 7efdd7c91700 1 -- 172.21.15.155:0/4292152471 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd010f6a0 con 0x7efdd01011d0 2023-12-16T05:50:22.948 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.335+0000 7efdd7c91700 1 -- 172.21.15.155:0/4292152471 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd010fab0 con 0x7efdd01011d0 2023-12-16T05:50:22.948 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.336+0000 7efdc67fc700 1 -- 172.21.15.155:0/4292152471 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7efdcc023470 con 0x7efdd01011d0 2023-12-16T05:50:22.948 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.336+0000 7efdd7c91700 1 -- 172.21.15.155:0/4292152471 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd004bb80 con 0x7efdd01011d0 2023-12-16T05:50:22.948 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.336+0000 7efdc67fc700 1 --2- 172.21.15.155:0/4292152471 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7efdbc036690 0x7efdbc038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:22.948 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.336+0000 7efdc67fc700 1 -- 172.21.15.155:0/4292152471 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7efdcc014070 con 0x7efdd01011d0 2023-12-16T05:50:22.948 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.336+0000 7efdd522c700 1 -- 172.21.15.155:0/4292152471 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7efdbc036690 msgr2=0x7efdbc038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6800/1287353594 2023-12-16T05:50:22.949 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.336+0000 7efdd522c700 1 --2- 172.21.15.155:0/4292152471 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7efdbc036690 0x7efdbc038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T05:50:22.949 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.341+0000 7efdc67fc700 1 -- 172.21.15.155:0/4292152471 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7efdcc07ea00 con 0x7efdd01011d0 2023-12-16T05:50:22.949 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.537+0000 7efdd522c700 1 -- 172.21.15.155:0/4292152471 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7efdbc036690 msgr2=0x7efdbc038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6800/1287353594 2023-12-16T05:50:22.949 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.537+0000 7efdd522c700 1 --2- 172.21.15.155:0/4292152471 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7efdbc036690 0x7efdbc038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T05:50:22.949 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.585+0000 7efdd7c91700 1 -- 172.21.15.155:0/4292152471 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7efdd0108bc0 con 0x7efdd01011d0 2023-12-16T05:50:22.949 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.585+0000 7efdc67fc700 1 -- 172.21.15.155:0/4292152471 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7efdcc010d30 con 0x7efdd01011d0 2023-12-16T05:50:22.949 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.588+0000 7efdd7c91700 1 -- 172.21.15.155:0/4292152471 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7efdbc036690 msgr2=0x7efdbc038b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T05:50:22.949 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.588+0000 7efdd7c91700 1 --2- 172.21.15.155:0/4292152471 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7efdbc036690 0x7efdbc038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:22.949 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.588+0000 7efdd7c91700 1 -- 172.21.15.155:0/4292152471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd01011d0 msgr2=0x7efdd010ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:22.949 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.588+0000 7efdd7c91700 1 --2- 172.21.15.155:0/4292152471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd01011d0 0x7efdd010ef60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0184f0 tx=0x7efdcc00b4f0 comp rx=0 tx=0).stop 2023-12-16T05:50:22.949 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.588+0000 7efdd7c91700 1 -- 172.21.15.155:0/4292152471 shutdown_connections 2023-12-16T05:50:22.949 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.588+0000 7efdd7c91700 1 --2- 172.21.15.155:0/4292152471 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7efdbc036690 0x7efdbc038b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:22.949 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.588+0000 7efdd7c91700 1 --2- 172.21.15.155:0/4292152471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd01011d0 0x7efdd010ef60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:22.949 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.588+0000 7efdd7c91700 1 -- 172.21.15.155:0/4292152471 >> 172.21.15.155:0/4292152471 conn(0x7efdd00fc970 msgr2=0x7efdd0105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:22.949 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.588+0000 7efdd7c91700 1 -- 172.21.15.155:0/4292152471 shutdown_connections 2023-12-16T05:50:22.950 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:22.588+0000 7efdd7c91700 1 -- 172.21.15.155:0/4292152471 wait complete. 2023-12-16T05:50:22.950 INFO:teuthology.orchestra.run.smithi155.stdout:Waiting for the mgr to restart... 2023-12-16T05:50:22.950 INFO:teuthology.orchestra.run.smithi155.stdout:Waiting for mgr epoch 9... 2023-12-16T05:50:23.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:23 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/4292152471' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-16T05:50:28.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:28 smithi155 ceph-mon[112451]: Active manager daemon smithi155.maowdn restarted 2023-12-16T05:50:28.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:28 smithi155 ceph-mon[112451]: Activating manager daemon smithi155.maowdn 2023-12-16T05:50:28.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:28 smithi155 ceph-mon[112451]: osdmap e3: 0 total, 0 up, 0 in 2023-12-16T05:50:28.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:28 smithi155 ceph-mon[112451]: mgrmap e10: smithi155.maowdn(active, starting, since 0.00342118s) 2023-12-16T05:50:28.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:28 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:50:28.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:28 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr metadata", "who": "smithi155.maowdn", "id": "smithi155.maowdn"}]: dispatch 2023-12-16T05:50:28.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:28 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T05:50:28.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:28 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T05:50:28.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:28 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T05:50:28.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:28 smithi155 ceph-mon[112451]: Manager daemon smithi155.maowdn is now available 2023-12-16T05:50:28.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:28 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:50:28.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:28 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:50:29.374 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:29 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.maowdn/mirror_snapshot_schedule"}]: dispatch 2023-12-16T05:50:29.374 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:29 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.maowdn/trash_purge_schedule"}]: dispatch 2023-12-16T05:50:29.374 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:29 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:29.374 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:29 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:29.374 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:29 smithi155 ceph-mon[112451]: mgrmap e11: smithi155.maowdn(active, since 1.00781s) 2023-12-16T05:50:29.446 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout { 2023-12-16T05:50:29.446 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-12-16T05:50:29.446 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-16T05:50:29.446 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout } 2023-12-16T05:50:29.446 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.297+0000 7f8fd586a700 1 Processor -- start 2023-12-16T05:50:29.447 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.297+0000 7f8fd586a700 1 -- start start 2023-12-16T05:50:29.447 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.297+0000 7f8fd586a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd0070fc0 0x7f8fd0104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:29.447 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.297+0000 7f8fd586a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd0105420 con 0x7f8fd0070fc0 2023-12-16T05:50:29.447 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.298+0000 7f8fceffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd0070fc0 0x7f8fd0104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:29.447 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.298+0000 7f8fceffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd0070fc0 0x7f8fd0104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59662/0 (socket says 172.21.15.155:59662) 2023-12-16T05:50:29.447 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.298+0000 7f8fceffd700 1 -- 172.21.15.155:0/4126461876 learned_addr learned my addr 172.21.15.155:0/4126461876 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:29.447 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.298+0000 7f8fceffd700 1 -- 172.21.15.155:0/4126461876 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd0105560 con 0x7f8fd0070fc0 2023-12-16T05:50:29.447 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.298+0000 7f8fceffd700 1 --2- 172.21.15.155:0/4126461876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd0070fc0 0x7f8fd0104ee0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00098e0 tx=0x7f8fc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea88e09556812e6d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:29.447 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.298+0000 7f8fcdffb700 1 -- 172.21.15.155:0/4126461876 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8fc000b860 con 0x7f8fd0070fc0 2023-12-16T05:50:29.447 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.298+0000 7f8fcdffb700 1 -- 172.21.15.155:0/4126461876 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8fc000be70 con 0x7f8fd0070fc0 2023-12-16T05:50:29.447 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.298+0000 7f8fcdffb700 1 -- 172.21.15.155:0/4126461876 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8fc0010380 con 0x7f8fd0070fc0 2023-12-16T05:50:29.447 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.299+0000 7f8fd586a700 1 -- 172.21.15.155:0/4126461876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd0070fc0 msgr2=0x7f8fd0104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:29.447 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.299+0000 7f8fd586a700 1 --2- 172.21.15.155:0/4126461876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd0070fc0 0x7f8fd0104ee0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00098e0 tx=0x7f8fc0009250 comp rx=0 tx=0).stop 2023-12-16T05:50:29.447 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.299+0000 7f8fd586a700 1 -- 172.21.15.155:0/4126461876 shutdown_connections 2023-12-16T05:50:29.447 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.299+0000 7f8fd586a700 1 --2- 172.21.15.155:0/4126461876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd0070fc0 0x7f8fd0104ee0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:29.448 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.299+0000 7f8fd586a700 1 -- 172.21.15.155:0/4126461876 >> 172.21.15.155:0/4126461876 conn(0x7f8fd00fc970 msgr2=0x7f8fd00fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:29.448 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.299+0000 7f8fd586a700 1 -- 172.21.15.155:0/4126461876 shutdown_connections 2023-12-16T05:50:29.448 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.299+0000 7f8fd586a700 1 -- 172.21.15.155:0/4126461876 wait complete. 2023-12-16T05:50:29.448 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.300+0000 7f8fd586a700 1 Processor -- start 2023-12-16T05:50:29.448 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.300+0000 7f8fd586a700 1 -- start start 2023-12-16T05:50:29.448 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.300+0000 7f8fd586a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd0070fc0 0x7f8fd01111c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:29.448 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.300+0000 7f8fd586a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd0111700 con 0x7f8fd0070fc0 2023-12-16T05:50:29.448 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.300+0000 7f8fceffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd0070fc0 0x7f8fd01111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:29.448 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.300+0000 7f8fceffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd0070fc0 0x7f8fd01111c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59674/0 (socket says 172.21.15.155:59674) 2023-12-16T05:50:29.448 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.300+0000 7f8fceffd700 1 -- 172.21.15.155:0/2830555175 learned_addr learned my addr 172.21.15.155:0/2830555175 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:29.448 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.300+0000 7f8fceffd700 1 -- 172.21.15.155:0/2830555175 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc00094f0 con 0x7f8fd0070fc0 2023-12-16T05:50:29.448 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.300+0000 7f8fceffd700 1 --2- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd0070fc0 0x7f8fd01111c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00094c0 tx=0x7f8fc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:29.448 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.301+0000 7f8fb77fe700 1 -- 172.21.15.155:0/2830555175 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8fc0010850 con 0x7f8fd0070fc0 2023-12-16T05:50:29.448 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.301+0000 7f8fb77fe700 1 -- 172.21.15.155:0/2830555175 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8fc0010e60 con 0x7f8fd0070fc0 2023-12-16T05:50:29.448 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.301+0000 7f8fd586a700 1 -- 172.21.15.155:0/2830555175 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd0111900 con 0x7f8fd0070fc0 2023-12-16T05:50:29.449 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.301+0000 7f8fb77fe700 1 -- 172.21.15.155:0/2830555175 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8fc001a430 con 0x7f8fd0070fc0 2023-12-16T05:50:29.449 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.301+0000 7f8fd586a700 1 -- 172.21.15.155:0/2830555175 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd0111d10 con 0x7f8fd0070fc0 2023-12-16T05:50:29.449 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.301+0000 7f8fb77fe700 1 -- 172.21.15.155:0/2830555175 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f8fc001a6b0 con 0x7f8fd0070fc0 2023-12-16T05:50:29.449 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.302+0000 7f8fb77fe700 1 --2- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f8fb8036640 0x7f8fb8038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:29.449 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.302+0000 7f8fb77fe700 1 -- 172.21.15.155:0/2830555175 --> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8fb8039200 con 0x7f8fb8036640 2023-12-16T05:50:29.449 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.302+0000 7f8fb77fe700 1 -- 172.21.15.155:0/2830555175 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f8fc004a500 con 0x7f8fd0070fc0 2023-12-16T05:50:29.449 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.302+0000 7f8fce7fc700 1 -- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f8fb8036640 msgr2=0x7f8fb8038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6800/1287353594 2023-12-16T05:50:29.449 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.302+0000 7f8fce7fc700 1 --2- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f8fb8036640 0x7f8fb8038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T05:50:29.449 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.503+0000 7f8fce7fc700 1 -- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f8fb8036640 msgr2=0x7f8fb8038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6800/1287353594 2023-12-16T05:50:29.449 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.503+0000 7f8fce7fc700 1 --2- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f8fb8036640 0x7f8fb8038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T05:50:29.449 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.904+0000 7f8fce7fc700 1 -- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f8fb8036640 msgr2=0x7f8fb8038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6800/1287353594 2023-12-16T05:50:29.449 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:23.904+0000 7f8fce7fc700 1 --2- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f8fb8036640 0x7f8fb8038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T05:50:29.449 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:24.705+0000 7f8fce7fc700 1 -- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f8fb8036640 msgr2=0x7f8fb8038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6800/1287353594 2023-12-16T05:50:29.450 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:24.705+0000 7f8fce7fc700 1 --2- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f8fb8036640 0x7f8fb8038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T05:50:29.450 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:26.306+0000 7f8fce7fc700 1 -- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f8fb8036640 msgr2=0x7f8fb8038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6800/1287353594 2023-12-16T05:50:29.450 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:26.306+0000 7f8fce7fc700 1 --2- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f8fb8036640 0x7f8fb8038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-16T05:50:29.450 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:28.086+0000 7f8fb77fe700 1 -- 172.21.15.155:0/2830555175 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mgrmap(e 10) v1 ==== 43061+0+0 (secure 0 0 0) 0x7f8fc00247b0 con 0x7f8fd0070fc0 2023-12-16T05:50:29.450 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:28.086+0000 7f8fb77fe700 1 -- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f8fb8036640 msgr2=0x7f8fb8038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T05:50:29.450 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:28.086+0000 7f8fb77fe700 1 --2- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f8fb8036640 0x7f8fb8038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:29.450 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.090+0000 7f8fb77fe700 1 -- 172.21.15.155:0/2830555175 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7f8fc002ad00 con 0x7f8fd0070fc0 2023-12-16T05:50:29.450 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.090+0000 7f8fb77fe700 1 --2- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f8fb8039fb0 0x7f8fb803c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:29.450 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.090+0000 7f8fb77fe700 1 -- 172.21.15.155:0/2830555175 --> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8fb8039200 con 0x7f8fb8039fb0 2023-12-16T05:50:29.450 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.091+0000 7f8fce7fc700 1 --2- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f8fb8039fb0 0x7f8fb803c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:29.450 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.091+0000 7f8fce7fc700 1 --2- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f8fb8039fb0 0x7f8fb803c390 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40039d0 tx=0x7f8fc40092f0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:29.450 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.092+0000 7f8fb77fe700 1 -- 172.21.15.155:0/2830555175 <== mgr.14162 v2:172.21.15.155:6800/2821498015 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f8fb8039200 con 0x7f8fb8039fb0 2023-12-16T05:50:29.450 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.097+0000 7f8fd586a700 1 -- 172.21.15.155:0/2830555175 --> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f8fd004bb80 con 0x7f8fb8039fb0 2023-12-16T05:50:29.450 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.098+0000 7f8fb77fe700 1 -- 172.21.15.155:0/2830555175 <== mgr.14162 v2:172.21.15.155:6800/2821498015 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f8fd004bb80 con 0x7f8fb8039fb0 2023-12-16T05:50:29.450 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.098+0000 7f8fd586a700 1 -- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f8fb8039fb0 msgr2=0x7f8fb803c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:29.450 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.098+0000 7f8fd586a700 1 --2- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f8fb8039fb0 0x7f8fb803c390 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40039d0 tx=0x7f8fc40092f0 comp rx=0 tx=0).stop 2023-12-16T05:50:29.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.098+0000 7f8fd586a700 1 -- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd0070fc0 msgr2=0x7f8fd01111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:29.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.098+0000 7f8fd586a700 1 --2- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd0070fc0 0x7f8fd01111c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00094c0 tx=0x7f8fc0009250 comp rx=0 tx=0).stop 2023-12-16T05:50:29.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.098+0000 7f8fd586a700 1 -- 172.21.15.155:0/2830555175 shutdown_connections 2023-12-16T05:50:29.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.098+0000 7f8fd586a700 1 --2- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd0070fc0 0x7f8fd01111c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:29.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.098+0000 7f8fd586a700 1 --2- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f8fb8039fb0 0x7f8fb803c390 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:29.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.098+0000 7f8fd586a700 1 --2- 172.21.15.155:0/2830555175 >> [v2:172.21.15.155:6800/1287353594,v1:172.21.15.155:6801/1287353594] conn(0x7f8fb8036640 0x7f8fb8038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:29.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.098+0000 7f8fd586a700 1 -- 172.21.15.155:0/2830555175 >> 172.21.15.155:0/2830555175 conn(0x7f8fd00fc970 msgr2=0x7f8fd00fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:29.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.098+0000 7f8fd586a700 1 -- 172.21.15.155:0/2830555175 shutdown_connections 2023-12-16T05:50:29.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.098+0000 7f8fd586a700 1 -- 172.21.15.155:0/2830555175 wait complete. 2023-12-16T05:50:29.451 INFO:teuthology.orchestra.run.smithi155.stdout:mgr epoch 9 is available 2023-12-16T05:50:29.451 INFO:teuthology.orchestra.run.smithi155.stdout:Generating a dashboard self-signed certificate... 2023-12-16T05:50:30.418 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-12-16T05:50:30.418 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.849+0000 7fc4f9763700 1 Processor -- start 2023-12-16T05:50:30.418 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.849+0000 7fc4f9763700 1 -- start start 2023-12-16T05:50:30.418 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.849+0000 7fc4f9763700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f41011d0 0x7fc4f41015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:30.418 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.849+0000 7fc4f9763700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f4101b20 con 0x7fc4f41011d0 2023-12-16T05:50:30.418 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.849+0000 7fc4f2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f41011d0 0x7fc4f41015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:30.418 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.849+0000 7fc4f2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f41011d0 0x7fc4f41015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54288/0 (socket says 172.21.15.155:54288) 2023-12-16T05:50:30.418 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.849+0000 7fc4f2ffd700 1 -- 172.21.15.155:0/1825314683 learned_addr learned my addr 172.21.15.155:0/1825314683 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:30.418 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.849+0000 7fc4f2ffd700 1 -- 172.21.15.155:0/1825314683 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f4101c60 con 0x7fc4f41011d0 2023-12-16T05:50:30.418 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.850+0000 7fc4f2ffd700 1 --2- 172.21.15.155:0/1825314683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f41011d0 0x7fc4f41015e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400bb80 tx=0x7fc4e400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d830569b3a64592 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:30.418 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.850+0000 7fc4f1ffb700 1 -- 172.21.15.155:0/1825314683 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4e400dd00 con 0x7fc4f41011d0 2023-12-16T05:50:30.419 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.850+0000 7fc4f1ffb700 1 -- 172.21.15.155:0/1825314683 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc4e400de60 con 0x7fc4f41011d0 2023-12-16T05:50:30.419 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.850+0000 7fc4f1ffb700 1 -- 172.21.15.155:0/1825314683 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4e40188d0 con 0x7fc4f41011d0 2023-12-16T05:50:30.419 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.850+0000 7fc4f9763700 1 -- 172.21.15.155:0/1825314683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f41011d0 msgr2=0x7fc4f41015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:30.419 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.850+0000 7fc4f9763700 1 --2- 172.21.15.155:0/1825314683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f41011d0 0x7fc4f41015e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400bb80 tx=0x7fc4e400b4f0 comp rx=0 tx=0).stop 2023-12-16T05:50:30.419 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.850+0000 7fc4f9763700 1 -- 172.21.15.155:0/1825314683 shutdown_connections 2023-12-16T05:50:30.419 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.850+0000 7fc4f9763700 1 --2- 172.21.15.155:0/1825314683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f41011d0 0x7fc4f41015e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:30.419 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.850+0000 7fc4f9763700 1 -- 172.21.15.155:0/1825314683 >> 172.21.15.155:0/1825314683 conn(0x7fc4f40fc950 msgr2=0x7fc4f40fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:30.419 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.850+0000 7fc4f9763700 1 -- 172.21.15.155:0/1825314683 shutdown_connections 2023-12-16T05:50:30.419 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.850+0000 7fc4f9763700 1 -- 172.21.15.155:0/1825314683 wait complete. 2023-12-16T05:50:30.419 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.851+0000 7fc4f9763700 1 Processor -- start 2023-12-16T05:50:30.419 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.851+0000 7fc4f9763700 1 -- start start 2023-12-16T05:50:30.419 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.851+0000 7fc4f9763700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f41011d0 0x7fc4f410ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:30.419 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.851+0000 7fc4f9763700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f410f440 con 0x7fc4f41011d0 2023-12-16T05:50:30.419 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.852+0000 7fc4f2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f41011d0 0x7fc4f410ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:30.419 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.852+0000 7fc4f2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f41011d0 0x7fc4f410ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54294/0 (socket says 172.21.15.155:54294) 2023-12-16T05:50:30.420 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.852+0000 7fc4f2ffd700 1 -- 172.21.15.155:0/1908520204 learned_addr learned my addr 172.21.15.155:0/1908520204 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:30.420 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.852+0000 7fc4f2ffd700 1 -- 172.21.15.155:0/1908520204 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e400b790 con 0x7fc4f41011d0 2023-12-16T05:50:30.420 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.852+0000 7fc4f2ffd700 1 --2- 172.21.15.155:0/1908520204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f41011d0 0x7fc4f410ef00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40184f0 tx=0x7fc4e400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:30.420 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.852+0000 7fc4db7fe700 1 -- 172.21.15.155:0/1908520204 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4e4010b90 con 0x7fc4f41011d0 2023-12-16T05:50:30.420 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.852+0000 7fc4db7fe700 1 -- 172.21.15.155:0/1908520204 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc4e401d050 con 0x7fc4f41011d0 2023-12-16T05:50:30.420 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.852+0000 7fc4db7fe700 1 -- 172.21.15.155:0/1908520204 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4e4022590 con 0x7fc4f41011d0 2023-12-16T05:50:30.420 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.852+0000 7fc4f9763700 1 -- 172.21.15.155:0/1908520204 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f410f640 con 0x7fc4f41011d0 2023-12-16T05:50:30.420 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.852+0000 7fc4f9763700 1 -- 172.21.15.155:0/1908520204 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f410fa50 con 0x7fc4f41011d0 2023-12-16T05:50:30.420 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.853+0000 7fc4db7fe700 1 -- 172.21.15.155:0/1908520204 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7fc4e4022800 con 0x7fc4f41011d0 2023-12-16T05:50:30.420 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.853+0000 7fc4db7fe700 1 --2- 172.21.15.155:0/1908520204 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fc4dc036570 0x7fc4dc038a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:30.420 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.853+0000 7fc4db7fe700 1 -- 172.21.15.155:0/1908520204 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc4e4014070 con 0x7fc4f41011d0 2023-12-16T05:50:30.420 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.853+0000 7fc4f27fc700 1 --2- 172.21.15.155:0/1908520204 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fc4dc036570 0x7fc4dc038a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:30.421 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.853+0000 7fc4f9763700 1 -- 172.21.15.155:0/1908520204 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e00052e0 con 0x7fc4f41011d0 2023-12-16T05:50:30.421 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.854+0000 7fc4f27fc700 1 --2- 172.21.15.155:0/1908520204 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fc4dc036570 0x7fc4dc038a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8009990 tx=0x7fc4e8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:30.421 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:29.858+0000 7fc4db7fe700 1 -- 172.21.15.155:0/1908520204 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc4e4022b50 con 0x7fc4f41011d0 2023-12-16T05:50:30.421 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:30.058+0000 7fc4f9763700 1 -- 172.21.15.155:0/1908520204 --> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4e0000bf0 con 0x7fc4dc036570 2023-12-16T05:50:30.421 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:30.098+0000 7fc4db7fe700 1 -- 172.21.15.155:0/1908520204 <== mgr.14162 v2:172.21.15.155:6800/2821498015 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fc4e0000bf0 con 0x7fc4dc036570 2023-12-16T05:50:30.421 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:30.100+0000 7fc4f9763700 1 -- 172.21.15.155:0/1908520204 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fc4dc036570 msgr2=0x7fc4dc038a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:30.421 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:30.100+0000 7fc4f9763700 1 --2- 172.21.15.155:0/1908520204 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fc4dc036570 0x7fc4dc038a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8009990 tx=0x7fc4e8006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:30.421 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:30.100+0000 7fc4f9763700 1 -- 172.21.15.155:0/1908520204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f41011d0 msgr2=0x7fc4f410ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:30.421 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:30.100+0000 7fc4f9763700 1 --2- 172.21.15.155:0/1908520204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f41011d0 0x7fc4f410ef00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40184f0 tx=0x7fc4e400b4f0 comp rx=0 tx=0).stop 2023-12-16T05:50:30.421 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:30.100+0000 7fc4f9763700 1 -- 172.21.15.155:0/1908520204 shutdown_connections 2023-12-16T05:50:30.421 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:30.100+0000 7fc4f9763700 1 --2- 172.21.15.155:0/1908520204 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fc4dc036570 0x7fc4dc038a20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:30.421 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:30.100+0000 7fc4f9763700 1 --2- 172.21.15.155:0/1908520204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f41011d0 0x7fc4f410ef00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:30.421 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:30.100+0000 7fc4f9763700 1 -- 172.21.15.155:0/1908520204 >> 172.21.15.155:0/1908520204 conn(0x7fc4f40fc950 msgr2=0x7fc4f4105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:30.421 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:30.101+0000 7fc4f9763700 1 -- 172.21.15.155:0/1908520204 shutdown_connections 2023-12-16T05:50:30.422 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:30.101+0000 7fc4f9763700 1 -- 172.21.15.155:0/1908520204 wait complete. 2023-12-16T05:50:30.422 INFO:teuthology.orchestra.run.smithi155.stdout:Creating initial admin user... 2023-12-16T05:50:30.422 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:30 smithi155 ceph-mon[112451]: [16/Dec/2023:05:50:28] ENGINE Bus STARTING 2023-12-16T05:50:30.422 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:30 smithi155 ceph-mon[112451]: [16/Dec/2023:05:50:28] ENGINE Serving on https://172.21.15.155:7150 2023-12-16T05:50:30.422 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:30 smithi155 ceph-mon[112451]: [16/Dec/2023:05:50:28] ENGINE Bus STARTED 2023-12-16T05:50:30.422 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:30 smithi155 ceph-mon[112451]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-16T05:50:30.422 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:30 smithi155 ceph-mon[112451]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-16T05:50:30.422 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:30 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:30.422 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:30 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:30.422 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:30 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:31.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:31 smithi155 ceph-mon[112451]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:50:31.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:31 smithi155 ceph-mon[112451]: mgrmap e12: smithi155.maowdn(active, since 3s) 2023-12-16T05:50:32.625 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$q83uu4j2WZFNIRMDIou16eD0xf3DjRdwIQL9mVligA.qpadeeTEGG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1702705832, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-12-16T05:50:32.626 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.833+0000 7fe90ae35700 1 Processor -- start 2023-12-16T05:50:32.626 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.833+0000 7fe90ae35700 1 -- start start 2023-12-16T05:50:32.626 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.833+0000 7fe90ae35700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe904071000 0x7fe904104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:32.626 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.833+0000 7fe90ae35700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9041053e0 con 0x7fe904071000 2023-12-16T05:50:32.626 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.834+0000 7fe908bd1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe904071000 0x7fe904104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:32.626 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.834+0000 7fe908bd1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe904071000 0x7fe904104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54302/0 (socket says 172.21.15.155:54302) 2023-12-16T05:50:32.626 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.834+0000 7fe908bd1700 1 -- 172.21.15.155:0/679611196 learned_addr learned my addr 172.21.15.155:0/679611196 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:32.626 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.834+0000 7fe908bd1700 1 -- 172.21.15.155:0/679611196 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe904105520 con 0x7fe904071000 2023-12-16T05:50:32.626 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.834+0000 7fe908bd1700 1 --2- 172.21.15.155:0/679611196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe904071000 0x7fe904104ea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80098e0 tx=0x7fe8f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c94c67f04bb02c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:32.626 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.834+0000 7fe9037fe700 1 -- 172.21.15.155:0/679611196 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8f800b860 con 0x7fe904071000 2023-12-16T05:50:32.626 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.834+0000 7fe9037fe700 1 -- 172.21.15.155:0/679611196 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe8f800be70 con 0x7fe904071000 2023-12-16T05:50:32.626 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.834+0000 7fe9037fe700 1 -- 172.21.15.155:0/679611196 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8f8010380 con 0x7fe904071000 2023-12-16T05:50:32.626 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.835+0000 7fe90ae35700 1 -- 172.21.15.155:0/679611196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe904071000 msgr2=0x7fe904104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:32.626 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.835+0000 7fe90ae35700 1 --2- 172.21.15.155:0/679611196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe904071000 0x7fe904104ea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80098e0 tx=0x7fe8f8009250 comp rx=0 tx=0).stop 2023-12-16T05:50:32.627 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.835+0000 7fe90ae35700 1 -- 172.21.15.155:0/679611196 shutdown_connections 2023-12-16T05:50:32.627 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.835+0000 7fe90ae35700 1 --2- 172.21.15.155:0/679611196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe904071000 0x7fe904104ea0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:32.627 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.835+0000 7fe90ae35700 1 -- 172.21.15.155:0/679611196 >> 172.21.15.155:0/679611196 conn(0x7fe9040fc970 msgr2=0x7fe9040fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:32.627 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.835+0000 7fe90ae35700 1 -- 172.21.15.155:0/679611196 shutdown_connections 2023-12-16T05:50:32.627 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.835+0000 7fe90ae35700 1 -- 172.21.15.155:0/679611196 wait complete. 2023-12-16T05:50:32.627 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.835+0000 7fe90ae35700 1 Processor -- start 2023-12-16T05:50:32.627 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.835+0000 7fe90ae35700 1 -- start start 2023-12-16T05:50:32.627 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.836+0000 7fe90ae35700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe904071000 0x7fe904102920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:32.627 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.836+0000 7fe90ae35700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe904100da0 con 0x7fe904071000 2023-12-16T05:50:32.627 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.836+0000 7fe908bd1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe904071000 0x7fe904102920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:32.627 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.836+0000 7fe908bd1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe904071000 0x7fe904102920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54316/0 (socket says 172.21.15.155:54316) 2023-12-16T05:50:32.627 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.836+0000 7fe908bd1700 1 -- 172.21.15.155:0/3744060609 learned_addr learned my addr 172.21.15.155:0/3744060609 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:32.627 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.836+0000 7fe908bd1700 1 -- 172.21.15.155:0/3744060609 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f80094f0 con 0x7fe904071000 2023-12-16T05:50:32.627 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.836+0000 7fe908bd1700 1 --2- 172.21.15.155:0/3744060609 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe904071000 0x7fe904102920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8003080 tx=0x7fe8f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:32.627 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.837+0000 7fe9017fa700 1 -- 172.21.15.155:0/3744060609 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8f8010960 con 0x7fe904071000 2023-12-16T05:50:32.628 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.837+0000 7fe9017fa700 1 -- 172.21.15.155:0/3744060609 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe8f801a430 con 0x7fe904071000 2023-12-16T05:50:32.628 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.837+0000 7fe90ae35700 1 -- 172.21.15.155:0/3744060609 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe904100fa0 con 0x7fe904071000 2023-12-16T05:50:32.628 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.837+0000 7fe9017fa700 1 -- 172.21.15.155:0/3744060609 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8f80245b0 con 0x7fe904071000 2023-12-16T05:50:32.628 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.837+0000 7fe90ae35700 1 -- 172.21.15.155:0/3744060609 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9041013b0 con 0x7fe904071000 2023-12-16T05:50:32.628 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.837+0000 7fe9017fa700 1 -- 172.21.15.155:0/3744060609 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fe8f802d3f0 con 0x7fe904071000 2023-12-16T05:50:32.628 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.838+0000 7fe9017fa700 1 --2- 172.21.15.155:0/3744060609 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fe8f4036640 0x7fe8f4038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:32.628 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.838+0000 7fe9017fa700 1 -- 172.21.15.155:0/3744060609 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe8f804b210 con 0x7fe904071000 2023-12-16T05:50:32.628 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.838+0000 7fe903fff700 1 --2- 172.21.15.155:0/3744060609 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fe8f4036640 0x7fe8f4038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:32.628 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.838+0000 7fe90ae35700 1 -- 172.21.15.155:0/3744060609 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe90405f270 con 0x7fe904071000 2023-12-16T05:50:32.628 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.838+0000 7fe903fff700 1 --2- 172.21.15.155:0/3744060609 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fe8f4036640 0x7fe8f4038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0009990 tx=0x7fe8f0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:32.628 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:31.842+0000 7fe9017fa700 1 -- 172.21.15.155:0/3744060609 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe8f802b8e0 con 0x7fe904071000 2023-12-16T05:50:32.628 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.043+0000 7fe90ae35700 1 -- 172.21.15.155:0/3744060609 --> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fe90405f090 con 0x7fe8f4036640 2023-12-16T05:50:32.628 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.261+0000 7fe9017fa700 1 -- 172.21.15.155:0/3744060609 <== mgr.14162 v2:172.21.15.155:6800/2821498015 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fe90405f090 con 0x7fe8f4036640 2023-12-16T05:50:32.628 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.263+0000 7fe90ae35700 1 -- 172.21.15.155:0/3744060609 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fe8f4036640 msgr2=0x7fe8f4038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:32.629 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.263+0000 7fe90ae35700 1 --2- 172.21.15.155:0/3744060609 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fe8f4036640 0x7fe8f4038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0009990 tx=0x7fe8f0006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:32.629 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.263+0000 7fe90ae35700 1 -- 172.21.15.155:0/3744060609 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe904071000 msgr2=0x7fe904102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:32.629 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.263+0000 7fe90ae35700 1 --2- 172.21.15.155:0/3744060609 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe904071000 0x7fe904102920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8003080 tx=0x7fe8f8009250 comp rx=0 tx=0).stop 2023-12-16T05:50:32.629 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.263+0000 7fe90ae35700 1 -- 172.21.15.155:0/3744060609 shutdown_connections 2023-12-16T05:50:32.629 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.263+0000 7fe90ae35700 1 --2- 172.21.15.155:0/3744060609 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fe8f4036640 0x7fe8f4038af0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:32.629 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.263+0000 7fe90ae35700 1 --2- 172.21.15.155:0/3744060609 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe904071000 0x7fe904102920 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:32.629 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.263+0000 7fe90ae35700 1 -- 172.21.15.155:0/3744060609 >> 172.21.15.155:0/3744060609 conn(0x7fe9040fc970 msgr2=0x7fe9040fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:32.629 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.263+0000 7fe90ae35700 1 -- 172.21.15.155:0/3744060609 shutdown_connections 2023-12-16T05:50:32.629 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.264+0000 7fe90ae35700 1 -- 172.21.15.155:0/3744060609 wait complete. 2023-12-16T05:50:32.629 INFO:teuthology.orchestra.run.smithi155.stdout:Fetching dashboard port number... 2023-12-16T05:50:33.456 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:33 smithi155 ceph-mon[112451]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:50:33.456 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:33 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:33.457 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:33 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/967965689' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-12-16T05:50:33.517 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stdout 8443 2023-12-16T05:50:33.517 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.968+0000 7f2f3cf4f700 1 Processor -- start 2023-12-16T05:50:33.517 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.968+0000 7f2f3cf4f700 1 -- start start 2023-12-16T05:50:33.517 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.968+0000 7f2f3cf4f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f38071000 0x7f2f38104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:33.517 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.968+0000 7f2f3cf4f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f381053e0 con 0x7f2f38071000 2023-12-16T05:50:33.517 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.968+0000 7f2f3659c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f38071000 0x7f2f38104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:33.517 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.968+0000 7f2f3659c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f38071000 0x7f2f38104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54320/0 (socket says 172.21.15.155:54320) 2023-12-16T05:50:33.517 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.968+0000 7f2f3659c700 1 -- 172.21.15.155:0/1930452260 learned_addr learned my addr 172.21.15.155:0/1930452260 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:33.517 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.969+0000 7f2f3659c700 1 -- 172.21.15.155:0/1930452260 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f38105520 con 0x7f2f38071000 2023-12-16T05:50:33.517 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.969+0000 7f2f3659c700 1 --2- 172.21.15.155:0/1930452260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f38071000 0x7f2f38104ea0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2f280098e0 tx=0x7f2f28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a710390317dfbc6c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:33.517 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.969+0000 7f2f3559a700 1 -- 172.21.15.155:0/1930452260 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f2800b860 con 0x7f2f38071000 2023-12-16T05:50:33.517 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.969+0000 7f2f3559a700 1 -- 172.21.15.155:0/1930452260 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f2800be70 con 0x7f2f38071000 2023-12-16T05:50:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.969+0000 7f2f3559a700 1 -- 172.21.15.155:0/1930452260 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f28010380 con 0x7f2f38071000 2023-12-16T05:50:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.969+0000 7f2f3cf4f700 1 -- 172.21.15.155:0/1930452260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f38071000 msgr2=0x7f2f38104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.969+0000 7f2f3cf4f700 1 --2- 172.21.15.155:0/1930452260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f38071000 0x7f2f38104ea0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2f280098e0 tx=0x7f2f28009250 comp rx=0 tx=0).stop 2023-12-16T05:50:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.969+0000 7f2f3cf4f700 1 -- 172.21.15.155:0/1930452260 shutdown_connections 2023-12-16T05:50:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.970+0000 7f2f3cf4f700 1 --2- 172.21.15.155:0/1930452260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f38071000 0x7f2f38104ea0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.970+0000 7f2f3cf4f700 1 -- 172.21.15.155:0/1930452260 >> 172.21.15.155:0/1930452260 conn(0x7f2f380fc970 msgr2=0x7f2f380fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.970+0000 7f2f3cf4f700 1 -- 172.21.15.155:0/1930452260 shutdown_connections 2023-12-16T05:50:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.970+0000 7f2f3cf4f700 1 -- 172.21.15.155:0/1930452260 wait complete. 2023-12-16T05:50:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.970+0000 7f2f3cf4f700 1 Processor -- start 2023-12-16T05:50:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.970+0000 7f2f3cf4f700 1 -- start start 2023-12-16T05:50:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.970+0000 7f2f3cf4f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f38071000 0x7f2f381111c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.970+0000 7f2f3cf4f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f38111700 con 0x7f2f38071000 2023-12-16T05:50:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.970+0000 7f2f3659c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f38071000 0x7f2f381111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.970+0000 7f2f3659c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f38071000 0x7f2f381111c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54336/0 (socket says 172.21.15.155:54336) 2023-12-16T05:50:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.970+0000 7f2f3659c700 1 -- 172.21.15.155:0/967965689 learned_addr learned my addr 172.21.15.155:0/967965689 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.971+0000 7f2f3659c700 1 -- 172.21.15.155:0/967965689 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f280094f0 con 0x7f2f38071000 2023-12-16T05:50:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.971+0000 7f2f3659c700 1 --2- 172.21.15.155:0/967965689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f38071000 0x7f2f381111c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2f280094c0 tx=0x7f2f28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.971+0000 7f2f26ffd700 1 -- 172.21.15.155:0/967965689 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f28010850 con 0x7f2f38071000 2023-12-16T05:50:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.971+0000 7f2f26ffd700 1 -- 172.21.15.155:0/967965689 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f28010e60 con 0x7f2f38071000 2023-12-16T05:50:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.971+0000 7f2f3cf4f700 1 -- 172.21.15.155:0/967965689 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f38111900 con 0x7f2f38071000 2023-12-16T05:50:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.971+0000 7f2f26ffd700 1 -- 172.21.15.155:0/967965689 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f2801a430 con 0x7f2f38071000 2023-12-16T05:50:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.971+0000 7f2f3cf4f700 1 -- 172.21.15.155:0/967965689 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f38111d10 con 0x7f2f38071000 2023-12-16T05:50:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.972+0000 7f2f26ffd700 1 -- 172.21.15.155:0/967965689 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f2f280247b0 con 0x7f2f38071000 2023-12-16T05:50:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.972+0000 7f2f3cf4f700 1 -- 172.21.15.155:0/967965689 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3804bb80 con 0x7f2f38071000 2023-12-16T05:50:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.972+0000 7f2f26ffd700 1 --2- 172.21.15.155:0/967965689 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f2f20036690 0x7f2f20038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.972+0000 7f2f26ffd700 1 -- 172.21.15.155:0/967965689 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2f2804a4c0 con 0x7f2f38071000 2023-12-16T05:50:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.972+0000 7f2f35d9b700 1 --2- 172.21.15.155:0/967965689 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f2f20036690 0x7f2f20038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.973+0000 7f2f35d9b700 1 --2- 172.21.15.155:0/967965689 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f2f20036690 0x7f2f20038b40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c009990 tx=0x7f2f2c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:32.977+0000 7f2f26ffd700 1 -- 172.21.15.155:0/967965689 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2f28024440 con 0x7f2f38071000 2023-12-16T05:50:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.163+0000 7f2f3cf4f700 1 -- 172.21.15.155:0/967965689 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f2f38106300 con 0x7f2f38071000 2023-12-16T05:50:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.164+0000 7f2f26ffd700 1 -- 172.21.15.155:0/967965689 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f2f28022340 con 0x7f2f38071000 2023-12-16T05:50:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.166+0000 7f2f3cf4f700 1 -- 172.21.15.155:0/967965689 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f2f20036690 msgr2=0x7f2f20038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.166+0000 7f2f3cf4f700 1 --2- 172.21.15.155:0/967965689 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f2f20036690 0x7f2f20038b40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c009990 tx=0x7f2f2c006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.166+0000 7f2f3cf4f700 1 -- 172.21.15.155:0/967965689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f38071000 msgr2=0x7f2f381111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.166+0000 7f2f3cf4f700 1 --2- 172.21.15.155:0/967965689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f38071000 0x7f2f381111c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2f280094c0 tx=0x7f2f28009250 comp rx=0 tx=0).stop 2023-12-16T05:50:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.166+0000 7f2f3cf4f700 1 -- 172.21.15.155:0/967965689 shutdown_connections 2023-12-16T05:50:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.166+0000 7f2f3cf4f700 1 --2- 172.21.15.155:0/967965689 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f2f20036690 0x7f2f20038b40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.166+0000 7f2f3cf4f700 1 --2- 172.21.15.155:0/967965689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f38071000 0x7f2f381111c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.166+0000 7f2f3cf4f700 1 -- 172.21.15.155:0/967965689 >> 172.21.15.155:0/967965689 conn(0x7f2f380fc970 msgr2=0x7f2f380fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.166+0000 7f2f3cf4f700 1 -- 172.21.15.155:0/967965689 shutdown_connections 2023-12-16T05:50:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.166+0000 7f2f3cf4f700 1 -- 172.21.15.155:0/967965689 wait complete. 2023-12-16T05:50:33.523 INFO:teuthology.orchestra.run.smithi155.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-16T05:50:33.523 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stdout disabled 2023-12-16T05:50:33.530 INFO:teuthology.orchestra.run.smithi155.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-16T05:50:33.530 INFO:teuthology.orchestra.run.smithi155.stdout:systemctl: stdout inactive 2023-12-16T05:50:33.530 INFO:teuthology.orchestra.run.smithi155.stdout:firewalld.service is not enabled 2023-12-16T05:50:33.531 INFO:teuthology.orchestra.run.smithi155.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-12-16T05:50:33.532 INFO:teuthology.orchestra.run.smithi155.stdout:Ceph Dashboard is now available at: 2023-12-16T05:50:33.533 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:50:33.533 INFO:teuthology.orchestra.run.smithi155.stdout: URL: https://smithi155.front.sepia.ceph.com:8443/ 2023-12-16T05:50:33.533 INFO:teuthology.orchestra.run.smithi155.stdout: User: admin 2023-12-16T05:50:33.533 INFO:teuthology.orchestra.run.smithi155.stdout: Password: qxh42ihefx 2023-12-16T05:50:33.533 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:50:33.533 INFO:teuthology.orchestra.run.smithi155.stdout:Saving cluster configuration to /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config directory 2023-12-16T05:50:33.533 INFO:teuthology.orchestra.run.smithi155.stdout:Enabling autotune for osd_memory_target 2023-12-16T05:50:34.450 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.886+0000 7f8e4eab5700 1 Processor -- start 2023-12-16T05:50:34.450 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.886+0000 7f8e4eab5700 1 -- start start 2023-12-16T05:50:34.450 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.886+0000 7f8e4eab5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e48070fc0 0x7f8e48104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:34.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.886+0000 7f8e4eab5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e48105420 con 0x7f8e48070fc0 2023-12-16T05:50:34.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.886+0000 7f8e4c851700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e48070fc0 0x7f8e48104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:34.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.886+0000 7f8e4c851700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e48070fc0 0x7f8e48104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54340/0 (socket says 172.21.15.155:54340) 2023-12-16T05:50:34.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.886+0000 7f8e4c851700 1 -- 172.21.15.155:0/2863923259 learned_addr learned my addr 172.21.15.155:0/2863923259 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:34.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.887+0000 7f8e4c851700 1 -- 172.21.15.155:0/2863923259 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e48105560 con 0x7f8e48070fc0 2023-12-16T05:50:34.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.887+0000 7f8e4c851700 1 --2- 172.21.15.155:0/2863923259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e48070fc0 0x7f8e48104ee0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c0098e0 tx=0x7f8e3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f74c4cf7878cd0d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:34.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.887+0000 7f8e477fe700 1 -- 172.21.15.155:0/2863923259 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e3c00b860 con 0x7f8e48070fc0 2023-12-16T05:50:34.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.887+0000 7f8e477fe700 1 -- 172.21.15.155:0/2863923259 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e3c00be70 con 0x7f8e48070fc0 2023-12-16T05:50:34.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.887+0000 7f8e477fe700 1 -- 172.21.15.155:0/2863923259 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e3c010380 con 0x7f8e48070fc0 2023-12-16T05:50:34.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.887+0000 7f8e4eab5700 1 -- 172.21.15.155:0/2863923259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e48070fc0 msgr2=0x7f8e48104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:34.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.887+0000 7f8e4eab5700 1 --2- 172.21.15.155:0/2863923259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e48070fc0 0x7f8e48104ee0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c0098e0 tx=0x7f8e3c009250 comp rx=0 tx=0).stop 2023-12-16T05:50:34.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.888+0000 7f8e4eab5700 1 -- 172.21.15.155:0/2863923259 shutdown_connections 2023-12-16T05:50:34.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.888+0000 7f8e4eab5700 1 --2- 172.21.15.155:0/2863923259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e48070fc0 0x7f8e48104ee0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:34.451 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.888+0000 7f8e4eab5700 1 -- 172.21.15.155:0/2863923259 >> 172.21.15.155:0/2863923259 conn(0x7f8e480fc970 msgr2=0x7f8e480fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:34.452 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.888+0000 7f8e4eab5700 1 -- 172.21.15.155:0/2863923259 shutdown_connections 2023-12-16T05:50:34.452 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.888+0000 7f8e4eab5700 1 -- 172.21.15.155:0/2863923259 wait complete. 2023-12-16T05:50:34.452 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.888+0000 7f8e4eab5700 1 Processor -- start 2023-12-16T05:50:34.452 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.888+0000 7f8e4eab5700 1 -- start start 2023-12-16T05:50:34.452 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.889+0000 7f8e4eab5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e48070fc0 0x7f8e481111c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:34.452 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.889+0000 7f8e4eab5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e48111700 con 0x7f8e48070fc0 2023-12-16T05:50:34.452 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.889+0000 7f8e4c851700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e48070fc0 0x7f8e481111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:34.452 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.889+0000 7f8e4c851700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e48070fc0 0x7f8e481111c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54352/0 (socket says 172.21.15.155:54352) 2023-12-16T05:50:34.452 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.889+0000 7f8e4c851700 1 -- 172.21.15.155:0/3846746080 learned_addr learned my addr 172.21.15.155:0/3846746080 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:34.452 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.889+0000 7f8e4c851700 1 -- 172.21.15.155:0/3846746080 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c0094f0 con 0x7f8e48070fc0 2023-12-16T05:50:34.452 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.889+0000 7f8e4c851700 1 --2- 172.21.15.155:0/3846746080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e48070fc0 0x7f8e481111c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c0094c0 tx=0x7f8e3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:34.452 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.889+0000 7f8e457fa700 1 -- 172.21.15.155:0/3846746080 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e3c010850 con 0x7f8e48070fc0 2023-12-16T05:50:34.452 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.889+0000 7f8e4eab5700 1 -- 172.21.15.155:0/3846746080 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e48111900 con 0x7f8e48070fc0 2023-12-16T05:50:34.452 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.889+0000 7f8e457fa700 1 -- 172.21.15.155:0/3846746080 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e3c010e60 con 0x7f8e48070fc0 2023-12-16T05:50:34.453 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.889+0000 7f8e457fa700 1 -- 172.21.15.155:0/3846746080 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e3c01a430 con 0x7f8e48070fc0 2023-12-16T05:50:34.453 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.889+0000 7f8e4eab5700 1 -- 172.21.15.155:0/3846746080 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e48111d10 con 0x7f8e48070fc0 2023-12-16T05:50:34.453 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.890+0000 7f8e4eab5700 1 -- 172.21.15.155:0/3846746080 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4804bb80 con 0x7f8e48070fc0 2023-12-16T05:50:34.453 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.891+0000 7f8e457fa700 1 -- 172.21.15.155:0/3846746080 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f8e3c0247b0 con 0x7f8e48070fc0 2023-12-16T05:50:34.453 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.891+0000 7f8e457fa700 1 --2- 172.21.15.155:0/3846746080 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f8e38036640 0x7f8e38038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:34.453 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.891+0000 7f8e457fa700 1 -- 172.21.15.155:0/3846746080 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8e3c04a540 con 0x7f8e48070fc0 2023-12-16T05:50:34.453 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.891+0000 7f8e47fff700 1 --2- 172.21.15.155:0/3846746080 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f8e38036640 0x7f8e38038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:34.453 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.891+0000 7f8e47fff700 1 --2- 172.21.15.155:0/3846746080 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f8e38036640 0x7f8e38038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009990 tx=0x7f8e34006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:34.453 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:33.895+0000 7f8e457fa700 1 -- 172.21.15.155:0/3846746080 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8e3c022520 con 0x7f8e48070fc0 2023-12-16T05:50:34.453 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.081+0000 7f8e4eab5700 1 -- 172.21.15.155:0/3846746080 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f8e481062e0 con 0x7f8e48070fc0 2023-12-16T05:50:34.453 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.082+0000 7f8e457fa700 1 -- 172.21.15.155:0/3846746080 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f8e3c022340 con 0x7f8e48070fc0 2023-12-16T05:50:34.453 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.084+0000 7f8e4eab5700 1 -- 172.21.15.155:0/3846746080 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f8e38036640 msgr2=0x7f8e38038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:34.453 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.084+0000 7f8e4eab5700 1 --2- 172.21.15.155:0/3846746080 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f8e38036640 0x7f8e38038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009990 tx=0x7f8e34006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:34.454 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.084+0000 7f8e4eab5700 1 -- 172.21.15.155:0/3846746080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e48070fc0 msgr2=0x7f8e481111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:34.454 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.084+0000 7f8e4eab5700 1 --2- 172.21.15.155:0/3846746080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e48070fc0 0x7f8e481111c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c0094c0 tx=0x7f8e3c009250 comp rx=0 tx=0).stop 2023-12-16T05:50:34.454 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.084+0000 7f8e4eab5700 1 -- 172.21.15.155:0/3846746080 shutdown_connections 2023-12-16T05:50:34.454 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.084+0000 7f8e4eab5700 1 --2- 172.21.15.155:0/3846746080 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f8e38036640 0x7f8e38038af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:34.454 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.084+0000 7f8e4eab5700 1 --2- 172.21.15.155:0/3846746080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e48070fc0 0x7f8e481111c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:34.454 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.084+0000 7f8e4eab5700 1 -- 172.21.15.155:0/3846746080 >> 172.21.15.155:0/3846746080 conn(0x7f8e480fc970 msgr2=0x7f8e480fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:34.454 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.084+0000 7f8e4eab5700 1 -- 172.21.15.155:0/3846746080 shutdown_connections 2023-12-16T05:50:34.454 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.084+0000 7f8e4eab5700 1 -- 172.21.15.155:0/3846746080 wait complete. 2023-12-16T05:50:35.467 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.801+0000 7f5f321e1700 1 Processor -- start 2023-12-16T05:50:35.467 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.802+0000 7f5f321e1700 1 -- start start 2023-12-16T05:50:35.467 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.802+0000 7f5f321e1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f2c070fc0 0x7f5f2c104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:35.467 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.802+0000 7f5f321e1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c105420 con 0x7f5f2c070fc0 2023-12-16T05:50:35.467 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.802+0000 7f5f2b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f2c070fc0 0x7f5f2c104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:35.467 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.802+0000 7f5f2b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f2c070fc0 0x7f5f2c104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54364/0 (socket says 172.21.15.155:54364) 2023-12-16T05:50:35.468 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.802+0000 7f5f2b7fe700 1 -- 172.21.15.155:0/4005860819 learned_addr learned my addr 172.21.15.155:0/4005860819 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:35.468 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.802+0000 7f5f2b7fe700 1 -- 172.21.15.155:0/4005860819 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c105560 con 0x7f5f2c070fc0 2023-12-16T05:50:35.468 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.802+0000 7f5f2b7fe700 1 --2- 172.21.15.155:0/4005860819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f2c070fc0 0x7f5f2c104ee0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5f200098e0 tx=0x7f5f20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4fa165d89bfba7a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:35.468 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.802+0000 7f5f2a7fc700 1 -- 172.21.15.155:0/4005860819 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f2000b860 con 0x7f5f2c070fc0 2023-12-16T05:50:35.468 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.802+0000 7f5f2a7fc700 1 -- 172.21.15.155:0/4005860819 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f2000be70 con 0x7f5f2c070fc0 2023-12-16T05:50:35.468 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.802+0000 7f5f2a7fc700 1 -- 172.21.15.155:0/4005860819 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f20010380 con 0x7f5f2c070fc0 2023-12-16T05:50:35.468 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.803+0000 7f5f321e1700 1 -- 172.21.15.155:0/4005860819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f2c070fc0 msgr2=0x7f5f2c104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:35.468 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.803+0000 7f5f321e1700 1 --2- 172.21.15.155:0/4005860819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f2c070fc0 0x7f5f2c104ee0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5f200098e0 tx=0x7f5f20009250 comp rx=0 tx=0).stop 2023-12-16T05:50:35.468 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.803+0000 7f5f321e1700 1 -- 172.21.15.155:0/4005860819 shutdown_connections 2023-12-16T05:50:35.468 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.803+0000 7f5f321e1700 1 --2- 172.21.15.155:0/4005860819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f2c070fc0 0x7f5f2c104ee0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:35.468 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.803+0000 7f5f321e1700 1 -- 172.21.15.155:0/4005860819 >> 172.21.15.155:0/4005860819 conn(0x7f5f2c0fc970 msgr2=0x7f5f2c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:35.468 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.803+0000 7f5f321e1700 1 -- 172.21.15.155:0/4005860819 shutdown_connections 2023-12-16T05:50:35.468 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.803+0000 7f5f321e1700 1 -- 172.21.15.155:0/4005860819 wait complete. 2023-12-16T05:50:35.468 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.804+0000 7f5f321e1700 1 Processor -- start 2023-12-16T05:50:35.468 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.804+0000 7f5f321e1700 1 -- start start 2023-12-16T05:50:35.468 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.804+0000 7f5f321e1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f2c070fc0 0x7f5f2c1111c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:35.469 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.804+0000 7f5f321e1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c111700 con 0x7f5f2c070fc0 2023-12-16T05:50:35.469 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.804+0000 7f5f2b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f2c070fc0 0x7f5f2c1111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:35.469 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.804+0000 7f5f2b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f2c070fc0 0x7f5f2c1111c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54370/0 (socket says 172.21.15.155:54370) 2023-12-16T05:50:35.469 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.804+0000 7f5f2b7fe700 1 -- 172.21.15.155:0/184228797 learned_addr learned my addr 172.21.15.155:0/184228797 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:35.469 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.805+0000 7f5f2b7fe700 1 -- 172.21.15.155:0/184228797 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f200094f0 con 0x7f5f2c070fc0 2023-12-16T05:50:35.469 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.805+0000 7f5f2b7fe700 1 --2- 172.21.15.155:0/184228797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f2c070fc0 0x7f5f2c1111c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5f200094c0 tx=0x7f5f20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:35.469 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.805+0000 7f5f13fff700 1 -- 172.21.15.155:0/184228797 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f20010850 con 0x7f5f2c070fc0 2023-12-16T05:50:35.469 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.805+0000 7f5f321e1700 1 -- 172.21.15.155:0/184228797 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2c111900 con 0x7f5f2c070fc0 2023-12-16T05:50:35.469 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.805+0000 7f5f13fff700 1 -- 172.21.15.155:0/184228797 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f20010e60 con 0x7f5f2c070fc0 2023-12-16T05:50:35.469 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.805+0000 7f5f13fff700 1 -- 172.21.15.155:0/184228797 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f2001a430 con 0x7f5f2c070fc0 2023-12-16T05:50:35.469 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.805+0000 7f5f321e1700 1 -- 172.21.15.155:0/184228797 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2c111d10 con 0x7f5f2c070fc0 2023-12-16T05:50:35.469 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.806+0000 7f5f13fff700 1 -- 172.21.15.155:0/184228797 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f5f2001a6b0 con 0x7f5f2c070fc0 2023-12-16T05:50:35.469 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.806+0000 7f5f321e1700 1 -- 172.21.15.155:0/184228797 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2c04bb80 con 0x7f5f2c070fc0 2023-12-16T05:50:35.469 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.806+0000 7f5f13fff700 1 --2- 172.21.15.155:0/184228797 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f5f140366e0 0x7f5f14038b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:35.470 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.806+0000 7f5f13fff700 1 -- 172.21.15.155:0/184228797 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5f2004a790 con 0x7f5f2c070fc0 2023-12-16T05:50:35.470 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.806+0000 7f5f2affd700 1 --2- 172.21.15.155:0/184228797 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f5f140366e0 0x7f5f14038b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:35.470 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.807+0000 7f5f2affd700 1 --2- 172.21.15.155:0/184228797 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f5f140366e0 0x7f5f14038b90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c009990 tx=0x7f5f1c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:35.470 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:34.811+0000 7f5f13fff700 1 -- 172.21.15.155:0/184228797 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5f2002d910 con 0x7f5f2c070fc0 2023-12-16T05:50:35.470 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:35.101+0000 7f5f321e1700 1 -- 172.21.15.155:0/184228797 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f5f2c1062e0 con 0x7f5f2c070fc0 2023-12-16T05:50:35.470 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:35.103+0000 7f5f13fff700 1 -- 172.21.15.155:0/184228797 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f5f20018350 con 0x7f5f2c070fc0 2023-12-16T05:50:35.470 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:35.105+0000 7f5f321e1700 1 -- 172.21.15.155:0/184228797 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f5f140366e0 msgr2=0x7f5f14038b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:35.470 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:35.105+0000 7f5f321e1700 1 --2- 172.21.15.155:0/184228797 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f5f140366e0 0x7f5f14038b90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c009990 tx=0x7f5f1c006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:35.470 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:35.105+0000 7f5f321e1700 1 -- 172.21.15.155:0/184228797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f2c070fc0 msgr2=0x7f5f2c1111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:35.470 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:35.105+0000 7f5f321e1700 1 --2- 172.21.15.155:0/184228797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f2c070fc0 0x7f5f2c1111c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5f200094c0 tx=0x7f5f20009250 comp rx=0 tx=0).stop 2023-12-16T05:50:35.470 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:35.105+0000 7f5f321e1700 1 -- 172.21.15.155:0/184228797 shutdown_connections 2023-12-16T05:50:35.470 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:35.106+0000 7f5f321e1700 1 --2- 172.21.15.155:0/184228797 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f5f140366e0 0x7f5f14038b90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:35.471 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:35.106+0000 7f5f321e1700 1 --2- 172.21.15.155:0/184228797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f2c070fc0 0x7f5f2c1111c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:35.471 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:35.106+0000 7f5f321e1700 1 -- 172.21.15.155:0/184228797 >> 172.21.15.155:0/184228797 conn(0x7f5f2c0fc970 msgr2=0x7f5f2c0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:35.471 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:35.106+0000 7f5f321e1700 1 -- 172.21.15.155:0/184228797 shutdown_connections 2023-12-16T05:50:35.471 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr 2023-12-16T05:50:35.106+0000 7f5f321e1700 1 -- 172.21.15.155:0/184228797 wait complete. 2023-12-16T05:50:35.471 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-12-16T05:50:35.471 INFO:teuthology.orchestra.run.smithi155.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-12-16T05:50:35.471 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:50:35.471 INFO:teuthology.orchestra.run.smithi155.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-12-16T05:50:35.471 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:50:35.471 INFO:teuthology.orchestra.run.smithi155.stdout:Or, if you are only running a single cluster on this host: 2023-12-16T05:50:35.471 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:50:35.471 INFO:teuthology.orchestra.run.smithi155.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-12-16T05:50:35.471 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:50:35.471 INFO:teuthology.orchestra.run.smithi155.stdout:Please consider enabling telemetry to help improve Ceph: 2023-12-16T05:50:35.471 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:50:35.472 INFO:teuthology.orchestra.run.smithi155.stdout: ceph telemetry on 2023-12-16T05:50:35.472 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:50:35.472 INFO:teuthology.orchestra.run.smithi155.stdout:For more information see: 2023-12-16T05:50:35.472 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:50:35.472 INFO:teuthology.orchestra.run.smithi155.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2023-12-16T05:50:35.472 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:50:35.472 INFO:teuthology.orchestra.run.smithi155.stdout:Bootstrap complete. 2023-12-16T05:50:35.483 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:35 smithi155 ceph-mon[112451]: mgrmap e13: smithi155.maowdn(active, since 6s) 2023-12-16T05:50:35.483 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:35 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/184228797' entity='client.admin' 2023-12-16T05:50:35.498 INFO:tasks.cephadm:Fetching config... 2023-12-16T05:50:35.498 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-16T05:50:35.499 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-12-16T05:50:35.558 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-12-16T05:50:35.558 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-16T05:50:35.558 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-12-16T05:50:35.616 INFO:tasks.cephadm:Fetching mon keyring... 2023-12-16T05:50:35.616 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-16T05:50:35.617 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/keyring of=/dev/stdout 2023-12-16T05:50:35.687 INFO:tasks.cephadm:Fetching pub ssh key... 2023-12-16T05:50:35.687 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-16T05:50:35.687 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-12-16T05:50:35.745 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-12-16T05:50:35.745 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcH2J/kv8sU2FVaZgiDx6Fu5zPKSXDdxA+sjzppale/9ONXDSn3YROr7+GykSIDgQtV/kxQk39kpZMUq5+SVx3aovR63PHct5AwoDgfI1PFB5UXa3epLlhckJuW0KPHUh8VD74YIjxgS3cF7vv1vZb+yNf7/d1XdSvzd5WHQYoNWcfqeZJ7Wvu4B/jN9qddAmADQcqhBS8ndz/QE3kSsTjC7W3i7iwuRXAUxbjglS6woMmjneTeT5LaoGtvbShj41cc4Olip603nR8PQuRdVI29w+hu5ibs9Wh2OyGGkwiUWpFEg1XSr/6AG2nFifUPfCQzkZJ2glv6d+mE/ycZTeQurz2hQ+QxHwczJxY35pKsA0RfgLPID+4xqY+qFexZ9S4qHR5wt/vJ51AD9giIP0mzlAeXBz/cExkTT2Gqub97+0xbBEiv0wggFNK9vXZAut13xBDs0wvqFJeqGfUqHu2pR4NLZaWH+KYIkH5ASgvez6vtqmpmKlcbFrUbop8KzM= ceph-d344784e-9bd6-11ee-95a5-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-16T05:50:35.822 INFO:teuthology.orchestra.run.smithi155.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcH2J/kv8sU2FVaZgiDx6Fu5zPKSXDdxA+sjzppale/9ONXDSn3YROr7+GykSIDgQtV/kxQk39kpZMUq5+SVx3aovR63PHct5AwoDgfI1PFB5UXa3epLlhckJuW0KPHUh8VD74YIjxgS3cF7vv1vZb+yNf7/d1XdSvzd5WHQYoNWcfqeZJ7Wvu4B/jN9qddAmADQcqhBS8ndz/QE3kSsTjC7W3i7iwuRXAUxbjglS6woMmjneTeT5LaoGtvbShj41cc4Olip603nR8PQuRdVI29w+hu5ibs9Wh2OyGGkwiUWpFEg1XSr/6AG2nFifUPfCQzkZJ2glv6d+mE/ycZTeQurz2hQ+QxHwczJxY35pKsA0RfgLPID+4xqY+qFexZ9S4qHR5wt/vJ51AD9giIP0mzlAeXBz/cExkTT2Gqub97+0xbBEiv0wggFNK9vXZAut13xBDs0wvqFJeqGfUqHu2pR4NLZaWH+KYIkH5ASgvez6vtqmpmKlcbFrUbop8KzM= ceph-d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:50:35.833 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcH2J/kv8sU2FVaZgiDx6Fu5zPKSXDdxA+sjzppale/9ONXDSn3YROr7+GykSIDgQtV/kxQk39kpZMUq5+SVx3aovR63PHct5AwoDgfI1PFB5UXa3epLlhckJuW0KPHUh8VD74YIjxgS3cF7vv1vZb+yNf7/d1XdSvzd5WHQYoNWcfqeZJ7Wvu4B/jN9qddAmADQcqhBS8ndz/QE3kSsTjC7W3i7iwuRXAUxbjglS6woMmjneTeT5LaoGtvbShj41cc4Olip603nR8PQuRdVI29w+hu5ibs9Wh2OyGGkwiUWpFEg1XSr/6AG2nFifUPfCQzkZJ2glv6d+mE/ycZTeQurz2hQ+QxHwczJxY35pKsA0RfgLPID+4xqY+qFexZ9S4qHR5wt/vJ51AD9giIP0mzlAeXBz/cExkTT2Gqub97+0xbBEiv0wggFNK9vXZAut13xBDs0wvqFJeqGfUqHu2pR4NLZaWH+KYIkH5ASgvez6vtqmpmKlcbFrUbop8KzM= ceph-d344784e-9bd6-11ee-95a5-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-16T05:50:35.883 INFO:teuthology.orchestra.run.smithi156.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcH2J/kv8sU2FVaZgiDx6Fu5zPKSXDdxA+sjzppale/9ONXDSn3YROr7+GykSIDgQtV/kxQk39kpZMUq5+SVx3aovR63PHct5AwoDgfI1PFB5UXa3epLlhckJuW0KPHUh8VD74YIjxgS3cF7vv1vZb+yNf7/d1XdSvzd5WHQYoNWcfqeZJ7Wvu4B/jN9qddAmADQcqhBS8ndz/QE3kSsTjC7W3i7iwuRXAUxbjglS6woMmjneTeT5LaoGtvbShj41cc4Olip603nR8PQuRdVI29w+hu5ibs9Wh2OyGGkwiUWpFEg1XSr/6AG2nFifUPfCQzkZJ2glv6d+mE/ycZTeQurz2hQ+QxHwczJxY35pKsA0RfgLPID+4xqY+qFexZ9S4qHR5wt/vJ51AD9giIP0mzlAeXBz/cExkTT2Gqub97+0xbBEiv0wggFNK9vXZAut13xBDs0wvqFJeqGfUqHu2pR4NLZaWH+KYIkH5ASgvez6vtqmpmKlcbFrUbop8KzM= ceph-d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:50:35.895 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-12-16T05:50:36.158 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:50:37.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.775+0000 7f59c0023700 1 -- 172.21.15.155:0/3721331804 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59b80fd3c0 msgr2=0x7f59b80ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:37.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.775+0000 7f59c0023700 1 --2- 172.21.15.155:0/3721331804 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59b80fd3c0 0x7f59b80ff7a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f59b40048c0 tx=0x7f59b4009e30 comp rx=0 tx=0).stop 2023-12-16T05:50:37.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.775+0000 7f59c0023700 1 -- 172.21.15.155:0/3721331804 shutdown_connections 2023-12-16T05:50:37.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.775+0000 7f59c0023700 1 --2- 172.21.15.155:0/3721331804 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59b80fd3c0 0x7f59b80ff7a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:37.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.775+0000 7f59c0023700 1 -- 172.21.15.155:0/3721331804 >> 172.21.15.155:0/3721331804 conn(0x7f59b80f6e40 msgr2=0x7f59b80f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:37.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.776+0000 7f59c0023700 1 -- 172.21.15.155:0/3721331804 shutdown_connections 2023-12-16T05:50:37.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.776+0000 7f59c0023700 1 -- 172.21.15.155:0/3721331804 wait complete. 2023-12-16T05:50:37.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.776+0000 7f59c0023700 1 Processor -- start 2023-12-16T05:50:37.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.776+0000 7f59c0023700 1 -- start start 2023-12-16T05:50:37.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.776+0000 7f59c0023700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59b80fd3c0 0x7f59b810ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:37.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.776+0000 7f59c0023700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b810cfa0 con 0x7f59b80fd3c0 2023-12-16T05:50:37.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.776+0000 7f59bddbf700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59b80fd3c0 0x7f59b810ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:37.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.776+0000 7f59bddbf700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59b80fd3c0 0x7f59b810ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40270/0 (socket says 172.21.15.155:40270) 2023-12-16T05:50:37.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.776+0000 7f59bddbf700 1 -- 172.21.15.155:0/1430995251 learned_addr learned my addr 172.21.15.155:0/1430995251 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:37.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.777+0000 7f59bddbf700 1 -- 172.21.15.155:0/1430995251 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b4005040 con 0x7f59b80fd3c0 2023-12-16T05:50:37.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.777+0000 7f59bddbf700 1 --2- 172.21.15.155:0/1430995251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59b80fd3c0 0x7f59b810ca60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f59b400b690 tx=0x7f59b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:37.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.777+0000 7f59ae7fc700 1 -- 172.21.15.155:0/1430995251 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59b4009650 con 0x7f59b80fd3c0 2023-12-16T05:50:37.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.777+0000 7f59c0023700 1 -- 172.21.15.155:0/1430995251 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b810d1a0 con 0x7f59b80fd3c0 2023-12-16T05:50:37.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.777+0000 7f59ae7fc700 1 -- 172.21.15.155:0/1430995251 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f59b40097b0 con 0x7f59b80fd3c0 2023-12-16T05:50:37.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.777+0000 7f59ae7fc700 1 -- 172.21.15.155:0/1430995251 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59b401c5b0 con 0x7f59b80fd3c0 2023-12-16T05:50:37.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.777+0000 7f59c0023700 1 -- 172.21.15.155:0/1430995251 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b810de40 con 0x7f59b80fd3c0 2023-12-16T05:50:37.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.778+0000 7f59ae7fc700 1 -- 172.21.15.155:0/1430995251 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f59b401c870 con 0x7f59b80fd3c0 2023-12-16T05:50:37.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.778+0000 7f59ae7fc700 1 --2- 172.21.15.155:0/1430995251 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f59a40366d0 0x7f59a4038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:37.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.778+0000 7f59ae7fc700 1 -- 172.21.15.155:0/1430995251 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f59b4049890 con 0x7f59b80fd3c0 2023-12-16T05:50:37.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.778+0000 7f59bd5be700 1 --2- 172.21.15.155:0/1430995251 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f59a40366d0 0x7f59a4038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:37.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.778+0000 7f59c0023700 1 -- 172.21.15.155:0/1430995251 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b805f270 con 0x7f59b80fd3c0 2023-12-16T05:50:37.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.778+0000 7f59bd5be700 1 --2- 172.21.15.155:0/1430995251 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f59a40366d0 0x7f59a4038b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f59a8009990 tx=0x7f59a8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:37.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.783+0000 7f59ae7fc700 1 -- 172.21.15.155:0/1430995251 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f59b4011db0 con 0x7f59b80fd3c0 2023-12-16T05:50:37.981 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.978+0000 7f59c0023700 1 -- 172.21.15.155:0/1430995251 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f59b810e8c0 con 0x7f59b80fd3c0 2023-12-16T05:50:37.983 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.981+0000 7f59ae7fc700 1 -- 172.21.15.155:0/1430995251 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f59b40340c0 con 0x7f59b80fd3c0 2023-12-16T05:50:37.986 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.984+0000 7f59c0023700 1 -- 172.21.15.155:0/1430995251 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f59a40366d0 msgr2=0x7f59a4038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:37.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.984+0000 7f59c0023700 1 --2- 172.21.15.155:0/1430995251 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f59a40366d0 0x7f59a4038b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f59a8009990 tx=0x7f59a8006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:37.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.984+0000 7f59c0023700 1 -- 172.21.15.155:0/1430995251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59b80fd3c0 msgr2=0x7f59b810ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:37.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.984+0000 7f59c0023700 1 --2- 172.21.15.155:0/1430995251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59b80fd3c0 0x7f59b810ca60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f59b400b690 tx=0x7f59b4009e30 comp rx=0 tx=0).stop 2023-12-16T05:50:37.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.984+0000 7f59c0023700 1 -- 172.21.15.155:0/1430995251 shutdown_connections 2023-12-16T05:50:37.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.984+0000 7f59c0023700 1 --2- 172.21.15.155:0/1430995251 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f59a40366d0 0x7f59a4038b80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:37.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.984+0000 7f59c0023700 1 --2- 172.21.15.155:0/1430995251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59b80fd3c0 0x7f59b810ca60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:37.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.984+0000 7f59c0023700 1 -- 172.21.15.155:0/1430995251 >> 172.21.15.155:0/1430995251 conn(0x7f59b80f6e40 msgr2=0x7f59b80f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:37.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.984+0000 7f59c0023700 1 -- 172.21.15.155:0/1430995251 shutdown_connections 2023-12-16T05:50:37.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:37.984+0000 7f59c0023700 1 -- 172.21.15.155:0/1430995251 wait complete. 2023-12-16T05:50:38.358 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-12-16T05:50:38.358 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-12-16T05:50:38.688 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:50:39.170 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:38 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/1430995251' entity='client.admin' 2023-12-16T05:50:39.170 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:38 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:39.170 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:38 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:39.170 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:38 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd/host:smithi155", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:50:39.170 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:38 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:39.170 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:38 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi155", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T05:50:39.170 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:38 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi155", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-16T05:50:39.171 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:38 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:50:40.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:39 smithi155 ceph-mon[112451]: Deploying daemon crash.smithi155 on smithi155 2023-12-16T05:50:40.373 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.369+0000 7f087d591700 1 -- 172.21.15.155:0/1400120210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08780fded0 msgr2=0x7f08780fe2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:40.373 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.369+0000 7f087d591700 1 --2- 172.21.15.155:0/1400120210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08780fded0 0x7f08780fe2e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f08680048c0 tx=0x7f0868009e30 comp rx=0 tx=0).stop 2023-12-16T05:50:40.373 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.369+0000 7f087d591700 1 -- 172.21.15.155:0/1400120210 shutdown_connections 2023-12-16T05:50:40.373 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.369+0000 7f087d591700 1 --2- 172.21.15.155:0/1400120210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08780fded0 0x7f08780fe2e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:40.373 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.369+0000 7f087d591700 1 -- 172.21.15.155:0/1400120210 >> 172.21.15.155:0/1400120210 conn(0x7f08780f65d0 msgr2=0x7f08780f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:40.373 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.370+0000 7f087d591700 1 -- 172.21.15.155:0/1400120210 shutdown_connections 2023-12-16T05:50:40.373 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.370+0000 7f087d591700 1 -- 172.21.15.155:0/1400120210 wait complete. 2023-12-16T05:50:40.374 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.370+0000 7f087d591700 1 Processor -- start 2023-12-16T05:50:40.374 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.370+0000 7f087d591700 1 -- start start 2023-12-16T05:50:40.374 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.370+0000 7f087d591700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08780fded0 0x7f087810cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:40.374 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.370+0000 7f087d591700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087810cff0 con 0x7f08780fded0 2023-12-16T05:50:40.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.371+0000 7f0876ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08780fded0 0x7f087810cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:40.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.371+0000 7f0876ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08780fded0 0x7f087810cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40286/0 (socket says 172.21.15.155:40286) 2023-12-16T05:50:40.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.371+0000 7f0876ffd700 1 -- 172.21.15.155:0/279264795 learned_addr learned my addr 172.21.15.155:0/279264795 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:40.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.371+0000 7f0876ffd700 1 -- 172.21.15.155:0/279264795 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0868005040 con 0x7f08780fded0 2023-12-16T05:50:40.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.371+0000 7f0876ffd700 1 --2- 172.21.15.155:0/279264795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08780fded0 0x7f087810cab0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f086800b690 tx=0x7f0868009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:40.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.371+0000 7f085f7fe700 1 -- 172.21.15.155:0/279264795 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0868009650 con 0x7f08780fded0 2023-12-16T05:50:40.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.371+0000 7f087d591700 1 -- 172.21.15.155:0/279264795 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f087810d1f0 con 0x7f08780fded0 2023-12-16T05:50:40.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.371+0000 7f085f7fe700 1 -- 172.21.15.155:0/279264795 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f08680097b0 con 0x7f08780fded0 2023-12-16T05:50:40.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.371+0000 7f085f7fe700 1 -- 172.21.15.155:0/279264795 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f086801c5d0 con 0x7f08780fded0 2023-12-16T05:50:40.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.371+0000 7f087d591700 1 -- 172.21.15.155:0/279264795 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087810de90 con 0x7f08780fded0 2023-12-16T05:50:40.376 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.372+0000 7f087d591700 1 -- 172.21.15.155:0/279264795 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f087805f270 con 0x7f08780fded0 2023-12-16T05:50:40.376 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.372+0000 7f085f7fe700 1 -- 172.21.15.155:0/279264795 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f08680139d0 con 0x7f08780fded0 2023-12-16T05:50:40.376 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.373+0000 7f085f7fe700 1 --2- 172.21.15.155:0/279264795 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f08600366d0 0x7f0860038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:40.376 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.373+0000 7f085f7fe700 1 -- 172.21.15.155:0/279264795 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0868049980 con 0x7f08780fded0 2023-12-16T05:50:40.376 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.373+0000 7f08767fc700 1 --2- 172.21.15.155:0/279264795 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f08600366d0 0x7f0860038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:40.376 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.373+0000 7f08767fc700 1 --2- 172.21.15.155:0/279264795 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f08600366d0 0x7f0860038b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f086c009990 tx=0x7f086c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:40.382 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.377+0000 7f085f7fe700 1 -- 172.21.15.155:0/279264795 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0868025400 con 0x7f08780fded0 2023-12-16T05:50:40.610 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.607+0000 7f087d591700 1 -- 172.21.15.155:0/279264795 --> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f087810ea50 con 0x7f08600366d0 2023-12-16T05:50:40.612 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.610+0000 7f085f7fe700 1 -- 172.21.15.155:0/279264795 <== mgr.14162 v2:172.21.15.155:6800/2821498015 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f087810ea50 con 0x7f08600366d0 2023-12-16T05:50:40.615 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.612+0000 7f087d591700 1 -- 172.21.15.155:0/279264795 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f08600366d0 msgr2=0x7f0860038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:40.615 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.612+0000 7f087d591700 1 --2- 172.21.15.155:0/279264795 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f08600366d0 0x7f0860038b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f086c009990 tx=0x7f086c006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:40.615 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.612+0000 7f087d591700 1 -- 172.21.15.155:0/279264795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08780fded0 msgr2=0x7f087810cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:40.615 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.612+0000 7f087d591700 1 --2- 172.21.15.155:0/279264795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08780fded0 0x7f087810cab0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f086800b690 tx=0x7f0868009e30 comp rx=0 tx=0).stop 2023-12-16T05:50:40.615 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.612+0000 7f087d591700 1 -- 172.21.15.155:0/279264795 shutdown_connections 2023-12-16T05:50:40.615 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.612+0000 7f087d591700 1 --2- 172.21.15.155:0/279264795 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f08600366d0 0x7f0860038b80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:40.615 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.612+0000 7f087d591700 1 --2- 172.21.15.155:0/279264795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08780fded0 0x7f087810cab0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:40.615 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.612+0000 7f087d591700 1 -- 172.21.15.155:0/279264795 >> 172.21.15.155:0/279264795 conn(0x7f08780f65d0 msgr2=0x7f08780f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:40.615 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.612+0000 7f087d591700 1 -- 172.21.15.155:0/279264795 shutdown_connections 2023-12-16T05:50:40.616 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:40.612+0000 7f087d591700 1 -- 172.21.15.155:0/279264795 wait complete. 2023-12-16T05:50:41.042 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi156 2023-12-16T05:50:41.043 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-12-16T05:50:41.043 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/etc/ceph/ceph.conf 2023-12-16T05:50:41.064 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-12-16T05:50:41.065 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-16T05:50:41.125 INFO:tasks.cephadm:Adding host smithi156 to orchestrator... 2023-12-16T05:50:41.125 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph orch host add smithi156 2023-12-16T05:50:41.407 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:50:41.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:41 smithi155 ceph-mon[112451]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:50:41.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:41 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:41.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:41 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:41.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:41 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:41.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:41 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:41.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:41 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:42.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.453+0000 7f4dd554c700 1 -- 172.21.15.155:0/1552553097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dd00fab30 msgr2=0x7f4dd00faf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:42.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.453+0000 7f4dd554c700 1 --2- 172.21.15.155:0/1552553097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dd00fab30 0x7f4dd00faf40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00048c0 tx=0x7f4dc0009e30 comp rx=0 tx=0).stop 2023-12-16T05:50:42.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.453+0000 7f4dd554c700 1 -- 172.21.15.155:0/1552553097 shutdown_connections 2023-12-16T05:50:42.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.453+0000 7f4dd554c700 1 --2- 172.21.15.155:0/1552553097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dd00fab30 0x7f4dd00faf40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:42.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.453+0000 7f4dd554c700 1 -- 172.21.15.155:0/1552553097 >> 172.21.15.155:0/1552553097 conn(0x7f4dd00f65d0 msgr2=0x7f4dd00f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:42.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.453+0000 7f4dd554c700 1 -- 172.21.15.155:0/1552553097 shutdown_connections 2023-12-16T05:50:42.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.453+0000 7f4dd554c700 1 -- 172.21.15.155:0/1552553097 wait complete. 2023-12-16T05:50:42.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.453+0000 7f4dd554c700 1 Processor -- start 2023-12-16T05:50:42.461 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.454+0000 7f4dd554c700 1 -- start start 2023-12-16T05:50:42.461 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.454+0000 7f4dd554c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dd00fab30 0x7f4dd010ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:42.461 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.454+0000 7f4dd554c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd010cf90 con 0x7f4dd00fab30 2023-12-16T05:50:42.461 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.454+0000 7f4dceffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dd00fab30 0x7f4dd010ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:42.461 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.454+0000 7f4dceffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dd00fab30 0x7f4dd010ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40310/0 (socket says 172.21.15.155:40310) 2023-12-16T05:50:42.461 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.454+0000 7f4dceffd700 1 -- 172.21.15.155:0/2851807516 learned_addr learned my addr 172.21.15.155:0/2851807516 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:42.461 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.454+0000 7f4dceffd700 1 -- 172.21.15.155:0/2851807516 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc0005040 con 0x7f4dd00fab30 2023-12-16T05:50:42.461 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.454+0000 7f4dceffd700 1 --2- 172.21.15.155:0/2851807516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dd00fab30 0x7f4dd010ca50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009040 tx=0x7f4dc0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:42.461 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.454+0000 7f4db77fe700 1 -- 172.21.15.155:0/2851807516 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4dc0009650 con 0x7f4dd00fab30 2023-12-16T05:50:42.462 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.454+0000 7f4db77fe700 1 -- 172.21.15.155:0/2851807516 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4dc00097b0 con 0x7f4dd00fab30 2023-12-16T05:50:42.462 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.454+0000 7f4dd554c700 1 -- 172.21.15.155:0/2851807516 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd010d190 con 0x7f4dd00fab30 2023-12-16T05:50:42.462 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.455+0000 7f4db77fe700 1 -- 172.21.15.155:0/2851807516 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4dc001c5b0 con 0x7f4dd00fab30 2023-12-16T05:50:42.462 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.455+0000 7f4dd554c700 1 -- 172.21.15.155:0/2851807516 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd010de30 con 0x7f4dd00fab30 2023-12-16T05:50:42.462 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.455+0000 7f4db77fe700 1 -- 172.21.15.155:0/2851807516 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f4dc001c870 con 0x7f4dd00fab30 2023-12-16T05:50:42.462 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.456+0000 7f4db77fe700 1 --2- 172.21.15.155:0/2851807516 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f4db80366d0 0x7f4db8038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:42.462 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.456+0000 7f4db77fe700 1 -- 172.21.15.155:0/2851807516 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4dc0049940 con 0x7f4dd00fab30 2023-12-16T05:50:42.462 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.456+0000 7f4dd554c700 1 -- 172.21.15.155:0/2851807516 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd005f270 con 0x7f4dd00fab30 2023-12-16T05:50:42.462 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.456+0000 7f4dce7fc700 1 --2- 172.21.15.155:0/2851807516 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f4db80366d0 0x7f4db8038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:42.462 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.456+0000 7f4dce7fc700 1 --2- 172.21.15.155:0/2851807516 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f4db80366d0 0x7f4db8038b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009990 tx=0x7f4dc4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:42.477 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.461+0000 7f4db77fe700 1 -- 172.21.15.155:0/2851807516 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4dc0011db0 con 0x7f4dd00fab30 2023-12-16T05:50:42.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:42.670+0000 7f4dd554c700 1 -- 172.21.15.155:0/2851807516 --> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi156", "target": ["mon-mgr", ""]}) v1 -- 0x7f4dd010e8b0 con 0x7f4db80366d0 2023-12-16T05:50:43.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:42 smithi155 ceph-mon[112451]: Deploying daemon node-exporter.smithi155 on smithi155 2023-12-16T05:50:44.518 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:44.514+0000 7f4db77fe700 1 -- 172.21.15.155:0/2851807516 <== mgr.14162 v2:172.21.15.155:6800/2821498015 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f4dd010e8b0 con 0x7f4db80366d0 2023-12-16T05:50:44.518 INFO:teuthology.orchestra.run.smithi155.stdout:Added host 'smithi156' with addr '172.21.15.156' 2023-12-16T05:50:44.520 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:44.517+0000 7f4dd554c700 1 -- 172.21.15.155:0/2851807516 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f4db80366d0 msgr2=0x7f4db8038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:44.520 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:44.517+0000 7f4dd554c700 1 --2- 172.21.15.155:0/2851807516 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f4db80366d0 0x7f4db8038b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009990 tx=0x7f4dc4006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:44.520 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:44.517+0000 7f4dd554c700 1 -- 172.21.15.155:0/2851807516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dd00fab30 msgr2=0x7f4dd010ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:44.520 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:44.517+0000 7f4dd554c700 1 --2- 172.21.15.155:0/2851807516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dd00fab30 0x7f4dd010ca50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009040 tx=0x7f4dc0009e30 comp rx=0 tx=0).stop 2023-12-16T05:50:44.520 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:44.517+0000 7f4dd554c700 1 -- 172.21.15.155:0/2851807516 shutdown_connections 2023-12-16T05:50:44.520 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:44.517+0000 7f4dd554c700 1 --2- 172.21.15.155:0/2851807516 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f4db80366d0 0x7f4db8038b80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:44.520 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:44.517+0000 7f4dd554c700 1 --2- 172.21.15.155:0/2851807516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dd00fab30 0x7f4dd010ca50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:44.520 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:44.517+0000 7f4dd554c700 1 -- 172.21.15.155:0/2851807516 >> 172.21.15.155:0/2851807516 conn(0x7f4dd00f65d0 msgr2=0x7f4dd00f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:44.520 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:44.517+0000 7f4dd554c700 1 -- 172.21.15.155:0/2851807516 shutdown_connections 2023-12-16T05:50:44.520 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:44.517+0000 7f4dd554c700 1 -- 172.21.15.155:0/2851807516 wait complete. 2023-12-16T05:50:44.551 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:44 smithi155 ceph-mon[112451]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi156", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:50:44.551 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:44 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:44.551 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:44 smithi155 ceph-mon[112451]: Deploying cephadm binary to smithi156 2023-12-16T05:50:44.551 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:44 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:44.551 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:44 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:44.551 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:44 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:44.551 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:44 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:44.907 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph orch host ls --format=json 2023-12-16T05:50:45.188 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:50:45.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:45 smithi155 ceph-mon[112451]: Deploying daemon alertmanager.smithi155 on smithi155 2023-12-16T05:50:45.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:45 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:45.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:45 smithi155 ceph-mon[112451]: Added host smithi156 2023-12-16T05:50:47.346 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.342+0000 7f3647390700 1 -- 172.21.15.155:0/784178498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3640065a40 msgr2=0x7f36400ff490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:47.346 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.342+0000 7f3647390700 1 --2- 172.21.15.155:0/784178498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3640065a40 0x7f36400ff490 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f36300048c0 tx=0x7f3630009e30 comp rx=0 tx=0).stop 2023-12-16T05:50:47.346 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.342+0000 7f3647390700 1 -- 172.21.15.155:0/784178498 shutdown_connections 2023-12-16T05:50:47.346 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.342+0000 7f3647390700 1 --2- 172.21.15.155:0/784178498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3640065a40 0x7f36400ff490 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:47.346 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.342+0000 7f3647390700 1 -- 172.21.15.155:0/784178498 >> 172.21.15.155:0/784178498 conn(0x7f36400f6e40 msgr2=0x7f36400f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:47.346 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.342+0000 7f3647390700 1 -- 172.21.15.155:0/784178498 shutdown_connections 2023-12-16T05:50:47.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.342+0000 7f3647390700 1 -- 172.21.15.155:0/784178498 wait complete. 2023-12-16T05:50:47.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.342+0000 7f3647390700 1 Processor -- start 2023-12-16T05:50:47.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.342+0000 7f3647390700 1 -- start start 2023-12-16T05:50:47.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.343+0000 7f3647390700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3640065a40 0x7f364010ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:47.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.343+0000 7f3647390700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364010cfc0 con 0x7f3640065a40 2023-12-16T05:50:47.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.343+0000 7f364512c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3640065a40 0x7f364010ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:47.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.343+0000 7f364512c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3640065a40 0x7f364010ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:60650/0 (socket says 172.21.15.155:60650) 2023-12-16T05:50:47.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.343+0000 7f364512c700 1 -- 172.21.15.155:0/179645604 learned_addr learned my addr 172.21.15.155:0/179645604 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:47.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.343+0000 7f364512c700 1 -- 172.21.15.155:0/179645604 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3630005040 con 0x7f3640065a40 2023-12-16T05:50:47.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.343+0000 7f364512c700 1 --2- 172.21.15.155:0/179645604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3640065a40 0x7f364010ca80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f363000b690 tx=0x7f3630009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:47.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.343+0000 7f3635ffb700 1 -- 172.21.15.155:0/179645604 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3630009650 con 0x7f3640065a40 2023-12-16T05:50:47.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.343+0000 7f3635ffb700 1 -- 172.21.15.155:0/179645604 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f36300097b0 con 0x7f3640065a40 2023-12-16T05:50:47.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.343+0000 7f3647390700 1 -- 172.21.15.155:0/179645604 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364010d1c0 con 0x7f3640065a40 2023-12-16T05:50:47.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.343+0000 7f3635ffb700 1 -- 172.21.15.155:0/179645604 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f363001c5b0 con 0x7f3640065a40 2023-12-16T05:50:47.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.343+0000 7f3647390700 1 -- 172.21.15.155:0/179645604 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364010de60 con 0x7f3640065a40 2023-12-16T05:50:47.348 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.344+0000 7f3635ffb700 1 -- 172.21.15.155:0/179645604 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f363001c820 con 0x7f3640065a40 2023-12-16T05:50:47.348 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.344+0000 7f3647390700 1 -- 172.21.15.155:0/179645604 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364005f270 con 0x7f3640065a40 2023-12-16T05:50:47.348 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.344+0000 7f3635ffb700 1 --2- 172.21.15.155:0/179645604 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f362c036720 0x7f362c038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:47.349 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.344+0000 7f3635ffb700 1 -- 172.21.15.155:0/179645604 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3630049870 con 0x7f3640065a40 2023-12-16T05:50:47.349 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.345+0000 7f364492b700 1 --2- 172.21.15.155:0/179645604 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f362c036720 0x7f362c038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:47.349 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.345+0000 7f364492b700 1 --2- 172.21.15.155:0/179645604 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f362c036720 0x7f362c038bd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f363c009990 tx=0x7f363c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:47.352 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.349+0000 7f3635ffb700 1 -- 172.21.15.155:0/179645604 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3630023300 con 0x7f3640065a40 2023-12-16T05:50:47.562 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.559+0000 7f3647390700 1 -- 172.21.15.155:0/179645604 --> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f364010ea20 con 0x7f362c036720 2023-12-16T05:50:47.563 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.560+0000 7f3635ffb700 1 -- 172.21.15.155:0/179645604 <== mgr.14162 v2:172.21.15.155:6800/2821498015 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f364010ea20 con 0x7f362c036720 2023-12-16T05:50:47.563 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:50:47.563 INFO:teuthology.orchestra.run.smithi155.stdout:[{"addr": "172.21.15.155", "hostname": "smithi155", "labels": [], "status": ""}, {"addr": "172.21.15.156", "hostname": "smithi156", "labels": [], "status": ""}] 2023-12-16T05:50:47.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.563+0000 7f3647390700 1 -- 172.21.15.155:0/179645604 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f362c036720 msgr2=0x7f362c038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:47.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.563+0000 7f3647390700 1 --2- 172.21.15.155:0/179645604 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f362c036720 0x7f362c038bd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f363c009990 tx=0x7f363c006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:47.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.563+0000 7f3647390700 1 -- 172.21.15.155:0/179645604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3640065a40 msgr2=0x7f364010ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:47.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.563+0000 7f3647390700 1 --2- 172.21.15.155:0/179645604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3640065a40 0x7f364010ca80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f363000b690 tx=0x7f3630009e30 comp rx=0 tx=0).stop 2023-12-16T05:50:47.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.563+0000 7f3647390700 1 -- 172.21.15.155:0/179645604 shutdown_connections 2023-12-16T05:50:47.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.563+0000 7f3647390700 1 --2- 172.21.15.155:0/179645604 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f362c036720 0x7f362c038bd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:47.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.563+0000 7f3647390700 1 --2- 172.21.15.155:0/179645604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3640065a40 0x7f364010ca80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:47.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.563+0000 7f3647390700 1 -- 172.21.15.155:0/179645604 >> 172.21.15.155:0/179645604 conn(0x7f36400f6e40 msgr2=0x7f36400f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:47.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.563+0000 7f3647390700 1 -- 172.21.15.155:0/179645604 shutdown_connections 2023-12-16T05:50:47.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:47.563+0000 7f3647390700 1 -- 172.21.15.155:0/179645604 wait complete. 2023-12-16T05:50:47.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:47 smithi155 ceph-mon[112451]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-16T05:50:47.929 INFO:tasks.cephadm:Setting crush tunables to default 2023-12-16T05:50:47.930 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph osd crush tunables default 2023-12-16T05:50:48.353 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:50:49.471 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:49 smithi155 ceph-mon[112451]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:50:49.471 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:49 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:49.764 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.760+0000 7f24d33a0700 1 -- 172.21.15.155:0/1610959252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24cc107280 msgr2=0x7f24cc107690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:49.764 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.760+0000 7f24d33a0700 1 --2- 172.21.15.155:0/1610959252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24cc107280 0x7f24cc107690 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f24c80048c0 tx=0x7f24c8009e30 comp rx=0 tx=0).stop 2023-12-16T05:50:49.764 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.760+0000 7f24d33a0700 1 -- 172.21.15.155:0/1610959252 shutdown_connections 2023-12-16T05:50:49.765 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.760+0000 7f24d33a0700 1 --2- 172.21.15.155:0/1610959252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24cc107280 0x7f24cc107690 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:49.765 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.760+0000 7f24d33a0700 1 -- 172.21.15.155:0/1610959252 >> 172.21.15.155:0/1610959252 conn(0x7f24cc066840 msgr2=0x7f24cc066c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:49.765 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.760+0000 7f24d33a0700 1 -- 172.21.15.155:0/1610959252 shutdown_connections 2023-12-16T05:50:49.765 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.760+0000 7f24d33a0700 1 -- 172.21.15.155:0/1610959252 wait complete. 2023-12-16T05:50:49.765 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.761+0000 7f24d33a0700 1 Processor -- start 2023-12-16T05:50:49.765 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.761+0000 7f24d33a0700 1 -- start start 2023-12-16T05:50:49.765 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.761+0000 7f24d33a0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24cc107280 0x7f24cc1174b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:49.765 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.761+0000 7f24d33a0700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc1179f0 con 0x7f24cc107280 2023-12-16T05:50:49.765 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.761+0000 7f24d113c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24cc107280 0x7f24cc1174b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:49.765 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.761+0000 7f24d113c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24cc107280 0x7f24cc1174b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:60664/0 (socket says 172.21.15.155:60664) 2023-12-16T05:50:49.765 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.761+0000 7f24d113c700 1 -- 172.21.15.155:0/2923353330 learned_addr learned my addr 172.21.15.155:0/2923353330 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:50:49.765 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.762+0000 7f24d113c700 1 -- 172.21.15.155:0/2923353330 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c8005040 con 0x7f24cc107280 2023-12-16T05:50:49.765 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.762+0000 7f24d113c700 1 --2- 172.21.15.155:0/2923353330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24cc107280 0x7f24cc1174b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009330 tx=0x7f24c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:49.767 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.762+0000 7f24c1ffb700 1 -- 172.21.15.155:0/2923353330 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f24c80096b0 con 0x7f24cc107280 2023-12-16T05:50:49.767 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.762+0000 7f24c1ffb700 1 -- 172.21.15.155:0/2923353330 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f24c8009810 con 0x7f24cc107280 2023-12-16T05:50:49.767 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.762+0000 7f24d33a0700 1 -- 172.21.15.155:0/2923353330 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24cc117bf0 con 0x7f24cc107280 2023-12-16T05:50:49.767 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.762+0000 7f24c1ffb700 1 -- 172.21.15.155:0/2923353330 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f24c801c5b0 con 0x7f24cc107280 2023-12-16T05:50:49.767 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.762+0000 7f24d33a0700 1 -- 172.21.15.155:0/2923353330 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24cc118890 con 0x7f24cc107280 2023-12-16T05:50:49.767 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.763+0000 7f24c1ffb700 1 -- 172.21.15.155:0/2923353330 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f24c801c870 con 0x7f24cc107280 2023-12-16T05:50:49.767 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.763+0000 7f24c1ffb700 1 --2- 172.21.15.155:0/2923353330 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f24b80366d0 0x7f24b8038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:49.767 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.763+0000 7f24c1ffb700 1 -- 172.21.15.155:0/2923353330 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f24c8049d10 con 0x7f24cc107280 2023-12-16T05:50:49.767 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.763+0000 7f24d093b700 1 --2- 172.21.15.155:0/2923353330 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f24b80366d0 0x7f24b8038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:49.767 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.763+0000 7f24d33a0700 1 -- 172.21.15.155:0/2923353330 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24cc05f270 con 0x7f24cc107280 2023-12-16T05:50:49.767 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.764+0000 7f24d093b700 1 --2- 172.21.15.155:0/2923353330 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f24b80366d0 0x7f24b8038b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009990 tx=0x7f24bc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:49.771 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.768+0000 7f24c1ffb700 1 -- 172.21.15.155:0/2923353330 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f24c8011dd0 con 0x7f24cc107280 2023-12-16T05:50:49.981 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:49.978+0000 7f24d33a0700 1 -- 172.21.15.155:0/2923353330 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f24cc1192a0 con 0x7f24cc107280 2023-12-16T05:50:50.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:50.151+0000 7f24c1ffb700 1 -- 172.21.15.155:0/2923353330 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f24c8011370 con 0x7f24cc107280 2023-12-16T05:50:50.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:50.154+0000 7f24d33a0700 1 -- 172.21.15.155:0/2923353330 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f24b80366d0 msgr2=0x7f24b8038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:50.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:50.154+0000 7f24d33a0700 1 --2- 172.21.15.155:0/2923353330 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f24b80366d0 0x7f24b8038b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009990 tx=0x7f24bc006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:50.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:50.154+0000 7f24d33a0700 1 -- 172.21.15.155:0/2923353330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24cc107280 msgr2=0x7f24cc1174b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:50.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:50.154+0000 7f24d33a0700 1 --2- 172.21.15.155:0/2923353330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24cc107280 0x7f24cc1174b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009330 tx=0x7f24c8009e30 comp rx=0 tx=0).stop 2023-12-16T05:50:50.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:50.154+0000 7f24d33a0700 1 -- 172.21.15.155:0/2923353330 shutdown_connections 2023-12-16T05:50:50.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:50.154+0000 7f24d33a0700 1 --2- 172.21.15.155:0/2923353330 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f24b80366d0 0x7f24b8038b80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:50.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:50.154+0000 7f24d33a0700 1 --2- 172.21.15.155:0/2923353330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24cc107280 0x7f24cc1174b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:50.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:50.154+0000 7f24d33a0700 1 -- 172.21.15.155:0/2923353330 >> 172.21.15.155:0/2923353330 conn(0x7f24cc066840 msgr2=0x7f24cc1054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:50.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:50.154+0000 7f24d33a0700 1 -- 172.21.15.155:0/2923353330 shutdown_connections 2023-12-16T05:50:50.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:50:50.154+0000 7f24d33a0700 1 -- 172.21.15.155:0/2923353330 wait complete. 2023-12-16T05:50:50.157 INFO:teuthology.orchestra.run.smithi155.stderr:adjusted tunables profile to default 2023-12-16T05:50:50.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:50 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2923353330' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-16T05:50:50.473 INFO:tasks.cephadm:Adding mon.smithi155 on smithi155 2023-12-16T05:50:50.474 INFO:tasks.cephadm:Adding mon.smithi156 on smithi156 2023-12-16T05:50:50.474 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph orch apply mon '2;smithi155:172.21.15.155=smithi155;smithi156:172.21.15.156=smithi156' 2023-12-16T05:50:50.766 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:50:50.829 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:50:51.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:51 smithi155 ceph-mon[112451]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:50:51.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:51 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2923353330' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-16T05:50:51.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:51 smithi155 ceph-mon[112451]: osdmap e4: 0 total, 0 up, 0 in 2023-12-16T05:50:51.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:51 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:51 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:51 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:51 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:51 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:51 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:51 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-16T05:50:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:51 smithi155 ceph-mon[112451]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-16T05:50:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:51 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:51 smithi155 ceph-mon[112451]: Deploying daemon grafana.smithi155 on smithi155 2023-12-16T05:50:52.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.061+0000 7fc3d935c700 1 -- 172.21.15.156:0/3242957829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3d40fb770 msgr2=0x7fc3d40fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:52.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.061+0000 7fc3d935c700 1 --2- 172.21.15.156:0/3242957829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3d40fb770 0x7fc3d40fbb80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40048c0 tx=0x7fc3c4009e30 comp rx=0 tx=0).stop 2023-12-16T05:50:52.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.061+0000 7fc3d935c700 1 -- 172.21.15.156:0/3242957829 shutdown_connections 2023-12-16T05:50:52.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.062+0000 7fc3d935c700 1 --2- 172.21.15.156:0/3242957829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3d40fb770 0x7fc3d40fbb80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:52.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.062+0000 7fc3d935c700 1 -- 172.21.15.156:0/3242957829 >> 172.21.15.156:0/3242957829 conn(0x7fc3d40f6e50 msgr2=0x7fc3d40f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:52.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.062+0000 7fc3d935c700 1 -- 172.21.15.156:0/3242957829 shutdown_connections 2023-12-16T05:50:52.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.062+0000 7fc3d935c700 1 -- 172.21.15.156:0/3242957829 wait complete. 2023-12-16T05:50:52.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.062+0000 7fc3d935c700 1 Processor -- start 2023-12-16T05:50:52.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.062+0000 7fc3d935c700 1 -- start start 2023-12-16T05:50:52.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.062+0000 7fc3d935c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3d40fb770 0x7fc3d410ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:52.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.062+0000 7fc3d935c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d410cfb0 con 0x7fc3d40fb770 2023-12-16T05:50:52.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.063+0000 7fc3d2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3d40fb770 0x7fc3d410ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:52.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.063+0000 7fc3d2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3d40fb770 0x7fc3d410ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.156:59670/0 (socket says 172.21.15.156:59670) 2023-12-16T05:50:52.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.063+0000 7fc3d2ffd700 1 -- 172.21.15.156:0/1482616801 learned_addr learned my addr 172.21.15.156:0/1482616801 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-12-16T05:50:52.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.063+0000 7fc3d2ffd700 1 -- 172.21.15.156:0/1482616801 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c4005040 con 0x7fc3d40fb770 2023-12-16T05:50:52.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.063+0000 7fc3d2ffd700 1 --2- 172.21.15.156:0/1482616801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3d40fb770 0x7fc3d410ca70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009330 tx=0x7fc3c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:52.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.063+0000 7fc3bb7fe700 1 -- 172.21.15.156:0/1482616801 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc3c40096b0 con 0x7fc3d40fb770 2023-12-16T05:50:52.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.063+0000 7fc3bb7fe700 1 -- 172.21.15.156:0/1482616801 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc3c4009810 con 0x7fc3d40fb770 2023-12-16T05:50:52.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.063+0000 7fc3d935c700 1 -- 172.21.15.156:0/1482616801 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d410d1b0 con 0x7fc3d40fb770 2023-12-16T05:50:52.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.063+0000 7fc3bb7fe700 1 -- 172.21.15.156:0/1482616801 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc3c401c5b0 con 0x7fc3d40fb770 2023-12-16T05:50:52.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.063+0000 7fc3d935c700 1 -- 172.21.15.156:0/1482616801 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d410de50 con 0x7fc3d40fb770 2023-12-16T05:50:52.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.064+0000 7fc3bb7fe700 1 -- 172.21.15.156:0/1482616801 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7fc3c401c870 con 0x7fc3d40fb770 2023-12-16T05:50:52.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.064+0000 7fc3bb7fe700 1 --2- 172.21.15.156:0/1482616801 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fc3bc0366d0 0x7fc3bc038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:52.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.064+0000 7fc3d935c700 1 -- 172.21.15.156:0/1482616801 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d405f270 con 0x7fc3d40fb770 2023-12-16T05:50:52.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.064+0000 7fc3bb7fe700 1 -- 172.21.15.156:0/1482616801 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc3c4049b90 con 0x7fc3d40fb770 2023-12-16T05:50:52.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.064+0000 7fc3d27fc700 1 --2- 172.21.15.156:0/1482616801 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fc3bc0366d0 0x7fc3bc038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:52.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.065+0000 7fc3d27fc700 1 --2- 172.21.15.156:0/1482616801 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fc3bc0366d0 0x7fc3bc038b80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009990 tx=0x7fc3c8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:52.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.069+0000 7fc3bb7fe700 1 -- 172.21.15.156:0/1482616801 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc3c4011550 con 0x7fc3d40fb770 2023-12-16T05:50:52.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.263+0000 7fc3d935c700 1 -- 172.21.15.156:0/1482616801 --> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi155:172.21.15.155=smithi155;smithi156:172.21.15.156=smithi156", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3d410e9e0 con 0x7fc3bc0366d0 2023-12-16T05:50:52.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.272+0000 7fc3bb7fe700 1 -- 172.21.15.156:0/1482616801 <== mgr.14162 v2:172.21.15.155:6800/2821498015 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc3d410e9e0 con 0x7fc3bc0366d0 2023-12-16T05:50:52.274 INFO:teuthology.orchestra.run.smithi156.stdout:Scheduled mon update... 2023-12-16T05:50:52.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.273+0000 7fc3d935c700 1 -- 172.21.15.156:0/1482616801 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fc3bc0366d0 msgr2=0x7fc3bc038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:52.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.273+0000 7fc3d935c700 1 --2- 172.21.15.156:0/1482616801 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fc3bc0366d0 0x7fc3bc038b80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009990 tx=0x7fc3c8006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:52.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.273+0000 7fc3d935c700 1 -- 172.21.15.156:0/1482616801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3d40fb770 msgr2=0x7fc3d410ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:52.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.273+0000 7fc3d935c700 1 --2- 172.21.15.156:0/1482616801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3d40fb770 0x7fc3d410ca70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009330 tx=0x7fc3c4009e30 comp rx=0 tx=0).stop 2023-12-16T05:50:52.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.274+0000 7fc3d935c700 1 -- 172.21.15.156:0/1482616801 shutdown_connections 2023-12-16T05:50:52.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.274+0000 7fc3d935c700 1 --2- 172.21.15.156:0/1482616801 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fc3bc0366d0 0x7fc3bc038b80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:52.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.274+0000 7fc3d935c700 1 --2- 172.21.15.156:0/1482616801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3d40fb770 0x7fc3d410ca70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:52.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.274+0000 7fc3d935c700 1 -- 172.21.15.156:0/1482616801 >> 172.21.15.156:0/1482616801 conn(0x7fc3d40f6e50 msgr2=0x7fc3d40660c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:52.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.274+0000 7fc3d935c700 1 -- 172.21.15.156:0/1482616801 shutdown_connections 2023-12-16T05:50:52.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:52.274+0000 7fc3d935c700 1 -- 172.21.15.156:0/1482616801 wait complete. 2023-12-16T05:50:52.640 DEBUG:teuthology.orchestra.run.smithi156:mon.smithi156> sudo journalctl -f -n 0 -u ceph-d344784e-9bd6-11ee-95a5-87774f69a715@mon.smithi156.service 2023-12-16T05:50:52.642 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T05:50:52.642 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T05:50:52.671 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:-- Logs begin at Sat 2023-12-16 04:41:43 UTC. -- 2023-12-16T05:50:52.948 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:50:53.006 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:50:53.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:53 smithi155 ceph-mon[112451]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:50:53.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:53 smithi155 ceph-mon[112451]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi155:172.21.15.155=smithi155;smithi156:172.21.15.156=smithi156", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:50:53.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:53 smithi155 ceph-mon[112451]: Saving service mon spec with placement smithi155:172.21.15.155=smithi155;smithi156:172.21.15.156=smithi156;count:2 2023-12-16T05:50:53.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:53 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:53.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:53 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:50:53.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.959+0000 7f88ff786700 1 -- 172.21.15.156:0/1041908118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f80fb780 msgr2=0x7f88f80fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:53.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.959+0000 7f88ff786700 1 --2- 172.21.15.156:0/1041908118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f80fb780 0x7f88f80fbb90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f88e80048c0 tx=0x7f88e8009e30 comp rx=0 tx=0).stop 2023-12-16T05:50:53.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.959+0000 7f88ff786700 1 -- 172.21.15.156:0/1041908118 shutdown_connections 2023-12-16T05:50:53.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.959+0000 7f88ff786700 1 --2- 172.21.15.156:0/1041908118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f80fb780 0x7f88f80fbb90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:53.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.959+0000 7f88ff786700 1 -- 172.21.15.156:0/1041908118 >> 172.21.15.156:0/1041908118 conn(0x7f88f80f6e40 msgr2=0x7f88f80f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:53.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.959+0000 7f88ff786700 1 -- 172.21.15.156:0/1041908118 shutdown_connections 2023-12-16T05:50:53.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.959+0000 7f88ff786700 1 -- 172.21.15.156:0/1041908118 wait complete. 2023-12-16T05:50:53.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.960+0000 7f88ff786700 1 Processor -- start 2023-12-16T05:50:53.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.960+0000 7f88ff786700 1 -- start start 2023-12-16T05:50:53.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.960+0000 7f88ff786700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f80fb780 0x7f88f810f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:53.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.960+0000 7f88ff786700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f8065a30 con 0x7f88f80fb780 2023-12-16T05:50:53.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.960+0000 7f88fd522700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f80fb780 0x7f88f810f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:53.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.960+0000 7f88fd522700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f80fb780 0x7f88f810f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.156:37292/0 (socket says 172.21.15.156:37292) 2023-12-16T05:50:53.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.960+0000 7f88fd522700 1 -- 172.21.15.156:0/1857424905 learned_addr learned my addr 172.21.15.156:0/1857424905 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-12-16T05:50:53.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.960+0000 7f88fd522700 1 -- 172.21.15.156:0/1857424905 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e8005040 con 0x7f88f80fb780 2023-12-16T05:50:53.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.960+0000 7f88fd522700 1 --2- 172.21.15.156:0/1857424905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f80fb780 0x7f88f810f7a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f88e800b690 tx=0x7f88e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:53.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.961+0000 7f88edffb700 1 -- 172.21.15.156:0/1857424905 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88e8009650 con 0x7f88f80fb780 2023-12-16T05:50:53.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.961+0000 7f88edffb700 1 -- 172.21.15.156:0/1857424905 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f88e80097b0 con 0x7f88f80fb780 2023-12-16T05:50:53.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.961+0000 7f88edffb700 1 -- 172.21.15.156:0/1857424905 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88e801c5d0 con 0x7f88f80fb780 2023-12-16T05:50:53.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.961+0000 7f88ff786700 1 -- 172.21.15.156:0/1857424905 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f8065c30 con 0x7f88f80fb780 2023-12-16T05:50:53.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.961+0000 7f88ff786700 1 -- 172.21.15.156:0/1857424905 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f810ff20 con 0x7f88f80fb780 2023-12-16T05:50:53.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.962+0000 7f88edffb700 1 -- 172.21.15.156:0/1857424905 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f88e80139d0 con 0x7f88f80fb780 2023-12-16T05:50:53.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.962+0000 7f88ff786700 1 -- 172.21.15.156:0/1857424905 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f8105410 con 0x7f88f80fb780 2023-12-16T05:50:53.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.962+0000 7f88edffb700 1 --2- 172.21.15.156:0/1857424905 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f88e40366d0 0x7f88e4038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:53.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.962+0000 7f88edffb700 1 -- 172.21.15.156:0/1857424905 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f88e8049940 con 0x7f88f80fb780 2023-12-16T05:50:53.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.962+0000 7f88fcd21700 1 --2- 172.21.15.156:0/1857424905 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f88e40366d0 0x7f88e4038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:53.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.962+0000 7f88fcd21700 1 --2- 172.21.15.156:0/1857424905 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f88e40366d0 0x7f88e4038b80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f88f4009990 tx=0x7f88f4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:53.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:53.967+0000 7f88edffb700 1 -- 172.21.15.156:0/1857424905 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f88e8025400 con 0x7f88f80fb780 2023-12-16T05:50:54.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:54.226+0000 7f88ff786700 1 -- 172.21.15.156:0/1857424905 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f88f804bb80 con 0x7f88f80fb780 2023-12-16T05:50:54.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:54.227+0000 7f88edffb700 1 -- 172.21.15.156:0/1857424905 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f88e8011b60 con 0x7f88f80fb780 2023-12-16T05:50:54.230 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:50:54.230 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"d344784e-9bd6-11ee-95a5-87774f69a715","modified":"2023-12-16T05:49:37.981819Z","created":"2023-12-16T05:49:37.981819Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi155","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T05:50:54.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:54.229+0000 7f88ff786700 1 -- 172.21.15.156:0/1857424905 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f88e40366d0 msgr2=0x7f88e4038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:54.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:54.229+0000 7f88ff786700 1 --2- 172.21.15.156:0/1857424905 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f88e40366d0 0x7f88e4038b80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f88f4009990 tx=0x7f88f4006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:54.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:54.229+0000 7f88ff786700 1 -- 172.21.15.156:0/1857424905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f80fb780 msgr2=0x7f88f810f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:54.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:54.229+0000 7f88ff786700 1 --2- 172.21.15.156:0/1857424905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f80fb780 0x7f88f810f7a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f88e800b690 tx=0x7f88e8009e30 comp rx=0 tx=0).stop 2023-12-16T05:50:54.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:54.229+0000 7f88ff786700 1 -- 172.21.15.156:0/1857424905 shutdown_connections 2023-12-16T05:50:54.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:54.229+0000 7f88ff786700 1 --2- 172.21.15.156:0/1857424905 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f88e40366d0 0x7f88e4038b80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:54.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:54.229+0000 7f88ff786700 1 --2- 172.21.15.156:0/1857424905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f80fb780 0x7f88f810f7a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:54.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:54.229+0000 7f88ff786700 1 -- 172.21.15.156:0/1857424905 >> 172.21.15.156:0/1857424905 conn(0x7f88f80f6e40 msgr2=0x7f88f80f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:54.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:54.229+0000 7f88ff786700 1 -- 172.21.15.156:0/1857424905 shutdown_connections 2023-12-16T05:50:54.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:54.229+0000 7f88ff786700 1 -- 172.21.15.156:0/1857424905 wait complete. 2023-12-16T05:50:54.233 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2023-12-16T05:50:54.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:54 smithi155 ceph-mon[112451]: from='client.? 172.21.15.156:0/1857424905' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:50:55.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:55 smithi155 ceph-mon[112451]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:50:55.590 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T05:50:55.591 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T05:50:55.876 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:50:55.934 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:50:56.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.859+0000 7fd8967fd700 1 -- 172.21.15.156:0/1492621569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8900fab30 msgr2=0x7fd8900faf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:56.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.859+0000 7fd8967fd700 1 --2- 172.21.15.156:0/1492621569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8900fab30 0x7fd8900faf40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd8800048c0 tx=0x7fd880009e30 comp rx=0 tx=0).stop 2023-12-16T05:50:56.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.859+0000 7fd8967fd700 1 -- 172.21.15.156:0/1492621569 shutdown_connections 2023-12-16T05:50:56.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.859+0000 7fd8967fd700 1 --2- 172.21.15.156:0/1492621569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8900fab30 0x7fd8900faf40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:56.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.859+0000 7fd8967fd700 1 -- 172.21.15.156:0/1492621569 >> 172.21.15.156:0/1492621569 conn(0x7fd8900f65d0 msgr2=0x7fd8900f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:56.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.859+0000 7fd8967fd700 1 -- 172.21.15.156:0/1492621569 shutdown_connections 2023-12-16T05:50:56.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.859+0000 7fd8967fd700 1 -- 172.21.15.156:0/1492621569 wait complete. 2023-12-16T05:50:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.859+0000 7fd8967fd700 1 Processor -- start 2023-12-16T05:50:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.860+0000 7fd8967fd700 1 -- start start 2023-12-16T05:50:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.860+0000 7fd8967fd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8900fab30 0x7fd8900fd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.860+0000 7fd8967fd700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8900fbad0 con 0x7fd8900fab30 2023-12-16T05:50:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.860+0000 7fd88ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8900fab30 0x7fd8900fd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.860+0000 7fd88ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8900fab30 0x7fd8900fd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.156:37304/0 (socket says 172.21.15.156:37304) 2023-12-16T05:50:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.860+0000 7fd88ffff700 1 -- 172.21.15.156:0/4254222036 learned_addr learned my addr 172.21.15.156:0/4254222036 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-12-16T05:50:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.860+0000 7fd88ffff700 1 -- 172.21.15.156:0/4254222036 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd880005040 con 0x7fd8900fab30 2023-12-16T05:50:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.860+0000 7fd88ffff700 1 --2- 172.21.15.156:0/4254222036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8900fab30 0x7fd8900fd650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd880009040 tx=0x7fd880009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.861+0000 7fd88cff9700 1 -- 172.21.15.156:0/4254222036 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd880009650 con 0x7fd8900fab30 2023-12-16T05:50:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.861+0000 7fd88cff9700 1 -- 172.21.15.156:0/4254222036 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd8800097b0 con 0x7fd8900fab30 2023-12-16T05:50:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.861+0000 7fd8967fd700 1 -- 172.21.15.156:0/4254222036 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8900fbcd0 con 0x7fd8900fab30 2023-12-16T05:50:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.861+0000 7fd88cff9700 1 -- 172.21.15.156:0/4254222036 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd88001c5b0 con 0x7fd8900fab30 2023-12-16T05:50:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.861+0000 7fd8967fd700 1 -- 172.21.15.156:0/4254222036 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8900fc1c0 con 0x7fd8900fab30 2023-12-16T05:50:56.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.861+0000 7fd88cff9700 1 -- 172.21.15.156:0/4254222036 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7fd880013420 con 0x7fd8900fab30 2023-12-16T05:50:56.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.861+0000 7fd8967fd700 1 -- 172.21.15.156:0/4254222036 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8901064a0 con 0x7fd8900fab30 2023-12-16T05:50:56.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.861+0000 7fd88cff9700 1 --2- 172.21.15.156:0/4254222036 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fd87c0366d0 0x7fd87c038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:56.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.862+0000 7fd88cff9700 1 -- 172.21.15.156:0/4254222036 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd880049970 con 0x7fd8900fab30 2023-12-16T05:50:56.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.862+0000 7fd88f7fe700 1 --2- 172.21.15.156:0/4254222036 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fd87c0366d0 0x7fd87c038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:56.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.862+0000 7fd88f7fe700 1 --2- 172.21.15.156:0/4254222036 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fd87c0366d0 0x7fd87c038b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd878009990 tx=0x7fd878006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:56.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:56.867+0000 7fd88cff9700 1 -- 172.21.15.156:0/4254222036 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd8800139d0 con 0x7fd8900fab30 2023-12-16T05:50:57.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:57.124+0000 7fd8967fd700 1 -- 172.21.15.156:0/4254222036 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd89004bb80 con 0x7fd8900fab30 2023-12-16T05:50:57.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:57.125+0000 7fd88cff9700 1 -- 172.21.15.156:0/4254222036 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fd880011370 con 0x7fd8900fab30 2023-12-16T05:50:57.128 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:50:57.128 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"d344784e-9bd6-11ee-95a5-87774f69a715","modified":"2023-12-16T05:49:37.981819Z","created":"2023-12-16T05:49:37.981819Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi155","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T05:50:57.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:57.127+0000 7fd8967fd700 1 -- 172.21.15.156:0/4254222036 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fd87c0366d0 msgr2=0x7fd87c038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:57.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:57.127+0000 7fd8967fd700 1 --2- 172.21.15.156:0/4254222036 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fd87c0366d0 0x7fd87c038b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd878009990 tx=0x7fd878006e40 comp rx=0 tx=0).stop 2023-12-16T05:50:57.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:57.127+0000 7fd8967fd700 1 -- 172.21.15.156:0/4254222036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8900fab30 msgr2=0x7fd8900fd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:57.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:57.127+0000 7fd8967fd700 1 --2- 172.21.15.156:0/4254222036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8900fab30 0x7fd8900fd650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd880009040 tx=0x7fd880009e30 comp rx=0 tx=0).stop 2023-12-16T05:50:57.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:57.127+0000 7fd8967fd700 1 -- 172.21.15.156:0/4254222036 shutdown_connections 2023-12-16T05:50:57.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:57.127+0000 7fd8967fd700 1 --2- 172.21.15.156:0/4254222036 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fd87c0366d0 0x7fd87c038b80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:57.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:57.127+0000 7fd8967fd700 1 --2- 172.21.15.156:0/4254222036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8900fab30 0x7fd8900fd650 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:57.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:57.127+0000 7fd8967fd700 1 -- 172.21.15.156:0/4254222036 >> 172.21.15.156:0/4254222036 conn(0x7fd8900f65d0 msgr2=0x7fd8900f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:57.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:57.127+0000 7fd8967fd700 1 -- 172.21.15.156:0/4254222036 shutdown_connections 2023-12-16T05:50:57.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:57.127+0000 7fd8967fd700 1 -- 172.21.15.156:0/4254222036 wait complete. 2023-12-16T05:50:57.131 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2023-12-16T05:50:57.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:57 smithi155 ceph-mon[112451]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:50:57.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:57 smithi155 ceph-mon[112451]: from='client.? 172.21.15.156:0/4254222036' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:50:58.525 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T05:50:58.526 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T05:50:58.806 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:50:58.862 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:50:59.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:50:59 smithi155 ceph-mon[112451]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:50:59.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.891+0000 7f0febfaa700 1 -- 172.21.15.156:0/947428921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fe40fb700 msgr2=0x7f0fe40fbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:50:59.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.891+0000 7f0febfaa700 1 --2- 172.21.15.156:0/947428921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fe40fb700 0x7f0fe40fbb10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40048c0 tx=0x7f0fd4009e30 comp rx=0 tx=0).stop 2023-12-16T05:50:59.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.891+0000 7f0febfaa700 1 -- 172.21.15.156:0/947428921 shutdown_connections 2023-12-16T05:50:59.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.891+0000 7f0febfaa700 1 --2- 172.21.15.156:0/947428921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fe40fb700 0x7f0fe40fbb10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:50:59.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.891+0000 7f0febfaa700 1 -- 172.21.15.156:0/947428921 >> 172.21.15.156:0/947428921 conn(0x7f0fe40f6e80 msgr2=0x7f0fe40f9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:50:59.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.891+0000 7f0febfaa700 1 -- 172.21.15.156:0/947428921 shutdown_connections 2023-12-16T05:50:59.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.891+0000 7f0febfaa700 1 -- 172.21.15.156:0/947428921 wait complete. 2023-12-16T05:50:59.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.892+0000 7f0febfaa700 1 Processor -- start 2023-12-16T05:50:59.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.892+0000 7f0febfaa700 1 -- start start 2023-12-16T05:50:59.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.892+0000 7f0febfaa700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fe40fb700 0x7f0fe410f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:59.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.892+0000 7f0febfaa700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe4065a30 con 0x7f0fe40fb700 2023-12-16T05:50:59.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.893+0000 7f0fe9d46700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fe40fb700 0x7f0fe410f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:59.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.893+0000 7f0fe9d46700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fe40fb700 0x7f0fe410f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.156:37332/0 (socket says 172.21.15.156:37332) 2023-12-16T05:50:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.893+0000 7f0fe9d46700 1 -- 172.21.15.156:0/1235803299 learned_addr learned my addr 172.21.15.156:0/1235803299 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-12-16T05:50:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.893+0000 7f0fe9d46700 1 -- 172.21.15.156:0/1235803299 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd4005040 con 0x7f0fe40fb700 2023-12-16T05:50:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.893+0000 7f0fe9d46700 1 --2- 172.21.15.156:0/1235803299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fe40fb700 0x7f0fe410f720 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4009040 tx=0x7f0fd4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.893+0000 7f0fda7fc700 1 -- 172.21.15.156:0/1235803299 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0fd4009620 con 0x7f0fe40fb700 2023-12-16T05:50:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.893+0000 7f0fda7fc700 1 -- 172.21.15.156:0/1235803299 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0fd4009780 con 0x7f0fe40fb700 2023-12-16T05:50:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.893+0000 7f0febfaa700 1 -- 172.21.15.156:0/1235803299 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe4065c30 con 0x7f0fe40fb700 2023-12-16T05:50:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.893+0000 7f0fda7fc700 1 -- 172.21.15.156:0/1235803299 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0fd401c5b0 con 0x7f0fe40fb700 2023-12-16T05:50:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.893+0000 7f0febfaa700 1 -- 172.21.15.156:0/1235803299 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe410fea0 con 0x7f0fe40fb700 2023-12-16T05:50:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.894+0000 7f0fda7fc700 1 -- 172.21.15.156:0/1235803299 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f0fd401c870 con 0x7f0fe40fb700 2023-12-16T05:50:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.894+0000 7f0febfaa700 1 -- 172.21.15.156:0/1235803299 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe4105310 con 0x7f0fe40fb700 2023-12-16T05:50:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.894+0000 7f0fda7fc700 1 --2- 172.21.15.156:0/1235803299 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f0fd00366e0 0x7f0fd0038b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:50:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.894+0000 7f0fda7fc700 1 -- 172.21.15.156:0/1235803299 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0fd4049a70 con 0x7f0fe40fb700 2023-12-16T05:50:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.894+0000 7f0fe9545700 1 --2- 172.21.15.156:0/1235803299 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f0fd00366e0 0x7f0fd0038b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:50:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.895+0000 7f0fe9545700 1 --2- 172.21.15.156:0/1235803299 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f0fd00366e0 0x7f0fd0038b90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0009990 tx=0x7f0fe0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:50:59.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:50:59.900+0000 7f0fda7fc700 1 -- 172.21.15.156:0/1235803299 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0fd4023300 con 0x7f0fe40fb700 2023-12-16T05:51:00.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:00.155+0000 7f0febfaa700 1 -- 172.21.15.156:0/1235803299 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0fe404bb80 con 0x7f0fe40fb700 2023-12-16T05:51:00.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:00.157+0000 7f0fda7fc700 1 -- 172.21.15.156:0/1235803299 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f0fd4011b60 con 0x7f0fe40fb700 2023-12-16T05:51:00.159 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:51:00.159 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"d344784e-9bd6-11ee-95a5-87774f69a715","modified":"2023-12-16T05:49:37.981819Z","created":"2023-12-16T05:49:37.981819Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi155","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T05:51:00.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:00.158+0000 7f0febfaa700 1 -- 172.21.15.156:0/1235803299 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f0fd00366e0 msgr2=0x7f0fd0038b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:00.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:00.158+0000 7f0febfaa700 1 --2- 172.21.15.156:0/1235803299 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f0fd00366e0 0x7f0fd0038b90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0009990 tx=0x7f0fe0006e40 comp rx=0 tx=0).stop 2023-12-16T05:51:00.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:00.158+0000 7f0febfaa700 1 -- 172.21.15.156:0/1235803299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fe40fb700 msgr2=0x7f0fe410f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:00.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:00.158+0000 7f0febfaa700 1 --2- 172.21.15.156:0/1235803299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fe40fb700 0x7f0fe410f720 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4009040 tx=0x7f0fd4009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:00.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:00.158+0000 7f0febfaa700 1 -- 172.21.15.156:0/1235803299 shutdown_connections 2023-12-16T05:51:00.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:00.158+0000 7f0febfaa700 1 --2- 172.21.15.156:0/1235803299 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f0fd00366e0 0x7f0fd0038b90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:00.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:00.158+0000 7f0febfaa700 1 --2- 172.21.15.156:0/1235803299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fe40fb700 0x7f0fe410f720 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:00.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:00.158+0000 7f0febfaa700 1 -- 172.21.15.156:0/1235803299 >> 172.21.15.156:0/1235803299 conn(0x7f0fe40f6e80 msgr2=0x7f0fe40f7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:00.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:00.158+0000 7f0febfaa700 1 -- 172.21.15.156:0/1235803299 shutdown_connections 2023-12-16T05:51:00.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:00.158+0000 7f0febfaa700 1 -- 172.21.15.156:0/1235803299 wait complete. 2023-12-16T05:51:00.162 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2023-12-16T05:51:00.477 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:00 smithi155 ceph-mon[112451]: from='client.? 172.21.15.156:0/1235803299' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:01.456 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:01 smithi155 ceph-mon[112451]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:01.456 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:01 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:01.456 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:01 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:01.540 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T05:51:01.541 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T05:51:01.818 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:51:01.877 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:51:02.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:02 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:02.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:02 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:02.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:02 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:02.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:02 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:02.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:02 smithi155 ceph-mon[112451]: Deploying daemon prometheus.smithi155 on smithi155 2023-12-16T05:51:02.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.903+0000 7fbb34415700 1 -- 172.21.15.156:0/1867558032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb2c0fc870 msgr2=0x7fbb2c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:02.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.903+0000 7fbb34415700 1 --2- 172.21.15.156:0/1867558032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb2c0fc870 0x7fbb2c0fcc80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbb280048c0 tx=0x7fbb28009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:02.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.903+0000 7fbb34415700 1 -- 172.21.15.156:0/1867558032 shutdown_connections 2023-12-16T05:51:02.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.903+0000 7fbb34415700 1 --2- 172.21.15.156:0/1867558032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb2c0fc870 0x7fbb2c0fcc80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:02.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.903+0000 7fbb34415700 1 -- 172.21.15.156:0/1867558032 >> 172.21.15.156:0/1867558032 conn(0x7fbb2c0f7f50 msgr2=0x7fbb2c0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:02.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.903+0000 7fbb34415700 1 -- 172.21.15.156:0/1867558032 shutdown_connections 2023-12-16T05:51:02.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.903+0000 7fbb34415700 1 -- 172.21.15.156:0/1867558032 wait complete. 2023-12-16T05:51:02.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.904+0000 7fbb34415700 1 Processor -- start 2023-12-16T05:51:02.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.904+0000 7fbb34415700 1 -- start start 2023-12-16T05:51:02.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.904+0000 7fbb34415700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb2c0fc870 0x7fbb2c10ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:02.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.904+0000 7fbb34415700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c10cfd0 con 0x7fbb2c0fc870 2023-12-16T05:51:02.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.904+0000 7fbb321b1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb2c0fc870 0x7fbb2c10ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:02.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.904+0000 7fbb321b1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb2c0fc870 0x7fbb2c10ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.156:35030/0 (socket says 172.21.15.156:35030) 2023-12-16T05:51:02.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.904+0000 7fbb321b1700 1 -- 172.21.15.156:0/2620931238 learned_addr learned my addr 172.21.15.156:0/2620931238 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-12-16T05:51:02.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.904+0000 7fbb321b1700 1 -- 172.21.15.156:0/2620931238 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb28005040 con 0x7fbb2c0fc870 2023-12-16T05:51:02.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.904+0000 7fbb321b1700 1 --2- 172.21.15.156:0/2620931238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb2c0fc870 0x7fbb2c10ca90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800b690 tx=0x7fbb28009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:02.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.904+0000 7fbb22ffd700 1 -- 172.21.15.156:0/2620931238 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb28009650 con 0x7fbb2c0fc870 2023-12-16T05:51:02.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.904+0000 7fbb34415700 1 -- 172.21.15.156:0/2620931238 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2c10d1d0 con 0x7fbb2c0fc870 2023-12-16T05:51:02.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.904+0000 7fbb22ffd700 1 -- 172.21.15.156:0/2620931238 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbb280097b0 con 0x7fbb2c0fc870 2023-12-16T05:51:02.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.904+0000 7fbb22ffd700 1 -- 172.21.15.156:0/2620931238 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb2801c5d0 con 0x7fbb2c0fc870 2023-12-16T05:51:02.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.905+0000 7fbb34415700 1 -- 172.21.15.156:0/2620931238 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2c10de70 con 0x7fbb2c0fc870 2023-12-16T05:51:02.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.905+0000 7fbb22ffd700 1 -- 172.21.15.156:0/2620931238 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7fbb28013420 con 0x7fbb2c0fc870 2023-12-16T05:51:02.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.905+0000 7fbb34415700 1 -- 172.21.15.156:0/2620931238 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2c05f270 con 0x7fbb2c0fc870 2023-12-16T05:51:02.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.905+0000 7fbb22ffd700 1 --2- 172.21.15.156:0/2620931238 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fbb180366d0 0x7fbb18038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:02.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.905+0000 7fbb22ffd700 1 -- 172.21.15.156:0/2620931238 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbb28049950 con 0x7fbb2c0fc870 2023-12-16T05:51:02.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.906+0000 7fbb319b0700 1 --2- 172.21.15.156:0/2620931238 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fbb180366d0 0x7fbb18038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:02.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.906+0000 7fbb319b0700 1 --2- 172.21.15.156:0/2620931238 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fbb180366d0 0x7fbb18038b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c009990 tx=0x7fbb1c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:02.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:02.911+0000 7fbb22ffd700 1 -- 172.21.15.156:0/2620931238 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbb28025780 con 0x7fbb2c0fc870 2023-12-16T05:51:03.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:03.165+0000 7fbb34415700 1 -- 172.21.15.156:0/2620931238 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbb2c10e9c0 con 0x7fbb2c0fc870 2023-12-16T05:51:03.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:03.165+0000 7fbb22ffd700 1 -- 172.21.15.156:0/2620931238 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fbb28011370 con 0x7fbb2c0fc870 2023-12-16T05:51:03.167 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:51:03.167 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"d344784e-9bd6-11ee-95a5-87774f69a715","modified":"2023-12-16T05:49:37.981819Z","created":"2023-12-16T05:49:37.981819Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi155","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T05:51:03.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:03.167+0000 7fbb34415700 1 -- 172.21.15.156:0/2620931238 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fbb180366d0 msgr2=0x7fbb18038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:03.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:03.167+0000 7fbb34415700 1 --2- 172.21.15.156:0/2620931238 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fbb180366d0 0x7fbb18038b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c009990 tx=0x7fbb1c006e40 comp rx=0 tx=0).stop 2023-12-16T05:51:03.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:03.167+0000 7fbb34415700 1 -- 172.21.15.156:0/2620931238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb2c0fc870 msgr2=0x7fbb2c10ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:03.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:03.167+0000 7fbb34415700 1 --2- 172.21.15.156:0/2620931238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb2c0fc870 0x7fbb2c10ca90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800b690 tx=0x7fbb28009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:03.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:03.167+0000 7fbb34415700 1 -- 172.21.15.156:0/2620931238 shutdown_connections 2023-12-16T05:51:03.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:03.167+0000 7fbb34415700 1 --2- 172.21.15.156:0/2620931238 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fbb180366d0 0x7fbb18038b80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:03.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:03.167+0000 7fbb34415700 1 --2- 172.21.15.156:0/2620931238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb2c0fc870 0x7fbb2c10ca90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:03.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:03.167+0000 7fbb34415700 1 -- 172.21.15.156:0/2620931238 >> 172.21.15.156:0/2620931238 conn(0x7fbb2c0f7f50 msgr2=0x7fbb2c0f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:03.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:03.167+0000 7fbb34415700 1 -- 172.21.15.156:0/2620931238 shutdown_connections 2023-12-16T05:51:03.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:03.167+0000 7fbb34415700 1 -- 172.21.15.156:0/2620931238 wait complete. 2023-12-16T05:51:03.170 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2023-12-16T05:51:03.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:03 smithi155 ceph-mon[112451]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:03.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:03 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:03.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:03 smithi155 ceph-mon[112451]: from='client.? 172.21.15.156:0/2620931238' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:04.555 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T05:51:04.556 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T05:51:04.845 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:51:04.913 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:51:05.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:05 smithi155 ceph-mon[112451]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:05.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.844+0000 7f22684cf700 1 -- 172.21.15.156:0/2886104721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22600fb780 msgr2=0x7f22600fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:05.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.844+0000 7f22684cf700 1 --2- 172.21.15.156:0/2886104721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22600fb780 0x7f22600fbb90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f225c0048c0 tx=0x7f225c009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:05.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.844+0000 7f22684cf700 1 -- 172.21.15.156:0/2886104721 shutdown_connections 2023-12-16T05:51:05.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.844+0000 7f22684cf700 1 --2- 172.21.15.156:0/2886104721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22600fb780 0x7f22600fbb90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:05.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.844+0000 7f22684cf700 1 -- 172.21.15.156:0/2886104721 >> 172.21.15.156:0/2886104721 conn(0x7f22600f6e40 msgr2=0x7f22600f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:05.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.844+0000 7f22684cf700 1 -- 172.21.15.156:0/2886104721 shutdown_connections 2023-12-16T05:51:05.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.844+0000 7f22684cf700 1 -- 172.21.15.156:0/2886104721 wait complete. 2023-12-16T05:51:05.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.845+0000 7f22684cf700 1 Processor -- start 2023-12-16T05:51:05.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.845+0000 7f22684cf700 1 -- start start 2023-12-16T05:51:05.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.845+0000 7f22684cf700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22600fb780 0x7f226010b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:05.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.845+0000 7f22684cf700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226010bee0 con 0x7f22600fb780 2023-12-16T05:51:05.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.845+0000 7f226626b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22600fb780 0x7f226010b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:05.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.845+0000 7f226626b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22600fb780 0x7f226010b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.156:35048/0 (socket says 172.21.15.156:35048) 2023-12-16T05:51:05.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.845+0000 7f226626b700 1 -- 172.21.15.156:0/715102433 learned_addr learned my addr 172.21.15.156:0/715102433 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-12-16T05:51:05.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.845+0000 7f226626b700 1 -- 172.21.15.156:0/715102433 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c005040 con 0x7f22600fb780 2023-12-16T05:51:05.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.845+0000 7f226626b700 1 --2- 172.21.15.156:0/715102433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22600fb780 0x7f226010b9a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f225c00b690 tx=0x7f225c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:05.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.846+0000 7f2256ffd700 1 -- 172.21.15.156:0/715102433 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f225c009650 con 0x7f22600fb780 2023-12-16T05:51:05.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.846+0000 7f2256ffd700 1 -- 172.21.15.156:0/715102433 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f225c0097b0 con 0x7f22600fb780 2023-12-16T05:51:05.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.846+0000 7f22684cf700 1 -- 172.21.15.156:0/715102433 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226010c0e0 con 0x7f22600fb780 2023-12-16T05:51:05.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.846+0000 7f2256ffd700 1 -- 172.21.15.156:0/715102433 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f225c01c5d0 con 0x7f22600fb780 2023-12-16T05:51:05.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.846+0000 7f22684cf700 1 -- 172.21.15.156:0/715102433 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226010cd80 con 0x7f22600fb780 2023-12-16T05:51:05.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.846+0000 7f2256ffd700 1 -- 172.21.15.156:0/715102433 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f225c01c730 con 0x7f22600fb780 2023-12-16T05:51:05.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.846+0000 7f2256ffd700 1 --2- 172.21.15.156:0/715102433 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f224c036720 0x7f224c038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:05.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.847+0000 7f2256ffd700 1 -- 172.21.15.156:0/715102433 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f225c049910 con 0x7f22600fb780 2023-12-16T05:51:05.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.847+0000 7f22684cf700 1 -- 172.21.15.156:0/715102433 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226005f270 con 0x7f22600fb780 2023-12-16T05:51:05.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.847+0000 7f2265a6a700 1 --2- 172.21.15.156:0/715102433 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f224c036720 0x7f224c038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:05.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.847+0000 7f2265a6a700 1 --2- 172.21.15.156:0/715102433 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f224c036720 0x7f224c038bd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2250009990 tx=0x7f2250006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:05.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:05.852+0000 7f2256ffd700 1 -- 172.21.15.156:0/715102433 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f225c0123c0 con 0x7f22600fb780 2023-12-16T05:51:06.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:06.107+0000 7f22684cf700 1 -- 172.21.15.156:0/715102433 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f226010d830 con 0x7f22600fb780 2023-12-16T05:51:06.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:06.108+0000 7f2256ffd700 1 -- 172.21.15.156:0/715102433 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f225c023300 con 0x7f22600fb780 2023-12-16T05:51:06.110 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:51:06.110 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"d344784e-9bd6-11ee-95a5-87774f69a715","modified":"2023-12-16T05:49:37.981819Z","created":"2023-12-16T05:49:37.981819Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi155","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T05:51:06.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:06.110+0000 7f22684cf700 1 -- 172.21.15.156:0/715102433 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f224c036720 msgr2=0x7f224c038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:06.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:06.110+0000 7f22684cf700 1 --2- 172.21.15.156:0/715102433 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f224c036720 0x7f224c038bd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2250009990 tx=0x7f2250006e40 comp rx=0 tx=0).stop 2023-12-16T05:51:06.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:06.110+0000 7f22684cf700 1 -- 172.21.15.156:0/715102433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22600fb780 msgr2=0x7f226010b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:06.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:06.110+0000 7f22684cf700 1 --2- 172.21.15.156:0/715102433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22600fb780 0x7f226010b9a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f225c00b690 tx=0x7f225c009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:06.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:06.110+0000 7f22684cf700 1 -- 172.21.15.156:0/715102433 shutdown_connections 2023-12-16T05:51:06.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:06.110+0000 7f22684cf700 1 --2- 172.21.15.156:0/715102433 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7f224c036720 0x7f224c038bd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:06.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:06.110+0000 7f22684cf700 1 --2- 172.21.15.156:0/715102433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22600fb780 0x7f226010b9a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:06.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:06.110+0000 7f22684cf700 1 -- 172.21.15.156:0/715102433 >> 172.21.15.156:0/715102433 conn(0x7f22600f6e40 msgr2=0x7f22600f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:06.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:06.110+0000 7f22684cf700 1 -- 172.21.15.156:0/715102433 shutdown_connections 2023-12-16T05:51:06.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:06.110+0000 7f22684cf700 1 -- 172.21.15.156:0/715102433 wait complete. 2023-12-16T05:51:06.113 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2023-12-16T05:51:06.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:06 smithi155 ceph-mon[112451]: from='client.? 172.21.15.156:0/715102433' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:07.500 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T05:51:07.500 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T05:51:07.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:07 smithi155 ceph-mon[112451]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:07.788 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:51:07.846 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:51:09.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.164+0000 7fafbf063700 1 -- 172.21.15.156:0/1661413145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafb80fc860 msgr2=0x7fafb80fcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:09.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.164+0000 7fafbf063700 1 --2- 172.21.15.156:0/1661413145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafb80fc860 0x7fafb80fcc70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fafac0048c0 tx=0x7fafac009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:09.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.165+0000 7fafbf063700 1 -- 172.21.15.156:0/1661413145 shutdown_connections 2023-12-16T05:51:09.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.165+0000 7fafbf063700 1 --2- 172.21.15.156:0/1661413145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafb80fc860 0x7fafb80fcc70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:09.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.165+0000 7fafbf063700 1 -- 172.21.15.156:0/1661413145 >> 172.21.15.156:0/1661413145 conn(0x7fafb80f7fe0 msgr2=0x7fafb80fa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:09.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.165+0000 7fafbf063700 1 -- 172.21.15.156:0/1661413145 shutdown_connections 2023-12-16T05:51:09.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.165+0000 7fafbf063700 1 -- 172.21.15.156:0/1661413145 wait complete. 2023-12-16T05:51:09.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.165+0000 7fafbf063700 1 Processor -- start 2023-12-16T05:51:09.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.165+0000 7fafbf063700 1 -- start start 2023-12-16T05:51:09.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.166+0000 7fafbf063700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafb80fc860 0x7fafb810ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:09.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.166+0000 7fafbf063700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb810cfb0 con 0x7fafb80fc860 2023-12-16T05:51:09.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.166+0000 7fafbcdff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafb80fc860 0x7fafb810ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:09.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.166+0000 7fafbcdff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafb80fc860 0x7fafb810ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.156:35076/0 (socket says 172.21.15.156:35076) 2023-12-16T05:51:09.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.166+0000 7fafbcdff700 1 -- 172.21.15.156:0/2717233197 learned_addr learned my addr 172.21.15.156:0/2717233197 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-12-16T05:51:09.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.166+0000 7fafbcdff700 1 -- 172.21.15.156:0/2717233197 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac005040 con 0x7fafb80fc860 2023-12-16T05:51:09.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.166+0000 7fafbcdff700 1 --2- 172.21.15.156:0/2717233197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafb80fc860 0x7fafb810ca70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fafac009040 tx=0x7fafac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:09.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.166+0000 7fafb57fa700 1 -- 172.21.15.156:0/2717233197 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafac009620 con 0x7fafb80fc860 2023-12-16T05:51:09.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.166+0000 7fafb57fa700 1 -- 172.21.15.156:0/2717233197 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fafac009780 con 0x7fafb80fc860 2023-12-16T05:51:09.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.166+0000 7fafb57fa700 1 -- 172.21.15.156:0/2717233197 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafac01c5b0 con 0x7fafb80fc860 2023-12-16T05:51:09.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.166+0000 7fafbf063700 1 -- 172.21.15.156:0/2717233197 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb810d1b0 con 0x7fafb80fc860 2023-12-16T05:51:09.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.166+0000 7fafbf063700 1 -- 172.21.15.156:0/2717233197 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb810de50 con 0x7fafb80fc860 2023-12-16T05:51:09.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.167+0000 7fafb57fa700 1 -- 172.21.15.156:0/2717233197 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7fafac01c820 con 0x7fafb80fc860 2023-12-16T05:51:09.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.167+0000 7fafb57fa700 1 --2- 172.21.15.156:0/2717233197 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fafa8036720 0x7fafa8038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:09.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.167+0000 7fafb57fa700 1 -- 172.21.15.156:0/2717233197 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fafac04a880 con 0x7fafb80fc860 2023-12-16T05:51:09.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.167+0000 7fafb7fff700 1 --2- 172.21.15.156:0/2717233197 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fafa8036720 0x7fafa8038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:09.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.167+0000 7fafbf063700 1 -- 172.21.15.156:0/2717233197 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb805f270 con 0x7fafb80fc860 2023-12-16T05:51:09.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.168+0000 7fafb7fff700 1 --2- 172.21.15.156:0/2717233197 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fafa8036720 0x7fafa8038bd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009990 tx=0x7fafa4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:09.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.172+0000 7fafb57fa700 1 -- 172.21.15.156:0/2717233197 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fafac023300 con 0x7fafb80fc860 2023-12-16T05:51:09.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.426+0000 7fafbf063700 1 -- 172.21.15.156:0/2717233197 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fafb810e860 con 0x7fafb80fc860 2023-12-16T05:51:09.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.427+0000 7fafb57fa700 1 -- 172.21.15.156:0/2717233197 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fafac011b60 con 0x7fafb80fc860 2023-12-16T05:51:09.429 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:51:09.429 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"d344784e-9bd6-11ee-95a5-87774f69a715","modified":"2023-12-16T05:49:37.981819Z","created":"2023-12-16T05:49:37.981819Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi155","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T05:51:09.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.429+0000 7fafbf063700 1 -- 172.21.15.156:0/2717233197 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fafa8036720 msgr2=0x7fafa8038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:09.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.429+0000 7fafbf063700 1 --2- 172.21.15.156:0/2717233197 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fafa8036720 0x7fafa8038bd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009990 tx=0x7fafa4006e40 comp rx=0 tx=0).stop 2023-12-16T05:51:09.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.429+0000 7fafbf063700 1 -- 172.21.15.156:0/2717233197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafb80fc860 msgr2=0x7fafb810ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:09.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.429+0000 7fafbf063700 1 --2- 172.21.15.156:0/2717233197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafb80fc860 0x7fafb810ca70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fafac009040 tx=0x7fafac009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:09.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.429+0000 7fafbf063700 1 -- 172.21.15.156:0/2717233197 shutdown_connections 2023-12-16T05:51:09.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.429+0000 7fafbf063700 1 --2- 172.21.15.156:0/2717233197 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fafa8036720 0x7fafa8038bd0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:09.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.429+0000 7fafbf063700 1 --2- 172.21.15.156:0/2717233197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fafb80fc860 0x7fafb810ca70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:09.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.429+0000 7fafbf063700 1 -- 172.21.15.156:0/2717233197 >> 172.21.15.156:0/2717233197 conn(0x7fafb80f7fe0 msgr2=0x7fafb80f8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:09.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.429+0000 7fafbf063700 1 -- 172.21.15.156:0/2717233197 shutdown_connections 2023-12-16T05:51:09.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:09.429+0000 7fafbf063700 1 -- 172.21.15.156:0/2717233197 wait complete. 2023-12-16T05:51:09.432 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2023-12-16T05:51:09.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:09 smithi155 ceph-mon[112451]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:09.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:09 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:09.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:09 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:09.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:09 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:09.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:09 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-16T05:51:10.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:10 smithi155 ceph-mon[112451]: from='client.? 172.21.15.156:0/2717233197' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:10.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:10 smithi155 ceph-mon[112451]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-16T05:51:10.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:10 smithi155 ceph-mon[112451]: mgrmap e14: smithi155.maowdn(active, since 41s) 2023-12-16T05:51:10.819 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T05:51:10.819 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T05:51:11.099 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:51:11.157 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:51:12.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.251+0000 7fcf4dbfd700 1 -- 172.21.15.156:0/42694622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf480fb770 msgr2=0x7fcf480fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:12.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.251+0000 7fcf4dbfd700 1 --2- 172.21.15.156:0/42694622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf480fb770 0x7fcf480fbb80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcf300048c0 tx=0x7fcf30009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:12.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.251+0000 7fcf4dbfd700 1 -- 172.21.15.156:0/42694622 shutdown_connections 2023-12-16T05:51:12.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.251+0000 7fcf4dbfd700 1 --2- 172.21.15.156:0/42694622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf480fb770 0x7fcf480fbb80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:12.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.251+0000 7fcf4dbfd700 1 -- 172.21.15.156:0/42694622 >> 172.21.15.156:0/42694622 conn(0x7fcf480f6e50 msgr2=0x7fcf480f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:12.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.251+0000 7fcf4dbfd700 1 -- 172.21.15.156:0/42694622 shutdown_connections 2023-12-16T05:51:12.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.251+0000 7fcf4dbfd700 1 -- 172.21.15.156:0/42694622 wait complete. 2023-12-16T05:51:12.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.252+0000 7fcf4dbfd700 1 Processor -- start 2023-12-16T05:51:12.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.252+0000 7fcf4dbfd700 1 -- start start 2023-12-16T05:51:12.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.252+0000 7fcf4dbfd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf480fb770 0x7fcf4810b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:12.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.252+0000 7fcf4dbfd700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4810bec0 con 0x7fcf480fb770 2023-12-16T05:51:12.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.252+0000 7fcf477fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf480fb770 0x7fcf4810b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:12.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.252+0000 7fcf477fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf480fb770 0x7fcf4810b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.156:35092/0 (socket says 172.21.15.156:35092) 2023-12-16T05:51:12.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.252+0000 7fcf477fe700 1 -- 172.21.15.156:0/3939083186 learned_addr learned my addr 172.21.15.156:0/3939083186 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-12-16T05:51:12.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.253+0000 7fcf477fe700 1 -- 172.21.15.156:0/3939083186 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf30005040 con 0x7fcf480fb770 2023-12-16T05:51:12.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.253+0000 7fcf477fe700 1 --2- 172.21.15.156:0/3939083186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf480fb770 0x7fcf4810b980 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009330 tx=0x7fcf30009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:12.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.253+0000 7fcf3ffff700 1 -- 172.21.15.156:0/3939083186 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf300096b0 con 0x7fcf480fb770 2023-12-16T05:51:12.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.253+0000 7fcf4dbfd700 1 -- 172.21.15.156:0/3939083186 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4810c0c0 con 0x7fcf480fb770 2023-12-16T05:51:12.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.253+0000 7fcf3ffff700 1 -- 172.21.15.156:0/3939083186 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcf30009810 con 0x7fcf480fb770 2023-12-16T05:51:12.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.253+0000 7fcf3ffff700 1 -- 172.21.15.156:0/3939083186 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf3001c5b0 con 0x7fcf480fb770 2023-12-16T05:51:12.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.253+0000 7fcf4dbfd700 1 -- 172.21.15.156:0/3939083186 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4810cd60 con 0x7fcf480fb770 2023-12-16T05:51:12.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.254+0000 7fcf3ffff700 1 -- 172.21.15.156:0/3939083186 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 14) v1 ==== 43352+0+0 (secure 0 0 0) 0x7fcf30013420 con 0x7fcf480fb770 2023-12-16T05:51:12.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.254+0000 7fcf4dbfd700 1 -- 172.21.15.156:0/3939083186 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4805f270 con 0x7fcf480fb770 2023-12-16T05:51:12.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.254+0000 7fcf3ffff700 1 --2- 172.21.15.156:0/3939083186 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fcf34036720 0x7fcf34038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:12.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.254+0000 7fcf3ffff700 1 -- 172.21.15.156:0/3939083186 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcf30049ae0 con 0x7fcf480fb770 2023-12-16T05:51:12.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.254+0000 7fcf46ffd700 1 -- 172.21.15.156:0/3939083186 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fcf34036720 msgr2=0x7fcf34038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6800/2821498015 2023-12-16T05:51:12.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.254+0000 7fcf46ffd700 1 --2- 172.21.15.156:0/3939083186 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fcf34036720 0x7fcf34038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T05:51:12.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.262+0000 7fcf3ffff700 1 -- 172.21.15.156:0/3939083186 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcf300119c0 con 0x7fcf480fb770 2023-12-16T05:51:12.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.455+0000 7fcf46ffd700 1 -- 172.21.15.156:0/3939083186 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fcf34036720 msgr2=0x7fcf34038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6800/2821498015 2023-12-16T05:51:12.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.455+0000 7fcf46ffd700 1 --2- 172.21.15.156:0/3939083186 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fcf34036720 0x7fcf34038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T05:51:12.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.520+0000 7fcf4dbfd700 1 -- 172.21.15.156:0/3939083186 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcf4810d8b0 con 0x7fcf480fb770 2023-12-16T05:51:12.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.520+0000 7fcf3ffff700 1 -- 172.21.15.156:0/3939083186 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fcf30011370 con 0x7fcf480fb770 2023-12-16T05:51:12.522 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:51:12.523 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"d344784e-9bd6-11ee-95a5-87774f69a715","modified":"2023-12-16T05:49:37.981819Z","created":"2023-12-16T05:49:37.981819Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi155","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T05:51:12.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.523+0000 7fcf4dbfd700 1 -- 172.21.15.156:0/3939083186 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fcf34036720 msgr2=0x7fcf34038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T05:51:12.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.523+0000 7fcf4dbfd700 1 --2- 172.21.15.156:0/3939083186 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fcf34036720 0x7fcf34038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:12.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.523+0000 7fcf4dbfd700 1 -- 172.21.15.156:0/3939083186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf480fb770 msgr2=0x7fcf4810b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:12.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.523+0000 7fcf4dbfd700 1 --2- 172.21.15.156:0/3939083186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf480fb770 0x7fcf4810b980 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009330 tx=0x7fcf30009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:12.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.523+0000 7fcf4dbfd700 1 -- 172.21.15.156:0/3939083186 shutdown_connections 2023-12-16T05:51:12.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.523+0000 7fcf4dbfd700 1 --2- 172.21.15.156:0/3939083186 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fcf34036720 0x7fcf34038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:12.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.523+0000 7fcf4dbfd700 1 --2- 172.21.15.156:0/3939083186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf480fb770 0x7fcf4810b980 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:12.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.523+0000 7fcf4dbfd700 1 -- 172.21.15.156:0/3939083186 >> 172.21.15.156:0/3939083186 conn(0x7fcf480f6e50 msgr2=0x7fcf480f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:12.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.523+0000 7fcf4dbfd700 1 -- 172.21.15.156:0/3939083186 shutdown_connections 2023-12-16T05:51:12.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:12.523+0000 7fcf4dbfd700 1 -- 172.21.15.156:0/3939083186 wait complete. 2023-12-16T05:51:12.526 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2023-12-16T05:51:12.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:12 smithi155 ceph-mon[112451]: from='client.? 172.21.15.156:0/3939083186' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:13.912 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T05:51:13.912 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T05:51:14.212 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:51:14.270 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:51:15.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.223+0000 7fdf83d18700 1 -- 172.21.15.156:0/3528415203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf7c0fb760 msgr2=0x7fdf7c0fbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:15.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.223+0000 7fdf83d18700 1 --2- 172.21.15.156:0/3528415203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf7c0fb760 0x7fdf7c0fbb70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0048c0 tx=0x7fdf6c009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:15.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.224+0000 7fdf83d18700 1 -- 172.21.15.156:0/3528415203 shutdown_connections 2023-12-16T05:51:15.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.224+0000 7fdf83d18700 1 --2- 172.21.15.156:0/3528415203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf7c0fb760 0x7fdf7c0fbb70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:15.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.224+0000 7fdf83d18700 1 -- 172.21.15.156:0/3528415203 >> 172.21.15.156:0/3528415203 conn(0x7fdf7c0f6ec0 msgr2=0x7fdf7c0f92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:15.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.224+0000 7fdf83d18700 1 -- 172.21.15.156:0/3528415203 shutdown_connections 2023-12-16T05:51:15.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.224+0000 7fdf83d18700 1 -- 172.21.15.156:0/3528415203 wait complete. 2023-12-16T05:51:15.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.224+0000 7fdf83d18700 1 Processor -- start 2023-12-16T05:51:15.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.224+0000 7fdf83d18700 1 -- start start 2023-12-16T05:51:15.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.225+0000 7fdf83d18700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf7c0fb760 0x7fdf7c10b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:15.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.225+0000 7fdf83d18700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c10beb0 con 0x7fdf7c0fb760 2023-12-16T05:51:15.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.225+0000 7fdf81ab4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf7c0fb760 0x7fdf7c10b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:15.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.225+0000 7fdf81ab4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf7c0fb760 0x7fdf7c10b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.156:57670/0 (socket says 172.21.15.156:57670) 2023-12-16T05:51:15.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.225+0000 7fdf81ab4700 1 -- 172.21.15.156:0/2075733513 learned_addr learned my addr 172.21.15.156:0/2075733513 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-12-16T05:51:15.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.225+0000 7fdf81ab4700 1 -- 172.21.15.156:0/2075733513 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c005040 con 0x7fdf7c0fb760 2023-12-16T05:51:15.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.225+0000 7fdf81ab4700 1 --2- 172.21.15.156:0/2075733513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf7c0fb760 0x7fdf7c10b970 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009040 tx=0x7fdf6c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:15.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.225+0000 7fdf727fc700 1 -- 172.21.15.156:0/2075733513 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf6c009620 con 0x7fdf7c0fb760 2023-12-16T05:51:15.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.225+0000 7fdf727fc700 1 -- 172.21.15.156:0/2075733513 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdf6c009780 con 0x7fdf7c0fb760 2023-12-16T05:51:15.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.225+0000 7fdf83d18700 1 -- 172.21.15.156:0/2075733513 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf7c10c0b0 con 0x7fdf7c0fb760 2023-12-16T05:51:15.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.225+0000 7fdf727fc700 1 -- 172.21.15.156:0/2075733513 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf6c01c5b0 con 0x7fdf7c0fb760 2023-12-16T05:51:15.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.225+0000 7fdf83d18700 1 -- 172.21.15.156:0/2075733513 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf7c10cd50 con 0x7fdf7c0fb760 2023-12-16T05:51:15.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.226+0000 7fdf727fc700 1 -- 172.21.15.156:0/2075733513 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 14) v1 ==== 43352+0+0 (secure 0 0 0) 0x7fdf6c013420 con 0x7fdf7c0fb760 2023-12-16T05:51:15.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.226+0000 7fdf83d18700 1 -- 172.21.15.156:0/2075733513 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf7c05f270 con 0x7fdf7c0fb760 2023-12-16T05:51:15.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.226+0000 7fdf727fc700 1 --2- 172.21.15.156:0/2075733513 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fdf68036770 0x7fdf68038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:15.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.226+0000 7fdf727fc700 1 -- 172.21.15.156:0/2075733513 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fdf6c0498c0 con 0x7fdf7c0fb760 2023-12-16T05:51:15.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.226+0000 7fdf812b3700 1 -- 172.21.15.156:0/2075733513 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fdf68036770 msgr2=0x7fdf68038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6800/2821498015 2023-12-16T05:51:15.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.226+0000 7fdf812b3700 1 --2- 172.21.15.156:0/2075733513 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fdf68036770 0x7fdf68038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T05:51:15.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.231+0000 7fdf727fc700 1 -- 172.21.15.156:0/2075733513 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdf6c0117e0 con 0x7fdf7c0fb760 2023-12-16T05:51:15.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.427+0000 7fdf812b3700 1 -- 172.21.15.156:0/2075733513 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fdf68036770 msgr2=0x7fdf68038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6800/2821498015 2023-12-16T05:51:15.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.427+0000 7fdf812b3700 1 --2- 172.21.15.156:0/2075733513 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fdf68036770 0x7fdf68038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T05:51:15.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.488+0000 7fdf83d18700 1 -- 172.21.15.156:0/2075733513 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdf7c10d8a0 con 0x7fdf7c0fb760 2023-12-16T05:51:15.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.488+0000 7fdf727fc700 1 -- 172.21.15.156:0/2075733513 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fdf6c01be90 con 0x7fdf7c0fb760 2023-12-16T05:51:15.490 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:51:15.491 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"d344784e-9bd6-11ee-95a5-87774f69a715","modified":"2023-12-16T05:49:37.981819Z","created":"2023-12-16T05:49:37.981819Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi155","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T05:51:15.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.490+0000 7fdf83d18700 1 -- 172.21.15.156:0/2075733513 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fdf68036770 msgr2=0x7fdf68038c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T05:51:15.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.490+0000 7fdf83d18700 1 --2- 172.21.15.156:0/2075733513 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fdf68036770 0x7fdf68038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:15.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.490+0000 7fdf83d18700 1 -- 172.21.15.156:0/2075733513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf7c0fb760 msgr2=0x7fdf7c10b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:15.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.490+0000 7fdf83d18700 1 --2- 172.21.15.156:0/2075733513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf7c0fb760 0x7fdf7c10b970 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009040 tx=0x7fdf6c009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:15.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.490+0000 7fdf83d18700 1 -- 172.21.15.156:0/2075733513 shutdown_connections 2023-12-16T05:51:15.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.490+0000 7fdf83d18700 1 --2- 172.21.15.156:0/2075733513 >> [v2:172.21.15.155:6800/2821498015,v1:172.21.15.155:6801/2821498015] conn(0x7fdf68036770 0x7fdf68038c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:15.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.490+0000 7fdf83d18700 1 --2- 172.21.15.156:0/2075733513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf7c0fb760 0x7fdf7c10b970 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:15.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.490+0000 7fdf83d18700 1 -- 172.21.15.156:0/2075733513 >> 172.21.15.156:0/2075733513 conn(0x7fdf7c0f6ec0 msgr2=0x7fdf7c0f7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:15.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.490+0000 7fdf83d18700 1 -- 172.21.15.156:0/2075733513 shutdown_connections 2023-12-16T05:51:15.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:15.490+0000 7fdf83d18700 1 -- 172.21.15.156:0/2075733513 wait complete. 2023-12-16T05:51:15.493 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2023-12-16T05:51:15.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:15 smithi155 ceph-mon[112451]: from='client.? 172.21.15.156:0/2075733513' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:16.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:16 smithi155 ceph-mon[112451]: Active manager daemon smithi155.maowdn restarted 2023-12-16T05:51:16.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:16 smithi155 ceph-mon[112451]: Activating manager daemon smithi155.maowdn 2023-12-16T05:51:16.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:16 smithi155 ceph-mon[112451]: osdmap e5: 0 total, 0 up, 0 in 2023-12-16T05:51:16.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:16 smithi155 ceph-mon[112451]: mgrmap e15: smithi155.maowdn(active, starting, since 0.00287573s) 2023-12-16T05:51:16.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:16 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:51:16.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:16 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr metadata", "who": "smithi155.maowdn", "id": "smithi155.maowdn"}]: dispatch 2023-12-16T05:51:16.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:16 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T05:51:16.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:16 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T05:51:16.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:16 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T05:51:16.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:16 smithi155 ceph-mon[112451]: Manager daemon smithi155.maowdn is now available 2023-12-16T05:51:16.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:16 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:51:16.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:16 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:51:16.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:16 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:16.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:16 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:51:16.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:16 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.maowdn/mirror_snapshot_schedule"}]: dispatch 2023-12-16T05:51:16.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:16 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.maowdn/trash_purge_schedule"}]: dispatch 2023-12-16T05:51:16.872 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T05:51:16.873 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T05:51:17.176 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:51:17.242 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:51:18.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.216+0000 7fdf00614700 1 -- 172.21.15.156:0/847709431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdef80fb780 msgr2=0x7fdef80fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:18.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.216+0000 7fdf00614700 1 --2- 172.21.15.156:0/847709431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdef80fb780 0x7fdef80fbb90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdef40048c0 tx=0x7fdef4009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:18.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.217+0000 7fdf00614700 1 -- 172.21.15.156:0/847709431 shutdown_connections 2023-12-16T05:51:18.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.217+0000 7fdf00614700 1 --2- 172.21.15.156:0/847709431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdef80fb780 0x7fdef80fbb90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:18.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.217+0000 7fdf00614700 1 -- 172.21.15.156:0/847709431 >> 172.21.15.156:0/847709431 conn(0x7fdef80f6e40 msgr2=0x7fdef80f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:18.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.217+0000 7fdf00614700 1 -- 172.21.15.156:0/847709431 shutdown_connections 2023-12-16T05:51:18.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.217+0000 7fdf00614700 1 -- 172.21.15.156:0/847709431 wait complete. 2023-12-16T05:51:18.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.217+0000 7fdf00614700 1 Processor -- start 2023-12-16T05:51:18.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.217+0000 7fdf00614700 1 -- start start 2023-12-16T05:51:18.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.217+0000 7fdf00614700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdef80fb780 0x7fdef8111bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:18.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.217+0000 7fdf00614700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef810d5b0 con 0x7fdef80fb780 2023-12-16T05:51:18.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.217+0000 7fdefe3b0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdef80fb780 0x7fdef8111bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:18.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.218+0000 7fdefe3b0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdef80fb780 0x7fdef8111bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.156:57688/0 (socket says 172.21.15.156:57688) 2023-12-16T05:51:18.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.218+0000 7fdefe3b0700 1 -- 172.21.15.156:0/2542987402 learned_addr learned my addr 172.21.15.156:0/2542987402 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-12-16T05:51:18.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.218+0000 7fdefe3b0700 1 -- 172.21.15.156:0/2542987402 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef4005040 con 0x7fdef80fb780 2023-12-16T05:51:18.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.218+0000 7fdefe3b0700 1 --2- 172.21.15.156:0/2542987402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdef80fb780 0x7fdef8111bc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdef400b690 tx=0x7fdef4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:18.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.218+0000 7fdeeeffd700 1 -- 172.21.15.156:0/2542987402 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdef4009650 con 0x7fdef80fb780 2023-12-16T05:51:18.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.218+0000 7fdf00614700 1 -- 172.21.15.156:0/2542987402 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef8065a10 con 0x7fdef80fb780 2023-12-16T05:51:18.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.218+0000 7fdeeeffd700 1 -- 172.21.15.156:0/2542987402 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdef40097b0 con 0x7fdef80fb780 2023-12-16T05:51:18.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.218+0000 7fdeeeffd700 1 -- 172.21.15.156:0/2542987402 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdef401c5d0 con 0x7fdef80fb780 2023-12-16T05:51:18.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.218+0000 7fdf00614700 1 -- 172.21.15.156:0/2542987402 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef8112100 con 0x7fdef80fb780 2023-12-16T05:51:18.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.219+0000 7fdeeeffd700 1 -- 172.21.15.156:0/2542987402 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) v1 ==== 43202+0+0 (secure 0 0 0) 0x7fdef401c840 con 0x7fdef80fb780 2023-12-16T05:51:18.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.219+0000 7fdf00614700 1 -- 172.21.15.156:0/2542987402 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef8105410 con 0x7fdef80fb780 2023-12-16T05:51:18.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.219+0000 7fdeeeffd700 1 --2- 172.21.15.156:0/2542987402 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fdee4036560 0x7fdee4038a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:18.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.219+0000 7fdeeeffd700 1 -- 172.21.15.156:0/2542987402 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fdef4049840 con 0x7fdef80fb780 2023-12-16T05:51:18.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.219+0000 7fdefdbaf700 1 --2- 172.21.15.156:0/2542987402 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fdee4036560 0x7fdee4038a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:18.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.220+0000 7fdefdbaf700 1 --2- 172.21.15.156:0/2542987402 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fdee4036560 0x7fdee4038a10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009990 tx=0x7fdee8006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:18.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.224+0000 7fdeeeffd700 1 -- 172.21.15.156:0/2542987402 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdef4011db0 con 0x7fdef80fb780 2023-12-16T05:51:18.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:18 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:18.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:18 smithi155 ceph-mon[112451]: [16/Dec/2023:05:51:17] ENGINE Bus STARTING 2023-12-16T05:51:18.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:18 smithi155 ceph-mon[112451]: [16/Dec/2023:05:51:17] ENGINE Serving on https://172.21.15.155:7150 2023-12-16T05:51:18.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:18 smithi155 ceph-mon[112451]: [16/Dec/2023:05:51:17] ENGINE Bus STARTED 2023-12-16T05:51:18.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:18 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:18.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:18 smithi155 ceph-mon[112451]: mgrmap e16: smithi155.maowdn(active, since 1.00474s) 2023-12-16T05:51:18.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:18 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:18.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.493+0000 7fdf00614700 1 -- 172.21.15.156:0/2542987402 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdef804bb80 con 0x7fdef80fb780 2023-12-16T05:51:18.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.494+0000 7fdeeeffd700 1 -- 172.21.15.156:0/2542987402 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fdef4011370 con 0x7fdef80fb780 2023-12-16T05:51:18.497 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:51:18.497 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"d344784e-9bd6-11ee-95a5-87774f69a715","modified":"2023-12-16T05:49:37.981819Z","created":"2023-12-16T05:49:37.981819Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi155","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T05:51:18.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.496+0000 7fdf00614700 1 -- 172.21.15.156:0/2542987402 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fdee4036560 msgr2=0x7fdee4038a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:18.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.496+0000 7fdf00614700 1 --2- 172.21.15.156:0/2542987402 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fdee4036560 0x7fdee4038a10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009990 tx=0x7fdee8006e40 comp rx=0 tx=0).stop 2023-12-16T05:51:18.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.496+0000 7fdf00614700 1 -- 172.21.15.156:0/2542987402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdef80fb780 msgr2=0x7fdef8111bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:18.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.496+0000 7fdf00614700 1 --2- 172.21.15.156:0/2542987402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdef80fb780 0x7fdef8111bc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdef400b690 tx=0x7fdef4009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:18.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.496+0000 7fdf00614700 1 -- 172.21.15.156:0/2542987402 shutdown_connections 2023-12-16T05:51:18.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.496+0000 7fdf00614700 1 --2- 172.21.15.156:0/2542987402 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fdee4036560 0x7fdee4038a10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:18.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.496+0000 7fdf00614700 1 --2- 172.21.15.156:0/2542987402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdef80fb780 0x7fdef8111bc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:18.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.496+0000 7fdf00614700 1 -- 172.21.15.156:0/2542987402 >> 172.21.15.156:0/2542987402 conn(0x7fdef80f6e40 msgr2=0x7fdef80f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:18.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.496+0000 7fdf00614700 1 -- 172.21.15.156:0/2542987402 shutdown_connections 2023-12-16T05:51:18.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:18.496+0000 7fdf00614700 1 -- 172.21.15.156:0/2542987402 wait complete. 2023-12-16T05:51:18.500 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2023-12-16T05:51:19.553 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:19 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:19.553 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:19 smithi155 ceph-mon[112451]: from='client.? 172.21.15.156:0/2542987402' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:19.895 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T05:51:19.895 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T05:51:20.161 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:51:20.212 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T05:51:20.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:20 smithi155 ceph-mon[112451]: mgrmap e17: smithi155.maowdn(active, since 2s) 2023-12-16T05:51:20.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:20 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:20.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:20 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:21.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.385+0000 7f28146ea700 1 -- 172.21.15.156:0/3300204557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f280c0fdeb0 msgr2=0x7f280c0fe2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:21.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.385+0000 7f28146ea700 1 --2- 172.21.15.156:0/3300204557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f280c0fdeb0 0x7f280c0fe2c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f28080048c0 tx=0x7f2808009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:21.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.385+0000 7f28146ea700 1 -- 172.21.15.156:0/3300204557 shutdown_connections 2023-12-16T05:51:21.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.385+0000 7f28146ea700 1 --2- 172.21.15.156:0/3300204557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f280c0fdeb0 0x7f280c0fe2c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:21.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.385+0000 7f28146ea700 1 -- 172.21.15.156:0/3300204557 >> 172.21.15.156:0/3300204557 conn(0x7f280c0f6670 msgr2=0x7f280c0f8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:21.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.385+0000 7f28146ea700 1 -- 172.21.15.156:0/3300204557 shutdown_connections 2023-12-16T05:51:21.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.385+0000 7f28146ea700 1 -- 172.21.15.156:0/3300204557 wait complete. 2023-12-16T05:51:21.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.385+0000 7f28146ea700 1 Processor -- start 2023-12-16T05:51:21.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.385+0000 7f28146ea700 1 -- start start 2023-12-16T05:51:21.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.386+0000 7f28146ea700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f280c0fdeb0 0x7f280c0fd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:21.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.386+0000 7f28146ea700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0fbb70 con 0x7f280c0fdeb0 2023-12-16T05:51:21.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.386+0000 7f2812486700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f280c0fdeb0 0x7f280c0fd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:21.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.386+0000 7f2812486700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f280c0fdeb0 0x7f280c0fd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.156:57692/0 (socket says 172.21.15.156:57692) 2023-12-16T05:51:21.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.386+0000 7f2812486700 1 -- 172.21.15.156:0/670583230 learned_addr learned my addr 172.21.15.156:0/670583230 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-12-16T05:51:21.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.386+0000 7f2812486700 1 -- 172.21.15.156:0/670583230 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2808005040 con 0x7f280c0fdeb0 2023-12-16T05:51:21.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.386+0000 7f2812486700 1 --2- 172.21.15.156:0/670583230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f280c0fdeb0 0x7f280c0fd6f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2808009680 tx=0x7f2808009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:21.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.386+0000 7f2802ffd700 1 -- 172.21.15.156:0/670583230 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f280800b5c0 con 0x7f280c0fdeb0 2023-12-16T05:51:21.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.386+0000 7f2802ffd700 1 -- 172.21.15.156:0/670583230 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2808004e60 con 0x7f280c0fdeb0 2023-12-16T05:51:21.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.386+0000 7f28146ea700 1 -- 172.21.15.156:0/670583230 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280c0fbd70 con 0x7f280c0fdeb0 2023-12-16T05:51:21.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.386+0000 7f2802ffd700 1 -- 172.21.15.156:0/670583230 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f280801c5b0 con 0x7f280c0fdeb0 2023-12-16T05:51:21.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.386+0000 7f28146ea700 1 -- 172.21.15.156:0/670583230 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280c0fc260 con 0x7f280c0fdeb0 2023-12-16T05:51:21.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.387+0000 7f2802ffd700 1 -- 172.21.15.156:0/670583230 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) v1 ==== 43396+0+0 (secure 0 0 0) 0x7f280801c7a0 con 0x7f280c0fdeb0 2023-12-16T05:51:21.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.387+0000 7f2802ffd700 1 --2- 172.21.15.156:0/670583230 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f27f8036810 0x7f27f8038cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:21.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.387+0000 7f28146ea700 1 -- 172.21.15.156:0/670583230 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280c106480 con 0x7f280c0fdeb0 2023-12-16T05:51:21.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.387+0000 7f2802ffd700 1 -- 172.21.15.156:0/670583230 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f2808049ac0 con 0x7f280c0fdeb0 2023-12-16T05:51:21.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.387+0000 7f2811c85700 1 --2- 172.21.15.156:0/670583230 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f27f8036810 0x7f27f8038cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:21.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.388+0000 7f2811c85700 1 --2- 172.21.15.156:0/670583230 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f27f8036810 0x7f27f8038cc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009990 tx=0x7f27fc006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:21.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.392+0000 7f2802ffd700 1 -- 172.21.15.156:0/670583230 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2808011550 con 0x7f280c0fdeb0 2023-12-16T05:51:21.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.671+0000 7f28146ea700 1 -- 172.21.15.156:0/670583230 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f280c04bb80 con 0x7f280c0fdeb0 2023-12-16T05:51:21.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.672+0000 7f2802ffd700 1 -- 172.21.15.156:0/670583230 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f2808011370 con 0x7f280c0fdeb0 2023-12-16T05:51:21.675 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:51:21.675 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"d344784e-9bd6-11ee-95a5-87774f69a715","modified":"2023-12-16T05:49:37.981819Z","created":"2023-12-16T05:49:37.981819Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi155","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T05:51:21.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.674+0000 7f28146ea700 1 -- 172.21.15.156:0/670583230 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f27f8036810 msgr2=0x7f27f8038cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:21.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.674+0000 7f28146ea700 1 --2- 172.21.15.156:0/670583230 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f27f8036810 0x7f27f8038cc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009990 tx=0x7f27fc006e40 comp rx=0 tx=0).stop 2023-12-16T05:51:21.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.674+0000 7f28146ea700 1 -- 172.21.15.156:0/670583230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f280c0fdeb0 msgr2=0x7f280c0fd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:21.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.674+0000 7f28146ea700 1 --2- 172.21.15.156:0/670583230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f280c0fdeb0 0x7f280c0fd6f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2808009680 tx=0x7f2808009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:21.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.674+0000 7f28146ea700 1 -- 172.21.15.156:0/670583230 shutdown_connections 2023-12-16T05:51:21.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.674+0000 7f28146ea700 1 --2- 172.21.15.156:0/670583230 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f27f8036810 0x7f27f8038cc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:21.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.674+0000 7f28146ea700 1 --2- 172.21.15.156:0/670583230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f280c0fdeb0 0x7f280c0fd6f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:21.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.674+0000 7f28146ea700 1 -- 172.21.15.156:0/670583230 >> 172.21.15.156:0/670583230 conn(0x7f280c0f6670 msgr2=0x7f280c0f74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:21.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.674+0000 7f28146ea700 1 -- 172.21.15.156:0/670583230 shutdown_connections 2023-12-16T05:51:21.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:21.674+0000 7f28146ea700 1 -- 172.21.15.156:0/670583230 wait complete. 2023-12-16T05:51:21.678 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2023-12-16T05:51:21.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:21 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:21.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:21 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:21.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:21 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd/host:smithi155", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:51:21.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:21 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:21.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:21 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:21.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:21 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:21.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:21 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:21.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:21 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd/host:smithi156", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:51:21.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:21 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:21.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:21 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:51:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:22 smithi155 ceph-mon[112451]: Updating smithi155:/etc/ceph/ceph.conf 2023-12-16T05:51:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:22 smithi155 ceph-mon[112451]: Updating smithi156:/etc/ceph/ceph.conf 2023-12-16T05:51:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:22 smithi155 ceph-mon[112451]: Updating smithi156:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:51:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:22 smithi155 ceph-mon[112451]: Updating smithi155:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:51:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:22 smithi155 ceph-mon[112451]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-12-16T05:51:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:22 smithi155 ceph-mon[112451]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2023-12-16T05:51:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:22 smithi155 ceph-mon[112451]: from='client.? 172.21.15.156:0/670583230' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:22 smithi155 ceph-mon[112451]: Updating smithi156:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T05:51:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:22 smithi155 ceph-mon[112451]: Updating smithi155:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T05:51:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:22 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:22 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:22 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:22 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:22.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:22 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:22.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:22 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi156", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T05:51:22.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:22 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi156", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-16T05:51:22.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:22 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:23.049 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T05:51:23.049 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T05:51:23.359 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:51:23.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:23 smithi155 ceph-mon[112451]: Deploying daemon crash.smithi156 on smithi156 2023-12-16T05:51:24.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.687+0000 7ff3008f2700 1 -- 172.21.15.156:0/1181571572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2fc06ff60 msgr2=0x7ff2fc070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:24.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.687+0000 7ff3008f2700 1 --2- 172.21.15.156:0/1181571572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2fc06ff60 0x7ff2fc070330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0048c0 tx=0x7ff2ec009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:24.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.687+0000 7ff3008f2700 1 -- 172.21.15.156:0/1181571572 shutdown_connections 2023-12-16T05:51:24.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.687+0000 7ff3008f2700 1 --2- 172.21.15.156:0/1181571572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2fc06ff60 0x7ff2fc070330 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:24.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.687+0000 7ff3008f2700 1 -- 172.21.15.156:0/1181571572 >> 172.21.15.156:0/1181571572 conn(0x7ff2fc0f8410 msgr2=0x7ff2fc0fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:24.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.687+0000 7ff3008f2700 1 -- 172.21.15.156:0/1181571572 shutdown_connections 2023-12-16T05:51:24.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.687+0000 7ff3008f2700 1 -- 172.21.15.156:0/1181571572 wait complete. 2023-12-16T05:51:24.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.688+0000 7ff3008f2700 1 Processor -- start 2023-12-16T05:51:24.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.688+0000 7ff3008f2700 1 -- start start 2023-12-16T05:51:24.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.688+0000 7ff3008f2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2fc06ff60 0x7ff2fc114df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:24.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.688+0000 7ff3008f2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc115330 con 0x7ff2fc06ff60 2023-12-16T05:51:24.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.688+0000 7ff2fa59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2fc06ff60 0x7ff2fc114df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:24.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.688+0000 7ff2fa59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2fc06ff60 0x7ff2fc114df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.156:50124/0 (socket says 172.21.15.156:50124) 2023-12-16T05:51:24.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.688+0000 7ff2fa59c700 1 -- 172.21.15.156:0/3340105471 learned_addr learned my addr 172.21.15.156:0/3340105471 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-12-16T05:51:24.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.689+0000 7ff2fa59c700 1 -- 172.21.15.156:0/3340105471 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec005040 con 0x7ff2fc06ff60 2023-12-16T05:51:24.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.689+0000 7ff2fa59c700 1 --2- 172.21.15.156:0/3340105471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2fc06ff60 0x7ff2fc114df0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec009300 tx=0x7ff2ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:24.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.689+0000 7ff2eaffd700 1 -- 172.21.15.156:0/3340105471 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2ec004e60 con 0x7ff2fc06ff60 2023-12-16T05:51:24.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.689+0000 7ff3008f2700 1 -- 172.21.15.156:0/3340105471 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2fc115530 con 0x7ff2fc06ff60 2023-12-16T05:51:24.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.689+0000 7ff2eaffd700 1 -- 172.21.15.156:0/3340105471 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff2ec013420 con 0x7ff2fc06ff60 2023-12-16T05:51:24.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.689+0000 7ff2eaffd700 1 -- 172.21.15.156:0/3340105471 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2ec01c5b0 con 0x7ff2fc06ff60 2023-12-16T05:51:24.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.689+0000 7ff3008f2700 1 -- 172.21.15.156:0/3340105471 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2fc1159a0 con 0x7ff2fc06ff60 2023-12-16T05:51:24.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.690+0000 7ff2eaffd700 1 -- 172.21.15.156:0/3340105471 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) v1 ==== 43396+0+0 (secure 0 0 0) 0x7ff2ec01c7a0 con 0x7ff2fc06ff60 2023-12-16T05:51:24.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.690+0000 7ff3008f2700 1 -- 172.21.15.156:0/3340105471 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2fc05f270 con 0x7ff2fc06ff60 2023-12-16T05:51:24.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.690+0000 7ff2eaffd700 1 --2- 172.21.15.156:0/3340105471 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7ff2e4036810 0x7ff2e4038cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:24.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.690+0000 7ff2eaffd700 1 -- 172.21.15.156:0/3340105471 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7ff2ec049960 con 0x7ff2fc06ff60 2023-12-16T05:51:24.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.690+0000 7ff2f9d9b700 1 --2- 172.21.15.156:0/3340105471 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7ff2e4036810 0x7ff2e4038cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:24.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.691+0000 7ff2f9d9b700 1 --2- 172.21.15.156:0/3340105471 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7ff2e4036810 0x7ff2e4038cc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009990 tx=0x7ff2f0006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:24.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.695+0000 7ff2eaffd700 1 -- 172.21.15.156:0/3340105471 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff2ec023300 con 0x7ff2fc06ff60 2023-12-16T05:51:24.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.985+0000 7ff3008f2700 1 -- 172.21.15.156:0/3340105471 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff2fc108c80 con 0x7ff2fc06ff60 2023-12-16T05:51:24.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.986+0000 7ff2eaffd700 1 -- 172.21.15.156:0/3340105471 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7ff2ec011b60 con 0x7ff2fc06ff60 2023-12-16T05:51:24.990 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:51:24.990 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"d344784e-9bd6-11ee-95a5-87774f69a715","modified":"2023-12-16T05:49:37.981819Z","created":"2023-12-16T05:49:37.981819Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi155","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T05:51:24.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.988+0000 7ff3008f2700 1 -- 172.21.15.156:0/3340105471 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7ff2e4036810 msgr2=0x7ff2e4038cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:24.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.988+0000 7ff3008f2700 1 --2- 172.21.15.156:0/3340105471 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7ff2e4036810 0x7ff2e4038cc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009990 tx=0x7ff2f0006e40 comp rx=0 tx=0).stop 2023-12-16T05:51:24.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.988+0000 7ff3008f2700 1 -- 172.21.15.156:0/3340105471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2fc06ff60 msgr2=0x7ff2fc114df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:24.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.988+0000 7ff3008f2700 1 --2- 172.21.15.156:0/3340105471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2fc06ff60 0x7ff2fc114df0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec009300 tx=0x7ff2ec009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:24.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.988+0000 7ff3008f2700 1 -- 172.21.15.156:0/3340105471 shutdown_connections 2023-12-16T05:51:24.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.988+0000 7ff3008f2700 1 --2- 172.21.15.156:0/3340105471 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7ff2e4036810 0x7ff2e4038cc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:24.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.988+0000 7ff3008f2700 1 --2- 172.21.15.156:0/3340105471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2fc06ff60 0x7ff2fc114df0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:24.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.988+0000 7ff3008f2700 1 -- 172.21.15.156:0/3340105471 >> 172.21.15.156:0/3340105471 conn(0x7ff2fc0f8410 msgr2=0x7ff2fc103450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:24.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.988+0000 7ff3008f2700 1 -- 172.21.15.156:0/3340105471 shutdown_connections 2023-12-16T05:51:24.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:24.988+0000 7ff3008f2700 1 -- 172.21.15.156:0/3340105471 wait complete. 2023-12-16T05:51:24.992 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2023-12-16T05:51:25.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:25 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:25.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:25 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:25.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:25 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:25.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:25 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:25.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:25 smithi155 ceph-mon[112451]: Deploying daemon node-exporter.smithi156 on smithi156 2023-12-16T05:51:25.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:25 smithi155 ceph-mon[112451]: from='client.? 172.21.15.156:0/3340105471' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:26.318 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T05:51:26.318 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T05:51:26.754 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:51:27.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:27 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:27.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.928+0000 7fbe86742700 1 -- 172.21.15.156:0/4111825925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe801017a0 msgr2=0x7fbe80101b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:27.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.928+0000 7fbe86742700 1 --2- 172.21.15.156:0/4111825925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe801017a0 0x7fbe80101b70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbe700048c0 tx=0x7fbe70009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:27.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.928+0000 7fbe86742700 1 -- 172.21.15.156:0/4111825925 shutdown_connections 2023-12-16T05:51:27.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.928+0000 7fbe86742700 1 --2- 172.21.15.156:0/4111825925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe801017a0 0x7fbe80101b70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:27.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.928+0000 7fbe86742700 1 -- 172.21.15.156:0/4111825925 >> 172.21.15.156:0/4111825925 conn(0x7fbe80071cb0 msgr2=0x7fbe800720b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:27.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.928+0000 7fbe86742700 1 -- 172.21.15.156:0/4111825925 shutdown_connections 2023-12-16T05:51:27.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.928+0000 7fbe86742700 1 -- 172.21.15.156:0/4111825925 wait complete. 2023-12-16T05:51:27.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.928+0000 7fbe86742700 1 Processor -- start 2023-12-16T05:51:27.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.929+0000 7fbe86742700 1 -- start start 2023-12-16T05:51:27.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.929+0000 7fbe86742700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe801017a0 0x7fbe80111940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:27.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.929+0000 7fbe86742700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe80111e80 con 0x7fbe801017a0 2023-12-16T05:51:27.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.929+0000 7fbe7ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe801017a0 0x7fbe80111940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:27.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.929+0000 7fbe7ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe801017a0 0x7fbe80111940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.156:50148/0 (socket says 172.21.15.156:50148) 2023-12-16T05:51:27.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.929+0000 7fbe7ffff700 1 -- 172.21.15.156:0/3918455342 learned_addr learned my addr 172.21.15.156:0/3918455342 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-12-16T05:51:27.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.930+0000 7fbe7ffff700 1 -- 172.21.15.156:0/3918455342 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe70005040 con 0x7fbe801017a0 2023-12-16T05:51:27.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.930+0000 7fbe7ffff700 1 --2- 172.21.15.156:0/3918455342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe801017a0 0x7fbe80111940 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009b80 tx=0x7fbe70009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:27.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.930+0000 7fbe7cff9700 1 -- 172.21.15.156:0/3918455342 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe70004e60 con 0x7fbe801017a0 2023-12-16T05:51:27.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.930+0000 7fbe86742700 1 -- 172.21.15.156:0/3918455342 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe801120e0 con 0x7fbe801017a0 2023-12-16T05:51:27.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.930+0000 7fbe7cff9700 1 -- 172.21.15.156:0/3918455342 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbe70009620 con 0x7fbe801017a0 2023-12-16T05:51:27.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.930+0000 7fbe7cff9700 1 -- 172.21.15.156:0/3918455342 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe7001c3f0 con 0x7fbe801017a0 2023-12-16T05:51:27.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.930+0000 7fbe86742700 1 -- 172.21.15.156:0/3918455342 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8010b800 con 0x7fbe801017a0 2023-12-16T05:51:27.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.931+0000 7fbe7cff9700 1 -- 172.21.15.156:0/3918455342 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) v1 ==== 43396+0+0 (secure 0 0 0) 0x7fbe7001c670 con 0x7fbe801017a0 2023-12-16T05:51:27.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.931+0000 7fbe7cff9700 1 --2- 172.21.15.156:0/3918455342 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fbe680367d0 0x7fbe68038c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:27.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.931+0000 7fbe7cff9700 1 -- 172.21.15.156:0/3918455342 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fbe7004a9f0 con 0x7fbe801017a0 2023-12-16T05:51:27.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.931+0000 7fbe7f7fe700 1 --2- 172.21.15.156:0/3918455342 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fbe680367d0 0x7fbe68038c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:27.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.931+0000 7fbe86742700 1 -- 172.21.15.156:0/3918455342 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8005f270 con 0x7fbe801017a0 2023-12-16T05:51:27.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.932+0000 7fbe7f7fe700 1 --2- 172.21.15.156:0/3918455342 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fbe680367d0 0x7fbe68038c80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009990 tx=0x7fbe74006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:27.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:27.936+0000 7fbe7cff9700 1 -- 172.21.15.156:0/3918455342 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbe70025400 con 0x7fbe801017a0 2023-12-16T05:51:28.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:28.229+0000 7fbe86742700 1 -- 172.21.15.156:0/3918455342 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbe8010cf20 con 0x7fbe801017a0 2023-12-16T05:51:28.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:28.229+0000 7fbe7cff9700 1 -- 172.21.15.156:0/3918455342 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fbe70011b60 con 0x7fbe801017a0 2023-12-16T05:51:28.232 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:51:28.232 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"d344784e-9bd6-11ee-95a5-87774f69a715","modified":"2023-12-16T05:49:37.981819Z","created":"2023-12-16T05:49:37.981819Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi155","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T05:51:28.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:28.231+0000 7fbe86742700 1 -- 172.21.15.156:0/3918455342 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fbe680367d0 msgr2=0x7fbe68038c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:28.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:28.231+0000 7fbe86742700 1 --2- 172.21.15.156:0/3918455342 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fbe680367d0 0x7fbe68038c80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009990 tx=0x7fbe74006e40 comp rx=0 tx=0).stop 2023-12-16T05:51:28.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:28.231+0000 7fbe86742700 1 -- 172.21.15.156:0/3918455342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe801017a0 msgr2=0x7fbe80111940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:28.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:28.231+0000 7fbe86742700 1 --2- 172.21.15.156:0/3918455342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe801017a0 0x7fbe80111940 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009b80 tx=0x7fbe70009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:28.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:28.231+0000 7fbe86742700 1 -- 172.21.15.156:0/3918455342 shutdown_connections 2023-12-16T05:51:28.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:28.231+0000 7fbe86742700 1 --2- 172.21.15.156:0/3918455342 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fbe680367d0 0x7fbe68038c80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:28.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:28.231+0000 7fbe86742700 1 --2- 172.21.15.156:0/3918455342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe801017a0 0x7fbe80111940 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:28.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:28.231+0000 7fbe86742700 1 -- 172.21.15.156:0/3918455342 >> 172.21.15.156:0/3918455342 conn(0x7fbe80071cb0 msgr2=0x7fbe80102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:28.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:28.231+0000 7fbe86742700 1 -- 172.21.15.156:0/3918455342 shutdown_connections 2023-12-16T05:51:28.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:28.231+0000 7fbe86742700 1 -- 172.21.15.156:0/3918455342 wait complete. 2023-12-16T05:51:28.235 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2023-12-16T05:51:29.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:28 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:29.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:28 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:29.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:28 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:29.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:28 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:29.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:28 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.pclong", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T05:51:29.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:28 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.pclong", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-16T05:51:29.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:28 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T05:51:29.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:28 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:29.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:28 smithi155 ceph-mon[112451]: Deploying daemon mgr.smithi156.pclong on smithi156 2023-12-16T05:51:29.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:28 smithi155 ceph-mon[112451]: from='client.? 172.21.15.156:0/3918455342' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:29.865 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T05:51:29.866 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T05:51:30.361 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:51:30.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:30 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:30.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:30 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:30.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:30 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:30.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:30 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:30.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:30 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T05:51:30.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:30 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:30.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:30 smithi155 ceph-mon[112451]: Deploying daemon mon.smithi156 on smithi156 2023-12-16T05:51:31.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.438+0000 7fae54061700 1 -- 172.21.15.156:0/1371786235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae4c1017d0 msgr2=0x7fae4c101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:31.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.438+0000 7fae54061700 1 --2- 172.21.15.156:0/1371786235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae4c1017d0 0x7fae4c101ba0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fae480048c0 tx=0x7fae48009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:31.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.438+0000 7fae54061700 1 -- 172.21.15.156:0/1371786235 shutdown_connections 2023-12-16T05:51:31.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.438+0000 7fae54061700 1 --2- 172.21.15.156:0/1371786235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae4c1017d0 0x7fae4c101ba0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:31.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.438+0000 7fae54061700 1 -- 172.21.15.156:0/1371786235 >> 172.21.15.156:0/1371786235 conn(0x7fae4c0f7310 msgr2=0x7fae4c0f9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:31.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.438+0000 7fae54061700 1 -- 172.21.15.156:0/1371786235 shutdown_connections 2023-12-16T05:51:31.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.438+0000 7fae54061700 1 -- 172.21.15.156:0/1371786235 wait complete. 2023-12-16T05:51:31.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.439+0000 7fae54061700 1 Processor -- start 2023-12-16T05:51:31.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.439+0000 7fae54061700 1 -- start start 2023-12-16T05:51:31.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.439+0000 7fae54061700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae4c1017d0 0x7fae4c10dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:31.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.439+0000 7fae54061700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c10e150 con 0x7fae4c1017d0 2023-12-16T05:51:31.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.439+0000 7fae51dfd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae4c1017d0 0x7fae4c10dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:31.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.439+0000 7fae51dfd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae4c1017d0 0x7fae4c10dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.156:50182/0 (socket says 172.21.15.156:50182) 2023-12-16T05:51:31.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.439+0000 7fae51dfd700 1 -- 172.21.15.156:0/2795722979 learned_addr learned my addr 172.21.15.156:0/2795722979 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-12-16T05:51:31.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.439+0000 7fae51dfd700 1 -- 172.21.15.156:0/2795722979 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae48005040 con 0x7fae4c1017d0 2023-12-16T05:51:31.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.440+0000 7fae51dfd700 1 --2- 172.21.15.156:0/2795722979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae4c1017d0 0x7fae4c10dc10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fae48009300 tx=0x7fae48009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:31.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.440+0000 7fae427fc700 1 -- 172.21.15.156:0/2795722979 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae48004e60 con 0x7fae4c1017d0 2023-12-16T05:51:31.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.440+0000 7fae54061700 1 -- 172.21.15.156:0/2795722979 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4c10e350 con 0x7fae4c1017d0 2023-12-16T05:51:31.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.440+0000 7fae427fc700 1 -- 172.21.15.156:0/2795722979 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fae48013420 con 0x7fae4c1017d0 2023-12-16T05:51:31.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.440+0000 7fae427fc700 1 -- 172.21.15.156:0/2795722979 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae4801c5b0 con 0x7fae4c1017d0 2023-12-16T05:51:31.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.440+0000 7fae54061700 1 -- 172.21.15.156:0/2795722979 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4c10e840 con 0x7fae4c1017d0 2023-12-16T05:51:31.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.441+0000 7fae427fc700 1 -- 172.21.15.156:0/2795722979 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) v1 ==== 43396+0+0 (secure 0 0 0) 0x7fae4801c7a0 con 0x7fae4c1017d0 2023-12-16T05:51:31.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.441+0000 7fae54061700 1 -- 172.21.15.156:0/2795722979 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4c100a40 con 0x7fae4c1017d0 2023-12-16T05:51:31.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.441+0000 7fae427fc700 1 --2- 172.21.15.156:0/2795722979 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fae3803ac20 0x7fae3803d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:31.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.441+0000 7fae427fc700 1 -- 172.21.15.156:0/2795722979 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fae48049bd0 con 0x7fae4c1017d0 2023-12-16T05:51:31.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.441+0000 7fae515fc700 1 --2- 172.21.15.156:0/2795722979 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fae3803ac20 0x7fae3803d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:31.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.442+0000 7fae515fc700 1 --2- 172.21.15.156:0/2795722979 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fae3803ac20 0x7fae3803d0d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fae3c009990 tx=0x7fae3c006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:31.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.446+0000 7fae427fc700 1 -- 172.21.15.156:0/2795722979 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fae48011db0 con 0x7fae4c1017d0 2023-12-16T05:51:31.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.714+0000 7fae54061700 1 -- 172.21.15.156:0/2795722979 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fae4c04bb80 con 0x7fae4c1017d0 2023-12-16T05:51:31.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.715+0000 7fae427fc700 1 -- 172.21.15.156:0/2795722979 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fae48023a00 con 0x7fae4c1017d0 2023-12-16T05:51:31.718 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:51:31.718 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"d344784e-9bd6-11ee-95a5-87774f69a715","modified":"2023-12-16T05:49:37.981819Z","created":"2023-12-16T05:49:37.981819Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi155","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T05:51:31.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.717+0000 7fae54061700 1 -- 172.21.15.156:0/2795722979 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fae3803ac20 msgr2=0x7fae3803d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:31.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.717+0000 7fae54061700 1 --2- 172.21.15.156:0/2795722979 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fae3803ac20 0x7fae3803d0d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fae3c009990 tx=0x7fae3c006e40 comp rx=0 tx=0).stop 2023-12-16T05:51:31.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.717+0000 7fae54061700 1 -- 172.21.15.156:0/2795722979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae4c1017d0 msgr2=0x7fae4c10dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:31.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.717+0000 7fae54061700 1 --2- 172.21.15.156:0/2795722979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae4c1017d0 0x7fae4c10dc10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fae48009300 tx=0x7fae48009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:31.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.717+0000 7fae54061700 1 -- 172.21.15.156:0/2795722979 shutdown_connections 2023-12-16T05:51:31.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.717+0000 7fae54061700 1 --2- 172.21.15.156:0/2795722979 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fae3803ac20 0x7fae3803d0d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:31.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.717+0000 7fae54061700 1 --2- 172.21.15.156:0/2795722979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae4c1017d0 0x7fae4c10dc10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:31.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.717+0000 7fae54061700 1 -- 172.21.15.156:0/2795722979 >> 172.21.15.156:0/2795722979 conn(0x7fae4c0f7310 msgr2=0x7fae4c0f92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:31.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.717+0000 7fae54061700 1 -- 172.21.15.156:0/2795722979 shutdown_connections 2023-12-16T05:51:31.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:31.717+0000 7fae54061700 1 -- 172.21.15.156:0/2795722979 wait complete. 2023-12-16T05:51:31.721 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2023-12-16T05:51:31.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:31 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:51:31.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:31 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.301 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 systemd[1]: Starting Ceph mon.smithi156 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T05:51:32.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: set uid:gid to 167:167 (ceph:ceph) 2023-12-16T05:51:32.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable), process ceph-mon, pid 7 2023-12-16T05:51:32.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: pidfile_write: ignore empty --pid-file 2023-12-16T05:51:32.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: load: jerasure load: lrc 2023-12-16T05:51:32.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: RocksDB version: 6.15.5 2023-12-16T05:51:32.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-16T05:51:32.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Compile date Dec 13 2023 2023-12-16T05:51:32.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: DB SUMMARY 2023-12-16T05:51:32.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: DB Session ID: SAD35143F6V53J4YT7G4 2023-12-16T05:51:32.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: CURRENT file: CURRENT 2023-12-16T05:51:32.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: IDENTITY file: IDENTITY 2023-12-16T05:51:32.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2023-12-16T05:51:32.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi156/store.db dir, Total Num: 0, files: 2023-12-16T05:51:32.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi156/store.db: 000004.log size: 511 ; 2023-12-16T05:51:32.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.error_if_exists: 0 2023-12-16T05:51:32.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.create_if_missing: 0 2023-12-16T05:51:32.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.paranoid_checks: 1 2023-12-16T05:51:32.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-16T05:51:32.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.env: 0x555c4cdf0a80 2023-12-16T05:51:32.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.fs: Posix File System 2023-12-16T05:51:32.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.info_log: 0x555c4f0a4780 2023-12-16T05:51:32.682 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_file_opening_threads: 16 2023-12-16T05:51:32.682 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.statistics: (nil) 2023-12-16T05:51:32.682 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.use_fsync: 0 2023-12-16T05:51:32.682 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_log_file_size: 0 2023-12-16T05:51:32.682 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-16T05:51:32.682 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-16T05:51:32.682 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.keep_log_file_num: 1000 2023-12-16T05:51:32.682 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.recycle_log_file_num: 0 2023-12-16T05:51:32.682 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.allow_fallocate: 1 2023-12-16T05:51:32.682 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.allow_mmap_reads: 0 2023-12-16T05:51:32.682 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.allow_mmap_writes: 0 2023-12-16T05:51:32.682 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.use_direct_reads: 0 2023-12-16T05:51:32.682 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-16T05:51:32.682 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.create_missing_column_families: 0 2023-12-16T05:51:32.682 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.db_log_dir: 2023-12-16T05:51:32.683 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi156/store.db 2023-12-16T05:51:32.683 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-16T05:51:32.683 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-16T05:51:32.684 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-16T05:51:32.684 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-16T05:51:32.685 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-16T05:51:32.685 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-16T05:51:32.685 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.advise_random_on_open: 1 2023-12-16T05:51:32.685 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.db_write_buffer_size: 0 2023-12-16T05:51:32.685 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.write_buffer_manager: 0x555c4fe14990 2023-12-16T05:51:32.685 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-16T05:51:32.685 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-16T05:51:32.685 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-16T05:51:32.685 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-16T05:51:32.685 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.rate_limiter: (nil) 2023-12-16T05:51:32.685 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-16T05:51:32.685 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.wal_recovery_mode: 2 2023-12-16T05:51:32.685 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.enable_thread_tracking: 0 2023-12-16T05:51:32.685 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.enable_pipelined_write: 0 2023-12-16T05:51:32.685 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.unordered_write: 0 2023-12-16T05:51:32.686 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-16T05:51:32.686 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-16T05:51:32.686 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-16T05:51:32.686 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-16T05:51:32.686 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.row_cache: None 2023-12-16T05:51:32.686 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.wal_filter: None 2023-12-16T05:51:32.686 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-16T05:51:32.686 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.allow_ingest_behind: 0 2023-12-16T05:51:32.686 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.preserve_deletes: 0 2023-12-16T05:51:32.686 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.two_write_queues: 0 2023-12-16T05:51:32.686 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.manual_wal_flush: 0 2023-12-16T05:51:32.686 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.atomic_flush: 0 2023-12-16T05:51:32.686 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-16T05:51:32.686 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-16T05:51:32.686 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-16T05:51:32.687 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.log_readahead_size: 0 2023-12-16T05:51:32.687 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-16T05:51:32.687 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.best_efforts_recovery: 0 2023-12-16T05:51:32.687 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-16T05:51:32.687 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-16T05:51:32.687 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.allow_data_in_errors: 0 2023-12-16T05:51:32.687 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.db_host_id: __hostname__ 2023-12-16T05:51:32.687 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_background_jobs: 2 2023-12-16T05:51:32.687 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_background_compactions: -1 2023-12-16T05:51:32.687 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_subcompactions: 1 2023-12-16T05:51:32.687 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-16T05:51:32.687 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-16T05:51:32.687 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-16T05:51:32.687 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_total_wal_size: 0 2023-12-16T05:51:32.687 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-16T05:51:32.687 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-16T05:51:32.688 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-16T05:51:32.688 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-16T05:51:32.688 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_open_files: -1 2023-12-16T05:51:32.688 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.bytes_per_sync: 0 2023-12-16T05:51:32.688 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-16T05:51:32.688 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-16T05:51:32.688 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compaction_readahead_size: 0 2023-12-16T05:51:32.688 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_background_flushes: -1 2023-12-16T05:51:32.688 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Compression algorithms supported: 2023-12-16T05:51:32.688 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-16T05:51:32.688 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: kZSTD supported: 0 2023-12-16T05:51:32.688 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: kXpressCompression supported: 0 2023-12-16T05:51:32.688 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: kLZ4HCCompression supported: 1 2023-12-16T05:51:32.688 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: kZlibCompression supported: 1 2023-12-16T05:51:32.688 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: kSnappyCompression supported: 1 2023-12-16T05:51:32.689 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: kLZ4Compression supported: 1 2023-12-16T05:51:32.689 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: kBZip2Compression supported: 0 2023-12-16T05:51:32.689 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-16T05:51:32.689 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi156/store.db/MANIFEST-000003 2023-12-16T05:51:32.689 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-16T05:51:32.689 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-16T05:51:32.689 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.merge_operator: 2023-12-16T05:51:32.689 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compaction_filter: None 2023-12-16T05:51:32.689 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compaction_filter_factory: None 2023-12-16T05:51:32.689 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.sst_partitioner_factory: None 2023-12-16T05:51:32.689 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-16T05:51:32.689 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-16T05:51:32.689 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555c4f0f4f90) 2023-12-16T05:51:32.689 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: cache_index_and_filter_blocks: 1 2023-12-16T05:51:32.689 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-16T05:51:32.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-16T05:51:32.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: pin_top_level_index_and_filter: 1 2023-12-16T05:51:32.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: index_type: 0 2023-12-16T05:51:32.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: data_block_index_type: 0 2023-12-16T05:51:32.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: index_shortening: 1 2023-12-16T05:51:32.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-16T05:51:32.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: hash_index_allow_collision: 1 2023-12-16T05:51:32.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: checksum: 1 2023-12-16T05:51:32.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: no_block_cache: 0 2023-12-16T05:51:32.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_cache: 0x555c4f127090 2023-12-16T05:51:32.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_cache_name: BinnedLRUCache 2023-12-16T05:51:32.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_cache_options: 2023-12-16T05:51:32.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: capacity : 536870912 2023-12-16T05:51:32.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: num_shard_bits : 4 2023-12-16T05:51:32.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: strict_capacity_limit : 0 2023-12-16T05:51:32.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: high_pri_pool_ratio: 0.000 2023-12-16T05:51:32.691 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_cache_compressed: (nil) 2023-12-16T05:51:32.691 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: persistent_cache: (nil) 2023-12-16T05:51:32.691 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_size: 4096 2023-12-16T05:51:32.691 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_size_deviation: 10 2023-12-16T05:51:32.691 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_restart_interval: 16 2023-12-16T05:51:32.691 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: index_block_restart_interval: 1 2023-12-16T05:51:32.691 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: metadata_block_size: 4096 2023-12-16T05:51:32.691 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: partition_filters: 0 2023-12-16T05:51:32.691 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: use_delta_encoding: 1 2023-12-16T05:51:32.691 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-16T05:51:32.691 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: whole_key_filtering: 1 2023-12-16T05:51:32.691 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: verify_compression: 0 2023-12-16T05:51:32.691 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: read_amp_bytes_per_bit: 0 2023-12-16T05:51:32.691 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: format_version: 4 2023-12-16T05:51:32.691 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: enable_index_compression: 1 2023-12-16T05:51:32.692 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_align: 0 2023-12-16T05:51:32.692 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.write_buffer_size: 33554432 2023-12-16T05:51:32.692 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_write_buffer_number: 2 2023-12-16T05:51:32.692 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compression: NoCompression 2023-12-16T05:51:32.692 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.bottommost_compression: Disabled 2023-12-16T05:51:32.692 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.prefix_extractor: nullptr 2023-12-16T05:51:32.692 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-16T05:51:32.692 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.num_levels: 7 2023-12-16T05:51:32.692 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-16T05:51:32.692 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-16T05:51:32.692 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-16T05:51:32.692 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-16T05:51:32.692 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-16T05:51:32.692 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-16T05:51:32.692 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-16T05:51:32.693 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-16T05:51:32.693 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-16T05:51:32.693 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-16T05:51:32.693 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-16T05:51:32.693 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compression_opts.level: 32767 2023-12-16T05:51:32.693 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compression_opts.strategy: 0 2023-12-16T05:51:32.693 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-16T05:51:32.693 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-16T05:51:32.693 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-16T05:51:32.693 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compression_opts.enabled: false 2023-12-16T05:51:32.693 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-16T05:51:32.693 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-16T05:51:32.694 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-16T05:51:32.694 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.target_file_size_base: 67108864 2023-12-16T05:51:32.694 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-16T05:51:32.694 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-16T05:51:32.694 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-16T05:51:32.694 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-16T05:51:32.694 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-16T05:51:32.694 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-16T05:51:32.694 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-16T05:51:32.694 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-16T05:51:32.694 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-16T05:51:32.694 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-16T05:51:32.694 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-16T05:51:32.694 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-16T05:51:32.694 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-16T05:51:32.695 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.arena_block_size: 4194304 2023-12-16T05:51:32.695 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-16T05:51:32.695 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-16T05:51:32.695 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-16T05:51:32.695 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.disable_auto_compactions: 0 2023-12-16T05:51:32.695 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-16T05:51:32.695 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-16T05:51:32.695 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-16T05:51:32.695 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-16T05:51:32.695 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-16T05:51:32.695 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-16T05:51:32.695 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-16T05:51:32.695 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-16T05:51:32.695 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-16T05:51:32.695 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-16T05:51:32.695 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.table_properties_collectors: 2023-12-16T05:51:32.696 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.inplace_update_support: 0 2023-12-16T05:51:32.696 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-16T05:51:32.696 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-16T05:51:32.696 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-16T05:51:32.696 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-16T05:51:32.696 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.bloom_locality: 0 2023-12-16T05:51:32.696 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.max_successive_merges: 0 2023-12-16T05:51:32.696 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-16T05:51:32.696 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.paranoid_file_checks: 0 2023-12-16T05:51:32.696 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.force_consistency_checks: 1 2023-12-16T05:51:32.696 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.report_bg_io_stats: 0 2023-12-16T05:51:32.696 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.ttl: 2592000 2023-12-16T05:51:32.696 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-16T05:51:32.696 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.enable_blob_files: false 2023-12-16T05:51:32.696 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.min_blob_size: 0 2023-12-16T05:51:32.697 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.blob_file_size: 268435456 2023-12-16T05:51:32.697 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-16T05:51:32.697 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-16T05:51:32.697 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-16T05:51:32.697 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi156/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-16T05:51:32.697 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2023-12-16T05:51:32.697 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2023-12-16T05:51:32.697 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702705892362032, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-12-16T05:51:32.697 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2023-12-16T05:51:32.697 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-16T05:51:32.697 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702705892362319, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1702705892, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "8ad93002-ba1f-479e-961b-50dcf3d53670", "db_session_id": "SAD35143F6V53J4YT7G4"}} 2023-12-16T05:51:32.697 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2023-12-16T05:51:32.697 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702705892362637, "job": 1, "event": "recovery_finished"} 2023-12-16T05:51:32.697 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi156/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-16T05:51:32.697 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x555c4f0bb180 2023-12-16T05:51:32.698 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: DB pointer 0x555c4f190000 2023-12-16T05:51:32.698 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-16T05:51:32.698 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-16T05:51:32.698 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** DB Stats ** 2023-12-16T05:51:32.698 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T05:51:32.698 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-16T05:51:32.698 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T05:51:32.698 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T05:51:32.698 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-16T05:51:32.698 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-16T05:51:32.698 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T05:51:32.698 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2023-12-16T05:51:32.698 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** Compaction Stats [default] ** 2023-12-16T05:51:32.698 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T05:51:32.698 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T05:51:32.698 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.5 0.00 0.00 1 0.000 0 0 2023-12-16T05:51:32.699 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.5 0.00 0.00 1 0.000 0 0 2023-12-16T05:51:32.699 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.5 0.00 0.00 1 0.000 0 0 2023-12-16T05:51:32.699 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2023-12-16T05:51:32.699 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** Compaction Stats [default] ** 2023-12-16T05:51:32.699 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T05:51:32.699 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T05:51:32.699 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.5 0.00 0.00 1 0.000 0 0 2023-12-16T05:51:32.699 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T05:51:32.699 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-16T05:51:32.699 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T05:51:32.699 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T05:51:32.699 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T05:51:32.699 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T05:51:32.699 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Cumulative compaction: 0.00 GB write, 0.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T05:51:32.699 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Interval compaction: 0.00 GB write, 0.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T05:51:32.700 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T05:51:32.700 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2023-12-16T05:51:32.700 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T05:51:32.700 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2023-12-16T05:51:32.700 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** Compaction Stats [default] ** 2023-12-16T05:51:32.700 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T05:51:32.700 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T05:51:32.700 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.5 0.00 0.00 1 0.000 0 0 2023-12-16T05:51:32.700 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.5 0.00 0.00 1 0.000 0 0 2023-12-16T05:51:32.700 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-16T05:51:32.700 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2023-12-16T05:51:32.700 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** Compaction Stats [default] ** 2023-12-16T05:51:32.700 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T05:51:32.700 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T05:51:32.700 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.5 0.00 0.00 1 0.000 0 0 2023-12-16T05:51:32.701 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T05:51:32.701 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-16T05:51:32.701 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T05:51:32.701 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T05:51:32.701 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T05:51:32.701 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T05:51:32.701 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Cumulative compaction: 0.00 GB write, 0.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T05:51:32.701 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T05:51:32.701 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T05:51:32.701 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2023-12-16T05:51:32.701 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T05:51:32.701 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mon.smithi156 does not exist in monmap, will attempt to join an existing cluster 2023-12-16T05:51:32.701 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: using public_addr v2:172.21.15.156:0/0 -> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-12-16T05:51:32.701 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: starting mon.smithi156 rank -1 at public addrs [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] at bind addrs [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi156 fsid d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:51:32.701 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mon.smithi156@-1(???) e0 preinit fsid d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:51:32.702 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 bash[120963]: 4575acae9bdb7ee5a7c9899080f94fb814bb94c92db5bc86cbffef20753aaddc 2023-12-16T05:51:32.702 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 systemd[1]: Started Ceph mon.smithi156 for d344784e-9bd6-11ee-95a5-87774f69a715. 2023-12-16T05:51:32.702 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mon.smithi156@-1(synchronizing).mds e1 new map 2023-12-16T05:51:32.702 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mon.smithi156@-1(synchronizing).mds e1 print_map 2023-12-16T05:51:32.702 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: e1 2023-12-16T05:51:32.702 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T05:51:32.702 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T05:51:32.702 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: legacy client fscid: -1 2023-12-16T05:51:32.702 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2023-12-16T05:51:32.702 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: No filesystems configured 2023-12-16T05:51:32.702 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mon.smithi156@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-12-16T05:51:32.702 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mon.smithi156@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-12-16T05:51:32.702 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mon.smithi156@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-12-16T05:51:32.702 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mon.smithi156@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-12-16T05:51:32.702 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mon.smithi156@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-12-16T05:51:32.702 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mon.smithi156@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-12-16T05:51:32.703 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mon.smithi156@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2023-12-16T05:51:32.703 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mon.smithi156@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-16T05:51:32.703 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mon.smithi156@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T05:51:32.703 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mon.smithi156@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T05:51:32.703 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mon.smithi156@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T05:51:32.703 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:32.703 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi155:172.21.15.155=smithi155;smithi156:172.21.15.156=smithi156", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:51:32.703 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: Saving service mon spec with placement smithi155:172.21.15.155=smithi155;smithi156:172.21.15.156=smithi156;count:2 2023-12-16T05:51:32.703 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.703 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.703 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='client.? 172.21.15.156:0/1857424905' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:32.703 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:32.703 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:32.703 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='client.? 172.21.15.156:0/4254222036' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:32.703 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:32.704 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='client.? 172.21.15.156:0/1235803299' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:32.704 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:32.704 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.704 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.704 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.704 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.704 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.704 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.704 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: Deploying daemon prometheus.smithi155 on smithi155 2023-12-16T05:51:32.704 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:32.704 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.704 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='client.? 172.21.15.156:0/2620931238' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:32.704 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:32.704 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='client.? 172.21.15.156:0/715102433' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:32.704 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:32.704 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:32.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-16T05:51:32.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='client.? 172.21.15.156:0/2717233197' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:32.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14162 172.21.15.155:0/3854044644' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-16T05:51:32.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mgrmap e14: smithi155.maowdn(active, since 41s) 2023-12-16T05:51:32.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='client.? 172.21.15.156:0/3939083186' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:32.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='client.? 172.21.15.156:0/2075733513' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:32.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: Active manager daemon smithi155.maowdn restarted 2023-12-16T05:51:32.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: Activating manager daemon smithi155.maowdn 2023-12-16T05:51:32.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: osdmap e5: 0 total, 0 up, 0 in 2023-12-16T05:51:32.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mgrmap e15: smithi155.maowdn(active, starting, since 0.00287573s) 2023-12-16T05:51:32.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:51:32.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr metadata", "who": "smithi155.maowdn", "id": "smithi155.maowdn"}]: dispatch 2023-12-16T05:51:32.706 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T05:51:32.706 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T05:51:32.706 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T05:51:32.706 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: Manager daemon smithi155.maowdn is now available 2023-12-16T05:51:32.706 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:51:32.706 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:51:32.706 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.706 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:51:32.706 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.maowdn/mirror_snapshot_schedule"}]: dispatch 2023-12-16T05:51:32.706 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.maowdn/trash_purge_schedule"}]: dispatch 2023-12-16T05:51:32.706 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.706 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: [16/Dec/2023:05:51:17] ENGINE Bus STARTING 2023-12-16T05:51:32.706 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: [16/Dec/2023:05:51:17] ENGINE Serving on https://172.21.15.155:7150 2023-12-16T05:51:32.706 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: [16/Dec/2023:05:51:17] ENGINE Bus STARTED 2023-12-16T05:51:32.706 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.706 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mgrmap e16: smithi155.maowdn(active, since 1.00474s) 2023-12-16T05:51:32.707 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.707 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.707 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='client.? 172.21.15.156:0/2542987402' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:32.707 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mgrmap e17: smithi155.maowdn(active, since 2s) 2023-12-16T05:51:32.707 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.707 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.707 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.707 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.707 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd/host:smithi155", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:51:32.707 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.707 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.707 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.707 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.707 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd/host:smithi156", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:51:32.707 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:32.707 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:51:32.708 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: Updating smithi155:/etc/ceph/ceph.conf 2023-12-16T05:51:32.708 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: Updating smithi156:/etc/ceph/ceph.conf 2023-12-16T05:51:32.708 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: Updating smithi156:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:51:32.708 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: Updating smithi155:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:51:32.708 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-12-16T05:51:32.708 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2023-12-16T05:51:32.708 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='client.? 172.21.15.156:0/670583230' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:32.708 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: Updating smithi156:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T05:51:32.708 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: Updating smithi155:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T05:51:32.708 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.708 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.708 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.708 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.708 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.708 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi156", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T05:51:32.709 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi156", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-16T05:51:32.709 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:32.709 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: Deploying daemon crash.smithi156 on smithi156 2023-12-16T05:51:32.709 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.709 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.709 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.709 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.709 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: Deploying daemon node-exporter.smithi156 on smithi156 2023-12-16T05:51:32.709 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='client.? 172.21.15.156:0/3340105471' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:32.709 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.709 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.709 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.709 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.709 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.709 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.pclong", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T05:51:32.709 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.pclong", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-16T05:51:32.710 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T05:51:32.710 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:32.710 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: Deploying daemon mgr.smithi156.pclong on smithi156 2023-12-16T05:51:32.710 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='client.? 172.21.15.156:0/3918455342' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:32.710 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.710 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.710 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.710 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.710 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T05:51:32.710 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:32.710 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: Deploying daemon mon.smithi156 on smithi156 2023-12-16T05:51:32.710 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:51:32.710 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:32.710 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mon.smithi156@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2023-12-16T05:51:32.710 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:32 smithi156 ceph-mon[121001]: mon.smithi156@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-12-16T05:51:33.131 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T05:51:33.131 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T05:51:33.409 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi156/config 2023-12-16T05:51:37.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.565+0000 7f5e48065700 1 -- 172.21.15.156:0/3126595531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e2c003580 msgr2=0x7f5e2c005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:37.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.565+0000 7f5e48065700 1 --2- 172.21.15.156:0/3126595531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e2c003580 0x7f5e2c005a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5e400fc9c0 tx=0x7f5e3c00b040 comp rx=0 tx=0).stop 2023-12-16T05:51:37.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.565+0000 7f5e48065700 1 -- 172.21.15.156:0/3126595531 shutdown_connections 2023-12-16T05:51:37.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.565+0000 7f5e48065700 1 --2- 172.21.15.156:0/3126595531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e2c003580 0x7f5e2c005a00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:37.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.565+0000 7f5e48065700 1 -- 172.21.15.156:0/3126595531 >> 172.21.15.156:0/3126595531 conn(0x7f5e400f8630 msgr2=0x7f5e400faa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:37.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.565+0000 7f5e48065700 1 -- 172.21.15.156:0/3126595531 shutdown_connections 2023-12-16T05:51:37.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.565+0000 7f5e48065700 1 -- 172.21.15.156:0/3126595531 wait complete. 2023-12-16T05:51:37.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.565+0000 7f5e48065700 1 Processor -- start 2023-12-16T05:51:37.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.565+0000 7f5e48065700 1 -- start start 2023-12-16T05:51:37.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.566+0000 7f5e48065700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e2c003580 0x7f5e40112cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:37.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.566+0000 7f5e48065700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e40113200 0x7f5e4010cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:37.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.566+0000 7f5e48065700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e40113810 con 0x7f5e2c003580 2023-12-16T05:51:37.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.566+0000 7f5e48065700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4010d0a0 con 0x7f5e40113200 2023-12-16T05:51:37.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.566+0000 7f5e45600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e40113200 0x7f5e4010cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:37.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.566+0000 7f5e45600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e40113200 0x7f5e4010cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54278/0 (socket says 172.21.15.156:54278) 2023-12-16T05:51:37.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.566+0000 7f5e45600700 1 -- 172.21.15.156:0/349819605 learned_addr learned my addr 172.21.15.156:0/349819605 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-12-16T05:51:37.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.566+0000 7f5e45e01700 1 --2- 172.21.15.156:0/349819605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e2c003580 0x7f5e40112cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:37.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.566+0000 7f5e45600700 1 -- 172.21.15.156:0/349819605 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e40113200 msgr2=0x7f5e4010cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-16T05:51:37.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.566+0000 7f5e45600700 1 -- 172.21.15.156:0/349819605 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e40113200 msgr2=0x7f5e4010cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-16T05:51:37.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.566+0000 7f5e45600700 1 --2- 172.21.15.156:0/349819605 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e40113200 0x7f5e4010cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-16T05:51:37.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.566+0000 7f5e45600700 1 --2- 172.21.15.156:0/349819605 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e40113200 0x7f5e4010cb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T05:51:37.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.566+0000 7f5e45e01700 1 -- 172.21.15.156:0/349819605 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e40113200 msgr2=0x7f5e4010cb60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T05:51:37.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.566+0000 7f5e45e01700 1 --2- 172.21.15.156:0/349819605 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e40113200 0x7f5e4010cb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:37.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.566+0000 7f5e45e01700 1 -- 172.21.15.156:0/349819605 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c005040 con 0x7f5e2c003580 2023-12-16T05:51:37.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.566+0000 7f5e45e01700 1 --2- 172.21.15.156:0/349819605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e2c003580 0x7f5e40112cc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c004810 tx=0x7f5e3c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:37.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.567+0000 7f5e367fc700 1 -- 172.21.15.156:0/349819605 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e3c015eb0 con 0x7f5e2c003580 2023-12-16T05:51:37.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.567+0000 7f5e367fc700 1 -- 172.21.15.156:0/349819605 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5e3c0095c0 con 0x7f5e2c003580 2023-12-16T05:51:37.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.567+0000 7f5e48065700 1 -- 172.21.15.156:0/349819605 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4010d320 con 0x7f5e2c003580 2023-12-16T05:51:37.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.567+0000 7f5e367fc700 1 -- 172.21.15.156:0/349819605 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e3c020ce0 con 0x7f5e2c003580 2023-12-16T05:51:37.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.567+0000 7f5e48065700 1 -- 172.21.15.156:0/349819605 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4010d860 con 0x7f5e2c003580 2023-12-16T05:51:37.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.568+0000 7f5e48065700 1 -- 172.21.15.156:0/349819605 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4005f270 con 0x7f5e2c003580 2023-12-16T05:51:37.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.568+0000 7f5e367fc700 1 -- 172.21.15.156:0/349819605 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 18) v1 ==== 86393+0+0 (secure 0 0 0) 0x7f5e3c01e070 con 0x7f5e2c003580 2023-12-16T05:51:37.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.568+0000 7f5e367fc700 1 --2- 172.21.15.156:0/349819605 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f5e24069020 0x7f5e2406b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:37.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.569+0000 7f5e367fc700 1 -- 172.21.15.156:0/349819605 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f5e3c01c070 con 0x7f5e2c003580 2023-12-16T05:51:37.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.569+0000 7f5e45600700 1 --2- 172.21.15.156:0/349819605 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f5e24069020 0x7f5e2406b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:37.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.569+0000 7f5e45600700 1 --2- 172.21.15.156:0/349819605 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f5e24069020 0x7f5e2406b4d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5e30006fd0 tx=0x7f5e30008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:37.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.573+0000 7f5e367fc700 1 -- 172.21.15.156:0/349819605 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5e3c057f60 con 0x7f5e2c003580 2023-12-16T05:51:37.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:51:37.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: mon.smithi155 calling monitor election 2023-12-16T05:51:37.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:51:37.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:51:37.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:51:37.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: mon.smithi156 calling monitor election 2023-12-16T05:51:37.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:51:37.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.156:0/2425496400' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.pclong/crt"}]: dispatch 2023-12-16T05:51:37.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:51:37.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:37.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:51:37.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: mon.smithi155 is new leader, mons smithi155,smithi156 in quorum (ranks 0,1) 2023-12-16T05:51:37.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: monmap e2: 2 mons at {smithi155=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0],smithi156=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T05:51:37.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: fsmap 2023-12-16T05:51:37.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: osdmap e5: 0 total, 0 up, 0 in 2023-12-16T05:51:37.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: mgrmap e17: smithi155.maowdn(active, since 20s) 2023-12-16T05:51:37.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: Standby manager daemon smithi156.pclong started 2023-12-16T05:51:37.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.156:0/2425496400' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T05:51:37.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: overall HEALTH_OK 2023-12-16T05:51:37.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.156:0/2425496400' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.pclong/key"}]: dispatch 2023-12-16T05:51:37.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.156:0/2425496400' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T05:51:37.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:37.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:37.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:37.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:37.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:37.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.847+0000 7f5e48065700 1 -- 172.21.15.156:0/349819605 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5e40104680 con 0x7f5e2c003580 2023-12-16T05:51:37.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.848+0000 7f5e367fc700 1 -- 172.21.15.156:0/349819605 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1021 (secure 0 0 0) 0x7f5e3c02e410 con 0x7f5e2c003580 2023-12-16T05:51:37.851 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-16T05:51:37.851 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":2,"fsid":"d344784e-9bd6-11ee-95a5-87774f69a715","modified":"2023-12-16T05:51:32.390843Z","created":"2023-12-16T05:49:37.981819Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi155","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi156","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:3300","nonce":0},{"type":"v1","addr":"172.21.15.156:6789","nonce":0}]},"addr":"172.21.15.156:6789/0","public_addr":"172.21.15.156:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-16T05:51:37.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.850+0000 7f5e48065700 1 -- 172.21.15.156:0/349819605 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f5e24069020 msgr2=0x7f5e2406b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:37.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.850+0000 7f5e48065700 1 --2- 172.21.15.156:0/349819605 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f5e24069020 0x7f5e2406b4d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5e30006fd0 tx=0x7f5e30008040 comp rx=0 tx=0).stop 2023-12-16T05:51:37.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.850+0000 7f5e48065700 1 -- 172.21.15.156:0/349819605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e2c003580 msgr2=0x7f5e40112cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:37.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.850+0000 7f5e48065700 1 --2- 172.21.15.156:0/349819605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e2c003580 0x7f5e40112cc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c004810 tx=0x7f5e3c00b040 comp rx=0 tx=0).stop 2023-12-16T05:51:37.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.850+0000 7f5e48065700 1 -- 172.21.15.156:0/349819605 shutdown_connections 2023-12-16T05:51:37.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.850+0000 7f5e48065700 1 --2- 172.21.15.156:0/349819605 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f5e24069020 0x7f5e2406b4d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:37.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.851+0000 7f5e48065700 1 --2- 172.21.15.156:0/349819605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e2c003580 0x7f5e40112cc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:37.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.851+0000 7f5e48065700 1 --2- 172.21.15.156:0/349819605 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e40113200 0x7f5e4010cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:37.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.851+0000 7f5e48065700 1 -- 172.21.15.156:0/349819605 >> 172.21.15.156:0/349819605 conn(0x7f5e400f8630 msgr2=0x7f5e400fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:37.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.851+0000 7f5e48065700 1 -- 172.21.15.156:0/349819605 shutdown_connections 2023-12-16T05:51:37.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:51:37.851+0000 7f5e48065700 1 -- 172.21.15.156:0/349819605 wait complete. 2023-12-16T05:51:37.855 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 2 2023-12-16T05:51:37.878 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:51:37.878 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: mon.smithi155 calling monitor election 2023-12-16T05:51:37.878 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:51:37.878 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:51:37.878 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:51:37.878 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: mon.smithi156 calling monitor election 2023-12-16T05:51:37.879 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:51:37.879 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.156:0/2425496400' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.pclong/crt"}]: dispatch 2023-12-16T05:51:37.879 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:51:37.879 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:37.879 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:51:37.879 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: mon.smithi155 is new leader, mons smithi155,smithi156 in quorum (ranks 0,1) 2023-12-16T05:51:37.879 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: monmap e2: 2 mons at {smithi155=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0],smithi156=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T05:51:37.879 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: fsmap 2023-12-16T05:51:37.879 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: osdmap e5: 0 total, 0 up, 0 in 2023-12-16T05:51:37.879 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: mgrmap e17: smithi155.maowdn(active, since 20s) 2023-12-16T05:51:37.879 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: Standby manager daemon smithi156.pclong started 2023-12-16T05:51:37.879 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.156:0/2425496400' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T05:51:37.879 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: overall HEALTH_OK 2023-12-16T05:51:37.879 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.156:0/2425496400' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.pclong/key"}]: dispatch 2023-12-16T05:51:37.879 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.156:0/2425496400' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T05:51:37.880 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:37.880 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:37.880 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:37.880 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:37.880 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:37 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:38.286 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-12-16T05:51:38.287 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph config generate-minimal-conf 2023-12-16T05:51:38.561 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:51:38.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:38 smithi155 ceph-mon[112451]: mgrmap e18: smithi155.maowdn(active, since 21s), standbys: smithi156.pclong 2023-12-16T05:51:38.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:38 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr metadata", "who": "smithi156.pclong", "id": "smithi156.pclong"}]: dispatch 2023-12-16T05:51:38.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:38 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:51:38.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:38 smithi155 ceph-mon[112451]: from='client.? 172.21.15.156:0/349819605' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:38.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:38 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:51:38.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:38 smithi156 ceph-mon[121001]: mgrmap e18: smithi155.maowdn(active, since 21s), standbys: smithi156.pclong 2023-12-16T05:51:38.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:38 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr metadata", "who": "smithi156.pclong", "id": "smithi156.pclong"}]: dispatch 2023-12-16T05:51:38.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:38 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:51:38.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:38 smithi156 ceph-mon[121001]: from='client.? 172.21.15.156:0/349819605' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T05:51:38.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:38 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:51:39.586 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.580+0000 7f6d0a7f7700 1 -- 172.21.15.155:0/1304628115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d041017e0 msgr2=0x7f6d04101bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:39.586 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.580+0000 7f6d0a7f7700 1 --2- 172.21.15.155:0/1304628115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d041017e0 0x7f6d04101bb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40048c0 tx=0x7f6cf4009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:39.586 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.580+0000 7f6d0a7f7700 1 -- 172.21.15.155:0/1304628115 shutdown_connections 2023-12-16T05:51:39.586 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.580+0000 7f6d0a7f7700 1 --2- 172.21.15.155:0/1304628115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d041017e0 0x7f6d04101bb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:39.586 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.580+0000 7f6d0a7f7700 1 -- 172.21.15.155:0/1304628115 >> 172.21.15.155:0/1304628115 conn(0x7f6d040715e0 msgr2=0x7f6d040719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:39.586 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.580+0000 7f6d0a7f7700 1 -- 172.21.15.155:0/1304628115 shutdown_connections 2023-12-16T05:51:39.586 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.580+0000 7f6d0a7f7700 1 -- 172.21.15.155:0/1304628115 wait complete. 2023-12-16T05:51:39.586 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.581+0000 7f6d0a7f7700 1 Processor -- start 2023-12-16T05:51:39.586 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.581+0000 7f6d0a7f7700 1 -- start start 2023-12-16T05:51:39.586 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.581+0000 7f6d0a7f7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d041017e0 0x7f6d04111b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:39.586 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.581+0000 7f6d0a7f7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d041120a0 0x7f6d0410ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:39.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.581+0000 7f6d0a7f7700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d04112660 con 0x7f6d041017e0 2023-12-16T05:51:39.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.581+0000 7f6d0a7f7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0410bf60 con 0x7f6d041120a0 2023-12-16T05:51:39.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.581+0000 7f6d03fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d041017e0 0x7f6d04111b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:39.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.581+0000 7f6d03fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d041017e0 0x7f6d04111b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45924/0 (socket says 172.21.15.155:45924) 2023-12-16T05:51:39.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.581+0000 7f6d03fff700 1 -- 172.21.15.155:0/2923205135 learned_addr learned my addr 172.21.15.155:0/2923205135 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:51:39.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.582+0000 7f6cfbfff700 1 --2- 172.21.15.155:0/2923205135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d041120a0 0x7f6d0410ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:39.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.582+0000 7f6d03fff700 1 -- 172.21.15.155:0/2923205135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d041120a0 msgr2=0x7f6d0410ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:39.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.582+0000 7f6d03fff700 1 --2- 172.21.15.155:0/2923205135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d041120a0 0x7f6d0410ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:39.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.582+0000 7f6d03fff700 1 -- 172.21.15.155:0/2923205135 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf4005040 con 0x7f6d041017e0 2023-12-16T05:51:39.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.582+0000 7f6cfbfff700 1 --2- 172.21.15.155:0/2923205135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d041120a0 0x7f6d0410ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T05:51:39.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.582+0000 7f6d03fff700 1 --2- 172.21.15.155:0/2923205135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d041017e0 0x7f6d04111b60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400bfe0 tx=0x7f6cf4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:39.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.582+0000 7f6d017fa700 1 -- 172.21.15.155:0/2923205135 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cf400e040 con 0x7f6d041017e0 2023-12-16T05:51:39.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.582+0000 7f6d017fa700 1 -- 172.21.15.155:0/2923205135 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6cf4013420 con 0x7f6d041017e0 2023-12-16T05:51:39.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.582+0000 7f6d0a7f7700 1 -- 172.21.15.155:0/2923205135 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0410c1e0 con 0x7f6d041017e0 2023-12-16T05:51:39.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.582+0000 7f6d017fa700 1 -- 172.21.15.155:0/2923205135 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cf401c630 con 0x7f6d041017e0 2023-12-16T05:51:39.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.582+0000 7f6d0a7f7700 1 -- 172.21.15.155:0/2923205135 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0410c7a0 con 0x7f6d041017e0 2023-12-16T05:51:39.589 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.583+0000 7f6d017fa700 1 -- 172.21.15.155:0/2923205135 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 18) v1 ==== 86393+0+0 (secure 0 0 0) 0x7f6cf40139e0 con 0x7f6d041017e0 2023-12-16T05:51:39.589 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.583+0000 7f6d0a7f7700 1 -- 172.21.15.155:0/2923205135 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0405f270 con 0x7f6d041017e0 2023-12-16T05:51:39.589 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.583+0000 7f6d017fa700 1 --2- 172.21.15.155:0/2923205135 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f6cf0069040 0x7f6cf006b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:39.589 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.584+0000 7f6d017fa700 1 -- 172.21.15.155:0/2923205135 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6cf4086f40 con 0x7f6d041017e0 2023-12-16T05:51:39.589 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.584+0000 7f6cfbfff700 1 --2- 172.21.15.155:0/2923205135 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f6cf0069040 0x7f6cf006b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:39.589 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.584+0000 7f6cfbfff700 1 --2- 172.21.15.155:0/2923205135 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f6cf0069040 0x7f6cf006b4f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0079f0 tx=0x7f6cec008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:39.590 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.588+0000 7f6d017fa700 1 -- 172.21.15.155:0/2923205135 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6cf4058020 con 0x7f6d041017e0 2023-12-16T05:51:39.786 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.783+0000 7f6d0a7f7700 1 -- 172.21.15.155:0/2923205135 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f6d041059f0 con 0x7f6d041017e0 2023-12-16T05:51:39.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.783+0000 7f6d017fa700 1 -- 172.21.15.155:0/2923205135 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7f6cf4052e60 con 0x7f6d041017e0 2023-12-16T05:51:39.787 INFO:teuthology.orchestra.run.smithi155.stdout:# minimal ceph.conf for d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:51:39.787 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2023-12-16T05:51:39.787 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:51:39.787 INFO:teuthology.orchestra.run.smithi155.stdout: mon_host = [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-12-16T05:51:39.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.785+0000 7f6d0a7f7700 1 -- 172.21.15.155:0/2923205135 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f6cf0069040 msgr2=0x7f6cf006b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:39.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.785+0000 7f6d0a7f7700 1 --2- 172.21.15.155:0/2923205135 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f6cf0069040 0x7f6cf006b4f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0079f0 tx=0x7f6cec008040 comp rx=0 tx=0).stop 2023-12-16T05:51:39.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.785+0000 7f6d0a7f7700 1 -- 172.21.15.155:0/2923205135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d041017e0 msgr2=0x7f6d04111b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:39.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.785+0000 7f6d0a7f7700 1 --2- 172.21.15.155:0/2923205135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d041017e0 0x7f6d04111b60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400bfe0 tx=0x7f6cf4009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:39.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.785+0000 7f6d0a7f7700 1 -- 172.21.15.155:0/2923205135 shutdown_connections 2023-12-16T05:51:39.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.785+0000 7f6d0a7f7700 1 --2- 172.21.15.155:0/2923205135 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f6cf0069040 0x7f6cf006b4f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:39.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.785+0000 7f6d0a7f7700 1 --2- 172.21.15.155:0/2923205135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d041017e0 0x7f6d04111b60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:39.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.785+0000 7f6d0a7f7700 1 --2- 172.21.15.155:0/2923205135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d041120a0 0x7f6d0410ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:39.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.785+0000 7f6d0a7f7700 1 -- 172.21.15.155:0/2923205135 >> 172.21.15.155:0/2923205135 conn(0x7f6d040715e0 msgr2=0x7f6d04102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:39.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.786+0000 7f6d0a7f7700 1 -- 172.21.15.155:0/2923205135 shutdown_connections 2023-12-16T05:51:39.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:39.786+0000 7f6d0a7f7700 1 -- 172.21.15.155:0/2923205135 wait complete. 2023-12-16T05:51:40.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:39 smithi155 ceph-mon[112451]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:40.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:40.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:40.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:40.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:51:40.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:39 smithi155 ceph-mon[112451]: Updating smithi155:/etc/ceph/ceph.conf 2023-12-16T05:51:40.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:39 smithi155 ceph-mon[112451]: Updating smithi156:/etc/ceph/ceph.conf 2023-12-16T05:51:40.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:40.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:40.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:40.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:40.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:40.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T05:51:40.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T05:51:40.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:40.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:39 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2923205135' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:40.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:39 smithi156 ceph-mon[121001]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:40.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:40.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:40.183 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:40.183 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:51:40.183 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:39 smithi156 ceph-mon[121001]: Updating smithi155:/etc/ceph/ceph.conf 2023-12-16T05:51:40.183 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:39 smithi156 ceph-mon[121001]: Updating smithi156:/etc/ceph/ceph.conf 2023-12-16T05:51:40.183 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:40.183 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:40.183 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:40.183 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:40.183 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:40.183 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T05:51:40.183 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T05:51:40.183 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:40.183 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:39 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/2923205135' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:40.222 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-12-16T05:51:40.222 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-16T05:51:40.223 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.conf 2023-12-16T05:51:40.252 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-16T05:51:40.253 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-16T05:51:40.321 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-12-16T05:51:40.321 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.conf 2023-12-16T05:51:40.357 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-12-16T05:51:40.357 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-16T05:51:40.428 INFO:tasks.cephadm:Deploying OSDs... 2023-12-16T05:51:40.429 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-16T05:51:40.429 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2023-12-16T05:51:40.446 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-16T05:51:40.447 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 2023-12-16T05:51:40.504 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-16T05:51:40.504 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T05:51:40.504 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 394776 Links: 1 2023-12-16T05:51:40.504 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T05:51:40.505 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T05:51:40.505 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-12-16 05:51:08.427990631 +0000 2023-12-16T05:51:40.505 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-12-16 04:53:36.785466953 +0000 2023-12-16T05:51:40.505 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-12-16 04:53:36.785466953 +0000 2023-12-16T05:51:40.505 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2023-12-16T05:51:40.505 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-16T05:51:40.570 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-12-16T05:51:40.570 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-12-16T05:51:40.570 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000197343 s, 2.6 MB/s 2023-12-16T05:51:40.571 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-16T05:51:40.630 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 2023-12-16T05:51:40.689 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-16T05:51:40.689 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T05:51:40.689 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 397373 Links: 1 2023-12-16T05:51:40.689 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T05:51:40.689 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T05:51:40.689 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-12-16 05:51:08.428990610 +0000 2023-12-16T05:51:40.689 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-12-16 04:53:37.297456797 +0000 2023-12-16T05:51:40.690 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-12-16 04:53:37.297456797 +0000 2023-12-16T05:51:40.690 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2023-12-16T05:51:40.690 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-16T05:51:40.756 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-12-16T05:51:40.756 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-12-16T05:51:40.756 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000214451 s, 2.4 MB/s 2023-12-16T05:51:40.757 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-16T05:51:40.816 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 2023-12-16T05:51:40.874 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-16T05:51:40.874 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T05:51:40.874 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 397537 Links: 1 2023-12-16T05:51:40.874 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T05:51:40.874 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T05:51:40.874 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-12-16 05:51:08.428990610 +0000 2023-12-16T05:51:40.874 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-12-16 04:53:37.820446423 +0000 2023-12-16T05:51:40.874 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-12-16 04:53:37.820446423 +0000 2023-12-16T05:51:40.874 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2023-12-16T05:51:40.875 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-16T05:51:40.939 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-12-16T05:51:40.939 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-12-16T05:51:40.939 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000196603 s, 2.6 MB/s 2023-12-16T05:51:40.940 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-16T05:51:41.001 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 2023-12-16T05:51:41.060 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-16T05:51:41.060 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T05:51:41.060 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 394952 Links: 1 2023-12-16T05:51:41.060 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T05:51:41.060 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T05:51:41.061 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-12-16 05:51:08.428990610 +0000 2023-12-16T05:51:41.061 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-12-16 04:53:38.333436246 +0000 2023-12-16T05:51:41.061 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-12-16 04:53:38.333436246 +0000 2023-12-16T05:51:41.061 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2023-12-16T05:51:41.061 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-16T05:51:41.129 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-12-16T05:51:41.129 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-12-16T05:51:41.129 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000223589 s, 2.3 MB/s 2023-12-16T05:51:41.130 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-16T05:51:41.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:40 smithi156 ceph-mon[121001]: Updating smithi156:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:51:41.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:40 smithi156 ceph-mon[121001]: Updating smithi155:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:51:41.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:40 smithi156 ceph-mon[121001]: Reconfiguring mon.smithi155 (unknown last config time)... 2023-12-16T05:51:41.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:40 smithi156 ceph-mon[121001]: Reconfiguring daemon mon.smithi155 on smithi155 2023-12-16T05:51:41.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:40 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:41.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:40 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:41.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:40 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi155.maowdn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T05:51:41.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:40 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T05:51:41.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:40 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:41.189 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-12-16T05:51:41.189 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/scratch_devs of=/dev/stdout 2023-12-16T05:51:41.211 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-16T05:51:41.212 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_1 2023-12-16T05:51:41.260 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:40 smithi155 ceph-mon[112451]: Updating smithi156:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:51:41.260 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:40 smithi155 ceph-mon[112451]: Updating smithi155:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:51:41.260 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:40 smithi155 ceph-mon[112451]: Reconfiguring mon.smithi155 (unknown last config time)... 2023-12-16T05:51:41.261 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:40 smithi155 ceph-mon[112451]: Reconfiguring daemon mon.smithi155 on smithi155 2023-12-16T05:51:41.261 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:40 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:41.261 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:40 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:41.261 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:40 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi155.maowdn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T05:51:41.261 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:40 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T05:51:41.261 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:40 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:41.272 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-16T05:51:41.272 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T05:51:41.272 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 394670 Links: 1 2023-12-16T05:51:41.272 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T05:51:41.272 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T05:51:41.273 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-12-16 05:51:31.982762105 +0000 2023-12-16T05:51:41.273 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-12-16 04:57:44.629078530 +0000 2023-12-16T05:51:41.273 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-12-16 04:57:44.629078530 +0000 2023-12-16T05:51:41.273 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-12-16T05:51:41.273 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-16T05:51:41.341 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-12-16T05:51:41.342 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-12-16T05:51:41.342 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000120084 s, 4.3 MB/s 2023-12-16T05:51:41.343 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-16T05:51:41.403 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_2 2023-12-16T05:51:41.463 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-16T05:51:41.463 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T05:51:41.463 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 395532 Links: 1 2023-12-16T05:51:41.463 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T05:51:41.463 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T05:51:41.463 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-12-16 05:51:31.982762105 +0000 2023-12-16T05:51:41.463 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-12-16 04:57:45.152070600 +0000 2023-12-16T05:51:41.463 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-12-16 04:57:45.152070600 +0000 2023-12-16T05:51:41.463 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-12-16T05:51:41.464 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-16T05:51:41.531 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-12-16T05:51:41.532 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-12-16T05:51:41.532 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000118552 s, 4.3 MB/s 2023-12-16T05:51:41.533 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-16T05:51:41.592 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_3 2023-12-16T05:51:41.651 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-16T05:51:41.651 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T05:51:41.651 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 396501 Links: 1 2023-12-16T05:51:41.651 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T05:51:41.651 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T05:51:41.651 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-12-16 05:51:31.982762105 +0000 2023-12-16T05:51:41.651 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-12-16 04:57:45.652063018 +0000 2023-12-16T05:51:41.651 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-12-16 04:57:45.652063018 +0000 2023-12-16T05:51:41.651 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-12-16T05:51:41.652 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-16T05:51:41.718 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-12-16T05:51:41.718 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-12-16T05:51:41.718 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000119692 s, 4.3 MB/s 2023-12-16T05:51:41.719 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-16T05:51:41.779 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_4 2023-12-16T05:51:41.838 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-16T05:51:41.838 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T05:51:41.838 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 393084 Links: 1 2023-12-16T05:51:41.838 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T05:51:41.839 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T05:51:41.839 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-12-16 05:51:31.982762105 +0000 2023-12-16T05:51:41.839 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-12-16 04:57:46.177055056 +0000 2023-12-16T05:51:41.839 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-12-16 04:57:46.177055056 +0000 2023-12-16T05:51:41.839 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-12-16T05:51:41.839 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-16T05:51:41.904 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-12-16T05:51:41.905 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-12-16T05:51:41.905 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.00010668 s, 4.8 MB/s 2023-12-16T05:51:41.906 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-16T05:51:41.964 INFO:tasks.cephadm:Deploying osd.0 on smithi155 with /dev/vg_nvme/lv_4... 2023-12-16T05:51:41.965 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-16T05:51:42.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:41 smithi156 ceph-mon[121001]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:42.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:41 smithi156 ceph-mon[121001]: Reconfiguring mgr.smithi155.maowdn (unknown last config time)... 2023-12-16T05:51:42.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:41 smithi156 ceph-mon[121001]: Reconfiguring daemon mgr.smithi155.maowdn on smithi155 2023-12-16T05:51:42.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:41 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:42.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:41 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:42.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:41 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:42.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:41 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi155", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T05:51:42.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:41 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:42.250 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:41 smithi155 ceph-mon[112451]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:42.250 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:41 smithi155 ceph-mon[112451]: Reconfiguring mgr.smithi155.maowdn (unknown last config time)... 2023-12-16T05:51:42.250 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:41 smithi155 ceph-mon[112451]: Reconfiguring daemon mgr.smithi155.maowdn on smithi155 2023-12-16T05:51:42.250 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:41 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:42.251 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:41 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:42.251 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:41 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:42.251 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:41 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi155", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T05:51:42.251 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:41 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:42.327 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:51:43.187 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:42 smithi155 ceph-mon[112451]: Reconfiguring crash.smithi155 (monmap changed)... 2023-12-16T05:51:43.188 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:42 smithi155 ceph-mon[112451]: Reconfiguring daemon crash.smithi155 on smithi155 2023-12-16T05:51:43.188 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:42 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:43.188 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:42 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:43.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:42 smithi156 ceph-mon[121001]: Reconfiguring crash.smithi155 (monmap changed)... 2023-12-16T05:51:43.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:42 smithi156 ceph-mon[121001]: Reconfiguring daemon crash.smithi155 on smithi155 2023-12-16T05:51:43.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:42 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:43.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:42 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:44.095 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-16T05:51:44.095 INFO:teuthology.orchestra.run.smithi155.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-16T05:51:44.095 INFO:teuthology.orchestra.run.smithi155.stderr: stderr: 10+0 records in 2023-12-16T05:51:44.095 INFO:teuthology.orchestra.run.smithi155.stderr:10+0 records out 2023-12-16T05:51:44.095 INFO:teuthology.orchestra.run.smithi155.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110035 s, 953 MB/s 2023-12-16T05:51:44.095 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping successful for: 2023-12-16T05:51:44.269 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:43 smithi155 ceph-mon[112451]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:44.270 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:43 smithi155 ceph-mon[112451]: Reconfiguring alertmanager.smithi155 (dependencies changed)... 2023-12-16T05:51:44.270 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:43 smithi155 ceph-mon[112451]: Reconfiguring daemon alertmanager.smithi155 on smithi155 2023-12-16T05:51:44.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:43 smithi156 ceph-mon[121001]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:44.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:43 smithi156 ceph-mon[121001]: Reconfiguring alertmanager.smithi155 (dependencies changed)... 2023-12-16T05:51:44.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:43 smithi156 ceph-mon[121001]: Reconfiguring daemon alertmanager.smithi155 on smithi155 2023-12-16T05:51:44.794 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi155:vg_nvme/lv_4 2023-12-16T05:51:45.352 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:51:46.176 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:45 smithi155 ceph-mon[112451]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:46.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:45 smithi156 ceph-mon[121001]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:46.558 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.555+0000 7f7d58c2a700 1 -- 172.21.15.155:0/2242695044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d540fbaf0 msgr2=0x7f7d540fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:46.558 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.555+0000 7f7d58c2a700 1 --2- 172.21.15.155:0/2242695044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d540fbaf0 0x7f7d540fbf00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7d44004940 tx=0x7f7d44009e30 comp rx=0 tx=0).stop 2023-12-16T05:51:46.558 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.555+0000 7f7d58c2a700 1 -- 172.21.15.155:0/2242695044 shutdown_connections 2023-12-16T05:51:46.558 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.555+0000 7f7d58c2a700 1 --2- 172.21.15.155:0/2242695044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d540fcd00 0x7f7d540fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:46.559 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.555+0000 7f7d58c2a700 1 --2- 172.21.15.155:0/2242695044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d540fbaf0 0x7f7d540fbf00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:46.559 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.555+0000 7f7d58c2a700 1 -- 172.21.15.155:0/2242695044 >> 172.21.15.155:0/2242695044 conn(0x7f7d540f71d0 msgr2=0x7f7d540f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:51:46.559 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.555+0000 7f7d58c2a700 1 -- 172.21.15.155:0/2242695044 shutdown_connections 2023-12-16T05:51:46.559 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.555+0000 7f7d58c2a700 1 -- 172.21.15.155:0/2242695044 wait complete. 2023-12-16T05:51:46.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.556+0000 7f7d58c2a700 1 Processor -- start 2023-12-16T05:51:46.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.556+0000 7f7d58c2a700 1 -- start start 2023-12-16T05:51:46.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.556+0000 7f7d58c2a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d540fbaf0 0x7f7d5410c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:46.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.556+0000 7f7d58c2a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d540fcd00 0x7f7d5410c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:46.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.556+0000 7f7d58c2a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5410cfa0 con 0x7f7d540fcd00 2023-12-16T05:51:46.561 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.556+0000 7f7d58c2a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5410d840 con 0x7f7d540fbaf0 2023-12-16T05:51:46.561 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.556+0000 7f7d51d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d540fcd00 0x7f7d5410c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:46.561 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.556+0000 7f7d51d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d540fcd00 0x7f7d5410c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:55108/0 (socket says 172.21.15.155:55108) 2023-12-16T05:51:46.561 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.556+0000 7f7d51d9b700 1 -- 172.21.15.155:0/1612268456 learned_addr learned my addr 172.21.15.155:0/1612268456 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:51:46.561 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.556+0000 7f7d5259c700 1 --2- 172.21.15.155:0/1612268456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d540fbaf0 0x7f7d5410c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:46.561 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.557+0000 7f7d51d9b700 1 -- 172.21.15.155:0/1612268456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d540fbaf0 msgr2=0x7f7d5410c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:51:46.561 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.557+0000 7f7d51d9b700 1 --2- 172.21.15.155:0/1612268456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d540fbaf0 0x7f7d5410c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:51:46.561 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.557+0000 7f7d51d9b700 1 -- 172.21.15.155:0/1612268456 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d44005040 con 0x7f7d540fcd00 2023-12-16T05:51:46.561 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.557+0000 7f7d51d9b700 1 --2- 172.21.15.155:0/1612268456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d540fcd00 0x7f7d5410c9a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800ead0 tx=0x7f7d48004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:46.561 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.557+0000 7f7d42ffd700 1 -- 172.21.15.155:0/1612268456 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d4800cb90 con 0x7f7d540fcd00 2023-12-16T05:51:46.562 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.557+0000 7f7d58c2a700 1 -- 172.21.15.155:0/1612268456 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5410dac0 con 0x7f7d540fcd00 2023-12-16T05:51:46.562 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.557+0000 7f7d42ffd700 1 -- 172.21.15.155:0/1612268456 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7d4800ccf0 con 0x7f7d540fcd00 2023-12-16T05:51:46.562 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.557+0000 7f7d42ffd700 1 -- 172.21.15.155:0/1612268456 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d48010810 con 0x7f7d540fcd00 2023-12-16T05:51:46.562 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.557+0000 7f7d58c2a700 1 -- 172.21.15.155:0/1612268456 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5410e000 con 0x7f7d540fcd00 2023-12-16T05:51:46.563 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.558+0000 7f7d58c2a700 1 -- 172.21.15.155:0/1612268456 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5404bb80 con 0x7f7d540fcd00 2023-12-16T05:51:46.563 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.559+0000 7f7d42ffd700 1 -- 172.21.15.155:0/1612268456 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 18) v1 ==== 86393+0+0 (secure 0 0 0) 0x7f7d48011470 con 0x7f7d540fcd00 2023-12-16T05:51:46.563 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.559+0000 7f7d42ffd700 1 --2- 172.21.15.155:0/1612268456 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7d3c068ed0 0x7f7d3c06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:51:46.563 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.559+0000 7f7d42ffd700 1 -- 172.21.15.155:0/1612268456 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f7d48088490 con 0x7f7d540fcd00 2023-12-16T05:51:46.563 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.559+0000 7f7d5259c700 1 --2- 172.21.15.155:0/1612268456 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7d3c068ed0 0x7f7d3c06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:51:46.563 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.559+0000 7f7d5259c700 1 --2- 172.21.15.155:0/1612268456 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7d3c068ed0 0x7f7d3c06b380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7d44004890 tx=0x7f7d44009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:51:46.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.563+0000 7f7d42ffd700 1 -- 172.21.15.155:0/1612268456 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7d480594d0 con 0x7f7d540fcd00 2023-12-16T05:51:46.778 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:51:46.775+0000 7f7d58c2a700 1 -- 172.21.15.155:0/1612268456 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d5410e4f0 con 0x7f7d3c068ed0 2023-12-16T05:51:47.488 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:47 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:47.488 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:47 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:47.488 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:47 smithi155 ceph-mon[112451]: Reconfiguring grafana.smithi155 (dependencies changed)... 2023-12-16T05:51:47.488 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:47 smithi155 ceph-mon[112451]: Reconfiguring daemon grafana.smithi155 on smithi155 2023-12-16T05:51:47.489 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:47 smithi155 ceph-mon[112451]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:47.489 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:47 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:51:47.489 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:47 smithi155 ceph-mon[112451]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:51:47.489 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:47 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T05:51:47.489 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:47 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T05:51:47.489 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:47 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:47.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:47 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:47.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:47 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:47.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:47 smithi156 ceph-mon[121001]: Reconfiguring grafana.smithi155 (dependencies changed)... 2023-12-16T05:51:47.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:47 smithi156 ceph-mon[121001]: Reconfiguring daemon grafana.smithi155 on smithi155 2023-12-16T05:51:47.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:47 smithi156 ceph-mon[121001]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:47.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:47 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:51:47.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:47 smithi156 ceph-mon[121001]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:51:47.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:47 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T05:51:47.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:47 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T05:51:47.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:47 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:49.455 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:49 smithi155 ceph-mon[112451]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:49.455 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:49 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:49.455 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:49 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:49.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:49 smithi156 ceph-mon[121001]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:49.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:49 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:49.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:49 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:50.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:50 smithi155 ceph-mon[112451]: Reconfiguring prometheus.smithi155 (dependencies changed)... 2023-12-16T05:51:50.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:50 smithi155 ceph-mon[112451]: Reconfiguring daemon prometheus.smithi155 on smithi155 2023-12-16T05:51:50.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:50 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/1130427131' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7f9fdb2e-99ba-4298-973a-70c36ba678ab"}]: dispatch 2023-12-16T05:51:50.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:50 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/1130427131' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7f9fdb2e-99ba-4298-973a-70c36ba678ab"}]': finished 2023-12-16T05:51:50.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:50 smithi155 ceph-mon[112451]: osdmap e6: 1 total, 0 up, 1 in 2023-12-16T05:51:50.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:50 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T05:51:50.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:50 smithi156 ceph-mon[121001]: Reconfiguring prometheus.smithi155 (dependencies changed)... 2023-12-16T05:51:50.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:50 smithi156 ceph-mon[121001]: Reconfiguring daemon prometheus.smithi155 on smithi155 2023-12-16T05:51:50.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:50 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/1130427131' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7f9fdb2e-99ba-4298-973a-70c36ba678ab"}]: dispatch 2023-12-16T05:51:50.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:50 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/1130427131' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7f9fdb2e-99ba-4298-973a-70c36ba678ab"}]': finished 2023-12-16T05:51:50.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:50 smithi156 ceph-mon[121001]: osdmap e6: 1 total, 0 up, 1 in 2023-12-16T05:51:50.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:50 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T05:51:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:51 smithi155 ceph-mon[112451]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:51 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/442333470' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T05:51:51.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:51 smithi156 ceph-mon[121001]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:51.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:51 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/442333470' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T05:51:53.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:53 smithi155 ceph-mon[112451]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:53.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:53 smithi156 ceph-mon[121001]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:55.792 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:55 smithi155 ceph-mon[112451]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:55.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:55 smithi156 ceph-mon[121001]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:57.657 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:57 smithi155 ceph-mon[112451]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:57.657 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:57 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:57.657 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:57 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:57.658 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:57 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi156", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T05:51:57.658 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:57 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:57.818 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:57 smithi156 ceph-mon[121001]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:57.818 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:57 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:57.818 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:57 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:57.818 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:57 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi156", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T05:51:57.819 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:57 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:58.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:58 smithi155 ceph-mon[112451]: Reconfiguring crash.smithi156 (monmap changed)... 2023-12-16T05:51:58.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:58 smithi155 ceph-mon[112451]: Reconfiguring daemon crash.smithi156 on smithi156 2023-12-16T05:51:58.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:58 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T05:51:58.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:58 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:58.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:58 smithi156 ceph-mon[121001]: Reconfiguring crash.smithi156 (monmap changed)... 2023-12-16T05:51:58.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:58 smithi156 ceph-mon[121001]: Reconfiguring daemon crash.smithi156 on smithi156 2023-12-16T05:51:58.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:58 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T05:51:58.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:58 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:59.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:59 smithi155 ceph-mon[112451]: Deploying daemon osd.0 on smithi155 2023-12-16T05:51:59.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:59 smithi155 ceph-mon[112451]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:59.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:59 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:59.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:59 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:59.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:59 smithi155 ceph-mon[112451]: Reconfiguring mgr.smithi156.pclong (monmap changed)... 2023-12-16T05:51:59.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:59 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.pclong", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T05:51:59.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:59 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T05:51:59.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:59 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:59.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:59 smithi155 ceph-mon[112451]: Reconfiguring daemon mgr.smithi156.pclong on smithi156 2023-12-16T05:51:59.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:59 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:59.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:59 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:59.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:59 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T05:51:59.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:59 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T05:51:59.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:51:59 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:59.883 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:59 smithi156 ceph-mon[121001]: Deploying daemon osd.0 on smithi155 2023-12-16T05:51:59.883 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:59 smithi156 ceph-mon[121001]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:51:59.884 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:59 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:59.884 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:59 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:59.884 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:59 smithi156 ceph-mon[121001]: Reconfiguring mgr.smithi156.pclong (monmap changed)... 2023-12-16T05:51:59.884 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:59 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.pclong", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T05:51:59.884 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:59 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T05:51:59.884 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:59 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:51:59.884 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:59 smithi156 ceph-mon[121001]: Reconfiguring daemon mgr.smithi156.pclong on smithi156 2023-12-16T05:51:59.884 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:59 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:59.884 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:59 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:51:59.884 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:59 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T05:51:59.884 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:59 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T05:51:59.884 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:51:59 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:00.740 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:00 smithi155 ceph-mon[112451]: Reconfiguring mon.smithi156 (monmap changed)... 2023-12-16T05:52:00.740 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:00 smithi155 ceph-mon[112451]: Reconfiguring daemon mon.smithi156 on smithi156 2023-12-16T05:52:00.740 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:00 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:00.740 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:00 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:00.740 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:00 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T05:52:00.740 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:00 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi155.front.sepia.ceph.com:9093"}]: dispatch 2023-12-16T05:52:00.740 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:00 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:00.741 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:00 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T05:52:00.741 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:00 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi155.front.sepia.ceph.com:3000"}]: dispatch 2023-12-16T05:52:00.741 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:00 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:00.741 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:00 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T05:52:00.741 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:00 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi155.front.sepia.ceph.com:9095"}]: dispatch 2023-12-16T05:52:00.741 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:00 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:00.741 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:00 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:52:00.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:00 smithi156 ceph-mon[121001]: Reconfiguring mon.smithi156 (monmap changed)... 2023-12-16T05:52:00.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:00 smithi156 ceph-mon[121001]: Reconfiguring daemon mon.smithi156 on smithi156 2023-12-16T05:52:00.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:00 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:00.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:00 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:00.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:00 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T05:52:00.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:00 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi155.front.sepia.ceph.com:9093"}]: dispatch 2023-12-16T05:52:00.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:00 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:00.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:00 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T05:52:00.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:00 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi155.front.sepia.ceph.com:3000"}]: dispatch 2023-12-16T05:52:00.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:00 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:00.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:00 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T05:52:00.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:00 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi155.front.sepia.ceph.com:9095"}]: dispatch 2023-12-16T05:52:00.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:00 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:00.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:00 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:52:01.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:01 smithi155 ceph-mon[112451]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:52:01.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:01 smithi155 ceph-mon[112451]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T05:52:01.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:01 smithi155 ceph-mon[112451]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi155.front.sepia.ceph.com:9093"}]: dispatch 2023-12-16T05:52:01.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:01 smithi155 ceph-mon[112451]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T05:52:01.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:01 smithi155 ceph-mon[112451]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi155.front.sepia.ceph.com:3000"}]: dispatch 2023-12-16T05:52:01.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:01 smithi155 ceph-mon[112451]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T05:52:01.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:01 smithi155 ceph-mon[112451]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi155.front.sepia.ceph.com:9095"}]: dispatch 2023-12-16T05:52:01.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:01 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:52:01.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:01 smithi156 ceph-mon[121001]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:52:01.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:01 smithi156 ceph-mon[121001]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T05:52:01.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:01 smithi156 ceph-mon[121001]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi155.front.sepia.ceph.com:9093"}]: dispatch 2023-12-16T05:52:01.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:01 smithi156 ceph-mon[121001]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T05:52:01.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:01 smithi156 ceph-mon[121001]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi155.front.sepia.ceph.com:3000"}]: dispatch 2023-12-16T05:52:01.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:01 smithi156 ceph-mon[121001]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T05:52:01.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:01 smithi156 ceph-mon[121001]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi155.front.sepia.ceph.com:9095"}]: dispatch 2023-12-16T05:52:01.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:01 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:52:03.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:02 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:03.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:02 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:03.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:02 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:03.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:02 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:03.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:02 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:03.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:02 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:03.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:02 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:03.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:02 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:03.949 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:03 smithi155 ceph-mon[112451]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:52:04.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:03 smithi156 ceph-mon[121001]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:52:04.485 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:04.482+0000 7f7d42ffd700 1 -- 172.21.15.155:0/1612268456 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7d5410e4f0 con 0x7f7d3c068ed0 2023-12-16T05:52:04.486 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 0 on host 'smithi155' 2023-12-16T05:52:04.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:04.484+0000 7f7d58c2a700 1 -- 172.21.15.155:0/1612268456 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7d3c068ed0 msgr2=0x7f7d3c06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:52:04.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:04.484+0000 7f7d58c2a700 1 --2- 172.21.15.155:0/1612268456 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7d3c068ed0 0x7f7d3c06b380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7d44004890 tx=0x7f7d44009e30 comp rx=0 tx=0).stop 2023-12-16T05:52:04.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:04.484+0000 7f7d58c2a700 1 -- 172.21.15.155:0/1612268456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d540fcd00 msgr2=0x7f7d5410c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:52:04.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:04.484+0000 7f7d58c2a700 1 --2- 172.21.15.155:0/1612268456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d540fcd00 0x7f7d5410c9a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800ead0 tx=0x7f7d48004500 comp rx=0 tx=0).stop 2023-12-16T05:52:04.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:04.484+0000 7f7d58c2a700 1 -- 172.21.15.155:0/1612268456 shutdown_connections 2023-12-16T05:52:04.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:04.484+0000 7f7d58c2a700 1 --2- 172.21.15.155:0/1612268456 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7d3c068ed0 0x7f7d3c06b380 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:52:04.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:04.484+0000 7f7d58c2a700 1 --2- 172.21.15.155:0/1612268456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d540fbaf0 0x7f7d5410c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:52:04.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:04.484+0000 7f7d58c2a700 1 --2- 172.21.15.155:0/1612268456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d540fcd00 0x7f7d5410c9a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:52:04.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:04.484+0000 7f7d58c2a700 1 -- 172.21.15.155:0/1612268456 >> 172.21.15.155:0/1612268456 conn(0x7f7d540f71d0 msgr2=0x7f7d540fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:52:04.489 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:04.484+0000 7f7d58c2a700 1 -- 172.21.15.155:0/1612268456 shutdown_connections 2023-12-16T05:52:04.489 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:04.484+0000 7f7d58c2a700 1 -- 172.21.15.155:0/1612268456 wait complete. 2023-12-16T05:52:04.932 DEBUG:teuthology.orchestra.run.smithi155:osd.0> sudo journalctl -f -n 0 -u ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.0.service 2023-12-16T05:52:04.935 INFO:tasks.cephadm:Deploying osd.1 on smithi155 with /dev/vg_nvme/lv_3... 2023-12-16T05:52:04.935 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-16T05:52:04.965 INFO:journalctl@ceph.osd.0.smithi155.stdout:-- Logs begin at Sat 2023-12-16 04:41:47 UTC. -- 2023-12-16T05:52:05.392 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:52:05.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:05 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:05.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:05 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:05.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:05 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:05.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:05 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:52:05.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:05 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:05.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:05 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:52:05.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:05 smithi156 ceph-mon[121001]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:52:05.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:05 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:05.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:05 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:05.529 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:05 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:05.530 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:05 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:05.530 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:05 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:05.530 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:05 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:52:05.530 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:05 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:05.530 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:05 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:52:05.530 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:05 smithi155 ceph-mon[112451]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:52:05.530 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:05 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:05.530 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:05 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:06.326 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 05:52:06 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-0[136151]: 2023-12-16T05:52:06.101+0000 7f2fb7182540 -1 osd.0 0 log_to_monitors true 2023-12-16T05:52:06.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:06 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:06.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:06 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:06.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:06 smithi155 ceph-mon[112451]: from='osd.0 [v2:172.21.15.155:6802/1483763675,v1:172.21.15.155:6803/1483763675]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-16T05:52:06.881 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-16T05:52:06.882 INFO:teuthology.orchestra.run.smithi155.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-16T05:52:06.882 INFO:teuthology.orchestra.run.smithi155.stderr: stderr: 10+0 records in 2023-12-16T05:52:06.882 INFO:teuthology.orchestra.run.smithi155.stderr:10+0 records out 2023-12-16T05:52:06.882 INFO:teuthology.orchestra.run.smithi155.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110774 s, 947 MB/s 2023-12-16T05:52:06.882 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping successful for: 2023-12-16T05:52:06.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:06 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:06.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:06 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:06.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:06 smithi156 ceph-mon[121001]: from='osd.0 [v2:172.21.15.155:6802/1483763675,v1:172.21.15.155:6803/1483763675]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-16T05:52:07.544 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi155:vg_nvme/lv_3 2023-12-16T05:52:07.747 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 05:52:07 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-0[136151]: 2023-12-16T05:52:07.452+0000 7f2fad967700 -1 osd.0 0 waiting for initial osdmap 2023-12-16T05:52:07.747 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 05:52:07 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-0[136151]: 2023-12-16T05:52:07.455+0000 7f2fa8762700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T05:52:07.747 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:07 smithi155 ceph-mon[112451]: from='osd.0 [v2:172.21.15.155:6802/1483763675,v1:172.21.15.155:6803/1483763675]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-16T05:52:07.747 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:07 smithi155 ceph-mon[112451]: osdmap e7: 1 total, 0 up, 1 in 2023-12-16T05:52:07.747 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:07 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T05:52:07.747 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:07 smithi155 ceph-mon[112451]: from='osd.0 [v2:172.21.15.155:6802/1483763675,v1:172.21.15.155:6803/1483763675]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-12-16T05:52:07.748 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:07 smithi155 ceph-mon[112451]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:52:07.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:07 smithi156 ceph-mon[121001]: from='osd.0 [v2:172.21.15.155:6802/1483763675,v1:172.21.15.155:6803/1483763675]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-16T05:52:07.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:07 smithi156 ceph-mon[121001]: osdmap e7: 1 total, 0 up, 1 in 2023-12-16T05:52:07.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:07 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T05:52:07.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:07 smithi156 ceph-mon[121001]: from='osd.0 [v2:172.21.15.155:6802/1483763675,v1:172.21.15.155:6803/1483763675]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-12-16T05:52:07.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:07 smithi156 ceph-mon[121001]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:52:08.049 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:52:08.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:08 smithi155 ceph-mon[112451]: from='osd.0 [v2:172.21.15.155:6802/1483763675,v1:172.21.15.155:6803/1483763675]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2023-12-16T05:52:08.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:08 smithi155 ceph-mon[112451]: osdmap e8: 1 total, 0 up, 1 in 2023-12-16T05:52:08.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:08 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T05:52:08.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:08 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T05:52:08.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:08 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:08.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:08 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:08.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:08 smithi156 ceph-mon[121001]: from='osd.0 [v2:172.21.15.155:6802/1483763675,v1:172.21.15.155:6803/1483763675]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2023-12-16T05:52:08.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:08 smithi156 ceph-mon[121001]: osdmap e8: 1 total, 0 up, 1 in 2023-12-16T05:52:08.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:08 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T05:52:08.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:08 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T05:52:08.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:08 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:08.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:08 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:09.238 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.234+0000 7f8fab7e4700 1 -- 172.21.15.155:0/3346931435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa4066030 msgr2=0x7f8fa40ff800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:52:09.238 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.234+0000 7f8fab7e4700 1 --2- 172.21.15.155:0/3346931435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa4066030 0x7f8fa40ff800 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0004940 tx=0x7f8fa0009e30 comp rx=0 tx=0).stop 2023-12-16T05:52:09.239 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.234+0000 7f8fab7e4700 1 -- 172.21.15.155:0/3346931435 shutdown_connections 2023-12-16T05:52:09.239 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.234+0000 7f8fab7e4700 1 --2- 172.21.15.155:0/3346931435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fa40ffdd0 0x7f8fa41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:52:09.239 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.234+0000 7f8fab7e4700 1 --2- 172.21.15.155:0/3346931435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa4066030 0x7f8fa40ff800 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:52:09.239 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.234+0000 7f8fab7e4700 1 -- 172.21.15.155:0/3346931435 >> 172.21.15.155:0/3346931435 conn(0x7f8fa40f7190 msgr2=0x7f8fa40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:52:09.239 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.234+0000 7f8fab7e4700 1 -- 172.21.15.155:0/3346931435 shutdown_connections 2023-12-16T05:52:09.239 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.234+0000 7f8fab7e4700 1 -- 172.21.15.155:0/3346931435 wait complete. 2023-12-16T05:52:09.239 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.235+0000 7f8fab7e4700 1 Processor -- start 2023-12-16T05:52:09.239 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.235+0000 7f8fab7e4700 1 -- start start 2023-12-16T05:52:09.239 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.235+0000 7f8fab7e4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa4066030 0x7f8fa410d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:52:09.239 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.235+0000 7f8fab7e4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fa40ffdd0 0x7f8fa410da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:52:09.239 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.235+0000 7f8fab7e4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa410e110 con 0x7f8fa4066030 2023-12-16T05:52:09.239 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.235+0000 7f8fab7e4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa410e950 con 0x7f8fa40ffdd0 2023-12-16T05:52:09.239 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.235+0000 7f8fa9580700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa4066030 0x7f8fa410d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:52:09.239 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.235+0000 7f8fa9580700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa4066030 0x7f8fa410d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52958/0 (socket says 172.21.15.155:52958) 2023-12-16T05:52:09.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.235+0000 7f8fa9580700 1 -- 172.21.15.155:0/1510811781 learned_addr learned my addr 172.21.15.155:0/1510811781 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:52:09.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.235+0000 7f8fa8d7f700 1 --2- 172.21.15.155:0/1510811781 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fa40ffdd0 0x7f8fa410da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:52:09.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.235+0000 7f8fa9580700 1 -- 172.21.15.155:0/1510811781 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fa40ffdd0 msgr2=0x7f8fa410da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:52:09.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.235+0000 7f8fa9580700 1 --2- 172.21.15.155:0/1510811781 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fa40ffdd0 0x7f8fa410da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:52:09.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.235+0000 7f8fa9580700 1 -- 172.21.15.155:0/1510811781 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa0005040 con 0x7f8fa4066030 2023-12-16T05:52:09.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.235+0000 7f8fa9580700 1 --2- 172.21.15.155:0/1510811781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa4066030 0x7f8fa410d540 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009380 tx=0x7f8fa0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:52:09.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.235+0000 7f8f99ffb700 1 -- 172.21.15.155:0/1510811781 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fa000e040 con 0x7f8fa4066030 2023-12-16T05:52:09.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.236+0000 7f8f99ffb700 1 -- 172.21.15.155:0/1510811781 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8fa000bda0 con 0x7f8fa4066030 2023-12-16T05:52:09.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.236+0000 7f8fab7e4700 1 -- 172.21.15.155:0/1510811781 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa410ebd0 con 0x7f8fa4066030 2023-12-16T05:52:09.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.236+0000 7f8fab7e4700 1 -- 172.21.15.155:0/1510811781 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa410f110 con 0x7f8fa4066030 2023-12-16T05:52:09.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.236+0000 7f8f99ffb700 1 -- 172.21.15.155:0/1510811781 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fa00255e0 con 0x7f8fa4066030 2023-12-16T05:52:09.241 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.237+0000 7f8fab7e4700 1 -- 172.21.15.155:0/1510811781 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa404bb80 con 0x7f8fa4066030 2023-12-16T05:52:09.241 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.237+0000 7f8f99ffb700 1 -- 172.21.15.155:0/1510811781 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 18) v1 ==== 86393+0+0 (secure 0 0 0) 0x7f8fa00139d0 con 0x7f8fa4066030 2023-12-16T05:52:09.241 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.237+0000 7f8f99ffb700 1 --2- 172.21.15.155:0/1510811781 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8f90068ed0 0x7f8f9006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:52:09.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.238+0000 7f8f99ffb700 1 -- 172.21.15.155:0/1510811781 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f8fa0087360 con 0x7f8fa4066030 2023-12-16T05:52:09.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.238+0000 7f8fa8d7f700 1 --2- 172.21.15.155:0/1510811781 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8f90068ed0 0x7f8f9006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:52:09.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.238+0000 7f8fa8d7f700 1 --2- 172.21.15.155:0/1510811781 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8f90068ed0 0x7f8f9006b380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8f94006fd0 tx=0x7f8f94008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:52:09.245 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.242+0000 7f8f99ffb700 1 -- 172.21.15.155:0/1510811781 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8fa0058140 con 0x7f8fa4066030 2023-12-16T05:52:09.443 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:09.440+0000 7f8fab7e4700 1 -- 172.21.15.155:0/1510811781 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fa410f570 con 0x7f8f90068ed0 2023-12-16T05:52:09.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:09 smithi155 ceph-mon[112451]: purged_snaps scrub starts 2023-12-16T05:52:09.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:09 smithi155 ceph-mon[112451]: purged_snaps scrub ok 2023-12-16T05:52:09.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:09 smithi155 ceph-mon[112451]: osd.0 [v2:172.21.15.155:6802/1483763675,v1:172.21.15.155:6803/1483763675] boot 2023-12-16T05:52:09.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:09 smithi155 ceph-mon[112451]: osdmap e9: 1 total, 1 up, 1 in 2023-12-16T05:52:09.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:09 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T05:52:09.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:09 smithi155 ceph-mon[112451]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:52:09.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:09 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T05:52:09.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:09 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T05:52:09.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:09 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:09.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:09 smithi156 ceph-mon[121001]: purged_snaps scrub starts 2023-12-16T05:52:09.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:09 smithi156 ceph-mon[121001]: purged_snaps scrub ok 2023-12-16T05:52:09.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:09 smithi156 ceph-mon[121001]: osd.0 [v2:172.21.15.155:6802/1483763675,v1:172.21.15.155:6803/1483763675] boot 2023-12-16T05:52:09.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:09 smithi156 ceph-mon[121001]: osdmap e9: 1 total, 1 up, 1 in 2023-12-16T05:52:09.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:09 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T05:52:09.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:09 smithi156 ceph-mon[121001]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T05:52:09.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:09 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T05:52:09.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:09 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T05:52:09.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:09 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:10.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:10 smithi155 ceph-mon[112451]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:52:10.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:10 smithi155 ceph-mon[112451]: osdmap e10: 1 total, 1 up, 1 in 2023-12-16T05:52:10.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:10 smithi156 ceph-mon[121001]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:52:10.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:10 smithi156 ceph-mon[121001]: osdmap e10: 1 total, 1 up, 1 in 2023-12-16T05:52:11.762 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:11 smithi156 ceph-mon[121001]: pgmap v25: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T05:52:11.763 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:11 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:11.763 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:11 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:11.763 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:11 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:52:11.763 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:11 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:11.763 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:11 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:11.763 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:11 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:52:11.763 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:11 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:11.763 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:11 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:52:11.772 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:11 smithi155 ceph-mon[112451]: pgmap v25: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T05:52:11.772 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:11 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:11.772 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:11 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:11.772 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:11 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:52:11.772 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:11 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:11.772 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:11 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:11.772 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:11 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:52:11.773 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:11 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:11.773 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:11 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:52:12.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:12 smithi155 ceph-mon[112451]: Detected new or changed devices on smithi155 2023-12-16T05:52:12.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:12 smithi155 ceph-mon[112451]: Adjusting osd_memory_target on smithi155 to 12898M 2023-12-16T05:52:12.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:12 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/4156220014' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b941218-a4cb-423c-82a7-4f5825269d82"}]: dispatch 2023-12-16T05:52:12.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:12 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/4156220014' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b941218-a4cb-423c-82a7-4f5825269d82"}]': finished 2023-12-16T05:52:12.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:12 smithi155 ceph-mon[112451]: osdmap e11: 2 total, 1 up, 2 in 2023-12-16T05:52:12.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:12 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T05:52:12.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:12 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:12.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:12 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:12.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:12 smithi156 ceph-mon[121001]: Detected new or changed devices on smithi155 2023-12-16T05:52:12.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:12 smithi156 ceph-mon[121001]: Adjusting osd_memory_target on smithi155 to 12898M 2023-12-16T05:52:12.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:12 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/4156220014' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b941218-a4cb-423c-82a7-4f5825269d82"}]: dispatch 2023-12-16T05:52:12.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:12 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/4156220014' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b941218-a4cb-423c-82a7-4f5825269d82"}]': finished 2023-12-16T05:52:12.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:12 smithi156 ceph-mon[121001]: osdmap e11: 2 total, 1 up, 2 in 2023-12-16T05:52:12.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:12 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T05:52:12.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:12 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:12.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:12 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:13.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:13 smithi155 ceph-mon[112451]: pgmap v27: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T05:52:13.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:13 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/928303757' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T05:52:13.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:13 smithi156 ceph-mon[121001]: pgmap v27: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T05:52:13.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:13 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/928303757' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T05:52:14.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:14 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:14.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:14 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:14.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:14 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:14.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:14 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:52:14.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:14 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:15.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:14 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:15.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:14 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:15.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:14 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:15.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:14 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:52:15.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:14 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:15.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:15 smithi156 ceph-mon[121001]: pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T05:52:15.967 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:15 smithi155 ceph-mon[112451]: pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T05:52:16.894 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:16 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:52:16.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:16 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:52:17.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:17 smithi156 ceph-mon[121001]: pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T05:52:18.004 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:17 smithi155 ceph-mon[112451]: pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T05:52:18.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:18 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T05:52:18.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:18 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:18.971 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:18 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T05:52:18.971 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:18 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:19.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:19 smithi156 ceph-mon[121001]: Deploying daemon osd.1 on smithi155 2023-12-16T05:52:19.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:19 smithi156 ceph-mon[121001]: pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T05:52:20.007 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:19 smithi155 ceph-mon[112451]: Deploying daemon osd.1 on smithi155 2023-12-16T05:52:20.007 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:19 smithi155 ceph-mon[112451]: pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T05:52:21.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:21 smithi156 ceph-mon[121001]: pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T05:52:22.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:21 smithi155 ceph-mon[112451]: pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T05:52:23.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:22 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:23.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:22 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:23.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:22 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:52:23.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:22 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:23.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:22 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:23.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:22 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:52:23.886 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:23 smithi155 ceph-mon[112451]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T05:52:24.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:23 smithi156 ceph-mon[121001]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T05:52:24.192 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:24.189+0000 7f8f99ffb700 1 -- 172.21.15.155:0/1510811781 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8fa410f570 con 0x7f8f90068ed0 2023-12-16T05:52:24.192 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 1 on host 'smithi155' 2023-12-16T05:52:24.194 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:24.191+0000 7f8fab7e4700 1 -- 172.21.15.155:0/1510811781 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8f90068ed0 msgr2=0x7f8f9006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:52:24.194 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:24.191+0000 7f8fab7e4700 1 --2- 172.21.15.155:0/1510811781 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8f90068ed0 0x7f8f9006b380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8f94006fd0 tx=0x7f8f94008040 comp rx=0 tx=0).stop 2023-12-16T05:52:24.194 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:24.191+0000 7f8fab7e4700 1 -- 172.21.15.155:0/1510811781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa4066030 msgr2=0x7f8fa410d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:52:24.194 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:24.191+0000 7f8fab7e4700 1 --2- 172.21.15.155:0/1510811781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa4066030 0x7f8fa410d540 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009380 tx=0x7f8fa0009e30 comp rx=0 tx=0).stop 2023-12-16T05:52:24.194 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:24.191+0000 7f8fab7e4700 1 -- 172.21.15.155:0/1510811781 shutdown_connections 2023-12-16T05:52:24.195 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:24.191+0000 7f8fab7e4700 1 --2- 172.21.15.155:0/1510811781 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8f90068ed0 0x7f8f9006b380 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:52:24.195 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:24.191+0000 7f8fab7e4700 1 --2- 172.21.15.155:0/1510811781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa4066030 0x7f8fa410d540 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:52:24.195 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:24.191+0000 7f8fab7e4700 1 --2- 172.21.15.155:0/1510811781 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fa40ffdd0 0x7f8fa410da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:52:24.195 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:24.191+0000 7f8fab7e4700 1 -- 172.21.15.155:0/1510811781 >> 172.21.15.155:0/1510811781 conn(0x7f8fa40f7190 msgr2=0x7f8fa40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:52:24.195 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:24.191+0000 7f8fab7e4700 1 -- 172.21.15.155:0/1510811781 shutdown_connections 2023-12-16T05:52:24.195 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:24.191+0000 7f8fab7e4700 1 -- 172.21.15.155:0/1510811781 wait complete. 2023-12-16T05:52:24.646 DEBUG:teuthology.orchestra.run.smithi155:osd.1> sudo journalctl -f -n 0 -u ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.1.service 2023-12-16T05:52:24.648 INFO:tasks.cephadm:Deploying osd.2 on smithi155 with /dev/vg_nvme/lv_2... 2023-12-16T05:52:24.648 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-16T05:52:24.681 INFO:journalctl@ceph.osd.1.smithi155.stdout:-- Logs begin at Sat 2023-12-16 04:41:47 UTC. -- 2023-12-16T05:52:25.160 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:52:25.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:25 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:25.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:25 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:25.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:25 smithi156 ceph-mon[121001]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T05:52:25.477 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:25 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:25.477 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:25 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:25.477 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:25 smithi155 ceph-mon[112451]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T05:52:25.826 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 05:52:25 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-1[146098]: 2023-12-16T05:52:25.696+0000 7f0ebd737540 -1 osd.1 0 log_to_monitors true 2023-12-16T05:52:26.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:26 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:26.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:26 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:26.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:26 smithi156 ceph-mon[121001]: from='osd.1 [v2:172.21.15.155:6810/3291965512,v1:172.21.15.155:6811/3291965512]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-16T05:52:26.487 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:26 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:26.487 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:26 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:26.487 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:26 smithi155 ceph-mon[112451]: from='osd.1 [v2:172.21.15.155:6810/3291965512,v1:172.21.15.155:6811/3291965512]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-16T05:52:26.694 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-16T05:52:26.694 INFO:teuthology.orchestra.run.smithi155.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-16T05:52:26.694 INFO:teuthology.orchestra.run.smithi155.stderr: stderr: 10+0 records in 2023-12-16T05:52:26.695 INFO:teuthology.orchestra.run.smithi155.stderr:10+0 records out 2023-12-16T05:52:26.695 INFO:teuthology.orchestra.run.smithi155.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0145828 s, 719 MB/s 2023-12-16T05:52:26.695 INFO:teuthology.orchestra.run.smithi155.stderr: stderr: 2023-12-16T05:52:26.695 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping successful for: 2023-12-16T05:52:27.188 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi155:vg_nvme/lv_2 2023-12-16T05:52:27.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:27 smithi156 ceph-mon[121001]: from='osd.1 [v2:172.21.15.155:6810/3291965512,v1:172.21.15.155:6811/3291965512]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-16T05:52:27.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:27 smithi156 ceph-mon[121001]: osdmap e12: 2 total, 1 up, 2 in 2023-12-16T05:52:27.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:27 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T05:52:27.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:27 smithi156 ceph-mon[121001]: from='osd.1 [v2:172.21.15.155:6810/3291965512,v1:172.21.15.155:6811/3291965512]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-12-16T05:52:27.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:27 smithi156 ceph-mon[121001]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T05:52:27.461 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:52:27.576 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 05:52:27 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-1[146098]: 2023-12-16T05:52:27.161+0000 7f0eb3f1c700 -1 osd.1 0 waiting for initial osdmap 2023-12-16T05:52:27.576 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 05:52:27 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-1[146098]: 2023-12-16T05:52:27.167+0000 7f0eaed17700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T05:52:27.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:27 smithi155 ceph-mon[112451]: from='osd.1 [v2:172.21.15.155:6810/3291965512,v1:172.21.15.155:6811/3291965512]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-16T05:52:27.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:27 smithi155 ceph-mon[112451]: osdmap e12: 2 total, 1 up, 2 in 2023-12-16T05:52:27.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:27 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T05:52:27.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:27 smithi155 ceph-mon[112451]: from='osd.1 [v2:172.21.15.155:6810/3291965512,v1:172.21.15.155:6811/3291965512]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-12-16T05:52:27.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:27 smithi155 ceph-mon[112451]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T05:52:28.246 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:28 smithi155 ceph-mon[112451]: from='osd.1 [v2:172.21.15.155:6810/3291965512,v1:172.21.15.155:6811/3291965512]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2023-12-16T05:52:28.246 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:28 smithi155 ceph-mon[112451]: osdmap e13: 2 total, 1 up, 2 in 2023-12-16T05:52:28.246 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:28 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T05:52:28.246 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:28 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T05:52:28.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:28 smithi156 ceph-mon[121001]: from='osd.1 [v2:172.21.15.155:6810/3291965512,v1:172.21.15.155:6811/3291965512]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2023-12-16T05:52:28.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:28 smithi156 ceph-mon[121001]: osdmap e13: 2 total, 1 up, 2 in 2023-12-16T05:52:28.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:28 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T05:52:28.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:28 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T05:52:28.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.570+0000 7f6e076c7700 1 -- 172.21.15.155:0/3389967067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e00100050 msgr2=0x7f6e00102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:52:28.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.570+0000 7f6e076c7700 1 --2- 172.21.15.155:0/3389967067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e00100050 0x7f6e00102430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc004940 tx=0x7f6dfc009e30 comp rx=0 tx=0).stop 2023-12-16T05:52:28.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.570+0000 7f6e076c7700 1 -- 172.21.15.155:0/3389967067 shutdown_connections 2023-12-16T05:52:28.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.570+0000 7f6e076c7700 1 --2- 172.21.15.155:0/3389967067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e00100050 0x7f6e00102430 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:52:28.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.570+0000 7f6e076c7700 1 --2- 172.21.15.155:0/3389967067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e000fd730 0x7f6e000ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:52:28.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.570+0000 7f6e076c7700 1 -- 172.21.15.155:0/3389967067 >> 172.21.15.155:0/3389967067 conn(0x7f6e000f7190 msgr2=0x7f6e000f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:52:28.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.570+0000 7f6e076c7700 1 -- 172.21.15.155:0/3389967067 shutdown_connections 2023-12-16T05:52:28.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.570+0000 7f6e076c7700 1 -- 172.21.15.155:0/3389967067 wait complete. 2023-12-16T05:52:28.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.570+0000 7f6e076c7700 1 Processor -- start 2023-12-16T05:52:28.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.571+0000 7f6e076c7700 1 -- start start 2023-12-16T05:52:28.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.571+0000 7f6e076c7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e000fd730 0x7f6e0010d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:52:28.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.571+0000 7f6e076c7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e00100050 0x7f6e0010da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:52:28.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.571+0000 7f6e076c7700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0010e0c0 con 0x7f6e00100050 2023-12-16T05:52:28.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.571+0000 7f6e076c7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0010e900 con 0x7f6e000fd730 2023-12-16T05:52:28.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.571+0000 7f6e04c62700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e00100050 0x7f6e0010da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:52:28.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.571+0000 7f6e04c62700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e00100050 0x7f6e0010da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33022/0 (socket says 172.21.15.155:33022) 2023-12-16T05:52:28.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.571+0000 7f6e04c62700 1 -- 172.21.15.155:0/3391796343 learned_addr learned my addr 172.21.15.155:0/3391796343 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:52:28.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.571+0000 7f6e05463700 1 --2- 172.21.15.155:0/3391796343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e000fd730 0x7f6e0010d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:52:28.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.571+0000 7f6e04c62700 1 -- 172.21.15.155:0/3391796343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e000fd730 msgr2=0x7f6e0010d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:52:28.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.571+0000 7f6e04c62700 1 --2- 172.21.15.155:0/3391796343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e000fd730 0x7f6e0010d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:52:28.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.571+0000 7f6e04c62700 1 -- 172.21.15.155:0/3391796343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dfc005040 con 0x7f6e00100050 2023-12-16T05:52:28.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.571+0000 7f6e04c62700 1 --2- 172.21.15.155:0/3391796343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e00100050 0x7f6e0010da30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc009360 tx=0x7f6dfc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:52:28.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.571+0000 7f6df5ffb700 1 -- 172.21.15.155:0/3391796343 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dfc00e040 con 0x7f6e00100050 2023-12-16T05:52:28.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.572+0000 7f6e076c7700 1 -- 172.21.15.155:0/3391796343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0010eb80 con 0x7f6e00100050 2023-12-16T05:52:28.577 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.572+0000 7f6df5ffb700 1 -- 172.21.15.155:0/3391796343 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6dfc00bc50 con 0x7f6e00100050 2023-12-16T05:52:28.577 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.572+0000 7f6df5ffb700 1 -- 172.21.15.155:0/3391796343 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dfc01c3f0 con 0x7f6e00100050 2023-12-16T05:52:28.577 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.572+0000 7f6e076c7700 1 -- 172.21.15.155:0/3391796343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0010f0c0 con 0x7f6e00100050 2023-12-16T05:52:28.577 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.573+0000 7f6e076c7700 1 -- 172.21.15.155:0/3391796343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e0004bb80 con 0x7f6e00100050 2023-12-16T05:52:28.577 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.573+0000 7f6df5ffb700 1 -- 172.21.15.155:0/3391796343 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 18) v1 ==== 86393+0+0 (secure 0 0 0) 0x7f6dfc013420 con 0x7f6e00100050 2023-12-16T05:52:28.578 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.574+0000 7f6df5ffb700 1 --2- 172.21.15.155:0/3391796343 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f6dec068ed0 0x7f6dec06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:52:28.578 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.574+0000 7f6df5ffb700 1 -- 172.21.15.155:0/3391796343 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f6dfc087410 con 0x7f6e00100050 2023-12-16T05:52:28.578 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.574+0000 7f6e05463700 1 --2- 172.21.15.155:0/3391796343 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f6dec068ed0 0x7f6dec06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:52:28.578 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.574+0000 7f6e05463700 1 --2- 172.21.15.155:0/3391796343 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f6dec068ed0 0x7f6dec06b380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009bf0 tx=0x7f6df00091a0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:52:28.581 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.578+0000 7f6df5ffb700 1 -- 172.21.15.155:0/3391796343 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6dfc057fc0 con 0x7f6e00100050 2023-12-16T05:52:28.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:28.796+0000 7f6e076c7700 1 -- 172.21.15.155:0/3391796343 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e0010f5c0 con 0x7f6dec068ed0 2023-12-16T05:52:29.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: purged_snaps scrub starts 2023-12-16T05:52:29.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: purged_snaps scrub ok 2023-12-16T05:52:29.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: osd.1 [v2:172.21.15.155:6810/3291965512,v1:172.21.15.155:6811/3291965512] boot 2023-12-16T05:52:29.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: osdmap e14: 2 total, 2 up, 2 in 2023-12-16T05:52:29.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T05:52:29.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T05:52:29.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: Detected new or changed devices on smithi155 2023-12-16T05:52:29.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:29.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:29.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:52:29.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:52:29.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: Adjusting osd_memory_target on smithi155 to 6449M 2023-12-16T05:52:29.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:29.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:29.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:52:29.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:29.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:52:29.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:52:29.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T05:52:29.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T05:52:29.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:29 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:29.504 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: purged_snaps scrub starts 2023-12-16T05:52:29.504 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: purged_snaps scrub ok 2023-12-16T05:52:29.504 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: osd.1 [v2:172.21.15.155:6810/3291965512,v1:172.21.15.155:6811/3291965512] boot 2023-12-16T05:52:29.505 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: osdmap e14: 2 total, 2 up, 2 in 2023-12-16T05:52:29.505 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T05:52:29.505 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T05:52:29.505 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: Detected new or changed devices on smithi155 2023-12-16T05:52:29.505 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:29.505 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:29.505 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:52:29.505 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:52:29.505 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: Adjusting osd_memory_target on smithi155 to 6449M 2023-12-16T05:52:29.505 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:29.505 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:29.505 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:52:29.505 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:29.505 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:52:29.506 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:52:29.506 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T05:52:29.506 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T05:52:29.506 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:29 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:30.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:30 smithi155 ceph-mon[112451]: osdmap e15: 2 total, 2 up, 2 in 2023-12-16T05:52:30.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:30 smithi156 ceph-mon[121001]: osdmap e15: 2 total, 2 up, 2 in 2023-12-16T05:52:31.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:31 smithi155 ceph-mon[112451]: pgmap v40: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T05:52:31.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:31 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/1162319999' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea6b309e-b3ba-4e72-8977-9d4915cb68ad"}]: dispatch 2023-12-16T05:52:31.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:31 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/1162319999' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea6b309e-b3ba-4e72-8977-9d4915cb68ad"}]': finished 2023-12-16T05:52:31.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:31 smithi155 ceph-mon[112451]: osdmap e16: 3 total, 2 up, 3 in 2023-12-16T05:52:31.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:31 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T05:52:31.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:31 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:52:31.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:31 smithi156 ceph-mon[121001]: pgmap v40: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T05:52:31.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:31 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/1162319999' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea6b309e-b3ba-4e72-8977-9d4915cb68ad"}]: dispatch 2023-12-16T05:52:31.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:31 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/1162319999' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea6b309e-b3ba-4e72-8977-9d4915cb68ad"}]': finished 2023-12-16T05:52:31.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:31 smithi156 ceph-mon[121001]: osdmap e16: 3 total, 2 up, 3 in 2023-12-16T05:52:31.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:31 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T05:52:31.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:31 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:52:33.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:33.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:33.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:33.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:52:33.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:33.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:32 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/3398178777' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T05:52:33.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:32 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:33.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:32 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:33.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:32 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:33.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:32 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:52:33.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:32 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:33.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:32 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/3398178777' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T05:52:34.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:33 smithi155 ceph-mon[112451]: pgmap v42: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T05:52:34.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:33 smithi156 ceph-mon[121001]: pgmap v42: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T05:52:36.267 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:35 smithi155 ceph-mon[112451]: pgmap v43: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T05:52:36.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:35 smithi156 ceph-mon[121001]: pgmap v43: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T05:52:38.249 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:37 smithi155 ceph-mon[112451]: pgmap v44: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T05:52:38.250 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T05:52:38.250 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:38.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:37 smithi156 ceph-mon[121001]: pgmap v44: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T05:52:38.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:37 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T05:52:38.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:37 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:39.242 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:38 smithi156 ceph-mon[121001]: Deploying daemon osd.2 on smithi155 2023-12-16T05:52:39.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:38 smithi155 ceph-mon[112451]: Deploying daemon osd.2 on smithi155 2023-12-16T05:52:40.207 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:39 smithi155 ceph-mon[112451]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T05:52:40.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:39 smithi156 ceph-mon[121001]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T05:52:42.185 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:41 smithi155 ceph-mon[112451]: pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T05:52:42.185 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:41 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:42.185 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:41 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:42.185 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:41 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:52:42.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:41 smithi156 ceph-mon[121001]: pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T05:52:42.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:41 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:42.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:41 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:42.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:41 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:52:44.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:44.144+0000 7f6df5ffb700 1 -- 172.21.15.155:0/3391796343 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6e0010f5c0 con 0x7f6dec068ed0 2023-12-16T05:52:44.147 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 2 on host 'smithi155' 2023-12-16T05:52:44.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:44.147+0000 7f6e076c7700 1 -- 172.21.15.155:0/3391796343 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f6dec068ed0 msgr2=0x7f6dec06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:52:44.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:44.147+0000 7f6e076c7700 1 --2- 172.21.15.155:0/3391796343 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f6dec068ed0 0x7f6dec06b380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009bf0 tx=0x7f6df00091a0 comp rx=0 tx=0).stop 2023-12-16T05:52:44.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:44.147+0000 7f6e076c7700 1 -- 172.21.15.155:0/3391796343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e00100050 msgr2=0x7f6e0010da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:52:44.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:44.147+0000 7f6e076c7700 1 --2- 172.21.15.155:0/3391796343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e00100050 0x7f6e0010da30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc009360 tx=0x7f6dfc009e30 comp rx=0 tx=0).stop 2023-12-16T05:52:44.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:44.147+0000 7f6e076c7700 1 -- 172.21.15.155:0/3391796343 shutdown_connections 2023-12-16T05:52:44.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:44.147+0000 7f6e076c7700 1 --2- 172.21.15.155:0/3391796343 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f6dec068ed0 0x7f6dec06b380 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:52:44.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:44.147+0000 7f6e076c7700 1 --2- 172.21.15.155:0/3391796343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e000fd730 0x7f6e0010d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:52:44.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:44.147+0000 7f6e076c7700 1 --2- 172.21.15.155:0/3391796343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e00100050 0x7f6e0010da30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:52:44.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:44.147+0000 7f6e076c7700 1 -- 172.21.15.155:0/3391796343 >> 172.21.15.155:0/3391796343 conn(0x7f6e000f7190 msgr2=0x7f6e000f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:52:44.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:44.147+0000 7f6e076c7700 1 -- 172.21.15.155:0/3391796343 shutdown_connections 2023-12-16T05:52:44.150 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:52:44.147+0000 7f6e076c7700 1 -- 172.21.15.155:0/3391796343 wait complete. 2023-12-16T05:52:44.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:43 smithi155 ceph-mon[112451]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T05:52:44.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:43 smithi156 ceph-mon[121001]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T05:52:44.733 DEBUG:teuthology.orchestra.run.smithi155:osd.2> sudo journalctl -f -n 0 -u ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.2.service 2023-12-16T05:52:44.735 INFO:tasks.cephadm:Deploying osd.3 on smithi156 with /dev/vg_nvme/lv_4... 2023-12-16T05:52:44.735 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-16T05:52:44.774 INFO:journalctl@ceph.osd.2.smithi155.stdout:-- Logs begin at Sat 2023-12-16 04:41:47 UTC. -- 2023-12-16T05:52:45.002 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi156/config 2023-12-16T05:52:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:45 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:45 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:45 smithi156 ceph-mon[121001]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T05:52:45.472 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:45 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:45.472 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:45 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:45.472 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:45 smithi155 ceph-mon[112451]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T05:52:45.473 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 05:52:45 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-2[155134]: 2023-12-16T05:52:45.467+0000 7f7a9fd99540 -1 osd.2 0 log_to_monitors true 2023-12-16T05:52:46.297 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-16T05:52:46.297 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-16T05:52:46.297 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2023-12-16T05:52:46.297 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2023-12-16T05:52:46.297 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00812307 s, 1.3 GB/s 2023-12-16T05:52:46.297 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2023-12-16T05:52:46.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:46 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:46.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:46 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:46.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:46 smithi156 ceph-mon[121001]: from='osd.2 [v2:172.21.15.155:6818/3010388644,v1:172.21.15.155:6819/3010388644]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-16T05:52:46.512 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:46 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:46.512 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:46 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:46.512 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:46 smithi155 ceph-mon[112451]: from='osd.2 [v2:172.21.15.155:6818/3010388644,v1:172.21.15.155:6819/3010388644]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-16T05:52:46.691 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi156:vg_nvme/lv_4 2023-12-16T05:52:46.949 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi156/config 2023-12-16T05:52:47.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:47 smithi155 ceph-mon[112451]: from='osd.2 [v2:172.21.15.155:6818/3010388644,v1:172.21.15.155:6819/3010388644]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-16T05:52:47.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:47 smithi155 ceph-mon[112451]: osdmap e17: 3 total, 2 up, 3 in 2023-12-16T05:52:47.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:47 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T05:52:47.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:47 smithi155 ceph-mon[112451]: from='osd.2 [v2:172.21.15.155:6818/3010388644,v1:172.21.15.155:6819/3010388644]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-12-16T05:52:47.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:47 smithi155 ceph-mon[112451]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T05:52:47.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:47 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:52:47.328 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 05:52:47 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-2[155134]: 2023-12-16T05:52:47.184+0000 7f7a9657e700 -1 osd.2 0 waiting for initial osdmap 2023-12-16T05:52:47.328 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 05:52:47 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-2[155134]: 2023-12-16T05:52:47.188+0000 7f7a90377700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T05:52:47.353 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:47 smithi156 ceph-mon[121001]: from='osd.2 [v2:172.21.15.155:6818/3010388644,v1:172.21.15.155:6819/3010388644]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-16T05:52:47.353 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:47 smithi156 ceph-mon[121001]: osdmap e17: 3 total, 2 up, 3 in 2023-12-16T05:52:47.353 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:47 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T05:52:47.353 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:47 smithi156 ceph-mon[121001]: from='osd.2 [v2:172.21.15.155:6818/3010388644,v1:172.21.15.155:6819/3010388644]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-12-16T05:52:47.354 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:47 smithi156 ceph-mon[121001]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T05:52:47.354 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:47 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:52:47.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.903+0000 7f470909e700 1 -- 172.21.15.156:0/766081418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4704100050 msgr2=0x7f4704102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:52:47.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.903+0000 7f470909e700 1 --2- 172.21.15.156:0/766081418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4704100050 0x7f4704102430 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f46f8004940 tx=0x7f46f8009e30 comp rx=0 tx=0).stop 2023-12-16T05:52:47.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.903+0000 7f470909e700 1 -- 172.21.15.156:0/766081418 shutdown_connections 2023-12-16T05:52:47.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.903+0000 7f470909e700 1 --2- 172.21.15.156:0/766081418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4704100050 0x7f4704102430 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:52:47.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.903+0000 7f470909e700 1 --2- 172.21.15.156:0/766081418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47040fd730 0x7f47040ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:52:47.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.903+0000 7f470909e700 1 -- 172.21.15.156:0/766081418 >> 172.21.15.156:0/766081418 conn(0x7f47040f7190 msgr2=0x7f47040f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:52:47.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.903+0000 7f470909e700 1 -- 172.21.15.156:0/766081418 shutdown_connections 2023-12-16T05:52:47.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.903+0000 7f470909e700 1 -- 172.21.15.156:0/766081418 wait complete. 2023-12-16T05:52:47.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.904+0000 7f470909e700 1 Processor -- start 2023-12-16T05:52:47.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.904+0000 7f470909e700 1 -- start start 2023-12-16T05:52:47.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.904+0000 7f470909e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47040fd730 0x7f470410d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:52:47.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.904+0000 7f470909e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4704100050 0x7f470410d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:52:47.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.904+0000 7f470909e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470410dfa0 con 0x7f47040fd730 2023-12-16T05:52:47.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.904+0000 7f470909e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470410e840 con 0x7f4704100050 2023-12-16T05:52:47.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.904+0000 7f470259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4704100050 0x7f470410d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:52:47.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.904+0000 7f470259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4704100050 0x7f470410d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55408/0 (socket says 172.21.15.156:55408) 2023-12-16T05:52:47.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.904+0000 7f470259c700 1 -- 172.21.15.156:0/352847214 learned_addr learned my addr 172.21.15.156:0/352847214 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-12-16T05:52:47.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.904+0000 7f4702d9d700 1 --2- 172.21.15.156:0/352847214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47040fd730 0x7f470410d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:52:47.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.905+0000 7f470259c700 1 -- 172.21.15.156:0/352847214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47040fd730 msgr2=0x7f470410d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:52:47.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.905+0000 7f470259c700 1 --2- 172.21.15.156:0/352847214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47040fd730 0x7f470410d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:52:47.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.905+0000 7f470259c700 1 -- 172.21.15.156:0/352847214 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f8005040 con 0x7f4704100050 2023-12-16T05:52:47.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.905+0000 7f470259c700 1 --2- 172.21.15.156:0/352847214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4704100050 0x7f470410d9a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f46f8000c00 tx=0x7f46f8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:52:47.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.905+0000 7f46eb7fe700 1 -- 172.21.15.156:0/352847214 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46f8021070 con 0x7f4704100050 2023-12-16T05:52:47.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.905+0000 7f46eb7fe700 1 -- 172.21.15.156:0/352847214 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f46f801c400 con 0x7f4704100050 2023-12-16T05:52:47.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.905+0000 7f470909e700 1 -- 172.21.15.156:0/352847214 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f470410eac0 con 0x7f4704100050 2023-12-16T05:52:47.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.905+0000 7f46eb7fe700 1 -- 172.21.15.156:0/352847214 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46f800e070 con 0x7f4704100050 2023-12-16T05:52:47.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.905+0000 7f470909e700 1 -- 172.21.15.156:0/352847214 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470410efa0 con 0x7f4704100050 2023-12-16T05:52:47.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.906+0000 7f470909e700 1 -- 172.21.15.156:0/352847214 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470404bb80 con 0x7f4704100050 2023-12-16T05:52:47.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.906+0000 7f46eb7fe700 1 -- 172.21.15.156:0/352847214 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 18) v1 ==== 86393+0+0 (secure 0 0 0) 0x7f46f801c9c0 con 0x7f4704100050 2023-12-16T05:52:47.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.907+0000 7f46eb7fe700 1 --2- 172.21.15.156:0/352847214 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f46ec068ed0 0x7f46ec06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:52:47.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.907+0000 7f46eb7fe700 1 -- 172.21.15.156:0/352847214 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 2562+0+0 (secure 0 0 0) 0x7f46f8087390 con 0x7f4704100050 2023-12-16T05:52:47.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.907+0000 7f4702d9d700 1 --2- 172.21.15.156:0/352847214 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f46ec068ed0 0x7f46ec06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:52:47.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.907+0000 7f4702d9d700 1 --2- 172.21.15.156:0/352847214 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f46ec068ed0 0x7f46ec06b380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009b80 tx=0x7f46f400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:52:47.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:47.911+0000 7f46eb7fe700 1 -- 172.21.15.156:0/352847214 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f46f8057f20 con 0x7f4704100050 2023-12-16T05:52:48.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:48.100+0000 7f470909e700 1 -- 172.21.15.156:0/352847214 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f470410f3b0 con 0x7f46ec068ed0 2023-12-16T05:52:48.500 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: from='osd.2 [v2:172.21.15.155:6818/3010388644,v1:172.21.15.155:6819/3010388644]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2023-12-16T05:52:48.500 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: osdmap e18: 3 total, 2 up, 3 in 2023-12-16T05:52:48.500 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T05:52:48.500 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T05:52:48.500 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: Detected new or changed devices on smithi155 2023-12-16T05:52:48.500 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:48.500 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:48.501 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:52:48.501 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:52:48.501 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:52:48.501 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: Adjusting osd_memory_target on smithi155 to 4299M 2023-12-16T05:52:48.501 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:48.501 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:48.501 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:52:48.501 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:48.501 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:52:48.501 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:48.501 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:52:48.501 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:48.502 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T05:52:48.502 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T05:52:48.502 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:48 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:48.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: from='osd.2 [v2:172.21.15.155:6818/3010388644,v1:172.21.15.155:6819/3010388644]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2023-12-16T05:52:48.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: osdmap e18: 3 total, 2 up, 3 in 2023-12-16T05:52:48.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T05:52:48.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T05:52:48.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: Detected new or changed devices on smithi155 2023-12-16T05:52:48.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:48.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:48.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:52:48.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:52:48.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:52:48.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: Adjusting osd_memory_target on smithi155 to 4299M 2023-12-16T05:52:48.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:48.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:48.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:52:48.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:48.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:52:48.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:48.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:52:48.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:48.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T05:52:48.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T05:52:48.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:48 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:49.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:49 smithi156 ceph-mon[121001]: purged_snaps scrub starts 2023-12-16T05:52:49.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:49 smithi156 ceph-mon[121001]: purged_snaps scrub ok 2023-12-16T05:52:49.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:49 smithi156 ceph-mon[121001]: from='client.24133 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:52:49.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:49 smithi156 ceph-mon[121001]: osd.2 [v2:172.21.15.155:6818/3010388644,v1:172.21.15.155:6819/3010388644] boot 2023-12-16T05:52:49.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:49 smithi156 ceph-mon[121001]: osdmap e19: 3 total, 3 up, 3 in 2023-12-16T05:52:49.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:49 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T05:52:49.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:49 smithi156 ceph-mon[121001]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T05:52:49.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:49 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-16T05:52:49.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:49 smithi155 ceph-mon[112451]: purged_snaps scrub starts 2023-12-16T05:52:49.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:49 smithi155 ceph-mon[112451]: purged_snaps scrub ok 2023-12-16T05:52:49.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:49 smithi155 ceph-mon[112451]: from='client.24133 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:52:49.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:49 smithi155 ceph-mon[112451]: osd.2 [v2:172.21.15.155:6818/3010388644,v1:172.21.15.155:6819/3010388644] boot 2023-12-16T05:52:49.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:49 smithi155 ceph-mon[112451]: osdmap e19: 3 total, 3 up, 3 in 2023-12-16T05:52:49.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:49 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T05:52:49.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:49 smithi155 ceph-mon[112451]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T05:52:49.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:49 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-16T05:52:50.576 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 05:52:50 smithi155 sudo[160468]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-16T05:52:50.577 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 05:52:50 smithi155 sudo[160468]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T05:52:50.577 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 05:52:50 smithi155 sudo[160468]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T05:52:50.577 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 05:52:50 smithi155 sudo[160468]: pam_unix(sudo:session): session closed for user root 2023-12-16T05:52:50.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:50 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-16T05:52:50.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:50 smithi155 ceph-mon[112451]: osdmap e20: 3 total, 3 up, 3 in 2023-12-16T05:52:50.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:50 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-16T05:52:50.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:50 smithi155 ceph-mon[112451]: from='client.? 172.21.15.156:0/2344912929' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae32e77a-1c79-47d0-802b-ff70099c3126"}]: dispatch 2023-12-16T05:52:50.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:50 smithi155 ceph-mon[112451]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae32e77a-1c79-47d0-802b-ff70099c3126"}]: dispatch 2023-12-16T05:52:50.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:50 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-16T05:52:50.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:50 smithi155 ceph-mon[112451]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ae32e77a-1c79-47d0-802b-ff70099c3126"}]': finished 2023-12-16T05:52:50.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:50 smithi155 ceph-mon[112451]: osdmap e21: 4 total, 3 up, 4 in 2023-12-16T05:52:50.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:50 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T05:52:50.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:50 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-16T05:52:50.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:50 smithi156 ceph-mon[121001]: osdmap e20: 3 total, 3 up, 3 in 2023-12-16T05:52:50.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:50 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-16T05:52:50.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:50 smithi156 ceph-mon[121001]: from='client.? 172.21.15.156:0/2344912929' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae32e77a-1c79-47d0-802b-ff70099c3126"}]: dispatch 2023-12-16T05:52:50.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:50 smithi156 ceph-mon[121001]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae32e77a-1c79-47d0-802b-ff70099c3126"}]: dispatch 2023-12-16T05:52:50.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:50 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-16T05:52:50.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:50 smithi156 ceph-mon[121001]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ae32e77a-1c79-47d0-802b-ff70099c3126"}]': finished 2023-12-16T05:52:50.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:50 smithi156 ceph-mon[121001]: osdmap e21: 4 total, 3 up, 4 in 2023-12-16T05:52:50.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:50 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T05:52:50.927 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 05:52:50 smithi155 sudo[160471]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-16T05:52:50.927 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 05:52:50 smithi155 sudo[160471]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T05:52:50.927 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 05:52:50 smithi155 sudo[160471]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T05:52:50.927 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 05:52:50 smithi155 sudo[160471]: pam_unix(sudo:session): session closed for user root 2023-12-16T05:52:51.308 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 05:52:50 smithi155 sudo[160474]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-16T05:52:51.308 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 05:52:50 smithi155 sudo[160474]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T05:52:51.308 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 05:52:50 smithi155 sudo[160474]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T05:52:51.308 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 05:52:50 smithi155 sudo[160474]: pam_unix(sudo:session): session closed for user root 2023-12-16T05:52:51.309 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 05:52:51 smithi155 sudo[160477]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-16T05:52:51.309 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 05:52:51 smithi155 sudo[160477]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T05:52:51.309 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 05:52:51 smithi155 sudo[160477]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T05:52:51.309 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 05:52:51 smithi155 sudo[160477]: pam_unix(sudo:session): session closed for user root 2023-12-16T05:52:51.576 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 05:52:51 smithi155 sudo[160480]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-16T05:52:51.576 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 05:52:51 smithi155 sudo[160480]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T05:52:51.577 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 05:52:51 smithi155 sudo[160480]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T05:52:51.577 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 05:52:51 smithi155 sudo[160480]: pam_unix(sudo:session): session closed for user root 2023-12-16T05:52:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:51 smithi155 ceph-mon[112451]: from='client.? 172.21.15.156:0/2190991986' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T05:52:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:51 smithi155 ceph-mon[112451]: pgmap v56: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-16T05:52:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:51 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:51 smithi155 ceph-mon[112451]: osdmap e22: 4 total, 3 up, 4 in 2023-12-16T05:52:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:51 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T05:52:51.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:51 smithi156 ceph-mon[121001]: from='client.? 172.21.15.156:0/2190991986' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T05:52:51.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:51 smithi156 ceph-mon[121001]: pgmap v56: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-16T05:52:51.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:51 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:51.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:51 smithi156 ceph-mon[121001]: osdmap e22: 4 total, 3 up, 4 in 2023-12-16T05:52:51.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:51 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T05:52:52.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:51 smithi155 sudo[160486]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-16T05:52:52.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:51 smithi155 sudo[160486]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T05:52:52.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:51 smithi155 sudo[160486]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T05:52:52.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:51 smithi155 sudo[160486]: pam_unix(sudo:session): session closed for user root 2023-12-16T05:52:52.078 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 05:52:51 smithi155 sudo[160483]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-16T05:52:52.078 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 05:52:51 smithi155 sudo[160483]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T05:52:52.078 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 05:52:51 smithi155 sudo[160483]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T05:52:52.078 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 05:52:51 smithi155 sudo[160483]: pam_unix(sudo:session): session closed for user root 2023-12-16T05:52:52.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:52:52.148+0000 7f46eb7fe700 1 -- 172.21.15.156:0/352847214 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f46f8054860 con 0x7f4704100050 2023-12-16T05:52:52.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:52 smithi155 sudo[160489]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-16T05:52:52.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:52 smithi155 sudo[160489]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T05:52:52.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:52 smithi155 sudo[160489]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T05:52:52.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:52 smithi155 sudo[160489]: pam_unix(sudo:session): session closed for user root 2023-12-16T05:52:52.636 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:52 smithi156 sudo[125945]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-16T05:52:52.636 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:52 smithi156 sudo[125945]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T05:52:52.636 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:52 smithi156 sudo[125945]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T05:52:52.637 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:52 smithi156 sudo[125945]: pam_unix(sudo:session): session closed for user root 2023-12-16T05:52:52.637 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:52 smithi156 sudo[126134]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-16T05:52:52.637 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:52 smithi156 sudo[126134]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T05:52:52.637 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:52 smithi156 sudo[126134]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T05:52:52.637 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:52 smithi156 sudo[126134]: pam_unix(sudo:session): session closed for user root 2023-12-16T05:52:52.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:52 smithi156 ceph-mon[121001]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-16T05:52:52.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:52 smithi156 ceph-mon[121001]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-16T05:52:52.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:52 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:52:52.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:52 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:52:52.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:52 smithi156 ceph-mon[121001]: mgrmap e19: smithi155.maowdn(active, since 95s), standbys: smithi156.pclong 2023-12-16T05:52:52.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:52 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:52:52.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:52 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:52:53.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:52 smithi155 ceph-mon[112451]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-16T05:52:53.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:52 smithi155 ceph-mon[112451]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-16T05:52:53.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:52 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:52:53.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:52 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:52:53.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:52 smithi155 ceph-mon[112451]: mgrmap e19: smithi155.maowdn(active, since 95s), standbys: smithi156.pclong 2023-12-16T05:52:53.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:52 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:52:53.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:52 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:52:53.756 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:53 smithi156 ceph-mon[121001]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-16T05:52:53.756 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:53 smithi156 ceph-mon[121001]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-16T05:52:53.756 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:53 smithi156 ceph-mon[121001]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-16T05:52:53.756 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:53 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:54.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:53 smithi155 ceph-mon[112451]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-16T05:52:54.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:53 smithi155 ceph-mon[112451]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-16T05:52:54.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:53 smithi155 ceph-mon[112451]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-16T05:52:54.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:53 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:55.730 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:55 smithi156 ceph-mon[121001]: pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-16T05:52:56.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:55 smithi155 ceph-mon[112451]: pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-16T05:52:56.893 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:56 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T05:52:56.893 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:56 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:56.894 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:56 smithi156 ceph-mon[121001]: Deploying daemon osd.3 on smithi156 2023-12-16T05:52:57.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:56 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T05:52:57.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:56 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:52:57.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:56 smithi155 ceph-mon[112451]: Deploying daemon osd.3 on smithi156 2023-12-16T05:52:57.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:57 smithi156 ceph-mon[121001]: pgmap v60: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-16T05:52:58.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:57 smithi155 ceph-mon[112451]: pgmap v60: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-16T05:52:59.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:59 smithi155 ceph-mon[112451]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-16T05:52:59.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:52:59 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:52:59.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:59 smithi156 ceph-mon[121001]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-16T05:52:59.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:52:59 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:00.568 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:00 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:00.568 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:00 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:53:00.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:00 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:00.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:00 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:53:01.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:01.450+0000 7f46eb7fe700 1 -- 172.21.15.156:0/352847214 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f470410f3b0 con 0x7f46ec068ed0 2023-12-16T05:53:01.453 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 3 on host 'smithi156' 2023-12-16T05:53:01.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:01.452+0000 7f470909e700 1 -- 172.21.15.156:0/352847214 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f46ec068ed0 msgr2=0x7f46ec06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:01.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:01.452+0000 7f470909e700 1 --2- 172.21.15.156:0/352847214 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f46ec068ed0 0x7f46ec06b380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009b80 tx=0x7f46f400b040 comp rx=0 tx=0).stop 2023-12-16T05:53:01.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:01.453+0000 7f470909e700 1 -- 172.21.15.156:0/352847214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4704100050 msgr2=0x7f470410d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:01.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:01.453+0000 7f470909e700 1 --2- 172.21.15.156:0/352847214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4704100050 0x7f470410d9a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f46f8000c00 tx=0x7f46f8009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:01.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:01.453+0000 7f470909e700 1 -- 172.21.15.156:0/352847214 shutdown_connections 2023-12-16T05:53:01.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:01.453+0000 7f470909e700 1 --2- 172.21.15.156:0/352847214 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f46ec068ed0 0x7f46ec06b380 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:01.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:01.453+0000 7f470909e700 1 --2- 172.21.15.156:0/352847214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47040fd730 0x7f470410d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:01.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:01.453+0000 7f470909e700 1 --2- 172.21.15.156:0/352847214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4704100050 0x7f470410d9a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:01.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:01.453+0000 7f470909e700 1 -- 172.21.15.156:0/352847214 >> 172.21.15.156:0/352847214 conn(0x7f47040f7190 msgr2=0x7f47040f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:01.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:01.453+0000 7f470909e700 1 -- 172.21.15.156:0/352847214 shutdown_connections 2023-12-16T05:53:01.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:01.453+0000 7f470909e700 1 -- 172.21.15.156:0/352847214 wait complete. 2023-12-16T05:53:01.834 DEBUG:teuthology.orchestra.run.smithi156:osd.3> sudo journalctl -f -n 0 -u ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.3.service 2023-12-16T05:53:01.836 INFO:tasks.cephadm:Deploying osd.4 on smithi156 with /dev/vg_nvme/lv_3... 2023-12-16T05:53:01.836 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-16T05:53:01.865 INFO:journalctl@ceph.osd.3.smithi156.stdout:-- Logs begin at Sat 2023-12-16 04:41:43 UTC. -- 2023-12-16T05:53:02.136 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:01 smithi156 ceph-mon[121001]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-16T05:53:02.137 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:01 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:02.137 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:01 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:02.137 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:01 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:53:02.137 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:01 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:53:02.137 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:01 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:02.137 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:01 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:02.137 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:01 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:02.137 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:01 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:53:02.137 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:01 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:53:02.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:01 smithi155 ceph-mon[112451]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-16T05:53:02.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:01 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:02.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:01 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:02.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:01 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:53:02.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:01 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:53:02.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:01 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:02.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:01 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:02.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:01 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:02.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:01 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:53:02.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:01 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:53:02.482 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi156/config 2023-12-16T05:53:03.377 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 05:53:03 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-3[127418]: 2023-12-16T05:53:03.272+0000 7ff0d8fbf540 -1 osd.3 0 log_to_monitors true 2023-12-16T05:53:03.912 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-16T05:53:03.912 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-16T05:53:03.912 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2023-12-16T05:53:03.913 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2023-12-16T05:53:03.913 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00879536 s, 1.2 GB/s 2023-12-16T05:53:03.913 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2023-12-16T05:53:04.151 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:04 smithi156 ceph-mon[121001]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-16T05:53:04.151 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:04 smithi156 ceph-mon[121001]: from='osd.3 [v2:172.21.15.156:6800/1620466967,v1:172.21.15.156:6801/1620466967]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T05:53:04.151 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:04 smithi156 ceph-mon[121001]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T05:53:04.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:04 smithi155 ceph-mon[112451]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-16T05:53:04.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:04 smithi155 ceph-mon[112451]: from='osd.3 [v2:172.21.15.156:6800/1620466967,v1:172.21.15.156:6801/1620466967]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T05:53:04.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:04 smithi155 ceph-mon[112451]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T05:53:04.396 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi156:vg_nvme/lv_3 2023-12-16T05:53:04.658 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi156/config 2023-12-16T05:53:05.018 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:05 smithi156 ceph-mon[121001]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-16T05:53:05.018 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:05 smithi156 ceph-mon[121001]: osdmap e23: 4 total, 3 up, 4 in 2023-12-16T05:53:05.018 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:05 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T05:53:05.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:05 smithi156 ceph-mon[121001]: from='osd.3 [v2:172.21.15.156:6800/1620466967,v1:172.21.15.156:6801/1620466967]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T05:53:05.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:05 smithi156 ceph-mon[121001]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T05:53:05.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:05 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:05.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:05 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:05.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:05 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:53:05.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:05 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:05.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:05 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:53:05.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:05 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:53:05.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:05 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:05.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:05 smithi155 ceph-mon[112451]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-16T05:53:05.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:05 smithi155 ceph-mon[112451]: osdmap e23: 4 total, 3 up, 4 in 2023-12-16T05:53:05.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:05 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T05:53:05.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:05 smithi155 ceph-mon[112451]: from='osd.3 [v2:172.21.15.156:6800/1620466967,v1:172.21.15.156:6801/1620466967]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T05:53:05.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:05 smithi155 ceph-mon[112451]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T05:53:05.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:05 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:05.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:05 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:05.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:05 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:53:05.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:05 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:05.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:05 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:53:05.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:05 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:53:05.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:05 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:05.385 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 05:53:05 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-3[127418]: 2023-12-16T05:53:05.019+0000 7ff0cf7a4700 -1 osd.3 0 waiting for initial osdmap 2023-12-16T05:53:05.385 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 05:53:05 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-3[127418]: 2023-12-16T05:53:05.025+0000 7ff0ca59f700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T05:53:05.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.549+0000 7f56cd38d700 1 -- 172.21.15.156:0/3116590989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56c80fde00 msgr2=0x7f56c80fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:05.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.549+0000 7f56cd38d700 1 --2- 172.21.15.156:0/3116590989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56c80fde00 0x7f56c80fe250 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f56b8004940 tx=0x7f56b8009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:05.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.549+0000 7f56cd38d700 1 -- 172.21.15.156:0/3116590989 shutdown_connections 2023-12-16T05:53:05.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.549+0000 7f56cd38d700 1 --2- 172.21.15.156:0/3116590989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56c80fde00 0x7f56c80fe250 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:05.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.549+0000 7f56cd38d700 1 --2- 172.21.15.156:0/3116590989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56c80fcbf0 0x7f56c80fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:05.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.549+0000 7f56cd38d700 1 -- 172.21.15.156:0/3116590989 >> 172.21.15.156:0/3116590989 conn(0x7f56c80f82d0 msgr2=0x7f56c80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:05.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.549+0000 7f56cd38d700 1 -- 172.21.15.156:0/3116590989 shutdown_connections 2023-12-16T05:53:05.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.549+0000 7f56cd38d700 1 -- 172.21.15.156:0/3116590989 wait complete. 2023-12-16T05:53:05.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.549+0000 7f56cd38d700 1 Processor -- start 2023-12-16T05:53:05.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.549+0000 7f56cd38d700 1 -- start start 2023-12-16T05:53:05.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.550+0000 7f56cd38d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56c80fcbf0 0x7f56c810d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:05.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.550+0000 7f56cd38d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56c80fde00 0x7f56c810db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:05.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.550+0000 7f56cd38d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c810e120 con 0x7f56c80fde00 2023-12-16T05:53:05.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.550+0000 7f56cd38d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c810e9c0 con 0x7f56c80fcbf0 2023-12-16T05:53:05.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.550+0000 7f56c6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56c80fcbf0 0x7f56c810d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:05.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.550+0000 7f56c6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56c80fcbf0 0x7f56c810d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56722/0 (socket says 172.21.15.156:56722) 2023-12-16T05:53:05.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.550+0000 7f56c6ffd700 1 -- 172.21.15.156:0/1798365168 learned_addr learned my addr 172.21.15.156:0/1798365168 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-12-16T05:53:05.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.550+0000 7f56c67fc700 1 --2- 172.21.15.156:0/1798365168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56c80fde00 0x7f56c810db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:05.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.550+0000 7f56c6ffd700 1 -- 172.21.15.156:0/1798365168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56c80fde00 msgr2=0x7f56c810db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:05.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.550+0000 7f56c6ffd700 1 --2- 172.21.15.156:0/1798365168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56c80fde00 0x7f56c810db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:05.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.550+0000 7f56c6ffd700 1 -- 172.21.15.156:0/1798365168 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b8005040 con 0x7f56c80fcbf0 2023-12-16T05:53:05.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.550+0000 7f56c6ffd700 1 --2- 172.21.15.156:0/1798365168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56c80fcbf0 0x7f56c810d5e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f56bc002a80 tx=0x7f56bc004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:05.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.550+0000 7f56af7fe700 1 -- 172.21.15.156:0/1798365168 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56bc007cc0 con 0x7f56c80fcbf0 2023-12-16T05:53:05.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.550+0000 7f56af7fe700 1 -- 172.21.15.156:0/1798365168 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f56bc00f040 con 0x7f56c80fcbf0 2023-12-16T05:53:05.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.550+0000 7f56af7fe700 1 -- 172.21.15.156:0/1798365168 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56bc00d9c0 con 0x7f56c80fcbf0 2023-12-16T05:53:05.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.550+0000 7f56cd38d700 1 -- 172.21.15.156:0/1798365168 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c810eca0 con 0x7f56c80fcbf0 2023-12-16T05:53:05.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.550+0000 7f56cd38d700 1 -- 172.21.15.156:0/1798365168 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c810f1e0 con 0x7f56c80fcbf0 2023-12-16T05:53:05.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.551+0000 7f56cd38d700 1 -- 172.21.15.156:0/1798365168 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c804bb80 con 0x7f56c80fcbf0 2023-12-16T05:53:05.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.552+0000 7f56af7fe700 1 -- 172.21.15.156:0/1798365168 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f56bc00db20 con 0x7f56c80fcbf0 2023-12-16T05:53:05.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.552+0000 7f56af7fe700 1 --2- 172.21.15.156:0/1798365168 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f56b0068f60 0x7f56b006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:05.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.552+0000 7f56af7fe700 1 -- 172.21.15.156:0/1798365168 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3490+0+0 (secure 0 0 0) 0x7f56bc086320 con 0x7f56c80fcbf0 2023-12-16T05:53:05.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.552+0000 7f56c67fc700 1 --2- 172.21.15.156:0/1798365168 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f56b0068f60 0x7f56b006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:05.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.553+0000 7f56c67fc700 1 --2- 172.21.15.156:0/1798365168 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f56b0068f60 0x7f56b006b410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f56b8004f90 tx=0x7f56b8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:05.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.557+0000 7f56af7fe700 1 -- 172.21.15.156:0/1798365168 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f56bc0569b0 con 0x7f56c80fcbf0 2023-12-16T05:53:05.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:05.747+0000 7f56cd38d700 1 -- 172.21.15.156:0/1798365168 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f56c810f630 con 0x7f56b0068f60 2023-12-16T05:53:06.321 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:06 smithi156 ceph-mon[121001]: Detected new or changed devices on smithi156 2023-12-16T05:53:06.321 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:06 smithi156 ceph-mon[121001]: Adjusting osd_memory_target on smithi156 to 15970M 2023-12-16T05:53:06.321 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:06 smithi156 ceph-mon[121001]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-16T05:53:06.321 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:06 smithi156 ceph-mon[121001]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-12-16T05:53:06.321 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:06 smithi156 ceph-mon[121001]: osdmap e24: 4 total, 3 up, 4 in 2023-12-16T05:53:06.321 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:06 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T05:53:06.321 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:06 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T05:53:06.321 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:06 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T05:53:06.321 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:06 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T05:53:06.321 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:06 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:53:06.321 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:06 smithi156 ceph-mon[121001]: osd.3 [v2:172.21.15.156:6800/1620466967,v1:172.21.15.156:6801/1620466967] boot 2023-12-16T05:53:06.322 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:06 smithi156 ceph-mon[121001]: osdmap e25: 4 total, 4 up, 4 in 2023-12-16T05:53:06.322 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:06 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T05:53:06.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:06 smithi155 ceph-mon[112451]: Detected new or changed devices on smithi156 2023-12-16T05:53:06.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:06 smithi155 ceph-mon[112451]: Adjusting osd_memory_target on smithi156 to 15970M 2023-12-16T05:53:06.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:06 smithi155 ceph-mon[112451]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-16T05:53:06.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:06 smithi155 ceph-mon[112451]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-12-16T05:53:06.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:06 smithi155 ceph-mon[112451]: osdmap e24: 4 total, 3 up, 4 in 2023-12-16T05:53:06.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:06 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T05:53:06.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:06 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T05:53:06.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:06 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T05:53:06.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:06 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T05:53:06.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:06 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:53:06.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:06 smithi155 ceph-mon[112451]: osd.3 [v2:172.21.15.156:6800/1620466967,v1:172.21.15.156:6801/1620466967] boot 2023-12-16T05:53:06.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:06 smithi155 ceph-mon[112451]: osdmap e25: 4 total, 4 up, 4 in 2023-12-16T05:53:06.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:06 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T05:53:07.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:07 smithi156 ceph-mon[121001]: purged_snaps scrub starts 2023-12-16T05:53:07.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:07 smithi156 ceph-mon[121001]: purged_snaps scrub ok 2023-12-16T05:53:07.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:07 smithi156 ceph-mon[121001]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:53:07.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:07 smithi156 ceph-mon[121001]: osdmap e26: 4 total, 4 up, 4 in 2023-12-16T05:53:07.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:07 smithi155 ceph-mon[112451]: purged_snaps scrub starts 2023-12-16T05:53:07.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:07 smithi155 ceph-mon[112451]: purged_snaps scrub ok 2023-12-16T05:53:07.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:07 smithi155 ceph-mon[112451]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:53:07.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:07 smithi155 ceph-mon[112451]: osdmap e26: 4 total, 4 up, 4 in 2023-12-16T05:53:08.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:08 smithi155 ceph-mon[112451]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T05:53:08.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:08 smithi155 ceph-mon[112451]: from='client.? 172.21.15.156:0/244213024' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f61396ce-8004-49ee-aa87-98c96fc7d35c"}]: dispatch 2023-12-16T05:53:08.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:08 smithi155 ceph-mon[112451]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f61396ce-8004-49ee-aa87-98c96fc7d35c"}]: dispatch 2023-12-16T05:53:08.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:08 smithi155 ceph-mon[112451]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f61396ce-8004-49ee-aa87-98c96fc7d35c"}]': finished 2023-12-16T05:53:08.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:08 smithi155 ceph-mon[112451]: osdmap e27: 5 total, 4 up, 5 in 2023-12-16T05:53:08.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:08 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T05:53:08.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:08 smithi156 ceph-mon[121001]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T05:53:08.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:08 smithi156 ceph-mon[121001]: from='client.? 172.21.15.156:0/244213024' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f61396ce-8004-49ee-aa87-98c96fc7d35c"}]: dispatch 2023-12-16T05:53:08.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:08 smithi156 ceph-mon[121001]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f61396ce-8004-49ee-aa87-98c96fc7d35c"}]: dispatch 2023-12-16T05:53:08.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:08 smithi156 ceph-mon[121001]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f61396ce-8004-49ee-aa87-98c96fc7d35c"}]': finished 2023-12-16T05:53:08.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:08 smithi156 ceph-mon[121001]: osdmap e27: 5 total, 4 up, 5 in 2023-12-16T05:53:08.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:08 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T05:53:09.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:09 smithi155 ceph-mon[112451]: from='client.? 172.21.15.156:0/1798548249' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T05:53:09.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:09 smithi155 ceph-mon[112451]: osdmap e28: 5 total, 4 up, 5 in 2023-12-16T05:53:09.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:09 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T05:53:09.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:09 smithi156 ceph-mon[121001]: from='client.? 172.21.15.156:0/1798548249' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T05:53:09.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:09 smithi156 ceph-mon[121001]: osdmap e28: 5 total, 4 up, 5 in 2023-12-16T05:53:09.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:09 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T05:53:10.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:10 smithi155 ceph-mon[112451]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T05:53:10.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:10 smithi155 ceph-mon[112451]: osdmap e29: 5 total, 4 up, 5 in 2023-12-16T05:53:10.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:10 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T05:53:10.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:10 smithi156 ceph-mon[121001]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T05:53:10.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:10 smithi156 ceph-mon[121001]: osdmap e29: 5 total, 4 up, 5 in 2023-12-16T05:53:10.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:10 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T05:53:11.428 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:11 smithi156 ceph-mon[121001]: pgmap v74: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-16T05:53:11.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:11 smithi155 ceph-mon[112451]: pgmap v74: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-16T05:53:13.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:13 smithi155 ceph-mon[112451]: pgmap v75: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2023-12-16T05:53:13.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:13 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T05:53:13.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:13 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:53:13.879 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:13 smithi156 ceph-mon[121001]: pgmap v75: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2023-12-16T05:53:13.879 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:13 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T05:53:13.880 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:13 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:53:14.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:14 smithi156 ceph-mon[121001]: Deploying daemon osd.4 on smithi156 2023-12-16T05:53:14.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:14 smithi155 ceph-mon[112451]: Deploying daemon osd.4 on smithi156 2023-12-16T05:53:15.699 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:15 smithi156 ceph-mon[121001]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-12-16T05:53:15.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:15 smithi155 ceph-mon[112451]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-12-16T05:53:16.815 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:16 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:53:16.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:16 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:53:17.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:17 smithi156 ceph-mon[121001]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-12-16T05:53:17.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:17 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:17.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:17 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:17.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:17 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:53:18.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:17 smithi155 ceph-mon[112451]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-12-16T05:53:18.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:17 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:18.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:17 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:18.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:17 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:53:19.103 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 4 on host 'smithi156' 2023-12-16T05:53:19.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:19.101+0000 7f56af7fe700 1 -- 172.21.15.156:0/1798365168 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f56c810f630 con 0x7f56b0068f60 2023-12-16T05:53:19.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:19.103+0000 7f56cd38d700 1 -- 172.21.15.156:0/1798365168 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f56b0068f60 msgr2=0x7f56b006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:19.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:19.103+0000 7f56cd38d700 1 --2- 172.21.15.156:0/1798365168 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f56b0068f60 0x7f56b006b410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f56b8004f90 tx=0x7f56b8009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:19.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:19.103+0000 7f56cd38d700 1 -- 172.21.15.156:0/1798365168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56c80fcbf0 msgr2=0x7f56c810d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:19.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:19.103+0000 7f56cd38d700 1 --2- 172.21.15.156:0/1798365168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56c80fcbf0 0x7f56c810d5e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f56bc002a80 tx=0x7f56bc004600 comp rx=0 tx=0).stop 2023-12-16T05:53:19.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:19.103+0000 7f56cd38d700 1 -- 172.21.15.156:0/1798365168 shutdown_connections 2023-12-16T05:53:19.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:19.103+0000 7f56cd38d700 1 --2- 172.21.15.156:0/1798365168 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f56b0068f60 0x7f56b006b410 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:19.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:19.103+0000 7f56cd38d700 1 --2- 172.21.15.156:0/1798365168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56c80fcbf0 0x7f56c810d5e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:19.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:19.103+0000 7f56cd38d700 1 --2- 172.21.15.156:0/1798365168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56c80fde00 0x7f56c810db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:19.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:19.103+0000 7f56cd38d700 1 -- 172.21.15.156:0/1798365168 >> 172.21.15.156:0/1798365168 conn(0x7f56c80f82d0 msgr2=0x7f56c8101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:19.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:19.103+0000 7f56cd38d700 1 -- 172.21.15.156:0/1798365168 shutdown_connections 2023-12-16T05:53:19.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:19.103+0000 7f56cd38d700 1 -- 172.21.15.156:0/1798365168 wait complete. 2023-12-16T05:53:19.474 DEBUG:teuthology.orchestra.run.smithi156:osd.4> sudo journalctl -f -n 0 -u ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.4.service 2023-12-16T05:53:19.476 INFO:tasks.cephadm:Deploying osd.5 on smithi156 with /dev/vg_nvme/lv_2... 2023-12-16T05:53:19.476 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-16T05:53:19.507 INFO:journalctl@ceph.osd.4.smithi156.stdout:-- Logs begin at Sat 2023-12-16 04:41:43 UTC. -- 2023-12-16T05:53:20.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:19 smithi156 ceph-mon[121001]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-16T05:53:20.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:19 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:20.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:19 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:20.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:19 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:53:20.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:19 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:53:20.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:19 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:20.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:19 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:20.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:19 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:20.020 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:19 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:53:20.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:19 smithi155 ceph-mon[112451]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-16T05:53:20.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:19 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:20.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:19 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:20.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:19 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:53:20.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:19 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:53:20.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:19 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:20.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:19 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:20.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:19 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:20.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:19 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:53:20.079 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi156/config 2023-12-16T05:53:21.180 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 05:53:20 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[135364]: 2023-12-16T05:53:20.872+0000 7fa478f13540 -1 osd.4 0 log_to_monitors true 2023-12-16T05:53:21.344 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-16T05:53:21.344 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-16T05:53:21.344 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2023-12-16T05:53:21.344 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2023-12-16T05:53:21.344 INFO:teuthology.orchestra.run.smithi156.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00827239 s, 1.3 GB/s 2023-12-16T05:53:21.344 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2023-12-16T05:53:21.843 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi156:vg_nvme/lv_2 2023-12-16T05:53:22.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:21 smithi155 ceph-mon[112451]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T05:53:22.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:21 smithi155 ceph-mon[112451]: from='osd.4 [v2:172.21.15.156:6808/2759834290,v1:172.21.15.156:6809/2759834290]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T05:53:22.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:21 smithi155 ceph-mon[112451]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T05:53:22.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:21 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:22.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:21 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:22.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:21 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:53:22.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:21 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:53:22.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:21 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:22.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:21 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:53:22.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:21 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:53:22.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:21 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:22.103 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi156/config 2023-12-16T05:53:22.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:21 smithi156 ceph-mon[121001]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T05:53:22.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:21 smithi156 ceph-mon[121001]: from='osd.4 [v2:172.21.15.156:6808/2759834290,v1:172.21.15.156:6809/2759834290]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T05:53:22.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:21 smithi156 ceph-mon[121001]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T05:53:22.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:21 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:22.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:21 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:22.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:21 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:53:22.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:21 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:53:22.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:21 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:22.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:21 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:53:22.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:21 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:53:22.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:21 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:22.882 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 05:53:22 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[135364]: 2023-12-16T05:53:22.768+0000 7fa46f6f8700 -1 osd.4 0 waiting for initial osdmap 2023-12-16T05:53:22.882 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 05:53:22 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[135364]: 2023-12-16T05:53:22.776+0000 7fa46c4f7700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T05:53:22.882 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:22 smithi156 ceph-mon[121001]: Detected new or changed devices on smithi156 2023-12-16T05:53:22.882 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:22 smithi156 ceph-mon[121001]: Adjusting osd_memory_target on smithi156 to 7985M 2023-12-16T05:53:22.883 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:22 smithi156 ceph-mon[121001]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-16T05:53:22.883 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:22 smithi156 ceph-mon[121001]: osdmap e30: 5 total, 4 up, 5 in 2023-12-16T05:53:22.883 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:22 smithi156 ceph-mon[121001]: from='osd.4 [v2:172.21.15.156:6808/2759834290,v1:172.21.15.156:6809/2759834290]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T05:53:22.883 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:22 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T05:53:22.883 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:22 smithi156 ceph-mon[121001]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T05:53:22.883 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:22 smithi156 ceph-mon[121001]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-12-16T05:53:22.883 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:22 smithi156 ceph-mon[121001]: osdmap e31: 5 total, 4 up, 5 in 2023-12-16T05:53:22.883 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:22 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T05:53:23.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.055+0000 7f2f7f7aa700 1 -- 172.21.15.156:0/1640565830 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f780fcbf0 msgr2=0x7f2f780fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:23.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.055+0000 7f2f7f7aa700 1 --2- 172.21.15.156:0/1640565830 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f780fcbf0 0x7f2f780fd000 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2f74004940 tx=0x7f2f74009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:23.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.056+0000 7f2f7f7aa700 1 -- 172.21.15.156:0/1640565830 shutdown_connections 2023-12-16T05:53:23.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.056+0000 7f2f7f7aa700 1 --2- 172.21.15.156:0/1640565830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f780fde00 0x7f2f780fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:23.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.056+0000 7f2f7f7aa700 1 --2- 172.21.15.156:0/1640565830 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f780fcbf0 0x7f2f780fd000 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:23.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.056+0000 7f2f7f7aa700 1 -- 172.21.15.156:0/1640565830 >> 172.21.15.156:0/1640565830 conn(0x7f2f780f82d0 msgr2=0x7f2f780fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:23.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.056+0000 7f2f7f7aa700 1 -- 172.21.15.156:0/1640565830 shutdown_connections 2023-12-16T05:53:23.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.056+0000 7f2f7f7aa700 1 -- 172.21.15.156:0/1640565830 wait complete. 2023-12-16T05:53:23.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.056+0000 7f2f7f7aa700 1 Processor -- start 2023-12-16T05:53:23.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.056+0000 7f2f7f7aa700 1 -- start start 2023-12-16T05:53:23.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.056+0000 7f2f7f7aa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f780fcbf0 0x7f2f7810d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:23.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.056+0000 7f2f7f7aa700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f780fde00 0x7f2f7810dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:23.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.056+0000 7f2f7f7aa700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7810e0b0 con 0x7f2f780fde00 2023-12-16T05:53:23.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.056+0000 7f2f7f7aa700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7810e950 con 0x7f2f780fcbf0 2023-12-16T05:53:23.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.056+0000 7f2f7d546700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f780fcbf0 0x7f2f7810d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:23.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.056+0000 7f2f7d546700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f780fcbf0 0x7f2f7810d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38992/0 (socket says 172.21.15.156:38992) 2023-12-16T05:53:23.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.056+0000 7f2f7d546700 1 -- 172.21.15.156:0/1581499133 learned_addr learned my addr 172.21.15.156:0/1581499133 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-12-16T05:53:23.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.057+0000 7f2f7cd45700 1 --2- 172.21.15.156:0/1581499133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f780fde00 0x7f2f7810dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:23.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.057+0000 7f2f7d546700 1 -- 172.21.15.156:0/1581499133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f780fde00 msgr2=0x7f2f7810dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:23.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.057+0000 7f2f7d546700 1 --2- 172.21.15.156:0/1581499133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f780fde00 0x7f2f7810dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:23.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.057+0000 7f2f7d546700 1 -- 172.21.15.156:0/1581499133 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f74005040 con 0x7f2f780fcbf0 2023-12-16T05:53:23.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.057+0000 7f2f7d546700 1 --2- 172.21.15.156:0/1581499133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f780fcbf0 0x7f2f7810d570 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2f74000c00 tx=0x7f2f74009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:23.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.057+0000 7f2f6dffb700 1 -- 172.21.15.156:0/1581499133 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f7400e040 con 0x7f2f780fcbf0 2023-12-16T05:53:23.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.057+0000 7f2f6dffb700 1 -- 172.21.15.156:0/1581499133 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f74009af0 con 0x7f2f780fcbf0 2023-12-16T05:53:23.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.057+0000 7f2f7f7aa700 1 -- 172.21.15.156:0/1581499133 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7810ebd0 con 0x7f2f780fcbf0 2023-12-16T05:53:23.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.057+0000 7f2f6dffb700 1 -- 172.21.15.156:0/1581499133 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f7401c630 con 0x7f2f780fcbf0 2023-12-16T05:53:23.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.057+0000 7f2f7f7aa700 1 -- 172.21.15.156:0/1581499133 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7810f110 con 0x7f2f780fcbf0 2023-12-16T05:53:23.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.058+0000 7f2f7f7aa700 1 -- 172.21.15.156:0/1581499133 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f781075d0 con 0x7f2f780fcbf0 2023-12-16T05:53:23.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.058+0000 7f2f6dffb700 1 -- 172.21.15.156:0/1581499133 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f2f7400bcd0 con 0x7f2f780fcbf0 2023-12-16T05:53:23.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.059+0000 7f2f6dffb700 1 --2- 172.21.15.156:0/1581499133 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2f64068f60 0x7f2f6406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:23.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.059+0000 7f2f6dffb700 1 -- 172.21.15.156:0/1581499133 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f2f74087bc0 con 0x7f2f780fcbf0 2023-12-16T05:53:23.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.059+0000 7f2f7cd45700 1 --2- 172.21.15.156:0/1581499133 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2f64068f60 0x7f2f6406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:23.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.059+0000 7f2f7cd45700 1 --2- 172.21.15.156:0/1581499133 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2f64068f60 0x7f2f6406b410 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2f68007fd0 tx=0x7f2f68009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:23.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.063+0000 7f2f6dffb700 1 -- 172.21.15.156:0/1581499133 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2f740581d0 con 0x7f2f780fcbf0 2023-12-16T05:53:23.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:22 smithi155 ceph-mon[112451]: Detected new or changed devices on smithi156 2023-12-16T05:53:23.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:22 smithi155 ceph-mon[112451]: Adjusting osd_memory_target on smithi156 to 7985M 2023-12-16T05:53:23.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:22 smithi155 ceph-mon[112451]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-16T05:53:23.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:22 smithi155 ceph-mon[112451]: osdmap e30: 5 total, 4 up, 5 in 2023-12-16T05:53:23.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:22 smithi155 ceph-mon[112451]: from='osd.4 [v2:172.21.15.156:6808/2759834290,v1:172.21.15.156:6809/2759834290]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T05:53:23.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:22 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T05:53:23.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:22 smithi155 ceph-mon[112451]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T05:53:23.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:22 smithi155 ceph-mon[112451]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-12-16T05:53:23.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:22 smithi155 ceph-mon[112451]: osdmap e31: 5 total, 4 up, 5 in 2023-12-16T05:53:23.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:22 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T05:53:23.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:23.254+0000 7f2f7f7aa700 1 -- 172.21.15.156:0/1581499133 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f7810f330 con 0x7f2f64068f60 2023-12-16T05:53:23.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:23 smithi156 ceph-mon[121001]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T05:53:23.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:23 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T05:53:23.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:23 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T05:53:23.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:23 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T05:53:23.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:23 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:53:23.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:23 smithi156 ceph-mon[121001]: osd.4 [v2:172.21.15.156:6808/2759834290,v1:172.21.15.156:6809/2759834290] boot 2023-12-16T05:53:23.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:23 smithi156 ceph-mon[121001]: osdmap e32: 5 total, 5 up, 5 in 2023-12-16T05:53:23.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:23 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T05:53:24.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:23 smithi155 ceph-mon[112451]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T05:53:24.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:23 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T05:53:24.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:23 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T05:53:24.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:23 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T05:53:24.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:23 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:53:24.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:23 smithi155 ceph-mon[112451]: osd.4 [v2:172.21.15.156:6808/2759834290,v1:172.21.15.156:6809/2759834290] boot 2023-12-16T05:53:24.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:23 smithi155 ceph-mon[112451]: osdmap e32: 5 total, 5 up, 5 in 2023-12-16T05:53:24.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:23 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T05:53:25.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:24 smithi155 ceph-mon[112451]: purged_snaps scrub starts 2023-12-16T05:53:25.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:24 smithi155 ceph-mon[112451]: purged_snaps scrub ok 2023-12-16T05:53:25.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:24 smithi155 ceph-mon[112451]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:53:25.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:24 smithi156 ceph-mon[121001]: purged_snaps scrub starts 2023-12-16T05:53:25.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:24 smithi156 ceph-mon[121001]: purged_snaps scrub ok 2023-12-16T05:53:25.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:24 smithi156 ceph-mon[121001]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:53:26.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:25 smithi155 ceph-mon[112451]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T05:53:26.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:25 smithi155 ceph-mon[112451]: osdmap e33: 5 total, 5 up, 5 in 2023-12-16T05:53:26.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:25 smithi155 ceph-mon[112451]: from='client.? 172.21.15.156:0/722176345' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f58d8355-9752-4ea8-b051-93a14b7f1091"}]: dispatch 2023-12-16T05:53:26.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:25 smithi155 ceph-mon[112451]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f58d8355-9752-4ea8-b051-93a14b7f1091"}]: dispatch 2023-12-16T05:53:26.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:25 smithi155 ceph-mon[112451]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f58d8355-9752-4ea8-b051-93a14b7f1091"}]': finished 2023-12-16T05:53:26.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:25 smithi155 ceph-mon[112451]: osdmap e34: 6 total, 5 up, 6 in 2023-12-16T05:53:26.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:25 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T05:53:26.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:25 smithi155 ceph-mon[112451]: from='client.? 172.21.15.156:0/3126906203' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T05:53:26.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:25 smithi156 ceph-mon[121001]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T05:53:26.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:25 smithi156 ceph-mon[121001]: osdmap e33: 5 total, 5 up, 5 in 2023-12-16T05:53:26.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:25 smithi156 ceph-mon[121001]: from='client.? 172.21.15.156:0/722176345' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f58d8355-9752-4ea8-b051-93a14b7f1091"}]: dispatch 2023-12-16T05:53:26.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:25 smithi156 ceph-mon[121001]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f58d8355-9752-4ea8-b051-93a14b7f1091"}]: dispatch 2023-12-16T05:53:26.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:25 smithi156 ceph-mon[121001]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f58d8355-9752-4ea8-b051-93a14b7f1091"}]': finished 2023-12-16T05:53:26.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:25 smithi156 ceph-mon[121001]: osdmap e34: 6 total, 5 up, 6 in 2023-12-16T05:53:26.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:25 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T05:53:26.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:25 smithi156 ceph-mon[121001]: from='client.? 172.21.15.156:0/3126906203' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T05:53:28.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:27 smithi155 ceph-mon[112451]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T05:53:28.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:27 smithi156 ceph-mon[121001]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T05:53:29.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:29 smithi155 ceph-mon[112451]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T05:53:29.659 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:29 smithi156 ceph-mon[121001]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T05:53:31.588 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:31 smithi156 ceph-mon[121001]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T05:53:31.588 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:31 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T05:53:31.588 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:31 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:53:31.589 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:31 smithi156 ceph-mon[121001]: Deploying daemon osd.5 on smithi156 2023-12-16T05:53:31.589 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:31 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:53:31.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:31 smithi155 ceph-mon[112451]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T05:53:31.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:31 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T05:53:31.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:31 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:53:31.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:31 smithi155 ceph-mon[112451]: Deploying daemon osd.5 on smithi156 2023-12-16T05:53:31.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:31 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:53:33.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:33 smithi155 ceph-mon[112451]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T05:53:33.863 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:33 smithi156 ceph-mon[121001]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T05:53:35.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:35 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:35.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:35 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:35.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:35 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:53:35.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:35 smithi156 ceph-mon[121001]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T05:53:35.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:35 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:35.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:35 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:35.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:35 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:53:35.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:35 smithi155 ceph-mon[112451]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T05:53:36.667 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 5 on host 'smithi156' 2023-12-16T05:53:36.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:36.663+0000 7f2f6dffb700 1 -- 172.21.15.156:0/1581499133 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2f7810f330 con 0x7f2f64068f60 2023-12-16T05:53:36.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:36.666+0000 7f2f7f7aa700 1 -- 172.21.15.156:0/1581499133 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2f64068f60 msgr2=0x7f2f6406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:36.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:36.666+0000 7f2f7f7aa700 1 --2- 172.21.15.156:0/1581499133 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2f64068f60 0x7f2f6406b410 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2f68007fd0 tx=0x7f2f68009040 comp rx=0 tx=0).stop 2023-12-16T05:53:36.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:36.666+0000 7f2f7f7aa700 1 -- 172.21.15.156:0/1581499133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f780fcbf0 msgr2=0x7f2f7810d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:36.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:36.666+0000 7f2f7f7aa700 1 --2- 172.21.15.156:0/1581499133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f780fcbf0 0x7f2f7810d570 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2f74000c00 tx=0x7f2f74009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:36.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:36.666+0000 7f2f7f7aa700 1 -- 172.21.15.156:0/1581499133 shutdown_connections 2023-12-16T05:53:36.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:36.666+0000 7f2f7f7aa700 1 --2- 172.21.15.156:0/1581499133 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2f64068f60 0x7f2f6406b410 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:36.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:36.666+0000 7f2f7f7aa700 1 --2- 172.21.15.156:0/1581499133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f780fcbf0 0x7f2f7810d570 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:36.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:36.666+0000 7f2f7f7aa700 1 --2- 172.21.15.156:0/1581499133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f780fde00 0x7f2f7810dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:36.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:36.666+0000 7f2f7f7aa700 1 -- 172.21.15.156:0/1581499133 >> 172.21.15.156:0/1581499133 conn(0x7f2f780f82d0 msgr2=0x7f2f780fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:36.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:36.666+0000 7f2f7f7aa700 1 -- 172.21.15.156:0/1581499133 shutdown_connections 2023-12-16T05:53:36.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:36.666+0000 7f2f7f7aa700 1 -- 172.21.15.156:0/1581499133 wait complete. 2023-12-16T05:53:37.042 DEBUG:teuthology.orchestra.run.smithi156:osd.5> sudo journalctl -f -n 0 -u ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.5.service 2023-12-16T05:53:37.044 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2023-12-16T05:53:37.044 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph osd stat -f json 2023-12-16T05:53:37.074 INFO:journalctl@ceph.osd.5.smithi156.stdout:-- Logs begin at Sat 2023-12-16 04:41:43 UTC. -- 2023-12-16T05:53:37.321 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:53:37.457 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:37.457 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:37.457 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:37 smithi155 ceph-mon[112451]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T05:53:37.457 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:37.457 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:37.548 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:37 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:37.549 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:37 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:37.549 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:37 smithi156 ceph-mon[121001]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T05:53:37.549 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:37 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:37.549 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:37 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:38.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.337+0000 7fcb2ddb8700 1 -- 172.21.15.155:0/3640742136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb280fcd00 msgr2=0x7fcb280fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:38.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.337+0000 7fcb2ddb8700 1 --2- 172.21.15.155:0/3640742136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb280fcd00 0x7fcb280fd150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c004940 tx=0x7fcb1c009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:38.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.337+0000 7fcb2ddb8700 1 -- 172.21.15.155:0/3640742136 shutdown_connections 2023-12-16T05:53:38.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.337+0000 7fcb2ddb8700 1 --2- 172.21.15.155:0/3640742136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb280fcd00 0x7fcb280fd150 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:38.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.337+0000 7fcb2ddb8700 1 --2- 172.21.15.155:0/3640742136 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb280fbaf0 0x7fcb280fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:38.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.337+0000 7fcb2ddb8700 1 -- 172.21.15.155:0/3640742136 >> 172.21.15.155:0/3640742136 conn(0x7fcb280f71b0 msgr2=0x7fcb280f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:38.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.337+0000 7fcb2ddb8700 1 -- 172.21.15.155:0/3640742136 shutdown_connections 2023-12-16T05:53:38.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.337+0000 7fcb2ddb8700 1 -- 172.21.15.155:0/3640742136 wait complete. 2023-12-16T05:53:38.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.338+0000 7fcb2ddb8700 1 Processor -- start 2023-12-16T05:53:38.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.338+0000 7fcb2ddb8700 1 -- start start 2023-12-16T05:53:38.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.338+0000 7fcb2ddb8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb280fbaf0 0x7fcb281101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:38.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.338+0000 7fcb2ddb8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb280fcd00 0x7fcb28112720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:38.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.338+0000 7fcb2ddb8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb280669a0 con 0x7fcb280fbaf0 2023-12-16T05:53:38.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.338+0000 7fcb2ddb8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28066ae0 con 0x7fcb280fcd00 2023-12-16T05:53:38.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.338+0000 7fcb277fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb280fbaf0 0x7fcb281101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:38.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.338+0000 7fcb277fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb280fbaf0 0x7fcb281101d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41046/0 (socket says 172.21.15.155:41046) 2023-12-16T05:53:38.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.338+0000 7fcb26ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb280fcd00 0x7fcb28112720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:38.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.338+0000 7fcb277fe700 1 -- 172.21.15.155:0/933076314 learned_addr learned my addr 172.21.15.155:0/933076314 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:53:38.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.339+0000 7fcb277fe700 1 -- 172.21.15.155:0/933076314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb280fcd00 msgr2=0x7fcb28112720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:38.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.339+0000 7fcb277fe700 1 --2- 172.21.15.155:0/933076314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb280fcd00 0x7fcb28112720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:38.344 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.339+0000 7fcb277fe700 1 -- 172.21.15.155:0/933076314 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1c005040 con 0x7fcb280fbaf0 2023-12-16T05:53:38.344 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.339+0000 7fcb277fe700 1 --2- 172.21.15.155:0/933076314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb280fbaf0 0x7fcb281101d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800eb40 tx=0x7fcb1800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:38.344 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.339+0000 7fcb0ffff700 1 -- 172.21.15.155:0/933076314 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb18007cc0 con 0x7fcb280fbaf0 2023-12-16T05:53:38.344 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.339+0000 7fcb0ffff700 1 -- 172.21.15.155:0/933076314 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcb1800f040 con 0x7fcb280fbaf0 2023-12-16T05:53:38.344 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.339+0000 7fcb0ffff700 1 -- 172.21.15.155:0/933076314 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb1800c9f0 con 0x7fcb280fbaf0 2023-12-16T05:53:38.344 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.339+0000 7fcb2ddb8700 1 -- 172.21.15.155:0/933076314 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb28112d20 con 0x7fcb280fbaf0 2023-12-16T05:53:38.344 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.339+0000 7fcb2ddb8700 1 -- 172.21.15.155:0/933076314 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb28113160 con 0x7fcb280fbaf0 2023-12-16T05:53:38.345 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.340+0000 7fcb2ddb8700 1 -- 172.21.15.155:0/933076314 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2804bb80 con 0x7fcb280fbaf0 2023-12-16T05:53:38.345 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.341+0000 7fcb0ffff700 1 -- 172.21.15.155:0/933076314 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fcb1800cb50 con 0x7fcb280fbaf0 2023-12-16T05:53:38.345 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.341+0000 7fcb0ffff700 1 --2- 172.21.15.155:0/933076314 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fcb10068f60 0x7fcb1006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:38.345 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.342+0000 7fcb0ffff700 1 -- 172.21.15.155:0/933076314 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4317+0+0 (secure 0 0 0) 0x7fcb18086860 con 0x7fcb280fbaf0 2023-12-16T05:53:38.345 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.342+0000 7fcb26ffd700 1 --2- 172.21.15.155:0/933076314 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fcb10068f60 0x7fcb1006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:38.345 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.342+0000 7fcb26ffd700 1 --2- 172.21.15.155:0/933076314 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fcb10068f60 0x7fcb1006b410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c000c00 tx=0x7fcb1c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:38.348 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.345+0000 7fcb0ffff700 1 -- 172.21.15.155:0/933076314 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcb180531b0 con 0x7fcb280fbaf0 2023-12-16T05:53:38.543 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.540+0000 7fcb2ddb8700 1 -- 172.21.15.155:0/933076314 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fcb28113380 con 0x7fcb280fbaf0 2023-12-16T05:53:38.544 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.541+0000 7fcb0ffff700 1 -- 172.21.15.155:0/933076314 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v34) v1 ==== 74+0+130 (secure 0 0 0) 0x7fcb180567d0 con 0x7fcb280fbaf0 2023-12-16T05:53:38.544 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:53:38.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.543+0000 7fcb2ddb8700 1 -- 172.21.15.155:0/933076314 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fcb10068f60 msgr2=0x7fcb1006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:38.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.543+0000 7fcb2ddb8700 1 --2- 172.21.15.155:0/933076314 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fcb10068f60 0x7fcb1006b410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c000c00 tx=0x7fcb1c009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:38.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.543+0000 7fcb2ddb8700 1 -- 172.21.15.155:0/933076314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb280fbaf0 msgr2=0x7fcb281101d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:38.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.543+0000 7fcb2ddb8700 1 --2- 172.21.15.155:0/933076314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb280fbaf0 0x7fcb281101d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800eb40 tx=0x7fcb1800b040 comp rx=0 tx=0).stop 2023-12-16T05:53:38.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.543+0000 7fcb2ddb8700 1 -- 172.21.15.155:0/933076314 shutdown_connections 2023-12-16T05:53:38.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.543+0000 7fcb2ddb8700 1 --2- 172.21.15.155:0/933076314 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fcb10068f60 0x7fcb1006b410 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:38.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.543+0000 7fcb2ddb8700 1 --2- 172.21.15.155:0/933076314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb280fbaf0 0x7fcb281101d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:38.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.543+0000 7fcb2ddb8700 1 --2- 172.21.15.155:0/933076314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb280fcd00 0x7fcb28112720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:38.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.543+0000 7fcb2ddb8700 1 -- 172.21.15.155:0/933076314 >> 172.21.15.155:0/933076314 conn(0x7fcb280f71b0 msgr2=0x7fcb280fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:38.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.543+0000 7fcb2ddb8700 1 -- 172.21.15.155:0/933076314 shutdown_connections 2023-12-16T05:53:38.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:38.543+0000 7fcb2ddb8700 1 -- 172.21.15.155:0/933076314 wait complete. 2023-12-16T05:53:38.644 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 05:53:38 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[143375]: 2023-12-16T05:53:38.367+0000 7f0b75bd7540 -1 osd.5 0 log_to_monitors true 2023-12-16T05:53:38.912 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":34,"num_osds":6,"num_up_osds":5,"osd_up_since":1702706003,"num_in_osds":6,"osd_in_since":1702706005,"num_remapped_pgs":0} 2023-12-16T05:53:39.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:39 smithi155 ceph-mon[112451]: from='osd.5 [v2:172.21.15.156:6816/81941755,v1:172.21.15.156:6817/81941755]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T05:53:39.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:39 smithi155 ceph-mon[112451]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T05:53:39.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:39 smithi155 ceph-mon[112451]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T05:53:39.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:39 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/933076314' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-16T05:53:39.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:39 smithi155 ceph-mon[112451]: Detected new or changed devices on smithi156 2023-12-16T05:53:39.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:39.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:39.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:53:39.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:53:39.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:53:39.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:39 smithi155 ceph-mon[112451]: Adjusting osd_memory_target on smithi156 to 5323M 2023-12-16T05:53:39.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:39.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:53:39.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:53:39.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:39.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:53:39.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:53:39.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:53:39.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:39.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:39 smithi156 ceph-mon[121001]: from='osd.5 [v2:172.21.15.156:6816/81941755,v1:172.21.15.156:6817/81941755]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T05:53:39.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:39 smithi156 ceph-mon[121001]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T05:53:39.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:39 smithi156 ceph-mon[121001]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T05:53:39.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:39 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/933076314' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-16T05:53:39.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:39 smithi156 ceph-mon[121001]: Detected new or changed devices on smithi156 2023-12-16T05:53:39.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:39.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:39.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:53:39.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:53:39.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:53:39.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:39 smithi156 ceph-mon[121001]: Adjusting osd_memory_target on smithi156 to 5323M 2023-12-16T05:53:39.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:39.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:53:39.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:53:39.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:39.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:53:39.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:53:39.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:53:39.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:53:39.913 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph osd stat -f json 2023-12-16T05:53:40.189 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:53:40.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:40 smithi155 ceph-mon[112451]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-16T05:53:40.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:40 smithi155 ceph-mon[112451]: osdmap e35: 6 total, 5 up, 6 in 2023-12-16T05:53:40.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:40 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T05:53:40.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:40 smithi155 ceph-mon[112451]: from='osd.5 [v2:172.21.15.156:6816/81941755,v1:172.21.15.156:6817/81941755]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T05:53:40.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:40 smithi155 ceph-mon[112451]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T05:53:40.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 05:53:40 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[143375]: 2023-12-16T05:53:40.322+0000 7f0b6c3bc700 -1 osd.5 0 waiting for initial osdmap 2023-12-16T05:53:40.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 05:53:40 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[143375]: 2023-12-16T05:53:40.333+0000 7f0b669b6700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T05:53:40.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:40 smithi156 ceph-mon[121001]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-16T05:53:40.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:40 smithi156 ceph-mon[121001]: osdmap e35: 6 total, 5 up, 6 in 2023-12-16T05:53:40.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:40 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T05:53:40.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:40 smithi156 ceph-mon[121001]: from='osd.5 [v2:172.21.15.156:6816/81941755,v1:172.21.15.156:6817/81941755]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T05:53:40.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:40 smithi156 ceph-mon[121001]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T05:53:41.180 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.177+0000 7fcf097c1700 1 -- 172.21.15.155:0/2520559370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf040fbaf0 msgr2=0x7fcf040fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:41.180 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.177+0000 7fcf097c1700 1 --2- 172.21.15.155:0/2520559370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf040fbaf0 0x7fcf040fbf00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcef4004940 tx=0x7fcef4009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:41.180 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.177+0000 7fcf097c1700 1 -- 172.21.15.155:0/2520559370 shutdown_connections 2023-12-16T05:53:41.180 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.177+0000 7fcf097c1700 1 --2- 172.21.15.155:0/2520559370 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf040fcd00 0x7fcf040fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:41.181 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.177+0000 7fcf097c1700 1 --2- 172.21.15.155:0/2520559370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf040fbaf0 0x7fcf040fbf00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:41.181 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.177+0000 7fcf097c1700 1 -- 172.21.15.155:0/2520559370 >> 172.21.15.155:0/2520559370 conn(0x7fcf040f7190 msgr2=0x7fcf040f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:41.181 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.177+0000 7fcf097c1700 1 -- 172.21.15.155:0/2520559370 shutdown_connections 2023-12-16T05:53:41.181 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.177+0000 7fcf097c1700 1 -- 172.21.15.155:0/2520559370 wait complete. 2023-12-16T05:53:41.182 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.178+0000 7fcf097c1700 1 Processor -- start 2023-12-16T05:53:41.182 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.178+0000 7fcf097c1700 1 -- start start 2023-12-16T05:53:41.182 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.178+0000 7fcf097c1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf040fbaf0 0x7fcf04110210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:41.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.178+0000 7fcf097c1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf040fcd00 0x7fcf04112760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:41.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.178+0000 7fcf097c1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf04066110 con 0x7fcf040fbaf0 2023-12-16T05:53:41.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.178+0000 7fcf097c1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf04066250 con 0x7fcf040fcd00 2023-12-16T05:53:41.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.178+0000 7fcf02ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf040fbaf0 0x7fcf04110210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:41.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.178+0000 7fcf02ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf040fbaf0 0x7fcf04110210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41058/0 (socket says 172.21.15.155:41058) 2023-12-16T05:53:41.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.178+0000 7fcf02ffd700 1 -- 172.21.15.155:0/3465488857 learned_addr learned my addr 172.21.15.155:0/3465488857 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:53:41.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.178+0000 7fcf027fc700 1 --2- 172.21.15.155:0/3465488857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf040fcd00 0x7fcf04112760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:41.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.178+0000 7fcf02ffd700 1 -- 172.21.15.155:0/3465488857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf040fcd00 msgr2=0x7fcf04112760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:41.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.178+0000 7fcf02ffd700 1 --2- 172.21.15.155:0/3465488857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf040fcd00 0x7fcf04112760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:41.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.178+0000 7fcf02ffd700 1 -- 172.21.15.155:0/3465488857 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef4005040 con 0x7fcf040fbaf0 2023-12-16T05:53:41.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.178+0000 7fcf02ffd700 1 --2- 172.21.15.155:0/3465488857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf040fbaf0 0x7fcf04110210 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcef4000c00 tx=0x7fcef4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:41.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.179+0000 7fcefb7fe700 1 -- 172.21.15.155:0/3465488857 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcef400e040 con 0x7fcf040fbaf0 2023-12-16T05:53:41.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.179+0000 7fcf097c1700 1 -- 172.21.15.155:0/3465488857 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf04112d60 con 0x7fcf040fbaf0 2023-12-16T05:53:41.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.179+0000 7fcefb7fe700 1 -- 172.21.15.155:0/3465488857 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcef4009af0 con 0x7fcf040fbaf0 2023-12-16T05:53:41.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.179+0000 7fcefb7fe700 1 -- 172.21.15.155:0/3465488857 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcef401c630 con 0x7fcf040fbaf0 2023-12-16T05:53:41.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.179+0000 7fcf097c1700 1 -- 172.21.15.155:0/3465488857 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf041131e0 con 0x7fcf040fbaf0 2023-12-16T05:53:41.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.180+0000 7fcf097c1700 1 -- 172.21.15.155:0/3465488857 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf0404bb80 con 0x7fcf040fbaf0 2023-12-16T05:53:41.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.180+0000 7fcefb7fe700 1 -- 172.21.15.155:0/3465488857 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fcef400bc50 con 0x7fcf040fbaf0 2023-12-16T05:53:41.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.181+0000 7fcefb7fe700 1 --2- 172.21.15.155:0/3465488857 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fcef0068f60 0x7fcef006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:41.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.181+0000 7fcefb7fe700 1 -- 172.21.15.155:0/3465488857 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4354+0+0 (secure 0 0 0) 0x7fcef4088760 con 0x7fcf040fbaf0 2023-12-16T05:53:41.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.181+0000 7fcf027fc700 1 --2- 172.21.15.155:0/3465488857 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fcef0068f60 0x7fcef006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:41.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.181+0000 7fcf027fc700 1 --2- 172.21.15.155:0/3465488857 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fcef0068f60 0x7fcef006b410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fceec009fd0 tx=0x7fceec00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:41.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.185+0000 7fcefb7fe700 1 -- 172.21.15.155:0/3465488857 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcef4055120 con 0x7fcf040fbaf0 2023-12-16T05:53:41.378 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.374+0000 7fcf097c1700 1 -- 172.21.15.155:0/3465488857 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fcf04104490 con 0x7fcf040fbaf0 2023-12-16T05:53:41.378 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.375+0000 7fcefb7fe700 1 -- 172.21.15.155:0/3465488857 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) v1 ==== 74+0+130 (secure 0 0 0) 0x7fcef4058740 con 0x7fcf040fbaf0 2023-12-16T05:53:41.378 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:53:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.376+0000 7fcf097c1700 1 -- 172.21.15.155:0/3465488857 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fcef0068f60 msgr2=0x7fcef006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.376+0000 7fcf097c1700 1 --2- 172.21.15.155:0/3465488857 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fcef0068f60 0x7fcef006b410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fceec009fd0 tx=0x7fceec00b040 comp rx=0 tx=0).stop 2023-12-16T05:53:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.377+0000 7fcf097c1700 1 -- 172.21.15.155:0/3465488857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf040fbaf0 msgr2=0x7fcf04110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.377+0000 7fcf097c1700 1 --2- 172.21.15.155:0/3465488857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf040fbaf0 0x7fcf04110210 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcef4000c00 tx=0x7fcef4009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.377+0000 7fcf097c1700 1 -- 172.21.15.155:0/3465488857 shutdown_connections 2023-12-16T05:53:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.377+0000 7fcf097c1700 1 --2- 172.21.15.155:0/3465488857 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fcef0068f60 0x7fcef006b410 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.377+0000 7fcf097c1700 1 --2- 172.21.15.155:0/3465488857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf040fbaf0 0x7fcf04110210 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.377+0000 7fcf097c1700 1 --2- 172.21.15.155:0/3465488857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf040fcd00 0x7fcf04112760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.377+0000 7fcf097c1700 1 -- 172.21.15.155:0/3465488857 >> 172.21.15.155:0/3465488857 conn(0x7fcf040f7190 msgr2=0x7fcf040fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.377+0000 7fcf097c1700 1 -- 172.21.15.155:0/3465488857 shutdown_connections 2023-12-16T05:53:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:41.377+0000 7fcf097c1700 1 -- 172.21.15.155:0/3465488857 wait complete. 2023-12-16T05:53:41.669 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:41 smithi155 ceph-mon[112451]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-12-16T05:53:41.669 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:41 smithi155 ceph-mon[112451]: osdmap e36: 6 total, 5 up, 6 in 2023-12-16T05:53:41.669 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:41 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T05:53:41.669 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:41 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T05:53:41.669 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:41 smithi155 ceph-mon[112451]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T05:53:41.682 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:41 smithi156 ceph-mon[121001]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-12-16T05:53:41.682 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:41 smithi156 ceph-mon[121001]: osdmap e36: 6 total, 5 up, 6 in 2023-12-16T05:53:41.682 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:41 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T05:53:41.682 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:41 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T05:53:41.682 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:41 smithi156 ceph-mon[121001]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T05:53:41.770 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":37,"num_osds":6,"num_up_osds":6,"osd_up_since":1702706021,"num_in_osds":6,"osd_in_since":1702706005,"num_remapped_pgs":0} 2023-12-16T05:53:41.770 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-16T05:53:42.031 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:53:42.491 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:42 smithi155 ceph-mon[112451]: purged_snaps scrub starts 2023-12-16T05:53:42.491 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:42 smithi155 ceph-mon[112451]: purged_snaps scrub ok 2023-12-16T05:53:42.491 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:42 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T05:53:42.491 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:42 smithi155 ceph-mon[112451]: osd.5 [v2:172.21.15.156:6816/81941755,v1:172.21.15.156:6817/81941755] boot 2023-12-16T05:53:42.491 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:42 smithi155 ceph-mon[112451]: osdmap e37: 6 total, 6 up, 6 in 2023-12-16T05:53:42.492 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:42 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T05:53:42.492 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:42 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/3465488857' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-16T05:53:42.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:42 smithi156 ceph-mon[121001]: purged_snaps scrub starts 2023-12-16T05:53:42.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:42 smithi156 ceph-mon[121001]: purged_snaps scrub ok 2023-12-16T05:53:42.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:42 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T05:53:42.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:42 smithi156 ceph-mon[121001]: osd.5 [v2:172.21.15.156:6816/81941755,v1:172.21.15.156:6817/81941755] boot 2023-12-16T05:53:42.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:42 smithi156 ceph-mon[121001]: osdmap e37: 6 total, 6 up, 6 in 2023-12-16T05:53:42.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:42 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T05:53:42.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:42 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/3465488857' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-16T05:53:43.061 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.057+0000 7f78849f1700 1 -- 172.21.15.155:0/501864834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78800fbb40 msgr2=0x7f78800fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:43.062 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.057+0000 7f78849f1700 1 --2- 172.21.15.155:0/501864834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78800fbb40 0x7f78800fbfb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7870004940 tx=0x7f7870009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:43.062 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.057+0000 7f78849f1700 1 -- 172.21.15.155:0/501864834 shutdown_connections 2023-12-16T05:53:43.062 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.057+0000 7f78849f1700 1 --2- 172.21.15.155:0/501864834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78800fbb40 0x7f78800fbfb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:43.062 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.057+0000 7f78849f1700 1 --2- 172.21.15.155:0/501864834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7880101b00 0x7f7880101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:43.062 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.057+0000 7f78849f1700 1 -- 172.21.15.155:0/501864834 >> 172.21.15.155:0/501864834 conn(0x7f78800f76c0 msgr2=0x7f78800f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:43.062 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.057+0000 7f78849f1700 1 -- 172.21.15.155:0/501864834 shutdown_connections 2023-12-16T05:53:43.062 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.057+0000 7f78849f1700 1 -- 172.21.15.155:0/501864834 wait complete. 2023-12-16T05:53:43.062 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.057+0000 7f78849f1700 1 Processor -- start 2023-12-16T05:53:43.062 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.058+0000 7f78849f1700 1 -- start start 2023-12-16T05:53:43.062 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.058+0000 7f78849f1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78800fbb40 0x7f7880113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:43.062 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.058+0000 7f78849f1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7880101b00 0x7f7880113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:43.063 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.058+0000 7f78849f1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7880114220 con 0x7f7880101b00 2023-12-16T05:53:43.063 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.058+0000 7f78849f1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788010d510 con 0x7f78800fbb40 2023-12-16T05:53:43.063 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.058+0000 7f787dd9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7880101b00 0x7f7880113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:43.063 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.058+0000 7f787dd9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7880101b00 0x7f7880113bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41068/0 (socket says 172.21.15.155:41068) 2023-12-16T05:53:43.063 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.058+0000 7f787dd9b700 1 -- 172.21.15.155:0/1749984983 learned_addr learned my addr 172.21.15.155:0/1749984983 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:53:43.063 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.058+0000 7f787e59c700 1 --2- 172.21.15.155:0/1749984983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78800fbb40 0x7f7880113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:43.063 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.058+0000 7f787dd9b700 1 -- 172.21.15.155:0/1749984983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78800fbb40 msgr2=0x7f7880113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:43.063 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.058+0000 7f787dd9b700 1 --2- 172.21.15.155:0/1749984983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78800fbb40 0x7f7880113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:43.063 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.058+0000 7f787dd9b700 1 -- 172.21.15.155:0/1749984983 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7870005040 con 0x7f7880101b00 2023-12-16T05:53:43.063 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.058+0000 7f787dd9b700 1 --2- 172.21.15.155:0/1749984983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7880101b00 0x7f7880113bd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7870009180 tx=0x7f7870009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:43.063 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.058+0000 7f786effd700 1 -- 172.21.15.155:0/1749984983 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f787000e040 con 0x7f7880101b00 2023-12-16T05:53:43.063 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.058+0000 7f786effd700 1 -- 172.21.15.155:0/1749984983 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7870004290 con 0x7f7880101b00 2023-12-16T05:53:43.063 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.058+0000 7f78849f1700 1 -- 172.21.15.155:0/1749984983 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788010d790 con 0x7f7880101b00 2023-12-16T05:53:43.063 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.058+0000 7f786effd700 1 -- 172.21.15.155:0/1749984983 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f787001c3f0 con 0x7f7880101b00 2023-12-16T05:53:43.063 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.059+0000 7f78849f1700 1 -- 172.21.15.155:0/1749984983 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788010dcd0 con 0x7f7880101b00 2023-12-16T05:53:43.064 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.059+0000 7f78849f1700 1 -- 172.21.15.155:0/1749984983 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7880113320 con 0x7f7880101b00 2023-12-16T05:53:43.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.060+0000 7f786effd700 1 -- 172.21.15.155:0/1749984983 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f7870013420 con 0x7f7880101b00 2023-12-16T05:53:43.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.060+0000 7f786effd700 1 --2- 172.21.15.155:0/1749984983 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7868068f60 0x7f786806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:43.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.060+0000 7f786effd700 1 -- 172.21.15.155:0/1749984983 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7870087ca0 con 0x7f7880101b00 2023-12-16T05:53:43.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.060+0000 7f787e59c700 1 --2- 172.21.15.155:0/1749984983 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7868068f60 0x7f786806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:43.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.061+0000 7f787e59c700 1 --2- 172.21.15.155:0/1749984983 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7868068f60 0x7f786806b410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7874007fd0 tx=0x7f7874009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:43.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.065+0000 7f786effd700 1 -- 172.21.15.155:0/1749984983 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f787008c070 con 0x7f7880101b00 2023-12-16T05:53:43.253 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.250+0000 7f78849f1700 1 -- 172.21.15.155:0/1749984983 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f788010ec30 con 0x7f7880101b00 2023-12-16T05:53:43.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.251+0000 7f786effd700 1 -- 172.21.15.155:0/1749984983 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11121 (secure 0 0 0) 0x7f7870058090 con 0x7f7880101b00 2023-12-16T05:53:43.254 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:53:43.254 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":38,"fsid":"d344784e-9bd6-11ee-95a5-87774f69a715","created":"2023-12-16T05:49:39.805571+0000","modified":"2023-12-16T05:53:42.327827+0000","last_up_change":"2023-12-16T05:53:41.318211+0000","last_in_change":"2023-12-16T05:53:25.098236+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T05:52:48.744538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"7f9fdb2e-99ba-4298-973a-70c36ba678ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1483763675},{"type":"v1","addr":"172.21.15.155:6803","nonce":1483763675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1483763675},{"type":"v1","addr":"172.21.15.155:6805","nonce":1483763675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1483763675},{"type":"v1","addr":"172.21.15.155:6809","nonce":1483763675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1483763675},{"type":"v1","addr":"172.21.15.155:6807","nonce":1483763675}]},"public_addr":"172.21.15.155:6803/1483763675","cluster_addr":"172.21.15.155:6805/1483763675","heartbeat_back_addr":"172.21.15.155:6809/1483763675","heartbeat_front_addr":"172.21.15.155:6807/1483763675","state":["exists","up"]},{"osd":1,"uuid":"6b941218-a4cb-423c-82a7-4f5825269d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3291965512},{"type":"v1","addr":"172.21.15.155:6811","nonce":3291965512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3291965512},{"type":"v1","addr":"172.21.15.155:6813","nonce":3291965512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3291965512},{"type":"v1","addr":"172.21.15.155:6817","nonce":3291965512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3291965512},{"type":"v1","addr":"172.21.15.155:6815","nonce":3291965512}]},"public_addr":"172.21.15.155:6811/3291965512","cluster_addr":"172.21.15.155:6813/3291965512","heartbeat_back_addr":"172.21.15.155:6817/3291965512","heartbeat_front_addr":"172.21.15.155:6815/3291965512","state":["exists","up"]},{"osd":2,"uuid":"ea6b309e-b3ba-4e72-8977-9d4915cb68ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3010388644},{"type":"v1","addr":"172.21.15.155:6819","nonce":3010388644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3010388644},{"type":"v1","addr":"172.21.15.155:6821","nonce":3010388644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3010388644},{"type":"v1","addr":"172.21.15.155:6825","nonce":3010388644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3010388644},{"type":"v1","addr":"172.21.15.155:6823","nonce":3010388644}]},"public_addr":"172.21.15.155:6819/3010388644","cluster_addr":"172.21.15.155:6821/3010388644","heartbeat_back_addr":"172.21.15.155:6825/3010388644","heartbeat_front_addr":"172.21.15.155:6823/3010388644","state":["exists","up"]},{"osd":3,"uuid":"ae32e77a-1c79-47d0-802b-ff70099c3126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1620466967},{"type":"v1","addr":"172.21.15.156:6801","nonce":1620466967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1620466967},{"type":"v1","addr":"172.21.15.156:6803","nonce":1620466967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1620466967},{"type":"v1","addr":"172.21.15.156:6807","nonce":1620466967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1620466967},{"type":"v1","addr":"172.21.15.156:6805","nonce":1620466967}]},"public_addr":"172.21.15.156:6801/1620466967","cluster_addr":"172.21.15.156:6803/1620466967","heartbeat_back_addr":"172.21.15.156:6807/1620466967","heartbeat_front_addr":"172.21.15.156:6805/1620466967","state":["exists","up"]},{"osd":4,"uuid":"f61396ce-8004-49ee-aa87-98c96fc7d35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2759834290},{"type":"v1","addr":"172.21.15.156:6809","nonce":2759834290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2759834290},{"type":"v1","addr":"172.21.15.156:6811","nonce":2759834290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2759834290},{"type":"v1","addr":"172.21.15.156:6815","nonce":2759834290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2759834290},{"type":"v1","addr":"172.21.15.156:6813","nonce":2759834290}]},"public_addr":"172.21.15.156:6809/2759834290","cluster_addr":"172.21.15.156:6811/2759834290","heartbeat_back_addr":"172.21.15.156:6815/2759834290","heartbeat_front_addr":"172.21.15.156:6813/2759834290","state":["exists","up"]},{"osd":5,"uuid":"f58d8355-9752-4ea8-b051-93a14b7f1091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":81941755},{"type":"v1","addr":"172.21.15.156:6817","nonce":81941755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":81941755},{"type":"v1","addr":"172.21.15.156:6819","nonce":81941755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":81941755},{"type":"v1","addr":"172.21.15.156:6823","nonce":81941755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":81941755},{"type":"v1","addr":"172.21.15.156:6821","nonce":81941755}]},"public_addr":"172.21.15.156:6817/81941755","cluster_addr":"172.21.15.156:6819/81941755","heartbeat_back_addr":"172.21.15.156:6823/81941755","heartbeat_front_addr":"172.21.15.156:6821/81941755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:52:07.086653+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:52:26.710074+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:52:46.466497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:53:04.226908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:53:21.851522+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:53:39.341732+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:6800/2821498015":"2023-12-17T05:51:16.444340+0000","172.21.15.155:0/4153694391":"2023-12-17T05:51:16.444340+0000","172.21.15.155:6801/2821498015":"2023-12-17T05:51:16.444340+0000","172.21.15.155:0/2967908456":"2023-12-17T05:51:16.444340+0000","172.21.15.155:6800/1287353594":"2023-12-17T05:50:28.085105+0000","172.21.15.155:0/2867995431":"2023-12-17T05:50:28.085105+0000","172.21.15.155:0/669103637":"2023-12-17T05:50:28.085105+0000","172.21.15.155:6801/291007537":"2023-12-17T05:50:04.441832+0000","172.21.15.155:6800/291007537":"2023-12-17T05:50:04.441832+0000","172.21.15.155:0/3953524373":"2023-12-17T05:50:04.441832+0000","172.21.15.155:6801/1287353594":"2023-12-17T05:50:28.085105+0000","172.21.15.155:0/3422132632":"2023-12-17T05:50:04.441832+0000","172.21.15.155:0/2787224311":"2023-12-17T05:50:04.441832+0000","172.21.15.155:0/2339263885":"2023-12-17T05:51:16.444340+0000","172.21.15.155:0/3544820495":"2023-12-17T05:50:28.085105+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T05:53:43.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.253+0000 7f78849f1700 1 -- 172.21.15.155:0/1749984983 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7868068f60 msgr2=0x7f786806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:43.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.253+0000 7f78849f1700 1 --2- 172.21.15.155:0/1749984983 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7868068f60 0x7f786806b410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7874007fd0 tx=0x7f7874009040 comp rx=0 tx=0).stop 2023-12-16T05:53:43.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.253+0000 7f78849f1700 1 -- 172.21.15.155:0/1749984983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7880101b00 msgr2=0x7f7880113bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:43.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.253+0000 7f78849f1700 1 --2- 172.21.15.155:0/1749984983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7880101b00 0x7f7880113bd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7870009180 tx=0x7f7870009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:43.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.253+0000 7f78849f1700 1 -- 172.21.15.155:0/1749984983 shutdown_connections 2023-12-16T05:53:43.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.253+0000 7f78849f1700 1 --2- 172.21.15.155:0/1749984983 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7868068f60 0x7f786806b410 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:43.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.253+0000 7f78849f1700 1 --2- 172.21.15.155:0/1749984983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78800fbb40 0x7f7880113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:43.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.253+0000 7f78849f1700 1 --2- 172.21.15.155:0/1749984983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7880101b00 0x7f7880113bd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:43.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.253+0000 7f78849f1700 1 -- 172.21.15.155:0/1749984983 >> 172.21.15.155:0/1749984983 conn(0x7f78800f76c0 msgr2=0x7f7880065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:43.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.253+0000 7f78849f1700 1 -- 172.21.15.155:0/1749984983 shutdown_connections 2023-12-16T05:53:43.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:43.253+0000 7f78849f1700 1 -- 172.21.15.155:0/1749984983 wait complete. 2023-12-16T05:53:43.568 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:43 smithi155 ceph-mon[112451]: osdmap e38: 6 total, 6 up, 6 in 2023-12-16T05:53:43.569 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:43 smithi155 ceph-mon[112451]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:53:43.569 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:43 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/1749984983' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T05:53:43.603 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T05:52:48.744538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-16T05:53:43.603 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph osd pool get .mgr pg_num 2023-12-16T05:53:43.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:43 smithi156 ceph-mon[121001]: osdmap e38: 6 total, 6 up, 6 in 2023-12-16T05:53:43.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:43 smithi156 ceph-mon[121001]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:53:43.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:43 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/1749984983' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T05:53:43.862 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:53:44.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.893+0000 7f2b31cda700 1 -- 172.21.15.155:0/2271960301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b2c102bf0 msgr2=0x7f2b2c102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:44.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.893+0000 7f2b31cda700 1 --2- 172.21.15.155:0/2271960301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b2c102bf0 0x7f2b2c102fc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2b20004940 tx=0x7f2b20009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:44.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.893+0000 7f2b31cda700 1 -- 172.21.15.155:0/2271960301 shutdown_connections 2023-12-16T05:53:44.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.893+0000 7f2b31cda700 1 --2- 172.21.15.155:0/2271960301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b2c103590 0x7f2b2c0fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:44.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.893+0000 7f2b31cda700 1 --2- 172.21.15.155:0/2271960301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b2c102bf0 0x7f2b2c102fc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:44.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.893+0000 7f2b31cda700 1 -- 172.21.15.155:0/2271960301 >> 172.21.15.155:0/2271960301 conn(0x7f2b2c0f87a0 msgr2=0x7f2b2c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:44.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.893+0000 7f2b31cda700 1 -- 172.21.15.155:0/2271960301 shutdown_connections 2023-12-16T05:53:44.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.893+0000 7f2b31cda700 1 -- 172.21.15.155:0/2271960301 wait complete. 2023-12-16T05:53:44.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.893+0000 7f2b31cda700 1 Processor -- start 2023-12-16T05:53:44.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.893+0000 7f2b31cda700 1 -- start start 2023-12-16T05:53:44.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.894+0000 7f2b31cda700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b2c102bf0 0x7f2b2c113650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:44.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.894+0000 7f2b31cda700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b2c103590 0x7f2b2c113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:44.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.894+0000 7f2b31cda700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c114220 con 0x7f2b2c103590 2023-12-16T05:53:44.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.894+0000 7f2b31cda700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c10d510 con 0x7f2b2c102bf0 2023-12-16T05:53:44.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.894+0000 7f2b2affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b2c103590 0x7f2b2c113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:44.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.894+0000 7f2b2affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b2c103590 0x7f2b2c113bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41082/0 (socket says 172.21.15.155:41082) 2023-12-16T05:53:44.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.894+0000 7f2b2affd700 1 -- 172.21.15.155:0/1021319032 learned_addr learned my addr 172.21.15.155:0/1021319032 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:53:44.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.894+0000 7f2b2b7fe700 1 --2- 172.21.15.155:0/1021319032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b2c102bf0 0x7f2b2c113650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:44.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.894+0000 7f2b2affd700 1 -- 172.21.15.155:0/1021319032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b2c102bf0 msgr2=0x7f2b2c113650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:44.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.894+0000 7f2b2affd700 1 --2- 172.21.15.155:0/1021319032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b2c102bf0 0x7f2b2c113650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:44.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.894+0000 7f2b2affd700 1 -- 172.21.15.155:0/1021319032 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b20005040 con 0x7f2b2c103590 2023-12-16T05:53:44.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.894+0000 7f2b2affd700 1 --2- 172.21.15.155:0/1021319032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b2c103590 0x7f2b2c113bd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00c890 tx=0x7f2b1c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:44.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.894+0000 7f2b13fff700 1 -- 172.21.15.155:0/1021319032 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b1c00a700 con 0x7f2b2c103590 2023-12-16T05:53:44.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.894+0000 7f2b13fff700 1 -- 172.21.15.155:0/1021319032 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2b1c00ad10 con 0x7f2b2c103590 2023-12-16T05:53:44.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.894+0000 7f2b31cda700 1 -- 172.21.15.155:0/1021319032 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2c10d7a0 con 0x7f2b2c103590 2023-12-16T05:53:44.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.894+0000 7f2b13fff700 1 -- 172.21.15.155:0/1021319032 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b1c012e70 con 0x7f2b2c103590 2023-12-16T05:53:44.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.894+0000 7f2b31cda700 1 -- 172.21.15.155:0/1021319032 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2c10dce0 con 0x7f2b2c103590 2023-12-16T05:53:44.900 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.895+0000 7f2b31cda700 1 -- 172.21.15.155:0/1021319032 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2c0fff00 con 0x7f2b2c103590 2023-12-16T05:53:44.900 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.896+0000 7f2b13fff700 1 -- 172.21.15.155:0/1021319032 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f2b1c00a860 con 0x7f2b2c103590 2023-12-16T05:53:44.900 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.896+0000 7f2b13fff700 1 --2- 172.21.15.155:0/1021319032 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2b14068f60 0x7f2b1406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:44.901 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.896+0000 7f2b13fff700 1 -- 172.21.15.155:0/1021319032 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2b1c086b80 con 0x7f2b2c103590 2023-12-16T05:53:44.901 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.896+0000 7f2b2b7fe700 1 --2- 172.21.15.155:0/1021319032 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2b14068f60 0x7f2b1406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:44.901 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.897+0000 7f2b2b7fe700 1 --2- 172.21.15.155:0/1021319032 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2b14068f60 0x7f2b1406b410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2b20004f90 tx=0x7f2b20009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:44.903 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:44.901+0000 7f2b13fff700 1 -- 172.21.15.155:0/1021319032 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2b1c056d80 con 0x7f2b2c103590 2023-12-16T05:53:45.095 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:45.091+0000 7f2b31cda700 1 -- 172.21.15.155:0/1021319032 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2b2c04bb80 con 0x7f2b2c103590 2023-12-16T05:53:45.095 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:45.091+0000 7f2b13fff700 1 -- 172.21.15.155:0/1021319032 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2b1c056910 con 0x7f2b2c103590 2023-12-16T05:53:45.095 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2023-12-16T05:53:45.097 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:45.094+0000 7f2b31cda700 1 -- 172.21.15.155:0/1021319032 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2b14068f60 msgr2=0x7f2b1406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:45.097 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:45.094+0000 7f2b31cda700 1 --2- 172.21.15.155:0/1021319032 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2b14068f60 0x7f2b1406b410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2b20004f90 tx=0x7f2b20009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:45.097 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:45.094+0000 7f2b31cda700 1 -- 172.21.15.155:0/1021319032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b2c103590 msgr2=0x7f2b2c113bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:45.097 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:45.094+0000 7f2b31cda700 1 --2- 172.21.15.155:0/1021319032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b2c103590 0x7f2b2c113bd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00c890 tx=0x7f2b1c0044c0 comp rx=0 tx=0).stop 2023-12-16T05:53:45.097 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:45.094+0000 7f2b31cda700 1 -- 172.21.15.155:0/1021319032 shutdown_connections 2023-12-16T05:53:45.097 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:45.094+0000 7f2b31cda700 1 --2- 172.21.15.155:0/1021319032 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2b14068f60 0x7f2b1406b410 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:45.097 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:45.094+0000 7f2b31cda700 1 --2- 172.21.15.155:0/1021319032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b2c102bf0 0x7f2b2c113650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:45.097 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:45.094+0000 7f2b31cda700 1 --2- 172.21.15.155:0/1021319032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b2c103590 0x7f2b2c113bd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:45.098 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:45.094+0000 7f2b31cda700 1 -- 172.21.15.155:0/1021319032 >> 172.21.15.155:0/1021319032 conn(0x7f2b2c0f87a0 msgr2=0x7f2b2c0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:45.098 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:45.094+0000 7f2b31cda700 1 -- 172.21.15.155:0/1021319032 shutdown_connections 2023-12-16T05:53:45.098 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:45.094+0000 7f2b31cda700 1 -- 172.21.15.155:0/1021319032 wait complete. 2023-12-16T05:53:45.486 INFO:tasks.cephadm:Setting up client nodes... 2023-12-16T05:53:45.487 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-16T05:53:45.749 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:53:45.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:45 smithi155 ceph-mon[112451]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:53:45.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:45 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/1021319032' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T05:53:45.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:45 smithi156 ceph-mon[121001]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:53:45.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:45 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/1021319032' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T05:53:46.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.777+0000 7f0c58200700 1 -- 172.21.15.155:0/231132495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c500fbaf0 msgr2=0x7f0c500fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:46.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.777+0000 7f0c58200700 1 --2- 172.21.15.155:0/231132495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c500fbaf0 0x7f0c500fbf00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0c48004940 tx=0x7f0c48009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:46.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.777+0000 7f0c58200700 1 -- 172.21.15.155:0/231132495 shutdown_connections 2023-12-16T05:53:46.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.777+0000 7f0c58200700 1 --2- 172.21.15.155:0/231132495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c500fcd00 0x7f0c500fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:46.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.777+0000 7f0c58200700 1 --2- 172.21.15.155:0/231132495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c500fbaf0 0x7f0c500fbf00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:46.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.777+0000 7f0c58200700 1 -- 172.21.15.155:0/231132495 >> 172.21.15.155:0/231132495 conn(0x7f0c500f7190 msgr2=0x7f0c500f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:46.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.777+0000 7f0c58200700 1 -- 172.21.15.155:0/231132495 shutdown_connections 2023-12-16T05:53:46.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.777+0000 7f0c58200700 1 -- 172.21.15.155:0/231132495 wait complete. 2023-12-16T05:53:46.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.778+0000 7f0c58200700 1 Processor -- start 2023-12-16T05:53:46.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.778+0000 7f0c58200700 1 -- start start 2023-12-16T05:53:46.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.778+0000 7f0c58200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c500fbaf0 0x7f0c50110300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:46.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.778+0000 7f0c58200700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c500fcd00 0x7f0c50112850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:46.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.778+0000 7f0c58200700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c500661a0 con 0x7f0c500fcd00 2023-12-16T05:53:46.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.778+0000 7f0c58200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c500662e0 con 0x7f0c500fbaf0 2023-12-16T05:53:46.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.778+0000 7f0c5579b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c500fcd00 0x7f0c50112850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:46.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.778+0000 7f0c5579b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c500fcd00 0x7f0c50112850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:51010/0 (socket says 172.21.15.155:51010) 2023-12-16T05:53:46.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.778+0000 7f0c5579b700 1 -- 172.21.15.155:0/3813377764 learned_addr learned my addr 172.21.15.155:0/3813377764 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:53:46.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.778+0000 7f0c55f9c700 1 --2- 172.21.15.155:0/3813377764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c500fbaf0 0x7f0c50110300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:46.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.778+0000 7f0c5579b700 1 -- 172.21.15.155:0/3813377764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c500fbaf0 msgr2=0x7f0c50110300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:46.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.778+0000 7f0c5579b700 1 --2- 172.21.15.155:0/3813377764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c500fbaf0 0x7f0c50110300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:46.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.778+0000 7f0c5579b700 1 -- 172.21.15.155:0/3813377764 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c48005040 con 0x7f0c500fcd00 2023-12-16T05:53:46.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.778+0000 7f0c5579b700 1 --2- 172.21.15.155:0/3813377764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c500fcd00 0x7f0c50112850 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400b790 tx=0x7f0c44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:46.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.778+0000 7f0c4e7fc700 1 -- 172.21.15.155:0/3813377764 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c4400f770 con 0x7f0c500fcd00 2023-12-16T05:53:46.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.778+0000 7f0c4e7fc700 1 -- 172.21.15.155:0/3813377764 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0c4400fd80 con 0x7f0c500fcd00 2023-12-16T05:53:46.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.779+0000 7f0c58200700 1 -- 172.21.15.155:0/3813377764 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c50112ee0 con 0x7f0c500fcd00 2023-12-16T05:53:46.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.779+0000 7f0c4e7fc700 1 -- 172.21.15.155:0/3813377764 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c44010e80 con 0x7f0c500fcd00 2023-12-16T05:53:46.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.779+0000 7f0c58200700 1 -- 172.21.15.155:0/3813377764 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c501133f0 con 0x7f0c500fcd00 2023-12-16T05:53:46.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.779+0000 7f0c58200700 1 -- 172.21.15.155:0/3813377764 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5004bb80 con 0x7f0c500fcd00 2023-12-16T05:53:46.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.780+0000 7f0c4e7fc700 1 -- 172.21.15.155:0/3813377764 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f0c440106b0 con 0x7f0c500fcd00 2023-12-16T05:53:46.785 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.780+0000 7f0c4e7fc700 1 --2- 172.21.15.155:0/3813377764 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0c38068f60 0x7f0c3806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:46.785 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.780+0000 7f0c4e7fc700 1 -- 172.21.15.155:0/3813377764 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0c44086970 con 0x7f0c500fcd00 2023-12-16T05:53:46.785 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.780+0000 7f0c55f9c700 1 --2- 172.21.15.155:0/3813377764 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0c38068f60 0x7f0c3806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:46.785 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.781+0000 7f0c55f9c700 1 --2- 172.21.15.155:0/3813377764 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0c38068f60 0x7f0c3806b410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0c48004890 tx=0x7f0c48009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:46.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:46.785+0000 7f0c4e7fc700 1 -- 172.21.15.155:0/3813377764 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0c44053220 con 0x7f0c500fcd00 2023-12-16T05:53:46.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:46 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:53:46.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:46 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:53:47.045 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:47.042+0000 7f0c58200700 1 -- 172.21.15.155:0/3813377764 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f0c50104510 con 0x7f0c500fcd00 2023-12-16T05:53:47.049 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:47.046+0000 7f0c4e7fc700 1 -- 172.21.15.155:0/3813377764 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f0c44056840 con 0x7f0c500fcd00 2023-12-16T05:53:47.049 INFO:teuthology.orchestra.run.smithi155.stdout:[client.0] 2023-12-16T05:53:47.050 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBrO31lkBymAhAA4KFu4yMgh44m+SynKd3WfQ== 2023-12-16T05:53:47.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:47.048+0000 7f0c58200700 1 -- 172.21.15.155:0/3813377764 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0c38068f60 msgr2=0x7f0c3806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:47.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:47.048+0000 7f0c58200700 1 --2- 172.21.15.155:0/3813377764 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0c38068f60 0x7f0c3806b410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0c48004890 tx=0x7f0c48009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:47.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:47.049+0000 7f0c58200700 1 -- 172.21.15.155:0/3813377764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c500fcd00 msgr2=0x7f0c50112850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:47.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:47.049+0000 7f0c58200700 1 --2- 172.21.15.155:0/3813377764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c500fcd00 0x7f0c50112850 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400b790 tx=0x7f0c44009250 comp rx=0 tx=0).stop 2023-12-16T05:53:47.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:47.049+0000 7f0c58200700 1 -- 172.21.15.155:0/3813377764 shutdown_connections 2023-12-16T05:53:47.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:47.049+0000 7f0c58200700 1 --2- 172.21.15.155:0/3813377764 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0c38068f60 0x7f0c3806b410 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:47.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:47.049+0000 7f0c58200700 1 --2- 172.21.15.155:0/3813377764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c500fbaf0 0x7f0c50110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:47.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:47.049+0000 7f0c58200700 1 --2- 172.21.15.155:0/3813377764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c500fcd00 0x7f0c50112850 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:47.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:47.049+0000 7f0c58200700 1 -- 172.21.15.155:0/3813377764 >> 172.21.15.155:0/3813377764 conn(0x7f0c500f7190 msgr2=0x7f0c500fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:47.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:47.049+0000 7f0c58200700 1 -- 172.21.15.155:0/3813377764 shutdown_connections 2023-12-16T05:53:47.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:47.049+0000 7f0c58200700 1 -- 172.21.15.155:0/3813377764 wait complete. 2023-12-16T05:53:47.420 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-16T05:53:47.420 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-12-16T05:53:47.420 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-16T05:53:47.460 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-16T05:53:47.738 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi156/config 2023-12-16T05:53:47.747 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:47 smithi155 ceph-mon[112451]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:53:47.747 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:47 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/3813377764' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T05:53:47.747 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:47 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/3813377764' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-16T05:53:47.843 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:47 smithi156 ceph-mon[121001]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:53:47.844 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:47 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/3813377764' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T05:53:47.844 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:47 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/3813377764' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-16T05:53:48.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.731+0000 7fdaabcf4700 1 -- 172.21.15.156:0/1312061950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdaa40fbaf0 msgr2=0x7fdaa40fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:48.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.731+0000 7fdaabcf4700 1 --2- 172.21.15.156:0/1312061950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdaa40fbaf0 0x7fdaa40fbf00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fda94004940 tx=0x7fda94009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:48.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.731+0000 7fdaabcf4700 1 -- 172.21.15.156:0/1312061950 shutdown_connections 2023-12-16T05:53:48.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.731+0000 7fdaabcf4700 1 --2- 172.21.15.156:0/1312061950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaa40fcd00 0x7fdaa40fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:48.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.731+0000 7fdaabcf4700 1 --2- 172.21.15.156:0/1312061950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdaa40fbaf0 0x7fdaa40fbf00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:48.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.731+0000 7fdaabcf4700 1 -- 172.21.15.156:0/1312061950 >> 172.21.15.156:0/1312061950 conn(0x7fdaa40f7190 msgr2=0x7fdaa40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:48.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.731+0000 7fdaabcf4700 1 -- 172.21.15.156:0/1312061950 shutdown_connections 2023-12-16T05:53:48.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.731+0000 7fdaabcf4700 1 -- 172.21.15.156:0/1312061950 wait complete. 2023-12-16T05:53:48.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.732+0000 7fdaabcf4700 1 Processor -- start 2023-12-16T05:53:48.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.732+0000 7fdaabcf4700 1 -- start start 2023-12-16T05:53:48.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.732+0000 7fdaabcf4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdaa40fbaf0 0x7fdaa410d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:48.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.732+0000 7fdaabcf4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaa40fcd00 0x7fdaa410dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:48.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.732+0000 7fdaabcf4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa410e0d0 con 0x7fdaa40fcd00 2023-12-16T05:53:48.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.732+0000 7fdaabcf4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa410e970 con 0x7fdaa40fbaf0 2023-12-16T05:53:48.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.732+0000 7fdaa9a90700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdaa40fbaf0 0x7fdaa410d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:48.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.732+0000 7fdaa9a90700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdaa40fbaf0 0x7fdaa410d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36620/0 (socket says 172.21.15.156:36620) 2023-12-16T05:53:48.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.732+0000 7fdaa9a90700 1 -- 172.21.15.156:0/1961812975 learned_addr learned my addr 172.21.15.156:0/1961812975 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-12-16T05:53:48.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.732+0000 7fdaa9a90700 1 -- 172.21.15.156:0/1961812975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaa40fcd00 msgr2=0x7fdaa410dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:48.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.732+0000 7fdaa928f700 1 --2- 172.21.15.156:0/1961812975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaa40fcd00 0x7fdaa410dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:48.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.732+0000 7fdaa9a90700 1 --2- 172.21.15.156:0/1961812975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaa40fcd00 0x7fdaa410dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:48.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.732+0000 7fdaa9a90700 1 -- 172.21.15.156:0/1961812975 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda94005040 con 0x7fdaa40fbaf0 2023-12-16T05:53:48.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.732+0000 7fdaa9a90700 1 --2- 172.21.15.156:0/1961812975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdaa40fbaf0 0x7fdaa410d590 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fda94004f90 tx=0x7fda94009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:48.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.733+0000 7fda9a7fc700 1 -- 172.21.15.156:0/1961812975 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda9400e040 con 0x7fdaa40fbaf0 2023-12-16T05:53:48.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.733+0000 7fda9a7fc700 1 -- 172.21.15.156:0/1961812975 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fda9400bcd0 con 0x7fdaa40fbaf0 2023-12-16T05:53:48.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.733+0000 7fdaabcf4700 1 -- 172.21.15.156:0/1961812975 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa410ebf0 con 0x7fdaa40fbaf0 2023-12-16T05:53:48.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.733+0000 7fda9a7fc700 1 -- 172.21.15.156:0/1961812975 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda9401c630 con 0x7fdaa40fbaf0 2023-12-16T05:53:48.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.733+0000 7fdaabcf4700 1 -- 172.21.15.156:0/1961812975 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa410f130 con 0x7fdaa40fbaf0 2023-12-16T05:53:48.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.734+0000 7fdaabcf4700 1 -- 172.21.15.156:0/1961812975 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa404bb80 con 0x7fdaa40fbaf0 2023-12-16T05:53:48.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.734+0000 7fda9a7fc700 1 -- 172.21.15.156:0/1961812975 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fda94013960 con 0x7fdaa40fbaf0 2023-12-16T05:53:48.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.734+0000 7fda9a7fc700 1 --2- 172.21.15.156:0/1961812975 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fda90068f60 0x7fda9006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:48.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.734+0000 7fda9a7fc700 1 -- 172.21.15.156:0/1961812975 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fda94087f00 con 0x7fdaa40fbaf0 2023-12-16T05:53:48.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.735+0000 7fdaa928f700 1 --2- 172.21.15.156:0/1961812975 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fda90068f60 0x7fda9006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:48.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.735+0000 7fdaa928f700 1 --2- 172.21.15.156:0/1961812975 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fda90068f60 0x7fda9006b410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0004c40 tx=0x7fdaa0009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:48.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.739+0000 7fda9a7fc700 1 -- 172.21.15.156:0/1961812975 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fda940581a0 con 0x7fdaa40fbaf0 2023-12-16T05:53:48.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.992+0000 7fdaabcf4700 1 -- 172.21.15.156:0/1961812975 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fdaa4104490 con 0x7fdaa40fbaf0 2023-12-16T05:53:49.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.997+0000 7fda9a7fc700 1 -- 172.21.15.156:0/1961812975 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7fda94057d30 con 0x7fdaa40fbaf0 2023-12-16T05:53:49.003 INFO:teuthology.orchestra.run.smithi156.stdout:[client.1] 2023-12-16T05:53:49.004 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBsO31lpAlIOxAAoHagdwr3zzOgyMcPhuK6zg== 2023-12-16T05:53:49.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.999+0000 7fdaabcf4700 1 -- 172.21.15.156:0/1961812975 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fda90068f60 msgr2=0x7fda9006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:49.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.999+0000 7fdaabcf4700 1 --2- 172.21.15.156:0/1961812975 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fda90068f60 0x7fda9006b410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0004c40 tx=0x7fdaa0009040 comp rx=0 tx=0).stop 2023-12-16T05:53:49.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.999+0000 7fdaabcf4700 1 -- 172.21.15.156:0/1961812975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdaa40fbaf0 msgr2=0x7fdaa410d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:49.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.999+0000 7fdaabcf4700 1 --2- 172.21.15.156:0/1961812975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdaa40fbaf0 0x7fdaa410d590 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fda94004f90 tx=0x7fda94009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:49.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.999+0000 7fdaabcf4700 1 -- 172.21.15.156:0/1961812975 shutdown_connections 2023-12-16T05:53:49.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.999+0000 7fdaabcf4700 1 --2- 172.21.15.156:0/1961812975 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fda90068f60 0x7fda9006b410 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:49.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.999+0000 7fdaabcf4700 1 --2- 172.21.15.156:0/1961812975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdaa40fbaf0 0x7fdaa410d590 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:49.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.999+0000 7fdaabcf4700 1 --2- 172.21.15.156:0/1961812975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaa40fcd00 0x7fdaa410dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:49.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.999+0000 7fdaabcf4700 1 -- 172.21.15.156:0/1961812975 >> 172.21.15.156:0/1961812975 conn(0x7fdaa40f7190 msgr2=0x7fdaa4065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:49.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.999+0000 7fdaabcf4700 1 -- 172.21.15.156:0/1961812975 shutdown_connections 2023-12-16T05:53:49.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-12-16T05:53:48.999+0000 7fdaabcf4700 1 -- 172.21.15.156:0/1961812975 wait complete. 2023-12-16T05:53:49.373 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-12-16T05:53:49.373 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2023-12-16T05:53:49.373 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-16T05:53:49.414 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-16T05:53:49.415 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-12-16T05:53:49.415 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph mgr dump --format=json 2023-12-16T05:53:49.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:49 smithi155 ceph-mon[112451]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:53:49.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:49 smithi155 ceph-mon[112451]: from='client.? 172.21.15.156:0/1961812975' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T05:53:49.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:49 smithi155 ceph-mon[112451]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T05:53:49.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:49 smithi155 ceph-mon[112451]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-16T05:53:49.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:49 smithi156 ceph-mon[121001]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:53:49.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:49 smithi156 ceph-mon[121001]: from='client.? 172.21.15.156:0/1961812975' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T05:53:49.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:49 smithi156 ceph-mon[121001]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T05:53:49.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:49 smithi156 ceph-mon[121001]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-16T05:53:49.692 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:53:50.639 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.635+0000 7f8f7cf70700 1 -- 172.21.15.155:0/1199409134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f780fbb40 msgr2=0x7f8f780fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:50.639 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.635+0000 7f8f7cf70700 1 --2- 172.21.15.155:0/1199409134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f780fbb40 0x7f8f780fbfb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8f68004940 tx=0x7f8f68009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:50.640 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.635+0000 7f8f7cf70700 1 -- 172.21.15.155:0/1199409134 shutdown_connections 2023-12-16T05:53:50.640 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.635+0000 7f8f7cf70700 1 --2- 172.21.15.155:0/1199409134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f780fbb40 0x7f8f780fbfb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:50.640 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.635+0000 7f8f7cf70700 1 --2- 172.21.15.155:0/1199409134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f78101b00 0x7f8f78101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:50.640 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.635+0000 7f8f7cf70700 1 -- 172.21.15.155:0/1199409134 >> 172.21.15.155:0/1199409134 conn(0x7f8f780719b0 msgr2=0x7f8f78071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:50.640 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.635+0000 7f8f7cf70700 1 -- 172.21.15.155:0/1199409134 shutdown_connections 2023-12-16T05:53:50.640 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.635+0000 7f8f7cf70700 1 -- 172.21.15.155:0/1199409134 wait complete. 2023-12-16T05:53:50.640 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.636+0000 7f8f7cf70700 1 Processor -- start 2023-12-16T05:53:50.640 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.636+0000 7f8f7cf70700 1 -- start start 2023-12-16T05:53:50.640 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.636+0000 7f8f7cf70700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f780fbb40 0x7f8f7810e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:50.640 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.636+0000 7f8f7cf70700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f78101b00 0x7f8f7810ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:50.640 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.636+0000 7f8f7cf70700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7810f280 con 0x7f8f780fbb40 2023-12-16T05:53:50.640 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.636+0000 7f8f7cf70700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7810f3f0 con 0x7f8f78101b00 2023-12-16T05:53:50.640 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.636+0000 7f8f7659c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f780fbb40 0x7f8f7810e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:50.640 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.636+0000 7f8f7659c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f780fbb40 0x7f8f7810e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:51018/0 (socket says 172.21.15.155:51018) 2023-12-16T05:53:50.641 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.636+0000 7f8f7659c700 1 -- 172.21.15.155:0/3400932416 learned_addr learned my addr 172.21.15.155:0/3400932416 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:53:50.641 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.636+0000 7f8f75d9b700 1 --2- 172.21.15.155:0/3400932416 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f78101b00 0x7f8f7810ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:50.641 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.636+0000 7f8f7659c700 1 -- 172.21.15.155:0/3400932416 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f78101b00 msgr2=0x7f8f7810ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:50.641 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.636+0000 7f8f7659c700 1 --2- 172.21.15.155:0/3400932416 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f78101b00 0x7f8f7810ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:50.641 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.636+0000 7f8f7659c700 1 -- 172.21.15.155:0/3400932416 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f68005040 con 0x7f8f780fbb40 2023-12-16T05:53:50.641 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.636+0000 7f8f7659c700 1 --2- 172.21.15.155:0/3400932416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f780fbb40 0x7f8f7810e740 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c002a50 tx=0x7f8f6c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:50.641 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.636+0000 7f8f66ffd700 1 -- 172.21.15.155:0/3400932416 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f6c007cc0 con 0x7f8f780fbb40 2023-12-16T05:53:50.641 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.636+0000 7f8f66ffd700 1 -- 172.21.15.155:0/3400932416 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8f6c00f040 con 0x7f8f780fbb40 2023-12-16T05:53:50.641 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.636+0000 7f8f7cf70700 1 -- 172.21.15.155:0/3400932416 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f78117740 con 0x7f8f780fbb40 2023-12-16T05:53:50.641 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.636+0000 7f8f66ffd700 1 -- 172.21.15.155:0/3400932416 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f6c00d960 con 0x7f8f780fbb40 2023-12-16T05:53:50.641 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.637+0000 7f8f7cf70700 1 -- 172.21.15.155:0/3400932416 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f78117c80 con 0x7f8f780fbb40 2023-12-16T05:53:50.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.638+0000 7f8f7cf70700 1 -- 172.21.15.155:0/3400932416 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f78103fb0 con 0x7f8f780fbb40 2023-12-16T05:53:50.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.638+0000 7f8f66ffd700 1 -- 172.21.15.155:0/3400932416 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f8f6c00dac0 con 0x7f8f780fbb40 2023-12-16T05:53:50.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.638+0000 7f8f66ffd700 1 --2- 172.21.15.155:0/3400932416 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8f60068f60 0x7f8f6006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:50.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.638+0000 7f8f66ffd700 1 -- 172.21.15.155:0/3400932416 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8f6c086780 con 0x7f8f780fbb40 2023-12-16T05:53:50.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.639+0000 7f8f75d9b700 1 --2- 172.21.15.155:0/3400932416 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8f60068f60 0x7f8f6006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:50.643 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.639+0000 7f8f75d9b700 1 --2- 172.21.15.155:0/3400932416 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8f60068f60 0x7f8f6006b410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8f78065e90 tx=0x7f8f68009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:50.645 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.643+0000 7f8f66ffd700 1 -- 172.21.15.155:0/3400932416 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8f6c052f10 con 0x7f8f780fbb40 2023-12-16T05:53:50.886 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.883+0000 7f8f7cf70700 1 -- 172.21.15.155:0/3400932416 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8f780734d0 con 0x7f8f780fbb40 2023-12-16T05:53:50.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.886+0000 7f8f66ffd700 1 -- 172.21.15.155:0/3400932416 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+166786 (secure 0 0 0) 0x7f8f6c056530 con 0x7f8f780fbb40 2023-12-16T05:53:50.891 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:53:50.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.888+0000 7f8f7cf70700 1 -- 172.21.15.155:0/3400932416 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8f60068f60 msgr2=0x7f8f6006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:50.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.888+0000 7f8f7cf70700 1 --2- 172.21.15.155:0/3400932416 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8f60068f60 0x7f8f6006b410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8f78065e90 tx=0x7f8f68009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:50.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.888+0000 7f8f7cf70700 1 -- 172.21.15.155:0/3400932416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f780fbb40 msgr2=0x7f8f7810e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:50.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.888+0000 7f8f7cf70700 1 --2- 172.21.15.155:0/3400932416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f780fbb40 0x7f8f7810e740 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c002a50 tx=0x7f8f6c0046b0 comp rx=0 tx=0).stop 2023-12-16T05:53:50.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.889+0000 7f8f7cf70700 1 -- 172.21.15.155:0/3400932416 shutdown_connections 2023-12-16T05:53:50.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.889+0000 7f8f7cf70700 1 --2- 172.21.15.155:0/3400932416 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8f60068f60 0x7f8f6006b410 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:50.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.889+0000 7f8f7cf70700 1 --2- 172.21.15.155:0/3400932416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f780fbb40 0x7f8f7810e740 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:50.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.889+0000 7f8f7cf70700 1 --2- 172.21.15.155:0/3400932416 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f78101b00 0x7f8f7810ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:50.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.889+0000 7f8f7cf70700 1 -- 172.21.15.155:0/3400932416 >> 172.21.15.155:0/3400932416 conn(0x7f8f780719b0 msgr2=0x7f8f780fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:50.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.889+0000 7f8f7cf70700 1 -- 172.21.15.155:0/3400932416 shutdown_connections 2023-12-16T05:53:50.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:50.889+0000 7f8f7cf70700 1 -- 172.21.15.155:0/3400932416 wait complete. 2023-12-16T05:53:51.252 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":19,"active_gid":14208,"active_name":"smithi155.maowdn","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3642837048},{"type":"v1","addr":"172.21.15.155:6801","nonce":3642837048}]},"active_addr":"172.21.15.155:6801/3642837048","active_change":"2023-12-16T05:51:16.444463+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14228,"name":"smithi156.pclong","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.155:8443/","prometheus":"http://172.21.15.155:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":3875666728}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":2852700903}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":1378946609}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":1934861149}]}]} 2023-12-16T05:53:51.256 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-12-16T05:53:51.256 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-12-16T05:53:51.256 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-16T05:53:51.517 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:53:51.818 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:51 smithi155 ceph-mon[112451]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:53:51.818 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:51 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/3400932416' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-16T05:53:51.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:51 smithi156 ceph-mon[121001]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:53:51.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:51 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/3400932416' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-16T05:53:52.495 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.492+0000 7f945de9f700 1 -- 172.21.15.155:0/3459218191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9458065390 msgr2=0x7f9458065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:52.495 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.492+0000 7f945de9f700 1 --2- 172.21.15.155:0/3459218191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9458065390 0x7f9458065800 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f944c004940 tx=0x7f944c009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:52.495 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.492+0000 7f945de9f700 1 -- 172.21.15.155:0/3459218191 shutdown_connections 2023-12-16T05:53:52.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.492+0000 7f945de9f700 1 --2- 172.21.15.155:0/3459218191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9458065390 0x7f9458065800 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:52.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.492+0000 7f945de9f700 1 --2- 172.21.15.155:0/3459218191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9458102c20 0x7f9458102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:52.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.492+0000 7f945de9f700 1 -- 172.21.15.155:0/3459218191 >> 172.21.15.155:0/3459218191 conn(0x7f94580719b0 msgr2=0x7f9458071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:52.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.492+0000 7f945de9f700 1 -- 172.21.15.155:0/3459218191 shutdown_connections 2023-12-16T05:53:52.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.492+0000 7f945de9f700 1 -- 172.21.15.155:0/3459218191 wait complete. 2023-12-16T05:53:52.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.492+0000 7f945de9f700 1 Processor -- start 2023-12-16T05:53:52.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.493+0000 7f945de9f700 1 -- start start 2023-12-16T05:53:52.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.493+0000 7f945de9f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9458065390 0x7f9458113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:52.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.493+0000 7f945de9f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9458102c20 0x7f9458113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:52.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.493+0000 7f945de9f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94581142c0 con 0x7f9458065390 2023-12-16T05:53:52.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.493+0000 7f945de9f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945810d5f0 con 0x7f9458102c20 2023-12-16T05:53:52.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.493+0000 7f94577fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9458065390 0x7f9458113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:52.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.493+0000 7f94577fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9458065390 0x7f9458113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:51040/0 (socket says 172.21.15.155:51040) 2023-12-16T05:53:52.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.493+0000 7f94577fe700 1 -- 172.21.15.155:0/3144426596 learned_addr learned my addr 172.21.15.155:0/3144426596 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:53:52.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.493+0000 7f9456ffd700 1 --2- 172.21.15.155:0/3144426596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9458102c20 0x7f9458113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:52.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.493+0000 7f94577fe700 1 -- 172.21.15.155:0/3144426596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9458102c20 msgr2=0x7f9458113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:52.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.493+0000 7f94577fe700 1 --2- 172.21.15.155:0/3144426596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9458102c20 0x7f9458113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:52.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.493+0000 7f94577fe700 1 -- 172.21.15.155:0/3144426596 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944c005040 con 0x7f9458065390 2023-12-16T05:53:52.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.493+0000 7f94577fe700 1 --2- 172.21.15.155:0/3144426596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9458065390 0x7f9458113730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f944800c8c0 tx=0x7f94480044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:52.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.494+0000 7f943ffff700 1 -- 172.21.15.155:0/3144426596 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f944800a760 con 0x7f9458065390 2023-12-16T05:53:52.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.494+0000 7f943ffff700 1 -- 172.21.15.155:0/3144426596 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f944800ad70 con 0x7f9458065390 2023-12-16T05:53:52.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.494+0000 7f945de9f700 1 -- 172.21.15.155:0/3144426596 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945810d8d0 con 0x7f9458065390 2023-12-16T05:53:52.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.494+0000 7f943ffff700 1 -- 172.21.15.155:0/3144426596 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94480113a0 con 0x7f9458065390 2023-12-16T05:53:52.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.494+0000 7f945de9f700 1 -- 172.21.15.155:0/3144426596 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f945810dde0 con 0x7f9458065390 2023-12-16T05:53:52.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.494+0000 7f945de9f700 1 -- 172.21.15.155:0/3144426596 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94580fff40 con 0x7f9458065390 2023-12-16T05:53:52.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.495+0000 7f943ffff700 1 -- 172.21.15.155:0/3144426596 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f9448012400 con 0x7f9458065390 2023-12-16T05:53:52.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.495+0000 7f943ffff700 1 --2- 172.21.15.155:0/3144426596 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9440068f60 0x7f944006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:52.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.496+0000 7f9456ffd700 1 --2- 172.21.15.155:0/3144426596 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9440068f60 0x7f944006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:52.500 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.496+0000 7f943ffff700 1 -- 172.21.15.155:0/3144426596 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9448086b00 con 0x7f9458065390 2023-12-16T05:53:52.500 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.496+0000 7f9456ffd700 1 --2- 172.21.15.155:0/3144426596 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9440068f60 0x7f944006b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f945810e920 tx=0x7f944c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:52.502 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.500+0000 7f943ffff700 1 -- 172.21.15.155:0/3144426596 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9448056da0 con 0x7f9458065390 2023-12-16T05:53:52.689 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.686+0000 7f945de9f700 1 -- 172.21.15.155:0/3144426596 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f945804bb80 con 0x7f9458065390 2023-12-16T05:53:52.690 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.687+0000 7f943ffff700 1 -- 172.21.15.155:0/3144426596 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11121 (secure 0 0 0) 0x7f9448056930 con 0x7f9458065390 2023-12-16T05:53:52.690 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:53:52.690 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":38,"fsid":"d344784e-9bd6-11ee-95a5-87774f69a715","created":"2023-12-16T05:49:39.805571+0000","modified":"2023-12-16T05:53:42.327827+0000","last_up_change":"2023-12-16T05:53:41.318211+0000","last_in_change":"2023-12-16T05:53:25.098236+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T05:52:48.744538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"7f9fdb2e-99ba-4298-973a-70c36ba678ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1483763675},{"type":"v1","addr":"172.21.15.155:6803","nonce":1483763675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1483763675},{"type":"v1","addr":"172.21.15.155:6805","nonce":1483763675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1483763675},{"type":"v1","addr":"172.21.15.155:6809","nonce":1483763675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1483763675},{"type":"v1","addr":"172.21.15.155:6807","nonce":1483763675}]},"public_addr":"172.21.15.155:6803/1483763675","cluster_addr":"172.21.15.155:6805/1483763675","heartbeat_back_addr":"172.21.15.155:6809/1483763675","heartbeat_front_addr":"172.21.15.155:6807/1483763675","state":["exists","up"]},{"osd":1,"uuid":"6b941218-a4cb-423c-82a7-4f5825269d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3291965512},{"type":"v1","addr":"172.21.15.155:6811","nonce":3291965512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3291965512},{"type":"v1","addr":"172.21.15.155:6813","nonce":3291965512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3291965512},{"type":"v1","addr":"172.21.15.155:6817","nonce":3291965512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3291965512},{"type":"v1","addr":"172.21.15.155:6815","nonce":3291965512}]},"public_addr":"172.21.15.155:6811/3291965512","cluster_addr":"172.21.15.155:6813/3291965512","heartbeat_back_addr":"172.21.15.155:6817/3291965512","heartbeat_front_addr":"172.21.15.155:6815/3291965512","state":["exists","up"]},{"osd":2,"uuid":"ea6b309e-b3ba-4e72-8977-9d4915cb68ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3010388644},{"type":"v1","addr":"172.21.15.155:6819","nonce":3010388644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3010388644},{"type":"v1","addr":"172.21.15.155:6821","nonce":3010388644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3010388644},{"type":"v1","addr":"172.21.15.155:6825","nonce":3010388644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3010388644},{"type":"v1","addr":"172.21.15.155:6823","nonce":3010388644}]},"public_addr":"172.21.15.155:6819/3010388644","cluster_addr":"172.21.15.155:6821/3010388644","heartbeat_back_addr":"172.21.15.155:6825/3010388644","heartbeat_front_addr":"172.21.15.155:6823/3010388644","state":["exists","up"]},{"osd":3,"uuid":"ae32e77a-1c79-47d0-802b-ff70099c3126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1620466967},{"type":"v1","addr":"172.21.15.156:6801","nonce":1620466967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1620466967},{"type":"v1","addr":"172.21.15.156:6803","nonce":1620466967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1620466967},{"type":"v1","addr":"172.21.15.156:6807","nonce":1620466967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1620466967},{"type":"v1","addr":"172.21.15.156:6805","nonce":1620466967}]},"public_addr":"172.21.15.156:6801/1620466967","cluster_addr":"172.21.15.156:6803/1620466967","heartbeat_back_addr":"172.21.15.156:6807/1620466967","heartbeat_front_addr":"172.21.15.156:6805/1620466967","state":["exists","up"]},{"osd":4,"uuid":"f61396ce-8004-49ee-aa87-98c96fc7d35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2759834290},{"type":"v1","addr":"172.21.15.156:6809","nonce":2759834290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2759834290},{"type":"v1","addr":"172.21.15.156:6811","nonce":2759834290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2759834290},{"type":"v1","addr":"172.21.15.156:6815","nonce":2759834290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2759834290},{"type":"v1","addr":"172.21.15.156:6813","nonce":2759834290}]},"public_addr":"172.21.15.156:6809/2759834290","cluster_addr":"172.21.15.156:6811/2759834290","heartbeat_back_addr":"172.21.15.156:6815/2759834290","heartbeat_front_addr":"172.21.15.156:6813/2759834290","state":["exists","up"]},{"osd":5,"uuid":"f58d8355-9752-4ea8-b051-93a14b7f1091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":81941755},{"type":"v1","addr":"172.21.15.156:6817","nonce":81941755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":81941755},{"type":"v1","addr":"172.21.15.156:6819","nonce":81941755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":81941755},{"type":"v1","addr":"172.21.15.156:6823","nonce":81941755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":81941755},{"type":"v1","addr":"172.21.15.156:6821","nonce":81941755}]},"public_addr":"172.21.15.156:6817/81941755","cluster_addr":"172.21.15.156:6819/81941755","heartbeat_back_addr":"172.21.15.156:6823/81941755","heartbeat_front_addr":"172.21.15.156:6821/81941755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:52:07.086653+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:52:26.710074+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:52:46.466497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:53:04.226908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:53:21.851522+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:53:39.341732+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:6800/2821498015":"2023-12-17T05:51:16.444340+0000","172.21.15.155:0/4153694391":"2023-12-17T05:51:16.444340+0000","172.21.15.155:6801/2821498015":"2023-12-17T05:51:16.444340+0000","172.21.15.155:0/2967908456":"2023-12-17T05:51:16.444340+0000","172.21.15.155:6800/1287353594":"2023-12-17T05:50:28.085105+0000","172.21.15.155:0/2867995431":"2023-12-17T05:50:28.085105+0000","172.21.15.155:0/669103637":"2023-12-17T05:50:28.085105+0000","172.21.15.155:6801/291007537":"2023-12-17T05:50:04.441832+0000","172.21.15.155:6800/291007537":"2023-12-17T05:50:04.441832+0000","172.21.15.155:0/3953524373":"2023-12-17T05:50:04.441832+0000","172.21.15.155:6801/1287353594":"2023-12-17T05:50:28.085105+0000","172.21.15.155:0/3422132632":"2023-12-17T05:50:04.441832+0000","172.21.15.155:0/2787224311":"2023-12-17T05:50:04.441832+0000","172.21.15.155:0/2339263885":"2023-12-17T05:51:16.444340+0000","172.21.15.155:0/3544820495":"2023-12-17T05:50:28.085105+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T05:53:52.693 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.689+0000 7f945de9f700 1 -- 172.21.15.155:0/3144426596 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9440068f60 msgr2=0x7f944006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:52.693 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.689+0000 7f945de9f700 1 --2- 172.21.15.155:0/3144426596 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9440068f60 0x7f944006b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f945810e920 tx=0x7f944c009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:52.693 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.689+0000 7f945de9f700 1 -- 172.21.15.155:0/3144426596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9458065390 msgr2=0x7f9458113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:52.693 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.689+0000 7f945de9f700 1 --2- 172.21.15.155:0/3144426596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9458065390 0x7f9458113730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f944800c8c0 tx=0x7f94480044c0 comp rx=0 tx=0).stop 2023-12-16T05:53:52.693 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.689+0000 7f945de9f700 1 -- 172.21.15.155:0/3144426596 shutdown_connections 2023-12-16T05:53:52.693 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.689+0000 7f945de9f700 1 --2- 172.21.15.155:0/3144426596 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9440068f60 0x7f944006b410 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:52.693 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.689+0000 7f945de9f700 1 --2- 172.21.15.155:0/3144426596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9458065390 0x7f9458113730 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:52.693 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.689+0000 7f945de9f700 1 --2- 172.21.15.155:0/3144426596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9458102c20 0x7f9458113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:52.693 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.689+0000 7f945de9f700 1 -- 172.21.15.155:0/3144426596 >> 172.21.15.155:0/3144426596 conn(0x7f94580719b0 msgr2=0x7f94580fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:52.693 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.689+0000 7f945de9f700 1 -- 172.21.15.155:0/3144426596 shutdown_connections 2023-12-16T05:53:52.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:52.689+0000 7f945de9f700 1 -- 172.21.15.155:0/3144426596 wait complete. 2023-12-16T05:53:53.068 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-12-16T05:53:53.069 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-16T05:53:53.331 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:53:53.806 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:53 smithi155 ceph-mon[112451]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:53:53.806 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:53 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/3144426596' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T05:53:53.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:53 smithi156 ceph-mon[121001]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:53:53.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:53 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/3144426596' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T05:53:54.334 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.329+0000 7f0d244ce700 1 -- 172.21.15.155:0/3210026738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d1c0fbb40 msgr2=0x7f0d1c0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:54.335 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.329+0000 7f0d244ce700 1 --2- 172.21.15.155:0/3210026738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d1c0fbb40 0x7f0d1c0fbfb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0d18004940 tx=0x7f0d18009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:54.335 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.329+0000 7f0d244ce700 1 -- 172.21.15.155:0/3210026738 shutdown_connections 2023-12-16T05:53:54.335 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.329+0000 7f0d244ce700 1 --2- 172.21.15.155:0/3210026738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d1c0fbb40 0x7f0d1c0fbfb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:54.335 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.329+0000 7f0d244ce700 1 --2- 172.21.15.155:0/3210026738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d1c101b00 0x7f0d1c101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:54.335 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.329+0000 7f0d244ce700 1 -- 172.21.15.155:0/3210026738 >> 172.21.15.155:0/3210026738 conn(0x7f0d1c0719b0 msgr2=0x7f0d1c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:54.335 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.329+0000 7f0d244ce700 1 -- 172.21.15.155:0/3210026738 shutdown_connections 2023-12-16T05:53:54.335 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.330+0000 7f0d244ce700 1 -- 172.21.15.155:0/3210026738 wait complete. 2023-12-16T05:53:54.335 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.330+0000 7f0d244ce700 1 Processor -- start 2023-12-16T05:53:54.335 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.330+0000 7f0d244ce700 1 -- start start 2023-12-16T05:53:54.335 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.330+0000 7f0d244ce700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d1c0fbb40 0x7f0d1c10e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:54.335 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.330+0000 7f0d244ce700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d1c101b00 0x7f0d1c10ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:54.335 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.330+0000 7f0d244ce700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c10f260 con 0x7f0d1c101b00 2023-12-16T05:53:54.335 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.330+0000 7f0d244ce700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c10f3a0 con 0x7f0d1c0fbb40 2023-12-16T05:53:54.336 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.330+0000 7f0d21a69700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d1c101b00 0x7f0d1c10ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:54.336 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.330+0000 7f0d21a69700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d1c101b00 0x7f0d1c10ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:51058/0 (socket says 172.21.15.155:51058) 2023-12-16T05:53:54.336 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.330+0000 7f0d21a69700 1 -- 172.21.15.155:0/236117691 learned_addr learned my addr 172.21.15.155:0/236117691 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:53:54.336 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.331+0000 7f0d2226a700 1 --2- 172.21.15.155:0/236117691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d1c0fbb40 0x7f0d1c10e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:54.336 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.331+0000 7f0d21a69700 1 -- 172.21.15.155:0/236117691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d1c0fbb40 msgr2=0x7f0d1c10e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:54.336 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.331+0000 7f0d21a69700 1 --2- 172.21.15.155:0/236117691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d1c0fbb40 0x7f0d1c10e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:54.336 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.331+0000 7f0d21a69700 1 -- 172.21.15.155:0/236117691 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d18005040 con 0x7f0d1c101b00 2023-12-16T05:53:54.336 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.331+0000 7f0d21a69700 1 --2- 172.21.15.155:0/236117691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d1c101b00 0x7f0d1c10ec40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009390 tx=0x7f0d18009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:54.336 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.331+0000 7f0d12ffd700 1 -- 172.21.15.155:0/236117691 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d1800e040 con 0x7f0d1c101b00 2023-12-16T05:53:54.336 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.331+0000 7f0d244ce700 1 -- 172.21.15.155:0/236117691 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1c117670 con 0x7f0d1c101b00 2023-12-16T05:53:54.336 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.331+0000 7f0d12ffd700 1 -- 172.21.15.155:0/236117691 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0d18004290 con 0x7f0d1c101b00 2023-12-16T05:53:54.336 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.331+0000 7f0d12ffd700 1 -- 172.21.15.155:0/236117691 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d18013ea0 con 0x7f0d1c101b00 2023-12-16T05:53:54.336 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.331+0000 7f0d244ce700 1 -- 172.21.15.155:0/236117691 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1c117bb0 con 0x7f0d1c101b00 2023-12-16T05:53:54.337 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.332+0000 7f0d244ce700 1 -- 172.21.15.155:0/236117691 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1c103fb0 con 0x7f0d1c101b00 2023-12-16T05:53:54.337 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.332+0000 7f0d12ffd700 1 -- 172.21.15.155:0/236117691 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f0d1800bc50 con 0x7f0d1c101b00 2023-12-16T05:53:54.337 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.333+0000 7f0d12ffd700 1 --2- 172.21.15.155:0/236117691 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0d08068f70 0x7f0d0806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:54.337 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.333+0000 7f0d12ffd700 1 -- 172.21.15.155:0/236117691 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0d18087d40 con 0x7f0d1c101b00 2023-12-16T05:53:54.337 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.333+0000 7f0d2226a700 1 --2- 172.21.15.155:0/236117691 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0d08068f70 0x7f0d0806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:54.337 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.333+0000 7f0d2226a700 1 --2- 172.21.15.155:0/236117691 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0d08068f70 0x7f0d0806b420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c006fd0 tx=0x7f0d0c008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:54.340 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.337+0000 7f0d12ffd700 1 -- 172.21.15.155:0/236117691 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0d18054550 con 0x7f0d1c101b00 2023-12-16T05:53:54.527 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.524+0000 7f0d244ce700 1 -- 172.21.15.155:0/236117691 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d1c0734d0 con 0x7f0d1c101b00 2023-12-16T05:53:54.527 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.525+0000 7f0d12ffd700 1 -- 172.21.15.155:0/236117691 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11121 (secure 0 0 0) 0x7f0d18057b70 con 0x7f0d1c101b00 2023-12-16T05:53:54.528 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:53:54.528 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":38,"fsid":"d344784e-9bd6-11ee-95a5-87774f69a715","created":"2023-12-16T05:49:39.805571+0000","modified":"2023-12-16T05:53:42.327827+0000","last_up_change":"2023-12-16T05:53:41.318211+0000","last_in_change":"2023-12-16T05:53:25.098236+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T05:52:48.744538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"7f9fdb2e-99ba-4298-973a-70c36ba678ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1483763675},{"type":"v1","addr":"172.21.15.155:6803","nonce":1483763675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1483763675},{"type":"v1","addr":"172.21.15.155:6805","nonce":1483763675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1483763675},{"type":"v1","addr":"172.21.15.155:6809","nonce":1483763675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1483763675},{"type":"v1","addr":"172.21.15.155:6807","nonce":1483763675}]},"public_addr":"172.21.15.155:6803/1483763675","cluster_addr":"172.21.15.155:6805/1483763675","heartbeat_back_addr":"172.21.15.155:6809/1483763675","heartbeat_front_addr":"172.21.15.155:6807/1483763675","state":["exists","up"]},{"osd":1,"uuid":"6b941218-a4cb-423c-82a7-4f5825269d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3291965512},{"type":"v1","addr":"172.21.15.155:6811","nonce":3291965512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3291965512},{"type":"v1","addr":"172.21.15.155:6813","nonce":3291965512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3291965512},{"type":"v1","addr":"172.21.15.155:6817","nonce":3291965512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3291965512},{"type":"v1","addr":"172.21.15.155:6815","nonce":3291965512}]},"public_addr":"172.21.15.155:6811/3291965512","cluster_addr":"172.21.15.155:6813/3291965512","heartbeat_back_addr":"172.21.15.155:6817/3291965512","heartbeat_front_addr":"172.21.15.155:6815/3291965512","state":["exists","up"]},{"osd":2,"uuid":"ea6b309e-b3ba-4e72-8977-9d4915cb68ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3010388644},{"type":"v1","addr":"172.21.15.155:6819","nonce":3010388644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3010388644},{"type":"v1","addr":"172.21.15.155:6821","nonce":3010388644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3010388644},{"type":"v1","addr":"172.21.15.155:6825","nonce":3010388644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3010388644},{"type":"v1","addr":"172.21.15.155:6823","nonce":3010388644}]},"public_addr":"172.21.15.155:6819/3010388644","cluster_addr":"172.21.15.155:6821/3010388644","heartbeat_back_addr":"172.21.15.155:6825/3010388644","heartbeat_front_addr":"172.21.15.155:6823/3010388644","state":["exists","up"]},{"osd":3,"uuid":"ae32e77a-1c79-47d0-802b-ff70099c3126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1620466967},{"type":"v1","addr":"172.21.15.156:6801","nonce":1620466967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1620466967},{"type":"v1","addr":"172.21.15.156:6803","nonce":1620466967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1620466967},{"type":"v1","addr":"172.21.15.156:6807","nonce":1620466967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1620466967},{"type":"v1","addr":"172.21.15.156:6805","nonce":1620466967}]},"public_addr":"172.21.15.156:6801/1620466967","cluster_addr":"172.21.15.156:6803/1620466967","heartbeat_back_addr":"172.21.15.156:6807/1620466967","heartbeat_front_addr":"172.21.15.156:6805/1620466967","state":["exists","up"]},{"osd":4,"uuid":"f61396ce-8004-49ee-aa87-98c96fc7d35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2759834290},{"type":"v1","addr":"172.21.15.156:6809","nonce":2759834290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2759834290},{"type":"v1","addr":"172.21.15.156:6811","nonce":2759834290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2759834290},{"type":"v1","addr":"172.21.15.156:6815","nonce":2759834290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2759834290},{"type":"v1","addr":"172.21.15.156:6813","nonce":2759834290}]},"public_addr":"172.21.15.156:6809/2759834290","cluster_addr":"172.21.15.156:6811/2759834290","heartbeat_back_addr":"172.21.15.156:6815/2759834290","heartbeat_front_addr":"172.21.15.156:6813/2759834290","state":["exists","up"]},{"osd":5,"uuid":"f58d8355-9752-4ea8-b051-93a14b7f1091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":81941755},{"type":"v1","addr":"172.21.15.156:6817","nonce":81941755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":81941755},{"type":"v1","addr":"172.21.15.156:6819","nonce":81941755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":81941755},{"type":"v1","addr":"172.21.15.156:6823","nonce":81941755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":81941755},{"type":"v1","addr":"172.21.15.156:6821","nonce":81941755}]},"public_addr":"172.21.15.156:6817/81941755","cluster_addr":"172.21.15.156:6819/81941755","heartbeat_back_addr":"172.21.15.156:6823/81941755","heartbeat_front_addr":"172.21.15.156:6821/81941755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:52:07.086653+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:52:26.710074+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:52:46.466497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:53:04.226908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:53:21.851522+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:53:39.341732+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:6800/2821498015":"2023-12-17T05:51:16.444340+0000","172.21.15.155:0/4153694391":"2023-12-17T05:51:16.444340+0000","172.21.15.155:6801/2821498015":"2023-12-17T05:51:16.444340+0000","172.21.15.155:0/2967908456":"2023-12-17T05:51:16.444340+0000","172.21.15.155:6800/1287353594":"2023-12-17T05:50:28.085105+0000","172.21.15.155:0/2867995431":"2023-12-17T05:50:28.085105+0000","172.21.15.155:0/669103637":"2023-12-17T05:50:28.085105+0000","172.21.15.155:6801/291007537":"2023-12-17T05:50:04.441832+0000","172.21.15.155:6800/291007537":"2023-12-17T05:50:04.441832+0000","172.21.15.155:0/3953524373":"2023-12-17T05:50:04.441832+0000","172.21.15.155:6801/1287353594":"2023-12-17T05:50:28.085105+0000","172.21.15.155:0/3422132632":"2023-12-17T05:50:04.441832+0000","172.21.15.155:0/2787224311":"2023-12-17T05:50:04.441832+0000","172.21.15.155:0/2339263885":"2023-12-17T05:51:16.444340+0000","172.21.15.155:0/3544820495":"2023-12-17T05:50:28.085105+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T05:53:54.530 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.526+0000 7f0d244ce700 1 -- 172.21.15.155:0/236117691 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0d08068f70 msgr2=0x7f0d0806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:54.530 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.526+0000 7f0d244ce700 1 --2- 172.21.15.155:0/236117691 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0d08068f70 0x7f0d0806b420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c006fd0 tx=0x7f0d0c008040 comp rx=0 tx=0).stop 2023-12-16T05:53:54.530 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.526+0000 7f0d244ce700 1 -- 172.21.15.155:0/236117691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d1c101b00 msgr2=0x7f0d1c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:54.530 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.526+0000 7f0d244ce700 1 --2- 172.21.15.155:0/236117691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d1c101b00 0x7f0d1c10ec40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009390 tx=0x7f0d18009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:54.530 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.527+0000 7f0d244ce700 1 -- 172.21.15.155:0/236117691 shutdown_connections 2023-12-16T05:53:54.530 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.527+0000 7f0d244ce700 1 --2- 172.21.15.155:0/236117691 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0d08068f70 0x7f0d0806b420 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:54.530 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.527+0000 7f0d244ce700 1 --2- 172.21.15.155:0/236117691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d1c0fbb40 0x7f0d1c10e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:54.530 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.527+0000 7f0d244ce700 1 --2- 172.21.15.155:0/236117691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d1c101b00 0x7f0d1c10ec40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:54.531 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.527+0000 7f0d244ce700 1 -- 172.21.15.155:0/236117691 >> 172.21.15.155:0/236117691 conn(0x7f0d1c0719b0 msgr2=0x7f0d1c0faa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:54.531 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.527+0000 7f0d244ce700 1 -- 172.21.15.155:0/236117691 shutdown_connections 2023-12-16T05:53:54.531 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:54.527+0000 7f0d244ce700 1 -- 172.21.15.155:0/236117691 wait complete. 2023-12-16T05:53:54.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:54 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/236117691' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T05:53:54.876 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2023-12-16T05:53:54.876 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2023-12-16T05:53:54.877 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2023-12-16T05:53:54.877 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2023-12-16T05:53:54.877 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2023-12-16T05:53:54.878 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2023-12-16T05:53:54.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:54 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/236117691' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T05:53:55.436 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:53:55.537 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:53:55.689 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:53:55.794 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:55 smithi155 ceph-mon[112451]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:53:55.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:55 smithi156 ceph-mon[121001]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:53:56.112 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:53:56.294 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:53:56.546 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:53:57.747 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:57 smithi155 ceph-mon[112451]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:53:57.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.795+0000 7f950e87e700 1 -- 172.21.15.155:0/3965930606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9508065390 msgr2=0x7f9508065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:57.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.795+0000 7f950e87e700 1 --2- 172.21.15.155:0/3965930606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9508065390 0x7f9508065800 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f94fc004940 tx=0x7f94fc009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:57.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.795+0000 7f950e87e700 1 -- 172.21.15.155:0/3965930606 shutdown_connections 2023-12-16T05:53:57.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.795+0000 7f950e87e700 1 --2- 172.21.15.155:0/3965930606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9508065390 0x7f9508065800 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:57.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.795+0000 7f950e87e700 1 --2- 172.21.15.155:0/3965930606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9508102c20 0x7f9508102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:57.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.795+0000 7f950e87e700 1 -- 172.21.15.155:0/3965930606 >> 172.21.15.155:0/3965930606 conn(0x7f95080719b0 msgr2=0x7f9508071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:57.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.795+0000 7f950e87e700 1 -- 172.21.15.155:0/3965930606 shutdown_connections 2023-12-16T05:53:57.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.795+0000 7f950e87e700 1 -- 172.21.15.155:0/3965930606 wait complete. 2023-12-16T05:53:57.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.795+0000 7f950e87e700 1 Processor -- start 2023-12-16T05:53:57.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.795+0000 7f950e87e700 1 -- start start 2023-12-16T05:53:57.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.796+0000 7f950e87e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9508065390 0x7f9508113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:57.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.796+0000 7f950e87e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9508102c20 0x7f9508113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:57.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.796+0000 7f950e87e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95081142c0 con 0x7f9508065390 2023-12-16T05:53:57.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.796+0000 7f950e87e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950810d5f0 con 0x7f9508102c20 2023-12-16T05:53:57.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.796+0000 7f9507fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9508065390 0x7f9508113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:57.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.796+0000 7f9507fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9508065390 0x7f9508113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52714/0 (socket says 172.21.15.155:52714) 2023-12-16T05:53:57.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.796+0000 7f9507fff700 1 -- 172.21.15.155:0/2706018866 learned_addr learned my addr 172.21.15.155:0/2706018866 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:53:57.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.796+0000 7f95077fe700 1 --2- 172.21.15.155:0/2706018866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9508102c20 0x7f9508113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:57.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.796+0000 7f9507fff700 1 -- 172.21.15.155:0/2706018866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9508102c20 msgr2=0x7f9508113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:57.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.796+0000 7f9507fff700 1 --2- 172.21.15.155:0/2706018866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9508102c20 0x7f9508113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:57.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.796+0000 7f9507fff700 1 -- 172.21.15.155:0/2706018866 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94fc005040 con 0x7f9508065390 2023-12-16T05:53:57.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.796+0000 7f9507fff700 1 --2- 172.21.15.155:0/2706018866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9508065390 0x7f9508113730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f94f8002a50 tx=0x7f94f80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:57.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.796+0000 7f9504ff9700 1 -- 172.21.15.155:0/2706018866 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94f8007cc0 con 0x7f9508065390 2023-12-16T05:53:57.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.796+0000 7f9504ff9700 1 -- 172.21.15.155:0/2706018866 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f94f800f040 con 0x7f9508065390 2023-12-16T05:53:57.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.796+0000 7f950e87e700 1 -- 172.21.15.155:0/2706018866 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950810d8d0 con 0x7f9508065390 2023-12-16T05:53:57.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.796+0000 7f9504ff9700 1 -- 172.21.15.155:0/2706018866 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94f800d9c0 con 0x7f9508065390 2023-12-16T05:53:57.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.796+0000 7f950e87e700 1 -- 172.21.15.155:0/2706018866 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950810dde0 con 0x7f9508065390 2023-12-16T05:53:57.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.797+0000 7f950e87e700 1 -- 172.21.15.155:0/2706018866 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f950810e280 con 0x7f9508065390 2023-12-16T05:53:57.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.798+0000 7f9504ff9700 1 -- 172.21.15.155:0/2706018866 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f94f800db20 con 0x7f9508065390 2023-12-16T05:53:57.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.798+0000 7f9504ff9700 1 --2- 172.21.15.155:0/2706018866 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f94f0068f60 0x7f94f006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:57.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.798+0000 7f9504ff9700 1 -- 172.21.15.155:0/2706018866 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f94f8086840 con 0x7f9508065390 2023-12-16T05:53:57.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.798+0000 7f95077fe700 1 --2- 172.21.15.155:0/2706018866 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f94f0068f60 0x7f94f006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:57.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.798+0000 7f9504ff9700 1 --2- 172.21.15.155:0/2706018866 >> [v2:172.21.15.155:6818/3010388644,v1:172.21.15.155:6819/3010388644] conn(0x7f94f006ec30 0x7f94f0071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:57.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.798+0000 7f9504ff9700 1 -- 172.21.15.155:0/2706018866 --> [v2:172.21.15.155:6818/3010388644,v1:172.21.15.155:6819/3010388644] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f94f00716f0 con 0x7f94f006ec30 2023-12-16T05:53:57.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.798+0000 7f9504ff9700 1 -- 172.21.15.155:0/2706018866 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94f8088d90 con 0x7f9508065390 2023-12-16T05:53:57.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.798+0000 7f950ce1b700 1 --2- 172.21.15.155:0/2706018866 >> [v2:172.21.15.155:6818/3010388644,v1:172.21.15.155:6819/3010388644] conn(0x7f94f006ec30 0x7f94f0071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:57.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.799+0000 7f95077fe700 1 --2- 172.21.15.155:0/2706018866 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f94f0068f60 0x7f94f006b410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f950810e920 tx=0x7f94fc009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:57.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.799+0000 7f950ce1b700 1 --2- 172.21.15.155:0/2706018866 >> [v2:172.21.15.155:6818/3010388644,v1:172.21.15.155:6819/3010388644] conn(0x7f94f006ec30 0x7f94f0071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:57.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.799+0000 7f9504ff9700 1 -- 172.21.15.155:0/2706018866 <== osd.2 v2:172.21.15.155:6818/3010388644 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f94f00716f0 con 0x7f94f006ec30 2023-12-16T05:53:57.818 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.815+0000 7f950e87e700 1 -- 172.21.15.155:0/2706018866 --> [v2:172.21.15.155:6818/3010388644,v1:172.21.15.155:6819/3010388644] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f950805e340 con 0x7f94f006ec30 2023-12-16T05:53:57.818 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.815+0000 7f9504ff9700 1 -- 172.21.15.155:0/2706018866 <== osd.2 v2:172.21.15.155:6818/3010388644 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f950805e340 con 0x7f94f006ec30 2023-12-16T05:53:57.819 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.816+0000 7f950e87e700 1 -- 172.21.15.155:0/2706018866 >> [v2:172.21.15.155:6818/3010388644,v1:172.21.15.155:6819/3010388644] conn(0x7f94f006ec30 msgr2=0x7f94f0071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:57.819 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.816+0000 7f950e87e700 1 --2- 172.21.15.155:0/2706018866 >> [v2:172.21.15.155:6818/3010388644,v1:172.21.15.155:6819/3010388644] conn(0x7f94f006ec30 0x7f94f0071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:57.819 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.816+0000 7f950e87e700 1 -- 172.21.15.155:0/2706018866 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f94f0068f60 msgr2=0x7f94f006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:57.819 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.816+0000 7f950e87e700 1 --2- 172.21.15.155:0/2706018866 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f94f0068f60 0x7f94f006b410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f950810e920 tx=0x7f94fc009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:57.819 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.816+0000 7f950e87e700 1 -- 172.21.15.155:0/2706018866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9508065390 msgr2=0x7f9508113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:57.819 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.816+0000 7f950e87e700 1 --2- 172.21.15.155:0/2706018866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9508065390 0x7f9508113730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f94f8002a50 tx=0x7f94f80046b0 comp rx=0 tx=0).stop 2023-12-16T05:53:57.819 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.816+0000 7f950e87e700 1 -- 172.21.15.155:0/2706018866 shutdown_connections 2023-12-16T05:53:57.819 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.816+0000 7f950e87e700 1 --2- 172.21.15.155:0/2706018866 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f94f0068f60 0x7f94f006b410 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:57.819 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.816+0000 7f950e87e700 1 --2- 172.21.15.155:0/2706018866 >> [v2:172.21.15.155:6818/3010388644,v1:172.21.15.155:6819/3010388644] conn(0x7f94f006ec30 0x7f94f0071040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:57.819 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.816+0000 7f950e87e700 1 --2- 172.21.15.155:0/2706018866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9508065390 0x7f9508113730 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:57.819 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.816+0000 7f950e87e700 1 --2- 172.21.15.155:0/2706018866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9508102c20 0x7f9508113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:57.819 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.816+0000 7f950e87e700 1 -- 172.21.15.155:0/2706018866 >> 172.21.15.155:0/2706018866 conn(0x7f95080719b0 msgr2=0x7f95080fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:57.820 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.816+0000 7f950e87e700 1 -- 172.21.15.155:0/2706018866 shutdown_connections 2023-12-16T05:53:57.820 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:57.816+0000 7f950e87e700 1 -- 172.21.15.155:0/2706018866 wait complete. 2023-12-16T05:53:57.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:57 smithi156 ceph-mon[121001]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:53:58.346 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.343+0000 7fe94a88d700 1 -- 172.21.15.155:0/94406101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe944102bf0 msgr2=0x7fe944102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:58.346 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.343+0000 7fe94a88d700 1 --2- 172.21.15.155:0/94406101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe944102bf0 0x7fe944102fc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe934004940 tx=0x7fe934009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:58.346 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.343+0000 7fe94a88d700 1 -- 172.21.15.155:0/94406101 shutdown_connections 2023-12-16T05:53:58.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.343+0000 7fe94a88d700 1 --2- 172.21.15.155:0/94406101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe944103590 0x7fe9440fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:58.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.343+0000 7fe94a88d700 1 --2- 172.21.15.155:0/94406101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe944102bf0 0x7fe944102fc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:58.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.343+0000 7fe94a88d700 1 -- 172.21.15.155:0/94406101 >> 172.21.15.155:0/94406101 conn(0x7fe9440f87a0 msgr2=0x7fe9440fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:58.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.343+0000 7fe94a88d700 1 -- 172.21.15.155:0/94406101 shutdown_connections 2023-12-16T05:53:58.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.343+0000 7fe94a88d700 1 -- 172.21.15.155:0/94406101 wait complete. 2023-12-16T05:53:58.348 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.344+0000 7fe94a88d700 1 Processor -- start 2023-12-16T05:53:58.348 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.344+0000 7fe94a88d700 1 -- start start 2023-12-16T05:53:58.348 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.344+0000 7fe94a88d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe944102bf0 0x7fe9441136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:58.348 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.344+0000 7fe94a88d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe944103590 0x7fe944113c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:58.348 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.344+0000 7fe94a88d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94410d580 con 0x7fe944102bf0 2023-12-16T05:53:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.344+0000 7fe94a88d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94410d6f0 con 0x7fe944103590 2023-12-16T05:53:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.344+0000 7fe943fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe944102bf0 0x7fe9441136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.344+0000 7fe943fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe944102bf0 0x7fe9441136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52732/0 (socket says 172.21.15.155:52732) 2023-12-16T05:53:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.344+0000 7fe943fff700 1 -- 172.21.15.155:0/1781659628 learned_addr learned my addr 172.21.15.155:0/1781659628 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:53:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.344+0000 7fe9437fe700 1 --2- 172.21.15.155:0/1781659628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe944103590 0x7fe944113c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.344+0000 7fe943fff700 1 -- 172.21.15.155:0/1781659628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe944103590 msgr2=0x7fe944113c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.344+0000 7fe943fff700 1 --2- 172.21.15.155:0/1781659628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe944103590 0x7fe944113c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.344+0000 7fe943fff700 1 -- 172.21.15.155:0/1781659628 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe934005040 con 0x7fe944102bf0 2023-12-16T05:53:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.345+0000 7fe943fff700 1 --2- 172.21.15.155:0/1781659628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe944102bf0 0x7fe9441136c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe93400b3b0 tx=0x7fe934009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.345+0000 7fe940ff9700 1 -- 172.21.15.155:0/1781659628 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe93400e040 con 0x7fe944102bf0 2023-12-16T05:53:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.345+0000 7fe94a88d700 1 -- 172.21.15.155:0/1781659628 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe94410d970 con 0x7fe944102bf0 2023-12-16T05:53:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.345+0000 7fe940ff9700 1 -- 172.21.15.155:0/1781659628 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe93400bc50 con 0x7fe944102bf0 2023-12-16T05:53:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.345+0000 7fe940ff9700 1 -- 172.21.15.155:0/1781659628 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe934013420 con 0x7fe944102bf0 2023-12-16T05:53:58.350 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.345+0000 7fe94a88d700 1 -- 172.21.15.155:0/1781659628 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94410deb0 con 0x7fe944102bf0 2023-12-16T05:53:58.350 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.346+0000 7fe94a88d700 1 -- 172.21.15.155:0/1781659628 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe94410e350 con 0x7fe944102bf0 2023-12-16T05:53:58.351 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.346+0000 7fe940ff9700 1 -- 172.21.15.155:0/1781659628 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fe93401c430 con 0x7fe944102bf0 2023-12-16T05:53:58.351 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.347+0000 7fe940ff9700 1 --2- 172.21.15.155:0/1781659628 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fe92c068f60 0x7fe92c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:58.351 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.347+0000 7fe940ff9700 1 -- 172.21.15.155:0/1781659628 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe934088350 con 0x7fe944102bf0 2023-12-16T05:53:58.351 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.347+0000 7fe9437fe700 1 --2- 172.21.15.155:0/1781659628 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fe92c068f60 0x7fe92c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:58.351 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.347+0000 7fe940ff9700 1 --2- 172.21.15.155:0/1781659628 >> [v2:172.21.15.155:6802/1483763675,v1:172.21.15.155:6803/1483763675] conn(0x7fe92c06ec30 0x7fe92c071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:58.351 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.347+0000 7fe940ff9700 1 -- 172.21.15.155:0/1781659628 --> [v2:172.21.15.155:6802/1483763675,v1:172.21.15.155:6803/1483763675] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe92c0716f0 con 0x7fe92c06ec30 2023-12-16T05:53:58.351 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.347+0000 7fe940ff9700 1 -- 172.21.15.155:0/1781659628 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe934088730 con 0x7fe944102bf0 2023-12-16T05:53:58.351 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.347+0000 7fe948e2a700 1 --2- 172.21.15.155:0/1781659628 >> [v2:172.21.15.155:6802/1483763675,v1:172.21.15.155:6803/1483763675] conn(0x7fe92c06ec30 0x7fe92c071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:58.351 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.347+0000 7fe9437fe700 1 --2- 172.21.15.155:0/1781659628 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fe92c068f60 0x7fe92c06b410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe938006fd0 tx=0x7fe938008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:58.351 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.347+0000 7fe948e2a700 1 --2- 172.21.15.155:0/1781659628 >> [v2:172.21.15.155:6802/1483763675,v1:172.21.15.155:6803/1483763675] conn(0x7fe92c06ec30 0x7fe92c071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:58.351 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.348+0000 7fe940ff9700 1 -- 172.21.15.155:0/1781659628 <== osd.0 v2:172.21.15.155:6802/1483763675 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe92c0716f0 con 0x7fe92c06ec30 2023-12-16T05:53:58.366 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.363+0000 7fe94a88d700 1 -- 172.21.15.155:0/1781659628 --> [v2:172.21.15.155:6802/1483763675,v1:172.21.15.155:6803/1483763675] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe9440fab70 con 0x7fe92c06ec30 2023-12-16T05:53:58.366 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.363+0000 7fe940ff9700 1 -- 172.21.15.155:0/1781659628 <== osd.0 v2:172.21.15.155:6802/1483763675 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe9440fab70 con 0x7fe92c06ec30 2023-12-16T05:53:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.363+0000 7fe94a88d700 1 -- 172.21.15.155:0/1781659628 >> [v2:172.21.15.155:6802/1483763675,v1:172.21.15.155:6803/1483763675] conn(0x7fe92c06ec30 msgr2=0x7fe92c071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.363+0000 7fe94a88d700 1 --2- 172.21.15.155:0/1781659628 >> [v2:172.21.15.155:6802/1483763675,v1:172.21.15.155:6803/1483763675] conn(0x7fe92c06ec30 0x7fe92c071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.364+0000 7fe94a88d700 1 -- 172.21.15.155:0/1781659628 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fe92c068f60 msgr2=0x7fe92c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.364+0000 7fe94a88d700 1 --2- 172.21.15.155:0/1781659628 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fe92c068f60 0x7fe92c06b410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe938006fd0 tx=0x7fe938008040 comp rx=0 tx=0).stop 2023-12-16T05:53:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.364+0000 7fe94a88d700 1 -- 172.21.15.155:0/1781659628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe944102bf0 msgr2=0x7fe9441136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.364+0000 7fe94a88d700 1 --2- 172.21.15.155:0/1781659628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe944102bf0 0x7fe9441136c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe93400b3b0 tx=0x7fe934009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.364+0000 7fe94a88d700 1 -- 172.21.15.155:0/1781659628 shutdown_connections 2023-12-16T05:53:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.364+0000 7fe94a88d700 1 --2- 172.21.15.155:0/1781659628 >> [v2:172.21.15.155:6802/1483763675,v1:172.21.15.155:6803/1483763675] conn(0x7fe92c06ec30 0x7fe92c071040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.364+0000 7fe94a88d700 1 --2- 172.21.15.155:0/1781659628 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fe92c068f60 0x7fe92c06b410 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.364+0000 7fe94a88d700 1 --2- 172.21.15.155:0/1781659628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe944102bf0 0x7fe9441136c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:58.368 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.364+0000 7fe94a88d700 1 --2- 172.21.15.155:0/1781659628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe944103590 0x7fe944113c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:58.368 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.364+0000 7fe94a88d700 1 -- 172.21.15.155:0/1781659628 >> 172.21.15.155:0/1781659628 conn(0x7fe9440f87a0 msgr2=0x7fe9440fa220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:58.368 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.364+0000 7fe94a88d700 1 -- 172.21.15.155:0/1781659628 shutdown_connections 2023-12-16T05:53:58.368 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:58.364+0000 7fe94a88d700 1 -- 172.21.15.155:0/1781659628 wait complete. 2023-12-16T05:53:58.786 INFO:teuthology.orchestra.run.smithi155.stdout:81604378640 2023-12-16T05:53:58.787 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.2 2023-12-16T05:53:59.127 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.124+0000 7f7bf7101700 1 -- 172.21.15.155:0/1064677333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf00fdc30 msgr2=0x7f7bf00fe000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:59.127 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.124+0000 7f7bf7101700 1 --2- 172.21.15.155:0/1064677333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf00fdc30 0x7f7bf00fe000 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7be4004940 tx=0x7f7be4009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:59.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.124+0000 7f7bf7101700 1 -- 172.21.15.155:0/1064677333 shutdown_connections 2023-12-16T05:53:59.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.124+0000 7f7bf7101700 1 --2- 172.21.15.155:0/1064677333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bf00fe5d0 0x7f7bf0106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.124+0000 7f7bf7101700 1 --2- 172.21.15.155:0/1064677333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf00fdc30 0x7f7bf00fe000 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.124+0000 7f7bf7101700 1 -- 172.21.15.155:0/1064677333 >> 172.21.15.155:0/1064677333 conn(0x7f7bf00f7690 msgr2=0x7f7bf00f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:59.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.124+0000 7f7bf7101700 1 -- 172.21.15.155:0/1064677333 shutdown_connections 2023-12-16T05:53:59.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.124+0000 7f7bf7101700 1 -- 172.21.15.155:0/1064677333 wait complete. 2023-12-16T05:53:59.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.124+0000 7f7bf7101700 1 Processor -- start 2023-12-16T05:53:59.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.124+0000 7f7bf7101700 1 -- start start 2023-12-16T05:53:59.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.125+0000 7f7bf7101700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf00fdc30 0x7f7bf00fbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:59.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.125+0000 7f7bf7101700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bf00fe5d0 0x7f7bf00fc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:59.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.125+0000 7f7bf7101700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf00fc630 con 0x7f7bf00fdc30 2023-12-16T05:53:59.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.125+0000 7f7bf7101700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf00fc7a0 con 0x7f7bf00fe5d0 2023-12-16T05:53:59.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.125+0000 7f7bf4e9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf00fdc30 0x7f7bf00fbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:59.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.125+0000 7f7bf4e9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf00fdc30 0x7f7bf00fbaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52754/0 (socket says 172.21.15.155:52754) 2023-12-16T05:53:59.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.125+0000 7f7bf4e9d700 1 -- 172.21.15.155:0/4130803214 learned_addr learned my addr 172.21.15.155:0/4130803214 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:53:59.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.125+0000 7f7beffff700 1 --2- 172.21.15.155:0/4130803214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bf00fe5d0 0x7f7bf00fc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:59.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.125+0000 7f7bf4e9d700 1 -- 172.21.15.155:0/4130803214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bf00fe5d0 msgr2=0x7f7bf00fc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:59.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.125+0000 7f7bf4e9d700 1 --2- 172.21.15.155:0/4130803214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bf00fe5d0 0x7f7bf00fc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.125+0000 7f7bf4e9d700 1 -- 172.21.15.155:0/4130803214 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be4005040 con 0x7f7bf00fdc30 2023-12-16T05:53:59.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.126+0000 7f7bf4e9d700 1 --2- 172.21.15.155:0/4130803214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf00fdc30 0x7f7bf00fbaf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7be4004890 tx=0x7f7be4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:59.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.126+0000 7f7bed7fa700 1 -- 172.21.15.155:0/4130803214 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7be4021070 con 0x7f7bf00fdc30 2023-12-16T05:53:59.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.126+0000 7f7bed7fa700 1 -- 172.21.15.155:0/4130803214 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7be40093b0 con 0x7f7bf00fdc30 2023-12-16T05:53:59.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.126+0000 7f7bf7101700 1 -- 172.21.15.155:0/4130803214 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf0119900 con 0x7f7bf00fdc30 2023-12-16T05:53:59.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.126+0000 7f7bed7fa700 1 -- 172.21.15.155:0/4130803214 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7be400e070 con 0x7f7bf00fdc30 2023-12-16T05:53:59.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.126+0000 7f7bf7101700 1 -- 172.21.15.155:0/4130803214 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf0119d60 con 0x7f7bf00fdc30 2023-12-16T05:53:59.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.127+0000 7f7bf7101700 1 -- 172.21.15.155:0/4130803214 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7bf005e300 con 0x7f7bf00fdc30 2023-12-16T05:53:59.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.127+0000 7f7bed7fa700 1 -- 172.21.15.155:0/4130803214 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f7be401c400 con 0x7f7bf00fdc30 2023-12-16T05:53:59.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.127+0000 7f7bed7fa700 1 --2- 172.21.15.155:0/4130803214 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7be0068f70 0x7f7be006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:59.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.128+0000 7f7bed7fa700 1 -- 172.21.15.155:0/4130803214 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7be4087a60 con 0x7f7bf00fdc30 2023-12-16T05:53:59.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.128+0000 7f7beffff700 1 --2- 172.21.15.155:0/4130803214 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7be0068f70 0x7f7be006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:59.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.128+0000 7f7bed7fa700 1 --2- 172.21.15.155:0/4130803214 >> [v2:172.21.15.156:6800/1620466967,v1:172.21.15.156:6801/1620466967] conn(0x7f7be006ec40 0x7f7be0071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:59.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.128+0000 7f7bed7fa700 1 -- 172.21.15.155:0/4130803214 --> [v2:172.21.15.156:6800/1620466967,v1:172.21.15.156:6801/1620466967] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7be0071700 con 0x7f7be006ec40 2023-12-16T05:53:59.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.128+0000 7f7bed7fa700 1 -- 172.21.15.155:0/4130803214 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7be408c220 con 0x7f7bf00fdc30 2023-12-16T05:53:59.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.128+0000 7f7beffff700 1 --2- 172.21.15.155:0/4130803214 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7be0068f70 0x7f7be006b420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00fd4f0 tx=0x7f7bdc00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:59.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.128+0000 7f7bf569e700 1 --2- 172.21.15.155:0/4130803214 >> [v2:172.21.15.156:6800/1620466967,v1:172.21.15.156:6801/1620466967] conn(0x7f7be006ec40 0x7f7be0071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:59.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.128+0000 7f7bf569e700 1 --2- 172.21.15.155:0/4130803214 >> [v2:172.21.15.156:6800/1620466967,v1:172.21.15.156:6801/1620466967] conn(0x7f7be006ec40 0x7f7be0071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:59.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.129+0000 7f7bed7fa700 1 -- 172.21.15.155:0/4130803214 <== osd.3 v2:172.21.15.156:6800/1620466967 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f7be0071700 con 0x7f7be006ec40 2023-12-16T05:53:59.147 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.144+0000 7f7bf7101700 1 -- 172.21.15.155:0/4130803214 --> [v2:172.21.15.156:6800/1620466967,v1:172.21.15.156:6801/1620466967] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7bf005e730 con 0x7f7be006ec40 2023-12-16T05:53:59.147 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.145+0000 7f7bed7fa700 1 -- 172.21.15.155:0/4130803214 <== osd.3 v2:172.21.15.156:6800/1620466967 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7bf005e730 con 0x7f7be006ec40 2023-12-16T05:53:59.148 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.145+0000 7f7bf7101700 1 -- 172.21.15.155:0/4130803214 >> [v2:172.21.15.156:6800/1620466967,v1:172.21.15.156:6801/1620466967] conn(0x7f7be006ec40 msgr2=0x7f7be0071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:59.148 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.145+0000 7f7bf7101700 1 --2- 172.21.15.155:0/4130803214 >> [v2:172.21.15.156:6800/1620466967,v1:172.21.15.156:6801/1620466967] conn(0x7f7be006ec40 0x7f7be0071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.148 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.145+0000 7f7bf7101700 1 -- 172.21.15.155:0/4130803214 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7be0068f70 msgr2=0x7f7be006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:59.148 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.145+0000 7f7bf7101700 1 --2- 172.21.15.155:0/4130803214 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7be0068f70 0x7f7be006b420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00fd4f0 tx=0x7f7bdc00b040 comp rx=0 tx=0).stop 2023-12-16T05:53:59.148 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.145+0000 7f7bf7101700 1 -- 172.21.15.155:0/4130803214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf00fdc30 msgr2=0x7f7bf00fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:59.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.145+0000 7f7bf7101700 1 --2- 172.21.15.155:0/4130803214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf00fdc30 0x7f7bf00fbaf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7be4004890 tx=0x7f7be4009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:59.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.145+0000 7f7bf7101700 1 -- 172.21.15.155:0/4130803214 shutdown_connections 2023-12-16T05:53:59.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.145+0000 7f7bf7101700 1 --2- 172.21.15.155:0/4130803214 >> [v2:172.21.15.156:6800/1620466967,v1:172.21.15.156:6801/1620466967] conn(0x7f7be006ec40 0x7f7be0071050 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.145+0000 7f7bf7101700 1 --2- 172.21.15.155:0/4130803214 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7be0068f70 0x7f7be006b420 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.145+0000 7f7bf7101700 1 --2- 172.21.15.155:0/4130803214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bf00fdc30 0x7f7bf00fbaf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.145+0000 7f7bf7101700 1 --2- 172.21.15.155:0/4130803214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bf00fe5d0 0x7f7bf00fc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.145+0000 7f7bf7101700 1 -- 172.21.15.155:0/4130803214 >> 172.21.15.155:0/4130803214 conn(0x7f7bf00f7690 msgr2=0x7f7bf01014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:59.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.145+0000 7f7bf7101700 1 -- 172.21.15.155:0/4130803214 shutdown_connections 2023-12-16T05:53:59.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.145+0000 7f7bf7101700 1 -- 172.21.15.155:0/4130803214 wait complete. 2023-12-16T05:53:59.445 INFO:teuthology.orchestra.run.smithi155.stdout:38654705689 2023-12-16T05:53:59.445 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.0 2023-12-16T05:53:59.494 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.490+0000 7faa5d6a2700 1 -- 172.21.15.155:0/2995929980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa580fcee0 msgr2=0x7faa58109190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:59.494 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.490+0000 7faa5d6a2700 1 --2- 172.21.15.155:0/2995929980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa580fcee0 0x7faa58109190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faa4c004940 tx=0x7faa4c009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:59.494 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.490+0000 7faa5d6a2700 1 -- 172.21.15.155:0/2995929980 shutdown_connections 2023-12-16T05:53:59.494 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.490+0000 7faa5d6a2700 1 --2- 172.21.15.155:0/2995929980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa580fcee0 0x7faa58109190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.494 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.490+0000 7faa5d6a2700 1 --2- 172.21.15.155:0/2995929980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa580fc5d0 0x7faa580fc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.494 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.490+0000 7faa5d6a2700 1 -- 172.21.15.155:0/2995929980 >> 172.21.15.155:0/2995929980 conn(0x7faa580719b0 msgr2=0x7faa58071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:59.494 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.491+0000 7faa5d6a2700 1 -- 172.21.15.155:0/2995929980 shutdown_connections 2023-12-16T05:53:59.494 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.491+0000 7faa5d6a2700 1 -- 172.21.15.155:0/2995929980 wait complete. 2023-12-16T05:53:59.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.491+0000 7faa5d6a2700 1 Processor -- start 2023-12-16T05:53:59.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.491+0000 7faa5d6a2700 1 -- start start 2023-12-16T05:53:59.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.492+0000 7faa5d6a2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa580fc5d0 0x7faa58115980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:59.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.492+0000 7faa5d6a2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa580fcee0 0x7faa58115ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:59.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.492+0000 7faa5d6a2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa58116510 con 0x7faa580fcee0 2023-12-16T05:53:59.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.492+0000 7faa5d6a2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5810f840 con 0x7faa580fc5d0 2023-12-16T05:53:59.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.492+0000 7faa567fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa580fcee0 0x7faa58115ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:59.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.492+0000 7faa567fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa580fcee0 0x7faa58115ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52766/0 (socket says 172.21.15.155:52766) 2023-12-16T05:53:59.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.492+0000 7faa567fc700 1 -- 172.21.15.155:0/1073743779 learned_addr learned my addr 172.21.15.155:0/1073743779 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:53:59.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.492+0000 7faa56ffd700 1 --2- 172.21.15.155:0/1073743779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa580fc5d0 0x7faa58115980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:59.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.492+0000 7faa567fc700 1 -- 172.21.15.155:0/1073743779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa580fc5d0 msgr2=0x7faa58115980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:59.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.492+0000 7faa567fc700 1 --2- 172.21.15.155:0/1073743779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa580fc5d0 0x7faa58115980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.492+0000 7faa567fc700 1 -- 172.21.15.155:0/1073743779 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c005040 con 0x7faa580fcee0 2023-12-16T05:53:59.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.492+0000 7faa567fc700 1 --2- 172.21.15.155:0/1073743779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa580fcee0 0x7faa58115ec0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00b3b0 tx=0x7faa4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:59.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.492+0000 7faa3f7fe700 1 -- 172.21.15.155:0/1073743779 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa4c00e040 con 0x7faa580fcee0 2023-12-16T05:53:59.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.492+0000 7faa5d6a2700 1 -- 172.21.15.155:0/1073743779 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5810fac0 con 0x7faa580fcee0 2023-12-16T05:53:59.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.492+0000 7faa3f7fe700 1 -- 172.21.15.155:0/1073743779 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faa4c01c430 con 0x7faa580fcee0 2023-12-16T05:53:59.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.492+0000 7faa3f7fe700 1 -- 172.21.15.155:0/1073743779 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa4c013640 con 0x7faa580fcee0 2023-12-16T05:53:59.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.493+0000 7faa5d6a2700 1 -- 172.21.15.155:0/1073743779 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa58110000 con 0x7faa580fcee0 2023-12-16T05:53:59.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.493+0000 7faa5d6a2700 1 -- 172.21.15.155:0/1073743779 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa581104a0 con 0x7faa580fcee0 2023-12-16T05:53:59.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.494+0000 7faa3f7fe700 1 -- 172.21.15.155:0/1073743779 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7faa4c01c5a0 con 0x7faa580fcee0 2023-12-16T05:53:59.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.494+0000 7faa3f7fe700 1 --2- 172.21.15.155:0/1073743779 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7faa40068f60 0x7faa4006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:59.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.494+0000 7faa3f7fe700 1 -- 172.21.15.155:0/1073743779 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7faa4c0875a0 con 0x7faa580fcee0 2023-12-16T05:53:59.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.494+0000 7faa56ffd700 1 --2- 172.21.15.155:0/1073743779 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7faa40068f60 0x7faa4006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:59.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.495+0000 7faa3f7fe700 1 --2- 172.21.15.155:0/1073743779 >> [v2:172.21.15.156:6816/81941755,v1:172.21.15.156:6817/81941755] conn(0x7faa4006ec30 0x7faa40071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:59.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.495+0000 7faa3f7fe700 1 -- 172.21.15.155:0/1073743779 --> [v2:172.21.15.156:6816/81941755,v1:172.21.15.156:6817/81941755] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa400716f0 con 0x7faa4006ec30 2023-12-16T05:53:59.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.495+0000 7faa3f7fe700 1 -- 172.21.15.155:0/1073743779 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa4c089b90 con 0x7faa580fcee0 2023-12-16T05:53:59.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.495+0000 7faa577fe700 1 --2- 172.21.15.155:0/1073743779 >> [v2:172.21.15.156:6816/81941755,v1:172.21.15.156:6817/81941755] conn(0x7faa4006ec30 0x7faa40071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:59.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.495+0000 7faa56ffd700 1 --2- 172.21.15.155:0/1073743779 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7faa40068f60 0x7faa4006b410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faa480041d0 tx=0x7faa480043c0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:59.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.495+0000 7faa577fe700 1 --2- 172.21.15.155:0/1073743779 >> [v2:172.21.15.156:6816/81941755,v1:172.21.15.156:6817/81941755] conn(0x7faa4006ec30 0x7faa40071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:59.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.496+0000 7faa3f7fe700 1 -- 172.21.15.155:0/1073743779 <== osd.5 v2:172.21.15.156:6816/81941755 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7faa400716f0 con 0x7faa4006ec30 2023-12-16T05:53:59.514 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.511+0000 7faa5d6a2700 1 -- 172.21.15.155:0/1073743779 --> [v2:172.21.15.156:6816/81941755,v1:172.21.15.156:6817/81941755] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faa5805e2c0 con 0x7faa4006ec30 2023-12-16T05:53:59.514 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.512+0000 7faa3f7fe700 1 -- 172.21.15.155:0/1073743779 <== osd.5 v2:172.21.15.156:6816/81941755 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7faa5805e2c0 con 0x7faa4006ec30 2023-12-16T05:53:59.515 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.512+0000 7faa5d6a2700 1 -- 172.21.15.155:0/1073743779 >> [v2:172.21.15.156:6816/81941755,v1:172.21.15.156:6817/81941755] conn(0x7faa4006ec30 msgr2=0x7faa40071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:59.515 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.512+0000 7faa5d6a2700 1 --2- 172.21.15.155:0/1073743779 >> [v2:172.21.15.156:6816/81941755,v1:172.21.15.156:6817/81941755] conn(0x7faa4006ec30 0x7faa40071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.515 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.512+0000 7faa5d6a2700 1 -- 172.21.15.155:0/1073743779 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7faa40068f60 msgr2=0x7faa4006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:59.516 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.512+0000 7faa5d6a2700 1 --2- 172.21.15.155:0/1073743779 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7faa40068f60 0x7faa4006b410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faa480041d0 tx=0x7faa480043c0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.516 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.512+0000 7faa5d6a2700 1 -- 172.21.15.155:0/1073743779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa580fcee0 msgr2=0x7faa58115ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:59.516 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.512+0000 7faa5d6a2700 1 --2- 172.21.15.155:0/1073743779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa580fcee0 0x7faa58115ec0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00b3b0 tx=0x7faa4c009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:59.516 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.512+0000 7faa5d6a2700 1 -- 172.21.15.155:0/1073743779 shutdown_connections 2023-12-16T05:53:59.516 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.512+0000 7faa5d6a2700 1 --2- 172.21.15.155:0/1073743779 >> [v2:172.21.15.156:6816/81941755,v1:172.21.15.156:6817/81941755] conn(0x7faa4006ec30 0x7faa40071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.516 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.512+0000 7faa5d6a2700 1 --2- 172.21.15.155:0/1073743779 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7faa40068f60 0x7faa4006b410 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.516 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.512+0000 7faa5d6a2700 1 --2- 172.21.15.155:0/1073743779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa580fc5d0 0x7faa58115980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.516 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.512+0000 7faa5d6a2700 1 --2- 172.21.15.155:0/1073743779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa580fcee0 0x7faa58115ec0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.516 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.512+0000 7faa5d6a2700 1 -- 172.21.15.155:0/1073743779 >> 172.21.15.155:0/1073743779 conn(0x7faa580719b0 msgr2=0x7faa580fa770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:59.516 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.512+0000 7faa5d6a2700 1 -- 172.21.15.155:0/1073743779 shutdown_connections 2023-12-16T05:53:59.516 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.512+0000 7faa5d6a2700 1 -- 172.21.15.155:0/1073743779 wait complete. 2023-12-16T05:53:59.544 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:53:59 smithi155 ceph-mon[112451]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:53:59.627 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.624+0000 7fe157246700 1 -- 172.21.15.155:0/3048378462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1501035a0 msgr2=0x7fe1500fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:59.628 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.624+0000 7fe157246700 1 --2- 172.21.15.155:0/3048378462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1501035a0 0x7fe1500fcc10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe144004940 tx=0x7fe144009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:59.628 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.624+0000 7fe157246700 1 -- 172.21.15.155:0/3048378462 shutdown_connections 2023-12-16T05:53:59.628 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.624+0000 7fe157246700 1 --2- 172.21.15.155:0/3048378462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1501035a0 0x7fe1500fcc10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.628 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.624+0000 7fe157246700 1 --2- 172.21.15.155:0/3048378462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe150102c00 0x7fe150102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.628 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.624+0000 7fe157246700 1 -- 172.21.15.155:0/3048378462 >> 172.21.15.155:0/3048378462 conn(0x7fe1500f8790 msgr2=0x7fe1500faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:59.628 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.625+0000 7fe157246700 1 -- 172.21.15.155:0/3048378462 shutdown_connections 2023-12-16T05:53:59.628 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.625+0000 7fe157246700 1 -- 172.21.15.155:0/3048378462 wait complete. 2023-12-16T05:53:59.632 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.625+0000 7fe157246700 1 Processor -- start 2023-12-16T05:53:59.632 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.625+0000 7fe157246700 1 -- start start 2023-12-16T05:53:59.632 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.625+0000 7fe157246700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe150102c00 0x7fe15006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:59.632 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.625+0000 7fe157246700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1501035a0 0x7fe150070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:59.632 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.625+0000 7fe157246700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe150070a80 con 0x7fe150102c00 2023-12-16T05:53:59.632 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.625+0000 7fe157246700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe150070bf0 con 0x7fe1501035a0 2023-12-16T05:53:59.632 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.626+0000 7fe154fe2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe150102c00 0x7fe15006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:59.632 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.626+0000 7fe154fe2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe150102c00 0x7fe15006ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52792/0 (socket says 172.21.15.155:52792) 2023-12-16T05:53:59.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.626+0000 7fe154fe2700 1 -- 172.21.15.155:0/349332999 learned_addr learned my addr 172.21.15.155:0/349332999 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:53:59.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.626+0000 7fe14ffff700 1 --2- 172.21.15.155:0/349332999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1501035a0 0x7fe150070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:59.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.626+0000 7fe154fe2700 1 -- 172.21.15.155:0/349332999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1501035a0 msgr2=0x7fe150070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:59.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.626+0000 7fe154fe2700 1 --2- 172.21.15.155:0/349332999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1501035a0 0x7fe150070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.626+0000 7fe154fe2700 1 -- 172.21.15.155:0/349332999 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe144005040 con 0x7fe150102c00 2023-12-16T05:53:59.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.626+0000 7fe154fe2700 1 --2- 172.21.15.155:0/349332999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe150102c00 0x7fe15006ff40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe14000eb70 tx=0x7fe14000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:59.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.626+0000 7fe14d7fa700 1 -- 172.21.15.155:0/349332999 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe140007cc0 con 0x7fe150102c00 2023-12-16T05:53:59.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.626+0000 7fe157246700 1 -- 172.21.15.155:0/349332999 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1501198c0 con 0x7fe150102c00 2023-12-16T05:53:59.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.626+0000 7fe14d7fa700 1 -- 172.21.15.155:0/349332999 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe14000f040 con 0x7fe150102c00 2023-12-16T05:53:59.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.626+0000 7fe14d7fa700 1 -- 172.21.15.155:0/349332999 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe14000c9f0 con 0x7fe150102c00 2023-12-16T05:53:59.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.626+0000 7fe157246700 1 -- 172.21.15.155:0/349332999 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe150119d20 con 0x7fe150102c00 2023-12-16T05:53:59.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.627+0000 7fe157246700 1 -- 172.21.15.155:0/349332999 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe15005e300 con 0x7fe150102c00 2023-12-16T05:53:59.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.628+0000 7fe14d7fa700 1 -- 172.21.15.155:0/349332999 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fe14000cb50 con 0x7fe150102c00 2023-12-16T05:53:59.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.628+0000 7fe14d7fa700 1 --2- 172.21.15.155:0/349332999 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fe138068f70 0x7fe13806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:59.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.628+0000 7fe14d7fa700 1 -- 172.21.15.155:0/349332999 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe140086610 con 0x7fe150102c00 2023-12-16T05:53:59.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.628+0000 7fe14ffff700 1 --2- 172.21.15.155:0/349332999 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fe138068f70 0x7fe13806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:59.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.628+0000 7fe14d7fa700 1 --2- 172.21.15.155:0/349332999 >> [v2:172.21.15.156:6808/2759834290,v1:172.21.15.156:6809/2759834290] conn(0x7fe13806ec40 0x7fe138071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:53:59.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.628+0000 7fe14d7fa700 1 -- 172.21.15.155:0/349332999 --> [v2:172.21.15.156:6808/2759834290,v1:172.21.15.156:6809/2759834290] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe138071700 con 0x7fe13806ec40 2023-12-16T05:53:59.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.628+0000 7fe14d7fa700 1 -- 172.21.15.155:0/349332999 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe140088c60 con 0x7fe150102c00 2023-12-16T05:53:59.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.628+0000 7fe1557e3700 1 --2- 172.21.15.155:0/349332999 >> [v2:172.21.15.156:6808/2759834290,v1:172.21.15.156:6809/2759834290] conn(0x7fe13806ec40 0x7fe138071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:53:59.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.629+0000 7fe14ffff700 1 --2- 172.21.15.155:0/349332999 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fe138068f70 0x7fe13806b420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe150072050 tx=0x7fe144009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:59.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.629+0000 7fe1557e3700 1 --2- 172.21.15.155:0/349332999 >> [v2:172.21.15.156:6808/2759834290,v1:172.21.15.156:6809/2759834290] conn(0x7fe13806ec40 0x7fe138071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:53:59.635 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.630+0000 7fe14d7fa700 1 -- 172.21.15.155:0/349332999 <== osd.4 v2:172.21.15.156:6808/2759834290 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe138071700 con 0x7fe13806ec40 2023-12-16T05:53:59.649 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.645+0000 7fe157246700 1 -- 172.21.15.155:0/349332999 --> [v2:172.21.15.156:6808/2759834290,v1:172.21.15.156:6809/2759834290] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe15005e780 con 0x7fe13806ec40 2023-12-16T05:53:59.649 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.646+0000 7fe14d7fa700 1 -- 172.21.15.155:0/349332999 <== osd.4 v2:172.21.15.156:6808/2759834290 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe15005e780 con 0x7fe13806ec40 2023-12-16T05:53:59.650 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.646+0000 7fe157246700 1 -- 172.21.15.155:0/349332999 >> [v2:172.21.15.156:6808/2759834290,v1:172.21.15.156:6809/2759834290] conn(0x7fe13806ec40 msgr2=0x7fe138071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:59.650 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.646+0000 7fe157246700 1 --2- 172.21.15.155:0/349332999 >> [v2:172.21.15.156:6808/2759834290,v1:172.21.15.156:6809/2759834290] conn(0x7fe13806ec40 0x7fe138071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.650 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.646+0000 7fe157246700 1 -- 172.21.15.155:0/349332999 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fe138068f70 msgr2=0x7fe13806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:59.650 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.646+0000 7fe157246700 1 --2- 172.21.15.155:0/349332999 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fe138068f70 0x7fe13806b420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe150072050 tx=0x7fe144009e30 comp rx=0 tx=0).stop 2023-12-16T05:53:59.650 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.646+0000 7fe157246700 1 -- 172.21.15.155:0/349332999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe150102c00 msgr2=0x7fe15006ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:53:59.650 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.646+0000 7fe157246700 1 --2- 172.21.15.155:0/349332999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe150102c00 0x7fe15006ff40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe14000eb70 tx=0x7fe14000b040 comp rx=0 tx=0).stop 2023-12-16T05:53:59.650 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.646+0000 7fe157246700 1 -- 172.21.15.155:0/349332999 shutdown_connections 2023-12-16T05:53:59.650 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.646+0000 7fe157246700 1 --2- 172.21.15.155:0/349332999 >> [v2:172.21.15.156:6808/2759834290,v1:172.21.15.156:6809/2759834290] conn(0x7fe13806ec40 0x7fe138071050 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.650 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.646+0000 7fe157246700 1 --2- 172.21.15.155:0/349332999 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fe138068f70 0x7fe13806b420 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.650 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.646+0000 7fe157246700 1 --2- 172.21.15.155:0/349332999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe150102c00 0x7fe15006ff40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.650 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.646+0000 7fe157246700 1 --2- 172.21.15.155:0/349332999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1501035a0 0x7fe150070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:53:59.650 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.646+0000 7fe157246700 1 -- 172.21.15.155:0/349332999 >> 172.21.15.155:0/349332999 conn(0x7fe1500f8790 msgr2=0x7fe1500fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:53:59.650 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.646+0000 7fe157246700 1 -- 172.21.15.155:0/349332999 shutdown_connections 2023-12-16T05:53:59.650 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.646+0000 7fe157246700 1 -- 172.21.15.155:0/349332999 wait complete. 2023-12-16T05:53:59.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:53:59 smithi156 ceph-mon[121001]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:53:59.858 INFO:teuthology.orchestra.run.smithi155.stdout:107374182413 2023-12-16T05:53:59.858 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.3 2023-12-16T05:54:00.104 INFO:teuthology.orchestra.run.smithi155.stdout:158913789959 2023-12-16T05:54:00.104 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.5 2023-12-16T05:54:00.136 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.982+0000 7f2f719c4700 1 -- 172.21.15.155:0/1143365622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f6c101af0 msgr2=0x7f2f6c101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:00.136 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.982+0000 7f2f719c4700 1 --2- 172.21.15.155:0/1143365622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f6c101af0 0x7f2f6c101ec0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c004940 tx=0x7f2f5c009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:00.136 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.982+0000 7f2f719c4700 1 -- 172.21.15.155:0/1143365622 shutdown_connections 2023-12-16T05:54:00.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.982+0000 7f2f719c4700 1 --2- 172.21.15.155:0/1143365622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f6c0fbb30 0x7f2f6c0fbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:00.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.982+0000 7f2f719c4700 1 --2- 172.21.15.155:0/1143365622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f6c101af0 0x7f2f6c101ec0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:00.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.982+0000 7f2f719c4700 1 -- 172.21.15.155:0/1143365622 >> 172.21.15.155:0/1143365622 conn(0x7f2f6c0f7690 msgr2=0x7f2f6c0f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:00.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.982+0000 7f2f719c4700 1 -- 172.21.15.155:0/1143365622 shutdown_connections 2023-12-16T05:54:00.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.982+0000 7f2f719c4700 1 -- 172.21.15.155:0/1143365622 wait complete. 2023-12-16T05:54:00.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.983+0000 7f2f719c4700 1 Processor -- start 2023-12-16T05:54:00.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.983+0000 7f2f719c4700 1 -- start start 2023-12-16T05:54:00.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.984+0000 7f2f719c4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f6c0fbb30 0x7f2f6c1125d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:00.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.984+0000 7f2f719c4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f6c101af0 0x7f2f6c112b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:00.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.984+0000 7f2f719c4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c1131f0 con 0x7f2f6c101af0 2023-12-16T05:54:00.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.984+0000 7f2f719c4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c10c500 con 0x7f2f6c0fbb30 2023-12-16T05:54:00.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.984+0000 7f2f6a7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f6c101af0 0x7f2f6c112b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:00.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.984+0000 7f2f6a7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f6c101af0 0x7f2f6c112b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52814/0 (socket says 172.21.15.155:52814) 2023-12-16T05:54:00.138 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.984+0000 7f2f6a7fc700 1 -- 172.21.15.155:0/3622426812 learned_addr learned my addr 172.21.15.155:0/3622426812 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:00.138 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.984+0000 7f2f6affd700 1 --2- 172.21.15.155:0/3622426812 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f6c0fbb30 0x7f2f6c1125d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:00.138 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.984+0000 7f2f6a7fc700 1 -- 172.21.15.155:0/3622426812 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f6c0fbb30 msgr2=0x7f2f6c1125d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:00.138 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.984+0000 7f2f6a7fc700 1 --2- 172.21.15.155:0/3622426812 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f6c0fbb30 0x7f2f6c1125d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:00.138 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.984+0000 7f2f6a7fc700 1 -- 172.21.15.155:0/3622426812 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c005040 con 0x7f2f6c101af0 2023-12-16T05:54:00.138 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.984+0000 7f2f6a7fc700 1 --2- 172.21.15.155:0/3622426812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f6c101af0 0x7f2f6c112b10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000b790 tx=0x7f2f60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:00.138 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.984+0000 7f2f537fe700 1 -- 172.21.15.155:0/3622426812 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f6000f6f0 con 0x7f2f6c101af0 2023-12-16T05:54:00.138 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.984+0000 7f2f537fe700 1 -- 172.21.15.155:0/3622426812 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f6000fd00 con 0x7f2f6c101af0 2023-12-16T05:54:00.138 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.984+0000 7f2f719c4700 1 -- 172.21.15.155:0/3622426812 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c10c7e0 con 0x7f2f6c101af0 2023-12-16T05:54:00.138 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.984+0000 7f2f537fe700 1 -- 172.21.15.155:0/3622426812 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f600103a0 con 0x7f2f6c101af0 2023-12-16T05:54:00.138 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.984+0000 7f2f719c4700 1 -- 172.21.15.155:0/3622426812 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6c10cd20 con 0x7f2f6c101af0 2023-12-16T05:54:00.138 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.985+0000 7f2f719c4700 1 -- 172.21.15.155:0/3622426812 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2f6c10d220 con 0x7f2f6c101af0 2023-12-16T05:54:00.138 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.986+0000 7f2f537fe700 1 -- 172.21.15.155:0/3622426812 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f2f6000f850 con 0x7f2f6c101af0 2023-12-16T05:54:00.138 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.986+0000 7f2f537fe700 1 --2- 172.21.15.155:0/3622426812 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2f54068f60 0x7f2f5406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:00.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.986+0000 7f2f537fe700 1 -- 172.21.15.155:0/3622426812 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2f600873e0 con 0x7f2f6c101af0 2023-12-16T05:54:00.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.986+0000 7f2f6affd700 1 --2- 172.21.15.155:0/3622426812 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2f54068f60 0x7f2f5406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:00.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.986+0000 7f2f537fe700 1 --2- 172.21.15.155:0/3622426812 >> [v2:172.21.15.155:6810/3291965512,v1:172.21.15.155:6811/3291965512] conn(0x7f2f5406ec30 0x7f2f54071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:00.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.986+0000 7f2f537fe700 1 -- 172.21.15.155:0/3622426812 --> [v2:172.21.15.155:6810/3291965512,v1:172.21.15.155:6811/3291965512] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f540716f0 con 0x7f2f5406ec30 2023-12-16T05:54:00.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.986+0000 7f2f537fe700 1 -- 172.21.15.155:0/3622426812 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f600877c0 con 0x7f2f6c101af0 2023-12-16T05:54:00.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.987+0000 7f2f6b7fe700 1 --2- 172.21.15.155:0/3622426812 >> [v2:172.21.15.155:6810/3291965512,v1:172.21.15.155:6811/3291965512] conn(0x7f2f5406ec30 0x7f2f54071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:00.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.987+0000 7f2f6affd700 1 --2- 172.21.15.155:0/3622426812 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2f54068f60 0x7f2f5406b410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c004f90 tx=0x7f2f5c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:00.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.987+0000 7f2f6b7fe700 1 --2- 172.21.15.155:0/3622426812 >> [v2:172.21.15.155:6810/3291965512,v1:172.21.15.155:6811/3291965512] conn(0x7f2f5406ec30 0x7f2f54071040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:00.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:53:59.987+0000 7f2f537fe700 1 -- 172.21.15.155:0/3622426812 <== osd.1 v2:172.21.15.155:6810/3291965512 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2f540716f0 con 0x7f2f5406ec30 2023-12-16T05:54:00.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:00.003+0000 7f2f719c4700 1 -- 172.21.15.155:0/3622426812 --> [v2:172.21.15.155:6810/3291965512,v1:172.21.15.155:6811/3291965512] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2f6c05e2c0 con 0x7f2f5406ec30 2023-12-16T05:54:00.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:00.003+0000 7f2f537fe700 1 -- 172.21.15.155:0/3622426812 <== osd.1 v2:172.21.15.155:6810/3291965512 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2f6c05e2c0 con 0x7f2f5406ec30 2023-12-16T05:54:00.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:00.003+0000 7f2f719c4700 1 -- 172.21.15.155:0/3622426812 >> [v2:172.21.15.155:6810/3291965512,v1:172.21.15.155:6811/3291965512] conn(0x7f2f5406ec30 msgr2=0x7f2f54071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:00.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:00.003+0000 7f2f719c4700 1 --2- 172.21.15.155:0/3622426812 >> [v2:172.21.15.155:6810/3291965512,v1:172.21.15.155:6811/3291965512] conn(0x7f2f5406ec30 0x7f2f54071040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:00.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:00.003+0000 7f2f719c4700 1 -- 172.21.15.155:0/3622426812 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2f54068f60 msgr2=0x7f2f5406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:00.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:00.003+0000 7f2f719c4700 1 --2- 172.21.15.155:0/3622426812 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2f54068f60 0x7f2f5406b410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c004f90 tx=0x7f2f5c009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:00.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:00.003+0000 7f2f719c4700 1 -- 172.21.15.155:0/3622426812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f6c101af0 msgr2=0x7f2f6c112b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:00.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:00.003+0000 7f2f719c4700 1 --2- 172.21.15.155:0/3622426812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f6c101af0 0x7f2f6c112b10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000b790 tx=0x7f2f60009250 comp rx=0 tx=0).stop 2023-12-16T05:54:00.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:00.003+0000 7f2f719c4700 1 -- 172.21.15.155:0/3622426812 shutdown_connections 2023-12-16T05:54:00.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:00.003+0000 7f2f719c4700 1 --2- 172.21.15.155:0/3622426812 >> [v2:172.21.15.155:6810/3291965512,v1:172.21.15.155:6811/3291965512] conn(0x7f2f5406ec30 0x7f2f54071040 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:00.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:00.003+0000 7f2f719c4700 1 --2- 172.21.15.155:0/3622426812 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2f54068f60 0x7f2f5406b410 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:00.141 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:00.003+0000 7f2f719c4700 1 --2- 172.21.15.155:0/3622426812 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f6c0fbb30 0x7f2f6c1125d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:00.141 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:00.003+0000 7f2f719c4700 1 --2- 172.21.15.155:0/3622426812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f6c101af0 0x7f2f6c112b10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:00.141 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:00.003+0000 7f2f719c4700 1 -- 172.21.15.155:0/3622426812 >> 172.21.15.155:0/3622426812 conn(0x7f2f6c0f7690 msgr2=0x7f2f6c0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:00.141 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:00.004+0000 7f2f719c4700 1 -- 172.21.15.155:0/3622426812 shutdown_connections 2023-12-16T05:54:00.141 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:00.004+0000 7f2f719c4700 1 -- 172.21.15.155:0/3622426812 wait complete. 2023-12-16T05:54:00.599 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:00.623 INFO:teuthology.orchestra.run.smithi155.stdout:137438953482 2023-12-16T05:54:00.623 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.4 2023-12-16T05:54:00.655 INFO:teuthology.orchestra.run.smithi155.stdout:60129542166 2023-12-16T05:54:00.655 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.1 2023-12-16T05:54:00.878 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:00.878 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:01.468 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:01.730 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:01 smithi155 ceph-mon[112451]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:01.730 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:01 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:54:01.900 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:01.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:01 smithi156 ceph-mon[121001]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:01.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:01 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:54:02.003 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.930+0000 7f113e514700 1 -- 172.21.15.155:0/1980240551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1138101b00 msgr2=0x7f1138101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:02.003 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.930+0000 7f113e514700 1 --2- 172.21.15.155:0/1980240551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1138101b00 0x7f1138101ed0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1128004940 tx=0x7f1128009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:02.003 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.930+0000 7f113e514700 1 -- 172.21.15.155:0/1980240551 shutdown_connections 2023-12-16T05:54:02.003 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.930+0000 7f113e514700 1 --2- 172.21.15.155:0/1980240551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11380fbb40 0x7f11380fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:02.003 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.930+0000 7f113e514700 1 --2- 172.21.15.155:0/1980240551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1138101b00 0x7f1138101ed0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:02.003 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.930+0000 7f113e514700 1 -- 172.21.15.155:0/1980240551 >> 172.21.15.155:0/1980240551 conn(0x7f11380719b0 msgr2=0x7f1138071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:02.003 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.930+0000 7f113e514700 1 -- 172.21.15.155:0/1980240551 shutdown_connections 2023-12-16T05:54:02.003 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.930+0000 7f113e514700 1 -- 172.21.15.155:0/1980240551 wait complete. 2023-12-16T05:54:02.003 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.930+0000 7f113e514700 1 Processor -- start 2023-12-16T05:54:02.003 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.931+0000 7f113e514700 1 -- start start 2023-12-16T05:54:02.003 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.931+0000 7f113e514700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11380fbb40 0x7f113806f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:02.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.931+0000 7f113e514700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1138101b00 0x7f113806a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:02.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.931+0000 7f113e514700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113806ade0 con 0x7f11380fbb40 2023-12-16T05:54:02.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.931+0000 7f113e514700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113806af50 con 0x7f1138101b00 2023-12-16T05:54:02.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.931+0000 7f1137fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11380fbb40 0x7f113806f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:02.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.931+0000 7f1137fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11380fbb40 0x7f113806f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52840/0 (socket says 172.21.15.155:52840) 2023-12-16T05:54:02.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.931+0000 7f1137fff700 1 -- 172.21.15.155:0/2811228900 learned_addr learned my addr 172.21.15.155:0/2811228900 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:02.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.931+0000 7f11377fe700 1 --2- 172.21.15.155:0/2811228900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1138101b00 0x7f113806a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:02.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.931+0000 7f1137fff700 1 -- 172.21.15.155:0/2811228900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1138101b00 msgr2=0x7f113806a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:02.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.931+0000 7f1137fff700 1 --2- 172.21.15.155:0/2811228900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1138101b00 0x7f113806a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:02.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.931+0000 7f1137fff700 1 -- 172.21.15.155:0/2811228900 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1128005040 con 0x7f11380fbb40 2023-12-16T05:54:02.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.932+0000 7f1137fff700 1 --2- 172.21.15.155:0/2811228900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11380fbb40 0x7f113806f8e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1128009180 tx=0x7f1128009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:02.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.932+0000 7f1134ff9700 1 -- 172.21.15.155:0/2811228900 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f112800e040 con 0x7f11380fbb40 2023-12-16T05:54:02.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.932+0000 7f1134ff9700 1 -- 172.21.15.155:0/2811228900 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1128004290 con 0x7f11380fbb40 2023-12-16T05:54:02.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.932+0000 7f113e514700 1 -- 172.21.15.155:0/2811228900 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113806b1d0 con 0x7f11380fbb40 2023-12-16T05:54:02.005 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.932+0000 7f1134ff9700 1 -- 172.21.15.155:0/2811228900 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f112801c3f0 con 0x7f11380fbb40 2023-12-16T05:54:02.005 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.932+0000 7f113e514700 1 -- 172.21.15.155:0/2811228900 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113811f2c0 con 0x7f11380fbb40 2023-12-16T05:54:02.005 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.933+0000 7f113e514700 1 -- 172.21.15.155:0/2811228900 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1138103fb0 con 0x7f11380fbb40 2023-12-16T05:54:02.005 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.933+0000 7f1134ff9700 1 -- 172.21.15.155:0/2811228900 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f1128013420 con 0x7f11380fbb40 2023-12-16T05:54:02.005 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.934+0000 7f1134ff9700 1 --2- 172.21.15.155:0/2811228900 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f1120068f60 0x7f112006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:02.005 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.934+0000 7f1134ff9700 1 -- 172.21.15.155:0/2811228900 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1128087d40 con 0x7f11380fbb40 2023-12-16T05:54:02.005 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.934+0000 7f11377fe700 1 --2- 172.21.15.155:0/2811228900 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f1120068f60 0x7f112006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:02.005 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.934+0000 7f11377fe700 1 --2- 172.21.15.155:0/2811228900 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f1120068f60 0x7f112006b410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f113806c190 tx=0x7f112c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:02.005 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:01.938+0000 7f1134ff9700 1 -- 172.21.15.155:0/2811228900 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1128054550 con 0x7f11380fbb40 2023-12-16T05:54:02.101 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:02.143 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:02.140+0000 7f113e514700 1 -- 172.21.15.155:0/2811228900 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f113804bb80 con 0x7f11380fbb40 2023-12-16T05:54:02.143 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:02.141+0000 7f1134ff9700 1 -- 172.21.15.155:0/2811228900 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1128057b70 con 0x7f11380fbb40 2023-12-16T05:54:02.144 INFO:teuthology.orchestra.run.smithi155.stdout:81604378641 2023-12-16T05:54:02.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:02.144+0000 7f113e514700 1 -- 172.21.15.155:0/2811228900 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f1120068f60 msgr2=0x7f112006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:02.147 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:02.144+0000 7f113e514700 1 --2- 172.21.15.155:0/2811228900 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f1120068f60 0x7f112006b410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f113806c190 tx=0x7f112c00b040 comp rx=0 tx=0).stop 2023-12-16T05:54:02.147 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:02.144+0000 7f113e514700 1 -- 172.21.15.155:0/2811228900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11380fbb40 msgr2=0x7f113806f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:02.147 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:02.144+0000 7f113e514700 1 --2- 172.21.15.155:0/2811228900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11380fbb40 0x7f113806f8e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1128009180 tx=0x7f1128009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:02.147 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:02.144+0000 7f113e514700 1 -- 172.21.15.155:0/2811228900 shutdown_connections 2023-12-16T05:54:02.147 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:02.144+0000 7f113e514700 1 --2- 172.21.15.155:0/2811228900 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f1120068f60 0x7f112006b410 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f113806c190 tx=0x7f112c00b040 comp rx=0 tx=0).stop 2023-12-16T05:54:02.147 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:02.144+0000 7f113e514700 1 --2- 172.21.15.155:0/2811228900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11380fbb40 0x7f113806f8e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:02.147 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:02.144+0000 7f113e514700 1 --2- 172.21.15.155:0/2811228900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1138101b00 0x7f113806a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:02.147 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:02.144+0000 7f113e514700 1 -- 172.21.15.155:0/2811228900 >> 172.21.15.155:0/2811228900 conn(0x7f11380719b0 msgr2=0x7f11380fab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:02.147 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:02.145+0000 7f113e514700 1 -- 172.21.15.155:0/2811228900 shutdown_connections 2023-12-16T05:54:02.148 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:02.145+0000 7f113e514700 1 -- 172.21.15.155:0/2811228900 wait complete. 2023-12-16T05:54:02.705 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:02 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2811228900' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-16T05:54:02.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:02 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/2811228900' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-16T05:54:03.117 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378640 got 81604378641 for osd.2 2023-12-16T05:54:03.117 DEBUG:teuthology.parallel:result is None 2023-12-16T05:54:03.650 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:03 smithi155 ceph-mon[112451]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:03.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:03 smithi156 ceph-mon[121001]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:04.075 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.071+0000 7fe0ebaf1700 1 -- 172.21.15.155:0/3051947600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0e4102c20 msgr2=0x7fe0e4102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:04.075 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.071+0000 7fe0ebaf1700 1 --2- 172.21.15.155:0/3051947600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0e4102c20 0x7fe0e4102ff0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0004940 tx=0x7fe0e0009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:04.075 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.071+0000 7fe0ebaf1700 1 -- 172.21.15.155:0/3051947600 shutdown_connections 2023-12-16T05:54:04.075 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.071+0000 7fe0ebaf1700 1 --2- 172.21.15.155:0/3051947600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0e4065390 0x7fe0e4065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:04.075 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.071+0000 7fe0ebaf1700 1 --2- 172.21.15.155:0/3051947600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0e4102c20 0x7fe0e4102ff0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:04.075 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.071+0000 7fe0ebaf1700 1 -- 172.21.15.155:0/3051947600 >> 172.21.15.155:0/3051947600 conn(0x7fe0e40719b0 msgr2=0x7fe0e4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:04.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.071+0000 7fe0ebaf1700 1 -- 172.21.15.155:0/3051947600 shutdown_connections 2023-12-16T05:54:04.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.071+0000 7fe0ebaf1700 1 -- 172.21.15.155:0/3051947600 wait complete. 2023-12-16T05:54:04.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.071+0000 7fe0ebaf1700 1 Processor -- start 2023-12-16T05:54:04.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.071+0000 7fe0ebaf1700 1 -- start start 2023-12-16T05:54:04.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.072+0000 7fe0ebaf1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0e4065390 0x7fe0e4113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:04.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.072+0000 7fe0ebaf1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0e4102c20 0x7fe0e4113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:04.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.072+0000 7fe0ebaf1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e41141e0 con 0x7fe0e4102c20 2023-12-16T05:54:04.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.072+0000 7fe0ebaf1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e410d4d0 con 0x7fe0e4065390 2023-12-16T05:54:04.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.072+0000 7fe0e908c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0e4102c20 0x7fe0e4113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:04.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.072+0000 7fe0e908c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0e4102c20 0x7fe0e4113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52868/0 (socket says 172.21.15.155:52868) 2023-12-16T05:54:04.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.072+0000 7fe0e908c700 1 -- 172.21.15.155:0/614778525 learned_addr learned my addr 172.21.15.155:0/614778525 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:04.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.072+0000 7fe0e988d700 1 --2- 172.21.15.155:0/614778525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0e4065390 0x7fe0e4113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:04.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.072+0000 7fe0e908c700 1 -- 172.21.15.155:0/614778525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0e4065390 msgr2=0x7fe0e4113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:04.077 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.072+0000 7fe0e908c700 1 --2- 172.21.15.155:0/614778525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0e4065390 0x7fe0e4113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:04.077 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.072+0000 7fe0e908c700 1 -- 172.21.15.155:0/614778525 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e0005040 con 0x7fe0e4102c20 2023-12-16T05:54:04.077 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.072+0000 7fe0e908c700 1 --2- 172.21.15.155:0/614778525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0e4102c20 0x7fe0e4113b90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4002a80 tx=0x7fe0d40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:04.077 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.072+0000 7fe0da7fc700 1 -- 172.21.15.155:0/614778525 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0d4007cc0 con 0x7fe0e4102c20 2023-12-16T05:54:04.077 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.072+0000 7fe0da7fc700 1 -- 172.21.15.155:0/614778525 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe0d400f040 con 0x7fe0e4102c20 2023-12-16T05:54:04.077 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.072+0000 7fe0ebaf1700 1 -- 172.21.15.155:0/614778525 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e410d760 con 0x7fe0e4102c20 2023-12-16T05:54:04.077 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.072+0000 7fe0da7fc700 1 -- 172.21.15.155:0/614778525 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0d400da60 con 0x7fe0e4102c20 2023-12-16T05:54:04.078 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.072+0000 7fe0ebaf1700 1 -- 172.21.15.155:0/614778525 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e410dca0 con 0x7fe0e4102c20 2023-12-16T05:54:04.078 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.073+0000 7fe0ebaf1700 1 -- 172.21.15.155:0/614778525 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e40fff40 con 0x7fe0e4102c20 2023-12-16T05:54:04.078 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.074+0000 7fe0da7fc700 1 -- 172.21.15.155:0/614778525 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fe0d400dbc0 con 0x7fe0e4102c20 2023-12-16T05:54:04.079 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.074+0000 7fe0da7fc700 1 --2- 172.21.15.155:0/614778525 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fe0d0068f60 0x7fe0d006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:04.079 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.075+0000 7fe0da7fc700 1 -- 172.21.15.155:0/614778525 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe0d40866d0 con 0x7fe0e4102c20 2023-12-16T05:54:04.079 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.075+0000 7fe0e988d700 1 --2- 172.21.15.155:0/614778525 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fe0d0068f60 0x7fe0d006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:04.079 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.075+0000 7fe0e988d700 1 --2- 172.21.15.155:0/614778525 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fe0d0068f60 0x7fe0d006b410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0004f90 tx=0x7fe0e0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:04.082 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.079+0000 7fe0da7fc700 1 -- 172.21.15.155:0/614778525 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe0d40568f0 con 0x7fe0e4102c20 2023-12-16T05:54:04.179 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.175+0000 7f9cb94ce700 1 -- 172.21.15.155:0/2014485626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cb40fbb40 msgr2=0x7f9cb40fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:04.179 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.175+0000 7f9cb94ce700 1 --2- 172.21.15.155:0/2014485626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cb40fbb40 0x7f9cb40fbfb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8004940 tx=0x7f9ca8009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:04.179 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.175+0000 7f9cb94ce700 1 -- 172.21.15.155:0/2014485626 shutdown_connections 2023-12-16T05:54:04.179 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.175+0000 7f9cb94ce700 1 --2- 172.21.15.155:0/2014485626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cb40fbb40 0x7f9cb40fbfb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:04.180 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.175+0000 7f9cb94ce700 1 --2- 172.21.15.155:0/2014485626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cb4101b00 0x7f9cb4101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:04.180 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.175+0000 7f9cb94ce700 1 -- 172.21.15.155:0/2014485626 >> 172.21.15.155:0/2014485626 conn(0x7f9cb40719b0 msgr2=0x7f9cb4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:04.180 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.175+0000 7f9cb94ce700 1 -- 172.21.15.155:0/2014485626 shutdown_connections 2023-12-16T05:54:04.180 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.175+0000 7f9cb94ce700 1 -- 172.21.15.155:0/2014485626 wait complete. 2023-12-16T05:54:04.180 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.176+0000 7f9cb94ce700 1 Processor -- start 2023-12-16T05:54:04.180 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.176+0000 7f9cb94ce700 1 -- start start 2023-12-16T05:54:04.181 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.177+0000 7f9cb94ce700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cb40fbb40 0x7f9cb410e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:04.181 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.177+0000 7f9cb94ce700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cb4101b00 0x7f9cb410ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:04.181 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.177+0000 7f9cb94ce700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb410f180 con 0x7f9cb4101b00 2023-12-16T05:54:04.181 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.177+0000 7f9cb94ce700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb410f2f0 con 0x7f9cb40fbb40 2023-12-16T05:54:04.181 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.177+0000 7f9cb27fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cb4101b00 0x7f9cb410ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:04.181 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.177+0000 7f9cb27fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cb4101b00 0x7f9cb410ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52890/0 (socket says 172.21.15.155:52890) 2023-12-16T05:54:04.182 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.177+0000 7f9cb27fc700 1 -- 172.21.15.155:0/2484452558 learned_addr learned my addr 172.21.15.155:0/2484452558 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:04.182 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.177+0000 7f9cb2ffd700 1 --2- 172.21.15.155:0/2484452558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cb40fbb40 0x7f9cb410e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:04.182 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.177+0000 7f9cb27fc700 1 -- 172.21.15.155:0/2484452558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cb40fbb40 msgr2=0x7f9cb410e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:04.182 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.177+0000 7f9cb27fc700 1 --2- 172.21.15.155:0/2484452558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cb40fbb40 0x7f9cb410e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:04.182 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.177+0000 7f9cb27fc700 1 -- 172.21.15.155:0/2484452558 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca8005040 con 0x7f9cb4101b00 2023-12-16T05:54:04.182 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.177+0000 7f9cb27fc700 1 --2- 172.21.15.155:0/2484452558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cb4101b00 0x7f9cb410ebd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8000c00 tx=0x7f9ca8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:04.182 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.177+0000 7f9c9b7fe700 1 -- 172.21.15.155:0/2484452558 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ca8021070 con 0x7f9cb4101b00 2023-12-16T05:54:04.182 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.178+0000 7f9cb94ce700 1 -- 172.21.15.155:0/2484452558 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb4117600 con 0x7f9cb4101b00 2023-12-16T05:54:04.182 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.178+0000 7f9c9b7fe700 1 -- 172.21.15.155:0/2484452558 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9ca801c400 con 0x7f9cb4101b00 2023-12-16T05:54:04.182 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.178+0000 7f9cb94ce700 1 -- 172.21.15.155:0/2484452558 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb4117ab0 con 0x7f9cb4101b00 2023-12-16T05:54:04.182 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.178+0000 7f9c9b7fe700 1 -- 172.21.15.155:0/2484452558 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ca800e070 con 0x7f9cb4101b00 2023-12-16T05:54:04.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.179+0000 7f9cb94ce700 1 -- 172.21.15.155:0/2484452558 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca00052e0 con 0x7f9cb4101b00 2023-12-16T05:54:04.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.179+0000 7f9c9b7fe700 1 -- 172.21.15.155:0/2484452558 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f9ca8013a30 con 0x7f9cb4101b00 2023-12-16T05:54:04.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.179+0000 7f9c9b7fe700 1 --2- 172.21.15.155:0/2484452558 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9c9c068f60 0x7f9c9c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:04.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.179+0000 7f9c9b7fe700 1 -- 172.21.15.155:0/2484452558 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9ca8087a10 con 0x7f9cb4101b00 2023-12-16T05:54:04.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.179+0000 7f9cb2ffd700 1 --2- 172.21.15.155:0/2484452558 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9c9c068f60 0x7f9c9c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:04.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.180+0000 7f9cb2ffd700 1 --2- 172.21.15.155:0/2484452558 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9c9c068f60 0x7f9c9c06b410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009b80 tx=0x7f9ca400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:04.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.188+0000 7f9c9b7fe700 1 -- 172.21.15.155:0/2484452558 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9ca80542c0 con 0x7f9cb4101b00 2023-12-16T05:54:04.295 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.292+0000 7fe0ebaf1700 1 -- 172.21.15.155:0/614778525 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe0e404bb80 con 0x7fe0e4102c20 2023-12-16T05:54:04.295 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.292+0000 7fe0da7fc700 1 -- 172.21.15.155:0/614778525 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe0d4056480 con 0x7fe0e4102c20 2023-12-16T05:54:04.295 INFO:teuthology.orchestra.run.smithi155.stdout:137438953482 2023-12-16T05:54:04.297 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.294+0000 7fe0ebaf1700 1 -- 172.21.15.155:0/614778525 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fe0d0068f60 msgr2=0x7fe0d006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:04.297 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.294+0000 7fe0ebaf1700 1 --2- 172.21.15.155:0/614778525 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fe0d0068f60 0x7fe0d006b410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0004f90 tx=0x7fe0e0009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:04.298 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.294+0000 7fe0ebaf1700 1 -- 172.21.15.155:0/614778525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0e4102c20 msgr2=0x7fe0e4113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:04.298 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.294+0000 7fe0ebaf1700 1 --2- 172.21.15.155:0/614778525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0e4102c20 0x7fe0e4113b90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4002a80 tx=0x7fe0d40046b0 comp rx=0 tx=0).stop 2023-12-16T05:54:04.298 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.294+0000 7fe0ebaf1700 1 -- 172.21.15.155:0/614778525 shutdown_connections 2023-12-16T05:54:04.298 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.294+0000 7fe0ebaf1700 1 --2- 172.21.15.155:0/614778525 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fe0d0068f60 0x7fe0d006b410 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:04.298 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.294+0000 7fe0ebaf1700 1 --2- 172.21.15.155:0/614778525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0e4065390 0x7fe0e4113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:04.298 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.294+0000 7fe0ebaf1700 1 --2- 172.21.15.155:0/614778525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0e4102c20 0x7fe0e4113b90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:04.298 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.294+0000 7fe0ebaf1700 1 -- 172.21.15.155:0/614778525 >> 172.21.15.155:0/614778525 conn(0x7fe0e40719b0 msgr2=0x7fe0e40fab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:04.298 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.295+0000 7fe0ebaf1700 1 -- 172.21.15.155:0/614778525 shutdown_connections 2023-12-16T05:54:04.298 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.295+0000 7fe0ebaf1700 1 -- 172.21.15.155:0/614778525 wait complete. 2023-12-16T05:54:04.404 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.400+0000 7f9cb94ce700 1 -- 172.21.15.155:0/2484452558 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9ca0005590 con 0x7f9cb4101b00 2023-12-16T05:54:04.404 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.401+0000 7f9c9b7fe700 1 -- 172.21.15.155:0/2484452558 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ca80578e0 con 0x7f9cb4101b00 2023-12-16T05:54:04.404 INFO:teuthology.orchestra.run.smithi155.stdout:107374182414 2023-12-16T05:54:04.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.403+0000 7f9cb94ce700 1 -- 172.21.15.155:0/2484452558 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9c9c068f60 msgr2=0x7f9c9c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:04.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.403+0000 7f9cb94ce700 1 --2- 172.21.15.155:0/2484452558 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9c9c068f60 0x7f9c9c06b410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009b80 tx=0x7f9ca400b040 comp rx=0 tx=0).stop 2023-12-16T05:54:04.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.403+0000 7f9cb94ce700 1 -- 172.21.15.155:0/2484452558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cb4101b00 msgr2=0x7f9cb410ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:04.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.403+0000 7f9cb94ce700 1 --2- 172.21.15.155:0/2484452558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cb4101b00 0x7f9cb410ebd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8000c00 tx=0x7f9ca8009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:04.407 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.403+0000 7f9cb94ce700 1 -- 172.21.15.155:0/2484452558 shutdown_connections 2023-12-16T05:54:04.407 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.403+0000 7f9cb94ce700 1 --2- 172.21.15.155:0/2484452558 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9c9c068f60 0x7f9c9c06b410 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:04.407 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.403+0000 7f9cb94ce700 1 --2- 172.21.15.155:0/2484452558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cb40fbb40 0x7f9cb410e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:04.407 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.403+0000 7f9cb94ce700 1 --2- 172.21.15.155:0/2484452558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cb4101b00 0x7f9cb410ebd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:04.407 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.403+0000 7f9cb94ce700 1 -- 172.21.15.155:0/2484452558 >> 172.21.15.155:0/2484452558 conn(0x7f9cb40719b0 msgr2=0x7f9cb40faa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:04.407 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.403+0000 7f9cb94ce700 1 -- 172.21.15.155:0/2484452558 shutdown_connections 2023-12-16T05:54:04.407 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.403+0000 7f9cb94ce700 1 -- 172.21.15.155:0/2484452558 wait complete. 2023-12-16T05:54:04.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:04 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/614778525' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-16T05:54:04.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:04 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/3005090760' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-16T05:54:04.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:04 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2484452558' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-16T05:54:04.861 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.133+0000 7fcf763ac700 1 -- 172.21.15.155:0/376102903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf700fe5b0 msgr2=0x7fcf70106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:04.861 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.133+0000 7fcf763ac700 1 --2- 172.21.15.155:0/376102903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf700fe5b0 0x7fcf70106bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcf64004940 tx=0x7fcf64009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:04.861 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.133+0000 7fcf763ac700 1 -- 172.21.15.155:0/376102903 shutdown_connections 2023-12-16T05:54:04.861 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.133+0000 7fcf763ac700 1 --2- 172.21.15.155:0/376102903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf700fe5b0 0x7fcf70106bf0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:04.861 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.133+0000 7fcf763ac700 1 --2- 172.21.15.155:0/376102903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf700fdc10 0x7fcf700fdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:04.861 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.133+0000 7fcf763ac700 1 -- 172.21.15.155:0/376102903 >> 172.21.15.155:0/376102903 conn(0x7fcf700f76c0 msgr2=0x7fcf700f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:04.861 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.133+0000 7fcf763ac700 1 -- 172.21.15.155:0/376102903 shutdown_connections 2023-12-16T05:54:04.861 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.133+0000 7fcf763ac700 1 -- 172.21.15.155:0/376102903 wait complete. 2023-12-16T05:54:04.862 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.134+0000 7fcf763ac700 1 Processor -- start 2023-12-16T05:54:04.862 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.134+0000 7fcf763ac700 1 -- start start 2023-12-16T05:54:04.862 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.134+0000 7fcf763ac700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf700fdc10 0x7fcf700fba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:04.862 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.134+0000 7fcf763ac700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf700fe5b0 0x7fcf700fbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:04.862 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.134+0000 7fcf763ac700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf700fc580 con 0x7fcf700fe5b0 2023-12-16T05:54:04.862 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.134+0000 7fcf763ac700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf700fc6f0 con 0x7fcf700fdc10 2023-12-16T05:54:04.862 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.134+0000 7fcf6f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf700fe5b0 0x7fcf700fbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:04.862 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.134+0000 7fcf6f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf700fe5b0 0x7fcf700fbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52878/0 (socket says 172.21.15.155:52878) 2023-12-16T05:54:04.862 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.134+0000 7fcf6f7fe700 1 -- 172.21.15.155:0/3005090760 learned_addr learned my addr 172.21.15.155:0/3005090760 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:04.862 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.134+0000 7fcf6ffff700 1 --2- 172.21.15.155:0/3005090760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf700fdc10 0x7fcf700fba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:04.862 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.135+0000 7fcf6f7fe700 1 -- 172.21.15.155:0/3005090760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf700fdc10 msgr2=0x7fcf700fba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:04.862 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.135+0000 7fcf6f7fe700 1 --2- 172.21.15.155:0/3005090760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf700fdc10 0x7fcf700fba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:04.862 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.135+0000 7fcf6f7fe700 1 -- 172.21.15.155:0/3005090760 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf64005040 con 0x7fcf700fe5b0 2023-12-16T05:54:04.863 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.135+0000 7fcf6f7fe700 1 --2- 172.21.15.155:0/3005090760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf700fe5b0 0x7fcf700fbf80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400b3b0 tx=0x7fcf64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:04.863 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.135+0000 7fcf6cff9700 1 -- 172.21.15.155:0/3005090760 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf6400e040 con 0x7fcf700fe5b0 2023-12-16T05:54:04.863 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.135+0000 7fcf6cff9700 1 -- 172.21.15.155:0/3005090760 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcf64004290 con 0x7fcf700fe5b0 2023-12-16T05:54:04.863 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.135+0000 7fcf763ac700 1 -- 172.21.15.155:0/3005090760 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf70119930 con 0x7fcf700fe5b0 2023-12-16T05:54:04.863 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.135+0000 7fcf6cff9700 1 -- 172.21.15.155:0/3005090760 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf6401c3f0 con 0x7fcf700fe5b0 2023-12-16T05:54:04.863 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.135+0000 7fcf763ac700 1 -- 172.21.15.155:0/3005090760 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf70119d90 con 0x7fcf700fe5b0 2023-12-16T05:54:04.863 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.136+0000 7fcf763ac700 1 -- 172.21.15.155:0/3005090760 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf70104200 con 0x7fcf700fe5b0 2023-12-16T05:54:04.863 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.136+0000 7fcf6cff9700 1 -- 172.21.15.155:0/3005090760 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fcf6401c620 con 0x7fcf700fe5b0 2023-12-16T05:54:04.863 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.137+0000 7fcf6cff9700 1 --2- 172.21.15.155:0/3005090760 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fcf58068f60 0x7fcf5806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:04.863 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.137+0000 7fcf6ffff700 1 --2- 172.21.15.155:0/3005090760 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fcf58068f60 0x7fcf5806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:04.863 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.137+0000 7fcf6cff9700 1 -- 172.21.15.155:0/3005090760 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcf64087da0 con 0x7fcf700fe5b0 2023-12-16T05:54:04.864 INFO:teuthology.orchestra.run.smithi155.stdout:38654705690 2023-12-16T05:54:04.864 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.137+0000 7fcf6ffff700 1 --2- 172.21.15.155:0/3005090760 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fcf58068f60 0x7fcf5806b410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcf60004f40 tx=0x7fcf6000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:04.864 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.141+0000 7fcf6cff9700 1 -- 172.21.15.155:0/3005090760 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcf64054550 con 0x7fcf700fe5b0 2023-12-16T05:54:04.864 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.367+0000 7fcf763ac700 1 -- 172.21.15.155:0/3005090760 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcf700fb2c0 con 0x7fcf700fe5b0 2023-12-16T05:54:04.864 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.368+0000 7fcf6cff9700 1 -- 172.21.15.155:0/3005090760 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf64057b70 con 0x7fcf700fe5b0 2023-12-16T05:54:04.864 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.370+0000 7fcf763ac700 1 -- 172.21.15.155:0/3005090760 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fcf58068f60 msgr2=0x7fcf5806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:04.864 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.370+0000 7fcf763ac700 1 --2- 172.21.15.155:0/3005090760 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fcf58068f60 0x7fcf5806b410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcf60004f40 tx=0x7fcf6000b040 comp rx=0 tx=0).stop 2023-12-16T05:54:04.864 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.370+0000 7fcf763ac700 1 -- 172.21.15.155:0/3005090760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf700fe5b0 msgr2=0x7fcf700fbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:04.864 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.370+0000 7fcf763ac700 1 --2- 172.21.15.155:0/3005090760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf700fe5b0 0x7fcf700fbf80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400b3b0 tx=0x7fcf64009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:04.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.370+0000 7fcf763ac700 1 -- 172.21.15.155:0/3005090760 shutdown_connections 2023-12-16T05:54:04.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.370+0000 7fcf763ac700 1 --2- 172.21.15.155:0/3005090760 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fcf58068f60 0x7fcf5806b410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:04.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.370+0000 7fcf763ac700 1 --2- 172.21.15.155:0/3005090760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf700fdc10 0x7fcf700fba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:04.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.370+0000 7fcf763ac700 1 --2- 172.21.15.155:0/3005090760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf700fe5b0 0x7fcf700fbf80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:04.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.370+0000 7fcf763ac700 1 -- 172.21.15.155:0/3005090760 >> 172.21.15.155:0/3005090760 conn(0x7fcf700f76c0 msgr2=0x7fcf70101380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:04.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.370+0000 7fcf763ac700 1 -- 172.21.15.155:0/3005090760 shutdown_connections 2023-12-16T05:54:04.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:04.370+0000 7fcf763ac700 1 -- 172.21.15.155:0/3005090760 wait complete. 2023-12-16T05:54:04.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:04 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/614778525' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-16T05:54:04.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:04 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/3005090760' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-16T05:54:04.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:04 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/2484452558' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-16T05:54:05.064 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.061+0000 7f1f3308c700 1 -- 172.21.15.155:0/4031524972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f2c102410 msgr2=0x7f1f2c0fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:05.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.061+0000 7f1f3308c700 1 --2- 172.21.15.155:0/4031524972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f2c102410 0x7f1f2c0fc2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1f18004940 tx=0x7f1f18009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:05.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.061+0000 7f1f3308c700 1 -- 172.21.15.155:0/4031524972 shutdown_connections 2023-12-16T05:54:05.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.061+0000 7f1f3308c700 1 --2- 172.21.15.155:0/4031524972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f2c102410 0x7f1f2c0fc2f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:05.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.061+0000 7f1f3308c700 1 --2- 172.21.15.155:0/4031524972 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f2c101b00 0x7f1f2c101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:05.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.061+0000 7f1f3308c700 1 -- 172.21.15.155:0/4031524972 >> 172.21.15.155:0/4031524972 conn(0x7f1f2c0711a0 msgr2=0x7f1f2c0715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:05.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.061+0000 7f1f3308c700 1 -- 172.21.15.155:0/4031524972 shutdown_connections 2023-12-16T05:54:05.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.061+0000 7f1f3308c700 1 -- 172.21.15.155:0/4031524972 wait complete. 2023-12-16T05:54:05.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.062+0000 7f1f3308c700 1 Processor -- start 2023-12-16T05:54:05.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.062+0000 7f1f3308c700 1 -- start start 2023-12-16T05:54:05.066 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.062+0000 7f1f3308c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f2c101b00 0x7f1f2c102960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:05.066 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.062+0000 7f1f3308c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f2c102410 0x7f1f2c102ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:05.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.062+0000 7f1f3308c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c103530 con 0x7f1f2c101b00 2023-12-16T05:54:05.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.062+0000 7f1f3308c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c1036a0 con 0x7f1f2c102410 2023-12-16T05:54:05.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.062+0000 7f1f30e28700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f2c101b00 0x7f1f2c102960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:05.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.062+0000 7f1f30e28700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f2c101b00 0x7f1f2c102960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52898/0 (socket says 172.21.15.155:52898) 2023-12-16T05:54:05.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.062+0000 7f1f30e28700 1 -- 172.21.15.155:0/2873587487 learned_addr learned my addr 172.21.15.155:0/2873587487 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:05.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.062+0000 7f1f2bfff700 1 --2- 172.21.15.155:0/2873587487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f2c102410 0x7f1f2c102ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:05.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.063+0000 7f1f30e28700 1 -- 172.21.15.155:0/2873587487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f2c102410 msgr2=0x7f1f2c102ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:05.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.063+0000 7f1f30e28700 1 --2- 172.21.15.155:0/2873587487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f2c102410 0x7f1f2c102ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:05.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.063+0000 7f1f30e28700 1 -- 172.21.15.155:0/2873587487 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f18005040 con 0x7f1f2c101b00 2023-12-16T05:54:05.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.063+0000 7f1f30e28700 1 --2- 172.21.15.155:0/2873587487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f2c101b00 0x7f1f2c102960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000b790 tx=0x7f1f20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:05.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.063+0000 7f1f297fa700 1 -- 172.21.15.155:0/2873587487 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f2000f6f0 con 0x7f1f2c101b00 2023-12-16T05:54:05.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.063+0000 7f1f3308c700 1 -- 172.21.15.155:0/2873587487 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2c119940 con 0x7f1f2c101b00 2023-12-16T05:54:05.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.063+0000 7f1f297fa700 1 -- 172.21.15.155:0/2873587487 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1f2000fd00 con 0x7f1f2c101b00 2023-12-16T05:54:05.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.063+0000 7f1f297fa700 1 -- 172.21.15.155:0/2873587487 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f200103a0 con 0x7f1f2c101b00 2023-12-16T05:54:05.068 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.063+0000 7f1f3308c700 1 -- 172.21.15.155:0/2873587487 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2c119e00 con 0x7f1f2c101b00 2023-12-16T05:54:05.068 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.064+0000 7f1f3308c700 1 -- 172.21.15.155:0/2873587487 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2c0ffe70 con 0x7f1f2c101b00 2023-12-16T05:54:05.068 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.064+0000 7f1f297fa700 1 -- 172.21.15.155:0/2873587487 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f1f2000f850 con 0x7f1f2c101b00 2023-12-16T05:54:05.069 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.065+0000 7f1f297fa700 1 --2- 172.21.15.155:0/2873587487 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f1f1c068f60 0x7f1f1c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:05.069 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.065+0000 7f1f297fa700 1 -- 172.21.15.155:0/2873587487 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1f20086880 con 0x7f1f2c101b00 2023-12-16T05:54:05.069 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.065+0000 7f1f2bfff700 1 --2- 172.21.15.155:0/2873587487 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f1f1c068f60 0x7f1f1c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:05.069 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.065+0000 7f1f2bfff700 1 --2- 172.21.15.155:0/2873587487 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f1f1c068f60 0x7f1f1c06b410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c104a70 tx=0x7f1f18009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:05.072 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.069+0000 7f1f297fa700 1 -- 172.21.15.155:0/2873587487 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1f20053090 con 0x7f1f2c101b00 2023-12-16T05:54:05.266 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.263+0000 7f1f3308c700 1 -- 172.21.15.155:0/2873587487 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1f2c072cc0 con 0x7f1f2c101b00 2023-12-16T05:54:05.266 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.263+0000 7f1f297fa700 1 -- 172.21.15.155:0/2873587487 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f200566b0 con 0x7f1f2c101b00 2023-12-16T05:54:05.266 INFO:teuthology.orchestra.run.smithi155.stdout:158913789960 2023-12-16T05:54:05.268 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.265+0000 7f1f3308c700 1 -- 172.21.15.155:0/2873587487 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f1f1c068f60 msgr2=0x7f1f1c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:05.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.265+0000 7f1f3308c700 1 --2- 172.21.15.155:0/2873587487 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f1f1c068f60 0x7f1f1c06b410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c104a70 tx=0x7f1f18009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:05.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.265+0000 7f1f3308c700 1 -- 172.21.15.155:0/2873587487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f2c101b00 msgr2=0x7f1f2c102960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:05.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.265+0000 7f1f3308c700 1 --2- 172.21.15.155:0/2873587487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f2c101b00 0x7f1f2c102960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000b790 tx=0x7f1f20009250 comp rx=0 tx=0).stop 2023-12-16T05:54:05.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.266+0000 7f1f3308c700 1 -- 172.21.15.155:0/2873587487 shutdown_connections 2023-12-16T05:54:05.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.266+0000 7f1f3308c700 1 --2- 172.21.15.155:0/2873587487 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f1f1c068f60 0x7f1f1c06b410 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:05.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.266+0000 7f1f3308c700 1 --2- 172.21.15.155:0/2873587487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f2c101b00 0x7f1f2c102960 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:05.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.266+0000 7f1f3308c700 1 --2- 172.21.15.155:0/2873587487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f2c102410 0x7f1f2c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:05.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.266+0000 7f1f3308c700 1 -- 172.21.15.155:0/2873587487 >> 172.21.15.155:0/2873587487 conn(0x7f1f2c0711a0 msgr2=0x7f1f2c1060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:05.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.266+0000 7f1f3308c700 1 -- 172.21.15.155:0/2873587487 shutdown_connections 2023-12-16T05:54:05.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.266+0000 7f1f3308c700 1 -- 172.21.15.155:0/2873587487 wait complete. 2023-12-16T05:54:05.405 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182413 got 107374182414 for osd.3 2023-12-16T05:54:05.405 DEBUG:teuthology.parallel:result is None 2023-12-16T05:54:05.594 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705689 got 38654705690 for osd.0 2023-12-16T05:54:05.594 DEBUG:teuthology.parallel:result is None 2023-12-16T05:54:05.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.745+0000 7fa97fbbb700 1 -- 172.21.15.155:0/1224395094 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa978103590 msgr2=0x7fa9780fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:05.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.745+0000 7fa97fbbb700 1 --2- 172.21.15.155:0/1224395094 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa978103590 0x7fa9780fcc00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa968004940 tx=0x7fa968009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:05.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.745+0000 7fa97fbbb700 1 -- 172.21.15.155:0/1224395094 shutdown_connections 2023-12-16T05:54:05.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.745+0000 7fa97fbbb700 1 --2- 172.21.15.155:0/1224395094 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa978103590 0x7fa9780fcc00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:05.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.745+0000 7fa97fbbb700 1 --2- 172.21.15.155:0/1224395094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa978102bf0 0x7fa978102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:05.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.745+0000 7fa97fbbb700 1 -- 172.21.15.155:0/1224395094 >> 172.21.15.155:0/1224395094 conn(0x7fa9780f87a0 msgr2=0x7fa9780fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:05.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.745+0000 7fa97fbbb700 1 -- 172.21.15.155:0/1224395094 shutdown_connections 2023-12-16T05:54:05.749 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.745+0000 7fa97fbbb700 1 -- 172.21.15.155:0/1224395094 wait complete. 2023-12-16T05:54:05.750 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.746+0000 7fa97fbbb700 1 Processor -- start 2023-12-16T05:54:05.750 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.746+0000 7fa97fbbb700 1 -- start start 2023-12-16T05:54:05.750 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.746+0000 7fa97fbbb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa978102bf0 0x7fa97806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:05.750 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.746+0000 7fa97fbbb700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa978103590 0x7fa978070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:05.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.746+0000 7fa97fbbb700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa978070a80 con 0x7fa978103590 2023-12-16T05:54:05.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.746+0000 7fa97fbbb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa978070bf0 con 0x7fa978102bf0 2023-12-16T05:54:05.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.746+0000 7fa97d156700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa978103590 0x7fa978070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:05.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.746+0000 7fa97d156700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa978103590 0x7fa978070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52906/0 (socket says 172.21.15.155:52906) 2023-12-16T05:54:05.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.746+0000 7fa97d156700 1 -- 172.21.15.155:0/2018279815 learned_addr learned my addr 172.21.15.155:0/2018279815 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:05.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.746+0000 7fa97d957700 1 --2- 172.21.15.155:0/2018279815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa978102bf0 0x7fa97806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:05.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.746+0000 7fa97d156700 1 -- 172.21.15.155:0/2018279815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa978102bf0 msgr2=0x7fa97806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:05.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.746+0000 7fa97d156700 1 --2- 172.21.15.155:0/2018279815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa978102bf0 0x7fa97806ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:05.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.746+0000 7fa97d156700 1 -- 172.21.15.155:0/2018279815 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa968005040 con 0x7fa978103590 2023-12-16T05:54:05.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.747+0000 7fa97d156700 1 --2- 172.21.15.155:0/2018279815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa978103590 0x7fa978070480 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa968009180 tx=0x7fa968009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:05.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.747+0000 7fa96e7fc700 1 -- 172.21.15.155:0/2018279815 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa96800e040 con 0x7fa978103590 2023-12-16T05:54:05.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.747+0000 7fa97fbbb700 1 -- 172.21.15.155:0/2018279815 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa978119860 con 0x7fa978103590 2023-12-16T05:54:05.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.747+0000 7fa96e7fc700 1 -- 172.21.15.155:0/2018279815 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa968004290 con 0x7fa978103590 2023-12-16T05:54:05.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.747+0000 7fa96e7fc700 1 -- 172.21.15.155:0/2018279815 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa96801c3f0 con 0x7fa978103590 2023-12-16T05:54:05.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.748+0000 7fa97fbbb700 1 -- 172.21.15.155:0/2018279815 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa978119cc0 con 0x7fa978103590 2023-12-16T05:54:05.752 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.748+0000 7fa96e7fc700 1 -- 172.21.15.155:0/2018279815 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fa96800bb80 con 0x7fa978103590 2023-12-16T05:54:05.752 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.749+0000 7fa96e7fc700 1 --2- 172.21.15.155:0/2018279815 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fa964068f70 0x7fa96406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:05.752 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.749+0000 7fa96e7fc700 1 -- 172.21.15.155:0/2018279815 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa96808b4b0 con 0x7fa978103590 2023-12-16T05:54:05.753 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.749+0000 7fa97d957700 1 --2- 172.21.15.155:0/2018279815 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fa964068f70 0x7fa96406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:05.753 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.749+0000 7fa97fbbb700 1 -- 172.21.15.155:0/2018279815 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9781050c0 con 0x7fa978103590 2023-12-16T05:54:05.753 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.749+0000 7fa97d957700 1 --2- 172.21.15.155:0/2018279815 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fa964068f70 0x7fa96406b420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa974004f40 tx=0x7fa97400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:05.756 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.754+0000 7fa96e7fc700 1 -- 172.21.15.155:0/2018279815 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa968053cd0 con 0x7fa978103590 2023-12-16T05:54:05.769 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789959 got 158913789960 for osd.5 2023-12-16T05:54:05.769 DEBUG:teuthology.parallel:result is None 2023-12-16T05:54:05.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:05 smithi155 ceph-mon[112451]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:05.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:05 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2873587487' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-16T05:54:05.891 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953482 got 137438953482 for osd.4 2023-12-16T05:54:05.891 DEBUG:teuthology.parallel:result is None 2023-12-16T05:54:05.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:05 smithi156 ceph-mon[121001]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:05.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:05 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/2873587487' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-16T05:54:05.955 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.952+0000 7fa97fbbb700 1 -- 172.21.15.155:0/2018279815 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa9780fc3a0 con 0x7fa978103590 2023-12-16T05:54:05.955 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.952+0000 7fa96e7fc700 1 -- 172.21.15.155:0/2018279815 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa9680572f0 con 0x7fa978103590 2023-12-16T05:54:05.955 INFO:teuthology.orchestra.run.smithi155.stdout:60129542167 2023-12-16T05:54:05.957 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.954+0000 7fa97fbbb700 1 -- 172.21.15.155:0/2018279815 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fa964068f70 msgr2=0x7fa96406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:05.958 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.954+0000 7fa97fbbb700 1 --2- 172.21.15.155:0/2018279815 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fa964068f70 0x7fa96406b420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa974004f40 tx=0x7fa97400b040 comp rx=0 tx=0).stop 2023-12-16T05:54:05.958 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.954+0000 7fa97fbbb700 1 -- 172.21.15.155:0/2018279815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa978103590 msgr2=0x7fa978070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:05.958 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.954+0000 7fa97fbbb700 1 --2- 172.21.15.155:0/2018279815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa978103590 0x7fa978070480 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa968009180 tx=0x7fa968009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:05.958 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.954+0000 7fa97fbbb700 1 -- 172.21.15.155:0/2018279815 shutdown_connections 2023-12-16T05:54:05.958 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.954+0000 7fa97fbbb700 1 --2- 172.21.15.155:0/2018279815 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fa964068f70 0x7fa96406b420 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:05.958 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.954+0000 7fa97fbbb700 1 --2- 172.21.15.155:0/2018279815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa978102bf0 0x7fa97806ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:05.958 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.954+0000 7fa97fbbb700 1 --2- 172.21.15.155:0/2018279815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa978103590 0x7fa978070480 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:05.958 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.954+0000 7fa97fbbb700 1 -- 172.21.15.155:0/2018279815 >> 172.21.15.155:0/2018279815 conn(0x7fa9780f87a0 msgr2=0x7fa9780fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:05.958 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.955+0000 7fa97fbbb700 1 -- 172.21.15.155:0/2018279815 shutdown_connections 2023-12-16T05:54:05.958 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:05.955+0000 7fa97fbbb700 1 -- 172.21.15.155:0/2018279815 wait complete. 2023-12-16T05:54:06.316 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542166 got 60129542167 for osd.1 2023-12-16T05:54:06.316 DEBUG:teuthology.parallel:result is None 2023-12-16T05:54:06.317 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-12-16T05:54:06.317 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph pg dump --format=json 2023-12-16T05:54:06.582 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:06.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:06 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2018279815' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-16T05:54:06.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:06 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/2018279815' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-16T05:54:07.632 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.627+0000 7f084f59e700 1 -- 172.21.15.155:0/3735021241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0850101970 msgr2=0x7f0850101d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:07.632 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.627+0000 7f084f59e700 1 --2- 172.21.15.155:0/3735021241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0850101970 0x7f0850101d40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0840004940 tx=0x7f0840009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:07.632 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.628+0000 7f084f59e700 1 -- 172.21.15.155:0/3735021241 shutdown_connections 2023-12-16T05:54:07.632 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.628+0000 7f084f59e700 1 --2- 172.21.15.155:0/3735021241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08500fb930 0x7f08500fbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:07.632 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.628+0000 7f084f59e700 1 --2- 172.21.15.155:0/3735021241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0850101970 0x7f0850101d40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:07.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.628+0000 7f084f59e700 1 -- 172.21.15.155:0/3735021241 >> 172.21.15.155:0/3735021241 conn(0x7f08500f7490 msgr2=0x7f08500f98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:07.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.628+0000 7f084f59e700 1 -- 172.21.15.155:0/3735021241 shutdown_connections 2023-12-16T05:54:07.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.628+0000 7f084f59e700 1 -- 172.21.15.155:0/3735021241 wait complete. 2023-12-16T05:54:07.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.628+0000 7f084f59e700 1 Processor -- start 2023-12-16T05:54:07.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.628+0000 7f084f59e700 1 -- start start 2023-12-16T05:54:07.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.628+0000 7f084f59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08500fb930 0x7f085010e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:07.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.628+0000 7f084f59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0850101970 0x7f085010ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:07.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.628+0000 7f084f59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085010efe0 con 0x7f0850101970 2023-12-16T05:54:07.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.628+0000 7f084f59e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085010f120 con 0x7f08500fb930 2023-12-16T05:54:07.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.628+0000 7f084dd9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0850101970 0x7f085010ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:07.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.629+0000 7f084dd9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0850101970 0x7f085010ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41300/0 (socket says 172.21.15.155:41300) 2023-12-16T05:54:07.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.629+0000 7f084dd9b700 1 -- 172.21.15.155:0/2552663476 learned_addr learned my addr 172.21.15.155:0/2552663476 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:07.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.629+0000 7f084e59c700 1 --2- 172.21.15.155:0/2552663476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08500fb930 0x7f085010e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:07.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.629+0000 7f084dd9b700 1 -- 172.21.15.155:0/2552663476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08500fb930 msgr2=0x7f085010e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:07.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.629+0000 7f084dd9b700 1 --2- 172.21.15.155:0/2552663476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08500fb930 0x7f085010e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:07.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.629+0000 7f084dd9b700 1 -- 172.21.15.155:0/2552663476 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0840005040 con 0x7f0850101970 2023-12-16T05:54:07.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.629+0000 7f084dd9b700 1 --2- 172.21.15.155:0/2552663476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0850101970 0x7f085010ea50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f084400c830 tx=0x7f0844004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:07.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.629+0000 7f083effd700 1 -- 172.21.15.155:0/2552663476 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08440106f0 con 0x7f0850101970 2023-12-16T05:54:07.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.629+0000 7f083effd700 1 -- 172.21.15.155:0/2552663476 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0844010d00 con 0x7f0850101970 2023-12-16T05:54:07.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.629+0000 7f084f59e700 1 -- 172.21.15.155:0/2552663476 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0850117480 con 0x7f0850101970 2023-12-16T05:54:07.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.629+0000 7f083effd700 1 -- 172.21.15.155:0/2552663476 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0844012e90 con 0x7f0850101970 2023-12-16T05:54:07.634 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.629+0000 7f084f59e700 1 -- 172.21.15.155:0/2552663476 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0850117990 con 0x7f0850101970 2023-12-16T05:54:07.635 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.630+0000 7f084f59e700 1 -- 172.21.15.155:0/2552663476 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0850103df0 con 0x7f0850101970 2023-12-16T05:54:07.635 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.630+0000 7f083effd700 1 -- 172.21.15.155:0/2552663476 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f0844010850 con 0x7f0850101970 2023-12-16T05:54:07.635 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.631+0000 7f083effd700 1 --2- 172.21.15.155:0/2552663476 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0838068f60 0x7f083806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:07.635 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.631+0000 7f083effd700 1 -- 172.21.15.155:0/2552663476 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0844086a20 con 0x7f0850101970 2023-12-16T05:54:07.635 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.631+0000 7f084e59c700 1 --2- 172.21.15.155:0/2552663476 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0838068f60 0x7f083806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:07.635 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.631+0000 7f084e59c700 1 --2- 172.21.15.155:0/2552663476 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0838068f60 0x7f083806b410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0840004f90 tx=0x7f0840009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:07.638 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.635+0000 7f083effd700 1 -- 172.21.15.155:0/2552663476 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0844053230 con 0x7f0850101970 2023-12-16T05:54:07.746 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:07 smithi155 ceph-mon[112451]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:07.822 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.819+0000 7f084f59e700 1 -- 172.21.15.155:0/2552663476 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0850066400 con 0x7f0838068f60 2023-12-16T05:54:07.823 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.821+0000 7f083effd700 1 -- 172.21.15.155:0/2552663476 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+21775 (secure 0 0 0) 0x7f0850066400 con 0x7f0838068f60 2023-12-16T05:54:07.824 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:54:07.825 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.822+0000 7f084f59e700 1 -- 172.21.15.155:0/2552663476 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0838068f60 msgr2=0x7f083806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:07.826 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.822+0000 7f084f59e700 1 --2- 172.21.15.155:0/2552663476 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0838068f60 0x7f083806b410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0840004f90 tx=0x7f0840009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:07.826 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.823+0000 7f084f59e700 1 -- 172.21.15.155:0/2552663476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0850101970 msgr2=0x7f085010ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:07.826 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.823+0000 7f084f59e700 1 --2- 172.21.15.155:0/2552663476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0850101970 0x7f085010ea50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f084400c830 tx=0x7f0844004470 comp rx=0 tx=0).stop 2023-12-16T05:54:07.826 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.823+0000 7f084f59e700 1 -- 172.21.15.155:0/2552663476 shutdown_connections 2023-12-16T05:54:07.826 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.823+0000 7f084f59e700 1 --2- 172.21.15.155:0/2552663476 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0838068f60 0x7f083806b410 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:07.826 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.823+0000 7f084f59e700 1 --2- 172.21.15.155:0/2552663476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08500fb930 0x7f085010e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:07.826 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.823+0000 7f084f59e700 1 --2- 172.21.15.155:0/2552663476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0850101970 0x7f085010ea50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:07.826 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.823+0000 7f084f59e700 1 -- 172.21.15.155:0/2552663476 >> 172.21.15.155:0/2552663476 conn(0x7f08500f7490 msgr2=0x7f08500f8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:07.826 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.823+0000 7f084f59e700 1 -- 172.21.15.155:0/2552663476 shutdown_connections 2023-12-16T05:54:07.826 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:07.823+0000 7f084f59e700 1 -- 172.21.15.155:0/2552663476 wait complete. 2023-12-16T05:54:07.826 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2023-12-16T05:54:07.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:07 smithi156 ceph-mon[121001]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:08.182 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2023-12-16T05:54:06.476550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787504,"kb_used_data":3776,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683408,"statfs":{"total":575970213888,"available":574139809792,"internally_reserved":0,"allocated":3866624,"data_stored":2563379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002279"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":188,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T05:53:40.680966+0000","last_change":"2023-12-16T05:53:23.768449+0000","last_active":"2023-12-16T05:53:40.680966+0000","last_peered":"2023-12-16T05:53:40.680966+0000","last_clean":"2023-12-16T05:53:40.680966+0000","last_became_active":"2023-12-16T05:53:23.768184+0000","last_became_peered":"2023-12-16T05:53:23.768184+0000","last_unstale":"2023-12-16T05:53:40.680966+0000","last_undegraded":"2023-12-16T05:53:40.680966+0000","last_fullsized":"2023-12-16T05:53:40.680966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T05:52:49.295417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T05:52:49.295417+0000","last_clean_scrub_stamp":"2023-12-16T05:52:49.295417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:15:58.983300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":4,"up_from":32,"seq":137438953483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]}]},{"osd":3,"up_from":25,"seq":107374182415,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378642,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297624,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447528,"statfs":{"total":95995035648,"available":95690268672,"internally_reserved":0,"allocated":344064,"data_stored":131495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 05:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":1.23},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":1.0469999999999999}]},{"osd":1,"last update":"Sat Dec 16 05:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":1.7290000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":1.2}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 05:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.28999999999999998}]},{"osd":2,"last update":"Sat Dec 16 05:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 05:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"last":0.16700000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.20499999999999999}]},{"osd":2,"last update":"Sat Dec 16 05:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.308},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T05:54:08.183 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph pg dump --format=json 2023-12-16T05:54:08.448 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:08.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:08 smithi155 ceph-mon[112451]: from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-16T05:54:08.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:08 smithi156 ceph-mon[121001]: from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-16T05:54:09.592 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.587+0000 7fa71a621700 1 -- 172.21.15.155:0/762603634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7140fe5b0 msgr2=0x7fa714106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:09.592 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.587+0000 7fa71a621700 1 --2- 172.21.15.155:0/762603634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7140fe5b0 0x7fa714106bf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa708004940 tx=0x7fa708009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:09.592 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.587+0000 7fa71a621700 1 -- 172.21.15.155:0/762603634 shutdown_connections 2023-12-16T05:54:09.592 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.587+0000 7fa71a621700 1 --2- 172.21.15.155:0/762603634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7140fe5b0 0x7fa714106bf0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:09.592 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.587+0000 7fa71a621700 1 --2- 172.21.15.155:0/762603634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7140fdc10 0x7fa7140fdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:09.592 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.587+0000 7fa71a621700 1 -- 172.21.15.155:0/762603634 >> 172.21.15.155:0/762603634 conn(0x7fa7140f76c0 msgr2=0x7fa7140f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:09.592 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.587+0000 7fa71a621700 1 -- 172.21.15.155:0/762603634 shutdown_connections 2023-12-16T05:54:09.592 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.587+0000 7fa71a621700 1 -- 172.21.15.155:0/762603634 wait complete. 2023-12-16T05:54:09.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.588+0000 7fa71a621700 1 Processor -- start 2023-12-16T05:54:09.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.588+0000 7fa71a621700 1 -- start start 2023-12-16T05:54:09.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.588+0000 7fa71a621700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7140fdc10 0x7fa714113660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:09.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.588+0000 7fa71a621700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7140fe5b0 0x7fa714113be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:09.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.588+0000 7fa71a621700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71410d520 con 0x7fa7140fdc10 2023-12-16T05:54:09.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.588+0000 7fa71a621700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71410d690 con 0x7fa7140fe5b0 2023-12-16T05:54:09.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.588+0000 7fa713fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7140fdc10 0x7fa714113660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:09.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.588+0000 7fa713fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7140fdc10 0x7fa714113660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41314/0 (socket says 172.21.15.155:41314) 2023-12-16T05:54:09.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.588+0000 7fa713fff700 1 -- 172.21.15.155:0/2426780175 learned_addr learned my addr 172.21.15.155:0/2426780175 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:09.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.588+0000 7fa713fff700 1 -- 172.21.15.155:0/2426780175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7140fe5b0 msgr2=0x7fa714113be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:09.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.588+0000 7fa713fff700 1 --2- 172.21.15.155:0/2426780175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7140fe5b0 0x7fa714113be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:09.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.588+0000 7fa713fff700 1 -- 172.21.15.155:0/2426780175 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa708005040 con 0x7fa7140fdc10 2023-12-16T05:54:09.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.589+0000 7fa713fff700 1 --2- 172.21.15.155:0/2426780175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7140fdc10 0x7fa714113660 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa70400b790 tx=0x7fa704009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:09.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.589+0000 7fa710ff9700 1 -- 172.21.15.155:0/2426780175 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa70400f770 con 0x7fa7140fdc10 2023-12-16T05:54:09.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.589+0000 7fa710ff9700 1 -- 172.21.15.155:0/2426780175 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa70400fd80 con 0x7fa7140fdc10 2023-12-16T05:54:09.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.589+0000 7fa710ff9700 1 -- 172.21.15.155:0/2426780175 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa70400d310 con 0x7fa7140fdc10 2023-12-16T05:54:09.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.589+0000 7fa71a621700 1 -- 172.21.15.155:0/2426780175 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71410d970 con 0x7fa7140fdc10 2023-12-16T05:54:09.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.589+0000 7fa71a621700 1 -- 172.21.15.155:0/2426780175 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71410deb0 con 0x7fa7140fdc10 2023-12-16T05:54:09.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.590+0000 7fa71a621700 1 -- 172.21.15.155:0/2426780175 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa714104200 con 0x7fa7140fdc10 2023-12-16T05:54:09.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.590+0000 7fa710ff9700 1 -- 172.21.15.155:0/2426780175 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fa704010420 con 0x7fa7140fdc10 2023-12-16T05:54:09.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.591+0000 7fa710ff9700 1 --2- 172.21.15.155:0/2426780175 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fa6fc068f60 0x7fa6fc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:09.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.591+0000 7fa710ff9700 1 -- 172.21.15.155:0/2426780175 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa704086930 con 0x7fa7140fdc10 2023-12-16T05:54:09.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.591+0000 7fa7137fe700 1 --2- 172.21.15.155:0/2426780175 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fa6fc068f60 0x7fa6fc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:09.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.591+0000 7fa7137fe700 1 --2- 172.21.15.155:0/2426780175 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fa6fc068f60 0x7fa6fc06b410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa708004f90 tx=0x7fa708009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:09.598 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.595+0000 7fa710ff9700 1 -- 172.21.15.155:0/2426780175 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa704056c70 con 0x7fa7140fdc10 2023-12-16T05:54:09.778 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.775+0000 7fa71a621700 1 -- 172.21.15.155:0/2426780175 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa71404bb80 con 0x7fa6fc068f60 2023-12-16T05:54:09.779 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.776+0000 7fa710ff9700 1 -- 172.21.15.155:0/2426780175 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+21761 (secure 0 0 0) 0x7fa71404bb80 con 0x7fa6fc068f60 2023-12-16T05:54:09.780 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:54:09.781 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.778+0000 7fa71a621700 1 -- 172.21.15.155:0/2426780175 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fa6fc068f60 msgr2=0x7fa6fc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:09.781 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.778+0000 7fa71a621700 1 --2- 172.21.15.155:0/2426780175 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fa6fc068f60 0x7fa6fc06b410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa708004f90 tx=0x7fa708009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:09.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.778+0000 7fa71a621700 1 -- 172.21.15.155:0/2426780175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7140fdc10 msgr2=0x7fa714113660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:09.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.778+0000 7fa71a621700 1 --2- 172.21.15.155:0/2426780175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7140fdc10 0x7fa714113660 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa70400b790 tx=0x7fa704009250 comp rx=0 tx=0).stop 2023-12-16T05:54:09.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.778+0000 7fa71a621700 1 -- 172.21.15.155:0/2426780175 shutdown_connections 2023-12-16T05:54:09.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.778+0000 7fa71a621700 1 --2- 172.21.15.155:0/2426780175 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fa6fc068f60 0x7fa6fc06b410 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:09.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.778+0000 7fa71a621700 1 --2- 172.21.15.155:0/2426780175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7140fdc10 0x7fa714113660 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:09.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.778+0000 7fa71a621700 1 --2- 172.21.15.155:0/2426780175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7140fe5b0 0x7fa714113be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:09.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.779+0000 7fa71a621700 1 -- 172.21.15.155:0/2426780175 >> 172.21.15.155:0/2426780175 conn(0x7fa7140f76c0 msgr2=0x7fa714101380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:09.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.779+0000 7fa71a621700 1 -- 172.21.15.155:0/2426780175 shutdown_connections 2023-12-16T05:54:09.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:09.779+0000 7fa71a621700 1 -- 172.21.15.155:0/2426780175 wait complete. 2023-12-16T05:54:09.782 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2023-12-16T05:54:09.805 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:09 smithi155 ceph-mon[112451]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:09.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:09 smithi156 ceph-mon[121001]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:10.165 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-12-16T05:54:08.476931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787504,"kb_used_data":3776,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683408,"statfs":{"total":575970213888,"available":574139809792,"internally_reserved":0,"allocated":3866624,"data_stored":2563379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002360"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":188,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T05:53:40.680966+0000","last_change":"2023-12-16T05:53:23.768449+0000","last_active":"2023-12-16T05:53:40.680966+0000","last_peered":"2023-12-16T05:53:40.680966+0000","last_clean":"2023-12-16T05:53:40.680966+0000","last_became_active":"2023-12-16T05:53:23.768184+0000","last_became_peered":"2023-12-16T05:53:23.768184+0000","last_unstale":"2023-12-16T05:53:40.680966+0000","last_undegraded":"2023-12-16T05:53:40.680966+0000","last_fullsized":"2023-12-16T05:53:40.680966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T05:52:49.295417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T05:52:49.295417+0000","last_clean_scrub_stamp":"2023-12-16T05:52:49.295417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:15:58.983300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":4,"up_from":32,"seq":137438953483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]}]},{"osd":3,"up_from":25,"seq":107374182415,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378642,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297624,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447528,"statfs":{"total":95995035648,"available":95690268672,"internally_reserved":0,"allocated":344064,"data_stored":131495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 05:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":1.23},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":1.0469999999999999}]},{"osd":1,"last update":"Sat Dec 16 05:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":1.7290000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":1.2}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 05:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.28999999999999998}]},{"osd":2,"last update":"Sat Dec 16 05:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 05:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"last":0.16700000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.20499999999999999}]},{"osd":2,"last update":"Sat Dec 16 05:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.308},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T05:54:10.166 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-12-16T05:54:10.166 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-16T05:54:10.166 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-12-16T05:54:10.166 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph health --format=json 2023-12-16T05:54:10.426 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:10.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:10 smithi155 ceph-mon[112451]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-16T05:54:10.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:10 smithi156 ceph-mon[121001]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-16T05:54:11.405 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.400+0000 7f9759879700 1 -- 172.21.15.155:0/2790059211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9754101b00 msgr2=0x7f9754101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:11.405 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.400+0000 7f9759879700 1 --2- 172.21.15.155:0/2790059211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9754101b00 0x7f9754101ed0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9744004940 tx=0x7f9744009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:11.405 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.400+0000 7f9759879700 1 -- 172.21.15.155:0/2790059211 shutdown_connections 2023-12-16T05:54:11.405 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.400+0000 7f9759879700 1 --2- 172.21.15.155:0/2790059211 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9754102410 0x7f97540fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:11.405 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.400+0000 7f9759879700 1 --2- 172.21.15.155:0/2790059211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9754101b00 0x7f9754101ed0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:11.405 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.400+0000 7f9759879700 1 -- 172.21.15.155:0/2790059211 >> 172.21.15.155:0/2790059211 conn(0x7f97540711a0 msgr2=0x7f97540715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:11.405 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.400+0000 7f9759879700 1 -- 172.21.15.155:0/2790059211 shutdown_connections 2023-12-16T05:54:11.405 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.400+0000 7f9759879700 1 -- 172.21.15.155:0/2790059211 wait complete. 2023-12-16T05:54:11.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.401+0000 7f9759879700 1 Processor -- start 2023-12-16T05:54:11.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.401+0000 7f9759879700 1 -- start start 2023-12-16T05:54:11.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.401+0000 7f9759879700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9754101b00 0x7f9754112500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:11.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.401+0000 7f9759879700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9754102410 0x7f9754112a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:11.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.401+0000 7f9759879700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9754113090 con 0x7f9754101b00 2023-12-16T05:54:11.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.401+0000 7f9759879700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975410c3c0 con 0x7f9754102410 2023-12-16T05:54:11.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.401+0000 7f9752ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9754101b00 0x7f9754112500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:11.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.401+0000 7f9752ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9754101b00 0x7f9754112500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41338/0 (socket says 172.21.15.155:41338) 2023-12-16T05:54:11.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.401+0000 7f9752ffd700 1 -- 172.21.15.155:0/3777889002 learned_addr learned my addr 172.21.15.155:0/3777889002 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:11.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.401+0000 7f97527fc700 1 --2- 172.21.15.155:0/3777889002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9754102410 0x7f9754112a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:11.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.401+0000 7f9752ffd700 1 -- 172.21.15.155:0/3777889002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9754102410 msgr2=0x7f9754112a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:11.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.401+0000 7f9752ffd700 1 --2- 172.21.15.155:0/3777889002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9754102410 0x7f9754112a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:11.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.401+0000 7f9752ffd700 1 -- 172.21.15.155:0/3777889002 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9744005040 con 0x7f9754101b00 2023-12-16T05:54:11.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.401+0000 7f97527fc700 1 --2- 172.21.15.155:0/3777889002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9754102410 0x7f9754112a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T05:54:11.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.402+0000 7f9752ffd700 1 --2- 172.21.15.155:0/3777889002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9754101b00 0x7f9754112500 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f974400b3b0 tx=0x7f9744009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:11.407 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.402+0000 7f973b7fe700 1 -- 172.21.15.155:0/3777889002 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f974400e040 con 0x7f9754101b00 2023-12-16T05:54:11.407 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.402+0000 7f9759879700 1 -- 172.21.15.155:0/3777889002 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975410c640 con 0x7f9754101b00 2023-12-16T05:54:11.407 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.402+0000 7f973b7fe700 1 -- 172.21.15.155:0/3777889002 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f974400be60 con 0x7f9754101b00 2023-12-16T05:54:11.407 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.402+0000 7f973b7fe700 1 -- 172.21.15.155:0/3777889002 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9744013770 con 0x7f9754101b00 2023-12-16T05:54:11.407 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.402+0000 7f9759879700 1 -- 172.21.15.155:0/3777889002 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975410cb80 con 0x7f9754101b00 2023-12-16T05:54:11.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.403+0000 7f9759879700 1 -- 172.21.15.155:0/3777889002 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9754072cc0 con 0x7f9754101b00 2023-12-16T05:54:11.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.404+0000 7f973b7fe700 1 -- 172.21.15.155:0/3777889002 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f974401ead0 con 0x7f9754101b00 2023-12-16T05:54:11.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.404+0000 7f973b7fe700 1 --2- 172.21.15.155:0/3777889002 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f973c068f60 0x7f973c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:11.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.404+0000 7f973b7fe700 1 -- 172.21.15.155:0/3777889002 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f974408b250 con 0x7f9754101b00 2023-12-16T05:54:11.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.404+0000 7f97527fc700 1 --2- 172.21.15.155:0/3777889002 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f973c068f60 0x7f973c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:11.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.404+0000 7f97527fc700 1 --2- 172.21.15.155:0/3777889002 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f973c068f60 0x7f973c06b410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f975410dda0 tx=0x7f9748009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:11.410 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.408+0000 7f973b7fe700 1 -- 172.21.15.155:0/3777889002 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f974405b4f0 con 0x7f9754101b00 2023-12-16T05:54:11.639 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.636+0000 7f9759879700 1 -- 172.21.15.155:0/3777889002 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f975410dbf0 con 0x7f9754101b00 2023-12-16T05:54:11.639 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.636+0000 7f973b7fe700 1 -- 172.21.15.155:0/3777889002 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f9744011370 con 0x7f9754101b00 2023-12-16T05:54:11.639 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:54:11.640 INFO:teuthology.orchestra.run.smithi155.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-16T05:54:11.641 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.638+0000 7f9759879700 1 -- 172.21.15.155:0/3777889002 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f973c068f60 msgr2=0x7f973c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:11.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.638+0000 7f9759879700 1 --2- 172.21.15.155:0/3777889002 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f973c068f60 0x7f973c06b410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f975410dda0 tx=0x7f9748009040 comp rx=0 tx=0).stop 2023-12-16T05:54:11.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.638+0000 7f9759879700 1 -- 172.21.15.155:0/3777889002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9754101b00 msgr2=0x7f9754112500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:11.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.638+0000 7f9759879700 1 --2- 172.21.15.155:0/3777889002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9754101b00 0x7f9754112500 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f974400b3b0 tx=0x7f9744009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:11.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.638+0000 7f9759879700 1 -- 172.21.15.155:0/3777889002 shutdown_connections 2023-12-16T05:54:11.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.638+0000 7f9759879700 1 --2- 172.21.15.155:0/3777889002 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f973c068f60 0x7f973c06b410 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:11.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.638+0000 7f9759879700 1 --2- 172.21.15.155:0/3777889002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9754101b00 0x7f9754112500 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:11.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.638+0000 7f9759879700 1 --2- 172.21.15.155:0/3777889002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9754102410 0x7f9754112a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:11.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.639+0000 7f9759879700 1 -- 172.21.15.155:0/3777889002 >> 172.21.15.155:0/3777889002 conn(0x7f97540711a0 msgr2=0x7f97540fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:11.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.639+0000 7f9759879700 1 -- 172.21.15.155:0/3777889002 shutdown_connections 2023-12-16T05:54:11.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:11.639+0000 7f9759879700 1 -- 172.21.15.155:0/3777889002 wait complete. 2023-12-16T05:54:11.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:11 smithi155 ceph-mon[112451]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:11.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:11 smithi156 ceph-mon[121001]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:12.024 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-12-16T05:54:12.024 INFO:tasks.cephadm:Setup complete, yielding 2023-12-16T05:54:12.024 INFO:teuthology.run_tasks:Running task print... 2023-12-16T05:54:12.034 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2023-12-16T05:54:12.034 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T05:54:12.106 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi155.front.sepia.ceph.com 2023-12-16T05:54:12.106 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2023-12-16T05:54:12.370 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:12.819 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:12 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/3777889002' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-16T05:54:12.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:12 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/3777889002' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-16T05:54:13.394 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.390+0000 7f105b8a5700 1 -- 172.21.15.155:0/4090755014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10540fcd00 msgr2=0x7f10540fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:13.394 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.390+0000 7f105b8a5700 1 --2- 172.21.15.155:0/4090755014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10540fcd00 0x7f10540fd150 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1050004940 tx=0x7f1050009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:13.394 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.390+0000 7f105b8a5700 1 -- 172.21.15.155:0/4090755014 shutdown_connections 2023-12-16T05:54:13.395 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.390+0000 7f105b8a5700 1 --2- 172.21.15.155:0/4090755014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10540fcd00 0x7f10540fd150 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:13.395 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.390+0000 7f105b8a5700 1 --2- 172.21.15.155:0/4090755014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10540fbaf0 0x7f10540fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:13.395 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.390+0000 7f105b8a5700 1 -- 172.21.15.155:0/4090755014 >> 172.21.15.155:0/4090755014 conn(0x7f10540f7190 msgr2=0x7f10540f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:13.395 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.390+0000 7f105b8a5700 1 -- 172.21.15.155:0/4090755014 shutdown_connections 2023-12-16T05:54:13.395 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.390+0000 7f105b8a5700 1 -- 172.21.15.155:0/4090755014 wait complete. 2023-12-16T05:54:13.395 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.391+0000 7f105b8a5700 1 Processor -- start 2023-12-16T05:54:13.395 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.391+0000 7f105b8a5700 1 -- start start 2023-12-16T05:54:13.395 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.391+0000 7f105b8a5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10540fbaf0 0x7f1054110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:13.395 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.391+0000 7f105b8a5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10540fcd00 0x7f10541127e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:13.395 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.391+0000 7f105b8a5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1054066110 con 0x7f10540fcd00 2023-12-16T05:54:13.395 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.391+0000 7f105b8a5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1054066250 con 0x7f10540fbaf0 2023-12-16T05:54:13.395 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.391+0000 7f1058e40700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10540fcd00 0x7f10541127e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:13.395 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.391+0000 7f1058e40700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10540fcd00 0x7f10541127e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41350/0 (socket says 172.21.15.155:41350) 2023-12-16T05:54:13.395 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.391+0000 7f1058e40700 1 -- 172.21.15.155:0/231072878 learned_addr learned my addr 172.21.15.155:0/231072878 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:13.396 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.391+0000 7f1059641700 1 --2- 172.21.15.155:0/231072878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10540fbaf0 0x7f1054110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:13.396 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.391+0000 7f1058e40700 1 -- 172.21.15.155:0/231072878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10540fbaf0 msgr2=0x7f1054110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:13.396 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.391+0000 7f1058e40700 1 --2- 172.21.15.155:0/231072878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10540fbaf0 0x7f1054110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:13.396 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.391+0000 7f1058e40700 1 -- 172.21.15.155:0/231072878 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1050005040 con 0x7f10540fcd00 2023-12-16T05:54:13.396 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.391+0000 7f1058e40700 1 --2- 172.21.15.155:0/231072878 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10540fcd00 0x7f10541127e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1050009fd0 tx=0x7f1050009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:13.396 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.391+0000 7f1049ffb700 1 -- 172.21.15.155:0/231072878 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f105000e040 con 0x7f10540fcd00 2023-12-16T05:54:13.396 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.391+0000 7f105b8a5700 1 -- 172.21.15.155:0/231072878 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1054112de0 con 0x7f10540fcd00 2023-12-16T05:54:13.396 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.391+0000 7f1049ffb700 1 -- 172.21.15.155:0/231072878 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1050004290 con 0x7f10540fcd00 2023-12-16T05:54:13.396 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.391+0000 7f1049ffb700 1 -- 172.21.15.155:0/231072878 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f105001c3f0 con 0x7f10540fcd00 2023-12-16T05:54:13.397 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.392+0000 7f105b8a5700 1 -- 172.21.15.155:0/231072878 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10541132a0 con 0x7f10540fcd00 2023-12-16T05:54:13.397 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.393+0000 7f105b8a5700 1 -- 172.21.15.155:0/231072878 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105404bb80 con 0x7f10540fcd00 2023-12-16T05:54:13.397 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.393+0000 7f1049ffb700 1 -- 172.21.15.155:0/231072878 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f105000bc50 con 0x7f10540fcd00 2023-12-16T05:54:13.397 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.393+0000 7f1049ffb700 1 --2- 172.21.15.155:0/231072878 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f1040068f70 0x7f104006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:13.397 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.393+0000 7f1049ffb700 1 -- 172.21.15.155:0/231072878 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1050087e50 con 0x7f10540fcd00 2023-12-16T05:54:13.397 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.393+0000 7f1059641700 1 --2- 172.21.15.155:0/231072878 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f1040068f70 0x7f104006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:13.397 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.394+0000 7f1059641700 1 --2- 172.21.15.155:0/231072878 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f1040068f70 0x7f104006b420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1054065d90 tx=0x7f1044009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:13.400 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.398+0000 7f1049ffb700 1 -- 172.21.15.155:0/231072878 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1050054660 con 0x7f10540fcd00 2023-12-16T05:54:13.586 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.583+0000 7f105b8a5700 1 -- 172.21.15.155:0/231072878 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f10541134c0 con 0x7f10540fcd00 2023-12-16T05:54:13.590 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.587+0000 7f1049ffb700 1 -- 172.21.15.155:0/231072878 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f1050057c80 con 0x7f10540fcd00 2023-12-16T05:54:13.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.590+0000 7f105b8a5700 1 -- 172.21.15.155:0/231072878 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f1040068f70 msgr2=0x7f104006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:13.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.590+0000 7f105b8a5700 1 --2- 172.21.15.155:0/231072878 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f1040068f70 0x7f104006b420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1054065d90 tx=0x7f1044009040 comp rx=0 tx=0).stop 2023-12-16T05:54:13.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.590+0000 7f105b8a5700 1 -- 172.21.15.155:0/231072878 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10540fcd00 msgr2=0x7f10541127e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:13.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.590+0000 7f105b8a5700 1 --2- 172.21.15.155:0/231072878 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10540fcd00 0x7f10541127e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1050009fd0 tx=0x7f1050009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:13.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.590+0000 7f105b8a5700 1 -- 172.21.15.155:0/231072878 shutdown_connections 2023-12-16T05:54:13.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.590+0000 7f105b8a5700 1 --2- 172.21.15.155:0/231072878 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f1040068f70 0x7f104006b420 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:13.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.590+0000 7f105b8a5700 1 --2- 172.21.15.155:0/231072878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10540fbaf0 0x7f1054110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:13.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.590+0000 7f105b8a5700 1 --2- 172.21.15.155:0/231072878 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10540fcd00 0x7f10541127e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:13.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.590+0000 7f105b8a5700 1 -- 172.21.15.155:0/231072878 >> 172.21.15.155:0/231072878 conn(0x7f10540f7190 msgr2=0x7f10540fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:13.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.590+0000 7f105b8a5700 1 -- 172.21.15.155:0/231072878 shutdown_connections 2023-12-16T05:54:13.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:13.590+0000 7f105b8a5700 1 -- 172.21.15.155:0/231072878 wait complete. 2023-12-16T05:54:13.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:13 smithi155 ceph-mon[112451]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:13.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:13 smithi156 ceph-mon[121001]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:13.948 INFO:teuthology.run_tasks:Running task print... 2023-12-16T05:54:13.958 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2023-12-16T05:54:13.958 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T05:54:13.997 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi155.front.sepia.ceph.com 2023-12-16T05:54:13.997 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- bash -c 'ceph orch status' 2023-12-16T05:54:14.258 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:14.711 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:14 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/231072878' entity='client.admin' 2023-12-16T05:54:14.711 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:14 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:54:14.711 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:14 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:54:14.711 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:14 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:54:14.711 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:14 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:14.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:14 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/231072878' entity='client.admin' 2023-12-16T05:54:14.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:14 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:54:14.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:14 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:54:14.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:14 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:54:14.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:14 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:15.207 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.202+0000 7f946dbf9700 1 -- 172.21.15.155:0/2926477683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94680fbaf0 msgr2=0x7f94680fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:15.207 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.202+0000 7f946dbf9700 1 --2- 172.21.15.155:0/2926477683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94680fbaf0 0x7f94680fbf00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9458004940 tx=0x7f9458009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:15.207 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.202+0000 7f946dbf9700 1 -- 172.21.15.155:0/2926477683 shutdown_connections 2023-12-16T05:54:15.207 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.202+0000 7f946dbf9700 1 --2- 172.21.15.155:0/2926477683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94680fcd00 0x7f94680fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:15.207 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.202+0000 7f946dbf9700 1 --2- 172.21.15.155:0/2926477683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94680fbaf0 0x7f94680fbf00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:15.207 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.202+0000 7f946dbf9700 1 -- 172.21.15.155:0/2926477683 >> 172.21.15.155:0/2926477683 conn(0x7f94680f71b0 msgr2=0x7f94680f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:15.207 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.202+0000 7f946dbf9700 1 -- 172.21.15.155:0/2926477683 shutdown_connections 2023-12-16T05:54:15.207 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.202+0000 7f946dbf9700 1 -- 172.21.15.155:0/2926477683 wait complete. 2023-12-16T05:54:15.207 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.202+0000 7f946dbf9700 1 Processor -- start 2023-12-16T05:54:15.207 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.203+0000 7f946dbf9700 1 -- start start 2023-12-16T05:54:15.207 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.203+0000 7f946dbf9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94680fbaf0 0x7f946810c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:15.207 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.203+0000 7f946dbf9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94680fcd00 0x7f946810c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:15.207 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.203+0000 7f946dbf9700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946810cfa0 con 0x7f94680fcd00 2023-12-16T05:54:15.208 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.203+0000 7f946dbf9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946810d840 con 0x7f94680fbaf0 2023-12-16T05:54:15.208 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.203+0000 7f9466ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94680fcd00 0x7f946810c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:15.208 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.203+0000 7f9466ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94680fcd00 0x7f946810c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41370/0 (socket says 172.21.15.155:41370) 2023-12-16T05:54:15.208 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.203+0000 7f9466ffd700 1 -- 172.21.15.155:0/3253323350 learned_addr learned my addr 172.21.15.155:0/3253323350 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:15.208 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.203+0000 7f94677fe700 1 --2- 172.21.15.155:0/3253323350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94680fbaf0 0x7f946810c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:15.208 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.203+0000 7f9466ffd700 1 -- 172.21.15.155:0/3253323350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94680fbaf0 msgr2=0x7f946810c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:15.208 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.203+0000 7f9466ffd700 1 --2- 172.21.15.155:0/3253323350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94680fbaf0 0x7f946810c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:15.208 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.203+0000 7f9466ffd700 1 -- 172.21.15.155:0/3253323350 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9458005040 con 0x7f94680fcd00 2023-12-16T05:54:15.208 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.203+0000 7f9466ffd700 1 --2- 172.21.15.155:0/3253323350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94680fcd00 0x7f946810c9a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9450002a50 tx=0x7f94500046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:15.208 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.204+0000 7f945ffff700 1 -- 172.21.15.155:0/3253323350 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9450007cc0 con 0x7f94680fcd00 2023-12-16T05:54:15.208 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.204+0000 7f945ffff700 1 -- 172.21.15.155:0/3253323350 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f945000f040 con 0x7f94680fcd00 2023-12-16T05:54:15.208 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.204+0000 7f946dbf9700 1 -- 172.21.15.155:0/3253323350 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f946810db20 con 0x7f94680fcd00 2023-12-16T05:54:15.208 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.204+0000 7f945ffff700 1 -- 172.21.15.155:0/3253323350 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f945000d9c0 con 0x7f94680fcd00 2023-12-16T05:54:15.208 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.204+0000 7f946dbf9700 1 -- 172.21.15.155:0/3253323350 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f946810e060 con 0x7f94680fcd00 2023-12-16T05:54:15.209 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.205+0000 7f946dbf9700 1 -- 172.21.15.155:0/3253323350 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94681064d0 con 0x7f94680fcd00 2023-12-16T05:54:15.209 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.205+0000 7f945ffff700 1 -- 172.21.15.155:0/3253323350 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f945000db20 con 0x7f94680fcd00 2023-12-16T05:54:15.209 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.205+0000 7f945ffff700 1 --2- 172.21.15.155:0/3253323350 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9454068f60 0x7f945406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:15.209 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.205+0000 7f945ffff700 1 -- 172.21.15.155:0/3253323350 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f94500867a0 con 0x7f94680fcd00 2023-12-16T05:54:15.210 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.205+0000 7f94677fe700 1 --2- 172.21.15.155:0/3253323350 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9454068f60 0x7f945406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:15.210 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.206+0000 7f94677fe700 1 --2- 172.21.15.155:0/3253323350 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9454068f60 0x7f945406b410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9458004890 tx=0x7f9458009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:15.212 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.210+0000 7f945ffff700 1 -- 172.21.15.155:0/3253323350 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f94500569c0 con 0x7f94680fcd00 2023-12-16T05:54:15.412 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.409+0000 7f946dbf9700 1 -- 172.21.15.155:0/3253323350 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f946810e280 con 0x7f9454068f60 2023-12-16T05:54:15.413 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.410+0000 7f945ffff700 1 -- 172.21.15.155:0/3253323350 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f946810e280 con 0x7f9454068f60 2023-12-16T05:54:15.413 INFO:teuthology.orchestra.run.smithi155.stdout:Backend: cephadm 2023-12-16T05:54:15.413 INFO:teuthology.orchestra.run.smithi155.stdout:Available: Yes 2023-12-16T05:54:15.413 INFO:teuthology.orchestra.run.smithi155.stdout:Paused: No 2023-12-16T05:54:15.415 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.412+0000 7f946dbf9700 1 -- 172.21.15.155:0/3253323350 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9454068f60 msgr2=0x7f945406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:15.415 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.412+0000 7f946dbf9700 1 --2- 172.21.15.155:0/3253323350 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9454068f60 0x7f945406b410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9458004890 tx=0x7f9458009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:15.415 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.412+0000 7f946dbf9700 1 -- 172.21.15.155:0/3253323350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94680fcd00 msgr2=0x7f946810c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:15.416 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.412+0000 7f946dbf9700 1 --2- 172.21.15.155:0/3253323350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94680fcd00 0x7f946810c9a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9450002a50 tx=0x7f94500046b0 comp rx=0 tx=0).stop 2023-12-16T05:54:15.416 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.412+0000 7f946dbf9700 1 -- 172.21.15.155:0/3253323350 shutdown_connections 2023-12-16T05:54:15.416 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.412+0000 7f946dbf9700 1 --2- 172.21.15.155:0/3253323350 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9454068f60 0x7f945406b410 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:15.416 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.412+0000 7f946dbf9700 1 --2- 172.21.15.155:0/3253323350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94680fbaf0 0x7f946810c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:15.416 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.412+0000 7f946dbf9700 1 --2- 172.21.15.155:0/3253323350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94680fcd00 0x7f946810c9a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:15.416 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.412+0000 7f946dbf9700 1 -- 172.21.15.155:0/3253323350 >> 172.21.15.155:0/3253323350 conn(0x7f94680f71b0 msgr2=0x7f94680f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:15.416 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.412+0000 7f946dbf9700 1 -- 172.21.15.155:0/3253323350 shutdown_connections 2023-12-16T05:54:15.416 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:15.413+0000 7f946dbf9700 1 -- 172.21.15.155:0/3253323350 wait complete. 2023-12-16T05:54:15.822 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:15 smithi155 ceph-mon[112451]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:15.842 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- bash -c 'ceph orch ps' 2023-12-16T05:54:15.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:15 smithi156 ceph-mon[121001]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:16.104 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:16.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:16 smithi155 ceph-mon[112451]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:54:16.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:16 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:54:16.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:16 smithi156 ceph-mon[121001]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:54:16.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:16 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:54:17.049 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.044+0000 7f2536125700 1 -- 172.21.15.155:0/3146665771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25300fcbf0 msgr2=0x7f25300fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:17.049 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.044+0000 7f2536125700 1 --2- 172.21.15.155:0/3146665771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25300fcbf0 0x7f25300fd000 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2520004940 tx=0x7f2520009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:17.049 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.044+0000 7f2536125700 1 -- 172.21.15.155:0/3146665771 shutdown_connections 2023-12-16T05:54:17.049 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.044+0000 7f2536125700 1 --2- 172.21.15.155:0/3146665771 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25300fde00 0x7f25300fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:17.049 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.044+0000 7f2536125700 1 --2- 172.21.15.155:0/3146665771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25300fcbf0 0x7f25300fd000 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:17.049 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.044+0000 7f2536125700 1 -- 172.21.15.155:0/3146665771 >> 172.21.15.155:0/3146665771 conn(0x7f25300f82d0 msgr2=0x7f25300fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:17.049 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.044+0000 7f2536125700 1 -- 172.21.15.155:0/3146665771 shutdown_connections 2023-12-16T05:54:17.049 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.044+0000 7f2536125700 1 -- 172.21.15.155:0/3146665771 wait complete. 2023-12-16T05:54:17.049 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.045+0000 7f2536125700 1 Processor -- start 2023-12-16T05:54:17.049 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.045+0000 7f2536125700 1 -- start start 2023-12-16T05:54:17.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.045+0000 7f2536125700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25300fcbf0 0x7f253010d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:17.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.045+0000 7f2536125700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25300fde00 0x7f253010dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:17.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.045+0000 7f2536125700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253010e170 con 0x7f25300fcbf0 2023-12-16T05:54:17.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.045+0000 7f2536125700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253010e9b0 con 0x7f25300fde00 2023-12-16T05:54:17.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.045+0000 7f252f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25300fcbf0 0x7f253010d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:17.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.045+0000 7f252f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25300fcbf0 0x7f253010d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43410/0 (socket says 172.21.15.155:43410) 2023-12-16T05:54:17.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.045+0000 7f252f7fe700 1 -- 172.21.15.155:0/864271574 learned_addr learned my addr 172.21.15.155:0/864271574 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:17.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.045+0000 7f252f7fe700 1 -- 172.21.15.155:0/864271574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25300fde00 msgr2=0x7f253010dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:17.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.045+0000 7f252f7fe700 1 --2- 172.21.15.155:0/864271574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25300fde00 0x7f253010dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:17.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.045+0000 7f252f7fe700 1 -- 172.21.15.155:0/864271574 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2520005040 con 0x7f25300fcbf0 2023-12-16T05:54:17.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.046+0000 7f252f7fe700 1 --2- 172.21.15.155:0/864271574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25300fcbf0 0x7f253010d5a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2520009fd0 tx=0x7f2520009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:17.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.046+0000 7f2517fff700 1 -- 172.21.15.155:0/864271574 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f252000e040 con 0x7f25300fcbf0 2023-12-16T05:54:17.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.046+0000 7f2517fff700 1 -- 172.21.15.155:0/864271574 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f252000bc50 con 0x7f25300fcbf0 2023-12-16T05:54:17.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.046+0000 7f2536125700 1 -- 172.21.15.155:0/864271574 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253010ec30 con 0x7f25300fcbf0 2023-12-16T05:54:17.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.046+0000 7f2517fff700 1 -- 172.21.15.155:0/864271574 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f252001c630 con 0x7f25300fcbf0 2023-12-16T05:54:17.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.046+0000 7f2536125700 1 -- 172.21.15.155:0/864271574 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253010f170 con 0x7f25300fcbf0 2023-12-16T05:54:17.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.047+0000 7f2536125700 1 -- 172.21.15.155:0/864271574 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253004bb80 con 0x7f25300fcbf0 2023-12-16T05:54:17.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.047+0000 7f2517fff700 1 -- 172.21.15.155:0/864271574 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f2520013420 con 0x7f25300fcbf0 2023-12-16T05:54:17.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.048+0000 7f2517fff700 1 --2- 172.21.15.155:0/864271574 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2518068f60 0x7f251806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:17.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.048+0000 7f2517fff700 1 -- 172.21.15.155:0/864271574 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2520087e60 con 0x7f25300fcbf0 2023-12-16T05:54:17.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.048+0000 7f252effd700 1 --2- 172.21.15.155:0/864271574 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2518068f60 0x7f251806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:17.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.048+0000 7f252effd700 1 --2- 172.21.15.155:0/864271574 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2518068f60 0x7f251806b410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2524006fd0 tx=0x7f2524006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:17.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.053+0000 7f2517fff700 1 -- 172.21.15.155:0/864271574 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2520058100 con 0x7f25300fcbf0 2023-12-16T05:54:17.247 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.244+0000 7f2536125700 1 -- 172.21.15.155:0/864271574 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f253010f740 con 0x7f2518068f60 2023-12-16T05:54:17.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.253+0000 7f2517fff700 1 -- 172.21.15.155:0/864271574 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2718 (secure 0 0 0) 0x7f253010f740 con 0x7f2518068f60 2023-12-16T05:54:17.255 INFO:teuthology.orchestra.run.smithi155.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T05:54:17.255 INFO:teuthology.orchestra.run.smithi155.stdout:alertmanager.smithi155 smithi155 *:9093,9094 running (2m) 92s ago 3m 26.3M - 0.25.0 c8568f914cd2 59958a4f4cbd 2023-12-16T05:54:17.255 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi155 smithi155 running (3m) 92s ago 3m 7444k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 033f79f53811 2023-12-16T05:54:17.255 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi156 smithi156 running (2m) 40s ago 2m 7470k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 c72bd1a1d00a 2023-12-16T05:54:17.256 INFO:teuthology.orchestra.run.smithi155.stdout:grafana.smithi155 smithi155 *:3000 running (2m) 92s ago 3m 81.7M - 9.4.7 954c08fa6188 cb715f87b8c6 2023-12-16T05:54:17.256 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi155.maowdn smithi155 *:9283 running (4m) 92s ago 4m 483M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 73b9fc45e71f 2023-12-16T05:54:17.256 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi156.pclong smithi156 *:8443,9283 running (2m) 40s ago 2m 438M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 39a878588040 2023-12-16T05:54:17.256 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi155 smithi155 running (4m) 92s ago 4m 59.0M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 0d0eecfde53b 2023-12-16T05:54:17.256 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi156 smithi156 running (2m) 40s ago 2m 50.1M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 4575acae9bdb 2023-12-16T05:54:17.256 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi155 smithi155 *:9100 running (3m) 92s ago 3m 15.4M - 1.5.0 0da6a335fe13 500b3e583f23 2023-12-16T05:54:17.256 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi156 smithi156 *:9100 running (2m) 40s ago 2m 18.9M - 1.5.0 0da6a335fe13 7e4371b6e840 2023-12-16T05:54:17.256 INFO:teuthology.orchestra.run.smithi155.stdout:osd.0 smithi155 running (2m) 92s ago 2m 40.0M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 91e650c277f7 2023-12-16T05:54:17.256 INFO:teuthology.orchestra.run.smithi155.stdout:osd.1 smithi155 running (115s) 92s ago 115s 39.7M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957303cb6598 2023-12-16T05:54:17.256 INFO:teuthology.orchestra.run.smithi155.stdout:osd.2 smithi155 running (96s) 92s ago 95s 12.0M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957a169c1cac 2023-12-16T05:54:17.256 INFO:teuthology.orchestra.run.smithi155.stdout:osd.3 smithi156 running (78s) 40s ago 77s 44.3M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c4f6c54afe99 2023-12-16T05:54:17.256 INFO:teuthology.orchestra.run.smithi155.stdout:osd.4 smithi156 running (60s) 40s ago 60s 41.0M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 6309b12204fd 2023-12-16T05:54:17.256 INFO:teuthology.orchestra.run.smithi155.stdout:osd.5 smithi156 running (43s) 40s ago 42s 12.0M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 84b2c33eb0e1 2023-12-16T05:54:17.256 INFO:teuthology.orchestra.run.smithi155.stdout:prometheus.smithi155 smithi155 *:9095 running (2m) 92s ago 3m 34.4M - 2.43.0 a07b618ecd1d 75cfe8962fd8 2023-12-16T05:54:17.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.254+0000 7f2536125700 1 -- 172.21.15.155:0/864271574 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2518068f60 msgr2=0x7f251806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:17.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.254+0000 7f2536125700 1 --2- 172.21.15.155:0/864271574 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2518068f60 0x7f251806b410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2524006fd0 tx=0x7f2524006db0 comp rx=0 tx=0).stop 2023-12-16T05:54:17.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.254+0000 7f2536125700 1 -- 172.21.15.155:0/864271574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25300fcbf0 msgr2=0x7f253010d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:17.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.254+0000 7f2536125700 1 --2- 172.21.15.155:0/864271574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25300fcbf0 0x7f253010d5a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2520009fd0 tx=0x7f2520009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:17.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.254+0000 7f2536125700 1 -- 172.21.15.155:0/864271574 shutdown_connections 2023-12-16T05:54:17.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.254+0000 7f2536125700 1 --2- 172.21.15.155:0/864271574 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2518068f60 0x7f251806b410 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:17.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.254+0000 7f2536125700 1 --2- 172.21.15.155:0/864271574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25300fcbf0 0x7f253010d5a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:17.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.254+0000 7f2536125700 1 --2- 172.21.15.155:0/864271574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25300fde00 0x7f253010dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:17.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.254+0000 7f2536125700 1 -- 172.21.15.155:0/864271574 >> 172.21.15.155:0/864271574 conn(0x7f25300f82d0 msgr2=0x7f2530101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:17.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.255+0000 7f2536125700 1 -- 172.21.15.155:0/864271574 shutdown_connections 2023-12-16T05:54:17.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:17.255+0000 7f2536125700 1 -- 172.21.15.155:0/864271574 wait complete. 2023-12-16T05:54:17.623 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- bash -c 'ceph orch ls' 2023-12-16T05:54:17.884 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:17.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:17 smithi156 ceph-mon[121001]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:17.999 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:17 smithi155 ceph-mon[112451]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:18.864 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.861+0000 7fb3bc33f700 1 -- 172.21.15.155:0/1737667437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3b40fbaf0 msgr2=0x7fb3b40fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:18.864 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.861+0000 7fb3bc33f700 1 --2- 172.21.15.155:0/1737667437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3b40fbaf0 0x7fb3b40fbf00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8004940 tx=0x7fb3a8009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:18.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.861+0000 7fb3bc33f700 1 -- 172.21.15.155:0/1737667437 shutdown_connections 2023-12-16T05:54:18.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.861+0000 7fb3bc33f700 1 --2- 172.21.15.155:0/1737667437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3b40fcd00 0x7fb3b40fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:18.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.861+0000 7fb3bc33f700 1 --2- 172.21.15.155:0/1737667437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3b40fbaf0 0x7fb3b40fbf00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:18.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.861+0000 7fb3bc33f700 1 -- 172.21.15.155:0/1737667437 >> 172.21.15.155:0/1737667437 conn(0x7fb3b40f7190 msgr2=0x7fb3b40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:18.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.861+0000 7fb3bc33f700 1 -- 172.21.15.155:0/1737667437 shutdown_connections 2023-12-16T05:54:18.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.861+0000 7fb3bc33f700 1 -- 172.21.15.155:0/1737667437 wait complete. 2023-12-16T05:54:18.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.862+0000 7fb3bc33f700 1 Processor -- start 2023-12-16T05:54:18.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.862+0000 7fb3bc33f700 1 -- start start 2023-12-16T05:54:18.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.862+0000 7fb3bc33f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3b40fbaf0 0x7fb3b410c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:18.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.862+0000 7fb3bc33f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3b40fcd00 0x7fb3b410c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:18.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.862+0000 7fb3bc33f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b410cfc0 con 0x7fb3b40fcd00 2023-12-16T05:54:18.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.862+0000 7fb3bc33f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b410d860 con 0x7fb3b40fbaf0 2023-12-16T05:54:18.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.862+0000 7fb3b98da700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3b40fcd00 0x7fb3b410c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:18.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.862+0000 7fb3b98da700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3b40fcd00 0x7fb3b410c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43426/0 (socket says 172.21.15.155:43426) 2023-12-16T05:54:18.866 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.862+0000 7fb3b98da700 1 -- 172.21.15.155:0/2061726125 learned_addr learned my addr 172.21.15.155:0/2061726125 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:18.866 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.862+0000 7fb3ba0db700 1 --2- 172.21.15.155:0/2061726125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3b40fbaf0 0x7fb3b410c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:18.866 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.862+0000 7fb3b98da700 1 -- 172.21.15.155:0/2061726125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3b40fbaf0 msgr2=0x7fb3b410c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:18.866 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.862+0000 7fb3b98da700 1 --2- 172.21.15.155:0/2061726125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3b40fbaf0 0x7fb3b410c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:18.866 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.862+0000 7fb3b98da700 1 -- 172.21.15.155:0/2061726125 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a8005040 con 0x7fb3b40fcd00 2023-12-16T05:54:18.866 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.862+0000 7fb3b98da700 1 --2- 172.21.15.155:0/2061726125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3b40fcd00 0x7fb3b410c9c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0002a50 tx=0x7fb3b00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:18.867 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.863+0000 7fb3a6ffd700 1 -- 172.21.15.155:0/2061726125 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3b0007cc0 con 0x7fb3b40fcd00 2023-12-16T05:54:18.867 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.863+0000 7fb3a6ffd700 1 -- 172.21.15.155:0/2061726125 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb3b000f040 con 0x7fb3b40fcd00 2023-12-16T05:54:18.867 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.863+0000 7fb3bc33f700 1 -- 172.21.15.155:0/2061726125 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b410db40 con 0x7fb3b40fcd00 2023-12-16T05:54:18.867 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.863+0000 7fb3a6ffd700 1 -- 172.21.15.155:0/2061726125 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3b000d9c0 con 0x7fb3b40fcd00 2023-12-16T05:54:18.867 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.863+0000 7fb3bc33f700 1 -- 172.21.15.155:0/2061726125 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b410e080 con 0x7fb3b40fcd00 2023-12-16T05:54:18.867 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.864+0000 7fb3bc33f700 1 -- 172.21.15.155:0/2061726125 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b404bb80 con 0x7fb3b40fcd00 2023-12-16T05:54:18.868 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.864+0000 7fb3a6ffd700 1 -- 172.21.15.155:0/2061726125 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fb3b000db20 con 0x7fb3b40fcd00 2023-12-16T05:54:18.868 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.864+0000 7fb3a6ffd700 1 --2- 172.21.15.155:0/2061726125 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fb3a0068f60 0x7fb3a006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:18.868 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.864+0000 7fb3a6ffd700 1 -- 172.21.15.155:0/2061726125 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb3b00866b0 con 0x7fb3b40fcd00 2023-12-16T05:54:18.868 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.865+0000 7fb3ba0db700 1 --2- 172.21.15.155:0/2061726125 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fb3a0068f60 0x7fb3a006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:18.868 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.865+0000 7fb3ba0db700 1 --2- 172.21.15.155:0/2061726125 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fb3a0068f60 0x7fb3a006b410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8004890 tx=0x7fb3a8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:18.870 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:18.869+0000 7fb3a6ffd700 1 -- 172.21.15.155:0/2061726125 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb3b0056950 con 0x7fb3b40fcd00 2023-12-16T05:54:18.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:18 smithi156 ceph-mon[121001]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:54:19.062 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:19.060+0000 7fb3bc33f700 1 -- 172.21.15.155:0/2061726125 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3b410e520 con 0x7fb3a0068f60 2023-12-16T05:54:19.066 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:19.064+0000 7fb3a6ffd700 1 -- 172.21.15.155:0/2061726125 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1179 (secure 0 0 0) 0x7fb3b410e520 con 0x7fb3a0068f60 2023-12-16T05:54:19.066 INFO:teuthology.orchestra.run.smithi155.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-12-16T05:54:19.066 INFO:teuthology.orchestra.run.smithi155.stdout:alertmanager ?:9093,9094 1/1 93s ago 4m count:1 2023-12-16T05:54:19.067 INFO:teuthology.orchestra.run.smithi155.stdout:crash 2/2 93s ago 4m * 2023-12-16T05:54:19.067 INFO:teuthology.orchestra.run.smithi155.stdout:grafana ?:3000 1/1 93s ago 4m count:1 2023-12-16T05:54:19.067 INFO:teuthology.orchestra.run.smithi155.stdout:mgr 2/2 93s ago 4m count:2 2023-12-16T05:54:19.067 INFO:teuthology.orchestra.run.smithi155.stdout:mon 2/2 93s ago 3m smithi155:172.21.15.155=smithi155;smithi156:172.21.15.156=smithi156;count:2 2023-12-16T05:54:19.067 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter ?:9100 2/2 93s ago 4m * 2023-12-16T05:54:19.067 INFO:teuthology.orchestra.run.smithi155.stdout:osd 6 93s ago - 2023-12-16T05:54:19.067 INFO:teuthology.orchestra.run.smithi155.stdout:prometheus ?:9095 1/1 93s ago 4m count:1 2023-12-16T05:54:19.069 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:19.066+0000 7fb3bc33f700 1 -- 172.21.15.155:0/2061726125 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fb3a0068f60 msgr2=0x7fb3a006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:19.069 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:19.066+0000 7fb3bc33f700 1 --2- 172.21.15.155:0/2061726125 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fb3a0068f60 0x7fb3a006b410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8004890 tx=0x7fb3a8009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:19.069 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:19.067+0000 7fb3bc33f700 1 -- 172.21.15.155:0/2061726125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3b40fcd00 msgr2=0x7fb3b410c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:19.069 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:19.067+0000 7fb3bc33f700 1 --2- 172.21.15.155:0/2061726125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3b40fcd00 0x7fb3b410c9c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0002a50 tx=0x7fb3b00046b0 comp rx=0 tx=0).stop 2023-12-16T05:54:19.069 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:19.067+0000 7fb3bc33f700 1 -- 172.21.15.155:0/2061726125 shutdown_connections 2023-12-16T05:54:19.069 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:19.067+0000 7fb3bc33f700 1 --2- 172.21.15.155:0/2061726125 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fb3a0068f60 0x7fb3a006b410 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:19.069 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:19.067+0000 7fb3bc33f700 1 --2- 172.21.15.155:0/2061726125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3b40fbaf0 0x7fb3b410c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:19.069 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:19.067+0000 7fb3bc33f700 1 --2- 172.21.15.155:0/2061726125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3b40fcd00 0x7fb3b410c9c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:19.069 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:19.067+0000 7fb3bc33f700 1 -- 172.21.15.155:0/2061726125 >> 172.21.15.155:0/2061726125 conn(0x7fb3b40f7190 msgr2=0x7fb3b40fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:19.069 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:19.067+0000 7fb3bc33f700 1 -- 172.21.15.155:0/2061726125 shutdown_connections 2023-12-16T05:54:19.070 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:19.067+0000 7fb3bc33f700 1 -- 172.21.15.155:0/2061726125 wait complete. 2023-12-16T05:54:19.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:18 smithi155 ceph-mon[112451]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:54:19.436 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- bash -c 'ceph orch host ls' 2023-12-16T05:54:19.778 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:19.916 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:19 smithi155 ceph-mon[112451]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:19.934 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:19 smithi156 ceph-mon[121001]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:20.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.708+0000 7f4b87dbb700 1 -- 172.21.15.155:0/1999568519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b800fbaf0 msgr2=0x7f4b800fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:20.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.708+0000 7f4b87dbb700 1 --2- 172.21.15.155:0/1999568519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b800fbaf0 0x7f4b800fbf00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4b74004940 tx=0x7f4b74009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:20.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.708+0000 7f4b87dbb700 1 -- 172.21.15.155:0/1999568519 shutdown_connections 2023-12-16T05:54:20.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.708+0000 7f4b87dbb700 1 --2- 172.21.15.155:0/1999568519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b800fcd00 0x7f4b800fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:20.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.708+0000 7f4b87dbb700 1 --2- 172.21.15.155:0/1999568519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b800fbaf0 0x7f4b800fbf00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:20.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.708+0000 7f4b87dbb700 1 -- 172.21.15.155:0/1999568519 >> 172.21.15.155:0/1999568519 conn(0x7f4b800f71b0 msgr2=0x7f4b800f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:20.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.708+0000 7f4b87dbb700 1 -- 172.21.15.155:0/1999568519 shutdown_connections 2023-12-16T05:54:20.712 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.708+0000 7f4b87dbb700 1 -- 172.21.15.155:0/1999568519 wait complete. 2023-12-16T05:54:20.712 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.709+0000 7f4b87dbb700 1 Processor -- start 2023-12-16T05:54:20.712 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.709+0000 7f4b87dbb700 1 -- start start 2023-12-16T05:54:20.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.709+0000 7f4b87dbb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b800fbaf0 0x7f4b8010c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:20.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.709+0000 7f4b87dbb700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b800fcd00 0x7f4b8010c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:20.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.709+0000 7f4b87dbb700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8010d040 con 0x7f4b800fcd00 2023-12-16T05:54:20.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.709+0000 7f4b87dbb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8010d880 con 0x7f4b800fbaf0 2023-12-16T05:54:20.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.709+0000 7f4b85356700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b800fcd00 0x7f4b8010c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:20.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.709+0000 7f4b85356700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b800fcd00 0x7f4b8010c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43442/0 (socket says 172.21.15.155:43442) 2023-12-16T05:54:20.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.709+0000 7f4b85356700 1 -- 172.21.15.155:0/4064035589 learned_addr learned my addr 172.21.15.155:0/4064035589 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:20.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.710+0000 7f4b85b57700 1 --2- 172.21.15.155:0/4064035589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b800fbaf0 0x7f4b8010c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:20.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.710+0000 7f4b85356700 1 -- 172.21.15.155:0/4064035589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b800fbaf0 msgr2=0x7f4b8010c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:20.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.710+0000 7f4b85356700 1 --2- 172.21.15.155:0/4064035589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b800fbaf0 0x7f4b8010c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:20.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.710+0000 7f4b85356700 1 -- 172.21.15.155:0/4064035589 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b74005040 con 0x7f4b800fcd00 2023-12-16T05:54:20.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.710+0000 7f4b85356700 1 --2- 172.21.15.155:0/4064035589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b800fcd00 0x7f4b8010c9b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00b790 tx=0x7f4b7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:20.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.710+0000 7f4b727fc700 1 -- 172.21.15.155:0/4064035589 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b7c00f770 con 0x7f4b800fcd00 2023-12-16T05:54:20.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.710+0000 7f4b727fc700 1 -- 172.21.15.155:0/4064035589 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4b7c00fd80 con 0x7f4b800fcd00 2023-12-16T05:54:20.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.710+0000 7f4b727fc700 1 -- 172.21.15.155:0/4064035589 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b7c00d310 con 0x7f4b800fcd00 2023-12-16T05:54:20.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.710+0000 7f4b87dbb700 1 -- 172.21.15.155:0/4064035589 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b8010db60 con 0x7f4b800fcd00 2023-12-16T05:54:20.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.710+0000 7f4b87dbb700 1 -- 172.21.15.155:0/4064035589 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8010e0a0 con 0x7f4b800fcd00 2023-12-16T05:54:20.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.711+0000 7f4b87dbb700 1 -- 172.21.15.155:0/4064035589 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b8004bb80 con 0x7f4b800fcd00 2023-12-16T05:54:20.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.711+0000 7f4b727fc700 1 -- 172.21.15.155:0/4064035589 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f4b7c010420 con 0x7f4b800fcd00 2023-12-16T05:54:20.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.712+0000 7f4b727fc700 1 --2- 172.21.15.155:0/4064035589 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f4b6c068f70 0x7f4b6c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:20.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.712+0000 7f4b85b57700 1 --2- 172.21.15.155:0/4064035589 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f4b6c068f70 0x7f4b6c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:20.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.712+0000 7f4b727fc700 1 -- 172.21.15.155:0/4064035589 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4b7c086a50 con 0x7f4b800fcd00 2023-12-16T05:54:20.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.712+0000 7f4b85b57700 1 --2- 172.21.15.155:0/4064035589 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f4b6c068f70 0x7f4b6c06b420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400b730 tx=0x7f4b74009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:20.718 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.716+0000 7f4b727fc700 1 -- 172.21.15.155:0/4064035589 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4b7c056cf0 con 0x7f4b800fcd00 2023-12-16T05:54:20.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:20 smithi155 ceph-mon[112451]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:54:20.911 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.909+0000 7f4b87dbb700 1 -- 172.21.15.155:0/4064035589 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b8010e570 con 0x7f4b6c068f70 2023-12-16T05:54:20.912 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.910+0000 7f4b727fc700 1 -- 172.21.15.155:0/4064035589 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f4b8010e570 con 0x7f4b6c068f70 2023-12-16T05:54:20.912 INFO:teuthology.orchestra.run.smithi155.stdout:HOST ADDR LABELS STATUS 2023-12-16T05:54:20.913 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155 172.21.15.155 2023-12-16T05:54:20.913 INFO:teuthology.orchestra.run.smithi155.stdout:smithi156 172.21.15.156 2023-12-16T05:54:20.913 INFO:teuthology.orchestra.run.smithi155.stdout:2 hosts in cluster 2023-12-16T05:54:20.914 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.912+0000 7f4b87dbb700 1 -- 172.21.15.155:0/4064035589 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f4b6c068f70 msgr2=0x7f4b6c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:20.914 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.912+0000 7f4b87dbb700 1 --2- 172.21.15.155:0/4064035589 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f4b6c068f70 0x7f4b6c06b420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400b730 tx=0x7f4b74009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:20.915 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.912+0000 7f4b87dbb700 1 -- 172.21.15.155:0/4064035589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b800fcd00 msgr2=0x7f4b8010c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:20.915 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.912+0000 7f4b87dbb700 1 --2- 172.21.15.155:0/4064035589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b800fcd00 0x7f4b8010c9b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00b790 tx=0x7f4b7c009250 comp rx=0 tx=0).stop 2023-12-16T05:54:20.915 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.912+0000 7f4b87dbb700 1 -- 172.21.15.155:0/4064035589 shutdown_connections 2023-12-16T05:54:20.915 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.912+0000 7f4b87dbb700 1 --2- 172.21.15.155:0/4064035589 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f4b6c068f70 0x7f4b6c06b420 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:20.915 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.912+0000 7f4b87dbb700 1 --2- 172.21.15.155:0/4064035589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b800fbaf0 0x7f4b8010c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:20.915 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.912+0000 7f4b87dbb700 1 --2- 172.21.15.155:0/4064035589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b800fcd00 0x7f4b8010c9b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:20.915 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.912+0000 7f4b87dbb700 1 -- 172.21.15.155:0/4064035589 >> 172.21.15.155:0/4064035589 conn(0x7f4b800f71b0 msgr2=0x7f4b800fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:20.915 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.913+0000 7f4b87dbb700 1 -- 172.21.15.155:0/4064035589 shutdown_connections 2023-12-16T05:54:20.915 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:20.913+0000 7f4b87dbb700 1 -- 172.21.15.155:0/4064035589 wait complete. 2023-12-16T05:54:20.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:20 smithi156 ceph-mon[121001]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:54:21.314 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- bash -c 'ceph orch device ls' 2023-12-16T05:54:21.575 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:21.901 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:21 smithi155 ceph-mon[112451]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:21.902 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:21 smithi155 ceph-mon[112451]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:54:21.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:21 smithi156 ceph-mon[121001]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:21.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:21 smithi156 ceph-mon[121001]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:54:22.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.585+0000 7f7aa06ff700 1 -- 172.21.15.155:0/1247668580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a980ffd90 msgr2=0x7f7a981021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:22.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.585+0000 7f7aa06ff700 1 --2- 172.21.15.155:0/1247668580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a980ffd90 0x7f7a981021d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7a94004940 tx=0x7f7a94009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:22.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.585+0000 7f7aa06ff700 1 -- 172.21.15.155:0/1247668580 shutdown_connections 2023-12-16T05:54:22.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.585+0000 7f7aa06ff700 1 --2- 172.21.15.155:0/1247668580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a980ffd90 0x7f7a981021d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:22.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.585+0000 7f7aa06ff700 1 --2- 172.21.15.155:0/1247668580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a98066070 0x7f7a980ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:22.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.585+0000 7f7aa06ff700 1 -- 172.21.15.155:0/1247668580 >> 172.21.15.155:0/1247668580 conn(0x7f7a980f7190 msgr2=0x7f7a980f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:22.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.585+0000 7f7aa06ff700 1 -- 172.21.15.155:0/1247668580 shutdown_connections 2023-12-16T05:54:22.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.585+0000 7f7aa06ff700 1 -- 172.21.15.155:0/1247668580 wait complete. 2023-12-16T05:54:22.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.586+0000 7f7aa06ff700 1 Processor -- start 2023-12-16T05:54:22.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.586+0000 7f7aa06ff700 1 -- start start 2023-12-16T05:54:22.590 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.586+0000 7f7aa06ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a98066070 0x7f7a9810d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:22.590 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.586+0000 7f7aa06ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a980ffd90 0x7f7a9810dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:22.590 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.586+0000 7f7aa06ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9810e0b0 con 0x7f7a98066070 2023-12-16T05:54:22.590 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.586+0000 7f7aa06ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9810e950 con 0x7f7a980ffd90 2023-12-16T05:54:22.590 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.586+0000 7f7a9e49b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a98066070 0x7f7a9810d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:22.590 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.586+0000 7f7a9e49b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a98066070 0x7f7a9810d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43450/0 (socket says 172.21.15.155:43450) 2023-12-16T05:54:22.590 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.586+0000 7f7a9e49b700 1 -- 172.21.15.155:0/3924454155 learned_addr learned my addr 172.21.15.155:0/3924454155 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:22.591 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.586+0000 7f7a9dc9a700 1 --2- 172.21.15.155:0/3924454155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a980ffd90 0x7f7a9810dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:22.591 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.587+0000 7f7a9e49b700 1 -- 172.21.15.155:0/3924454155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a980ffd90 msgr2=0x7f7a9810dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:22.591 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.587+0000 7f7a9e49b700 1 --2- 172.21.15.155:0/3924454155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a980ffd90 0x7f7a9810dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:22.591 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.587+0000 7f7a9e49b700 1 -- 172.21.15.155:0/3924454155 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a94005040 con 0x7f7a98066070 2023-12-16T05:54:22.591 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.587+0000 7f7a9e49b700 1 --2- 172.21.15.155:0/3924454155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a98066070 0x7f7a9810d570 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c002a50 tx=0x7f7a8c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:22.591 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.587+0000 7f7a8affd700 1 -- 172.21.15.155:0/3924454155 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a8c007cc0 con 0x7f7a98066070 2023-12-16T05:54:22.591 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.587+0000 7f7a8affd700 1 -- 172.21.15.155:0/3924454155 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7a8c00f040 con 0x7f7a98066070 2023-12-16T05:54:22.591 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.587+0000 7f7aa06ff700 1 -- 172.21.15.155:0/3924454155 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a9810ec30 con 0x7f7a98066070 2023-12-16T05:54:22.591 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.587+0000 7f7a8affd700 1 -- 172.21.15.155:0/3924454155 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a8c00d9c0 con 0x7f7a98066070 2023-12-16T05:54:22.591 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.587+0000 7f7aa06ff700 1 -- 172.21.15.155:0/3924454155 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a9810f170 con 0x7f7a98066070 2023-12-16T05:54:22.591 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.588+0000 7f7aa06ff700 1 -- 172.21.15.155:0/3924454155 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a981075c0 con 0x7f7a98066070 2023-12-16T05:54:22.591 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.588+0000 7f7a8affd700 1 -- 172.21.15.155:0/3924454155 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f7a8c00db20 con 0x7f7a98066070 2023-12-16T05:54:22.592 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.589+0000 7f7a8affd700 1 --2- 172.21.15.155:0/3924454155 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7a84068f60 0x7f7a8406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:22.592 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.589+0000 7f7a8affd700 1 -- 172.21.15.155:0/3924454155 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7a8c0867a0 con 0x7f7a98066070 2023-12-16T05:54:22.592 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.589+0000 7f7a9dc9a700 1 --2- 172.21.15.155:0/3924454155 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7a84068f60 0x7f7a8406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:22.592 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.589+0000 7f7a9dc9a700 1 --2- 172.21.15.155:0/3924454155 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7a84068f60 0x7f7a8406b410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7a94004890 tx=0x7f7a94009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:22.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.593+0000 7f7a8affd700 1 -- 172.21.15.155:0/3924454155 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7a8c0569c0 con 0x7f7a98066070 2023-12-16T05:54:22.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.785+0000 7f7aa06ff700 1 -- 172.21.15.155:0/3924454155 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a9810f400 con 0x7f7a84068f60 2023-12-16T05:54:22.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.787+0000 7f7a8affd700 1 -- 172.21.15.155:0/3924454155 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f7a9810f400 con 0x7f7a84068f60 2023-12-16T05:54:22.789 INFO:teuthology.orchestra.run.smithi155.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-12-16T05:54:22.789 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GW400BGN 372G No 95s ago Has a FileSystem, LVM detected 2023-12-16T05:54:22.789 INFO:teuthology.orchestra.run.smithi155.stdout:smithi156 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB74760040480DGN 447G No 43s ago Has a FileSystem, LVM detected 2023-12-16T05:54:22.793 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.789+0000 7f7aa06ff700 1 -- 172.21.15.155:0/3924454155 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7a84068f60 msgr2=0x7f7a8406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:22.793 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.789+0000 7f7aa06ff700 1 --2- 172.21.15.155:0/3924454155 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7a84068f60 0x7f7a8406b410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7a94004890 tx=0x7f7a94009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:22.793 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.789+0000 7f7aa06ff700 1 -- 172.21.15.155:0/3924454155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a98066070 msgr2=0x7f7a9810d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:22.793 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.789+0000 7f7aa06ff700 1 --2- 172.21.15.155:0/3924454155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a98066070 0x7f7a9810d570 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c002a50 tx=0x7f7a8c0046b0 comp rx=0 tx=0).stop 2023-12-16T05:54:22.793 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.789+0000 7f7aa06ff700 1 -- 172.21.15.155:0/3924454155 shutdown_connections 2023-12-16T05:54:22.793 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.789+0000 7f7aa06ff700 1 --2- 172.21.15.155:0/3924454155 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7a84068f60 0x7f7a8406b410 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:22.793 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.789+0000 7f7aa06ff700 1 --2- 172.21.15.155:0/3924454155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a98066070 0x7f7a9810d570 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:22.793 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.789+0000 7f7aa06ff700 1 --2- 172.21.15.155:0/3924454155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a980ffd90 0x7f7a9810dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:22.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.789+0000 7f7aa06ff700 1 -- 172.21.15.155:0/3924454155 >> 172.21.15.155:0/3924454155 conn(0x7f7a980f7190 msgr2=0x7f7a980f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:22.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.789+0000 7f7aa06ff700 1 -- 172.21.15.155:0/3924454155 shutdown_connections 2023-12-16T05:54:22.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:22.789+0000 7f7aa06ff700 1 -- 172.21.15.155:0/3924454155 wait complete. 2023-12-16T05:54:23.163 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T05:54:23.172 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi155.front.sepia.ceph.com 2023-12-16T05:54:23.173 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2023-12-16T05:54:23.438 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:23.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:23 smithi155 ceph-mon[112451]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:23.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:23 smithi155 ceph-mon[112451]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:54:23.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:23 smithi156 ceph-mon[121001]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:23.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:23 smithi156 ceph-mon[121001]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:54:24.389 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.384+0000 7f8f32182700 1 -- 172.21.15.155:0/450631749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c0fcd00 msgr2=0x7f8f2c0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:24.389 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.384+0000 7f8f32182700 1 --2- 172.21.15.155:0/450631749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c0fcd00 0x7f8f2c0fd150 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c004940 tx=0x7f8f1c009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:24.389 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.384+0000 7f8f32182700 1 -- 172.21.15.155:0/450631749 shutdown_connections 2023-12-16T05:54:24.389 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.384+0000 7f8f32182700 1 --2- 172.21.15.155:0/450631749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c0fcd00 0x7f8f2c0fd150 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:24.389 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.384+0000 7f8f32182700 1 --2- 172.21.15.155:0/450631749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f2c0fbaf0 0x7f8f2c0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:24.389 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.384+0000 7f8f32182700 1 -- 172.21.15.155:0/450631749 >> 172.21.15.155:0/450631749 conn(0x7f8f2c0f71d0 msgr2=0x7f8f2c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:24.389 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.384+0000 7f8f32182700 1 -- 172.21.15.155:0/450631749 shutdown_connections 2023-12-16T05:54:24.389 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.384+0000 7f8f32182700 1 -- 172.21.15.155:0/450631749 wait complete. 2023-12-16T05:54:24.389 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.384+0000 7f8f32182700 1 Processor -- start 2023-12-16T05:54:24.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.384+0000 7f8f32182700 1 -- start start 2023-12-16T05:54:24.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.384+0000 7f8f32182700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f2c0fbaf0 0x7f8f2c10c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:24.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.384+0000 7f8f32182700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c0fcd00 0x7f8f2c10c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:24.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.384+0000 7f8f32182700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c10d040 con 0x7f8f2c0fcd00 2023-12-16T05:54:24.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.384+0000 7f8f32182700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c10d880 con 0x7f8f2c0fbaf0 2023-12-16T05:54:24.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.385+0000 7f8f2affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c0fcd00 0x7f8f2c10c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:24.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.385+0000 7f8f2affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c0fcd00 0x7f8f2c10c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43470/0 (socket says 172.21.15.155:43470) 2023-12-16T05:54:24.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.385+0000 7f8f2affd700 1 -- 172.21.15.155:0/298180309 learned_addr learned my addr 172.21.15.155:0/298180309 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:24.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.385+0000 7f8f2b7fe700 1 --2- 172.21.15.155:0/298180309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f2c0fbaf0 0x7f8f2c10c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:24.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.385+0000 7f8f2affd700 1 -- 172.21.15.155:0/298180309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f2c0fbaf0 msgr2=0x7f8f2c10c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:24.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.385+0000 7f8f2affd700 1 --2- 172.21.15.155:0/298180309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f2c0fbaf0 0x7f8f2c10c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:24.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.385+0000 7f8f2affd700 1 -- 172.21.15.155:0/298180309 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c005040 con 0x7f8f2c0fcd00 2023-12-16T05:54:24.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.385+0000 7f8f2b7fe700 1 --2- 172.21.15.155:0/298180309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f2c0fbaf0 0x7f8f2c10c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T05:54:24.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.385+0000 7f8f2affd700 1 --2- 172.21.15.155:0/298180309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c0fcd00 0x7f8f2c10c9b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c009360 tx=0x7f8f1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:24.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.385+0000 7f8f23fff700 1 -- 172.21.15.155:0/298180309 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f1c00e040 con 0x7f8f2c0fcd00 2023-12-16T05:54:24.391 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.385+0000 7f8f23fff700 1 -- 172.21.15.155:0/298180309 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8f1c00bcd0 con 0x7f8f2c0fcd00 2023-12-16T05:54:24.391 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.385+0000 7f8f32182700 1 -- 172.21.15.155:0/298180309 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2c10db00 con 0x7f8f2c0fcd00 2023-12-16T05:54:24.391 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.385+0000 7f8f23fff700 1 -- 172.21.15.155:0/298180309 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f1c01c630 con 0x7f8f2c0fcd00 2023-12-16T05:54:24.391 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.385+0000 7f8f32182700 1 -- 172.21.15.155:0/298180309 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c10e040 con 0x7f8f2c0fcd00 2023-12-16T05:54:24.392 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.386+0000 7f8f32182700 1 -- 172.21.15.155:0/298180309 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2c04bb80 con 0x7f8f2c0fcd00 2023-12-16T05:54:24.392 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.387+0000 7f8f23fff700 1 -- 172.21.15.155:0/298180309 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f8f1c013960 con 0x7f8f2c0fcd00 2023-12-16T05:54:24.392 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.387+0000 7f8f23fff700 1 --2- 172.21.15.155:0/298180309 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8f18068f60 0x7f8f1806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:24.392 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.387+0000 7f8f23fff700 1 -- 172.21.15.155:0/298180309 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8f1c087f30 con 0x7f8f2c0fcd00 2023-12-16T05:54:24.392 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.387+0000 7f8f2b7fe700 1 --2- 172.21.15.155:0/298180309 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8f18068f60 0x7f8f1806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:24.392 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.388+0000 7f8f2b7fe700 1 --2- 172.21.15.155:0/298180309 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8f18068f60 0x7f8f1806b410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8f14006fd0 tx=0x7f8f14008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:24.394 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.392+0000 7f8f23fff700 1 -- 172.21.15.155:0/298180309 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8f1c0b9a00 con 0x7f8f2c0fcd00 2023-12-16T05:54:24.608 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:24.605+0000 7f8f32182700 1 -- 172.21.15.155:0/298180309 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f2c10e4b0 con 0x7f8f18068f60 2023-12-16T05:54:25.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:25 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-16T05:54:25.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:25 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-16T05:54:25.923 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:25.920+0000 7f8f23fff700 1 -- 172.21.15.155:0/298180309 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8f2c10e4b0 con 0x7f8f18068f60 2023-12-16T05:54:25.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:25.923+0000 7f8f32182700 1 -- 172.21.15.155:0/298180309 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8f18068f60 msgr2=0x7f8f1806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:25.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:25.923+0000 7f8f32182700 1 --2- 172.21.15.155:0/298180309 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8f18068f60 0x7f8f1806b410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8f14006fd0 tx=0x7f8f14008040 comp rx=0 tx=0).stop 2023-12-16T05:54:25.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:25.923+0000 7f8f32182700 1 -- 172.21.15.155:0/298180309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c0fcd00 msgr2=0x7f8f2c10c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:25.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:25.923+0000 7f8f32182700 1 --2- 172.21.15.155:0/298180309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c0fcd00 0x7f8f2c10c9b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c009360 tx=0x7f8f1c009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:25.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:25.923+0000 7f8f32182700 1 -- 172.21.15.155:0/298180309 shutdown_connections 2023-12-16T05:54:25.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:25.923+0000 7f8f32182700 1 --2- 172.21.15.155:0/298180309 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8f18068f60 0x7f8f1806b410 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:25.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:25.923+0000 7f8f32182700 1 --2- 172.21.15.155:0/298180309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f2c0fbaf0 0x7f8f2c10c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:25.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:25.923+0000 7f8f32182700 1 --2- 172.21.15.155:0/298180309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c0fcd00 0x7f8f2c10c9b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:25.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:25.923+0000 7f8f32182700 1 -- 172.21.15.155:0/298180309 >> 172.21.15.155:0/298180309 conn(0x7f8f2c0f71d0 msgr2=0x7f8f2c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:25.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:25.923+0000 7f8f32182700 1 -- 172.21.15.155:0/298180309 shutdown_connections 2023-12-16T05:54:25.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:25.923+0000 7f8f32182700 1 -- 172.21.15.155:0/298180309 wait complete. 2023-12-16T05:54:26.205 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:25 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-mon-smithi155[112428]: 2023-12-16T05:54:25.896+0000 7fdaa0d96700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-16T05:54:26.205 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:26.205 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:54:26.205 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-16T05:54:26.205 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: osdmap e39: 6 total, 6 up, 6 in 2023-12-16T05:54:26.205 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-16T05:54:26.205 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-16T05:54:26.205 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: osdmap e40: 6 total, 6 up, 6 in 2023-12-16T05:54:26.205 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-16T05:54:26.205 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-16T05:54:26.205 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-16T05:54:26.205 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: osdmap e41: 6 total, 6 up, 6 in 2023-12-16T05:54:26.206 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-16T05:54:26.206 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: fsmap cephfs:0 2023-12-16T05:54:26.206 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: Saving service mds.cephfs spec with placement count:4 2023-12-16T05:54:26.206 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:26.206 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:54:26.206 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:54:26.206 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:54:26.206 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:26.206 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.bzsxjw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T05:54:26.206 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.bzsxjw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T05:54:26.206 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:54:26.206 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:26 smithi155 ceph-mon[112451]: Deploying daemon mds.cephfs.smithi155.bzsxjw on smithi155 2023-12-16T05:54:26.327 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-16T05:54:26.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:26.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:54:26.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-16T05:54:26.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: osdmap e39: 6 total, 6 up, 6 in 2023-12-16T05:54:26.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-16T05:54:26.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-16T05:54:26.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: osdmap e40: 6 total, 6 up, 6 in 2023-12-16T05:54:26.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-16T05:54:26.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-16T05:54:26.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-16T05:54:26.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: osdmap e41: 6 total, 6 up, 6 in 2023-12-16T05:54:26.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-16T05:54:26.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: fsmap cephfs:0 2023-12-16T05:54:26.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: Saving service mds.cephfs spec with placement count:4 2023-12-16T05:54:26.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:26.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:54:26.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:54:26.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:54:26.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:26.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.bzsxjw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T05:54:26.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.bzsxjw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T05:54:26.432 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:54:26.432 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:26 smithi156 ceph-mon[121001]: Deploying daemon mds.cephfs.smithi155.bzsxjw on smithi155 2023-12-16T05:54:26.984 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:28.160 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:27 smithi155 ceph-mon[112451]: pgmap v124: 65 pgs: 6 creating+peering, 49 unknown, 10 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:28.160 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:27 smithi155 ceph-mon[112451]: osdmap e42: 6 total, 6 up, 6 in 2023-12-16T05:54:28.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:27 smithi156 ceph-mon[121001]: pgmap v124: 65 pgs: 6 creating+peering, 49 unknown, 10 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:28.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:27 smithi156 ceph-mon[121001]: osdmap e42: 6 total, 6 up, 6 in 2023-12-16T05:54:28.337 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.333+0000 7f9e4eae0700 1 -- 172.21.15.155:0/3841441982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e48065370 msgr2=0x7f9e480fb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:28.337 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.333+0000 7f9e4eae0700 1 --2- 172.21.15.155:0/3841441982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e48065370 0x7f9e480fb290 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009ce0 tx=0x7f9e40004d10 comp rx=0 tx=0).stop 2023-12-16T05:54:28.338 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.333+0000 7f9e4eae0700 1 -- 172.21.15.155:0/3841441982 shutdown_connections 2023-12-16T05:54:28.338 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.333+0000 7f9e4eae0700 1 --2- 172.21.15.155:0/3841441982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e48065810 0x7f9e480fb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:28.338 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.333+0000 7f9e4eae0700 1 --2- 172.21.15.155:0/3841441982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e48065370 0x7f9e480fb290 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009ce0 tx=0x7f9e40004d10 comp rx=0 tx=0).stop 2023-12-16T05:54:28.338 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.333+0000 7f9e4eae0700 1 -- 172.21.15.155:0/3841441982 >> 172.21.15.155:0/3841441982 conn(0x7f9e480f6950 msgr2=0x7f9e480f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:28.338 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.333+0000 7f9e4eae0700 1 -- 172.21.15.155:0/3841441982 shutdown_connections 2023-12-16T05:54:28.338 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.333+0000 7f9e4eae0700 1 -- 172.21.15.155:0/3841441982 wait complete. 2023-12-16T05:54:28.338 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.334+0000 7f9e4eae0700 1 Processor -- start 2023-12-16T05:54:28.338 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.334+0000 7f9e4eae0700 1 -- start start 2023-12-16T05:54:28.338 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.334+0000 7f9e4eae0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e48065810 0x7f9e48115220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:28.338 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.334+0000 7f9e4eae0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e48115760 0x7f9e481162c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:28.338 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.334+0000 7f9e4eae0700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e48115c70 con 0x7f9e48115760 2023-12-16T05:54:28.338 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.334+0000 7f9e4eae0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e48115de0 con 0x7f9e48065810 2023-12-16T05:54:28.338 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.334+0000 7f9e4c87c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e48065810 0x7f9e48115220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:28.338 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.335+0000 7f9e4c87c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e48065810 0x7f9e48115220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.155:39260/0 (socket says 172.21.15.155:39260) 2023-12-16T05:54:28.338 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.335+0000 7f9e4c87c700 1 -- 172.21.15.155:0/2605756178 learned_addr learned my addr 172.21.15.155:0/2605756178 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:28.339 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.335+0000 7f9e47fff700 1 --2- 172.21.15.155:0/2605756178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e48115760 0x7f9e481162c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:28.339 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.335+0000 7f9e4c87c700 1 -- 172.21.15.155:0/2605756178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e48115760 msgr2=0x7f9e481162c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:28.339 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.335+0000 7f9e4c87c700 1 --2- 172.21.15.155:0/2605756178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e48115760 0x7f9e481162c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:28.339 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.335+0000 7f9e4c87c700 1 -- 172.21.15.155:0/2605756178 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e40009940 con 0x7f9e48065810 2023-12-16T05:54:28.339 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.335+0000 7f9e4c87c700 1 --2- 172.21.15.155:0/2605756178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e48065810 0x7f9e48115220 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9e40015040 tx=0x7f9e40004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:28.340 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.335+0000 7f9e457fa700 1 -- 172.21.15.155:0/2605756178 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e4000e040 con 0x7f9e48065810 2023-12-16T05:54:28.340 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.335+0000 7f9e4eae0700 1 -- 172.21.15.155:0/2605756178 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e481168c0 con 0x7f9e48065810 2023-12-16T05:54:28.340 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.335+0000 7f9e457fa700 1 -- 172.21.15.155:0/2605756178 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9e40007e80 con 0x7f9e48065810 2023-12-16T05:54:28.340 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.335+0000 7f9e457fa700 1 -- 172.21.15.155:0/2605756178 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e4001c760 con 0x7f9e48065810 2023-12-16T05:54:28.340 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.335+0000 7f9e4eae0700 1 -- 172.21.15.155:0/2605756178 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e48116e00 con 0x7f9e48065810 2023-12-16T05:54:28.340 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.336+0000 7f9e4eae0700 1 -- 172.21.15.155:0/2605756178 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e4804bb80 con 0x7f9e48065810 2023-12-16T05:54:28.340 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.337+0000 7f9e457fa700 1 -- 172.21.15.155:0/2605756178 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f9e40012620 con 0x7f9e48065810 2023-12-16T05:54:28.341 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.337+0000 7f9e457fa700 1 --2- 172.21.15.155:0/2605756178 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9e30068f70 0x7f9e3006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:28.341 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.337+0000 7f9e457fa700 1 -- 172.21.15.155:0/2605756178 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9e40088b10 con 0x7f9e48065810 2023-12-16T05:54:28.341 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.337+0000 7f9e47fff700 1 --2- 172.21.15.155:0/2605756178 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9e30068f70 0x7f9e3006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:28.341 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.337+0000 7f9e47fff700 1 --2- 172.21.15.155:0/2605756178 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9e30068f70 0x7f9e3006b420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009b80 tx=0x7f9e3800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:28.345 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.342+0000 7f9e457fa700 1 -- 172.21.15.155:0/2605756178 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9e40058990 con 0x7f9e48065810 2023-12-16T05:54:28.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.568+0000 7f9e4eae0700 1 -- 172.21.15.155:0/2605756178 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9e48069670 con 0x7f9e48065810 2023-12-16T05:54:28.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.569+0000 7f9e457fa700 1 -- 172.21.15.155:0/2605756178 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 3 v3) v1 ==== 75+0+1249 (secure 0 0 0) 0x7f9e40058520 con 0x7f9e48065810 2023-12-16T05:54:28.571 INFO:teuthology.orchestra.run.smithi155.stdout:e3 2023-12-16T05:54:28.572 INFO:teuthology.orchestra.run.smithi155.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T05:54:28.572 INFO:teuthology.orchestra.run.smithi155.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T05:54:28.572 INFO:teuthology.orchestra.run.smithi155.stdout:legacy client fscid: 1 2023-12-16T05:54:28.572 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:54:28.572 INFO:teuthology.orchestra.run.smithi155.stdout:Filesystem 'cephfs' (1) 2023-12-16T05:54:28.572 INFO:teuthology.orchestra.run.smithi155.stdout:fs_name cephfs 2023-12-16T05:54:28.572 INFO:teuthology.orchestra.run.smithi155.stdout:epoch 3 2023-12-16T05:54:28.572 INFO:teuthology.orchestra.run.smithi155.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T05:54:28.572 INFO:teuthology.orchestra.run.smithi155.stdout:created 2023-12-16T05:54:25.897091+0000 2023-12-16T05:54:28.572 INFO:teuthology.orchestra.run.smithi155.stdout:modified 2023-12-16T05:54:28.315403+0000 2023-12-16T05:54:28.572 INFO:teuthology.orchestra.run.smithi155.stdout:tableserver 0 2023-12-16T05:54:28.572 INFO:teuthology.orchestra.run.smithi155.stdout:root 0 2023-12-16T05:54:28.572 INFO:teuthology.orchestra.run.smithi155.stdout:session_timeout 60 2023-12-16T05:54:28.573 INFO:teuthology.orchestra.run.smithi155.stdout:session_autoclose 300 2023-12-16T05:54:28.573 INFO:teuthology.orchestra.run.smithi155.stdout:max_file_size 1099511627776 2023-12-16T05:54:28.573 INFO:teuthology.orchestra.run.smithi155.stdout:required_client_features {} 2023-12-16T05:54:28.573 INFO:teuthology.orchestra.run.smithi155.stdout:last_failure 0 2023-12-16T05:54:28.573 INFO:teuthology.orchestra.run.smithi155.stdout:last_failure_osd_epoch 0 2023-12-16T05:54:28.573 INFO:teuthology.orchestra.run.smithi155.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T05:54:28.573 INFO:teuthology.orchestra.run.smithi155.stdout:max_mds 1 2023-12-16T05:54:28.573 INFO:teuthology.orchestra.run.smithi155.stdout:in 0 2023-12-16T05:54:28.573 INFO:teuthology.orchestra.run.smithi155.stdout:up {0=14456} 2023-12-16T05:54:28.573 INFO:teuthology.orchestra.run.smithi155.stdout:failed 2023-12-16T05:54:28.573 INFO:teuthology.orchestra.run.smithi155.stdout:damaged 2023-12-16T05:54:28.573 INFO:teuthology.orchestra.run.smithi155.stdout:stopped 2023-12-16T05:54:28.573 INFO:teuthology.orchestra.run.smithi155.stdout:data_pools [3] 2023-12-16T05:54:28.573 INFO:teuthology.orchestra.run.smithi155.stdout:metadata_pool 2 2023-12-16T05:54:28.573 INFO:teuthology.orchestra.run.smithi155.stdout:inline_data disabled 2023-12-16T05:54:28.574 INFO:teuthology.orchestra.run.smithi155.stdout:balancer 2023-12-16T05:54:28.574 INFO:teuthology.orchestra.run.smithi155.stdout:standby_count_wanted 0 2023-12-16T05:54:28.574 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi155.bzsxjw{0:14456} state up:creating seq 1 addr [v2:172.21.15.155:6826/1416140807,v1:172.21.15.155:6827/1416140807] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:54:28.574 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:54:28.574 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:54:28.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.571+0000 7f9e4eae0700 1 -- 172.21.15.155:0/2605756178 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9e30068f70 msgr2=0x7f9e3006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:28.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.571+0000 7f9e4eae0700 1 --2- 172.21.15.155:0/2605756178 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9e30068f70 0x7f9e3006b420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009b80 tx=0x7f9e3800b040 comp rx=0 tx=0).stop 2023-12-16T05:54:28.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.571+0000 7f9e4eae0700 1 -- 172.21.15.155:0/2605756178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e48065810 msgr2=0x7f9e48115220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:28.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.571+0000 7f9e4eae0700 1 --2- 172.21.15.155:0/2605756178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e48065810 0x7f9e48115220 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9e40015040 tx=0x7f9e40004d10 comp rx=0 tx=0).stop 2023-12-16T05:54:28.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.571+0000 7f9e4eae0700 1 -- 172.21.15.155:0/2605756178 shutdown_connections 2023-12-16T05:54:28.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.571+0000 7f9e4eae0700 1 --2- 172.21.15.155:0/2605756178 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9e30068f70 0x7f9e3006b420 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:28.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.571+0000 7f9e4eae0700 1 --2- 172.21.15.155:0/2605756178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e48065810 0x7f9e48115220 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:28.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.571+0000 7f9e4eae0700 1 --2- 172.21.15.155:0/2605756178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e48115760 0x7f9e481162c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:28.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.571+0000 7f9e4eae0700 1 -- 172.21.15.155:0/2605756178 >> 172.21.15.155:0/2605756178 conn(0x7f9e480f6950 msgr2=0x7f9e48101070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:28.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.571+0000 7f9e4eae0700 1 -- 172.21.15.155:0/2605756178 shutdown_connections 2023-12-16T05:54:28.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:28.571+0000 7f9e4eae0700 1 -- 172.21.15.155:0/2605756178 wait complete. 2023-12-16T05:54:28.575 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 3 2023-12-16T05:54:28.946 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T05:54:28.955 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi155.front.sepia.ceph.com 2023-12-16T05:54:28.955 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 2' 2023-12-16T05:54:29.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:28 smithi156 ceph-mon[121001]: osdmap e43: 6 total, 6 up, 6 in 2023-12-16T05:54:29.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:28 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:29.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:28 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:29.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:28 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:29.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:28 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.qvgmfj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T05:54:29.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:28 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.qvgmfj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T05:54:29.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:28 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:54:29.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:28 smithi156 ceph-mon[121001]: daemon mds.cephfs.smithi155.bzsxjw assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-16T05:54:29.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:28 smithi156 ceph-mon[121001]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-16T05:54:29.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:28 smithi156 ceph-mon[121001]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-16T05:54:29.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:28 smithi156 ceph-mon[121001]: Cluster is now healthy 2023-12-16T05:54:29.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:28 smithi156 ceph-mon[121001]: mds.? [v2:172.21.15.155:6826/1416140807,v1:172.21.15.155:6827/1416140807] up:boot 2023-12-16T05:54:29.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:28 smithi156 ceph-mon[121001]: fsmap cephfs:1 {0=cephfs.smithi155.bzsxjw=up:creating} 2023-12-16T05:54:29.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:28 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.bzsxjw"}]: dispatch 2023-12-16T05:54:29.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:28 smithi156 ceph-mon[121001]: daemon mds.cephfs.smithi155.bzsxjw is now active in filesystem cephfs as rank 0 2023-12-16T05:54:29.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:28 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/2605756178' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T05:54:29.219 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:29.323 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:28 smithi155 ceph-mon[112451]: osdmap e43: 6 total, 6 up, 6 in 2023-12-16T05:54:29.324 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:28 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:29.324 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:28 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:29.324 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:28 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:29.324 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:28 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.qvgmfj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T05:54:29.324 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:28 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.qvgmfj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T05:54:29.324 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:28 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:54:29.324 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:28 smithi155 ceph-mon[112451]: daemon mds.cephfs.smithi155.bzsxjw assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-16T05:54:29.324 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:28 smithi155 ceph-mon[112451]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-16T05:54:29.324 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:28 smithi155 ceph-mon[112451]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-16T05:54:29.324 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:28 smithi155 ceph-mon[112451]: Cluster is now healthy 2023-12-16T05:54:29.324 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:28 smithi155 ceph-mon[112451]: mds.? [v2:172.21.15.155:6826/1416140807,v1:172.21.15.155:6827/1416140807] up:boot 2023-12-16T05:54:29.324 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:28 smithi155 ceph-mon[112451]: fsmap cephfs:1 {0=cephfs.smithi155.bzsxjw=up:creating} 2023-12-16T05:54:29.324 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:28 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.bzsxjw"}]: dispatch 2023-12-16T05:54:29.324 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:28 smithi155 ceph-mon[112451]: daemon mds.cephfs.smithi155.bzsxjw is now active in filesystem cephfs as rank 0 2023-12-16T05:54:29.325 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:28 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2605756178' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T05:54:30.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:29 smithi156 ceph-mon[121001]: Deploying daemon mds.cephfs.smithi156.qvgmfj on smithi156 2023-12-16T05:54:30.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:29 smithi156 ceph-mon[121001]: pgmap v127: 65 pgs: 6 creating+peering, 36 unknown, 23 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:30.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:29 smithi156 ceph-mon[121001]: mds.? [v2:172.21.15.155:6826/1416140807,v1:172.21.15.155:6827/1416140807] up:active 2023-12-16T05:54:30.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:29 smithi156 ceph-mon[121001]: fsmap cephfs:1 {0=cephfs.smithi155.bzsxjw=up:active} 2023-12-16T05:54:30.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:29 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:30.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:29 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:30.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:29 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:30.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:29 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.vicpis", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T05:54:30.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:29 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.vicpis", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T05:54:30.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:29 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:54:30.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.180+0000 7f7ff39bf700 1 -- 172.21.15.155:0/1422995500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fec0ffd70 msgr2=0x7f7fec1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:30.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.180+0000 7f7ff39bf700 1 --2- 172.21.15.155:0/1422995500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fec0ffd70 0x7f7fec1021d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc004940 tx=0x7f7fdc009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:30.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.180+0000 7f7ff39bf700 1 -- 172.21.15.155:0/1422995500 shutdown_connections 2023-12-16T05:54:30.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.180+0000 7f7ff39bf700 1 --2- 172.21.15.155:0/1422995500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fec0ffd70 0x7f7fec1021d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:30.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.180+0000 7f7ff39bf700 1 --2- 172.21.15.155:0/1422995500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fec066920 0x7f7fec0ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:30.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.180+0000 7f7ff39bf700 1 -- 172.21.15.155:0/1422995500 >> 172.21.15.155:0/1422995500 conn(0x7f7fec0f71b0 msgr2=0x7f7fec0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:30.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.180+0000 7f7ff39bf700 1 -- 172.21.15.155:0/1422995500 shutdown_connections 2023-12-16T05:54:30.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.180+0000 7f7ff39bf700 1 -- 172.21.15.155:0/1422995500 wait complete. 2023-12-16T05:54:30.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.180+0000 7f7ff39bf700 1 Processor -- start 2023-12-16T05:54:30.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.180+0000 7f7ff39bf700 1 -- start start 2023-12-16T05:54:30.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.181+0000 7f7ff39bf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fec066920 0x7f7fec10d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:30.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.181+0000 7f7ff39bf700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fec0ffd70 0x7f7fec10d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:30.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.181+0000 7f7ff39bf700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec10dfe0 con 0x7f7fec0ffd70 2023-12-16T05:54:30.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.181+0000 7f7ff39bf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec10e880 con 0x7f7fec066920 2023-12-16T05:54:30.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.181+0000 7f7ff0f5a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fec0ffd70 0x7f7fec10d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:30.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.181+0000 7f7ff0f5a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fec0ffd70 0x7f7fec10d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39080/0 (socket says 172.21.15.155:39080) 2023-12-16T05:54:30.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.181+0000 7f7ff0f5a700 1 -- 172.21.15.155:0/4183134648 learned_addr learned my addr 172.21.15.155:0/4183134648 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:30.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.181+0000 7f7ff175b700 1 --2- 172.21.15.155:0/4183134648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fec066920 0x7f7fec10d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:30.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.181+0000 7f7ff0f5a700 1 -- 172.21.15.155:0/4183134648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fec066920 msgr2=0x7f7fec10d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:30.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.181+0000 7f7ff0f5a700 1 --2- 172.21.15.155:0/4183134648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fec066920 0x7f7fec10d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:30.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.181+0000 7f7ff0f5a700 1 -- 172.21.15.155:0/4183134648 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc005040 con 0x7f7fec0ffd70 2023-12-16T05:54:30.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.181+0000 7f7ff0f5a700 1 --2- 172.21.15.155:0/4183134648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fec0ffd70 0x7f7fec10d9e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc000c00 tx=0x7f7fdc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:30.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.181+0000 7f7fe1ffb700 1 -- 172.21.15.155:0/4183134648 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fdc021070 con 0x7f7fec0ffd70 2023-12-16T05:54:30.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.181+0000 7f7fe1ffb700 1 -- 172.21.15.155:0/4183134648 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7fdc01c400 con 0x7f7fec0ffd70 2023-12-16T05:54:30.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.181+0000 7f7ff39bf700 1 -- 172.21.15.155:0/4183134648 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fec10eb00 con 0x7f7fec0ffd70 2023-12-16T05:54:30.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.181+0000 7f7fe1ffb700 1 -- 172.21.15.155:0/4183134648 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fdc00e070 con 0x7f7fec0ffd70 2023-12-16T05:54:30.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.182+0000 7f7ff39bf700 1 -- 172.21.15.155:0/4183134648 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fec10efe0 con 0x7f7fec0ffd70 2023-12-16T05:54:30.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.183+0000 7f7ff39bf700 1 -- 172.21.15.155:0/4183134648 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fec04bb80 con 0x7f7fec0ffd70 2023-12-16T05:54:30.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.183+0000 7f7fe1ffb700 1 -- 172.21.15.155:0/4183134648 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f7fdc01ca00 con 0x7f7fec0ffd70 2023-12-16T05:54:30.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.183+0000 7f7fe1ffb700 1 --2- 172.21.15.155:0/4183134648 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7fd8068f60 0x7f7fd806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:30.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.183+0000 7f7fe1ffb700 1 -- 172.21.15.155:0/4183134648 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f7fdc087f60 con 0x7f7fec0ffd70 2023-12-16T05:54:30.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.184+0000 7f7ff175b700 1 --2- 172.21.15.155:0/4183134648 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7fd8068f60 0x7f7fd806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:30.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.184+0000 7f7ff175b700 1 --2- 172.21.15.155:0/4183134648 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7fd8068f60 0x7f7fd806b410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8009b80 tx=0x7f7fe800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:30.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.188+0000 7f7fe1ffb700 1 -- 172.21.15.155:0/4183134648 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7fdc0b9a00 con 0x7f7fec0ffd70 2023-12-16T05:54:30.305 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:29 smithi155 ceph-mon[112451]: Deploying daemon mds.cephfs.smithi156.qvgmfj on smithi156 2023-12-16T05:54:30.305 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:29 smithi155 ceph-mon[112451]: pgmap v127: 65 pgs: 6 creating+peering, 36 unknown, 23 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T05:54:30.305 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:29 smithi155 ceph-mon[112451]: mds.? [v2:172.21.15.155:6826/1416140807,v1:172.21.15.155:6827/1416140807] up:active 2023-12-16T05:54:30.305 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:29 smithi155 ceph-mon[112451]: fsmap cephfs:1 {0=cephfs.smithi155.bzsxjw=up:active} 2023-12-16T05:54:30.306 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:29 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:30.306 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:29 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:30.306 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:29 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:30.306 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:29 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.vicpis", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T05:54:30.306 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:29 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.vicpis", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T05:54:30.306 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:29 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:54:30.433 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:30.430+0000 7f7ff39bf700 1 -- 172.21.15.155:0/4183134648 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f7fec10f380 con 0x7f7fec0ffd70 2023-12-16T05:54:31.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:30 smithi156 ceph-mon[121001]: Deploying daemon mds.cephfs.smithi155.vicpis on smithi155 2023-12-16T05:54:31.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:30 smithi156 ceph-mon[121001]: mds.? [v2:172.21.15.156:6824/2823725296,v1:172.21.15.156:6825/2823725296] up:boot 2023-12-16T05:54:31.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:30 smithi156 ceph-mon[121001]: fsmap cephfs:1 {0=cephfs.smithi155.bzsxjw=up:active} 1 up:standby 2023-12-16T05:54:31.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:30 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.qvgmfj"}]: dispatch 2023-12-16T05:54:31.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:30 smithi156 ceph-mon[121001]: fsmap cephfs:1 {0=cephfs.smithi155.bzsxjw=up:active} 1 up:standby 2023-12-16T05:54:31.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:30 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/4183134648' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-12-16T05:54:31.319 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:30 smithi155 ceph-mon[112451]: Deploying daemon mds.cephfs.smithi155.vicpis on smithi155 2023-12-16T05:54:31.319 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:30 smithi155 ceph-mon[112451]: mds.? [v2:172.21.15.156:6824/2823725296,v1:172.21.15.156:6825/2823725296] up:boot 2023-12-16T05:54:31.319 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:30 smithi155 ceph-mon[112451]: fsmap cephfs:1 {0=cephfs.smithi155.bzsxjw=up:active} 1 up:standby 2023-12-16T05:54:31.319 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:30 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.qvgmfj"}]: dispatch 2023-12-16T05:54:31.320 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:30 smithi155 ceph-mon[112451]: fsmap cephfs:1 {0=cephfs.smithi155.bzsxjw=up:active} 1 up:standby 2023-12-16T05:54:31.320 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:30 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/4183134648' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-12-16T05:54:31.345 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:31.341+0000 7f7fe1ffb700 1 -- 172.21.15.155:0/4183134648 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v7) v1 ==== 105+0+0 (secure 0 0 0) 0x7f7fdc057ec0 con 0x7f7fec0ffd70 2023-12-16T05:54:31.346 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:31.343+0000 7f7ff39bf700 1 -- 172.21.15.155:0/4183134648 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7fd8068f60 msgr2=0x7f7fd806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:31.346 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:31.343+0000 7f7ff39bf700 1 --2- 172.21.15.155:0/4183134648 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7fd8068f60 0x7f7fd806b410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8009b80 tx=0x7f7fe800b040 comp rx=0 tx=0).stop 2023-12-16T05:54:31.346 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:31.343+0000 7f7ff39bf700 1 -- 172.21.15.155:0/4183134648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fec0ffd70 msgr2=0x7f7fec10d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:31.346 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:31.343+0000 7f7ff39bf700 1 --2- 172.21.15.155:0/4183134648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fec0ffd70 0x7f7fec10d9e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc000c00 tx=0x7f7fdc009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:31.343+0000 7f7ff39bf700 1 -- 172.21.15.155:0/4183134648 shutdown_connections 2023-12-16T05:54:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:31.343+0000 7f7ff39bf700 1 --2- 172.21.15.155:0/4183134648 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7fd8068f60 0x7f7fd806b410 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:31.343+0000 7f7ff39bf700 1 --2- 172.21.15.155:0/4183134648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fec066920 0x7f7fec10d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:31.343+0000 7f7ff39bf700 1 --2- 172.21.15.155:0/4183134648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fec0ffd70 0x7f7fec10d9e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:31.343+0000 7f7ff39bf700 1 -- 172.21.15.155:0/4183134648 >> 172.21.15.155:0/4183134648 conn(0x7f7fec0f71b0 msgr2=0x7f7fec0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:31.343+0000 7f7ff39bf700 1 -- 172.21.15.155:0/4183134648 shutdown_connections 2023-12-16T05:54:31.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:31.343+0000 7f7ff39bf700 1 -- 172.21.15.155:0/4183134648 wait complete. 2023-12-16T05:54:31.888 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T05:54:31.899 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi155.front.sepia.ceph.com 2023-12-16T05:54:31.899 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2023-12-16T05:54:32.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:31 smithi155 ceph-mon[112451]: pgmap v128: 65 pgs: 6 creating+peering, 59 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s wr, 6 op/s 2023-12-16T05:54:32.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:31 smithi155 ceph-mon[112451]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-16T05:54:32.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:31 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/4183134648' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2023-12-16T05:54:32.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:31 smithi155 ceph-mon[112451]: daemon mds.cephfs.smithi156.qvgmfj assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-16T05:54:32.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:31 smithi155 ceph-mon[112451]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-12-16T05:54:32.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:31 smithi155 ceph-mon[112451]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-16T05:54:32.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:31 smithi155 ceph-mon[112451]: fsmap cephfs:1 {0=cephfs.smithi155.bzsxjw=up:active} 1 up:standby 2023-12-16T05:54:32.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:31 smithi155 ceph-mon[112451]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:creating} 2023-12-16T05:54:32.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:31 smithi155 ceph-mon[112451]: daemon mds.cephfs.smithi156.qvgmfj is now active in filesystem cephfs as rank 1 2023-12-16T05:54:32.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:31 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:32.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:31 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:54:32.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:31 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:32.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:31 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:32.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:31 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:32.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:31 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.fasing", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T05:54:32.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:31 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.fasing", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T05:54:32.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:31 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:54:32.167 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:32.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:31 smithi156 ceph-mon[121001]: pgmap v128: 65 pgs: 6 creating+peering, 59 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s wr, 6 op/s 2023-12-16T05:54:32.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:31 smithi156 ceph-mon[121001]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-16T05:54:32.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:31 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/4183134648' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2023-12-16T05:54:32.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:31 smithi156 ceph-mon[121001]: daemon mds.cephfs.smithi156.qvgmfj assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-16T05:54:32.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:31 smithi156 ceph-mon[121001]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-12-16T05:54:32.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:31 smithi156 ceph-mon[121001]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-16T05:54:32.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:31 smithi156 ceph-mon[121001]: fsmap cephfs:1 {0=cephfs.smithi155.bzsxjw=up:active} 1 up:standby 2023-12-16T05:54:32.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:31 smithi156 ceph-mon[121001]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:creating} 2023-12-16T05:54:32.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:31 smithi156 ceph-mon[121001]: daemon mds.cephfs.smithi156.qvgmfj is now active in filesystem cephfs as rank 1 2023-12-16T05:54:32.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:31 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:32.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:31 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:54:32.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:31 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:32.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:31 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:32.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:31 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:32.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:31 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.fasing", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T05:54:32.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:31 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.fasing", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T05:54:32.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:31 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:54:33.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.127+0000 7f53f76f7700 1 -- 172.21.15.155:0/3714615722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53f00fcd00 msgr2=0x7f53f00fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:33.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.127+0000 7f53f76f7700 1 --2- 172.21.15.155:0/3714615722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53f00fcd00 0x7f53f00fd150 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f53e4004940 tx=0x7f53e4009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:33.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.127+0000 7f53f76f7700 1 -- 172.21.15.155:0/3714615722 shutdown_connections 2023-12-16T05:54:33.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.127+0000 7f53f76f7700 1 --2- 172.21.15.155:0/3714615722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53f00fcd00 0x7f53f00fd150 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:33.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.127+0000 7f53f76f7700 1 --2- 172.21.15.155:0/3714615722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53f00fbaf0 0x7f53f00fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:33.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.127+0000 7f53f76f7700 1 -- 172.21.15.155:0/3714615722 >> 172.21.15.155:0/3714615722 conn(0x7f53f00f7190 msgr2=0x7f53f00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:33.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.127+0000 7f53f76f7700 1 -- 172.21.15.155:0/3714615722 shutdown_connections 2023-12-16T05:54:33.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.127+0000 7f53f76f7700 1 -- 172.21.15.155:0/3714615722 wait complete. 2023-12-16T05:54:33.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.128+0000 7f53f76f7700 1 Processor -- start 2023-12-16T05:54:33.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.128+0000 7f53f76f7700 1 -- start start 2023-12-16T05:54:33.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.128+0000 7f53f76f7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53f00fbaf0 0x7f53f010d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:33.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.128+0000 7f53f76f7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53f00fcd00 0x7f53f010dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:33.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.128+0000 7f53f76f7700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f010e0c0 con 0x7f53f00fcd00 2023-12-16T05:54:33.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.128+0000 7f53f76f7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f010e960 con 0x7f53f00fbaf0 2023-12-16T05:54:33.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.128+0000 7f53f4c92700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53f00fcd00 0x7f53f010dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:33.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.128+0000 7f53f4c92700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53f00fcd00 0x7f53f010dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39114/0 (socket says 172.21.15.155:39114) 2023-12-16T05:54:33.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.128+0000 7f53f4c92700 1 -- 172.21.15.155:0/302553466 learned_addr learned my addr 172.21.15.155:0/302553466 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:33.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.128+0000 7f53f5493700 1 --2- 172.21.15.155:0/302553466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53f00fbaf0 0x7f53f010d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:33.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.128+0000 7f53f4c92700 1 -- 172.21.15.155:0/302553466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53f00fbaf0 msgr2=0x7f53f010d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:33.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.128+0000 7f53f4c92700 1 --2- 172.21.15.155:0/302553466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53f00fbaf0 0x7f53f010d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:33.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.128+0000 7f53f4c92700 1 -- 172.21.15.155:0/302553466 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e4005040 con 0x7f53f00fcd00 2023-12-16T05:54:33.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.128+0000 7f53f4c92700 1 --2- 172.21.15.155:0/302553466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53f00fcd00 0x7f53f010dac0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009380 tx=0x7f53e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:33.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.129+0000 7f53e1ffb700 1 -- 172.21.15.155:0/302553466 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53e400e040 con 0x7f53f00fcd00 2023-12-16T05:54:33.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.129+0000 7f53e1ffb700 1 -- 172.21.15.155:0/302553466 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f53e400bda0 con 0x7f53f00fcd00 2023-12-16T05:54:33.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.129+0000 7f53f76f7700 1 -- 172.21.15.155:0/302553466 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f010ebe0 con 0x7f53f00fcd00 2023-12-16T05:54:33.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.129+0000 7f53e1ffb700 1 -- 172.21.15.155:0/302553466 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53e401c630 con 0x7f53f00fcd00 2023-12-16T05:54:33.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.129+0000 7f53f76f7700 1 -- 172.21.15.155:0/302553466 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f010f120 con 0x7f53f00fcd00 2023-12-16T05:54:33.134 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.130+0000 7f53f76f7700 1 -- 172.21.15.155:0/302553466 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f004bb80 con 0x7f53f00fcd00 2023-12-16T05:54:33.134 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.130+0000 7f53e1ffb700 1 -- 172.21.15.155:0/302553466 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f53e40139d0 con 0x7f53f00fcd00 2023-12-16T05:54:33.134 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.131+0000 7f53e1ffb700 1 --2- 172.21.15.155:0/302553466 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f53dc068fb0 0x7f53dc06b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:33.134 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.131+0000 7f53e1ffb700 1 -- 172.21.15.155:0/302553466 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f53e40882c0 con 0x7f53f00fcd00 2023-12-16T05:54:33.134 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.131+0000 7f53f5493700 1 --2- 172.21.15.155:0/302553466 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f53dc068fb0 0x7f53dc06b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:33.135 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.131+0000 7f53f5493700 1 --2- 172.21.15.155:0/302553466 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f53dc068fb0 0x7f53dc06b460 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0041d0 tx=0x7f53ec009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:33.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.135+0000 7f53e1ffb700 1 -- 172.21.15.155:0/302553466 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f53e4058180 con 0x7f53f00fcd00 2023-12-16T05:54:33.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:32 smithi156 ceph-mon[121001]: Deploying daemon mds.cephfs.smithi156.fasing on smithi156 2023-12-16T05:54:33.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:32 smithi156 ceph-mon[121001]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2023-12-16T05:54:33.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:32 smithi156 ceph-mon[121001]: Cluster is now healthy 2023-12-16T05:54:33.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:32 smithi156 ceph-mon[121001]: mds.? [v2:172.21.15.156:6824/2823725296,v1:172.21.15.156:6825/2823725296] up:active 2023-12-16T05:54:33.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:32 smithi156 ceph-mon[121001]: mds.? [v2:172.21.15.155:6828/750006619,v1:172.21.15.155:6829/750006619] up:boot 2023-12-16T05:54:33.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:32 smithi156 ceph-mon[121001]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 1 up:standby 2023-12-16T05:54:33.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.vicpis"}]: dispatch 2023-12-16T05:54:33.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:32 smithi155 ceph-mon[112451]: Deploying daemon mds.cephfs.smithi156.fasing on smithi156 2023-12-16T05:54:33.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:32 smithi155 ceph-mon[112451]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2023-12-16T05:54:33.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:32 smithi155 ceph-mon[112451]: Cluster is now healthy 2023-12-16T05:54:33.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:32 smithi155 ceph-mon[112451]: mds.? [v2:172.21.15.156:6824/2823725296,v1:172.21.15.156:6825/2823725296] up:active 2023-12-16T05:54:33.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:32 smithi155 ceph-mon[112451]: mds.? [v2:172.21.15.155:6828/750006619,v1:172.21.15.155:6829/750006619] up:boot 2023-12-16T05:54:33.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:32 smithi155 ceph-mon[112451]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 1 up:standby 2023-12-16T05:54:33.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:32 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.vicpis"}]: dispatch 2023-12-16T05:54:33.382 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.379+0000 7f53f76f7700 1 -- 172.21.15.155:0/302553466 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f53f01044b0 con 0x7f53f00fcd00 2023-12-16T05:54:33.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.923+0000 7f53e1ffb700 1 -- 172.21.15.155:0/302553466 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v10) v1 ==== 121+0+0 (secure 0 0 0) 0x7f53e4057d10 con 0x7f53f00fcd00 2023-12-16T05:54:33.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.926+0000 7f53f76f7700 1 -- 172.21.15.155:0/302553466 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f53dc068fb0 msgr2=0x7f53dc06b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:33.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.926+0000 7f53f76f7700 1 --2- 172.21.15.155:0/302553466 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f53dc068fb0 0x7f53dc06b460 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0041d0 tx=0x7f53ec009040 comp rx=0 tx=0).stop 2023-12-16T05:54:33.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.926+0000 7f53f76f7700 1 -- 172.21.15.155:0/302553466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53f00fcd00 msgr2=0x7f53f010dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:33.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.926+0000 7f53f76f7700 1 --2- 172.21.15.155:0/302553466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53f00fcd00 0x7f53f010dac0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009380 tx=0x7f53e4009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:33.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.926+0000 7f53f76f7700 1 -- 172.21.15.155:0/302553466 shutdown_connections 2023-12-16T05:54:33.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.926+0000 7f53f76f7700 1 --2- 172.21.15.155:0/302553466 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f53dc068fb0 0x7f53dc06b460 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:33.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.926+0000 7f53f76f7700 1 --2- 172.21.15.155:0/302553466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53f00fbaf0 0x7f53f010d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:33.930 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.926+0000 7f53f76f7700 1 --2- 172.21.15.155:0/302553466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53f00fcd00 0x7f53f010dac0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:33.930 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.926+0000 7f53f76f7700 1 -- 172.21.15.155:0/302553466 >> 172.21.15.155:0/302553466 conn(0x7f53f00f7190 msgr2=0x7f53f0065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:33.930 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.926+0000 7f53f76f7700 1 -- 172.21.15.155:0/302553466 shutdown_connections 2023-12-16T05:54:33.930 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:33.926+0000 7f53f76f7700 1 -- 172.21.15.155:0/302553466 wait complete. 2023-12-16T05:54:34.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:33 smithi155 ceph-mon[112451]: pgmap v129: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.9 KiB/s wr, 8 op/s 2023-12-16T05:54:34.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:33 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:34.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:33 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:34.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:33 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:34.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:33 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:34.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:33 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:34.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:33 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/302553466' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-16T05:54:34.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:33 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:54:34.346 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T05:54:34.359 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi155.front.sepia.ceph.com 2023-12-16T05:54:34.359 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data false' 2023-12-16T05:54:34.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:33 smithi156 ceph-mon[121001]: pgmap v129: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.9 KiB/s wr, 8 op/s 2023-12-16T05:54:34.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:33 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:34.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:33 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:34.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:33 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:34.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:33 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:34.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:33 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:34.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:33 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/302553466' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-16T05:54:34.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:33 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:54:34.776 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:35.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:34 smithi155 ceph-mon[112451]: mds.? [v2:172.21.15.156:6826/1763385284,v1:172.21.15.156:6827/1763385284] up:boot 2023-12-16T05:54:35.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:34 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/302553466' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-16T05:54:35.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:34 smithi155 ceph-mon[112451]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby 2023-12-16T05:54:35.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:34 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.fasing"}]: dispatch 2023-12-16T05:54:35.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:34 smithi155 ceph-mon[112451]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby-replay 2023-12-16T05:54:35.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:34 smithi156 ceph-mon[121001]: mds.? [v2:172.21.15.156:6826/1763385284,v1:172.21.15.156:6827/1763385284] up:boot 2023-12-16T05:54:35.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:34 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/302553466' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-16T05:54:35.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:34 smithi156 ceph-mon[121001]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby 2023-12-16T05:54:35.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:34 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.fasing"}]: dispatch 2023-12-16T05:54:35.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:34 smithi156 ceph-mon[121001]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby-replay 2023-12-16T05:54:35.937 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.932+0000 7f5f90366700 1 -- 172.21.15.155:0/322520298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f880fd730 msgr2=0x7f5f880ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:35.937 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.932+0000 7f5f90366700 1 --2- 172.21.15.155:0/322520298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f880fd730 0x7f5f880ffb10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5f84004940 tx=0x7f5f84009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:35.937 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.932+0000 7f5f90366700 1 -- 172.21.15.155:0/322520298 shutdown_connections 2023-12-16T05:54:35.937 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.932+0000 7f5f90366700 1 --2- 172.21.15.155:0/322520298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f88100050 0x7f5f88102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:35.938 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.932+0000 7f5f90366700 1 --2- 172.21.15.155:0/322520298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f880fd730 0x7f5f880ffb10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:35.938 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.932+0000 7f5f90366700 1 -- 172.21.15.155:0/322520298 >> 172.21.15.155:0/322520298 conn(0x7f5f880f7190 msgr2=0x7f5f880f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:35.938 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.932+0000 7f5f90366700 1 -- 172.21.15.155:0/322520298 shutdown_connections 2023-12-16T05:54:35.938 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.932+0000 7f5f90366700 1 -- 172.21.15.155:0/322520298 wait complete. 2023-12-16T05:54:35.938 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.933+0000 7f5f90366700 1 Processor -- start 2023-12-16T05:54:35.938 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.933+0000 7f5f90366700 1 -- start start 2023-12-16T05:54:35.938 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.933+0000 7f5f90366700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f880fd730 0x7f5f8810d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:35.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.933+0000 7f5f90366700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f88100050 0x7f5f8810da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:35.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.933+0000 7f5f90366700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8810e000 con 0x7f5f88100050 2023-12-16T05:54:35.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.933+0000 7f5f90366700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8810e8a0 con 0x7f5f880fd730 2023-12-16T05:54:35.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.933+0000 7f5f8d901700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f88100050 0x7f5f8810da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:35.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.933+0000 7f5f8d901700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f88100050 0x7f5f8810da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:39142/0 (socket says 172.21.15.155:39142) 2023-12-16T05:54:35.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.933+0000 7f5f8d901700 1 -- 172.21.15.155:0/2471960266 learned_addr learned my addr 172.21.15.155:0/2471960266 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:35.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.933+0000 7f5f8e102700 1 --2- 172.21.15.155:0/2471960266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f880fd730 0x7f5f8810d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.933+0000 7f5f8d901700 1 -- 172.21.15.155:0/2471960266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f880fd730 msgr2=0x7f5f8810d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.933+0000 7f5f8d901700 1 --2- 172.21.15.155:0/2471960266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f880fd730 0x7f5f8810d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.933+0000 7f5f8d901700 1 -- 172.21.15.155:0/2471960266 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f84005040 con 0x7f5f88100050 2023-12-16T05:54:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.934+0000 7f5f8d901700 1 --2- 172.21.15.155:0/2471960266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f88100050 0x7f5f8810da00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5f7800eb70 tx=0x7f5f7800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.934+0000 7f5f7effd700 1 -- 172.21.15.155:0/2471960266 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f78007cc0 con 0x7f5f88100050 2023-12-16T05:54:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.934+0000 7f5f7effd700 1 -- 172.21.15.155:0/2471960266 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f7800f040 con 0x7f5f88100050 2023-12-16T05:54:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.934+0000 7f5f90366700 1 -- 172.21.15.155:0/2471960266 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8810eb20 con 0x7f5f88100050 2023-12-16T05:54:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.934+0000 7f5f7effd700 1 -- 172.21.15.155:0/2471960266 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f7800c9f0 con 0x7f5f88100050 2023-12-16T05:54:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.934+0000 7f5f90366700 1 -- 172.21.15.155:0/2471960266 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8810f060 con 0x7f5f88100050 2023-12-16T05:54:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.935+0000 7f5f90366700 1 -- 172.21.15.155:0/2471960266 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8804bb80 con 0x7f5f88100050 2023-12-16T05:54:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.936+0000 7f5f7effd700 1 -- 172.21.15.155:0/2471960266 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f5f7800cb50 con 0x7f5f88100050 2023-12-16T05:54:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.937+0000 7f5f7effd700 1 --2- 172.21.15.155:0/2471960266 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f5f74068f60 0x7f5f7406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.937+0000 7f5f7effd700 1 -- 172.21.15.155:0/2471960266 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5f78086ce0 con 0x7f5f88100050 2023-12-16T05:54:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.937+0000 7f5f8e102700 1 --2- 172.21.15.155:0/2471960266 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f5f74068f60 0x7f5f7406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.937+0000 7f5f8e102700 1 --2- 172.21.15.155:0/2471960266 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f5f74068f60 0x7f5f7406b410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5f84000c00 tx=0x7f5f84009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:35.943 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:35.940+0000 7f5f7effd700 1 -- 172.21.15.155:0/2471960266 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5f78056c40 con 0x7f5f88100050 2023-12-16T05:54:36.201 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:36.198+0000 7f5f90366700 1 -- 172.21.15.155:0/2471960266 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f5f881055a0 con 0x7f5f88100050 2023-12-16T05:54:36.321 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:35 smithi155 ceph-mon[112451]: pgmap v130: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 2.9 KiB/s wr, 9 op/s 2023-12-16T05:54:36.321 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:35 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:36.321 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:35 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:36.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:35 smithi156 ceph-mon[121001]: pgmap v130: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 2.9 KiB/s wr, 9 op/s 2023-12-16T05:54:36.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:35 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:36.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:35 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:37.005 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:37.002+0000 7f5f7effd700 1 -- 172.21.15.155:0/2471960266 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v13) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5f780567d0 con 0x7f5f88100050 2023-12-16T05:54:37.007 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:37.004+0000 7f5f90366700 1 -- 172.21.15.155:0/2471960266 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f5f74068f60 msgr2=0x7f5f7406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:37.007 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:37.004+0000 7f5f90366700 1 --2- 172.21.15.155:0/2471960266 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f5f74068f60 0x7f5f7406b410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5f84000c00 tx=0x7f5f84009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:37.007 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:37.004+0000 7f5f90366700 1 -- 172.21.15.155:0/2471960266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f88100050 msgr2=0x7f5f8810da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:37.007 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:37.004+0000 7f5f90366700 1 --2- 172.21.15.155:0/2471960266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f88100050 0x7f5f8810da00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5f7800eb70 tx=0x7f5f7800b040 comp rx=0 tx=0).stop 2023-12-16T05:54:37.007 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:37.004+0000 7f5f90366700 1 -- 172.21.15.155:0/2471960266 shutdown_connections 2023-12-16T05:54:37.007 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:37.004+0000 7f5f90366700 1 --2- 172.21.15.155:0/2471960266 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f5f74068f60 0x7f5f7406b410 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:37.007 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:37.004+0000 7f5f90366700 1 --2- 172.21.15.155:0/2471960266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f880fd730 0x7f5f8810d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:37.007 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:37.004+0000 7f5f90366700 1 --2- 172.21.15.155:0/2471960266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f88100050 0x7f5f8810da00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:37.008 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:37.004+0000 7f5f90366700 1 -- 172.21.15.155:0/2471960266 >> 172.21.15.155:0/2471960266 conn(0x7f5f880f7190 msgr2=0x7f5f880f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:37.008 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:37.004+0000 7f5f90366700 1 -- 172.21.15.155:0/2471960266 shutdown_connections 2023-12-16T05:54:37.008 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:37.004+0000 7f5f90366700 1 -- 172.21.15.155:0/2471960266 wait complete. 2023-12-16T05:54:37.008 INFO:teuthology.orchestra.run.smithi155.stderr:inline data disabled 2023-12-16T05:54:37.311 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:36 smithi155 ceph-mon[112451]: mds.? [v2:172.21.15.156:6824/2823725296,v1:172.21.15.156:6825/2823725296] up:active 2023-12-16T05:54:37.311 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:36 smithi155 ceph-mon[112451]: mds.? [v2:172.21.15.155:6828/750006619,v1:172.21.15.155:6829/750006619] up:standby-replay 2023-12-16T05:54:37.311 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:36 smithi155 ceph-mon[112451]: mds.? [v2:172.21.15.155:6826/1416140807,v1:172.21.15.155:6827/1416140807] up:active 2023-12-16T05:54:37.311 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:36 smithi155 ceph-mon[112451]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby-replay 2023-12-16T05:54:37.311 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:36 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2471960266' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-12-16T05:54:37.311 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:36 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:37.311 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:36 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:37.312 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:36 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:37.332 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T05:54:37.344 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi155.front.sepia.ceph.com 2023-12-16T05:54:37.344 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-16T05:54:37.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:36 smithi156 ceph-mon[121001]: mds.? [v2:172.21.15.156:6824/2823725296,v1:172.21.15.156:6825/2823725296] up:active 2023-12-16T05:54:37.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:36 smithi156 ceph-mon[121001]: mds.? [v2:172.21.15.155:6828/750006619,v1:172.21.15.155:6829/750006619] up:standby-replay 2023-12-16T05:54:37.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:36 smithi156 ceph-mon[121001]: mds.? [v2:172.21.15.155:6826/1416140807,v1:172.21.15.155:6827/1416140807] up:active 2023-12-16T05:54:37.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:36 smithi156 ceph-mon[121001]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby-replay 2023-12-16T05:54:37.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:36 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/2471960266' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-12-16T05:54:37.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:36 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:37.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:36 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:37.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:36 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:37.786 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:38.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:38 smithi156 ceph-mon[121001]: pgmap v131: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2023-12-16T05:54:38.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:38 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/2471960266' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2023-12-16T05:54:38.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:38 smithi156 ceph-mon[121001]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby-replay 2023-12-16T05:54:38.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:38 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:54:38.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:38 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:54:38.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:38 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:38.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:38 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:54:38.257 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:37 smithi155 ceph-mon[112451]: pgmap v131: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2023-12-16T05:54:38.258 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:37 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2471960266' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2023-12-16T05:54:38.258 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:37 smithi155 ceph-mon[112451]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby-replay 2023-12-16T05:54:38.258 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:54:38.258 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:54:38.258 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:38.258 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:37 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:54:38.972 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.967+0000 7fa906ca0700 1 -- 172.21.15.155:0/3900800379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000fbaf0 msgr2=0x7fa9000fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:38.972 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.967+0000 7fa906ca0700 1 --2- 172.21.15.155:0/3900800379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000fbaf0 0x7fa9000fbf00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4004940 tx=0x7fa8f4009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:38.972 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.967+0000 7fa906ca0700 1 -- 172.21.15.155:0/3900800379 shutdown_connections 2023-12-16T05:54:38.972 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.967+0000 7fa906ca0700 1 --2- 172.21.15.155:0/3900800379 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9000fcd00 0x7fa9000fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:38.972 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.967+0000 7fa906ca0700 1 --2- 172.21.15.155:0/3900800379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000fbaf0 0x7fa9000fbf00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:38.972 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.967+0000 7fa906ca0700 1 -- 172.21.15.155:0/3900800379 >> 172.21.15.155:0/3900800379 conn(0x7fa9000f7190 msgr2=0x7fa9000f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:38.972 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.967+0000 7fa906ca0700 1 -- 172.21.15.155:0/3900800379 shutdown_connections 2023-12-16T05:54:38.972 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.967+0000 7fa906ca0700 1 -- 172.21.15.155:0/3900800379 wait complete. 2023-12-16T05:54:38.973 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.968+0000 7fa906ca0700 1 Processor -- start 2023-12-16T05:54:38.973 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.968+0000 7fa906ca0700 1 -- start start 2023-12-16T05:54:38.973 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.968+0000 7fa906ca0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000fbaf0 0x7fa90010d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:38.973 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.968+0000 7fa906ca0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9000fcd00 0x7fa90010da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:38.973 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.968+0000 7fa906ca0700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90010e030 con 0x7fa9000fbaf0 2023-12-16T05:54:38.973 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.968+0000 7fa906ca0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90010e8d0 con 0x7fa9000fcd00 2023-12-16T05:54:38.973 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.968+0000 7fa904a3c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000fbaf0 0x7fa90010d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:38.973 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.968+0000 7fa904a3c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000fbaf0 0x7fa90010d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52416/0 (socket says 172.21.15.155:52416) 2023-12-16T05:54:38.973 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.968+0000 7fa904a3c700 1 -- 172.21.15.155:0/317742006 learned_addr learned my addr 172.21.15.155:0/317742006 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:38.973 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.968+0000 7fa8fffff700 1 --2- 172.21.15.155:0/317742006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9000fcd00 0x7fa90010da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:38.973 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.968+0000 7fa904a3c700 1 -- 172.21.15.155:0/317742006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9000fcd00 msgr2=0x7fa90010da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:38.973 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.968+0000 7fa904a3c700 1 --2- 172.21.15.155:0/317742006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9000fcd00 0x7fa90010da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:38.973 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.968+0000 7fa904a3c700 1 -- 172.21.15.155:0/317742006 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f4005040 con 0x7fa9000fbaf0 2023-12-16T05:54:38.973 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.969+0000 7fa904a3c700 1 --2- 172.21.15.155:0/317742006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000fbaf0 0x7fa90010d4f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4000c00 tx=0x7fa8f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:38.974 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.969+0000 7fa8fd7fa700 1 -- 172.21.15.155:0/317742006 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8f4021070 con 0x7fa9000fbaf0 2023-12-16T05:54:38.974 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.969+0000 7fa8fd7fa700 1 -- 172.21.15.155:0/317742006 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa8f401c400 con 0x7fa9000fbaf0 2023-12-16T05:54:38.974 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.969+0000 7fa906ca0700 1 -- 172.21.15.155:0/317742006 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa90010eb50 con 0x7fa9000fbaf0 2023-12-16T05:54:38.974 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.969+0000 7fa8fd7fa700 1 -- 172.21.15.155:0/317742006 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8f400e070 con 0x7fa9000fbaf0 2023-12-16T05:54:38.974 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.969+0000 7fa906ca0700 1 -- 172.21.15.155:0/317742006 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90010f030 con 0x7fa9000fbaf0 2023-12-16T05:54:38.975 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.970+0000 7fa906ca0700 1 -- 172.21.15.155:0/317742006 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90004bb80 con 0x7fa9000fbaf0 2023-12-16T05:54:38.975 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.971+0000 7fa8fd7fa700 1 -- 172.21.15.155:0/317742006 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fa8f401ca00 con 0x7fa9000fbaf0 2023-12-16T05:54:38.975 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.971+0000 7fa8fd7fa700 1 --2- 172.21.15.155:0/317742006 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fa8f0068f60 0x7fa8f006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:38.975 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.971+0000 7fa8fd7fa700 1 -- 172.21.15.155:0/317742006 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa8f40885f0 con 0x7fa9000fbaf0 2023-12-16T05:54:38.975 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.971+0000 7fa8fffff700 1 --2- 172.21.15.155:0/317742006 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fa8f0068f60 0x7fa8f006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:38.975 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.971+0000 7fa8fffff700 1 --2- 172.21.15.155:0/317742006 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fa8f0068f60 0x7fa8f006b410 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec009b80 tx=0x7fa8ec00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:38.977 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:38.975+0000 7fa8fd7fa700 1 -- 172.21.15.155:0/317742006 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa8f40585f0 con 0x7fa9000fbaf0 2023-12-16T05:54:39.225 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:39.221+0000 7fa906ca0700 1 -- 172.21.15.155:0/317742006 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa90010f720 con 0x7fa9000fbaf0 2023-12-16T05:54:39.225 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:39.222+0000 7fa8fd7fa700 1 -- 172.21.15.155:0/317742006 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1835 (secure 0 0 0) 0x7fa8f4058180 con 0x7fa9000fbaf0 2023-12-16T05:54:39.225 INFO:teuthology.orchestra.run.smithi155.stdout:e14 2023-12-16T05:54:39.225 INFO:teuthology.orchestra.run.smithi155.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T05:54:39.225 INFO:teuthology.orchestra.run.smithi155.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T05:54:39.226 INFO:teuthology.orchestra.run.smithi155.stdout:legacy client fscid: 1 2023-12-16T05:54:39.226 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:54:39.226 INFO:teuthology.orchestra.run.smithi155.stdout:Filesystem 'cephfs' (1) 2023-12-16T05:54:39.226 INFO:teuthology.orchestra.run.smithi155.stdout:fs_name cephfs 2023-12-16T05:54:39.226 INFO:teuthology.orchestra.run.smithi155.stdout:epoch 14 2023-12-16T05:54:39.226 INFO:teuthology.orchestra.run.smithi155.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-16T05:54:39.226 INFO:teuthology.orchestra.run.smithi155.stdout:created 2023-12-16T05:54:25.897091+0000 2023-12-16T05:54:39.226 INFO:teuthology.orchestra.run.smithi155.stdout:modified 2023-12-16T05:54:38.113085+0000 2023-12-16T05:54:39.226 INFO:teuthology.orchestra.run.smithi155.stdout:tableserver 0 2023-12-16T05:54:39.226 INFO:teuthology.orchestra.run.smithi155.stdout:root 0 2023-12-16T05:54:39.226 INFO:teuthology.orchestra.run.smithi155.stdout:session_timeout 60 2023-12-16T05:54:39.226 INFO:teuthology.orchestra.run.smithi155.stdout:session_autoclose 300 2023-12-16T05:54:39.226 INFO:teuthology.orchestra.run.smithi155.stdout:max_file_size 1099511627776 2023-12-16T05:54:39.226 INFO:teuthology.orchestra.run.smithi155.stdout:required_client_features {} 2023-12-16T05:54:39.227 INFO:teuthology.orchestra.run.smithi155.stdout:last_failure 0 2023-12-16T05:54:39.227 INFO:teuthology.orchestra.run.smithi155.stdout:last_failure_osd_epoch 0 2023-12-16T05:54:39.227 INFO:teuthology.orchestra.run.smithi155.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T05:54:39.227 INFO:teuthology.orchestra.run.smithi155.stdout:max_mds 2 2023-12-16T05:54:39.227 INFO:teuthology.orchestra.run.smithi155.stdout:in 0,1 2023-12-16T05:54:39.227 INFO:teuthology.orchestra.run.smithi155.stdout:up {0=14456,1=24281} 2023-12-16T05:54:39.227 INFO:teuthology.orchestra.run.smithi155.stdout:failed 2023-12-16T05:54:39.227 INFO:teuthology.orchestra.run.smithi155.stdout:damaged 2023-12-16T05:54:39.227 INFO:teuthology.orchestra.run.smithi155.stdout:stopped 2023-12-16T05:54:39.227 INFO:teuthology.orchestra.run.smithi155.stdout:data_pools [3] 2023-12-16T05:54:39.227 INFO:teuthology.orchestra.run.smithi155.stdout:metadata_pool 2 2023-12-16T05:54:39.227 INFO:teuthology.orchestra.run.smithi155.stdout:inline_data disabled 2023-12-16T05:54:39.227 INFO:teuthology.orchestra.run.smithi155.stdout:balancer 2023-12-16T05:54:39.227 INFO:teuthology.orchestra.run.smithi155.stdout:standby_count_wanted 1 2023-12-16T05:54:39.228 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi155.bzsxjw{0:14456} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.155:6826/1416140807,v1:172.21.15.155:6827/1416140807] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:54:39.228 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi156.fasing{0:24289} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1763385284,v1:172.21.15.156:6827/1763385284] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:54:39.228 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi156.qvgmfj{1:24281} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.156:6824/2823725296,v1:172.21.15.156:6825/2823725296] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:54:39.228 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi155.vicpis{1:14472} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.155:6828/750006619,v1:172.21.15.155:6829/750006619] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:54:39.228 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:54:39.228 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:54:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:39.224+0000 7fa906ca0700 1 -- 172.21.15.155:0/317742006 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fa8f0068f60 msgr2=0x7fa8f006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:39.224+0000 7fa906ca0700 1 --2- 172.21.15.155:0/317742006 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fa8f0068f60 0x7fa8f006b410 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec009b80 tx=0x7fa8ec00b040 comp rx=0 tx=0).stop 2023-12-16T05:54:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:39.224+0000 7fa906ca0700 1 -- 172.21.15.155:0/317742006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000fbaf0 msgr2=0x7fa90010d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:39.224+0000 7fa906ca0700 1 --2- 172.21.15.155:0/317742006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000fbaf0 0x7fa90010d4f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4000c00 tx=0x7fa8f4009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:39.224+0000 7fa906ca0700 1 -- 172.21.15.155:0/317742006 shutdown_connections 2023-12-16T05:54:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:39.224+0000 7fa906ca0700 1 --2- 172.21.15.155:0/317742006 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fa8f0068f60 0x7fa8f006b410 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:39.224+0000 7fa906ca0700 1 --2- 172.21.15.155:0/317742006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000fbaf0 0x7fa90010d4f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:39.224+0000 7fa906ca0700 1 --2- 172.21.15.155:0/317742006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9000fcd00 0x7fa90010da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:39.224+0000 7fa906ca0700 1 -- 172.21.15.155:0/317742006 >> 172.21.15.155:0/317742006 conn(0x7fa9000f7190 msgr2=0x7fa900065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:39.224+0000 7fa906ca0700 1 -- 172.21.15.155:0/317742006 shutdown_connections 2023-12-16T05:54:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:39.224+0000 7fa906ca0700 1 -- 172.21.15.155:0/317742006 wait complete. 2023-12-16T05:54:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 14 2023-12-16T05:54:39.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:39 smithi156 ceph-mon[121001]: mds.? [v2:172.21.15.156:6826/1763385284,v1:172.21.15.156:6827/1763385284] up:standby-replay 2023-12-16T05:54:39.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:39 smithi156 ceph-mon[121001]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby-replay 2023-12-16T05:54:39.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:39 smithi156 ceph-mon[121001]: pgmap v132: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2023-12-16T05:54:39.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:39.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:39 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:39.465 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:39 smithi155 ceph-mon[112451]: mds.? [v2:172.21.15.156:6826/1763385284,v1:172.21.15.156:6827/1763385284] up:standby-replay 2023-12-16T05:54:39.466 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:39 smithi155 ceph-mon[112451]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby-replay 2023-12-16T05:54:39.466 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:39 smithi155 ceph-mon[112451]: pgmap v132: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2023-12-16T05:54:39.466 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:39.466 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:39 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:39.789 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2023-12-16T05:54:40.114 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:40.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:40 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/317742006' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T05:54:40.488 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:40 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/317742006' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T05:54:41.312 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.308+0000 7f73d5238700 1 -- 172.21.15.155:0/3363819500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73d00fbaf0 msgr2=0x7f73d00fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:41.312 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.308+0000 7f73d5238700 1 --2- 172.21.15.155:0/3363819500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73d00fbaf0 0x7f73d00fbf00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f73c4004940 tx=0x7f73c4009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:41.312 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.308+0000 7f73d5238700 1 -- 172.21.15.155:0/3363819500 shutdown_connections 2023-12-16T05:54:41.312 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.308+0000 7f73d5238700 1 --2- 172.21.15.155:0/3363819500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73d00fcd00 0x7f73d00fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:41.312 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.308+0000 7f73d5238700 1 --2- 172.21.15.155:0/3363819500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73d00fbaf0 0x7f73d00fbf00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:41.312 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.308+0000 7f73d5238700 1 -- 172.21.15.155:0/3363819500 >> 172.21.15.155:0/3363819500 conn(0x7f73d00f71b0 msgr2=0x7f73d00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.308+0000 7f73d5238700 1 -- 172.21.15.155:0/3363819500 shutdown_connections 2023-12-16T05:54:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.308+0000 7f73d5238700 1 -- 172.21.15.155:0/3363819500 wait complete. 2023-12-16T05:54:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.309+0000 7f73d5238700 1 Processor -- start 2023-12-16T05:54:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.309+0000 7f73d5238700 1 -- start start 2023-12-16T05:54:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.309+0000 7f73d5238700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73d00fbaf0 0x7f73d0110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.309+0000 7f73d5238700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73d00fcd00 0x7f73d01127e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.309+0000 7f73d5238700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d0066a30 con 0x7f73d00fcd00 2023-12-16T05:54:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.309+0000 7f73d5238700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d0066b70 con 0x7f73d00fbaf0 2023-12-16T05:54:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.309+0000 7f73ce59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73d00fcd00 0x7f73d01127e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.309+0000 7f73ce59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73d00fcd00 0x7f73d01127e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52432/0 (socket says 172.21.15.155:52432) 2023-12-16T05:54:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.309+0000 7f73ce59c700 1 -- 172.21.15.155:0/3274828946 learned_addr learned my addr 172.21.15.155:0/3274828946 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.309+0000 7f73ced9d700 1 --2- 172.21.15.155:0/3274828946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73d00fbaf0 0x7f73d0110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.309+0000 7f73ce59c700 1 -- 172.21.15.155:0/3274828946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73d00fbaf0 msgr2=0x7f73d0110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.309+0000 7f73ce59c700 1 --2- 172.21.15.155:0/3274828946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73d00fbaf0 0x7f73d0110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:41.314 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.309+0000 7f73ce59c700 1 -- 172.21.15.155:0/3274828946 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c4005040 con 0x7f73d00fcd00 2023-12-16T05:54:41.314 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.309+0000 7f73ce59c700 1 --2- 172.21.15.155:0/3274828946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73d00fcd00 0x7f73d01127e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f73c000b790 tx=0x7f73c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.310+0000 7f73b77fe700 1 -- 172.21.15.155:0/3274828946 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73c000f6f0 con 0x7f73d00fcd00 2023-12-16T05:54:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.310+0000 7f73d5238700 1 -- 172.21.15.155:0/3274828946 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d0112e70 con 0x7f73d00fcd00 2023-12-16T05:54:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.310+0000 7f73b77fe700 1 -- 172.21.15.155:0/3274828946 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f73c000fd00 con 0x7f73d00fcd00 2023-12-16T05:54:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.310+0000 7f73b77fe700 1 -- 172.21.15.155:0/3274828946 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73c0011e00 con 0x7f73d00fcd00 2023-12-16T05:54:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.310+0000 7f73d5238700 1 -- 172.21.15.155:0/3274828946 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d0113380 con 0x7f73d00fcd00 2023-12-16T05:54:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.311+0000 7f73d5238700 1 -- 172.21.15.155:0/3274828946 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d004bb80 con 0x7f73d00fcd00 2023-12-16T05:54:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.311+0000 7f73b77fe700 1 -- 172.21.15.155:0/3274828946 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f73c000f850 con 0x7f73d00fcd00 2023-12-16T05:54:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.311+0000 7f73b77fe700 1 --2- 172.21.15.155:0/3274828946 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f73b8068ef0 0x7f73b806b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.312+0000 7f73ced9d700 1 --2- 172.21.15.155:0/3274828946 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f73b8068ef0 0x7f73b806b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.312+0000 7f73b77fe700 1 -- 172.21.15.155:0/3274828946 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f73c0086c30 con 0x7f73d00fcd00 2023-12-16T05:54:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.312+0000 7f73ced9d700 1 --2- 172.21.15.155:0/3274828946 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f73b8068ef0 0x7f73b806b3a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f73c4004890 tx=0x7f73c4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:41.319 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.316+0000 7f73b77fe700 1 -- 172.21.15.155:0/3274828946 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f73c0053100 con 0x7f73d00fcd00 2023-12-16T05:54:41.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:41 smithi155 ceph-mon[112451]: pgmap v133: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2023-12-16T05:54:41.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:41 smithi156 ceph-mon[121001]: pgmap v133: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2023-12-16T05:54:41.549 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.546+0000 7f73d5238700 1 -- 172.21.15.155:0/3274828946 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73d0113650 con 0x7f73d00fcd00 2023-12-16T05:54:41.549 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.546+0000 7f73b77fe700 1 -- 172.21.15.155:0/3274828946 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4726 (secure 0 0 0) 0x7f73c0056720 con 0x7f73d00fcd00 2023-12-16T05:54:41.552 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.548+0000 7f73d5238700 1 -- 172.21.15.155:0/3274828946 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f73b8068ef0 msgr2=0x7f73b806b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:41.552 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.548+0000 7f73d5238700 1 --2- 172.21.15.155:0/3274828946 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f73b8068ef0 0x7f73b806b3a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f73c4004890 tx=0x7f73c4009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:41.552 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.548+0000 7f73d5238700 1 -- 172.21.15.155:0/3274828946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73d00fcd00 msgr2=0x7f73d01127e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:41.552 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.548+0000 7f73d5238700 1 --2- 172.21.15.155:0/3274828946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73d00fcd00 0x7f73d01127e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f73c000b790 tx=0x7f73c0009250 comp rx=0 tx=0).stop 2023-12-16T05:54:41.552 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.549+0000 7f73d5238700 1 -- 172.21.15.155:0/3274828946 shutdown_connections 2023-12-16T05:54:41.552 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.549+0000 7f73d5238700 1 --2- 172.21.15.155:0/3274828946 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f73b8068ef0 0x7f73b806b3a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:41.552 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.549+0000 7f73d5238700 1 --2- 172.21.15.155:0/3274828946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73d00fbaf0 0x7f73d0110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:41.553 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.549+0000 7f73d5238700 1 --2- 172.21.15.155:0/3274828946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73d00fcd00 0x7f73d01127e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:41.553 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.549+0000 7f73d5238700 1 -- 172.21.15.155:0/3274828946 >> 172.21.15.155:0/3274828946 conn(0x7f73d00f71b0 msgr2=0x7f73d00fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:41.553 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.549+0000 7f73d5238700 1 -- 172.21.15.155:0/3274828946 shutdown_connections 2023-12-16T05:54:41.553 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:41.549+0000 7f73d5238700 1 -- 172.21.15.155:0/3274828946 wait complete. 2023-12-16T05:54:41.553 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 14 2023-12-16T05:54:41.562 INFO:teuthology.orchestra.run.smithi155.stdout:true 2023-12-16T05:54:41.921 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2023-12-16T05:54:42.186 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:42.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:42 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:42.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:42 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:42.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:42 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:54:42.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:42 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:54:42.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:42 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:42.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:42 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/3274828946' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-16T05:54:42.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:42 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:42.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:42 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:42.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:42 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:54:42.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:42 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:54:42.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:42 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:42.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:42 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/3274828946' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-16T05:54:43.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.132+0000 7f396098a700 1 -- 172.21.15.155:0/142423208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0fc4a0 msgr2=0x7f395c0fc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:43.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.132+0000 7f396098a700 1 --2- 172.21.15.155:0/142423208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0fc4a0 0x7f395c0fc8f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f394c004940 tx=0x7f394c009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:43.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.132+0000 7f396098a700 1 -- 172.21.15.155:0/142423208 shutdown_connections 2023-12-16T05:54:43.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.132+0000 7f396098a700 1 --2- 172.21.15.155:0/142423208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0fc4a0 0x7f395c0fc8f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:43.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.132+0000 7f396098a700 1 --2- 172.21.15.155:0/142423208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f395c0fb290 0x7f395c0fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:43.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.132+0000 7f396098a700 1 -- 172.21.15.155:0/142423208 >> 172.21.15.155:0/142423208 conn(0x7f395c0f6950 msgr2=0x7f395c0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:43.138 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.132+0000 7f396098a700 1 -- 172.21.15.155:0/142423208 shutdown_connections 2023-12-16T05:54:43.138 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.132+0000 7f396098a700 1 -- 172.21.15.155:0/142423208 wait complete. 2023-12-16T05:54:43.138 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.133+0000 7f396098a700 1 Processor -- start 2023-12-16T05:54:43.138 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.133+0000 7f396098a700 1 -- start start 2023-12-16T05:54:43.138 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.133+0000 7f396098a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0fb290 0x7f395c10b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:43.138 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.133+0000 7f396098a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f395c0fc4a0 0x7f395c10b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:43.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.133+0000 7f396098a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395c10be70 con 0x7f395c0fb290 2023-12-16T05:54:43.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.133+0000 7f396098a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395c10c710 con 0x7f395c0fc4a0 2023-12-16T05:54:43.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.133+0000 7f395a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0fb290 0x7f395c10b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:43.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.133+0000 7f395a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0fb290 0x7f395c10b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52444/0 (socket says 172.21.15.155:52444) 2023-12-16T05:54:43.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.133+0000 7f395a59c700 1 -- 172.21.15.155:0/361727171 learned_addr learned my addr 172.21.15.155:0/361727171 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:43.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.133+0000 7f3959d9b700 1 --2- 172.21.15.155:0/361727171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f395c0fc4a0 0x7f395c10b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:43.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.133+0000 7f395a59c700 1 -- 172.21.15.155:0/361727171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f395c0fc4a0 msgr2=0x7f395c10b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:43.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.133+0000 7f395a59c700 1 --2- 172.21.15.155:0/361727171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f395c0fc4a0 0x7f395c10b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:43.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.134+0000 7f395a59c700 1 -- 172.21.15.155:0/361727171 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c005040 con 0x7f395c0fb290 2023-12-16T05:54:43.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.134+0000 7f395a59c700 1 --2- 172.21.15.155:0/361727171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0fb290 0x7f395c10b330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f395000fc80 tx=0x7f39500046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:43.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.134+0000 7f394affd700 1 -- 172.21.15.155:0/361727171 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f395000d8c0 con 0x7f395c0fb290 2023-12-16T05:54:43.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.134+0000 7f396098a700 1 -- 172.21.15.155:0/361727171 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f395c10c9f0 con 0x7f395c0fb290 2023-12-16T05:54:43.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.134+0000 7f394affd700 1 -- 172.21.15.155:0/361727171 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f395000a0d0 con 0x7f395c0fb290 2023-12-16T05:54:43.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.134+0000 7f394affd700 1 -- 172.21.15.155:0/361727171 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3950012690 con 0x7f395c0fb290 2023-12-16T05:54:43.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.134+0000 7f396098a700 1 -- 172.21.15.155:0/361727171 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395c10cf30 con 0x7f395c0fb290 2023-12-16T05:54:43.141 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.135+0000 7f396098a700 1 -- 172.21.15.155:0/361727171 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f395c1053f0 con 0x7f395c0fb290 2023-12-16T05:54:43.141 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.135+0000 7f394affd700 1 -- 172.21.15.155:0/361727171 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f395000a240 con 0x7f395c0fb290 2023-12-16T05:54:43.141 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.136+0000 7f394affd700 1 --2- 172.21.15.155:0/361727171 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f3944068f70 0x7f394406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:43.141 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.136+0000 7f394affd700 1 -- 172.21.15.155:0/361727171 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f39500894a0 con 0x7f395c0fb290 2023-12-16T05:54:43.141 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.136+0000 7f3959d9b700 1 --2- 172.21.15.155:0/361727171 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f3944068f70 0x7f394406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:43.141 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.136+0000 7f3959d9b700 1 --2- 172.21.15.155:0/361727171 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f3944068f70 0x7f394406b420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f394c0043d0 tx=0x7f394c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:43.143 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.140+0000 7f394affd700 1 -- 172.21.15.155:0/361727171 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3950059380 con 0x7f395c0fb290 2023-12-16T05:54:43.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.405+0000 7f396098a700 1 -- 172.21.15.155:0/361727171 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f395c04bb80 con 0x7f395c0fb290 2023-12-16T05:54:43.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.406+0000 7f394affd700 1 -- 172.21.15.155:0/361727171 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v14) v1 ==== 78+0+99 (secure 0 0 0) 0x7f3950058f10 con 0x7f395c0fb290 2023-12-16T05:54:43.411 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.408+0000 7f396098a700 1 -- 172.21.15.155:0/361727171 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f3944068f70 msgr2=0x7f394406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:43.411 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.408+0000 7f396098a700 1 --2- 172.21.15.155:0/361727171 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f3944068f70 0x7f394406b420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f394c0043d0 tx=0x7f394c009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:43.411 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.408+0000 7f396098a700 1 -- 172.21.15.155:0/361727171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0fb290 msgr2=0x7f395c10b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:43.411 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.408+0000 7f396098a700 1 --2- 172.21.15.155:0/361727171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0fb290 0x7f395c10b330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f395000fc80 tx=0x7f39500046b0 comp rx=0 tx=0).stop 2023-12-16T05:54:43.411 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.408+0000 7f396098a700 1 -- 172.21.15.155:0/361727171 shutdown_connections 2023-12-16T05:54:43.411 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.408+0000 7f396098a700 1 --2- 172.21.15.155:0/361727171 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f3944068f70 0x7f394406b420 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:43.411 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.408+0000 7f396098a700 1 --2- 172.21.15.155:0/361727171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0fb290 0x7f395c10b330 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:43.411 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.408+0000 7f396098a700 1 --2- 172.21.15.155:0/361727171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f395c0fc4a0 0x7f395c10b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:43.411 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.408+0000 7f396098a700 1 -- 172.21.15.155:0/361727171 >> 172.21.15.155:0/361727171 conn(0x7f395c0f6950 msgr2=0x7f395c0f8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:43.411 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.408+0000 7f396098a700 1 -- 172.21.15.155:0/361727171 shutdown_connections 2023-12-16T05:54:43.411 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.408+0000 7f396098a700 1 -- 172.21.15.155:0/361727171 wait complete. 2023-12-16T05:54:43.421 INFO:teuthology.orchestra.run.smithi155.stdout:true 2023-12-16T05:54:43.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:43 smithi155 ceph-mon[112451]: pgmap v134: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-12-16T05:54:43.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:43 smithi156 ceph-mon[121001]: pgmap v134: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-12-16T05:54:43.769 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2023-12-16T05:54:43.801 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T05:54:43.938 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.933+0000 7f91dbb5a700 1 -- 172.21.15.155:0/141365439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91d40fd5c0 msgr2=0x7f91d40ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:43.938 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.933+0000 7f91dbb5a700 1 --2- 172.21.15.155:0/141365439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91d40fd5c0 0x7f91d40ff9a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f91d0004940 tx=0x7f91d0009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:43.938 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.933+0000 7f91dbb5a700 1 -- 172.21.15.155:0/141365439 shutdown_connections 2023-12-16T05:54:43.938 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.933+0000 7f91dbb5a700 1 --2- 172.21.15.155:0/141365439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d40ffee0 0x7f91d41022c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:43.938 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.933+0000 7f91dbb5a700 1 --2- 172.21.15.155:0/141365439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91d40fd5c0 0x7f91d40ff9a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:43.938 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.933+0000 7f91dbb5a700 1 -- 172.21.15.155:0/141365439 >> 172.21.15.155:0/141365439 conn(0x7f91d40f7000 msgr2=0x7f91d40f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:43.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.933+0000 7f91dbb5a700 1 -- 172.21.15.155:0/141365439 shutdown_connections 2023-12-16T05:54:43.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.933+0000 7f91dbb5a700 1 -- 172.21.15.155:0/141365439 wait complete. 2023-12-16T05:54:43.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.933+0000 7f91dbb5a700 1 Processor -- start 2023-12-16T05:54:43.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.933+0000 7f91dbb5a700 1 -- start start 2023-12-16T05:54:43.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.934+0000 7f91dbb5a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d40fd5c0 0x7f91d410d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:43.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.934+0000 7f91dbb5a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91d40ffee0 0x7f91d410d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:43.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.934+0000 7f91dbb5a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d410ddf0 con 0x7f91d40ffee0 2023-12-16T05:54:43.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.934+0000 7f91dbb5a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d410df60 con 0x7f91d40fd5c0 2023-12-16T05:54:43.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.934+0000 7f91d90f5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91d40ffee0 0x7f91d410d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:43.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.934+0000 7f91d90f5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91d40ffee0 0x7f91d410d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52472/0 (socket says 172.21.15.155:52472) 2023-12-16T05:54:43.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.934+0000 7f91d90f5700 1 -- 172.21.15.155:0/2869154241 learned_addr learned my addr 172.21.15.155:0/2869154241 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:43.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.934+0000 7f91d98f6700 1 --2- 172.21.15.155:0/2869154241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d40fd5c0 0x7f91d410d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:43.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.934+0000 7f91d90f5700 1 -- 172.21.15.155:0/2869154241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d40fd5c0 msgr2=0x7f91d410d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:43.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.934+0000 7f91d90f5700 1 --2- 172.21.15.155:0/2869154241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d40fd5c0 0x7f91d410d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:43.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.934+0000 7f91d90f5700 1 -- 172.21.15.155:0/2869154241 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d0005040 con 0x7f91d40ffee0 2023-12-16T05:54:43.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.934+0000 7f91d90f5700 1 --2- 172.21.15.155:0/2869154241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91d40ffee0 0x7f91d410d7f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f91c4002a50 tx=0x7f91c40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:43.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.934+0000 7f91ca7fc700 1 -- 172.21.15.155:0/2869154241 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91c4007cc0 con 0x7f91d40ffee0 2023-12-16T05:54:43.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.934+0000 7f91ca7fc700 1 -- 172.21.15.155:0/2869154241 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f91c400f040 con 0x7f91d40ffee0 2023-12-16T05:54:43.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.934+0000 7f91ca7fc700 1 -- 172.21.15.155:0/2869154241 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91c400d9c0 con 0x7f91d40ffee0 2023-12-16T05:54:43.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.934+0000 7f91dbb5a700 1 -- 172.21.15.155:0/2869154241 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d4112a10 con 0x7f91d40ffee0 2023-12-16T05:54:43.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.934+0000 7f91dbb5a700 1 -- 172.21.15.155:0/2869154241 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d4112fd0 con 0x7f91d40ffee0 2023-12-16T05:54:43.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.935+0000 7f91dbb5a700 1 -- 172.21.15.155:0/2869154241 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d4107450 con 0x7f91d40ffee0 2023-12-16T05:54:43.941 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.936+0000 7f91ca7fc700 1 -- 172.21.15.155:0/2869154241 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f91c400db20 con 0x7f91d40ffee0 2023-12-16T05:54:43.941 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.936+0000 7f91ca7fc700 1 --2- 172.21.15.155:0/2869154241 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f91c0068f70 0x7f91c006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:43.941 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.936+0000 7f91ca7fc700 1 -- 172.21.15.155:0/2869154241 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f91c40869f0 con 0x7f91d40ffee0 2023-12-16T05:54:43.941 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.936+0000 7f91d98f6700 1 --2- 172.21.15.155:0/2869154241 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f91c0068f70 0x7f91c006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:43.941 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.936+0000 7f91d98f6700 1 --2- 172.21.15.155:0/2869154241 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f91c0068f70 0x7f91c006b420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f91d000b3b0 tx=0x7f91d0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:43.943 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:43.940+0000 7f91ca7fc700 1 -- 172.21.15.155:0/2869154241 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f91c4088e60 con 0x7f91d40ffee0 2023-12-16T05:54:44.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.125+0000 7f91dbb5a700 1 -- 172.21.15.155:0/2869154241 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91d402b310 con 0x7f91d40ffee0 2023-12-16T05:54:44.129 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.126+0000 7f91ca7fc700 1 -- 172.21.15.155:0/2869154241 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+14306 (secure 0 0 0) 0x7f91c4056950 con 0x7f91d40ffee0 2023-12-16T05:54:44.129 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:54:44.130 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":43,"fsid":"d344784e-9bd6-11ee-95a5-87774f69a715","created":"2023-12-16T05:49:39.805571+0000","modified":"2023-12-16T05:54:27.907217+0000","last_up_change":"2023-12-16T05:53:41.318211+0000","last_in_change":"2023-12-16T05:53:25.098236+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T05:52:48.744538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-16T05:54:24.832362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-16T05:54:25.116129+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7f9fdb2e-99ba-4298-973a-70c36ba678ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1483763675},{"type":"v1","addr":"172.21.15.155:6803","nonce":1483763675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1483763675},{"type":"v1","addr":"172.21.15.155:6805","nonce":1483763675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1483763675},{"type":"v1","addr":"172.21.15.155:6809","nonce":1483763675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1483763675},{"type":"v1","addr":"172.21.15.155:6807","nonce":1483763675}]},"public_addr":"172.21.15.155:6803/1483763675","cluster_addr":"172.21.15.155:6805/1483763675","heartbeat_back_addr":"172.21.15.155:6809/1483763675","heartbeat_front_addr":"172.21.15.155:6807/1483763675","state":["exists","up"]},{"osd":1,"uuid":"6b941218-a4cb-423c-82a7-4f5825269d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3291965512},{"type":"v1","addr":"172.21.15.155:6811","nonce":3291965512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3291965512},{"type":"v1","addr":"172.21.15.155:6813","nonce":3291965512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3291965512},{"type":"v1","addr":"172.21.15.155:6817","nonce":3291965512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3291965512},{"type":"v1","addr":"172.21.15.155:6815","nonce":3291965512}]},"public_addr":"172.21.15.155:6811/3291965512","cluster_addr":"172.21.15.155:6813/3291965512","heartbeat_back_addr":"172.21.15.155:6817/3291965512","heartbeat_front_addr":"172.21.15.155:6815/3291965512","state":["exists","up"]},{"osd":2,"uuid":"ea6b309e-b3ba-4e72-8977-9d4915cb68ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3010388644},{"type":"v1","addr":"172.21.15.155:6819","nonce":3010388644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3010388644},{"type":"v1","addr":"172.21.15.155:6821","nonce":3010388644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3010388644},{"type":"v1","addr":"172.21.15.155:6825","nonce":3010388644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3010388644},{"type":"v1","addr":"172.21.15.155:6823","nonce":3010388644}]},"public_addr":"172.21.15.155:6819/3010388644","cluster_addr":"172.21.15.155:6821/3010388644","heartbeat_back_addr":"172.21.15.155:6825/3010388644","heartbeat_front_addr":"172.21.15.155:6823/3010388644","state":["exists","up"]},{"osd":3,"uuid":"ae32e77a-1c79-47d0-802b-ff70099c3126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1620466967},{"type":"v1","addr":"172.21.15.156:6801","nonce":1620466967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1620466967},{"type":"v1","addr":"172.21.15.156:6803","nonce":1620466967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1620466967},{"type":"v1","addr":"172.21.15.156:6807","nonce":1620466967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1620466967},{"type":"v1","addr":"172.21.15.156:6805","nonce":1620466967}]},"public_addr":"172.21.15.156:6801/1620466967","cluster_addr":"172.21.15.156:6803/1620466967","heartbeat_back_addr":"172.21.15.156:6807/1620466967","heartbeat_front_addr":"172.21.15.156:6805/1620466967","state":["exists","up"]},{"osd":4,"uuid":"f61396ce-8004-49ee-aa87-98c96fc7d35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2759834290},{"type":"v1","addr":"172.21.15.156:6809","nonce":2759834290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2759834290},{"type":"v1","addr":"172.21.15.156:6811","nonce":2759834290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2759834290},{"type":"v1","addr":"172.21.15.156:6815","nonce":2759834290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2759834290},{"type":"v1","addr":"172.21.15.156:6813","nonce":2759834290}]},"public_addr":"172.21.15.156:6809/2759834290","cluster_addr":"172.21.15.156:6811/2759834290","heartbeat_back_addr":"172.21.15.156:6815/2759834290","heartbeat_front_addr":"172.21.15.156:6813/2759834290","state":["exists","up"]},{"osd":5,"uuid":"f58d8355-9752-4ea8-b051-93a14b7f1091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":81941755},{"type":"v1","addr":"172.21.15.156:6817","nonce":81941755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":81941755},{"type":"v1","addr":"172.21.15.156:6819","nonce":81941755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":81941755},{"type":"v1","addr":"172.21.15.156:6823","nonce":81941755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":81941755},{"type":"v1","addr":"172.21.15.156:6821","nonce":81941755}]},"public_addr":"172.21.15.156:6817/81941755","cluster_addr":"172.21.15.156:6819/81941755","heartbeat_back_addr":"172.21.15.156:6823/81941755","heartbeat_front_addr":"172.21.15.156:6821/81941755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:52:07.086653+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:52:26.710074+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:52:46.466497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:53:04.226908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:53:21.851522+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:53:39.341732+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:6800/2821498015":"2023-12-17T05:51:16.444340+0000","172.21.15.155:0/4153694391":"2023-12-17T05:51:16.444340+0000","172.21.15.155:6801/2821498015":"2023-12-17T05:51:16.444340+0000","172.21.15.155:0/2967908456":"2023-12-17T05:51:16.444340+0000","172.21.15.155:6800/1287353594":"2023-12-17T05:50:28.085105+0000","172.21.15.155:0/2867995431":"2023-12-17T05:50:28.085105+0000","172.21.15.155:0/669103637":"2023-12-17T05:50:28.085105+0000","172.21.15.155:6801/291007537":"2023-12-17T05:50:04.441832+0000","172.21.15.155:6800/291007537":"2023-12-17T05:50:04.441832+0000","172.21.15.155:0/3953524373":"2023-12-17T05:50:04.441832+0000","172.21.15.155:6801/1287353594":"2023-12-17T05:50:28.085105+0000","172.21.15.155:0/3422132632":"2023-12-17T05:50:04.441832+0000","172.21.15.155:0/2787224311":"2023-12-17T05:50:04.441832+0000","172.21.15.155:0/2339263885":"2023-12-17T05:51:16.444340+0000","172.21.15.155:0/3544820495":"2023-12-17T05:50:28.085105+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T05:54:44.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.128+0000 7f91dbb5a700 1 -- 172.21.15.155:0/2869154241 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f91c0068f70 msgr2=0x7f91c006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:44.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.128+0000 7f91dbb5a700 1 --2- 172.21.15.155:0/2869154241 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f91c0068f70 0x7f91c006b420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f91d000b3b0 tx=0x7f91d0009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:44.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.128+0000 7f91dbb5a700 1 -- 172.21.15.155:0/2869154241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91d40ffee0 msgr2=0x7f91d410d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:44.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.128+0000 7f91dbb5a700 1 --2- 172.21.15.155:0/2869154241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91d40ffee0 0x7f91d410d7f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f91c4002a50 tx=0x7f91c40046b0 comp rx=0 tx=0).stop 2023-12-16T05:54:44.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.128+0000 7f91dbb5a700 1 -- 172.21.15.155:0/2869154241 shutdown_connections 2023-12-16T05:54:44.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.128+0000 7f91dbb5a700 1 --2- 172.21.15.155:0/2869154241 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f91c0068f70 0x7f91c006b420 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:44.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.128+0000 7f91dbb5a700 1 --2- 172.21.15.155:0/2869154241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d40fd5c0 0x7f91d410d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:44.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.128+0000 7f91dbb5a700 1 --2- 172.21.15.155:0/2869154241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91d40ffee0 0x7f91d410d7f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:44.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.129+0000 7f91dbb5a700 1 -- 172.21.15.155:0/2869154241 >> 172.21.15.155:0/2869154241 conn(0x7f91d40f7000 msgr2=0x7f91d40f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:44.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.129+0000 7f91dbb5a700 1 -- 172.21.15.155:0/2869154241 shutdown_connections 2023-12-16T05:54:44.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.129+0000 7f91dbb5a700 1 -- 172.21.15.155:0/2869154241 wait complete. 2023-12-16T05:54:44.144 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T05:52:48.744538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-16T05:54:24.832362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-16T05:54:25.116129+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-16T05:54:44.144 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T05:54:44.268 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.263+0000 7f965cebb700 1 -- 172.21.15.155:0/1828810023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96580fadd0 msgr2=0x7f96580fb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:44.268 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.263+0000 7f965cebb700 1 --2- 172.21.15.155:0/1828810023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96580fadd0 0x7f96580fb1e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9650004940 tx=0x7f9650009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:44.268 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.263+0000 7f965cebb700 1 -- 172.21.15.155:0/1828810023 shutdown_connections 2023-12-16T05:54:44.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.263+0000 7f965cebb700 1 --2- 172.21.15.155:0/1828810023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96580fb7b0 0x7f96580fe060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:44.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.263+0000 7f965cebb700 1 --2- 172.21.15.155:0/1828810023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96580fadd0 0x7f96580fb1e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:44.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.263+0000 7f965cebb700 1 -- 172.21.15.155:0/1828810023 >> 172.21.15.155:0/1828810023 conn(0x7f96580f67b0 msgr2=0x7f96580f8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:44.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.263+0000 7f965cebb700 1 -- 172.21.15.155:0/1828810023 shutdown_connections 2023-12-16T05:54:44.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.263+0000 7f965cebb700 1 -- 172.21.15.155:0/1828810023 wait complete. 2023-12-16T05:54:44.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.263+0000 7f965cebb700 1 Processor -- start 2023-12-16T05:54:44.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.263+0000 7f965cebb700 1 -- start start 2023-12-16T05:54:44.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.263+0000 7f965cebb700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96580fadd0 0x7f965810f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:44.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.263+0000 7f965cebb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f965810fbb0 0x7f9658114c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:44.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.263+0000 7f965cebb700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9658110070 con 0x7f96580fadd0 2023-12-16T05:54:44.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.263+0000 7f965cebb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96581101b0 con 0x7f965810fbb0 2023-12-16T05:54:44.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.263+0000 7f965659c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96580fadd0 0x7f965810f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:44.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.264+0000 7f965659c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96580fadd0 0x7f965810f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52492/0 (socket says 172.21.15.155:52492) 2023-12-16T05:54:44.270 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.264+0000 7f965659c700 1 -- 172.21.15.155:0/4094855774 learned_addr learned my addr 172.21.15.155:0/4094855774 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:44.270 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.264+0000 7f9655d9b700 1 --2- 172.21.15.155:0/4094855774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f965810fbb0 0x7f9658114c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:44.270 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.264+0000 7f965659c700 1 -- 172.21.15.155:0/4094855774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f965810fbb0 msgr2=0x7f9658114c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:44.270 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.264+0000 7f965659c700 1 --2- 172.21.15.155:0/4094855774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f965810fbb0 0x7f9658114c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:44.270 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.264+0000 7f965659c700 1 -- 172.21.15.155:0/4094855774 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9650005040 con 0x7f96580fadd0 2023-12-16T05:54:44.270 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.264+0000 7f9655d9b700 1 --2- 172.21.15.155:0/4094855774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f965810fbb0 0x7f9658114c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T05:54:44.270 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.264+0000 7f965659c700 1 --2- 172.21.15.155:0/4094855774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96580fadd0 0x7f965810f670 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9650009360 tx=0x7f9650009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:44.270 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.264+0000 7f964effd700 1 -- 172.21.15.155:0/4094855774 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f965000e040 con 0x7f96580fadd0 2023-12-16T05:54:44.270 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.264+0000 7f964effd700 1 -- 172.21.15.155:0/4094855774 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f965000bcd0 con 0x7f96580fadd0 2023-12-16T05:54:44.270 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.264+0000 7f965cebb700 1 -- 172.21.15.155:0/4094855774 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9658115170 con 0x7f96580fadd0 2023-12-16T05:54:44.270 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.264+0000 7f964effd700 1 -- 172.21.15.155:0/4094855774 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f965001c630 con 0x7f96580fadd0 2023-12-16T05:54:44.270 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.264+0000 7f965cebb700 1 -- 172.21.15.155:0/4094855774 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96581156e0 con 0x7f96580fadd0 2023-12-16T05:54:44.270 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.265+0000 7f965cebb700 1 -- 172.21.15.155:0/4094855774 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96581020c0 con 0x7f96580fadd0 2023-12-16T05:54:44.270 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.265+0000 7f964effd700 1 -- 172.21.15.155:0/4094855774 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f9650013960 con 0x7f96580fadd0 2023-12-16T05:54:44.271 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.266+0000 7f964effd700 1 --2- 172.21.15.155:0/4094855774 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9644068f60 0x7f964406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:44.271 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.266+0000 7f9655d9b700 1 --2- 172.21.15.155:0/4094855774 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9644068f60 0x7f964406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:44.271 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.266+0000 7f964effd700 1 -- 172.21.15.155:0/4094855774 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9650088270 con 0x7f96580fadd0 2023-12-16T05:54:44.271 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.266+0000 7f9655d9b700 1 --2- 172.21.15.155:0/4094855774 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9644068f60 0x7f964406b410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9640009fd0 tx=0x7f9640009ee0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:44.273 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.270+0000 7f964effd700 1 -- 172.21.15.155:0/4094855774 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f96500581d0 con 0x7f96580fadd0 2023-12-16T05:54:44.462 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.459+0000 7f965cebb700 1 -- 172.21.15.155:0/4094855774 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96580fb7b0 con 0x7f96580fadd0 2023-12-16T05:54:44.462 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.459+0000 7f964effd700 1 -- 172.21.15.155:0/4094855774 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9650057d60 con 0x7f96580fadd0 2023-12-16T05:54:44.462 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2023-12-16T05:54:44.464 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.461+0000 7f965cebb700 1 -- 172.21.15.155:0/4094855774 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9644068f60 msgr2=0x7f964406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:44.464 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.461+0000 7f965cebb700 1 --2- 172.21.15.155:0/4094855774 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9644068f60 0x7f964406b410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9640009fd0 tx=0x7f9640009ee0 comp rx=0 tx=0).stop 2023-12-16T05:54:44.465 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.461+0000 7f965cebb700 1 -- 172.21.15.155:0/4094855774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96580fadd0 msgr2=0x7f965810f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:44.465 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.461+0000 7f965cebb700 1 --2- 172.21.15.155:0/4094855774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96580fadd0 0x7f965810f670 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9650009360 tx=0x7f9650009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:44.465 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.461+0000 7f965cebb700 1 -- 172.21.15.155:0/4094855774 shutdown_connections 2023-12-16T05:54:44.465 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.461+0000 7f965cebb700 1 --2- 172.21.15.155:0/4094855774 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9644068f60 0x7f964406b410 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:44.465 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.461+0000 7f965cebb700 1 --2- 172.21.15.155:0/4094855774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96580fadd0 0x7f965810f670 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:44.465 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.461+0000 7f965cebb700 1 --2- 172.21.15.155:0/4094855774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f965810fbb0 0x7f9658114c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:44.465 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.461+0000 7f965cebb700 1 -- 172.21.15.155:0/4094855774 >> 172.21.15.155:0/4094855774 conn(0x7f96580f67b0 msgr2=0x7f96580ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:44.465 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.461+0000 7f965cebb700 1 -- 172.21.15.155:0/4094855774 shutdown_connections 2023-12-16T05:54:44.465 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.461+0000 7f965cebb700 1 -- 172.21.15.155:0/4094855774 wait complete. 2023-12-16T05:54:44.475 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:44 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/361727171' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-16T05:54:44.475 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:44 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2869154241' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T05:54:44.477 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-16T05:54:44.600 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.595+0000 7f0c1f43e700 1 -- 172.21.15.155:0/617209073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c180fd5b0 msgr2=0x7f0c180ff990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:44.600 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.595+0000 7f0c1f43e700 1 --2- 172.21.15.155:0/617209073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c180fd5b0 0x7f0c180ff990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0c08004940 tx=0x7f0c08009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:44.600 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.595+0000 7f0c1f43e700 1 -- 172.21.15.155:0/617209073 shutdown_connections 2023-12-16T05:54:44.601 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.595+0000 7f0c1f43e700 1 --2- 172.21.15.155:0/617209073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c180ffed0 0x7f0c181022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:44.601 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.595+0000 7f0c1f43e700 1 --2- 172.21.15.155:0/617209073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c180fd5b0 0x7f0c180ff990 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:44.601 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.595+0000 7f0c1f43e700 1 -- 172.21.15.155:0/617209073 >> 172.21.15.155:0/617209073 conn(0x7f0c180f7010 msgr2=0x7f0c180f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:44.601 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.595+0000 7f0c1f43e700 1 -- 172.21.15.155:0/617209073 shutdown_connections 2023-12-16T05:54:44.601 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.595+0000 7f0c1f43e700 1 -- 172.21.15.155:0/617209073 wait complete. 2023-12-16T05:54:44.601 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.596+0000 7f0c1f43e700 1 Processor -- start 2023-12-16T05:54:44.601 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.596+0000 7f0c1f43e700 1 -- start start 2023-12-16T05:54:44.601 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.596+0000 7f0c1f43e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c180fd5b0 0x7f0c1810d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:44.601 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.596+0000 7f0c1f43e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c180ffed0 0x7f0c1810d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:44.601 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.596+0000 7f0c1f43e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1810dda0 con 0x7f0c180fd5b0 2023-12-16T05:54:44.601 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.596+0000 7f0c1f43e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1810df10 con 0x7f0c180ffed0 2023-12-16T05:54:44.601 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.596+0000 7f0c1d1da700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c180fd5b0 0x7f0c1810d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:44.602 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.596+0000 7f0c1d1da700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c180fd5b0 0x7f0c1810d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52518/0 (socket says 172.21.15.155:52518) 2023-12-16T05:54:44.602 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.596+0000 7f0c1d1da700 1 -- 172.21.15.155:0/2050099864 learned_addr learned my addr 172.21.15.155:0/2050099864 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:44.602 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.596+0000 7f0c1c9d9700 1 --2- 172.21.15.155:0/2050099864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c180ffed0 0x7f0c1810d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:44.602 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.597+0000 7f0c1d1da700 1 -- 172.21.15.155:0/2050099864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c180ffed0 msgr2=0x7f0c1810d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:44.602 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.597+0000 7f0c1d1da700 1 --2- 172.21.15.155:0/2050099864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c180ffed0 0x7f0c1810d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:44.602 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.597+0000 7f0c1d1da700 1 -- 172.21.15.155:0/2050099864 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c08005040 con 0x7f0c180fd5b0 2023-12-16T05:54:44.602 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.597+0000 7f0c1c9d9700 1 --2- 172.21.15.155:0/2050099864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c180ffed0 0x7f0c1810d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T05:54:44.602 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.597+0000 7f0c1d1da700 1 --2- 172.21.15.155:0/2050099864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c180fd5b0 0x7f0c1810d260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0c08009360 tx=0x7f0c08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:44.602 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.597+0000 7f0c0dffb700 1 -- 172.21.15.155:0/2050099864 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c0800e040 con 0x7f0c180fd5b0 2023-12-16T05:54:44.603 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.597+0000 7f0c0dffb700 1 -- 172.21.15.155:0/2050099864 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0c0800bcd0 con 0x7f0c180fd5b0 2023-12-16T05:54:44.603 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.597+0000 7f0c1f43e700 1 -- 172.21.15.155:0/2050099864 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c18112960 con 0x7f0c180fd5b0 2023-12-16T05:54:44.603 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.597+0000 7f0c0dffb700 1 -- 172.21.15.155:0/2050099864 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c0801c630 con 0x7f0c180fd5b0 2023-12-16T05:54:44.603 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.597+0000 7f0c1f43e700 1 -- 172.21.15.155:0/2050099864 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c18112f20 con 0x7f0c180fd5b0 2023-12-16T05:54:44.604 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.598+0000 7f0c1f43e700 1 -- 172.21.15.155:0/2050099864 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c18107440 con 0x7f0c180fd5b0 2023-12-16T05:54:44.604 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.599+0000 7f0c0dffb700 1 -- 172.21.15.155:0/2050099864 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f0c08013960 con 0x7f0c180fd5b0 2023-12-16T05:54:44.604 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.599+0000 7f0c0dffb700 1 --2- 172.21.15.155:0/2050099864 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0c04068f60 0x7f0c0406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:44.604 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.599+0000 7f0c0dffb700 1 -- 172.21.15.155:0/2050099864 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0c08088270 con 0x7f0c180fd5b0 2023-12-16T05:54:44.604 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.599+0000 7f0c1c9d9700 1 --2- 172.21.15.155:0/2050099864 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0c04068f60 0x7f0c0406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:44.604 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.599+0000 7f0c1c9d9700 1 --2- 172.21.15.155:0/2050099864 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0c04068f60 0x7f0c0406b410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009fd0 tx=0x7f0c1400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:44.606 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.603+0000 7f0c0dffb700 1 -- 172.21.15.155:0/2050099864 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0c080581d0 con 0x7f0c180fd5b0 2023-12-16T05:54:44.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:44 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/361727171' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-16T05:54:44.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:44 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/2869154241' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T05:54:44.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.786+0000 7f0c1f43e700 1 -- 172.21.15.155:0/2050099864 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f0c1802b510 con 0x7f0c180fd5b0 2023-12-16T05:54:44.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.786+0000 7f0c0dffb700 1 -- 172.21.15.155:0/2050099864 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v43) v1 ==== 107+0+11 (secure 0 0 0) 0x7f0c08057d60 con 0x7f0c180fd5b0 2023-12-16T05:54:44.789 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2023-12-16T05:54:44.791 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.788+0000 7f0c1f43e700 1 -- 172.21.15.155:0/2050099864 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0c04068f60 msgr2=0x7f0c0406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:44.791 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.788+0000 7f0c1f43e700 1 --2- 172.21.15.155:0/2050099864 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0c04068f60 0x7f0c0406b410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009fd0 tx=0x7f0c1400b040 comp rx=0 tx=0).stop 2023-12-16T05:54:44.792 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.788+0000 7f0c1f43e700 1 -- 172.21.15.155:0/2050099864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c180fd5b0 msgr2=0x7f0c1810d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:44.792 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.788+0000 7f0c1f43e700 1 --2- 172.21.15.155:0/2050099864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c180fd5b0 0x7f0c1810d260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0c08009360 tx=0x7f0c08009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:44.792 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.788+0000 7f0c1f43e700 1 -- 172.21.15.155:0/2050099864 shutdown_connections 2023-12-16T05:54:44.792 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.788+0000 7f0c1f43e700 1 --2- 172.21.15.155:0/2050099864 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0c04068f60 0x7f0c0406b410 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:44.792 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.788+0000 7f0c1f43e700 1 --2- 172.21.15.155:0/2050099864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c180fd5b0 0x7f0c1810d260 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:44.792 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.788+0000 7f0c1f43e700 1 --2- 172.21.15.155:0/2050099864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c180ffed0 0x7f0c1810d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:44.792 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.788+0000 7f0c1f43e700 1 -- 172.21.15.155:0/2050099864 >> 172.21.15.155:0/2050099864 conn(0x7f0c180f7010 msgr2=0x7f0c180f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:44.792 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.788+0000 7f0c1f43e700 1 -- 172.21.15.155:0/2050099864 shutdown_connections 2023-12-16T05:54:44.792 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.789+0000 7f0c1f43e700 1 -- 172.21.15.155:0/2050099864 wait complete. 2023-12-16T05:54:44.803 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-16T05:54:44.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.921+0000 7fc80da90700 1 -- 172.21.15.155:0/1350621904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8080fcb80 msgr2=0x7fc8080fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:44.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.921+0000 7fc80da90700 1 --2- 172.21.15.155:0/1350621904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8080fcb80 0x7fc8080fcfd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8004940 tx=0x7fc7f8009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:44.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.921+0000 7fc80da90700 1 -- 172.21.15.155:0/1350621904 shutdown_connections 2023-12-16T05:54:44.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.921+0000 7fc80da90700 1 --2- 172.21.15.155:0/1350621904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8080fcb80 0x7fc8080fcfd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:44.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.921+0000 7fc80da90700 1 --2- 172.21.15.155:0/1350621904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8080fb970 0x7fc8080fbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:44.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.921+0000 7fc80da90700 1 -- 172.21.15.155:0/1350621904 >> 172.21.15.155:0/1350621904 conn(0x7fc8080f7010 msgr2=0x7fc8080f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:44.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.921+0000 7fc80da90700 1 -- 172.21.15.155:0/1350621904 shutdown_connections 2023-12-16T05:54:44.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.921+0000 7fc80da90700 1 -- 172.21.15.155:0/1350621904 wait complete. 2023-12-16T05:54:44.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.921+0000 7fc80da90700 1 Processor -- start 2023-12-16T05:54:44.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.921+0000 7fc80da90700 1 -- start start 2023-12-16T05:54:44.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.921+0000 7fc80da90700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8080fb970 0x7fc8080ff860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:44.928 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.921+0000 7fc80da90700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8080fcb80 0x7fc8080fdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:44.928 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.921+0000 7fc80da90700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080ffe60 con 0x7fc8080fcb80 2023-12-16T05:54:44.928 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.921+0000 7fc80da90700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080fe430 con 0x7fc8080fb970 2023-12-16T05:54:44.928 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.922+0000 7fc806ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8080fcb80 0x7fc8080fdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:44.928 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.922+0000 7fc806ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8080fcb80 0x7fc8080fdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52548/0 (socket says 172.21.15.155:52548) 2023-12-16T05:54:44.928 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.922+0000 7fc806ffd700 1 -- 172.21.15.155:0/3487364622 learned_addr learned my addr 172.21.15.155:0/3487364622 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:44.928 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.922+0000 7fc8077fe700 1 --2- 172.21.15.155:0/3487364622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8080fb970 0x7fc8080ff860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:44.928 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.922+0000 7fc806ffd700 1 -- 172.21.15.155:0/3487364622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8080fb970 msgr2=0x7fc8080ff860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:44.928 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.922+0000 7fc806ffd700 1 --2- 172.21.15.155:0/3487364622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8080fb970 0x7fc8080ff860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:44.928 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.922+0000 7fc806ffd700 1 -- 172.21.15.155:0/3487364622 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f8005040 con 0x7fc8080fcb80 2023-12-16T05:54:44.928 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.922+0000 7fc806ffd700 1 --2- 172.21.15.155:0/3487364622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8080fcb80 0x7fc8080fdec0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8009360 tx=0x7fc7f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:44.928 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.922+0000 7fc7effff700 1 -- 172.21.15.155:0/3487364622 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7f800e040 con 0x7fc8080fcb80 2023-12-16T05:54:44.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.922+0000 7fc7effff700 1 -- 172.21.15.155:0/3487364622 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc7f800bc50 con 0x7fc8080fcb80 2023-12-16T05:54:44.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.922+0000 7fc80da90700 1 -- 172.21.15.155:0/3487364622 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8080fe6b0 con 0x7fc8080fcb80 2023-12-16T05:54:44.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.922+0000 7fc7effff700 1 -- 172.21.15.155:0/3487364622 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7f801c3f0 con 0x7fc8080fcb80 2023-12-16T05:54:44.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.922+0000 7fc80da90700 1 -- 172.21.15.155:0/3487364622 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8080fec70 con 0x7fc8080fcb80 2023-12-16T05:54:44.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.923+0000 7fc80da90700 1 -- 172.21.15.155:0/3487364622 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc808104310 con 0x7fc8080fcb80 2023-12-16T05:54:44.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.923+0000 7fc7effff700 1 -- 172.21.15.155:0/3487364622 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fc7f8013420 con 0x7fc8080fcb80 2023-12-16T05:54:44.930 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.924+0000 7fc7effff700 1 --2- 172.21.15.155:0/3487364622 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fc7f0068f60 0x7fc7f006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:44.930 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.924+0000 7fc7effff700 1 -- 172.21.15.155:0/3487364622 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fc7f8088120 con 0x7fc8080fcb80 2023-12-16T05:54:44.930 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.924+0000 7fc8077fe700 1 --2- 172.21.15.155:0/3487364622 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fc7f0068f60 0x7fc7f006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:44.930 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.924+0000 7fc8077fe700 1 --2- 172.21.15.155:0/3487364622 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fc7f0068f60 0x7fc7f006b410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc8080fc9e0 tx=0x7fc7fc00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:44.931 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:44.928+0000 7fc7effff700 1 -- 172.21.15.155:0/3487364622 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc7f8058000 con 0x7fc8080fcb80 2023-12-16T05:54:45.118 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.115+0000 7fc80da90700 1 -- 172.21.15.155:0/3487364622 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fc808115800 con 0x7fc8080fcb80 2023-12-16T05:54:45.118 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.115+0000 7fc7effff700 1 -- 172.21.15.155:0/3487364622 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v43) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc7f8057b90 con 0x7fc8080fcb80 2023-12-16T05:54:45.118 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2023-12-16T05:54:45.120 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.117+0000 7fc80da90700 1 -- 172.21.15.155:0/3487364622 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fc7f0068f60 msgr2=0x7fc7f006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:45.120 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.117+0000 7fc80da90700 1 --2- 172.21.15.155:0/3487364622 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fc7f0068f60 0x7fc7f006b410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc8080fc9e0 tx=0x7fc7fc00b040 comp rx=0 tx=0).stop 2023-12-16T05:54:45.120 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.117+0000 7fc80da90700 1 -- 172.21.15.155:0/3487364622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8080fcb80 msgr2=0x7fc8080fdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:45.120 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.117+0000 7fc80da90700 1 --2- 172.21.15.155:0/3487364622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8080fcb80 0x7fc8080fdec0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8009360 tx=0x7fc7f8009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:45.120 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.117+0000 7fc80da90700 1 -- 172.21.15.155:0/3487364622 shutdown_connections 2023-12-16T05:54:45.120 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.117+0000 7fc80da90700 1 --2- 172.21.15.155:0/3487364622 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fc7f0068f60 0x7fc7f006b410 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:45.120 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.117+0000 7fc80da90700 1 --2- 172.21.15.155:0/3487364622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8080fb970 0x7fc8080ff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:45.120 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.117+0000 7fc80da90700 1 --2- 172.21.15.155:0/3487364622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8080fcb80 0x7fc8080fdec0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:45.121 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.117+0000 7fc80da90700 1 -- 172.21.15.155:0/3487364622 >> 172.21.15.155:0/3487364622 conn(0x7fc8080f7010 msgr2=0x7fc808064b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:45.121 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.117+0000 7fc80da90700 1 -- 172.21.15.155:0/3487364622 shutdown_connections 2023-12-16T05:54:45.121 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.117+0000 7fc80da90700 1 -- 172.21.15.155:0/3487364622 wait complete. 2023-12-16T05:54:45.132 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T05:54:45.250 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.247+0000 7f0c9db91700 1 -- 172.21.15.155:0/3212707901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c980fca90 msgr2=0x7f0c980fcea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:45.251 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.247+0000 7f0c9db91700 1 --2- 172.21.15.155:0/3212707901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c980fca90 0x7f0c980fcea0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0c88004940 tx=0x7f0c88009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:45.251 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.247+0000 7f0c9db91700 1 -- 172.21.15.155:0/3212707901 shutdown_connections 2023-12-16T05:54:45.251 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.247+0000 7f0c9db91700 1 --2- 172.21.15.155:0/3212707901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c980fdca0 0x7f0c980fe0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:45.251 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.247+0000 7f0c9db91700 1 --2- 172.21.15.155:0/3212707901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c980fca90 0x7f0c980fcea0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:45.251 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.247+0000 7f0c9db91700 1 -- 172.21.15.155:0/3212707901 >> 172.21.15.155:0/3212707901 conn(0x7f0c980f8150 msgr2=0x7f0c980fa580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:45.251 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.247+0000 7f0c9db91700 1 -- 172.21.15.155:0/3212707901 shutdown_connections 2023-12-16T05:54:45.251 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.247+0000 7f0c9db91700 1 -- 172.21.15.155:0/3212707901 wait complete. 2023-12-16T05:54:45.251 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.248+0000 7f0c9db91700 1 Processor -- start 2023-12-16T05:54:45.251 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.248+0000 7f0c9db91700 1 -- start start 2023-12-16T05:54:45.253 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.248+0000 7f0c9db91700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c980fca90 0x7f0c9810d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:45.253 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.248+0000 7f0c9db91700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c980fdca0 0x7f0c9810d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:45.253 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.248+0000 7f0c9db91700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9810de60 con 0x7f0c980fca90 2023-12-16T05:54:45.253 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.248+0000 7f0c9db91700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9810dfd0 con 0x7f0c980fdca0 2023-12-16T05:54:45.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.248+0000 7f0c977fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c980fca90 0x7f0c9810d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:45.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.248+0000 7f0c977fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c980fca90 0x7f0c9810d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52572/0 (socket says 172.21.15.155:52572) 2023-12-16T05:54:45.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.248+0000 7f0c977fe700 1 -- 172.21.15.155:0/2978168873 learned_addr learned my addr 172.21.15.155:0/2978168873 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:45.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.248+0000 7f0c96ffd700 1 --2- 172.21.15.155:0/2978168873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c980fdca0 0x7f0c9810d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:45.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.248+0000 7f0c977fe700 1 -- 172.21.15.155:0/2978168873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c980fdca0 msgr2=0x7f0c9810d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:45.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.248+0000 7f0c977fe700 1 --2- 172.21.15.155:0/2978168873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c980fdca0 0x7f0c9810d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:45.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.249+0000 7f0c977fe700 1 -- 172.21.15.155:0/2978168873 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c88005040 con 0x7f0c980fca90 2023-12-16T05:54:45.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.249+0000 7f0c96ffd700 1 --2- 172.21.15.155:0/2978168873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c980fdca0 0x7f0c9810d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T05:54:45.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.249+0000 7f0c977fe700 1 --2- 172.21.15.155:0/2978168873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c980fca90 0x7f0c9810d320 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0c88004f90 tx=0x7f0c88009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:45.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.249+0000 7f0c7ffff700 1 -- 172.21.15.155:0/2978168873 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c8800e040 con 0x7f0c980fca90 2023-12-16T05:54:45.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.249+0000 7f0c9db91700 1 -- 172.21.15.155:0/2978168873 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c98112a20 con 0x7f0c980fca90 2023-12-16T05:54:45.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.249+0000 7f0c7ffff700 1 -- 172.21.15.155:0/2978168873 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0c8800bcd0 con 0x7f0c980fca90 2023-12-16T05:54:45.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.249+0000 7f0c7ffff700 1 -- 172.21.15.155:0/2978168873 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c8801c630 con 0x7f0c980fca90 2023-12-16T05:54:45.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.249+0000 7f0c9db91700 1 -- 172.21.15.155:0/2978168873 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c98112fe0 con 0x7f0c980fca90 2023-12-16T05:54:45.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.250+0000 7f0c9db91700 1 -- 172.21.15.155:0/2978168873 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c98105430 con 0x7f0c980fca90 2023-12-16T05:54:45.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.250+0000 7f0c7ffff700 1 -- 172.21.15.155:0/2978168873 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f0c88013960 con 0x7f0c980fca90 2023-12-16T05:54:45.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.251+0000 7f0c7ffff700 1 --2- 172.21.15.155:0/2978168873 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0c80068f60 0x7f0c8006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:45.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.251+0000 7f0c7ffff700 1 -- 172.21.15.155:0/2978168873 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0c88088240 con 0x7f0c980fca90 2023-12-16T05:54:45.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.251+0000 7f0c96ffd700 1 --2- 172.21.15.155:0/2978168873 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0c80068f60 0x7f0c8006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:45.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.251+0000 7f0c96ffd700 1 --2- 172.21.15.155:0/2978168873 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0c80068f60 0x7f0c8006b410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009fd0 tx=0x7f0c8c009ee0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:45.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.255+0000 7f0c7ffff700 1 -- 172.21.15.155:0/2978168873 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0c880581a0 con 0x7f0c980fca90 2023-12-16T05:54:45.485 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.482+0000 7f0c9db91700 1 -- 172.21.15.155:0/2978168873 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c98113390 con 0x7f0c980fca90 2023-12-16T05:54:45.486 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.483+0000 7f0c7ffff700 1 -- 172.21.15.155:0/2978168873 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4726 (secure 0 0 0) 0x7f0c88057d30 con 0x7f0c980fca90 2023-12-16T05:54:45.486 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:54:45.486 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-16T05:54:25.897091+0000","modified":"2023-12-16T05:54:38.113085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14456,"mds_1":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14456":{"gid":14456,"name":"cephfs.smithi155.bzsxjw","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6827/1416140807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1416140807},{"type":"v1","addr":"172.21.15.155:6827","nonce":1416140807}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14472":{"gid":14472,"name":"cephfs.smithi155.vicpis","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.155:6829/750006619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":750006619},{"type":"v1","addr":"172.21.15.155:6829","nonce":750006619}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24281":{"gid":24281,"name":"cephfs.smithi156.qvgmfj","rank":1,"incarnation":8,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6825/2823725296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2823725296},{"type":"v1","addr":"172.21.15.156:6825","nonce":2823725296}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24289":{"gid":24289,"name":"cephfs.smithi156.fasing","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.156:6827/1763385284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1763385284},{"type":"v1","addr":"172.21.15.156:6827","nonce":1763385284}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-12-16T05:54:45.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.485+0000 7f0c9db91700 1 -- 172.21.15.155:0/2978168873 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0c80068f60 msgr2=0x7f0c8006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:45.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.485+0000 7f0c9db91700 1 --2- 172.21.15.155:0/2978168873 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0c80068f60 0x7f0c8006b410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009fd0 tx=0x7f0c8c009ee0 comp rx=0 tx=0).stop 2023-12-16T05:54:45.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.485+0000 7f0c9db91700 1 -- 172.21.15.155:0/2978168873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c980fca90 msgr2=0x7f0c9810d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:45.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.485+0000 7f0c9db91700 1 --2- 172.21.15.155:0/2978168873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c980fca90 0x7f0c9810d320 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0c88004f90 tx=0x7f0c88009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:45.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.485+0000 7f0c9db91700 1 -- 172.21.15.155:0/2978168873 shutdown_connections 2023-12-16T05:54:45.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.485+0000 7f0c9db91700 1 --2- 172.21.15.155:0/2978168873 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f0c80068f60 0x7f0c8006b410 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:45.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.485+0000 7f0c9db91700 1 --2- 172.21.15.155:0/2978168873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c980fca90 0x7f0c9810d320 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:45.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.485+0000 7f0c9db91700 1 --2- 172.21.15.155:0/2978168873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c980fdca0 0x7f0c9810d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:45.489 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.485+0000 7f0c9db91700 1 -- 172.21.15.155:0/2978168873 >> 172.21.15.155:0/2978168873 conn(0x7f0c980f8150 msgr2=0x7f0c98100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:45.489 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.485+0000 7f0c9db91700 1 -- 172.21.15.155:0/2978168873 shutdown_connections 2023-12-16T05:54:45.489 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:45.485+0000 7f0c9db91700 1 -- 172.21.15.155:0/2978168873 wait complete. 2023-12-16T05:54:45.489 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 14 2023-12-16T05:54:45.499 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:45 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/4094855774' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T05:54:45.499 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:45 smithi155 ceph-mon[112451]: pgmap v135: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2023-12-16T05:54:45.499 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:45 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2050099864' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T05:54:45.499 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:45 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/3487364622' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T05:54:45.500 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 2, 'flags': 50} 2023-12-16T05:54:45.500 INFO:teuthology.run_tasks:Running task kclient... 2023-12-16T05:54:45.551 INFO:tasks.kclient:Mounting kernel clients... 2023-12-16T05:54:45.551 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-16T05:54:45.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:45.552 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-12-16T05:54:45.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:45.570 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2023-12-16T05:54:45.640 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2023-12-16T05:54:45.641 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T05:54:45.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:45.641 DEBUG:teuthology.orchestra.run.smithi156:> ip netns list 2023-12-16T05:54:45.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:45.665 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link delete ceph-brx 2023-12-16T05:54:45.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:45 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/4094855774' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T05:54:45.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:45 smithi156 ceph-mon[121001]: pgmap v135: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2023-12-16T05:54:45.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:45 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/2050099864' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T05:54:45.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:45 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/3487364622' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T05:54:45.718 INFO:teuthology.orchestra.run.smithi156.stderr:Cannot find device "ceph-brx" 2023-12-16T05:54:45.719 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T05:54:45.720 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-16T05:54:45.720 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-16T05:54:45.720 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T05:54:45.720 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph fs ls 2023-12-16T05:54:45.984 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:46.440 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:46 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2978168873' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-16T05:54:46.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:46 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/2978168873' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-16T05:54:47.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.148+0000 7f2e60651700 1 -- 172.21.15.155:0/3810988174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e58101c10 msgr2=0x7f2e580fb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:47.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.148+0000 7f2e60651700 1 --2- 172.21.15.155:0/3810988174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e58101c10 0x7f2e580fb2d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2e54004940 tx=0x7f2e54009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:47.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.148+0000 7f2e60651700 1 -- 172.21.15.155:0/3810988174 shutdown_connections 2023-12-16T05:54:47.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.148+0000 7f2e60651700 1 --2- 172.21.15.155:0/3810988174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e58101c10 0x7f2e580fb2d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:47.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.148+0000 7f2e60651700 1 --2- 172.21.15.155:0/3810988174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e58101270 0x7f2e58101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:47.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.148+0000 7f2e60651700 1 -- 172.21.15.155:0/3810988174 >> 172.21.15.155:0/3810988174 conn(0x7f2e580711a0 msgr2=0x7f2e580715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:47.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.148+0000 7f2e60651700 1 -- 172.21.15.155:0/3810988174 shutdown_connections 2023-12-16T05:54:47.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.148+0000 7f2e60651700 1 -- 172.21.15.155:0/3810988174 wait complete. 2023-12-16T05:54:47.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.148+0000 7f2e60651700 1 Processor -- start 2023-12-16T05:54:47.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.148+0000 7f2e60651700 1 -- start start 2023-12-16T05:54:47.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.148+0000 7f2e60651700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e58101270 0x7f2e581113b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:47.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.148+0000 7f2e60651700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e58101c10 0x7f2e581118f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:47.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.148+0000 7f2e60651700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e58111f40 con 0x7f2e58101c10 2023-12-16T05:54:47.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.148+0000 7f2e60651700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5810b250 con 0x7f2e58101270 2023-12-16T05:54:47.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.149+0000 7f2e5dbec700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e58101c10 0x7f2e581118f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:47.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.149+0000 7f2e5dbec700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e58101c10 0x7f2e581118f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:35602/0 (socket says 172.21.15.155:35602) 2023-12-16T05:54:47.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.149+0000 7f2e5dbec700 1 -- 172.21.15.155:0/1888111469 learned_addr learned my addr 172.21.15.155:0/1888111469 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:47.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.149+0000 7f2e5e3ed700 1 --2- 172.21.15.155:0/1888111469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e58101270 0x7f2e581113b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:47.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.149+0000 7f2e5dbec700 1 -- 172.21.15.155:0/1888111469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e58101270 msgr2=0x7f2e581113b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:47.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.149+0000 7f2e5dbec700 1 --2- 172.21.15.155:0/1888111469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e58101270 0x7f2e581113b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:47.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.149+0000 7f2e5dbec700 1 -- 172.21.15.155:0/1888111469 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e54005040 con 0x7f2e58101c10 2023-12-16T05:54:47.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.149+0000 7f2e5dbec700 1 --2- 172.21.15.155:0/1888111469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e58101c10 0x7f2e581118f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2e54000c00 tx=0x7f2e54009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:47.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.149+0000 7f2e4effd700 1 -- 172.21.15.155:0/1888111469 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e54021070 con 0x7f2e58101c10 2023-12-16T05:54:47.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.149+0000 7f2e4effd700 1 -- 172.21.15.155:0/1888111469 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2e5401c400 con 0x7f2e58101c10 2023-12-16T05:54:47.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.149+0000 7f2e60651700 1 -- 172.21.15.155:0/1888111469 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5810b4d0 con 0x7f2e58101c10 2023-12-16T05:54:47.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.149+0000 7f2e4effd700 1 -- 172.21.15.155:0/1888111469 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e5400e070 con 0x7f2e58101c10 2023-12-16T05:54:47.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.149+0000 7f2e60651700 1 -- 172.21.15.155:0/1888111469 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5810b9b0 con 0x7f2e58101c10 2023-12-16T05:54:47.155 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.150+0000 7f2e60651700 1 -- 172.21.15.155:0/1888111469 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e58103740 con 0x7f2e58101c10 2023-12-16T05:54:47.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.151+0000 7f2e4effd700 1 -- 172.21.15.155:0/1888111469 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f2e5401c9e0 con 0x7f2e58101c10 2023-12-16T05:54:47.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.151+0000 7f2e4effd700 1 --2- 172.21.15.155:0/1888111469 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2e44068f60 0x7f2e4406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:47.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.151+0000 7f2e4effd700 1 -- 172.21.15.155:0/1888111469 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2e54087f70 con 0x7f2e58101c10 2023-12-16T05:54:47.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.151+0000 7f2e5e3ed700 1 --2- 172.21.15.155:0/1888111469 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2e44068f60 0x7f2e4406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:47.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.151+0000 7f2e5e3ed700 1 --2- 172.21.15.155:0/1888111469 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2e44068f60 0x7f2e4406b410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2e48004710 tx=0x7f2e4800c040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:47.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.155+0000 7f2e4effd700 1 -- 172.21.15.155:0/1888111469 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2e540b9a00 con 0x7f2e58101c10 2023-12-16T05:54:47.386 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.382+0000 7f2e60651700 1 -- 172.21.15.155:0/1888111469 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2e58072cc0 con 0x7f2e58101c10 2023-12-16T05:54:47.386 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.383+0000 7f2e4effd700 1 -- 172.21.15.155:0/1888111469 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7f2e54057ed0 con 0x7f2e58101c10 2023-12-16T05:54:47.386 INFO:teuthology.orchestra.run.smithi155.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-16T05:54:47.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.385+0000 7f2e60651700 1 -- 172.21.15.155:0/1888111469 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2e44068f60 msgr2=0x7f2e4406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:47.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.385+0000 7f2e60651700 1 --2- 172.21.15.155:0/1888111469 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2e44068f60 0x7f2e4406b410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2e48004710 tx=0x7f2e4800c040 comp rx=0 tx=0).stop 2023-12-16T05:54:47.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.385+0000 7f2e60651700 1 -- 172.21.15.155:0/1888111469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e58101c10 msgr2=0x7f2e581118f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:47.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.385+0000 7f2e60651700 1 --2- 172.21.15.155:0/1888111469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e58101c10 0x7f2e581118f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2e54000c00 tx=0x7f2e54009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:47.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.385+0000 7f2e60651700 1 -- 172.21.15.155:0/1888111469 shutdown_connections 2023-12-16T05:54:47.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.385+0000 7f2e60651700 1 --2- 172.21.15.155:0/1888111469 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2e44068f60 0x7f2e4406b410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:47.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.385+0000 7f2e60651700 1 --2- 172.21.15.155:0/1888111469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e58101270 0x7f2e581113b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:47.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.385+0000 7f2e60651700 1 --2- 172.21.15.155:0/1888111469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e58101c10 0x7f2e581118f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:47.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.385+0000 7f2e60651700 1 -- 172.21.15.155:0/1888111469 >> 172.21.15.155:0/1888111469 conn(0x7f2e580711a0 msgr2=0x7f2e580fa250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:47.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.385+0000 7f2e60651700 1 -- 172.21.15.155:0/1888111469 shutdown_connections 2023-12-16T05:54:47.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:47.385+0000 7f2e60651700 1 -- 172.21.15.155:0/1888111469 wait complete. 2023-12-16T05:54:47.692 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:47 smithi155 ceph-mon[112451]: pgmap v136: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-12-16T05:54:47.692 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:47 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:47.693 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:47 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:54:47.693 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:47 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/1888111469' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-16T05:54:47.769 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-16T05:54:47.769 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T05:54:47.769 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2023-12-16T05:54:47.769 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-16T05:54:47.770 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T05:54:47.770 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-16T05:54:47.770 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-16T05:54:47.770 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T05:54:47.770 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-16T05:54:47.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:47.770 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2023-12-16T05:54:47.789 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T05:54:47.789 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T05:54:47.789 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T05:54:47.789 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-12-16T05:54:47.790 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2023-12-16T05:54:47.790 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-12-16T05:54:47.790 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T05:54:47.790 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2023-12-16T05:54:47.790 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2023-12-16T05:54:47.790 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T05:54:47.790 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2023-12-16T05:54:47.790 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2023-12-16T05:54:47.790 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T05:54:47.790 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2023-12-16T05:54:47.790 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T05:54:47.790 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2023-12-16T05:54:47.791 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-16T05:54:47.791 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 38833sec preferred_lft 38833sec 2023-12-16T05:54:47.791 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2023-12-16T05:54:47.791 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-12-16T05:54:47.791 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-16T05:54:47.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:47.791 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-12-16T05:54:47.791 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-12-16T05:54:47.792 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add name ceph-brx type bridge 2023-12-16T05:54:47.792 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr flush dev ceph-brx 2023-12-16T05:54:47.792 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set ceph-brx up 2023-12-16T05:54:47.792 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-16T05:54:47.792 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-12-16T05:54:47.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:47 smithi156 ceph-mon[121001]: pgmap v136: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-12-16T05:54:47.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:47 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:54:47.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:47 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:54:47.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:47 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/1888111469' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-16T05:54:47.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:47.969 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T05:54:47.998 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-12-16T05:54:47.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:47.999 DEBUG:teuthology.orchestra.run.smithi155:> route 2023-12-16T05:54:48.077 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2023-12-16T05:54:48.078 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T05:54:48.078 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-16T05:54:48.078 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-16T05:54:48.078 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T05:54:48.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:48.078 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-12-16T05:54:48.079 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-12-16T05:54:48.079 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-16T05:54:48.079 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-16T05:54:48.079 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-16T05:54:48.079 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-12-16T05:54:48.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:48.366 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-12-16T05:54:48.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:48.384 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list-id 2023-12-16T05:54:48.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:48.442 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-12-16T05:54:48.442 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-12-16T05:54:48.442 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T05:54:48.442 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-16T05:54:48.442 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-12-16T05:54:48.536 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-16T05:54:48.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:48.537 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-12-16T05:54:48.537 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-12-16T05:54:48.537 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-16T05:54:48.537 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-16T05:54:48.537 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-16T05:54:48.537 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-16T05:54:48.537 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-16T05:54:48.537 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-12-16T05:54:48.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:48.741 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-12-16T05:54:48.741 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-12-16T05:54:48.742 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2023-12-16T05:54:48.742 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set dev brx.0 master ceph-brx 2023-12-16T05:54:48.742 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-12-16T05:54:48.839 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T05:54:48.839 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-16T05:54:48.857 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-16T05:54:48.857 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T05:54:48.857 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-16T05:54:48.914 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-16T05:54:48.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:48.914 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-16T05:54:49.008 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-16T05:54:49.008 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-16T05:54:49.008 INFO:teuthology.orchestra.run.smithi155.stdout:invalid new device string format 2023-12-16T05:54:49.084 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-16T05:54:49.084 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-16T05:54:49.084 INFO:teuthology.orchestra.run.smithi155.stdout:invalid new device string format 2023-12-16T05:54:49.084 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.155:3300,172.21.15.156:3300" 2023-12-16T05:54:49.084 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-16T05:54:49.103 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-16T05:54:49.103 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-16T05:54:49.103 INFO:teuthology.orchestra.run.smithi155.stdout:invalid new device string format 2023-12-16T05:54:49.103 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.155:3300,172.21.15.156:3300" 2023-12-16T05:54:49.103 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-16T05:54:49.103 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.155:6789,172.21.15.156:6789" 2023-12-16T05:54:49.103 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.155:6789,172.21.15.156:6789:/ 2023-12-16T05:54:49.103 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=d344784e-9bd6-11ee-95a5-87774f69a715" will pass to kernel 2023-12-16T05:54:49.106 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T05:54:49.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:49.106 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-16T05:54:49.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:49.134 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T05:54:49.219 INFO:teuthology.orchestra.run.smithi155.stdout:client24327 2023-12-16T05:54:49.219 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-16T05:54:49.219 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T05:54:49.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:49.238 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T05:54:49.323 INFO:teuthology.orchestra.run.smithi155.stdout:client24327 2023-12-16T05:54:49.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:49.323 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T05:54:49.367 INFO:teuthology.orchestra.run.smithi155.stdout:client24327 2023-12-16T05:54:49.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:49.368 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/d344784e-9bd6-11ee-95a5-87774f69a715.client24327/status') 2023-12-16T05:54:49.416 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:49 smithi155 ceph-mon[112451]: pgmap v137: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-16T05:54:49.418 INFO:teuthology.orchestra.run.smithi155.stdout:instance: client.24327 (3)172.21.15.155:0/881375398 2023-12-16T05:54:49.418 INFO:teuthology.orchestra.run.smithi155.stdout:blocklisted: false 2023-12-16T05:54:49.419 INFO:teuthology.orchestra.run.smithi155.stderr:0+1 records in 2023-12-16T05:54:49.419 INFO:teuthology.orchestra.run.smithi155.stderr:0+1 records out 2023-12-16T05:54:49.419 INFO:teuthology.orchestra.run.smithi155.stderr:71 bytes copied, 2.1257e-05 s, 3.3 MB/s 2023-12-16T05:54:49.420 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-12-16T05:54:49.420 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-16T05:54:49.421 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-16T05:54:49.421 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -- ceph fs ls 2023-12-16T05:54:49.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:49 smithi156 ceph-mon[121001]: pgmap v137: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-16T05:54:49.685 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:50.698 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.694+0000 7f8d413e2700 1 -- 172.21.15.155:0/657951478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d3c102c70 msgr2=0x7f8d3c103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:50.698 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.694+0000 7f8d413e2700 1 --2- 172.21.15.155:0/657951478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d3c102c70 0x7f8d3c103040 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c004940 tx=0x7f8d2c009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:50.698 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.694+0000 7f8d413e2700 1 -- 172.21.15.155:0/657951478 shutdown_connections 2023-12-16T05:54:50.698 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.694+0000 7f8d413e2700 1 --2- 172.21.15.155:0/657951478 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d3c0fb1e0 0x7f8d3c0fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:50.698 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.694+0000 7f8d413e2700 1 --2- 172.21.15.155:0/657951478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d3c102c70 0x7f8d3c103040 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:50.699 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.694+0000 7f8d413e2700 1 -- 172.21.15.155:0/657951478 >> 172.21.15.155:0/657951478 conn(0x7f8d3c0711a0 msgr2=0x7f8d3c0715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:50.699 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.694+0000 7f8d413e2700 1 -- 172.21.15.155:0/657951478 shutdown_connections 2023-12-16T05:54:50.699 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.694+0000 7f8d413e2700 1 -- 172.21.15.155:0/657951478 wait complete. 2023-12-16T05:54:50.699 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.695+0000 7f8d413e2700 1 Processor -- start 2023-12-16T05:54:50.699 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.695+0000 7f8d413e2700 1 -- start start 2023-12-16T05:54:50.701 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.695+0000 7f8d413e2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d3c0fb1e0 0x7f8d3c1135f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:50.701 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.695+0000 7f8d413e2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d3c102c70 0x7f8d3c113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:50.701 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.695+0000 7f8d413e2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c10d4b0 con 0x7f8d3c0fb1e0 2023-12-16T05:54:50.702 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.695+0000 7f8d413e2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c10d620 con 0x7f8d3c102c70 2023-12-16T05:54:50.702 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.695+0000 7f8d3affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d3c0fb1e0 0x7f8d3c1135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:50.702 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.695+0000 7f8d3affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d3c0fb1e0 0x7f8d3c1135f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:35628/0 (socket says 172.21.15.155:35628) 2023-12-16T05:54:50.702 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.695+0000 7f8d3affd700 1 -- 172.21.15.155:0/4223746205 learned_addr learned my addr 172.21.15.155:0/4223746205 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:50.703 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.695+0000 7f8d3affd700 1 -- 172.21.15.155:0/4223746205 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d3c102c70 msgr2=0x7f8d3c113b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:50.703 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.695+0000 7f8d3affd700 1 --2- 172.21.15.155:0/4223746205 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d3c102c70 0x7f8d3c113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:50.703 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.695+0000 7f8d3affd700 1 -- 172.21.15.155:0/4223746205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c005040 con 0x7f8d3c0fb1e0 2023-12-16T05:54:50.703 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.695+0000 7f8d3affd700 1 --2- 172.21.15.155:0/4223746205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d3c0fb1e0 0x7f8d3c1135f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00b3b0 tx=0x7f8d2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:50.703 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.696+0000 7f8d237fe700 1 -- 172.21.15.155:0/4223746205 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d2c00e040 con 0x7f8d3c0fb1e0 2023-12-16T05:54:50.704 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.696+0000 7f8d237fe700 1 -- 172.21.15.155:0/4223746205 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8d2c00bc50 con 0x7f8d3c0fb1e0 2023-12-16T05:54:50.704 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.696+0000 7f8d413e2700 1 -- 172.21.15.155:0/4223746205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d3c10d8a0 con 0x7f8d3c0fb1e0 2023-12-16T05:54:50.704 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.696+0000 7f8d237fe700 1 -- 172.21.15.155:0/4223746205 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d2c013420 con 0x7f8d3c0fb1e0 2023-12-16T05:54:50.704 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.696+0000 7f8d413e2700 1 -- 172.21.15.155:0/4223746205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3c10dde0 con 0x7f8d3c0fb1e0 2023-12-16T05:54:50.705 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.697+0000 7f8d413e2700 1 -- 172.21.15.155:0/4223746205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d3c072cc0 con 0x7f8d3c0fb1e0 2023-12-16T05:54:50.705 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.697+0000 7f8d237fe700 1 -- 172.21.15.155:0/4223746205 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f8d2c01c430 con 0x7f8d3c0fb1e0 2023-12-16T05:54:50.705 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.697+0000 7f8d237fe700 1 --2- 172.21.15.155:0/4223746205 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8d24068f60 0x7f8d2406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:50.705 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.698+0000 7f8d237fe700 1 -- 172.21.15.155:0/4223746205 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8d2c087ba0 con 0x7f8d3c0fb1e0 2023-12-16T05:54:50.705 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.698+0000 7f8d3a7fc700 1 --2- 172.21.15.155:0/4223746205 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8d24068f60 0x7f8d2406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:50.705 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.698+0000 7f8d3a7fc700 1 --2- 172.21.15.155:0/4223746205 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8d24068f60 0x7f8d2406b410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8d30006fd0 tx=0x7f8d30006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:50.705 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.702+0000 7f8d237fe700 1 -- 172.21.15.155:0/4223746205 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8d2c057bb0 con 0x7f8d3c0fb1e0 2023-12-16T05:54:50.942 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.932+0000 7f8d413e2700 1 -- 172.21.15.155:0/4223746205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8d3c10ebd0 con 0x7f8d3c0fb1e0 2023-12-16T05:54:50.943 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.932+0000 7f8d237fe700 1 -- 172.21.15.155:0/4223746205 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7f8d2c057740 con 0x7f8d3c0fb1e0 2023-12-16T05:54:50.944 INFO:teuthology.orchestra.run.smithi155.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-16T05:54:50.945 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.934+0000 7f8d413e2700 1 -- 172.21.15.155:0/4223746205 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8d24068f60 msgr2=0x7f8d2406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:50.945 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.934+0000 7f8d413e2700 1 --2- 172.21.15.155:0/4223746205 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8d24068f60 0x7f8d2406b410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8d30006fd0 tx=0x7f8d30006db0 comp rx=0 tx=0).stop 2023-12-16T05:54:50.945 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.934+0000 7f8d413e2700 1 -- 172.21.15.155:0/4223746205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d3c0fb1e0 msgr2=0x7f8d3c1135f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:50.945 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.934+0000 7f8d413e2700 1 --2- 172.21.15.155:0/4223746205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d3c0fb1e0 0x7f8d3c1135f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00b3b0 tx=0x7f8d2c009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:50.945 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.934+0000 7f8d413e2700 1 -- 172.21.15.155:0/4223746205 shutdown_connections 2023-12-16T05:54:50.945 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.934+0000 7f8d413e2700 1 --2- 172.21.15.155:0/4223746205 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8d24068f60 0x7f8d2406b410 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:50.945 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.934+0000 7f8d413e2700 1 --2- 172.21.15.155:0/4223746205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d3c0fb1e0 0x7f8d3c1135f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:50.945 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.934+0000 7f8d413e2700 1 --2- 172.21.15.155:0/4223746205 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d3c102c70 0x7f8d3c113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:50.945 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.934+0000 7f8d413e2700 1 -- 172.21.15.155:0/4223746205 >> 172.21.15.155:0/4223746205 conn(0x7f8d3c0711a0 msgr2=0x7f8d3c0f9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:50.946 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.934+0000 7f8d413e2700 1 -- 172.21.15.155:0/4223746205 shutdown_connections 2023-12-16T05:54:50.946 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:50.934+0000 7f8d413e2700 1 -- 172.21.15.155:0/4223746205 wait complete. 2023-12-16T05:54:51.342 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-16T05:54:51.343 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T05:54:51.343 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi156.front.sepia.ceph.com 2023-12-16T05:54:51.343 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-16T05:54:51.343 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-16T05:54:51.343 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-16T05:54:51.343 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-16T05:54:51.343 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T05:54:51.343 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-16T05:54:51.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:51.343 DEBUG:teuthology.orchestra.run.smithi156:> ip addr 2023-12-16T05:54:51.367 INFO:teuthology.orchestra.run.smithi156.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T05:54:51.367 INFO:teuthology.orchestra.run.smithi156.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T05:54:51.367 INFO:teuthology.orchestra.run.smithi156.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T05:54:51.367 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2023-12-16T05:54:51.367 INFO:teuthology.orchestra.run.smithi156.stdout: inet6 ::1/128 scope host 2023-12-16T05:54:51.367 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2023-12-16T05:54:51.367 INFO:teuthology.orchestra.run.smithi156.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T05:54:51.367 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:da:6a:c0 brd ff:ff:ff:ff:ff:ff 2023-12-16T05:54:51.368 INFO:teuthology.orchestra.run.smithi156.stdout: altname enp7s0f0 2023-12-16T05:54:51.368 INFO:teuthology.orchestra.run.smithi156.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T05:54:51.368 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:da:6a:c1 brd ff:ff:ff:ff:ff:ff 2023-12-16T05:54:51.368 INFO:teuthology.orchestra.run.smithi156.stdout: altname enp7s0f1 2023-12-16T05:54:51.368 INFO:teuthology.orchestra.run.smithi156.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T05:54:51.368 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:88:6d:fc brd ff:ff:ff:ff:ff:ff 2023-12-16T05:54:51.368 INFO:teuthology.orchestra.run.smithi156.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T05:54:51.368 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:88:6d:fd brd ff:ff:ff:ff:ff:ff 2023-12-16T05:54:51.368 INFO:teuthology.orchestra.run.smithi156.stdout: inet 172.21.15.156/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-16T05:54:51.368 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft 38826sec preferred_lft 38826sec 2023-12-16T05:54:51.368 INFO:teuthology.orchestra.run.smithi156.stdout: inet6 fe80::ec4:7aff:fe88:6dfd/64 scope link 2023-12-16T05:54:51.368 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2023-12-16T05:54:51.369 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-16T05:54:51.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:51.369 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec bash -c ' 2023-12-16T05:54:51.370 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2023-12-16T05:54:51.370 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link add name ceph-brx type bridge 2023-12-16T05:54:51.370 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip addr flush dev ceph-brx 2023-12-16T05:54:51.370 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link set ceph-brx up 2023-12-16T05:54:51.370 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-16T05:54:51.370 DEBUG:teuthology.orchestra.run.smithi156:> ') 2023-12-16T05:54:51.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:51.555 DEBUG:teuthology.orchestra.run.smithi156:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T05:54:51.582 INFO:teuthology.orchestra.run.smithi156.stdout:1 2023-12-16T05:54:51.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:51.584 DEBUG:teuthology.orchestra.run.smithi156:> route 2023-12-16T05:54:51.669 INFO:teuthology.orchestra.run.smithi156.stdout:Kernel IP routing table 2023-12-16T05:54:51.669 INFO:teuthology.orchestra.run.smithi156.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T05:54:51.669 INFO:teuthology.orchestra.run.smithi156.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-16T05:54:51.669 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-16T05:54:51.670 INFO:teuthology.orchestra.run.smithi156.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T05:54:51.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:51.670 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec bash -c ' 2023-12-16T05:54:51.670 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2023-12-16T05:54:51.670 DEBUG:teuthology.orchestra.run.smithi156:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-16T05:54:51.670 DEBUG:teuthology.orchestra.run.smithi156:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-16T05:54:51.670 DEBUG:teuthology.orchestra.run.smithi156:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-16T05:54:51.670 DEBUG:teuthology.orchestra.run.smithi156:> ') 2023-12-16T05:54:51.751 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:51 smithi156 ceph-mon[121001]: pgmap v138: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-16T05:54:51.752 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:51 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/4223746205' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-16T05:54:51.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:51 smithi155 ceph-mon[112451]: pgmap v138: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-16T05:54:51.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:51 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/4223746205' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-16T05:54:51.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:51.949 DEBUG:teuthology.orchestra.run.smithi156:> ip netns list 2023-12-16T05:54:52.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:52.010 DEBUG:teuthology.orchestra.run.smithi156:> ip netns list-id 2023-12-16T05:54:52.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:52.069 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec bash -c ' 2023-12-16T05:54:52.069 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2023-12-16T05:54:52.069 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-16T05:54:52.069 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-16T05:54:52.069 DEBUG:teuthology.orchestra.run.smithi156:> ') 2023-12-16T05:54:52.167 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-16T05:54:52.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:52.168 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec bash -c ' 2023-12-16T05:54:52.168 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2023-12-16T05:54:52.168 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-16T05:54:52.168 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-16T05:54:52.168 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-16T05:54:52.168 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-16T05:54:52.168 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-16T05:54:52.168 DEBUG:teuthology.orchestra.run.smithi156:> ') 2023-12-16T05:54:52.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:52.408 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec bash -c ' 2023-12-16T05:54:52.408 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2023-12-16T05:54:52.408 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link set brx.0 up 2023-12-16T05:54:52.408 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link set dev brx.0 master ceph-brx 2023-12-16T05:54:52.409 DEBUG:teuthology.orchestra.run.smithi156:> ') 2023-12-16T05:54:52.507 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T05:54:52.507 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-16T05:54:52.524 INFO:teuthology.orchestra.run.smithi156.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-16T05:54:52.525 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T05:54:52.525 DEBUG:teuthology.orchestra.run.smithi156:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-16T05:54:52.582 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-16T05:54:52.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:52.583 DEBUG:teuthology.orchestra.run.smithi156:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-16T05:54:52.671 INFO:teuthology.orchestra.run.smithi156.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-16T05:54:52.671 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-16T05:54:52.671 INFO:teuthology.orchestra.run.smithi156.stdout:invalid new device string format 2023-12-16T05:54:52.747 INFO:teuthology.orchestra.run.smithi156.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-16T05:54:52.747 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-16T05:54:52.747 INFO:teuthology.orchestra.run.smithi156.stdout:invalid new device string format 2023-12-16T05:54:52.747 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: resolved to: "172.21.15.155:3300,172.21.15.156:3300" 2023-12-16T05:54:52.748 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-16T05:54:52.765 INFO:teuthology.orchestra.run.smithi156.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-16T05:54:52.765 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-16T05:54:52.765 INFO:teuthology.orchestra.run.smithi156.stdout:invalid new device string format 2023-12-16T05:54:52.765 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: resolved to: "172.21.15.155:3300,172.21.15.156:3300" 2023-12-16T05:54:52.766 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-16T05:54:52.766 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: resolved to: "172.21.15.155:6789,172.21.15.156:6789" 2023-12-16T05:54:52.766 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.155:6789,172.21.15.156:6789:/ 2023-12-16T05:54:52.766 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=d344784e-9bd6-11ee-95a5-87774f69a715" will pass to kernel 2023-12-16T05:54:52.769 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T05:54:52.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:52.769 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-16T05:54:52.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:52.796 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T05:54:52.870 INFO:teuthology.orchestra.run.smithi156.stdout:client24329 2023-12-16T05:54:52.870 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-12-16T05:54:52.871 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T05:54:52.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:52.930 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T05:54:53.004 INFO:teuthology.orchestra.run.smithi156.stdout:client24329 2023-12-16T05:54:53.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:53.004 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T05:54:53.078 INFO:teuthology.orchestra.run.smithi156.stdout:client24329 2023-12-16T05:54:53.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T05:54:53.078 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/d344784e-9bd6-11ee-95a5-87774f69a715.client24329/status') 2023-12-16T05:54:53.160 INFO:teuthology.orchestra.run.smithi156.stdout:instance: client.24329 (3)192.168.0.1:0/2207038311 2023-12-16T05:54:53.160 INFO:teuthology.orchestra.run.smithi156.stdout:blocklisted: false 2023-12-16T05:54:53.161 INFO:teuthology.orchestra.run.smithi156.stderr:0+1 records in 2023-12-16T05:54:53.161 INFO:teuthology.orchestra.run.smithi156.stderr:0+1 records out 2023-12-16T05:54:53.161 INFO:teuthology.orchestra.run.smithi156.stderr:70 bytes copied, 3.5244e-05 s, 2.0 MB/s 2023-12-16T05:54:53.162 INFO:teuthology.run_tasks:Running task print... 2023-12-16T05:54:53.172 INFO:teuthology.task.print:**** done client 2023-12-16T05:54:53.172 INFO:teuthology.run_tasks:Running task parallel... 2023-12-16T05:54:53.228 INFO:teuthology.task.parallel:starting parallel... 2023-12-16T05:54:53.228 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-16T05:54:53.240 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-16T05:54:53.240 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi155.front.sepia.ceph.com 2023-12-16T05:54:53.240 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-16T05:54:53.241 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-16T05:54:53.241 INFO:teuthology.task.sequential:In sequential, running task workunit... 2023-12-16T05:54:53.244 INFO:tasks.workunit:Pulling workunits from ref 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T05:54:53.244 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-16T05:54:53.244 INFO:tasks.workunit:timeout=3h 2023-12-16T05:54:53.244 INFO:tasks.workunit:cleanup=True 2023-12-16T05:54:53.244 DEBUG:teuthology.orchestra.run.smithi155:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-16T05:54:53.268 INFO:teuthology.orchestra.run.smithi155.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-16T05:54:53.268 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-12-16T05:54:53.268 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 8eh/142d Inode: 1 Links: 2 2023-12-16T05:54:53.268 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T05:54:53.269 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-16T05:54:53.269 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-16T05:54:53.269 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-12-16 05:54:28.318809454 +0000 2023-12-16T05:54:53.269 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-12-16 05:54:49.129467110 +0000 2023-12-16T05:54:53.269 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2023-12-16 05:54:28.318809454 +0000 2023-12-16T05:54:53.269 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-16T05:54:53.269 DEBUG:teuthology.orchestra.run.smithi155:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-16T05:54:53.342 DEBUG:teuthology.orchestra.run.smithi156:> stat -- /home/ubuntu/cephtest/mnt.1 2023-12-16T05:54:53.362 INFO:teuthology.orchestra.run.smithi156.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-12-16T05:54:53.362 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2023-12-16T05:54:53.362 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 78h/120d Inode: 1 Links: 3 2023-12-16T05:54:53.362 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T05:54:53.362 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-16T05:54:53.362 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-16T05:54:53.362 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-12-16 05:54:53.334382829 +0000 2023-12-16T05:54:53.362 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-12-16 05:54:53.334382829 +0000 2023-12-16T05:54:53.363 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2023-12-16 05:54:28.318809454 +0000 2023-12-16T05:54:53.363 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-12-16T05:54:53.363 DEBUG:teuthology.orchestra.run.smithi156:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-12-16T05:54:53.434 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T05:54:53.435 DEBUG:teuthology.orchestra.run.smithi156:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T05:54:53.453 INFO:tasks.workunit.client.0.smithi155.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-16T05:54:53.493 INFO:tasks.workunit.client.1.smithi156.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-12-16T05:54:53.532 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:53.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:53 smithi156 ceph-mon[121001]: pgmap v139: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 170 B/s wr, 4 op/s 2023-12-16T05:54:53.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:53 smithi155 ceph-mon[112451]: pgmap v139: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 170 B/s wr, 4 op/s 2023-12-16T05:54:54.544 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.540+0000 7f8bc7749700 1 -- 172.21.15.155:0/3235477281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bc00fb290 msgr2=0x7f8bc00fb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.540+0000 7f8bc7749700 1 --2- 172.21.15.155:0/3235477281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bc00fb290 0x7f8bc00fb6a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0004940 tx=0x7f8bb0009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.540+0000 7f8bc7749700 1 -- 172.21.15.155:0/3235477281 shutdown_connections 2023-12-16T05:54:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.540+0000 7f8bc7749700 1 --2- 172.21.15.155:0/3235477281 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bc00fc4a0 0x7f8bc00fc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.540+0000 7f8bc7749700 1 --2- 172.21.15.155:0/3235477281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bc00fb290 0x7f8bc00fb6a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.540+0000 7f8bc7749700 1 -- 172.21.15.155:0/3235477281 >> 172.21.15.155:0/3235477281 conn(0x7f8bc00f6950 msgr2=0x7f8bc00f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.540+0000 7f8bc7749700 1 -- 172.21.15.155:0/3235477281 shutdown_connections 2023-12-16T05:54:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.541+0000 7f8bc7749700 1 -- 172.21.15.155:0/3235477281 wait complete. 2023-12-16T05:54:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.541+0000 7f8bc7749700 1 Processor -- start 2023-12-16T05:54:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.541+0000 7f8bc7749700 1 -- start start 2023-12-16T05:54:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.541+0000 7f8bc7749700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bc00fb290 0x7f8bc010c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.541+0000 7f8bc7749700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bc00fc4a0 0x7f8bc010cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:54.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.541+0000 7f8bc7749700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc010d0b0 con 0x7f8bc00fc4a0 2023-12-16T05:54:54.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.541+0000 7f8bc7749700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc010d950 con 0x7f8bc00fb290 2023-12-16T05:54:54.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.541+0000 7f8bc4ce4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bc00fc4a0 0x7f8bc010cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:54.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.541+0000 7f8bc4ce4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bc00fc4a0 0x7f8bc010cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:35650/0 (socket says 172.21.15.155:35650) 2023-12-16T05:54:54.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.541+0000 7f8bc4ce4700 1 -- 172.21.15.155:0/3932221069 learned_addr learned my addr 172.21.15.155:0/3932221069 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:54.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.541+0000 7f8bc54e5700 1 --2- 172.21.15.155:0/3932221069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bc00fb290 0x7f8bc010c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:54.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.542+0000 7f8bc4ce4700 1 -- 172.21.15.155:0/3932221069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bc00fb290 msgr2=0x7f8bc010c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:54.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.542+0000 7f8bc4ce4700 1 --2- 172.21.15.155:0/3932221069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bc00fb290 0x7f8bc010c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:54.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.542+0000 7f8bc4ce4700 1 -- 172.21.15.155:0/3932221069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb0005040 con 0x7f8bc00fc4a0 2023-12-16T05:54:54.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.542+0000 7f8bc4ce4700 1 --2- 172.21.15.155:0/3932221069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bc00fc4a0 0x7f8bc010cab0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00c8c0 tx=0x7f8bbc0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:54.547 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.542+0000 7f8bb5ffb700 1 -- 172.21.15.155:0/3932221069 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bbc00a760 con 0x7f8bc00fc4a0 2023-12-16T05:54:54.547 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.542+0000 7f8bb5ffb700 1 -- 172.21.15.155:0/3932221069 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8bbc00ad70 con 0x7f8bc00fc4a0 2023-12-16T05:54:54.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.542+0000 7f8bb5ffb700 1 -- 172.21.15.155:0/3932221069 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bbc0113a0 con 0x7f8bc00fc4a0 2023-12-16T05:54:54.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.542+0000 7f8bc7749700 1 -- 172.21.15.155:0/3932221069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc010dc30 con 0x7f8bc00fc4a0 2023-12-16T05:54:54.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.542+0000 7f8bc7749700 1 -- 172.21.15.155:0/3932221069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc010e170 con 0x7f8bc00fc4a0 2023-12-16T05:54:54.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.543+0000 7f8bc7749700 1 -- 172.21.15.155:0/3932221069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc0106500 con 0x7f8bc00fc4a0 2023-12-16T05:54:54.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.544+0000 7f8bb5ffb700 1 -- 172.21.15.155:0/3932221069 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f8bbc012400 con 0x7f8bc00fc4a0 2023-12-16T05:54:54.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.544+0000 7f8bb5ffb700 1 --2- 172.21.15.155:0/3932221069 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8bac068f60 0x7f8bac06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:54.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.544+0000 7f8bb5ffb700 1 -- 172.21.15.155:0/3932221069 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8bbc086d20 con 0x7f8bc00fc4a0 2023-12-16T05:54:54.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.544+0000 7f8bc54e5700 1 --2- 172.21.15.155:0/3932221069 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8bac068f60 0x7f8bac06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:54.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.544+0000 7f8bc54e5700 1 --2- 172.21.15.155:0/3932221069 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8bac068f60 0x7f8bac06b410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0004f90 tx=0x7f8bb0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:54.551 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.548+0000 7f8bb5ffb700 1 -- 172.21.15.155:0/3932221069 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8bbc056d20 con 0x7f8bc00fc4a0 2023-12-16T05:54:54.740 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.737+0000 7f8bc7749700 1 -- 172.21.15.155:0/3932221069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f8bc004bb80 con 0x7f8bc00fc4a0 2023-12-16T05:54:54.740 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.737+0000 7f8bb5ffb700 1 -- 172.21.15.155:0/3932221069 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f8bc004bb80 con 0x7f8bc00fc4a0 2023-12-16T05:54:54.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.739+0000 7f8bc7749700 1 -- 172.21.15.155:0/3932221069 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8bac068f60 msgr2=0x7f8bac06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:54.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.739+0000 7f8bc7749700 1 --2- 172.21.15.155:0/3932221069 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8bac068f60 0x7f8bac06b410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0004f90 tx=0x7f8bb0009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:54.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.739+0000 7f8bc7749700 1 -- 172.21.15.155:0/3932221069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bc00fc4a0 msgr2=0x7f8bc010cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:54.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.739+0000 7f8bc7749700 1 --2- 172.21.15.155:0/3932221069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bc00fc4a0 0x7f8bc010cab0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00c8c0 tx=0x7f8bbc0044c0 comp rx=0 tx=0).stop 2023-12-16T05:54:54.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.739+0000 7f8bc7749700 1 -- 172.21.15.155:0/3932221069 shutdown_connections 2023-12-16T05:54:54.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.739+0000 7f8bc7749700 1 --2- 172.21.15.155:0/3932221069 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8bac068f60 0x7f8bac06b410 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:54.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.739+0000 7f8bc7749700 1 --2- 172.21.15.155:0/3932221069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bc00fb290 0x7f8bc010c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:54.743 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.739+0000 7f8bc7749700 1 --2- 172.21.15.155:0/3932221069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bc00fc4a0 0x7f8bc010cab0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:54.743 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.739+0000 7f8bc7749700 1 -- 172.21.15.155:0/3932221069 >> 172.21.15.155:0/3932221069 conn(0x7f8bc00f6950 msgr2=0x7f8bc00f8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:54.743 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.739+0000 7f8bc7749700 1 -- 172.21.15.155:0/3932221069 shutdown_connections 2023-12-16T05:54:54.743 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:54.739+0000 7f8bc7749700 1 -- 172.21.15.155:0/3932221069 wait complete. 2023-12-16T05:54:55.110 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-16T05:54:55.414 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:55.822 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:55 smithi155 ceph-mon[112451]: pgmap v140: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2023-12-16T05:54:55.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:55 smithi156 ceph-mon[121001]: pgmap v140: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2023-12-16T05:54:56.377 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.372+0000 7f2928b64700 1 -- 172.21.15.155:0/3847501067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29240fbaf0 msgr2=0x7f29240fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:56.377 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.372+0000 7f2928b64700 1 --2- 172.21.15.155:0/3847501067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29240fbaf0 0x7f29240fbf00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2914004940 tx=0x7f2914009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:56.377 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.372+0000 7f2928b64700 1 -- 172.21.15.155:0/3847501067 shutdown_connections 2023-12-16T05:54:56.377 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.372+0000 7f2928b64700 1 --2- 172.21.15.155:0/3847501067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29240fcd00 0x7f29240fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:56.377 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.372+0000 7f2928b64700 1 --2- 172.21.15.155:0/3847501067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29240fbaf0 0x7f29240fbf00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:56.377 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.372+0000 7f2928b64700 1 -- 172.21.15.155:0/3847501067 >> 172.21.15.155:0/3847501067 conn(0x7f29240f7190 msgr2=0x7f29240f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:56.377 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.372+0000 7f2928b64700 1 -- 172.21.15.155:0/3847501067 shutdown_connections 2023-12-16T05:54:56.377 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.372+0000 7f2928b64700 1 -- 172.21.15.155:0/3847501067 wait complete. 2023-12-16T05:54:56.377 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.373+0000 7f2928b64700 1 Processor -- start 2023-12-16T05:54:56.377 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.373+0000 7f2928b64700 1 -- start start 2023-12-16T05:54:56.377 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.373+0000 7f2928b64700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29240fbaf0 0x7f292410d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:56.378 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.373+0000 7f2928b64700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29240fcd00 0x7f292410dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:56.378 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.373+0000 7f2928b64700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292410e0d0 con 0x7f29240fbaf0 2023-12-16T05:54:56.378 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.373+0000 7f2928b64700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292410e970 con 0x7f29240fcd00 2023-12-16T05:54:56.378 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.373+0000 7f292259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29240fbaf0 0x7f292410d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:56.378 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.373+0000 7f292259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29240fbaf0 0x7f292410d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33342/0 (socket says 172.21.15.155:33342) 2023-12-16T05:54:56.378 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.373+0000 7f292259c700 1 -- 172.21.15.155:0/2762918043 learned_addr learned my addr 172.21.15.155:0/2762918043 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:56.378 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.373+0000 7f292259c700 1 -- 172.21.15.155:0/2762918043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29240fcd00 msgr2=0x7f292410dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:56.378 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.373+0000 7f292259c700 1 --2- 172.21.15.155:0/2762918043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29240fcd00 0x7f292410dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:56.378 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.373+0000 7f292259c700 1 -- 172.21.15.155:0/2762918043 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2914005040 con 0x7f29240fbaf0 2023-12-16T05:54:56.378 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.374+0000 7f292259c700 1 --2- 172.21.15.155:0/2762918043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29240fbaf0 0x7f292410d590 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2914000c00 tx=0x7f2914009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:56.378 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.374+0000 7f2912ffd700 1 -- 172.21.15.155:0/2762918043 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f291400e040 con 0x7f29240fbaf0 2023-12-16T05:54:56.378 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.374+0000 7f2912ffd700 1 -- 172.21.15.155:0/2762918043 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2914009af0 con 0x7f29240fbaf0 2023-12-16T05:54:56.379 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.374+0000 7f2928b64700 1 -- 172.21.15.155:0/2762918043 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f292410ebf0 con 0x7f29240fbaf0 2023-12-16T05:54:56.379 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.374+0000 7f2912ffd700 1 -- 172.21.15.155:0/2762918043 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f291401c630 con 0x7f29240fbaf0 2023-12-16T05:54:56.379 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.374+0000 7f2928b64700 1 -- 172.21.15.155:0/2762918043 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f292410f130 con 0x7f29240fbaf0 2023-12-16T05:54:56.379 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.375+0000 7f2928b64700 1 -- 172.21.15.155:0/2762918043 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f292404bb80 con 0x7f29240fbaf0 2023-12-16T05:54:56.380 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.375+0000 7f2912ffd700 1 -- 172.21.15.155:0/2762918043 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f291400bcd0 con 0x7f29240fbaf0 2023-12-16T05:54:56.380 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.376+0000 7f2912ffd700 1 --2- 172.21.15.155:0/2762918043 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f290c068f60 0x7f290c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:56.380 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.376+0000 7f2912ffd700 1 -- 172.21.15.155:0/2762918043 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f29140881c0 con 0x7f29240fbaf0 2023-12-16T05:54:56.380 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.376+0000 7f2921d9b700 1 --2- 172.21.15.155:0/2762918043 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f290c068f60 0x7f290c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:56.380 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.376+0000 7f2921d9b700 1 --2- 172.21.15.155:0/2762918043 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f290c068f60 0x7f290c06b410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2918004ad0 tx=0x7f2918007d40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:56.382 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.380+0000 7f2912ffd700 1 -- 172.21.15.155:0/2762918043 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f29140581d0 con 0x7f29240fbaf0 2023-12-16T05:54:56.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.568+0000 7f2928b64700 1 -- 172.21.15.155:0/2762918043 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f2924104490 con 0x7f29240fbaf0 2023-12-16T05:54:56.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.568+0000 7f2912ffd700 1 -- 172.21.15.155:0/2762918043 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f2914057d60 con 0x7f29240fbaf0 2023-12-16T05:54:56.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.570+0000 7f2928b64700 1 -- 172.21.15.155:0/2762918043 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f290c068f60 msgr2=0x7f290c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:56.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.570+0000 7f2928b64700 1 --2- 172.21.15.155:0/2762918043 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f290c068f60 0x7f290c06b410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2918004ad0 tx=0x7f2918007d40 comp rx=0 tx=0).stop 2023-12-16T05:54:56.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.570+0000 7f2928b64700 1 -- 172.21.15.155:0/2762918043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29240fbaf0 msgr2=0x7f292410d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:56.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.570+0000 7f2928b64700 1 --2- 172.21.15.155:0/2762918043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29240fbaf0 0x7f292410d590 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2914000c00 tx=0x7f2914009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:56.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.570+0000 7f2928b64700 1 -- 172.21.15.155:0/2762918043 shutdown_connections 2023-12-16T05:54:56.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.570+0000 7f2928b64700 1 --2- 172.21.15.155:0/2762918043 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f290c068f60 0x7f290c06b410 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:56.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.570+0000 7f2928b64700 1 --2- 172.21.15.155:0/2762918043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29240fbaf0 0x7f292410d590 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:56.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.570+0000 7f2928b64700 1 --2- 172.21.15.155:0/2762918043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29240fcd00 0x7f292410dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:56.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.570+0000 7f2928b64700 1 -- 172.21.15.155:0/2762918043 >> 172.21.15.155:0/2762918043 conn(0x7f29240f7190 msgr2=0x7f2924065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:56.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.571+0000 7f2928b64700 1 -- 172.21.15.155:0/2762918043 shutdown_connections 2023-12-16T05:54:56.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:56.571+0000 7f2928b64700 1 -- 172.21.15.155:0/2762918043 wait complete. 2023-12-16T05:54:56.918 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-16T05:54:57.182 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:57.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:57 smithi155 ceph-mon[112451]: pgmap v141: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 682 B/s wr, 4 op/s 2023-12-16T05:54:57.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:57 smithi156 ceph-mon[121001]: pgmap v141: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 682 B/s wr, 4 op/s 2023-12-16T05:54:58.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.146+0000 7f27626c0700 1 -- 172.21.15.155:0/1453859413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f275c0fbaf0 msgr2=0x7f275c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:58.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.146+0000 7f27626c0700 1 --2- 172.21.15.155:0/1453859413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f275c0fbaf0 0x7f275c0fbf00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f274c004940 tx=0x7f274c009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:58.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.146+0000 7f27626c0700 1 -- 172.21.15.155:0/1453859413 shutdown_connections 2023-12-16T05:54:58.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.146+0000 7f27626c0700 1 --2- 172.21.15.155:0/1453859413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f275c0fcd00 0x7f275c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:58.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.146+0000 7f27626c0700 1 --2- 172.21.15.155:0/1453859413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f275c0fbaf0 0x7f275c0fbf00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:58.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.146+0000 7f27626c0700 1 -- 172.21.15.155:0/1453859413 >> 172.21.15.155:0/1453859413 conn(0x7f275c0f7190 msgr2=0x7f275c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:58.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.146+0000 7f27626c0700 1 -- 172.21.15.155:0/1453859413 shutdown_connections 2023-12-16T05:54:58.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.146+0000 7f27626c0700 1 -- 172.21.15.155:0/1453859413 wait complete. 2023-12-16T05:54:58.151 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.146+0000 7f27626c0700 1 Processor -- start 2023-12-16T05:54:58.151 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.147+0000 7f27626c0700 1 -- start start 2023-12-16T05:54:58.151 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.147+0000 7f27626c0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f275c0fbaf0 0x7f275c10c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:58.151 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.147+0000 7f27626c0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f275c0fcd00 0x7f275c10c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:58.151 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.147+0000 7f27626c0700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c10cfc0 con 0x7f275c0fbaf0 2023-12-16T05:54:58.151 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.147+0000 7f27626c0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c10d860 con 0x7f275c0fcd00 2023-12-16T05:54:58.151 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.147+0000 7f275bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f275c0fbaf0 0x7f275c10c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:58.151 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.147+0000 7f275bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f275c0fbaf0 0x7f275c10c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33358/0 (socket says 172.21.15.155:33358) 2023-12-16T05:54:58.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.147+0000 7f275bfff700 1 -- 172.21.15.155:0/3452450132 learned_addr learned my addr 172.21.15.155:0/3452450132 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:58.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.147+0000 7f275b7fe700 1 --2- 172.21.15.155:0/3452450132 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f275c0fcd00 0x7f275c10c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:58.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.147+0000 7f275bfff700 1 -- 172.21.15.155:0/3452450132 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f275c0fcd00 msgr2=0x7f275c10c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:58.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.147+0000 7f275bfff700 1 --2- 172.21.15.155:0/3452450132 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f275c0fcd00 0x7f275c10c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:58.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.147+0000 7f275bfff700 1 -- 172.21.15.155:0/3452450132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c005040 con 0x7f275c0fbaf0 2023-12-16T05:54:58.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.147+0000 7f275bfff700 1 --2- 172.21.15.155:0/3452450132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f275c0fbaf0 0x7f275c10c480 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f274c004f90 tx=0x7f274c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:58.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.148+0000 7f2758ff9700 1 -- 172.21.15.155:0/3452450132 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f274c00e040 con 0x7f275c0fbaf0 2023-12-16T05:54:58.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.148+0000 7f2758ff9700 1 -- 172.21.15.155:0/3452450132 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f274c01e8d0 con 0x7f275c0fbaf0 2023-12-16T05:54:58.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.148+0000 7f27626c0700 1 -- 172.21.15.155:0/3452450132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275c10dae0 con 0x7f275c0fbaf0 2023-12-16T05:54:58.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.148+0000 7f2758ff9700 1 -- 172.21.15.155:0/3452450132 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f274c013780 con 0x7f275c0fbaf0 2023-12-16T05:54:58.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.148+0000 7f27626c0700 1 -- 172.21.15.155:0/3452450132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275c10dfc0 con 0x7f275c0fbaf0 2023-12-16T05:54:58.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.149+0000 7f27626c0700 1 -- 172.21.15.155:0/3452450132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275c04bb80 con 0x7f275c0fbaf0 2023-12-16T05:54:58.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.149+0000 7f2758ff9700 1 -- 172.21.15.155:0/3452450132 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f274c01e420 con 0x7f275c0fbaf0 2023-12-16T05:54:58.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.149+0000 7f2758ff9700 1 --2- 172.21.15.155:0/3452450132 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2744068f60 0x7f274406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:58.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.149+0000 7f2758ff9700 1 -- 172.21.15.155:0/3452450132 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f274c08ae60 con 0x7f275c0fbaf0 2023-12-16T05:54:58.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.149+0000 7f275b7fe700 1 --2- 172.21.15.155:0/3452450132 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2744068f60 0x7f274406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:58.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.150+0000 7f275b7fe700 1 --2- 172.21.15.155:0/3452450132 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2744068f60 0x7f274406b410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2750004990 tx=0x7f2750009ee0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:58.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.154+0000 7f2758ff9700 1 -- 172.21.15.155:0/3452450132 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f274c05ad40 con 0x7f275c0fbaf0 2023-12-16T05:54:58.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.339+0000 7f27626c0700 1 -- 172.21.15.155:0/3452450132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f275c104490 con 0x7f275c0fbaf0 2023-12-16T05:54:58.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.339+0000 7f2758ff9700 1 -- 172.21.15.155:0/3452450132 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f274c05a8d0 con 0x7f275c0fbaf0 2023-12-16T05:54:58.344 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.341+0000 7f27626c0700 1 -- 172.21.15.155:0/3452450132 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2744068f60 msgr2=0x7f274406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:58.344 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.341+0000 7f27626c0700 1 --2- 172.21.15.155:0/3452450132 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2744068f60 0x7f274406b410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2750004990 tx=0x7f2750009ee0 comp rx=0 tx=0).stop 2023-12-16T05:54:58.344 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.341+0000 7f27626c0700 1 -- 172.21.15.155:0/3452450132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f275c0fbaf0 msgr2=0x7f275c10c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:58.344 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.341+0000 7f27626c0700 1 --2- 172.21.15.155:0/3452450132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f275c0fbaf0 0x7f275c10c480 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f274c004f90 tx=0x7f274c009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:58.344 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.341+0000 7f27626c0700 1 -- 172.21.15.155:0/3452450132 shutdown_connections 2023-12-16T05:54:58.344 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.341+0000 7f27626c0700 1 --2- 172.21.15.155:0/3452450132 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2744068f60 0x7f274406b410 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:58.344 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.341+0000 7f27626c0700 1 --2- 172.21.15.155:0/3452450132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f275c0fbaf0 0x7f275c10c480 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:58.345 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.341+0000 7f27626c0700 1 --2- 172.21.15.155:0/3452450132 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f275c0fcd00 0x7f275c10c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:58.345 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.341+0000 7f27626c0700 1 -- 172.21.15.155:0/3452450132 >> 172.21.15.155:0/3452450132 conn(0x7f275c0f7190 msgr2=0x7f275c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:58.345 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.341+0000 7f27626c0700 1 -- 172.21.15.155:0/3452450132 shutdown_connections 2023-12-16T05:54:58.345 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:58.341+0000 7f27626c0700 1 -- 172.21.15.155:0/3452450132 wait complete. 2023-12-16T05:54:58.692 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2023-12-16T05:54:58.985 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:54:59.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:54:59 smithi156 ceph-mon[121001]: pgmap v142: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 682 B/s wr, 4 op/s 2023-12-16T05:54:59.789 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:54:59 smithi155 ceph-mon[112451]: pgmap v142: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 682 B/s wr, 4 op/s 2023-12-16T05:54:59.962 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.958+0000 7f3f4018d700 1 -- 172.21.15.155:0/3241560170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f38100050 msgr2=0x7f3f38102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.958+0000 7f3f4018d700 1 --2- 172.21.15.155:0/3241560170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f38100050 0x7f3f38102430 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3f28004940 tx=0x7f3f28009e30 comp rx=0 tx=0).stop 2023-12-16T05:54:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.958+0000 7f3f4018d700 1 -- 172.21.15.155:0/3241560170 shutdown_connections 2023-12-16T05:54:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.958+0000 7f3f4018d700 1 --2- 172.21.15.155:0/3241560170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f38100050 0x7f3f38102430 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.958+0000 7f3f4018d700 1 --2- 172.21.15.155:0/3241560170 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f380fd730 0x7f3f380ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.958+0000 7f3f4018d700 1 -- 172.21.15.155:0/3241560170 >> 172.21.15.155:0/3241560170 conn(0x7f3f380f7190 msgr2=0x7f3f380f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:54:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.958+0000 7f3f4018d700 1 -- 172.21.15.155:0/3241560170 shutdown_connections 2023-12-16T05:54:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.958+0000 7f3f4018d700 1 -- 172.21.15.155:0/3241560170 wait complete. 2023-12-16T05:54:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.959+0000 7f3f4018d700 1 Processor -- start 2023-12-16T05:54:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.959+0000 7f3f4018d700 1 -- start start 2023-12-16T05:54:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.959+0000 7f3f4018d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f380fd730 0x7f3f3810d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.959+0000 7f3f4018d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f38100050 0x7f3f3810da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.959+0000 7f3f4018d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3810e070 con 0x7f3f380fd730 2023-12-16T05:54:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.959+0000 7f3f4018d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3810e910 con 0x7f3f38100050 2023-12-16T05:54:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.959+0000 7f3f3df29700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f380fd730 0x7f3f3810d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.959+0000 7f3f3df29700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f380fd730 0x7f3f3810d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33372/0 (socket says 172.21.15.155:33372) 2023-12-16T05:54:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.959+0000 7f3f3df29700 1 -- 172.21.15.155:0/3007810086 learned_addr learned my addr 172.21.15.155:0/3007810086 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:54:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.959+0000 7f3f3d728700 1 --2- 172.21.15.155:0/3007810086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f38100050 0x7f3f3810da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.959+0000 7f3f3df29700 1 -- 172.21.15.155:0/3007810086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f38100050 msgr2=0x7f3f3810da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:54:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.959+0000 7f3f3df29700 1 --2- 172.21.15.155:0/3007810086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f38100050 0x7f3f3810da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:54:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.959+0000 7f3f3df29700 1 -- 172.21.15.155:0/3007810086 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f28005040 con 0x7f3f380fd730 2023-12-16T05:54:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.960+0000 7f3f3df29700 1 --2- 172.21.15.155:0/3007810086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f380fd730 0x7f3f3810d530 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3f34002a50 tx=0x7f3f340046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.960+0000 7f3f2e7fc700 1 -- 172.21.15.155:0/3007810086 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f34007cc0 con 0x7f3f380fd730 2023-12-16T05:54:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.960+0000 7f3f2e7fc700 1 -- 172.21.15.155:0/3007810086 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3f3400f040 con 0x7f3f380fd730 2023-12-16T05:54:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.960+0000 7f3f4018d700 1 -- 172.21.15.155:0/3007810086 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f3810ebf0 con 0x7f3f380fd730 2023-12-16T05:54:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.960+0000 7f3f2e7fc700 1 -- 172.21.15.155:0/3007810086 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f3400d9c0 con 0x7f3f380fd730 2023-12-16T05:54:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.960+0000 7f3f4018d700 1 -- 172.21.15.155:0/3007810086 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3810f130 con 0x7f3f380fd730 2023-12-16T05:54:59.965 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.961+0000 7f3f4018d700 1 -- 172.21.15.155:0/3007810086 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f381075c0 con 0x7f3f380fd730 2023-12-16T05:54:59.965 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.961+0000 7f3f2e7fc700 1 -- 172.21.15.155:0/3007810086 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f3f3400db20 con 0x7f3f380fd730 2023-12-16T05:54:59.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.961+0000 7f3f2e7fc700 1 --2- 172.21.15.155:0/3007810086 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f3f24068f70 0x7f3f2406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:54:59.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.962+0000 7f3f2e7fc700 1 -- 172.21.15.155:0/3007810086 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3f34086ae0 con 0x7f3f380fd730 2023-12-16T05:54:59.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.962+0000 7f3f3d728700 1 --2- 172.21.15.155:0/3007810086 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f3f24068f70 0x7f3f2406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:54:59.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.962+0000 7f3f3d728700 1 --2- 172.21.15.155:0/3007810086 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f3f24068f70 0x7f3f2406b420 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800b3b0 tx=0x7f3f28009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:54:59.969 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:54:59.966+0000 7f3f2e7fc700 1 -- 172.21.15.155:0/3007810086 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3f340569c0 con 0x7f3f380fd730 2023-12-16T05:55:00.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:00.182+0000 7f3f4018d700 1 -- 172.21.15.155:0/3007810086 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f3810f470 con 0x7f3f24068f70 2023-12-16T05:55:01.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:01 smithi155 ceph-mon[112451]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:55:01.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:01 smithi155 ceph-mon[112451]: pgmap v143: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2023-12-16T05:55:01.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:01 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:55:01.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:01 smithi156 ceph-mon[121001]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:55:01.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:01 smithi156 ceph-mon[121001]: pgmap v143: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2023-12-16T05:55:01.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:01 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:55:03.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:03 smithi155 ceph-mon[112451]: pgmap v144: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2023-12-16T05:55:03.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:03 smithi156 ceph-mon[121001]: pgmap v144: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2023-12-16T05:55:05.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:05 smithi155 ceph-mon[112451]: pgmap v145: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 597 B/s wr, 4 op/s 2023-12-16T05:55:05.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:05 smithi156 ceph-mon[121001]: pgmap v145: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 597 B/s wr, 4 op/s 2023-12-16T05:55:07.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:07 smithi155 ceph-mon[112451]: pgmap v146: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 597 B/s wr, 4 op/s 2023-12-16T05:55:07.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:07 smithi156 ceph-mon[121001]: pgmap v146: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 597 B/s wr, 4 op/s 2023-12-16T05:55:09.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:09 smithi156 ceph-mon[121001]: pgmap v147: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 3 op/s 2023-12-16T05:55:09.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:09 smithi155 ceph-mon[112451]: pgmap v147: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 3 op/s 2023-12-16T05:55:11.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:11 smithi155 ceph-mon[112451]: pgmap v148: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2023-12-16T05:55:11.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:11 smithi156 ceph-mon[121001]: pgmap v148: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2023-12-16T05:55:13.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:13 smithi155 ceph-mon[112451]: pgmap v149: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T05:55:13.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:13 smithi156 ceph-mon[121001]: pgmap v149: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T05:55:15.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:15 smithi155 ceph-mon[112451]: pgmap v150: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:55:15.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:15 smithi156 ceph-mon[121001]: pgmap v150: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:55:16.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:16 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:55:16.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:16 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:55:17.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:17 smithi155 ceph-mon[112451]: pgmap v151: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T05:55:17.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:17 smithi156 ceph-mon[121001]: pgmap v151: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T05:55:19.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:19 smithi156 ceph-mon[121001]: pgmap v152: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-12-16T05:55:19.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:19 smithi155 ceph-mon[112451]: pgmap v152: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-12-16T05:55:21.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:21 smithi155 ceph-mon[112451]: pgmap v153: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:55:21.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:21 smithi156 ceph-mon[121001]: pgmap v153: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:55:23.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:23 smithi155 ceph-mon[112451]: pgmap v154: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T05:55:23.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:23 smithi156 ceph-mon[121001]: pgmap v154: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T05:55:25.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:25 smithi155 ceph-mon[112451]: pgmap v155: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:55:25.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:25 smithi156 ceph-mon[121001]: pgmap v155: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:55:27.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:27 smithi155 ceph-mon[112451]: pgmap v156: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T05:55:27.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:27 smithi156 ceph-mon[121001]: pgmap v156: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T05:55:29.390 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:29 smithi155 ceph-mon[112451]: pgmap v157: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-12-16T05:55:29.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:29 smithi156 ceph-mon[121001]: pgmap v157: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2023-12-16T05:55:29.767 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:29.764+0000 7f3f2e7fc700 1 -- 172.21.15.155:0/3007810086 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f3f3810f470 con 0x7f3f24068f70 2023-12-16T05:55:29.767 INFO:teuthology.orchestra.run.smithi155.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T05:55:29.770 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:29.767+0000 7f3f4018d700 1 -- 172.21.15.155:0/3007810086 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f3f24068f70 msgr2=0x7f3f2406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:29.770 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:29.767+0000 7f3f4018d700 1 --2- 172.21.15.155:0/3007810086 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f3f24068f70 0x7f3f2406b420 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800b3b0 tx=0x7f3f28009e30 comp rx=0 tx=0).stop 2023-12-16T05:55:29.770 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:29.767+0000 7f3f4018d700 1 -- 172.21.15.155:0/3007810086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f380fd730 msgr2=0x7f3f3810d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:29.770 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:29.767+0000 7f3f4018d700 1 --2- 172.21.15.155:0/3007810086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f380fd730 0x7f3f3810d530 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3f34002a50 tx=0x7f3f340046b0 comp rx=0 tx=0).stop 2023-12-16T05:55:29.770 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:29.767+0000 7f3f4018d700 1 -- 172.21.15.155:0/3007810086 shutdown_connections 2023-12-16T05:55:29.770 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:29.767+0000 7f3f4018d700 1 --2- 172.21.15.155:0/3007810086 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f3f24068f70 0x7f3f2406b420 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:29.770 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:29.767+0000 7f3f4018d700 1 --2- 172.21.15.155:0/3007810086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f380fd730 0x7f3f3810d530 secure :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3f34002a50 tx=0x7f3f340046b0 comp rx=0 tx=0).stop 2023-12-16T05:55:29.770 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:29.767+0000 7f3f4018d700 1 --2- 172.21.15.155:0/3007810086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f38100050 0x7f3f3810da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:29.770 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:29.767+0000 7f3f4018d700 1 -- 172.21.15.155:0/3007810086 >> 172.21.15.155:0/3007810086 conn(0x7f3f380f7190 msgr2=0x7f3f380f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:55:29.770 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:29.767+0000 7f3f4018d700 1 -- 172.21.15.155:0/3007810086 shutdown_connections 2023-12-16T05:55:29.771 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:29.767+0000 7f3f4018d700 1 -- 172.21.15.155:0/3007810086 wait complete. 2023-12-16T05:55:30.168 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2023-12-16T05:55:30.567 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:55:31.033 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:30 smithi155 ceph-mon[112451]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T05:55:31.033 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:30 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:55:31.033 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:30 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:55:31.033 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:30 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:55:31.033 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:30 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:55:31.033 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:30 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:55:31.033 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:30 smithi155 ceph-mon[112451]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T05:55:31.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:30 smithi156 ceph-mon[121001]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T05:55:31.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:30 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:55:31.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:30 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:55:31.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:30 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:55:31.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:30 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:55:31.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:30 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:55:31.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:30 smithi156 ceph-mon[121001]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T05:55:32.033 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.030+0000 7f7de3be4700 1 -- 172.21.15.155:0/1925146469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ddc0fcd00 msgr2=0x7f7ddc0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:32.033 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.030+0000 7f7de3be4700 1 --2- 172.21.15.155:0/1925146469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ddc0fcd00 0x7f7ddc0fd150 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc004940 tx=0x7f7dcc009e30 comp rx=0 tx=0).stop 2023-12-16T05:55:32.033 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.030+0000 7f7de3be4700 1 -- 172.21.15.155:0/1925146469 shutdown_connections 2023-12-16T05:55:32.034 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.030+0000 7f7de3be4700 1 --2- 172.21.15.155:0/1925146469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ddc0fcd00 0x7f7ddc0fd150 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:32.034 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.030+0000 7f7de3be4700 1 --2- 172.21.15.155:0/1925146469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ddc0fbaf0 0x7f7ddc0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:32.034 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.030+0000 7f7de3be4700 1 -- 172.21.15.155:0/1925146469 >> 172.21.15.155:0/1925146469 conn(0x7f7ddc0f7190 msgr2=0x7f7ddc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:55:32.034 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.030+0000 7f7de3be4700 1 -- 172.21.15.155:0/1925146469 shutdown_connections 2023-12-16T05:55:32.034 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.030+0000 7f7de3be4700 1 -- 172.21.15.155:0/1925146469 wait complete. 2023-12-16T05:55:32.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.031+0000 7f7de3be4700 1 Processor -- start 2023-12-16T05:55:32.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.031+0000 7f7de3be4700 1 -- start start 2023-12-16T05:55:32.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.031+0000 7f7de3be4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ddc0fbaf0 0x7f7ddc10b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:55:32.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.031+0000 7f7de3be4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ddc0fcd00 0x7f7ddc10b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:55:32.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.031+0000 7f7de3be4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc10be30 con 0x7f7ddc0fcd00 2023-12-16T05:55:32.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.031+0000 7f7de3be4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc10f920 con 0x7f7ddc0fbaf0 2023-12-16T05:55:32.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.032+0000 7f7de1980700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ddc0fbaf0 0x7f7ddc10b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:55:32.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.032+0000 7f7de1980700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ddc0fbaf0 0x7f7ddc10b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.155:37454/0 (socket says 172.21.15.155:37454) 2023-12-16T05:55:32.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.032+0000 7f7de1980700 1 -- 172.21.15.155:0/3109005746 learned_addr learned my addr 172.21.15.155:0/3109005746 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:55:32.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.032+0000 7f7de117f700 1 --2- 172.21.15.155:0/3109005746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ddc0fcd00 0x7f7ddc10b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:55:32.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.032+0000 7f7de1980700 1 -- 172.21.15.155:0/3109005746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ddc0fcd00 msgr2=0x7f7ddc10b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:32.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.032+0000 7f7de1980700 1 --2- 172.21.15.155:0/3109005746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ddc0fcd00 0x7f7ddc10b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:32.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.032+0000 7f7de1980700 1 -- 172.21.15.155:0/3109005746 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc005040 con 0x7f7ddc0fbaf0 2023-12-16T05:55:32.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.032+0000 7f7de1980700 1 --2- 172.21.15.155:0/3109005746 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ddc0fbaf0 0x7f7ddc10b2a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800eb70 tx=0x7f7dd800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:55:32.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.032+0000 7f7dd27fc700 1 -- 172.21.15.155:0/3109005746 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dd8007cc0 con 0x7f7ddc0fbaf0 2023-12-16T05:55:32.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.032+0000 7f7dd27fc700 1 -- 172.21.15.155:0/3109005746 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7dd800f040 con 0x7f7ddc0fbaf0 2023-12-16T05:55:32.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.033+0000 7f7de3be4700 1 -- 172.21.15.155:0/3109005746 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ddc10fb20 con 0x7f7ddc0fbaf0 2023-12-16T05:55:32.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.033+0000 7f7dd27fc700 1 -- 172.21.15.155:0/3109005746 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dd800cad0 con 0x7f7ddc0fbaf0 2023-12-16T05:55:32.037 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.033+0000 7f7de3be4700 1 -- 172.21.15.155:0/3109005746 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ddc110030 con 0x7f7ddc0fbaf0 2023-12-16T05:55:32.037 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.034+0000 7f7de3be4700 1 -- 172.21.15.155:0/3109005746 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ddc04bb80 con 0x7f7ddc0fbaf0 2023-12-16T05:55:32.038 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.035+0000 7f7dd27fc700 1 -- 172.21.15.155:0/3109005746 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f7dd800cc30 con 0x7f7ddc0fbaf0 2023-12-16T05:55:32.038 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.035+0000 7f7dd27fc700 1 --2- 172.21.15.155:0/3109005746 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7dc8068f60 0x7f7dc806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:55:32.038 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.035+0000 7f7dd27fc700 1 -- 172.21.15.155:0/3109005746 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f7dd8086900 con 0x7f7ddc0fbaf0 2023-12-16T05:55:32.038 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.036+0000 7f7de117f700 1 --2- 172.21.15.155:0/3109005746 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7dc8068f60 0x7f7dc806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:55:32.039 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.036+0000 7f7de117f700 1 --2- 172.21.15.155:0/3109005746 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7dc8068f60 0x7f7dc806b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00b0d0 tx=0x7f7dcc009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:55:32.046 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.044+0000 7f7dd27fc700 1 -- 172.21.15.155:0/3109005746 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7dd804da00 con 0x7f7ddc0fbaf0 2023-12-16T05:55:32.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:31 smithi155 ceph-mon[112451]: pgmap v158: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2023-12-16T05:55:32.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:31 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:55:32.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:31 smithi156 ceph-mon[121001]: pgmap v158: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2023-12-16T05:55:32.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:31 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:55:32.315 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.312+0000 7f7de3be4700 1 -- 172.21.15.155:0/3109005746 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ddc10c6d0 con 0x7f7dc8068f60 2023-12-16T05:55:32.316 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.313+0000 7f7dd27fc700 1 -- 172.21.15.155:0/3109005746 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f7ddc10c6d0 con 0x7f7dc8068f60 2023-12-16T05:55:32.319 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.316+0000 7f7de3be4700 1 -- 172.21.15.155:0/3109005746 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7dc8068f60 msgr2=0x7f7dc806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:32.319 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.316+0000 7f7de3be4700 1 --2- 172.21.15.155:0/3109005746 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7dc8068f60 0x7f7dc806b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00b0d0 tx=0x7f7dcc009e30 comp rx=0 tx=0).stop 2023-12-16T05:55:32.319 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.316+0000 7f7de3be4700 1 -- 172.21.15.155:0/3109005746 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ddc0fbaf0 msgr2=0x7f7ddc10b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:32.319 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.316+0000 7f7de3be4700 1 --2- 172.21.15.155:0/3109005746 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ddc0fbaf0 0x7f7ddc10b2a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800eb70 tx=0x7f7dd800b040 comp rx=0 tx=0).stop 2023-12-16T05:55:32.319 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.317+0000 7f7de3be4700 1 -- 172.21.15.155:0/3109005746 shutdown_connections 2023-12-16T05:55:32.319 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.317+0000 7f7de3be4700 1 --2- 172.21.15.155:0/3109005746 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f7dc8068f60 0x7f7dc806b410 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:32.320 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.317+0000 7f7de3be4700 1 --2- 172.21.15.155:0/3109005746 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ddc0fbaf0 0x7f7ddc10b2a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:32.320 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.317+0000 7f7de3be4700 1 --2- 172.21.15.155:0/3109005746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ddc0fcd00 0x7f7ddc10b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:32.320 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.317+0000 7f7de3be4700 1 -- 172.21.15.155:0/3109005746 >> 172.21.15.155:0/3109005746 conn(0x7f7ddc0f7190 msgr2=0x7f7ddc0f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:55:32.320 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.318+0000 7f7de3be4700 1 -- 172.21.15.155:0/3109005746 shutdown_connections 2023-12-16T05:55:32.321 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.318+0000 7f7de3be4700 1 -- 172.21.15.155:0/3109005746 wait complete. 2023-12-16T05:55:32.336 INFO:teuthology.orchestra.run.smithi155.stdout:true 2023-12-16T05:55:32.450 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.447+0000 7f89b57f4700 1 -- 172.21.15.155:0/1215243830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89b00fd730 msgr2=0x7f89b00ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:32.450 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.447+0000 7f89b57f4700 1 --2- 172.21.15.155:0/1215243830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89b00fd730 0x7f89b00ffb10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f89a0004940 tx=0x7f89a0009e30 comp rx=0 tx=0).stop 2023-12-16T05:55:32.450 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.447+0000 7f89b57f4700 1 -- 172.21.15.155:0/1215243830 shutdown_connections 2023-12-16T05:55:32.450 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.447+0000 7f89b57f4700 1 --2- 172.21.15.155:0/1215243830 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89b0100050 0x7f89b0102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:32.450 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.447+0000 7f89b57f4700 1 --2- 172.21.15.155:0/1215243830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89b00fd730 0x7f89b00ffb10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:32.450 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.447+0000 7f89b57f4700 1 -- 172.21.15.155:0/1215243830 >> 172.21.15.155:0/1215243830 conn(0x7f89b00f7190 msgr2=0x7f89b00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:55:32.450 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.447+0000 7f89b57f4700 1 -- 172.21.15.155:0/1215243830 shutdown_connections 2023-12-16T05:55:32.450 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.447+0000 7f89b57f4700 1 -- 172.21.15.155:0/1215243830 wait complete. 2023-12-16T05:55:32.452 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.447+0000 7f89b57f4700 1 Processor -- start 2023-12-16T05:55:32.452 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.448+0000 7f89b57f4700 1 -- start start 2023-12-16T05:55:32.452 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.448+0000 7f89b57f4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89b00fd730 0x7f89b010d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:55:32.452 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.448+0000 7f89b57f4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89b0100050 0x7f89b010d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:55:32.452 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.448+0000 7f89b57f4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b010dfd0 con 0x7f89b00fd730 2023-12-16T05:55:32.452 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.448+0000 7f89b57f4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b010e870 con 0x7f89b0100050 2023-12-16T05:55:32.452 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.448+0000 7f89aeffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89b00fd730 0x7f89b010d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:55:32.452 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.448+0000 7f89aeffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89b00fd730 0x7f89b010d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52282/0 (socket says 172.21.15.155:52282) 2023-12-16T05:55:32.452 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.448+0000 7f89aeffd700 1 -- 172.21.15.155:0/1910845987 learned_addr learned my addr 172.21.15.155:0/1910845987 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:55:32.452 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.448+0000 7f89a7fff700 1 --2- 172.21.15.155:0/1910845987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89b0100050 0x7f89b010d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:55:32.452 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.448+0000 7f89aeffd700 1 -- 172.21.15.155:0/1910845987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89b0100050 msgr2=0x7f89b010d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:32.452 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.448+0000 7f89aeffd700 1 --2- 172.21.15.155:0/1910845987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89b0100050 0x7f89b010d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:32.453 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.448+0000 7f89aeffd700 1 -- 172.21.15.155:0/1910845987 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a0005040 con 0x7f89b00fd730 2023-12-16T05:55:32.453 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.448+0000 7f89a7fff700 1 --2- 172.21.15.155:0/1910845987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89b0100050 0x7f89b010d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T05:55:32.453 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.449+0000 7f89aeffd700 1 --2- 172.21.15.155:0/1910845987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89b00fd730 0x7f89b010d490 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f89a0009380 tx=0x7f89a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:55:32.453 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.449+0000 7f89a77fe700 1 -- 172.21.15.155:0/1910845987 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89a000e040 con 0x7f89b00fd730 2023-12-16T05:55:32.453 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.449+0000 7f89a77fe700 1 -- 172.21.15.155:0/1910845987 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f89a000bd20 con 0x7f89b00fd730 2023-12-16T05:55:32.453 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.449+0000 7f89b57f4700 1 -- 172.21.15.155:0/1910845987 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b010eaf0 con 0x7f89b00fd730 2023-12-16T05:55:32.453 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.449+0000 7f89b57f4700 1 -- 172.21.15.155:0/1910845987 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b010f030 con 0x7f89b00fd730 2023-12-16T05:55:32.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.449+0000 7f89a77fe700 1 -- 172.21.15.155:0/1910845987 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89a001c630 con 0x7f89b00fd730 2023-12-16T05:55:32.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.450+0000 7f89b57f4700 1 -- 172.21.15.155:0/1910845987 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b004bb80 con 0x7f89b00fd730 2023-12-16T05:55:32.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.451+0000 7f89a77fe700 1 -- 172.21.15.155:0/1910845987 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f89a0013420 con 0x7f89b00fd730 2023-12-16T05:55:32.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.451+0000 7f89a77fe700 1 --2- 172.21.15.155:0/1910845987 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f899c068f60 0x7f899c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:55:32.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.451+0000 7f89a77fe700 1 -- 172.21.15.155:0/1910845987 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f89a0088070 con 0x7f89b00fd730 2023-12-16T05:55:32.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.451+0000 7f89a7fff700 1 --2- 172.21.15.155:0/1910845987 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f899c068f60 0x7f899c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:55:32.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.452+0000 7f89a7fff700 1 --2- 172.21.15.155:0/1910845987 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f899c068f60 0x7f899c06b410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8998009fd0 tx=0x7f899800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:55:32.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.455+0000 7f89a77fe700 1 -- 172.21.15.155:0/1910845987 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f89a0058070 con 0x7f89b00fd730 2023-12-16T05:55:32.727 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.724+0000 7f89b57f4700 1 -- 172.21.15.155:0/1910845987 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f89b0100cb0 con 0x7f899c068f60 2023-12-16T05:55:32.728 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.725+0000 7f89a77fe700 1 -- 172.21.15.155:0/1910845987 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f89b0100cb0 con 0x7f899c068f60 2023-12-16T05:55:32.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.728+0000 7f89b57f4700 1 -- 172.21.15.155:0/1910845987 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f899c068f60 msgr2=0x7f899c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:32.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.728+0000 7f89b57f4700 1 --2- 172.21.15.155:0/1910845987 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f899c068f60 0x7f899c06b410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8998009fd0 tx=0x7f899800b040 comp rx=0 tx=0).stop 2023-12-16T05:55:32.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.728+0000 7f89b57f4700 1 -- 172.21.15.155:0/1910845987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89b00fd730 msgr2=0x7f89b010d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:32.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.728+0000 7f89b57f4700 1 --2- 172.21.15.155:0/1910845987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89b00fd730 0x7f89b010d490 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f89a0009380 tx=0x7f89a0009e30 comp rx=0 tx=0).stop 2023-12-16T05:55:32.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.728+0000 7f89b57f4700 1 -- 172.21.15.155:0/1910845987 shutdown_connections 2023-12-16T05:55:32.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.728+0000 7f89b57f4700 1 --2- 172.21.15.155:0/1910845987 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f899c068f60 0x7f899c06b410 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:32.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.728+0000 7f89b57f4700 1 --2- 172.21.15.155:0/1910845987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89b00fd730 0x7f89b010d490 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:32.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.728+0000 7f89b57f4700 1 --2- 172.21.15.155:0/1910845987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89b0100050 0x7f89b010d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:32.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.728+0000 7f89b57f4700 1 -- 172.21.15.155:0/1910845987 >> 172.21.15.155:0/1910845987 conn(0x7f89b00f7190 msgr2=0x7f89b00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:55:32.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.728+0000 7f89b57f4700 1 -- 172.21.15.155:0/1910845987 shutdown_connections 2023-12-16T05:55:32.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.728+0000 7f89b57f4700 1 -- 172.21.15.155:0/1910845987 wait complete. 2023-12-16T05:55:32.847 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.844+0000 7f45ceb68700 1 -- 172.21.15.155:0/2161021546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c80fcd00 msgr2=0x7f45c80fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:32.847 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.844+0000 7f45ceb68700 1 --2- 172.21.15.155:0/2161021546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c80fcd00 0x7f45c80fd150 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f45b4004940 tx=0x7f45b4009e30 comp rx=0 tx=0).stop 2023-12-16T05:55:32.848 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.845+0000 7f45ceb68700 1 -- 172.21.15.155:0/2161021546 shutdown_connections 2023-12-16T05:55:32.848 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.845+0000 7f45ceb68700 1 --2- 172.21.15.155:0/2161021546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c80fcd00 0x7f45c80fd150 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:32.848 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.845+0000 7f45ceb68700 1 --2- 172.21.15.155:0/2161021546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45c80fbaf0 0x7f45c80fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:32.848 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.845+0000 7f45ceb68700 1 -- 172.21.15.155:0/2161021546 >> 172.21.15.155:0/2161021546 conn(0x7f45c80f71d0 msgr2=0x7f45c80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:55:32.848 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.845+0000 7f45ceb68700 1 -- 172.21.15.155:0/2161021546 shutdown_connections 2023-12-16T05:55:32.849 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.845+0000 7f45ceb68700 1 -- 172.21.15.155:0/2161021546 wait complete. 2023-12-16T05:55:32.849 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.845+0000 7f45ceb68700 1 Processor -- start 2023-12-16T05:55:32.849 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.845+0000 7f45ceb68700 1 -- start start 2023-12-16T05:55:32.849 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.846+0000 7f45ceb68700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c80fbaf0 0x7f45c810d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:55:32.849 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.846+0000 7f45ceb68700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45c80fcd00 0x7f45c810da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:55:32.849 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.846+0000 7f45ceb68700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c810e000 con 0x7f45c80fbaf0 2023-12-16T05:55:32.849 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.846+0000 7f45ceb68700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c810e8a0 con 0x7f45c80fcd00 2023-12-16T05:55:32.849 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.846+0000 7f45c7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45c80fcd00 0x7f45c810da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:55:32.849 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.846+0000 7f45c7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45c80fcd00 0x7f45c810da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.155:37488/0 (socket says 172.21.15.155:37488) 2023-12-16T05:55:32.849 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.846+0000 7f45c7fff700 1 -- 172.21.15.155:0/2628692373 learned_addr learned my addr 172.21.15.155:0/2628692373 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:55:32.849 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.846+0000 7f45cc904700 1 --2- 172.21.15.155:0/2628692373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c80fbaf0 0x7f45c810d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:55:32.850 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.846+0000 7f45c7fff700 1 -- 172.21.15.155:0/2628692373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c80fbaf0 msgr2=0x7f45c810d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:32.850 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.846+0000 7f45c7fff700 1 --2- 172.21.15.155:0/2628692373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c80fbaf0 0x7f45c810d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:32.850 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.846+0000 7f45c7fff700 1 -- 172.21.15.155:0/2628692373 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b4005040 con 0x7f45c80fcd00 2023-12-16T05:55:32.850 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.847+0000 7f45c7fff700 1 --2- 172.21.15.155:0/2628692373 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45c80fcd00 0x7f45c810da00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f45b4000c00 tx=0x7f45b4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:55:32.850 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.847+0000 7f45c57fa700 1 -- 172.21.15.155:0/2628692373 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45b4021070 con 0x7f45c80fcd00 2023-12-16T05:55:32.851 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.847+0000 7f45ceb68700 1 -- 172.21.15.155:0/2628692373 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c810eb20 con 0x7f45c80fcd00 2023-12-16T05:55:32.851 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.847+0000 7f45c57fa700 1 -- 172.21.15.155:0/2628692373 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f45b401c400 con 0x7f45c80fcd00 2023-12-16T05:55:32.851 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.847+0000 7f45c57fa700 1 -- 172.21.15.155:0/2628692373 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45b400e070 con 0x7f45c80fcd00 2023-12-16T05:55:32.851 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.847+0000 7f45ceb68700 1 -- 172.21.15.155:0/2628692373 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c810f000 con 0x7f45c80fcd00 2023-12-16T05:55:32.851 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.848+0000 7f45ceb68700 1 -- 172.21.15.155:0/2628692373 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c804bb80 con 0x7f45c80fcd00 2023-12-16T05:55:32.851 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.849+0000 7f45c57fa700 1 -- 172.21.15.155:0/2628692373 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f45b4013a30 con 0x7f45c80fcd00 2023-12-16T05:55:32.852 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.849+0000 7f45c57fa700 1 --2- 172.21.15.155:0/2628692373 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f45b8068f60 0x7f45b806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:55:32.852 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.849+0000 7f45c57fa700 1 -- 172.21.15.155:0/2628692373 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f45b4088030 con 0x7f45c80fcd00 2023-12-16T05:55:32.852 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.850+0000 7f45cc904700 1 --2- 172.21.15.155:0/2628692373 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f45b8068f60 0x7f45b806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:55:32.853 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.850+0000 7f45cc904700 1 --2- 172.21.15.155:0/2628692373 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f45b8068f60 0x7f45b806b410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009b80 tx=0x7f45bc00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:55:32.860 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:32.857+0000 7f45c57fa700 1 -- 172.21.15.155:0/2628692373 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f45b40b9a00 con 0x7f45c80fcd00 2023-12-16T05:55:33.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.110+0000 7f45ceb68700 1 -- 172.21.15.155:0/2628692373 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f45c810f450 con 0x7f45b8068f60 2023-12-16T05:55:33.123 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.120+0000 7f45c57fa700 1 -- 172.21.15.155:0/2628692373 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f45c810f450 con 0x7f45b8068f60 2023-12-16T05:55:33.123 INFO:teuthology.orchestra.run.smithi155.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T05:55:33.123 INFO:teuthology.orchestra.run.smithi155.stdout:alertmanager.smithi155 smithi155 *:9093,9094 running (3m) 51s ago 4m 26.3M - 0.25.0 c8568f914cd2 59958a4f4cbd 2023-12-16T05:55:33.123 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi155 smithi155 running (4m) 51s ago 4m 7444k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 033f79f53811 2023-12-16T05:55:33.123 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi156 smithi156 running (4m) 54s ago 4m 7474k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 c72bd1a1d00a 2023-12-16T05:55:33.123 INFO:teuthology.orchestra.run.smithi155.stdout:grafana.smithi155 smithi155 *:3000 running (3m) 51s ago 4m 92.7M - 9.4.7 954c08fa6188 cb715f87b8c6 2023-12-16T05:55:33.123 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.bzsxjw smithi155 running (65s) 51s ago 65s 16.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6bcabf94a5c3 2023-12-16T05:55:33.123 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.vicpis smithi155 running (61s) 51s ago 61s 16.9M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 afa64e1ef8da 2023-12-16T05:55:33.123 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.fasing smithi156 running (60s) 54s ago 59s 14.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 7d97160bda7c 2023-12-16T05:55:33.124 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.qvgmfj smithi156 running (63s) 54s ago 63s 18.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4018b2f2e27e 2023-12-16T05:55:33.124 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi155.maowdn smithi155 *:9283 running (5m) 51s ago 5m 494M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 73b9fc45e71f 2023-12-16T05:55:33.124 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi156.pclong smithi156 *:8443,9283 running (4m) 54s ago 4m 438M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 39a878588040 2023-12-16T05:55:33.124 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi155 smithi155 running (5m) 51s ago 5m 77.4M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 0d0eecfde53b 2023-12-16T05:55:33.124 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi156 smithi156 running (4m) 54s ago 4m 57.6M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 4575acae9bdb 2023-12-16T05:55:33.124 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi155 smithi155 *:9100 running (4m) 51s ago 4m 15.9M - 1.5.0 0da6a335fe13 500b3e583f23 2023-12-16T05:55:33.124 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi156 smithi156 *:9100 running (4m) 54s ago 4m 18.9M - 1.5.0 0da6a335fe13 7e4371b6e840 2023-12-16T05:55:33.124 INFO:teuthology.orchestra.run.smithi155.stdout:osd.0 smithi155 running (3m) 51s ago 3m 56.3M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 91e650c277f7 2023-12-16T05:55:33.124 INFO:teuthology.orchestra.run.smithi155.stdout:osd.1 smithi155 running (3m) 51s ago 3m 59.8M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957303cb6598 2023-12-16T05:55:33.124 INFO:teuthology.orchestra.run.smithi155.stdout:osd.2 smithi155 running (2m) 51s ago 2m 54.7M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957a169c1cac 2023-12-16T05:55:33.124 INFO:teuthology.orchestra.run.smithi155.stdout:osd.3 smithi156 running (2m) 54s ago 2m 55.0M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c4f6c54afe99 2023-12-16T05:55:33.124 INFO:teuthology.orchestra.run.smithi155.stdout:osd.4 smithi156 running (2m) 54s ago 2m 49.2M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 6309b12204fd 2023-12-16T05:55:33.124 INFO:teuthology.orchestra.run.smithi155.stdout:osd.5 smithi156 running (118s) 54s ago 118s 50.2M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 84b2c33eb0e1 2023-12-16T05:55:33.124 INFO:teuthology.orchestra.run.smithi155.stdout:prometheus.smithi155 smithi155 *:9095 running (3m) 51s ago 4m 42.5M - 2.43.0 a07b618ecd1d 75cfe8962fd8 2023-12-16T05:55:33.126 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.123+0000 7f45ceb68700 1 -- 172.21.15.155:0/2628692373 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f45b8068f60 msgr2=0x7f45b806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:33.126 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.123+0000 7f45ceb68700 1 --2- 172.21.15.155:0/2628692373 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f45b8068f60 0x7f45b806b410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009b80 tx=0x7f45bc00b040 comp rx=0 tx=0).stop 2023-12-16T05:55:33.126 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.123+0000 7f45ceb68700 1 -- 172.21.15.155:0/2628692373 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45c80fcd00 msgr2=0x7f45c810da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:33.126 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.123+0000 7f45ceb68700 1 --2- 172.21.15.155:0/2628692373 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45c80fcd00 0x7f45c810da00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f45b4000c00 tx=0x7f45b4009e30 comp rx=0 tx=0).stop 2023-12-16T05:55:33.126 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.123+0000 7f45ceb68700 1 -- 172.21.15.155:0/2628692373 shutdown_connections 2023-12-16T05:55:33.126 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.123+0000 7f45ceb68700 1 --2- 172.21.15.155:0/2628692373 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f45b8068f60 0x7f45b806b410 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:33.126 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.123+0000 7f45ceb68700 1 --2- 172.21.15.155:0/2628692373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c80fbaf0 0x7f45c810d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:33.126 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.123+0000 7f45ceb68700 1 --2- 172.21.15.155:0/2628692373 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45c80fcd00 0x7f45c810da00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:33.126 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.123+0000 7f45ceb68700 1 -- 172.21.15.155:0/2628692373 >> 172.21.15.155:0/2628692373 conn(0x7f45c80f71d0 msgr2=0x7f45c80fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:55:33.126 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.123+0000 7f45ceb68700 1 -- 172.21.15.155:0/2628692373 shutdown_connections 2023-12-16T05:55:33.126 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.123+0000 7f45ceb68700 1 -- 172.21.15.155:0/2628692373 wait complete. 2023-12-16T05:55:33.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:55:33.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:32 smithi156 ceph-mon[121001]: Upgrade: Target is version 19.0.0-191-g6d933094 (unknown) 2023-12-16T05:55:33.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:32 smithi156 ceph-mon[121001]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17'] 2023-12-16T05:55:33.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:55:33.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:32 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:55:33.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:32 smithi156 ceph-mon[121001]: Upgrade: Need to upgrade myself (mgr.smithi155.maowdn) 2023-12-16T05:55:33.239 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.236+0000 7f8d4a780700 1 -- 172.21.15.155:0/3374310412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d440fbaf0 msgr2=0x7f8d440fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:33.239 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.236+0000 7f8d4a780700 1 --2- 172.21.15.155:0/3374310412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d440fbaf0 0x7f8d440fbf00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8d34004940 tx=0x7f8d34009e30 comp rx=0 tx=0).stop 2023-12-16T05:55:33.239 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.236+0000 7f8d4a780700 1 -- 172.21.15.155:0/3374310412 shutdown_connections 2023-12-16T05:55:33.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.236+0000 7f8d4a780700 1 --2- 172.21.15.155:0/3374310412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d440fcd00 0x7f8d440fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:33.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.236+0000 7f8d4a780700 1 --2- 172.21.15.155:0/3374310412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d440fbaf0 0x7f8d440fbf00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:33.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.236+0000 7f8d4a780700 1 -- 172.21.15.155:0/3374310412 >> 172.21.15.155:0/3374310412 conn(0x7f8d440f7190 msgr2=0x7f8d440f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:55:33.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.236+0000 7f8d4a780700 1 -- 172.21.15.155:0/3374310412 shutdown_connections 2023-12-16T05:55:33.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.236+0000 7f8d4a780700 1 -- 172.21.15.155:0/3374310412 wait complete. 2023-12-16T05:55:33.241 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.237+0000 7f8d4a780700 1 Processor -- start 2023-12-16T05:55:33.241 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.237+0000 7f8d4a780700 1 -- start start 2023-12-16T05:55:33.241 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.237+0000 7f8d4a780700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d440fbaf0 0x7f8d44110210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:55:33.241 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.238+0000 7f8d4a780700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d440fcd00 0x7f8d44112760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:55:33.241 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.238+0000 7f8d4a780700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d44066110 con 0x7f8d440fcd00 2023-12-16T05:55:33.241 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.238+0000 7f8d4a780700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d44066250 con 0x7f8d440fbaf0 2023-12-16T05:55:33.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.238+0000 7f8d43fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d440fbaf0 0x7f8d44110210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:55:33.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.238+0000 7f8d437fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d440fcd00 0x7f8d44112760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:55:33.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.238+0000 7f8d43fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d440fbaf0 0x7f8d44110210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.155:37502/0 (socket says 172.21.15.155:37502) 2023-12-16T05:55:33.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.238+0000 7f8d43fff700 1 -- 172.21.15.155:0/2965352748 learned_addr learned my addr 172.21.15.155:0/2965352748 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:55:33.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.238+0000 7f8d437fe700 1 -- 172.21.15.155:0/2965352748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d440fbaf0 msgr2=0x7f8d44110210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:33.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.238+0000 7f8d437fe700 1 --2- 172.21.15.155:0/2965352748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d440fbaf0 0x7f8d44110210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:33.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.238+0000 7f8d437fe700 1 -- 172.21.15.155:0/2965352748 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d34005040 con 0x7f8d440fcd00 2023-12-16T05:55:33.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.238+0000 7f8d437fe700 1 --2- 172.21.15.155:0/2965352748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d440fcd00 0x7f8d44112760 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8d38009fd0 tx=0x7f8d3800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:55:33.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.238+0000 7f8d40ff9700 1 -- 172.21.15.155:0/2965352748 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d38015070 con 0x7f8d440fcd00 2023-12-16T05:55:33.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.239+0000 7f8d4a780700 1 -- 172.21.15.155:0/2965352748 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4410c050 con 0x7f8d440fcd00 2023-12-16T05:55:33.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.239+0000 7f8d4a780700 1 -- 172.21.15.155:0/2965352748 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4410c590 con 0x7f8d440fcd00 2023-12-16T05:55:33.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.239+0000 7f8d40ff9700 1 -- 172.21.15.155:0/2965352748 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8d3800bde0 con 0x7f8d440fcd00 2023-12-16T05:55:33.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.239+0000 7f8d40ff9700 1 -- 172.21.15.155:0/2965352748 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d3801b470 con 0x7f8d440fcd00 2023-12-16T05:55:33.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.240+0000 7f8d4a780700 1 -- 172.21.15.155:0/2965352748 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4404bb80 con 0x7f8d440fcd00 2023-12-16T05:55:33.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.241+0000 7f8d40ff9700 1 -- 172.21.15.155:0/2965352748 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f8d3801b6a0 con 0x7f8d440fcd00 2023-12-16T05:55:33.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.241+0000 7f8d40ff9700 1 --2- 172.21.15.155:0/2965352748 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8d2c068f60 0x7f8d2c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:55:33.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.241+0000 7f8d40ff9700 1 -- 172.21.15.155:0/2965352748 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8d3808b210 con 0x7f8d440fcd00 2023-12-16T05:55:33.245 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.243+0000 7f8d43fff700 1 --2- 172.21.15.155:0/2965352748 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8d2c068f60 0x7f8d2c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:55:33.246 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.243+0000 7f8d43fff700 1 --2- 172.21.15.155:0/2965352748 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8d2c068f60 0x7f8d2c06b410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8d34013600 tx=0x7f8d34009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:55:33.249 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.246+0000 7f8d40ff9700 1 -- 172.21.15.155:0/2965352748 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8d38058480 con 0x7f8d440fcd00 2023-12-16T05:55:33.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:32 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:55:33.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:32 smithi155 ceph-mon[112451]: Upgrade: Target is version 19.0.0-191-g6d933094 (unknown) 2023-12-16T05:55:33.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:32 smithi155 ceph-mon[112451]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17'] 2023-12-16T05:55:33.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:32 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:55:33.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:32 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:55:33.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:32 smithi155 ceph-mon[112451]: Upgrade: Need to upgrade myself (mgr.smithi155.maowdn) 2023-12-16T05:55:33.527 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.524+0000 7f8d4a780700 1 -- 172.21.15.155:0/2965352748 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8d4410cc50 con 0x7f8d440fcd00 2023-12-16T05:55:33.527 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.525+0000 7f8d40ff9700 1 -- 172.21.15.155:0/2965352748 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f8d3805baa0 con 0x7f8d440fcd00 2023-12-16T05:55:33.527 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T05:55:33.527 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": { 2023-12-16T05:55:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T05:55:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:55:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": { 2023-12-16T05:55:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T05:55:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:55:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": { 2023-12-16T05:55:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T05:55:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:55:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2023-12-16T05:55:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T05:55:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:55:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: "overall": { 2023-12-16T05:55:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 14 2023-12-16T05:55:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-12-16T05:55:33.528 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T05:55:33.530 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.527+0000 7f8d4a780700 1 -- 172.21.15.155:0/2965352748 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8d2c068f60 msgr2=0x7f8d2c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:33.531 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.527+0000 7f8d4a780700 1 --2- 172.21.15.155:0/2965352748 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8d2c068f60 0x7f8d2c06b410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8d34013600 tx=0x7f8d34009e30 comp rx=0 tx=0).stop 2023-12-16T05:55:33.531 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.527+0000 7f8d4a780700 1 -- 172.21.15.155:0/2965352748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d440fcd00 msgr2=0x7f8d44112760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:33.531 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.527+0000 7f8d4a780700 1 --2- 172.21.15.155:0/2965352748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d440fcd00 0x7f8d44112760 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8d38009fd0 tx=0x7f8d3800b040 comp rx=0 tx=0).stop 2023-12-16T05:55:33.531 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.527+0000 7f8d4a780700 1 -- 172.21.15.155:0/2965352748 shutdown_connections 2023-12-16T05:55:33.531 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.527+0000 7f8d4a780700 1 --2- 172.21.15.155:0/2965352748 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8d2c068f60 0x7f8d2c06b410 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:33.531 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.527+0000 7f8d4a780700 1 --2- 172.21.15.155:0/2965352748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d440fbaf0 0x7f8d44110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:33.531 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.527+0000 7f8d4a780700 1 --2- 172.21.15.155:0/2965352748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d440fcd00 0x7f8d44112760 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:33.531 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.527+0000 7f8d4a780700 1 -- 172.21.15.155:0/2965352748 >> 172.21.15.155:0/2965352748 conn(0x7f8d440f7190 msgr2=0x7f8d440fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:55:33.531 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.528+0000 7f8d4a780700 1 -- 172.21.15.155:0/2965352748 shutdown_connections 2023-12-16T05:55:33.531 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.528+0000 7f8d4a780700 1 -- 172.21.15.155:0/2965352748 wait complete. 2023-12-16T05:55:33.692 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.688+0000 7f2db44dc700 1 -- 172.21.15.155:0/2177734444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dac0fcd10 msgr2=0x7f2dac0fd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:33.692 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.688+0000 7f2db44dc700 1 --2- 172.21.15.155:0/2177734444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dac0fcd10 0x7f2dac0fd160 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c004940 tx=0x7f2d9c009e30 comp rx=0 tx=0).stop 2023-12-16T05:55:33.692 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.689+0000 7f2db44dc700 1 -- 172.21.15.155:0/2177734444 shutdown_connections 2023-12-16T05:55:33.692 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.689+0000 7f2db44dc700 1 --2- 172.21.15.155:0/2177734444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dac0fcd10 0x7f2dac0fd160 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:33.692 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.689+0000 7f2db44dc700 1 --2- 172.21.15.155:0/2177734444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2dac0fbb00 0x7f2dac0fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:33.692 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.689+0000 7f2db44dc700 1 -- 172.21.15.155:0/2177734444 >> 172.21.15.155:0/2177734444 conn(0x7f2dac0f71c0 msgr2=0x7f2dac0f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:55:33.692 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.689+0000 7f2db44dc700 1 -- 172.21.15.155:0/2177734444 shutdown_connections 2023-12-16T05:55:33.692 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.689+0000 7f2db44dc700 1 -- 172.21.15.155:0/2177734444 wait complete. 2023-12-16T05:55:33.693 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.689+0000 7f2db44dc700 1 Processor -- start 2023-12-16T05:55:33.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.689+0000 7f2db44dc700 1 -- start start 2023-12-16T05:55:33.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.690+0000 7f2db44dc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dac0fbb00 0x7f2dac10d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:55:33.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.690+0000 7f2db44dc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2dac0fcd10 0x7f2dac10d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:55:33.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.690+0000 7f2db44dc700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac10dfc0 con 0x7f2dac0fbb00 2023-12-16T05:55:33.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.690+0000 7f2db44dc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac10e860 con 0x7f2dac0fcd10 2023-12-16T05:55:33.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.690+0000 7f2db2278700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dac0fbb00 0x7f2dac10d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:55:33.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.690+0000 7f2db2278700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dac0fbb00 0x7f2dac10d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52330/0 (socket says 172.21.15.155:52330) 2023-12-16T05:55:33.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.690+0000 7f2db2278700 1 -- 172.21.15.155:0/1889273896 learned_addr learned my addr 172.21.15.155:0/1889273896 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:55:33.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.690+0000 7f2db1a77700 1 --2- 172.21.15.155:0/1889273896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2dac0fcd10 0x7f2dac10d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:55:33.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.690+0000 7f2db2278700 1 -- 172.21.15.155:0/1889273896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2dac0fcd10 msgr2=0x7f2dac10d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:33.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.690+0000 7f2db2278700 1 --2- 172.21.15.155:0/1889273896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2dac0fcd10 0x7f2dac10d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:33.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.690+0000 7f2db2278700 1 -- 172.21.15.155:0/1889273896 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9c005040 con 0x7f2dac0fbb00 2023-12-16T05:55:33.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.690+0000 7f2db2278700 1 --2- 172.21.15.155:0/1889273896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dac0fbb00 0x7f2dac10d480 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2da800eb70 tx=0x7f2da800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:55:33.695 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.691+0000 7f2da2ffd700 1 -- 172.21.15.155:0/1889273896 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2da8007cc0 con 0x7f2dac0fbb00 2023-12-16T05:55:33.695 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.691+0000 7f2da2ffd700 1 -- 172.21.15.155:0/1889273896 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2da800f040 con 0x7f2dac0fbb00 2023-12-16T05:55:33.695 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.691+0000 7f2db44dc700 1 -- 172.21.15.155:0/1889273896 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dac10eae0 con 0x7f2dac0fbb00 2023-12-16T05:55:33.695 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.691+0000 7f2da2ffd700 1 -- 172.21.15.155:0/1889273896 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2da800cad0 con 0x7f2dac0fbb00 2023-12-16T05:55:33.695 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.691+0000 7f2db44dc700 1 -- 172.21.15.155:0/1889273896 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dac10f020 con 0x7f2dac0fbb00 2023-12-16T05:55:33.695 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.692+0000 7f2db44dc700 1 -- 172.21.15.155:0/1889273896 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dac04bb80 con 0x7f2dac0fbb00 2023-12-16T05:55:33.695 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.693+0000 7f2da2ffd700 1 -- 172.21.15.155:0/1889273896 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f2da800cc30 con 0x7f2dac0fbb00 2023-12-16T05:55:33.696 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.693+0000 7f2da2ffd700 1 --2- 172.21.15.155:0/1889273896 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2d98068f70 0x7f2d9806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:55:33.696 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.693+0000 7f2da2ffd700 1 -- 172.21.15.155:0/1889273896 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2da80867e0 con 0x7f2dac0fbb00 2023-12-16T05:55:33.700 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.697+0000 7f2db1a77700 1 --2- 172.21.15.155:0/1889273896 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2d98068f70 0x7f2d9806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:55:33.700 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.698+0000 7f2db1a77700 1 --2- 172.21.15.155:0/1889273896 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2d98068f70 0x7f2d9806b420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00b0d0 tx=0x7f2d9c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:55:33.704 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:33.702+0000 7f2da2ffd700 1 -- 172.21.15.155:0/1889273896 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2da804da00 con 0x7f2dac0fbb00 2023-12-16T05:55:34.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:34.032+0000 7f2db44dc700 1 -- 172.21.15.155:0/1889273896 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2dac101660 con 0x7f2d98068f70 2023-12-16T05:55:34.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:34.034+0000 7f2da2ffd700 1 -- 172.21.15.155:0/1889273896 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f2dac101660 con 0x7f2d98068f70 2023-12-16T05:55:34.037 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T05:55:34.037 INFO:teuthology.orchestra.run.smithi155.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T05:55:34.037 INFO:teuthology.orchestra.run.smithi155.stdout: "in_progress": true, 2023-12-16T05:55:34.037 INFO:teuthology.orchestra.run.smithi155.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T05:55:34.037 INFO:teuthology.orchestra.run.smithi155.stdout: "services_complete": [], 2023-12-16T05:55:34.037 INFO:teuthology.orchestra.run.smithi155.stdout: "progress": "0/2 daemons upgraded", 2023-12-16T05:55:34.037 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17 image on host smithi156", 2023-12-16T05:55:34.037 INFO:teuthology.orchestra.run.smithi155.stdout: "is_paused": false 2023-12-16T05:55:34.037 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T05:55:34.040 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:34.037+0000 7f2db44dc700 1 -- 172.21.15.155:0/1889273896 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2d98068f70 msgr2=0x7f2d9806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:34.040 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:34.037+0000 7f2db44dc700 1 --2- 172.21.15.155:0/1889273896 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2d98068f70 0x7f2d9806b420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00b0d0 tx=0x7f2d9c009e30 comp rx=0 tx=0).stop 2023-12-16T05:55:34.040 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:34.037+0000 7f2db44dc700 1 -- 172.21.15.155:0/1889273896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dac0fbb00 msgr2=0x7f2dac10d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:55:34.040 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:34.037+0000 7f2db44dc700 1 --2- 172.21.15.155:0/1889273896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dac0fbb00 0x7f2dac10d480 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2da800eb70 tx=0x7f2da800b040 comp rx=0 tx=0).stop 2023-12-16T05:55:34.040 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:34.037+0000 7f2db44dc700 1 -- 172.21.15.155:0/1889273896 shutdown_connections 2023-12-16T05:55:34.040 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:34.037+0000 7f2db44dc700 1 --2- 172.21.15.155:0/1889273896 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f2d98068f70 0x7f2d9806b420 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:34.040 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:34.037+0000 7f2db44dc700 1 --2- 172.21.15.155:0/1889273896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dac0fbb00 0x7f2dac10d480 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:34.040 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:34.037+0000 7f2db44dc700 1 --2- 172.21.15.155:0/1889273896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2dac0fcd10 0x7f2dac10d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:55:34.040 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:34.037+0000 7f2db44dc700 1 -- 172.21.15.155:0/1889273896 >> 172.21.15.155:0/1889273896 conn(0x7f2dac0f71c0 msgr2=0x7f2dac0fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:55:34.041 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:34.037+0000 7f2db44dc700 1 -- 172.21.15.155:0/1889273896 shutdown_connections 2023-12-16T05:55:34.041 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:55:34.037+0000 7f2db44dc700 1 -- 172.21.15.155:0/1889273896 wait complete. 2023-12-16T05:55:34.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:33 smithi156 ceph-mon[121001]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17 on smithi156 2023-12-16T05:55:34.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:33 smithi156 ceph-mon[121001]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:55:34.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:33 smithi156 ceph-mon[121001]: pgmap v159: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-16T05:55:34.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:33 smithi156 ceph-mon[121001]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:55:34.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:33 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/2965352748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:55:34.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:33 smithi155 ceph-mon[112451]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17 on smithi156 2023-12-16T05:55:34.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:33 smithi155 ceph-mon[112451]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:55:34.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:33 smithi155 ceph-mon[112451]: pgmap v159: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-16T05:55:34.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:33 smithi155 ceph-mon[112451]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:55:34.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:33 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2965352748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:55:35.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:34 smithi156 ceph-mon[121001]: from='client.24351 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:55:35.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:34 smithi156 ceph-mon[121001]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:55:35.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:34 smithi155 ceph-mon[112451]: from='client.24351 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:55:35.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:34 smithi155 ceph-mon[112451]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:55:36.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:35 smithi156 ceph-mon[121001]: pgmap v160: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2023-12-16T05:55:36.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:35 smithi155 ceph-mon[112451]: pgmap v160: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2023-12-16T05:55:38.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:37 smithi155 ceph-mon[112451]: pgmap v161: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2023-12-16T05:55:38.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:37 smithi156 ceph-mon[121001]: pgmap v161: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2023-12-16T05:55:39.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:39 smithi156 ceph-mon[121001]: pgmap v162: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2023-12-16T05:55:39.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:39 smithi155 ceph-mon[112451]: pgmap v162: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2023-12-16T05:55:41.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:41 smithi155 ceph-mon[112451]: pgmap v163: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2023-12-16T05:55:41.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:41 smithi156 ceph-mon[121001]: pgmap v163: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2023-12-16T05:55:43.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:43 smithi155 ceph-mon[112451]: pgmap v164: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-16T05:55:43.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:43 smithi156 ceph-mon[121001]: pgmap v164: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-16T05:55:44.859 INFO:tasks.workunit.client.0.smithi155.stderr:Note: switching to '6d933094a156ec7587742e5aa25fba5ba27ec678'. 2023-12-16T05:55:44.860 INFO:tasks.workunit.client.0.smithi155.stderr: 2023-12-16T05:55:44.860 INFO:tasks.workunit.client.0.smithi155.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-16T05:55:44.860 INFO:tasks.workunit.client.0.smithi155.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-16T05:55:44.860 INFO:tasks.workunit.client.0.smithi155.stderr:state without impacting any branches by switching back to a branch. 2023-12-16T05:55:44.860 INFO:tasks.workunit.client.0.smithi155.stderr: 2023-12-16T05:55:44.860 INFO:tasks.workunit.client.0.smithi155.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-16T05:55:44.860 INFO:tasks.workunit.client.0.smithi155.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-16T05:55:44.860 INFO:tasks.workunit.client.0.smithi155.stderr: 2023-12-16T05:55:44.860 INFO:tasks.workunit.client.0.smithi155.stderr: git switch -c 2023-12-16T05:55:44.860 INFO:tasks.workunit.client.0.smithi155.stderr: 2023-12-16T05:55:44.860 INFO:tasks.workunit.client.0.smithi155.stderr:Or undo this operation with: 2023-12-16T05:55:44.860 INFO:tasks.workunit.client.0.smithi155.stderr: 2023-12-16T05:55:44.860 INFO:tasks.workunit.client.0.smithi155.stderr: git switch - 2023-12-16T05:55:44.860 INFO:tasks.workunit.client.0.smithi155.stderr: 2023-12-16T05:55:44.861 INFO:tasks.workunit.client.0.smithi155.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-16T05:55:44.861 INFO:tasks.workunit.client.0.smithi155.stderr: 2023-12-16T05:55:44.861 INFO:tasks.workunit.client.0.smithi155.stderr:HEAD is now at 6d933094a15 Merge PR #52196 into main 2023-12-16T05:55:44.865 DEBUG:teuthology.orchestra.run.smithi155:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-16T05:55:44.899 INFO:tasks.workunit.client.0.smithi155.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-16T05:55:44.901 INFO:tasks.workunit.client.0.smithi155.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-16T05:55:44.901 INFO:tasks.workunit.client.0.smithi155.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-16T05:55:45.436 INFO:tasks.workunit.client.0.smithi155.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-16T05:55:45.490 INFO:tasks.workunit.client.0.smithi155.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-16T05:55:45.526 INFO:tasks.workunit.client.0.smithi155.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-16T05:55:45.528 INFO:tasks.workunit.client.0.smithi155.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-16T05:55:45.528 INFO:tasks.workunit.client.0.smithi155.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-16T05:55:45.564 INFO:tasks.workunit.client.0.smithi155.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-16T05:55:45.568 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-16T05:55:45.568 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-16T05:55:45.625 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2023-12-16T05:55:45.627 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-16T05:55:45.627 DEBUG:teuthology.orchestra.run.smithi155:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6d933094a156ec7587742e5aa25fba5ba27ec678 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2023-12-16T05:55:45.689 INFO:tasks.workunit.client.0.smithi155.stderr:+ mkdir -p fsstress 2023-12-16T05:55:45.690 INFO:tasks.workunit.client.0.smithi155.stderr:+ pushd fsstress 2023-12-16T05:55:45.690 INFO:tasks.workunit.client.0.smithi155.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-16T05:55:45.691 INFO:tasks.workunit.client.0.smithi155.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-16T05:55:45.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:45 smithi155 ceph-mon[112451]: pgmap v165: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 4 op/s 2023-12-16T05:55:45.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:45 smithi156 ceph-mon[121001]: pgmap v165: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 4 op/s 2023-12-16T05:55:46.223 INFO:tasks.workunit.client.0.smithi155.stderr:+ tar xzf ltp-full.tgz 2023-12-16T05:55:46.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:46 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:55:46.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:46 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:55:47.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:47 smithi155 ceph-mon[112451]: pgmap v166: 65 pgs: 65 active+clean; 598 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.9 KiB/s rd, 1023 B/s wr, 4 op/s 2023-12-16T05:55:47.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:47 smithi156 ceph-mon[121001]: pgmap v166: 65 pgs: 65 active+clean; 598 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.9 KiB/s rd, 1023 B/s wr, 4 op/s 2023-12-16T05:55:49.487 INFO:tasks.workunit.client.1.smithi156.stderr:Updating files: 93% (10828/11620) Updating files: 94% (10923/11620) Updating files: 95% (11039/11620) Updating files: 96% (11156/11620) Updating files: 97% (11272/11620) Updating files: 98% (11388/11620) Updating files: 99% (11504/11620) Updating files: 100% (11620/11620) Updating files: 100% (11620/11620), done. 2023-12-16T05:55:49.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:49 smithi156 ceph-mon[121001]: pgmap v167: 65 pgs: 65 active+clean; 598 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.9 KiB/s rd, 1023 B/s wr, 4 op/s 2023-12-16T05:55:49.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:49 smithi155 ceph-mon[112451]: pgmap v167: 65 pgs: 65 active+clean; 598 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.9 KiB/s rd, 1023 B/s wr, 4 op/s 2023-12-16T05:55:50.298 INFO:tasks.workunit.client.1.smithi156.stderr:Note: switching to '6d933094a156ec7587742e5aa25fba5ba27ec678'. 2023-12-16T05:55:50.298 INFO:tasks.workunit.client.1.smithi156.stderr: 2023-12-16T05:55:50.298 INFO:tasks.workunit.client.1.smithi156.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-16T05:55:50.298 INFO:tasks.workunit.client.1.smithi156.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-16T05:55:50.299 INFO:tasks.workunit.client.1.smithi156.stderr:state without impacting any branches by switching back to a branch. 2023-12-16T05:55:50.299 INFO:tasks.workunit.client.1.smithi156.stderr: 2023-12-16T05:55:50.299 INFO:tasks.workunit.client.1.smithi156.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-16T05:55:50.299 INFO:tasks.workunit.client.1.smithi156.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-16T05:55:50.299 INFO:tasks.workunit.client.1.smithi156.stderr: 2023-12-16T05:55:50.299 INFO:tasks.workunit.client.1.smithi156.stderr: git switch -c 2023-12-16T05:55:50.299 INFO:tasks.workunit.client.1.smithi156.stderr: 2023-12-16T05:55:50.299 INFO:tasks.workunit.client.1.smithi156.stderr:Or undo this operation with: 2023-12-16T05:55:50.299 INFO:tasks.workunit.client.1.smithi156.stderr: 2023-12-16T05:55:50.299 INFO:tasks.workunit.client.1.smithi156.stderr: git switch - 2023-12-16T05:55:50.299 INFO:tasks.workunit.client.1.smithi156.stderr: 2023-12-16T05:55:50.299 INFO:tasks.workunit.client.1.smithi156.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-16T05:55:50.299 INFO:tasks.workunit.client.1.smithi156.stderr: 2023-12-16T05:55:50.299 INFO:tasks.workunit.client.1.smithi156.stderr:HEAD is now at 6d933094a15 Merge PR #52196 into main 2023-12-16T05:55:50.303 DEBUG:teuthology.orchestra.run.smithi156:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2023-12-16T05:55:50.369 INFO:tasks.workunit.client.1.smithi156.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-16T05:55:50.371 INFO:tasks.workunit.client.1.smithi156.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-16T05:55:50.371 INFO:tasks.workunit.client.1.smithi156.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-16T05:55:50.911 INFO:tasks.workunit.client.1.smithi156.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-16T05:55:50.973 INFO:tasks.workunit.client.1.smithi156.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-16T05:55:51.011 INFO:tasks.workunit.client.1.smithi156.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-16T05:55:51.013 INFO:tasks.workunit.client.1.smithi156.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-16T05:55:51.013 INFO:tasks.workunit.client.1.smithi156.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-16T05:55:51.051 INFO:tasks.workunit.client.1.smithi156.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-16T05:55:51.054 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-12-16T05:55:51.054 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2023-12-16T05:55:51.112 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2023-12-16T05:55:51.113 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-16T05:55:51.113 DEBUG:teuthology.orchestra.run.smithi156:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6d933094a156ec7587742e5aa25fba5ba27ec678 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2023-12-16T05:55:51.175 INFO:tasks.workunit.client.1.smithi156.stderr:+ mkdir -p fsstress 2023-12-16T05:55:51.177 INFO:tasks.workunit.client.1.smithi156.stderr:+ pushd fsstress 2023-12-16T05:55:51.177 INFO:tasks.workunit.client.1.smithi156.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-16T05:55:51.177 INFO:tasks.workunit.client.1.smithi156.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-16T05:55:51.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:51 smithi155 ceph-mon[112451]: pgmap v168: 65 pgs: 65 active+clean; 2.7 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 191 KiB/s wr, 4 op/s 2023-12-16T05:55:51.937 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:51 smithi156 ceph-mon[121001]: pgmap v168: 65 pgs: 65 active+clean; 2.7 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 191 KiB/s wr, 4 op/s 2023-12-16T05:55:52.561 INFO:tasks.workunit.client.1.smithi156.stderr:+ tar xzf ltp-full.tgz 2023-12-16T05:55:53.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:53 smithi155 ceph-mon[112451]: pgmap v169: 65 pgs: 65 active+clean; 20 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 479 KiB/s rd, 1.7 MiB/s wr, 118 op/s 2023-12-16T05:55:53.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:53 smithi156 ceph-mon[121001]: pgmap v169: 65 pgs: 65 active+clean; 20 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 479 KiB/s rd, 1.7 MiB/s wr, 118 op/s 2023-12-16T05:55:54.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:54 smithi155 ceph-mon[112451]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby-replay 2023-12-16T05:55:54.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:54 smithi156 ceph-mon[121001]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby-replay 2023-12-16T05:55:55.829 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:55 smithi155 ceph-mon[112451]: pgmap v170: 65 pgs: 65 active+clean; 43 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 3.8 MiB/s wr, 381 op/s 2023-12-16T05:55:55.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:55 smithi156 ceph-mon[121001]: pgmap v170: 65 pgs: 65 active+clean; 43 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 3.8 MiB/s wr, 381 op/s 2023-12-16T05:55:57.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:57 smithi155 ceph-mon[112451]: pgmap v171: 65 pgs: 65 active+clean; 56 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.9 MiB/s wr, 471 op/s 2023-12-16T05:55:57.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:57 smithi156 ceph-mon[121001]: pgmap v171: 65 pgs: 65 active+clean; 56 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.9 MiB/s wr, 471 op/s 2023-12-16T05:55:59.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:59 smithi156 ceph-mon[121001]: pgmap v172: 65 pgs: 65 active+clean; 61 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 5.3 MiB/s wr, 499 op/s 2023-12-16T05:55:59.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:59 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:55:59.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:59 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.pclong", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T05:55:59.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:59 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T05:55:59.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:55:59 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:55:59.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:59 smithi155 ceph-mon[112451]: pgmap v172: 65 pgs: 65 active+clean; 61 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 5.3 MiB/s wr, 499 op/s 2023-12-16T05:55:59.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:59 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:55:59.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:59 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.pclong", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T05:55:59.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:59 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T05:55:59.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:55:59 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:56:00.615 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:00 smithi156 ceph-mon[121001]: Upgrade: Updating mgr.smithi156.pclong 2023-12-16T05:56:00.615 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:00 smithi156 ceph-mon[121001]: Deploying daemon mgr.smithi156.pclong on smithi156 2023-12-16T05:56:00.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:00 smithi155 ceph-mon[112451]: Upgrade: Updating mgr.smithi156.pclong 2023-12-16T05:56:00.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:00 smithi155 ceph-mon[112451]: Deploying daemon mgr.smithi156.pclong on smithi156 2023-12-16T05:56:01.499 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:01 smithi156 ceph-mon[121001]: pgmap v173: 65 pgs: 65 active+clean; 75 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 6.5 MiB/s wr, 562 op/s 2023-12-16T05:56:01.499 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:01 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:56:01.499 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:01 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:56:01.499 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:01 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:56:01.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:01 smithi155 ceph-mon[112451]: pgmap v173: 65 pgs: 65 active+clean; 75 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 6.5 MiB/s wr, 562 op/s 2023-12-16T05:56:01.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:01 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:56:01.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:01 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:56:01.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:01 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:56:02.665 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:02 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:56:02.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:02 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:56:03.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:03 smithi156 ceph-mon[121001]: pgmap v174: 65 pgs: 65 active+clean; 83 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 7.1 MiB/s wr, 591 op/s 2023-12-16T05:56:03.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:03 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:56:03.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:03 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:56:03.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:03 smithi155 ceph-mon[112451]: pgmap v174: 65 pgs: 65 active+clean; 83 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 7.1 MiB/s wr, 591 op/s 2023-12-16T05:56:03.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:03 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:56:03.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:03 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:56:04.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.153+0000 7f9551aa1700 1 -- 172.21.15.155:0/659971879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f954c0ffdb0 msgr2=0x7f954c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:04.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.153+0000 7f9551aa1700 1 --2- 172.21.15.155:0/659971879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f954c0ffdb0 0x7f954c1021d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9540004940 tx=0x7f9540009e30 comp rx=0 tx=0).stop 2023-12-16T05:56:04.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.153+0000 7f9551aa1700 1 -- 172.21.15.155:0/659971879 shutdown_connections 2023-12-16T05:56:04.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.154+0000 7f9551aa1700 1 --2- 172.21.15.155:0/659971879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f954c0ffdb0 0x7f954c1021d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:04.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.154+0000 7f9551aa1700 1 --2- 172.21.15.155:0/659971879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f954c0668e0 0x7f954c0ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:04.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.154+0000 7f9551aa1700 1 -- 172.21.15.155:0/659971879 >> 172.21.15.155:0/659971879 conn(0x7f954c0f71b0 msgr2=0x7f954c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:56:04.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.154+0000 7f9551aa1700 1 -- 172.21.15.155:0/659971879 shutdown_connections 2023-12-16T05:56:04.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.154+0000 7f9551aa1700 1 -- 172.21.15.155:0/659971879 wait complete. 2023-12-16T05:56:04.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.154+0000 7f9551aa1700 1 Processor -- start 2023-12-16T05:56:04.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.154+0000 7f9551aa1700 1 -- start start 2023-12-16T05:56:04.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.155+0000 7f9551aa1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f954c0668e0 0x7f954c10d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:04.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.155+0000 7f9551aa1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f954c0ffdb0 0x7f954c10da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:04.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.155+0000 7f9551aa1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c10e000 con 0x7f954c0668e0 2023-12-16T05:56:04.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.155+0000 7f9551aa1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c10e8a0 con 0x7f954c0ffdb0 2023-12-16T05:56:04.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.155+0000 7f954b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f954c0668e0 0x7f954c10d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:04.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.155+0000 7f954b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f954c0668e0 0x7f954c10d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:34036/0 (socket says 172.21.15.155:34036) 2023-12-16T05:56:04.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.155+0000 7f954b7fe700 1 -- 172.21.15.155:0/1488167469 learned_addr learned my addr 172.21.15.155:0/1488167469 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:56:04.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.155+0000 7f954affd700 1 --2- 172.21.15.155:0/1488167469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f954c0ffdb0 0x7f954c10da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:04.160 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.155+0000 7f954b7fe700 1 -- 172.21.15.155:0/1488167469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f954c0ffdb0 msgr2=0x7f954c10da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:04.160 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.155+0000 7f954b7fe700 1 --2- 172.21.15.155:0/1488167469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f954c0ffdb0 0x7f954c10da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:04.160 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.155+0000 7f954b7fe700 1 -- 172.21.15.155:0/1488167469 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9540005040 con 0x7f954c0668e0 2023-12-16T05:56:04.160 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.155+0000 7f954b7fe700 1 --2- 172.21.15.155:0/1488167469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f954c0668e0 0x7f954c10d4c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f953c00eb40 tx=0x7f953c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:56:04.160 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.155+0000 7f9533fff700 1 -- 172.21.15.155:0/1488167469 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f953c007cc0 con 0x7f954c0668e0 2023-12-16T05:56:04.160 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.155+0000 7f9551aa1700 1 -- 172.21.15.155:0/1488167469 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954c10eb20 con 0x7f954c0668e0 2023-12-16T05:56:04.160 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.155+0000 7f9533fff700 1 -- 172.21.15.155:0/1488167469 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f953c00f040 con 0x7f954c0668e0 2023-12-16T05:56:04.160 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.155+0000 7f9533fff700 1 -- 172.21.15.155:0/1488167469 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f953c00c990 con 0x7f954c0668e0 2023-12-16T05:56:04.160 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.155+0000 7f9551aa1700 1 -- 172.21.15.155:0/1488167469 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954c10f060 con 0x7f954c0668e0 2023-12-16T05:56:04.161 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.157+0000 7f9551aa1700 1 -- 172.21.15.155:0/1488167469 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f954c04bb80 con 0x7f954c0668e0 2023-12-16T05:56:04.161 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.157+0000 7f9533fff700 1 -- 172.21.15.155:0/1488167469 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f953c00cc00 con 0x7f954c0668e0 2023-12-16T05:56:04.161 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.157+0000 7f9533fff700 1 --2- 172.21.15.155:0/1488167469 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9534068f60 0x7f953406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:04.161 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.158+0000 7f9533fff700 1 -- 172.21.15.155:0/1488167469 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f953c0869a0 con 0x7f954c0668e0 2023-12-16T05:56:04.161 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.158+0000 7f954affd700 1 --2- 172.21.15.155:0/1488167469 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9534068f60 0x7f953406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:04.161 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.158+0000 7f954affd700 1 --2- 172.21.15.155:0/1488167469 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9534068f60 0x7f953406b410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9540013680 tx=0x7f9540009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:56:04.165 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.162+0000 7f9533fff700 1 -- 172.21.15.155:0/1488167469 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f953c04da00 con 0x7f954c0668e0 2023-12-16T05:56:04.371 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.369+0000 7f9551aa1700 1 -- 172.21.15.155:0/1488167469 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f954c10f480 con 0x7f9534068f60 2023-12-16T05:56:04.372 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.370+0000 7f9533fff700 1 -- 172.21.15.155:0/1488167469 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f954c10f480 con 0x7f9534068f60 2023-12-16T05:56:04.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.372+0000 7f9551aa1700 1 -- 172.21.15.155:0/1488167469 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9534068f60 msgr2=0x7f953406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:04.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.372+0000 7f9551aa1700 1 --2- 172.21.15.155:0/1488167469 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9534068f60 0x7f953406b410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9540013680 tx=0x7f9540009e30 comp rx=0 tx=0).stop 2023-12-16T05:56:04.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.372+0000 7f9551aa1700 1 -- 172.21.15.155:0/1488167469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f954c0668e0 msgr2=0x7f954c10d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:04.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.372+0000 7f9551aa1700 1 --2- 172.21.15.155:0/1488167469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f954c0668e0 0x7f954c10d4c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f953c00eb40 tx=0x7f953c00b040 comp rx=0 tx=0).stop 2023-12-16T05:56:04.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.372+0000 7f9551aa1700 1 -- 172.21.15.155:0/1488167469 shutdown_connections 2023-12-16T05:56:04.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.372+0000 7f9551aa1700 1 --2- 172.21.15.155:0/1488167469 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f9534068f60 0x7f953406b410 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:04.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.372+0000 7f9551aa1700 1 --2- 172.21.15.155:0/1488167469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f954c0668e0 0x7f954c10d4c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:04.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.372+0000 7f9551aa1700 1 --2- 172.21.15.155:0/1488167469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f954c0ffdb0 0x7f954c10da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:04.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.372+0000 7f9551aa1700 1 -- 172.21.15.155:0/1488167469 >> 172.21.15.155:0/1488167469 conn(0x7f954c0f71b0 msgr2=0x7f954c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:56:04.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.372+0000 7f9551aa1700 1 -- 172.21.15.155:0/1488167469 shutdown_connections 2023-12-16T05:56:04.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.372+0000 7f9551aa1700 1 -- 172.21.15.155:0/1488167469 wait complete. 2023-12-16T05:56:04.385 INFO:teuthology.orchestra.run.smithi155.stdout:true 2023-12-16T05:56:04.476 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.473+0000 7fd8da090700 1 -- 172.21.15.155:0/4022160649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8d40fcd00 msgr2=0x7fd8d40fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:04.477 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.473+0000 7fd8da090700 1 --2- 172.21.15.155:0/4022160649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8d40fcd00 0x7fd8d40fd150 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8004940 tx=0x7fd8c8009e30 comp rx=0 tx=0).stop 2023-12-16T05:56:04.477 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.474+0000 7fd8da090700 1 -- 172.21.15.155:0/4022160649 shutdown_connections 2023-12-16T05:56:04.477 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.474+0000 7fd8da090700 1 --2- 172.21.15.155:0/4022160649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8d40fcd00 0x7fd8d40fd150 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:04.477 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.474+0000 7fd8da090700 1 --2- 172.21.15.155:0/4022160649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d40fbaf0 0x7fd8d40fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:04.477 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.474+0000 7fd8da090700 1 -- 172.21.15.155:0/4022160649 >> 172.21.15.155:0/4022160649 conn(0x7fd8d40f71d0 msgr2=0x7fd8d40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:56:04.477 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.474+0000 7fd8da090700 1 -- 172.21.15.155:0/4022160649 shutdown_connections 2023-12-16T05:56:04.477 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.474+0000 7fd8da090700 1 -- 172.21.15.155:0/4022160649 wait complete. 2023-12-16T05:56:04.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.474+0000 7fd8da090700 1 Processor -- start 2023-12-16T05:56:04.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.475+0000 7fd8da090700 1 -- start start 2023-12-16T05:56:04.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.475+0000 7fd8da090700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8d40fbaf0 0x7fd8d410c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:04.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.475+0000 7fd8da090700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d40fcd00 0x7fd8d410c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:04.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.475+0000 7fd8da090700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d410ccc0 con 0x7fd8d40fbaf0 2023-12-16T05:56:04.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.475+0000 7fd8da090700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d410d560 con 0x7fd8d40fcd00 2023-12-16T05:56:04.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.475+0000 7fd8d37fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8d40fbaf0 0x7fd8d410c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:04.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.475+0000 7fd8d37fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8d40fbaf0 0x7fd8d410c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:34054/0 (socket says 172.21.15.155:34054) 2023-12-16T05:56:04.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.475+0000 7fd8d37fe700 1 -- 172.21.15.155:0/3809097225 learned_addr learned my addr 172.21.15.155:0/3809097225 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:56:04.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.475+0000 7fd8d2ffd700 1 --2- 172.21.15.155:0/3809097225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d40fcd00 0x7fd8d410c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:04.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.475+0000 7fd8d37fe700 1 -- 172.21.15.155:0/3809097225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d40fcd00 msgr2=0x7fd8d410c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:04.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.475+0000 7fd8d37fe700 1 --2- 172.21.15.155:0/3809097225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d40fcd00 0x7fd8d410c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:04.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.475+0000 7fd8d37fe700 1 -- 172.21.15.155:0/3809097225 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c8005040 con 0x7fd8d40fbaf0 2023-12-16T05:56:04.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.475+0000 7fd8d37fe700 1 --2- 172.21.15.155:0/3809097225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8d40fbaf0 0x7fd8d410c180 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd8c400eb70 tx=0x7fd8c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:56:04.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.475+0000 7fd8bbfff700 1 -- 172.21.15.155:0/3809097225 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8c4007cc0 con 0x7fd8d40fbaf0 2023-12-16T05:56:04.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.475+0000 7fd8bbfff700 1 -- 172.21.15.155:0/3809097225 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd8c400f040 con 0x7fd8d40fbaf0 2023-12-16T05:56:04.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.475+0000 7fd8da090700 1 -- 172.21.15.155:0/3809097225 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d410d7e0 con 0x7fd8d40fbaf0 2023-12-16T05:56:04.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.475+0000 7fd8bbfff700 1 -- 172.21.15.155:0/3809097225 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8c400c9d0 con 0x7fd8d40fbaf0 2023-12-16T05:56:04.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.475+0000 7fd8da090700 1 -- 172.21.15.155:0/3809097225 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d410dd20 con 0x7fd8d40fbaf0 2023-12-16T05:56:04.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.476+0000 7fd8da090700 1 -- 172.21.15.155:0/3809097225 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d404bb80 con 0x7fd8d40fbaf0 2023-12-16T05:56:04.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.477+0000 7fd8bbfff700 1 -- 172.21.15.155:0/3809097225 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fd8c400cc40 con 0x7fd8d40fbaf0 2023-12-16T05:56:04.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.477+0000 7fd8bbfff700 1 --2- 172.21.15.155:0/3809097225 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fd8bc068f60 0x7fd8bc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:04.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.477+0000 7fd8bbfff700 1 -- 172.21.15.155:0/3809097225 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd8c4086860 con 0x7fd8d40fbaf0 2023-12-16T05:56:04.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.477+0000 7fd8d2ffd700 1 --2- 172.21.15.155:0/3809097225 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fd8bc068f60 0x7fd8bc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:04.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.478+0000 7fd8d2ffd700 1 --2- 172.21.15.155:0/3809097225 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fd8bc068f60 0x7fd8bc06b410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800b0d0 tx=0x7fd8c8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:56:04.485 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.482+0000 7fd8bbfff700 1 -- 172.21.15.155:0/3809097225 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd8c404da00 con 0x7fd8d40fbaf0 2023-12-16T05:56:04.690 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.687+0000 7fd8da090700 1 -- 172.21.15.155:0/3809097225 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8d410e140 con 0x7fd8bc068f60 2023-12-16T05:56:04.691 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.688+0000 7fd8bbfff700 1 -- 172.21.15.155:0/3809097225 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fd8d410e140 con 0x7fd8bc068f60 2023-12-16T05:56:04.693 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.690+0000 7fd8da090700 1 -- 172.21.15.155:0/3809097225 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fd8bc068f60 msgr2=0x7fd8bc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:04.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.690+0000 7fd8da090700 1 --2- 172.21.15.155:0/3809097225 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fd8bc068f60 0x7fd8bc06b410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800b0d0 tx=0x7fd8c8009e30 comp rx=0 tx=0).stop 2023-12-16T05:56:04.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.690+0000 7fd8da090700 1 -- 172.21.15.155:0/3809097225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8d40fbaf0 msgr2=0x7fd8d410c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:04.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.690+0000 7fd8da090700 1 --2- 172.21.15.155:0/3809097225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8d40fbaf0 0x7fd8d410c180 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd8c400eb70 tx=0x7fd8c400b040 comp rx=0 tx=0).stop 2023-12-16T05:56:04.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.690+0000 7fd8da090700 1 -- 172.21.15.155:0/3809097225 shutdown_connections 2023-12-16T05:56:04.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.690+0000 7fd8da090700 1 --2- 172.21.15.155:0/3809097225 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7fd8bc068f60 0x7fd8bc06b410 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:04.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.690+0000 7fd8da090700 1 --2- 172.21.15.155:0/3809097225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8d40fbaf0 0x7fd8d410c180 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:04.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.690+0000 7fd8da090700 1 --2- 172.21.15.155:0/3809097225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d40fcd00 0x7fd8d410c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:04.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.690+0000 7fd8da090700 1 -- 172.21.15.155:0/3809097225 >> 172.21.15.155:0/3809097225 conn(0x7fd8d40f71d0 msgr2=0x7fd8d40fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:56:04.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.691+0000 7fd8da090700 1 -- 172.21.15.155:0/3809097225 shutdown_connections 2023-12-16T05:56:04.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.691+0000 7fd8da090700 1 -- 172.21.15.155:0/3809097225 wait complete. 2023-12-16T05:56:04.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.793+0000 7f5887461700 1 -- 172.21.15.155:0/483424161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58800fcd00 msgr2=0x7f58800fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:04.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.793+0000 7f5887461700 1 --2- 172.21.15.155:0/483424161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58800fcd00 0x7f58800fd150 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5870004940 tx=0x7f5870009e30 comp rx=0 tx=0).stop 2023-12-16T05:56:04.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.794+0000 7f5887461700 1 -- 172.21.15.155:0/483424161 shutdown_connections 2023-12-16T05:56:04.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.794+0000 7f5887461700 1 --2- 172.21.15.155:0/483424161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58800fcd00 0x7f58800fd150 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:04.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.794+0000 7f5887461700 1 --2- 172.21.15.155:0/483424161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58800fbaf0 0x7f58800fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:04.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.794+0000 7f5887461700 1 -- 172.21.15.155:0/483424161 >> 172.21.15.155:0/483424161 conn(0x7f58800f71d0 msgr2=0x7f58800f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:56:04.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.794+0000 7f5887461700 1 -- 172.21.15.155:0/483424161 shutdown_connections 2023-12-16T05:56:04.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.794+0000 7f5887461700 1 -- 172.21.15.155:0/483424161 wait complete. 2023-12-16T05:56:04.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.794+0000 7f5887461700 1 Processor -- start 2023-12-16T05:56:04.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.794+0000 7f5887461700 1 -- start start 2023-12-16T05:56:04.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.794+0000 7f5887461700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58800fbaf0 0x7f5880110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:04.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.794+0000 7f5887461700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58800fcd00 0x7f58801126d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:04.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.794+0000 7f5887461700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58800669c0 con 0x7f58800fbaf0 2023-12-16T05:56:04.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.794+0000 7f5887461700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5880066b00 con 0x7f58800fcd00 2023-12-16T05:56:04.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.794+0000 7f58851fd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58800fbaf0 0x7f5880110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:04.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.794+0000 7f58851fd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58800fbaf0 0x7f5880110180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:34058/0 (socket says 172.21.15.155:34058) 2023-12-16T05:56:04.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.794+0000 7f58851fd700 1 -- 172.21.15.155:0/753324611 learned_addr learned my addr 172.21.15.155:0/753324611 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:56:04.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.795+0000 7f58849fc700 1 --2- 172.21.15.155:0/753324611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58800fcd00 0x7f58801126d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:04.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.795+0000 7f58851fd700 1 -- 172.21.15.155:0/753324611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58800fcd00 msgr2=0x7f58801126d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:04.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.795+0000 7f58851fd700 1 --2- 172.21.15.155:0/753324611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58800fcd00 0x7f58801126d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:04.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.795+0000 7f58851fd700 1 -- 172.21.15.155:0/753324611 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5870005040 con 0x7f58800fbaf0 2023-12-16T05:56:04.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.795+0000 7f58851fd700 1 --2- 172.21.15.155:0/753324611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58800fbaf0 0x7f5880110180 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f587c00eb70 tx=0x7f587c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:56:04.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.795+0000 7f5875ffb700 1 -- 172.21.15.155:0/753324611 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f587c007cc0 con 0x7f58800fbaf0 2023-12-16T05:56:04.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.795+0000 7f5875ffb700 1 -- 172.21.15.155:0/753324611 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f587c00f040 con 0x7f58800fbaf0 2023-12-16T05:56:04.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.795+0000 7f5887461700 1 -- 172.21.15.155:0/753324611 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5880112cd0 con 0x7f58800fbaf0 2023-12-16T05:56:04.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.795+0000 7f5875ffb700 1 -- 172.21.15.155:0/753324611 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f587c00c9d0 con 0x7f58800fbaf0 2023-12-16T05:56:04.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.795+0000 7f5887461700 1 -- 172.21.15.155:0/753324611 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5880113170 con 0x7f58800fbaf0 2023-12-16T05:56:04.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.796+0000 7f5887461700 1 -- 172.21.15.155:0/753324611 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588004bb80 con 0x7f58800fbaf0 2023-12-16T05:56:04.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.797+0000 7f5875ffb700 1 -- 172.21.15.155:0/753324611 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f587c00cc40 con 0x7f58800fbaf0 2023-12-16T05:56:04.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.797+0000 7f5875ffb700 1 --2- 172.21.15.155:0/753324611 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f586c068f60 0x7f586c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:04.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.797+0000 7f5875ffb700 1 -- 172.21.15.155:0/753324611 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f587c086860 con 0x7f58800fbaf0 2023-12-16T05:56:04.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.797+0000 7f58849fc700 1 --2- 172.21.15.155:0/753324611 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f586c068f60 0x7f586c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:04.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.797+0000 7f58849fc700 1 --2- 172.21.15.155:0/753324611 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f586c068f60 0x7f586c06b410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5870000c00 tx=0x7f5870009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:56:04.804 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.801+0000 7f5875ffb700 1 -- 172.21.15.155:0/753324611 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f587c04da00 con 0x7f58800fbaf0 2023-12-16T05:56:04.998 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:04.995+0000 7f5887461700 1 -- 172.21.15.155:0/753324611 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5880101650 con 0x7f586c068f60 2023-12-16T05:56:05.007 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.004+0000 7f5875ffb700 1 -- 172.21.15.155:0/753324611 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f5880101650 con 0x7f586c068f60 2023-12-16T05:56:05.007 INFO:teuthology.orchestra.run.smithi155.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T05:56:05.007 INFO:teuthology.orchestra.run.smithi155.stdout:alertmanager.smithi155 smithi155 *:9093,9094 running (4m) 83s ago 5m 26.3M - 0.25.0 c8568f914cd2 59958a4f4cbd 2023-12-16T05:56:05.007 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi155 smithi155 running (5m) 83s ago 5m 7444k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 033f79f53811 2023-12-16T05:56:05.007 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi156 smithi156 running (4m) 1s ago 4m 7470k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 c72bd1a1d00a 2023-12-16T05:56:05.007 INFO:teuthology.orchestra.run.smithi155.stdout:grafana.smithi155 smithi155 *:3000 running (4m) 83s ago 5m 92.7M - 9.4.7 954c08fa6188 cb715f87b8c6 2023-12-16T05:56:05.007 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.bzsxjw smithi155 running (97s) 83s ago 97s 16.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6bcabf94a5c3 2023-12-16T05:56:05.007 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.vicpis smithi155 running (93s) 83s ago 93s 16.9M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 afa64e1ef8da 2023-12-16T05:56:05.007 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.fasing smithi156 running (92s) 1s ago 91s 170M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 7d97160bda7c 2023-12-16T05:56:05.007 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.qvgmfj smithi156 running (95s) 1s ago 95s 59.6M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4018b2f2e27e 2023-12-16T05:56:05.008 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi155.maowdn smithi155 *:9283 running (6m) 83s ago 6m 494M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 73b9fc45e71f 2023-12-16T05:56:05.008 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi156.pclong smithi156 *:8443,9283 running (4s) 1s ago 4m 49.0M - 19.0.0-191-g6d933094 a29c258b5d6f 99f9fc95fc56 2023-12-16T05:56:05.008 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi155 smithi155 running (6m) 83s ago 6m 77.4M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 0d0eecfde53b 2023-12-16T05:56:05.008 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi156 smithi156 running (4m) 1s ago 4m 51.2M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 4575acae9bdb 2023-12-16T05:56:05.008 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi155 smithi155 *:9100 running (5m) 83s ago 5m 15.9M - 1.5.0 0da6a335fe13 500b3e583f23 2023-12-16T05:56:05.008 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi156 smithi156 *:9100 running (4m) 1s ago 4m 19.0M - 1.5.0 0da6a335fe13 7e4371b6e840 2023-12-16T05:56:05.008 INFO:teuthology.orchestra.run.smithi155.stdout:osd.0 smithi155 running (4m) 83s ago 4m 56.3M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 91e650c277f7 2023-12-16T05:56:05.008 INFO:teuthology.orchestra.run.smithi155.stdout:osd.1 smithi155 running (3m) 83s ago 3m 59.8M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957303cb6598 2023-12-16T05:56:05.008 INFO:teuthology.orchestra.run.smithi155.stdout:osd.2 smithi155 running (3m) 83s ago 3m 54.7M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957a169c1cac 2023-12-16T05:56:05.008 INFO:teuthology.orchestra.run.smithi155.stdout:osd.3 smithi156 running (3m) 1s ago 3m 164M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c4f6c54afe99 2023-12-16T05:56:05.008 INFO:teuthology.orchestra.run.smithi155.stdout:osd.4 smithi156 running (2m) 1s ago 2m 137M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 6309b12204fd 2023-12-16T05:56:05.008 INFO:teuthology.orchestra.run.smithi155.stdout:osd.5 smithi156 running (2m) 1s ago 2m 155M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 84b2c33eb0e1 2023-12-16T05:56:05.008 INFO:teuthology.orchestra.run.smithi155.stdout:prometheus.smithi155 smithi155 *:9095 running (4m) 83s ago 4m 42.5M - 2.43.0 a07b618ecd1d 75cfe8962fd8 2023-12-16T05:56:05.009 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.006+0000 7f5887461700 1 -- 172.21.15.155:0/753324611 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f586c068f60 msgr2=0x7f586c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:05.009 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.006+0000 7f5887461700 1 --2- 172.21.15.155:0/753324611 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f586c068f60 0x7f586c06b410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5870000c00 tx=0x7f5870009e30 comp rx=0 tx=0).stop 2023-12-16T05:56:05.009 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.006+0000 7f5887461700 1 -- 172.21.15.155:0/753324611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58800fbaf0 msgr2=0x7f5880110180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:05.009 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.006+0000 7f5887461700 1 --2- 172.21.15.155:0/753324611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58800fbaf0 0x7f5880110180 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f587c00eb70 tx=0x7f587c00b040 comp rx=0 tx=0).stop 2023-12-16T05:56:05.009 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.006+0000 7f5887461700 1 -- 172.21.15.155:0/753324611 shutdown_connections 2023-12-16T05:56:05.009 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.006+0000 7f5887461700 1 --2- 172.21.15.155:0/753324611 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f586c068f60 0x7f586c06b410 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:05.009 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.006+0000 7f5887461700 1 --2- 172.21.15.155:0/753324611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58800fbaf0 0x7f5880110180 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:05.009 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.006+0000 7f5887461700 1 --2- 172.21.15.155:0/753324611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58800fcd00 0x7f58801126d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:05.010 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.006+0000 7f5887461700 1 -- 172.21.15.155:0/753324611 >> 172.21.15.155:0/753324611 conn(0x7f58800f71d0 msgr2=0x7f58800fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:56:05.010 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.006+0000 7f5887461700 1 -- 172.21.15.155:0/753324611 shutdown_connections 2023-12-16T05:56:05.010 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.006+0000 7f5887461700 1 -- 172.21.15.155:0/753324611 wait complete. 2023-12-16T05:56:05.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.108+0000 7f82717c6700 1 -- 172.21.15.155:0/3622962076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826c0fff70 msgr2=0x7f826c1003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:05.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.108+0000 7f82717c6700 1 --2- 172.21.15.155:0/3622962076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826c0fff70 0x7f826c1003e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8260004880 tx=0x7f8260009e30 comp rx=0 tx=0).stop 2023-12-16T05:56:05.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.108+0000 7f82717c6700 1 -- 172.21.15.155:0/3622962076 shutdown_connections 2023-12-16T05:56:05.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.108+0000 7f82717c6700 1 --2- 172.21.15.155:0/3622962076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826c0fff70 0x7f826c1003e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:05.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.108+0000 7f82717c6700 1 --2- 172.21.15.155:0/3622962076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f826c0fee00 0x7f826c0ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:05.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.108+0000 7f82717c6700 1 -- 172.21.15.155:0/3622962076 >> 172.21.15.155:0/3622962076 conn(0x7f826c0fa5d0 msgr2=0x7f826c0fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:56:05.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.108+0000 7f82717c6700 1 -- 172.21.15.155:0/3622962076 shutdown_connections 2023-12-16T05:56:05.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.108+0000 7f82717c6700 1 -- 172.21.15.155:0/3622962076 wait complete. 2023-12-16T05:56:05.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.108+0000 7f82717c6700 1 Processor -- start 2023-12-16T05:56:05.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.108+0000 7f82717c6700 1 -- start start 2023-12-16T05:56:05.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.109+0000 7f82717c6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826c0fee00 0x7f826c10f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:05.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.109+0000 7f82717c6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f826c0fff70 0x7f826c10fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:05.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.109+0000 7f82717c6700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c110230 con 0x7f826c0fee00 2023-12-16T05:56:05.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.109+0000 7f82717c6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c110ad0 con 0x7f826c0fff70 2023-12-16T05:56:05.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.109+0000 7f826affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826c0fee00 0x7f826c10f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:05.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.109+0000 7f826affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826c0fee00 0x7f826c10f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:34080/0 (socket says 172.21.15.155:34080) 2023-12-16T05:56:05.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.109+0000 7f826affd700 1 -- 172.21.15.155:0/387219730 learned_addr learned my addr 172.21.15.155:0/387219730 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:56:05.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.109+0000 7f826a7fc700 1 --2- 172.21.15.155:0/387219730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f826c0fff70 0x7f826c10fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:05.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.109+0000 7f826affd700 1 -- 172.21.15.155:0/387219730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f826c0fff70 msgr2=0x7f826c10fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:05.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.109+0000 7f826affd700 1 --2- 172.21.15.155:0/387219730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f826c0fff70 0x7f826c10fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:05.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.109+0000 7f826affd700 1 -- 172.21.15.155:0/387219730 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8260005040 con 0x7f826c0fee00 2023-12-16T05:56:05.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.109+0000 7f826affd700 1 --2- 172.21.15.155:0/387219730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826c0fee00 0x7f826c10f6f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f825c0041d0 tx=0x7f825c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:56:05.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.109+0000 7f82537fe700 1 -- 172.21.15.155:0/387219730 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f825c007cc0 con 0x7f826c0fee00 2023-12-16T05:56:05.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.109+0000 7f82717c6700 1 -- 172.21.15.155:0/387219730 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f826c110d50 con 0x7f826c0fee00 2023-12-16T05:56:05.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.109+0000 7f82537fe700 1 -- 172.21.15.155:0/387219730 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f825c00f040 con 0x7f826c0fee00 2023-12-16T05:56:05.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.109+0000 7f82537fe700 1 -- 172.21.15.155:0/387219730 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f825c00c990 con 0x7f826c0fee00 2023-12-16T05:56:05.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.109+0000 7f82717c6700 1 -- 172.21.15.155:0/387219730 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f826c111290 con 0x7f826c0fee00 2023-12-16T05:56:05.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.110+0000 7f82717c6700 1 -- 172.21.15.155:0/387219730 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f826c04bb80 con 0x7f826c0fee00 2023-12-16T05:56:05.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.111+0000 7f82537fe700 1 -- 172.21.15.155:0/387219730 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f825c00cc00 con 0x7f826c0fee00 2023-12-16T05:56:05.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.111+0000 7f82537fe700 1 --2- 172.21.15.155:0/387219730 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8254068f70 0x7f825406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:05.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.111+0000 7f82537fe700 1 -- 172.21.15.155:0/387219730 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f825c086800 con 0x7f826c0fee00 2023-12-16T05:56:05.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.111+0000 7f826a7fc700 1 --2- 172.21.15.155:0/387219730 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8254068f70 0x7f825406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:05.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.112+0000 7f826a7fc700 1 --2- 172.21.15.155:0/387219730 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8254068f70 0x7f825406b420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f82600135d0 tx=0x7f8260009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:56:05.118 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.115+0000 7f82537fe700 1 -- 172.21.15.155:0/387219730 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f825c04da00 con 0x7f826c0fee00 2023-12-16T05:56:05.143 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:04 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:56:05.143 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:04 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:56:05.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:04 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:56:05.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:04 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:56:05.386 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.382+0000 7f82717c6700 1 -- 172.21.15.155:0/387219730 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f826c111640 con 0x7f826c0fee00 2023-12-16T05:56:05.386 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.383+0000 7f82537fe700 1 -- 172.21.15.155:0/387219730 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f825c056790 con 0x7f826c0fee00 2023-12-16T05:56:05.386 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T05:56:05.386 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": { 2023-12-16T05:56:05.386 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T05:56:05.386 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:56:05.386 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": { 2023-12-16T05:56:05.386 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T05:56:05.387 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:56:05.387 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": { 2023-12-16T05:56:05.387 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T05:56:05.387 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:56:05.387 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2023-12-16T05:56:05.387 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T05:56:05.387 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:56:05.387 INFO:teuthology.orchestra.run.smithi155.stdout: "overall": { 2023-12-16T05:56:05.387 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 14 2023-12-16T05:56:05.387 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-12-16T05:56:05.387 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T05:56:05.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.385+0000 7f82717c6700 1 -- 172.21.15.155:0/387219730 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8254068f70 msgr2=0x7f825406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:05.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.385+0000 7f82717c6700 1 --2- 172.21.15.155:0/387219730 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8254068f70 0x7f825406b420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f82600135d0 tx=0x7f8260009e30 comp rx=0 tx=0).stop 2023-12-16T05:56:05.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.385+0000 7f82717c6700 1 -- 172.21.15.155:0/387219730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826c0fee00 msgr2=0x7f826c10f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:05.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.385+0000 7f82717c6700 1 --2- 172.21.15.155:0/387219730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826c0fee00 0x7f826c10f6f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f825c0041d0 tx=0x7f825c00b040 comp rx=0 tx=0).stop 2023-12-16T05:56:05.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.385+0000 7f82717c6700 1 -- 172.21.15.155:0/387219730 shutdown_connections 2023-12-16T05:56:05.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.385+0000 7f82717c6700 1 --2- 172.21.15.155:0/387219730 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8254068f70 0x7f825406b420 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:05.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.385+0000 7f82717c6700 1 --2- 172.21.15.155:0/387219730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826c0fee00 0x7f826c10f6f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:05.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.385+0000 7f82717c6700 1 --2- 172.21.15.155:0/387219730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f826c0fff70 0x7f826c10fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:05.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.385+0000 7f82717c6700 1 -- 172.21.15.155:0/387219730 >> 172.21.15.155:0/387219730 conn(0x7f826c0fa5d0 msgr2=0x7f826c103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:56:05.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.385+0000 7f82717c6700 1 -- 172.21.15.155:0/387219730 shutdown_connections 2023-12-16T05:56:05.389 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.385+0000 7f82717c6700 1 -- 172.21.15.155:0/387219730 wait complete. 2023-12-16T05:56:05.495 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.491+0000 7f819bd82700 1 -- 172.21.15.155:0/1620046114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81940fcd00 msgr2=0x7f81940fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:05.495 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.491+0000 7f819bd82700 1 --2- 172.21.15.155:0/1620046114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81940fcd00 0x7f81940fd150 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8190004940 tx=0x7f8190009e30 comp rx=0 tx=0).stop 2023-12-16T05:56:05.495 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.491+0000 7f819bd82700 1 -- 172.21.15.155:0/1620046114 shutdown_connections 2023-12-16T05:56:05.495 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.491+0000 7f819bd82700 1 --2- 172.21.15.155:0/1620046114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81940fcd00 0x7f81940fd150 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:05.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.491+0000 7f819bd82700 1 --2- 172.21.15.155:0/1620046114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81940fbaf0 0x7f81940fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:05.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.491+0000 7f819bd82700 1 -- 172.21.15.155:0/1620046114 >> 172.21.15.155:0/1620046114 conn(0x7f81940f71b0 msgr2=0x7f81940f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:56:05.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.491+0000 7f819bd82700 1 -- 172.21.15.155:0/1620046114 shutdown_connections 2023-12-16T05:56:05.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.491+0000 7f819bd82700 1 -- 172.21.15.155:0/1620046114 wait complete. 2023-12-16T05:56:05.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.491+0000 7f819bd82700 1 Processor -- start 2023-12-16T05:56:05.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.491+0000 7f819bd82700 1 -- start start 2023-12-16T05:56:05.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.492+0000 7f819bd82700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81940fbaf0 0x7f81940ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:05.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.492+0000 7f819bd82700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81940fcd00 0x7f81940fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:05.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.492+0000 7f819bd82700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81940fe640 con 0x7f81940fbaf0 2023-12-16T05:56:05.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.492+0000 7f819bd82700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81940fe7b0 con 0x7f81940fcd00 2023-12-16T05:56:05.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.492+0000 7f8199b1e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81940fbaf0 0x7f81940ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:05.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.492+0000 7f8199b1e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81940fbaf0 0x7f81940ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:34090/0 (socket says 172.21.15.155:34090) 2023-12-16T05:56:05.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.492+0000 7f8199b1e700 1 -- 172.21.15.155:0/775900930 learned_addr learned my addr 172.21.15.155:0/775900930 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:56:05.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.492+0000 7f819931d700 1 --2- 172.21.15.155:0/775900930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81940fcd00 0x7f81940fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:05.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.492+0000 7f8199b1e700 1 -- 172.21.15.155:0/775900930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81940fcd00 msgr2=0x7f81940fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:05.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.492+0000 7f8199b1e700 1 --2- 172.21.15.155:0/775900930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81940fcd00 0x7f81940fe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:05.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.492+0000 7f8199b1e700 1 -- 172.21.15.155:0/775900930 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8190005040 con 0x7f81940fbaf0 2023-12-16T05:56:05.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.492+0000 7f8199b1e700 1 --2- 172.21.15.155:0/775900930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81940fbaf0 0x7f81940ffbc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8184002a80 tx=0x7f8184004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:56:05.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.492+0000 7f818a7fc700 1 -- 172.21.15.155:0/775900930 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8184007cc0 con 0x7f81940fbaf0 2023-12-16T05:56:05.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.492+0000 7f818a7fc700 1 -- 172.21.15.155:0/775900930 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f818400f040 con 0x7f81940fbaf0 2023-12-16T05:56:05.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.492+0000 7f819bd82700 1 -- 172.21.15.155:0/775900930 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81940fea90 con 0x7f81940fbaf0 2023-12-16T05:56:05.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.492+0000 7f818a7fc700 1 -- 172.21.15.155:0/775900930 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f818400d9c0 con 0x7f81940fbaf0 2023-12-16T05:56:05.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.492+0000 7f819bd82700 1 -- 172.21.15.155:0/775900930 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8194115550 con 0x7f81940fbaf0 2023-12-16T05:56:05.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.493+0000 7f819bd82700 1 -- 172.21.15.155:0/775900930 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819404bb80 con 0x7f81940fbaf0 2023-12-16T05:56:05.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.494+0000 7f818a7fc700 1 -- 172.21.15.155:0/775900930 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f818400db20 con 0x7f81940fbaf0 2023-12-16T05:56:05.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.494+0000 7f818a7fc700 1 --2- 172.21.15.155:0/775900930 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8180068f60 0x7f818006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:05.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.494+0000 7f818a7fc700 1 -- 172.21.15.155:0/775900930 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8184086ad0 con 0x7f81940fbaf0 2023-12-16T05:56:05.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.494+0000 7f819931d700 1 --2- 172.21.15.155:0/775900930 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8180068f60 0x7f818006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:05.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.495+0000 7f819931d700 1 --2- 172.21.15.155:0/775900930 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8180068f60 0x7f818006b410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8190004890 tx=0x7f8190009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:56:05.501 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.498+0000 7f818a7fc700 1 -- 172.21.15.155:0/775900930 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f81840569b0 con 0x7f81940fbaf0 2023-12-16T05:56:05.706 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.701+0000 7f819bd82700 1 -- 172.21.15.155:0/775900930 --> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8194066310 con 0x7f8180068f60 2023-12-16T05:56:05.706 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.702+0000 7f818a7fc700 1 -- 172.21.15.155:0/775900930 <== mgr.14208 v2:172.21.15.155:6800/3642837048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f8194066310 con 0x7f8180068f60 2023-12-16T05:56:05.707 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T05:56:05.707 INFO:teuthology.orchestra.run.smithi155.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T05:56:05.707 INFO:teuthology.orchestra.run.smithi155.stdout: "in_progress": true, 2023-12-16T05:56:05.707 INFO:teuthology.orchestra.run.smithi155.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T05:56:05.707 INFO:teuthology.orchestra.run.smithi155.stdout: "services_complete": [], 2023-12-16T05:56:05.707 INFO:teuthology.orchestra.run.smithi155.stdout: "progress": "1/2 daemons upgraded", 2023-12-16T05:56:05.707 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "Currently upgrading mgr daemons", 2023-12-16T05:56:05.707 INFO:teuthology.orchestra.run.smithi155.stdout: "is_paused": false 2023-12-16T05:56:05.707 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T05:56:05.708 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.704+0000 7f819bd82700 1 -- 172.21.15.155:0/775900930 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8180068f60 msgr2=0x7f818006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:05.708 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.704+0000 7f819bd82700 1 --2- 172.21.15.155:0/775900930 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8180068f60 0x7f818006b410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8190004890 tx=0x7f8190009e30 comp rx=0 tx=0).stop 2023-12-16T05:56:05.708 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.704+0000 7f819bd82700 1 -- 172.21.15.155:0/775900930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81940fbaf0 msgr2=0x7f81940ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:05.708 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.704+0000 7f819bd82700 1 --2- 172.21.15.155:0/775900930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81940fbaf0 0x7f81940ffbc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8184002a80 tx=0x7f8184004600 comp rx=0 tx=0).stop 2023-12-16T05:56:05.708 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.704+0000 7f819bd82700 1 -- 172.21.15.155:0/775900930 shutdown_connections 2023-12-16T05:56:05.708 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.704+0000 7f819bd82700 1 --2- 172.21.15.155:0/775900930 >> [v2:172.21.15.155:6800/3642837048,v1:172.21.15.155:6801/3642837048] conn(0x7f8180068f60 0x7f818006b410 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:05.708 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.704+0000 7f819bd82700 1 --2- 172.21.15.155:0/775900930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81940fbaf0 0x7f81940ffbc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:05.708 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.704+0000 7f819bd82700 1 --2- 172.21.15.155:0/775900930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81940fcd00 0x7f81940fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:05.708 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.704+0000 7f819bd82700 1 -- 172.21.15.155:0/775900930 >> 172.21.15.155:0/775900930 conn(0x7f81940f71b0 msgr2=0x7f8194065c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:56:05.708 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.704+0000 7f819bd82700 1 -- 172.21.15.155:0/775900930 shutdown_connections 2023-12-16T05:56:05.708 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:05.704+0000 7f819bd82700 1 -- 172.21.15.155:0/775900930 wait complete. 2023-12-16T05:56:05.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:05 smithi156 ceph-mon[121001]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:56:05.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:05 smithi156 ceph-mon[121001]: pgmap v175: 65 pgs: 65 active+clean; 86 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 478 op/s 2023-12-16T05:56:05.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:05 smithi156 ceph-mon[121001]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:56:05.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:05 smithi156 ceph-mon[121001]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:56:05.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:05 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/387219730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:56:06.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:05 smithi155 ceph-mon[112451]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:56:06.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:05 smithi155 ceph-mon[112451]: pgmap v175: 65 pgs: 65 active+clean; 86 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 478 op/s 2023-12-16T05:56:06.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:05 smithi155 ceph-mon[112451]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:56:06.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:05 smithi155 ceph-mon[112451]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:56:06.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:05 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/387219730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:56:07.183 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:06 smithi156 ceph-mon[121001]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:56:07.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:06 smithi155 ceph-mon[112451]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:56:07.926 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:07 smithi156 ceph-mon[121001]: pgmap v176: 65 pgs: 65 active+clean; 88 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 218 op/s 2023-12-16T05:56:08.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:07 smithi155 ceph-mon[112451]: pgmap v176: 65 pgs: 65 active+clean; 88 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 218 op/s 2023-12-16T05:56:09.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:09 smithi156 ceph-mon[121001]: pgmap v177: 65 pgs: 65 active+clean; 94 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 179 op/s 2023-12-16T05:56:09.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:09 smithi155 ceph-mon[112451]: pgmap v177: 65 pgs: 65 active+clean; 94 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 179 op/s 2023-12-16T05:56:10.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:10 smithi156 ceph-mon[121001]: Standby manager daemon smithi156.pclong restarted 2023-12-16T05:56:10.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:10 smithi156 ceph-mon[121001]: Standby manager daemon smithi156.pclong started 2023-12-16T05:56:10.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:10 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.pclong/crt"}]: dispatch 2023-12-16T05:56:10.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:10 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T05:56:10.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:10 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.pclong/key"}]: dispatch 2023-12-16T05:56:10.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:10 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T05:56:10.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:10 smithi155 ceph-mon[112451]: Standby manager daemon smithi156.pclong restarted 2023-12-16T05:56:10.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:10 smithi155 ceph-mon[112451]: Standby manager daemon smithi156.pclong started 2023-12-16T05:56:10.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:10 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.pclong/crt"}]: dispatch 2023-12-16T05:56:10.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:10 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T05:56:10.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:10 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.pclong/key"}]: dispatch 2023-12-16T05:56:10.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:10 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T05:56:11.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:11 smithi156 ceph-mon[121001]: mgrmap e20: smithi155.maowdn(active, since 4m), standbys: smithi156.pclong 2023-12-16T05:56:11.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:11 smithi156 ceph-mon[121001]: pgmap v178: 65 pgs: 65 active+clean; 112 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 340 op/s 2023-12-16T05:56:11.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:11 smithi155 ceph-mon[112451]: mgrmap e20: smithi155.maowdn(active, since 4m), standbys: smithi156.pclong 2023-12-16T05:56:11.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:11 smithi155 ceph-mon[112451]: pgmap v178: 65 pgs: 65 active+clean; 112 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 340 op/s 2023-12-16T05:56:14.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:56:14.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:56:14.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:56:14.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:56:14.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:56:14.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:56:14.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr fail", "who": "smithi155.maowdn"}]: dispatch 2023-12-16T05:56:14.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: osdmap e44: 6 total, 6 up, 6 in 2023-12-16T05:56:14.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "mgr fail", "who": "smithi155.maowdn"}]': finished 2023-12-16T05:56:14.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: mgrmap e21: smithi156.pclong(active, starting, since 0.00656614s) 2023-12-16T05:56:14.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:56:14.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:56:14.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.bzsxjw"}]: dispatch 2023-12-16T05:56:14.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.vicpis"}]: dispatch 2023-12-16T05:56:14.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.qvgmfj"}]: dispatch 2023-12-16T05:56:14.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.fasing"}]: dispatch 2023-12-16T05:56:14.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mgr metadata", "who": "smithi156.pclong", "id": "smithi156.pclong"}]: dispatch 2023-12-16T05:56:14.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T05:56:14.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T05:56:14.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T05:56:14.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T05:56:14.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T05:56:14.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T05:56:14.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T05:56:14.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T05:56:14.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T05:56:14.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: Manager daemon smithi156.pclong is now available 2023-12-16T05:56:14.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:14.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:56:14.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:56:14.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:56:14.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi156.pclong/mirror_snapshot_schedule"}]: dispatch 2023-12-16T05:56:14.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi156.pclong/mirror_snapshot_schedule"}]: dispatch 2023-12-16T05:56:14.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi156.pclong/trash_purge_schedule"}]: dispatch 2023-12-16T05:56:14.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi156.pclong/trash_purge_schedule"}]: dispatch 2023-12-16T05:56:14.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:14.183 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:13 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:14.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:56:14.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:56:14.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:56:14.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:56:14.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' 2023-12-16T05:56:14.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:56:14.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr fail", "who": "smithi155.maowdn"}]: dispatch 2023-12-16T05:56:14.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: osdmap e44: 6 total, 6 up, 6 in 2023-12-16T05:56:14.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.14208 172.21.15.155:0/384184169' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "mgr fail", "who": "smithi155.maowdn"}]': finished 2023-12-16T05:56:14.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: mgrmap e21: smithi156.pclong(active, starting, since 0.00656614s) 2023-12-16T05:56:14.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:56:14.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:56:14.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.bzsxjw"}]: dispatch 2023-12-16T05:56:14.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.vicpis"}]: dispatch 2023-12-16T05:56:14.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.qvgmfj"}]: dispatch 2023-12-16T05:56:14.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.fasing"}]: dispatch 2023-12-16T05:56:14.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mgr metadata", "who": "smithi156.pclong", "id": "smithi156.pclong"}]: dispatch 2023-12-16T05:56:14.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T05:56:14.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T05:56:14.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T05:56:14.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T05:56:14.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T05:56:14.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T05:56:14.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T05:56:14.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T05:56:14.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T05:56:14.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: Manager daemon smithi156.pclong is now available 2023-12-16T05:56:14.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:14.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:56:14.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:56:14.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:56:14.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi156.pclong/mirror_snapshot_schedule"}]: dispatch 2023-12-16T05:56:14.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi156.pclong/mirror_snapshot_schedule"}]: dispatch 2023-12-16T05:56:14.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi156.pclong/trash_purge_schedule"}]: dispatch 2023-12-16T05:56:14.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi156.pclong/trash_purge_schedule"}]: dispatch 2023-12-16T05:56:14.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:14.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:13 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:15.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:15 smithi155 ceph-mon[112451]: Deploying cephadm binary to smithi155 2023-12-16T05:56:15.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:15 smithi155 ceph-mon[112451]: Deploying cephadm binary to smithi156 2023-12-16T05:56:15.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:15 smithi155 ceph-mon[112451]: mgrmap e22: smithi156.pclong(active, since 1.00809s) 2023-12-16T05:56:15.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:15 smithi155 ceph-mon[112451]: pgmap v3: 65 pgs: 65 active+clean; 134 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:56:15.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:15 smithi156 ceph-mon[121001]: Deploying cephadm binary to smithi155 2023-12-16T05:56:15.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:15 smithi156 ceph-mon[121001]: Deploying cephadm binary to smithi156 2023-12-16T05:56:15.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:15 smithi156 ceph-mon[121001]: mgrmap e22: smithi156.pclong(active, since 1.00809s) 2023-12-16T05:56:15.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:15 smithi156 ceph-mon[121001]: pgmap v3: 65 pgs: 65 active+clean; 134 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:56:16.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:16 smithi155 ceph-mon[112451]: [16/Dec/2023:05:56:14] ENGINE Bus STARTING 2023-12-16T05:56:16.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:16 smithi155 ceph-mon[112451]: [16/Dec/2023:05:56:14] ENGINE Serving on http://172.21.15.156:8765 2023-12-16T05:56:16.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:16 smithi155 ceph-mon[112451]: [16/Dec/2023:05:56:14] ENGINE Serving on https://172.21.15.156:7150 2023-12-16T05:56:16.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:16 smithi155 ceph-mon[112451]: [16/Dec/2023:05:56:14] ENGINE Bus STARTED 2023-12-16T05:56:16.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:16 smithi155 ceph-mon[112451]: pgmap v4: 65 pgs: 65 active+clean; 134 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:56:16.428 INFO:tasks.workunit.client.0.smithi155.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-16T05:56:16.428 INFO:tasks.workunit.client.0.smithi155.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-16T05:56:16.428 INFO:tasks.workunit.client.0.smithi155.stderr:+ make 2023-12-16T05:56:16.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:16 smithi156 ceph-mon[121001]: [16/Dec/2023:05:56:14] ENGINE Bus STARTING 2023-12-16T05:56:16.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:16 smithi156 ceph-mon[121001]: [16/Dec/2023:05:56:14] ENGINE Serving on http://172.21.15.156:8765 2023-12-16T05:56:16.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:16 smithi156 ceph-mon[121001]: [16/Dec/2023:05:56:14] ENGINE Serving on https://172.21.15.156:7150 2023-12-16T05:56:16.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:16 smithi156 ceph-mon[121001]: [16/Dec/2023:05:56:14] ENGINE Bus STARTED 2023-12-16T05:56:16.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:16 smithi156 ceph-mon[121001]: pgmap v4: 65 pgs: 65 active+clean; 134 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:56:16.646 INFO:tasks.workunit.client.0.smithi155.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-16T05:56:16.762 INFO:tasks.workunit.client.1.smithi156.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-16T05:56:16.764 INFO:tasks.workunit.client.1.smithi156.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-16T05:56:16.764 INFO:tasks.workunit.client.1.smithi156.stderr:+ make 2023-12-16T05:56:16.891 INFO:tasks.workunit.client.0.smithi155.stderr:++ readlink -f fsstress 2023-12-16T05:56:16.892 INFO:tasks.workunit.client.0.smithi155.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-16T05:56:16.892 INFO:tasks.workunit.client.0.smithi155.stderr:+ popd 2023-12-16T05:56:16.892 INFO:tasks.workunit.client.0.smithi155.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-16T05:56:16.892 INFO:tasks.workunit.client.0.smithi155.stderr:+ popd 2023-12-16T05:56:16.892 INFO:tasks.workunit.client.0.smithi155.stdout:~/cephtest/mnt.0/client.0/tmp 2023-12-16T05:56:16.893 INFO:tasks.workunit.client.0.smithi155.stderr:++ mktemp -d -p . 2023-12-16T05:56:16.894 INFO:tasks.workunit.client.0.smithi155.stderr:+ T=./tmp.d0BeU3Hpr1 2023-12-16T05:56:16.894 INFO:tasks.workunit.client.0.smithi155.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.d0BeU3Hpr1 -l 1 -n 1000 -p 10 -v 2023-12-16T05:56:16.896 INFO:tasks.workunit.client.0.smithi155.stdout:seed = 1701878454 2023-12-16T05:56:16.898 INFO:tasks.workunit.client.0.smithi155.stdout:0/0: readlink - no filename 2023-12-16T05:56:16.899 INFO:tasks.workunit.client.0.smithi155.stdout:1/0: fdatasync - no filename 2023-12-16T05:56:16.900 INFO:tasks.workunit.client.0.smithi155.stdout:1/1: dread - no filename 2023-12-16T05:56:16.900 INFO:tasks.workunit.client.0.smithi155.stdout:0/1: mknod c0 0 2023-12-16T05:56:16.901 INFO:tasks.workunit.client.0.smithi155.stdout:2/0: dread - no filename 2023-12-16T05:56:16.902 INFO:tasks.workunit.client.0.smithi155.stdout:2/1: dwrite - no filename 2023-12-16T05:56:16.902 INFO:tasks.workunit.client.0.smithi155.stdout:2/2: rename - no filename 2023-12-16T05:56:16.902 INFO:tasks.workunit.client.0.smithi155.stdout:1/2: mknod c0 0 2023-12-16T05:56:16.902 INFO:tasks.workunit.client.0.smithi155.stdout:1/3: dread - no filename 2023-12-16T05:56:16.902 INFO:tasks.workunit.client.0.smithi155.stdout:1/4: dwrite - no filename 2023-12-16T05:56:16.903 INFO:tasks.workunit.client.0.smithi155.stdout:0/2: creat f1 x:0 0 0 2023-12-16T05:56:16.905 INFO:tasks.workunit.client.0.smithi155.stdout:3/0: getdents . 0 2023-12-16T05:56:16.905 INFO:tasks.workunit.client.0.smithi155.stdout:3/1: dwrite - no filename 2023-12-16T05:56:16.905 INFO:tasks.workunit.client.0.smithi155.stdout:2/3: mkdir d0 0 2023-12-16T05:56:16.907 INFO:tasks.workunit.client.0.smithi155.stdout:1/5: mkdir d1 0 2023-12-16T05:56:16.907 INFO:tasks.workunit.client.0.smithi155.stdout:1/6: write - no filename 2023-12-16T05:56:16.907 INFO:tasks.workunit.client.0.smithi155.stdout:1/7: chown d1 2816 1 2023-12-16T05:56:16.907 INFO:tasks.workunit.client.0.smithi155.stdout:1/8: rename d1 to d1/d2 22 2023-12-16T05:56:16.910 INFO:tasks.workunit.client.0.smithi155.stdout:4/0: write - no filename 2023-12-16T05:56:16.910 INFO:tasks.workunit.client.0.smithi155.stdout:4/1: fdatasync - no filename 2023-12-16T05:56:16.910 INFO:tasks.workunit.client.0.smithi155.stdout:4/2: readlink - no filename 2023-12-16T05:56:16.910 INFO:tasks.workunit.client.0.smithi155.stdout:4/3: truncate - no filename 2023-12-16T05:56:16.910 INFO:tasks.workunit.client.0.smithi155.stdout:4/4: truncate - no filename 2023-12-16T05:56:16.910 INFO:tasks.workunit.client.0.smithi155.stdout:4/5: dread - no filename 2023-12-16T05:56:16.910 INFO:tasks.workunit.client.0.smithi155.stdout:4/6: dread - no filename 2023-12-16T05:56:16.911 INFO:tasks.workunit.client.0.smithi155.stdout:4/7: dread - no filename 2023-12-16T05:56:16.911 INFO:tasks.workunit.client.0.smithi155.stdout:4/8: unlink - no file 2023-12-16T05:56:16.911 INFO:tasks.workunit.client.0.smithi155.stdout:4/9: dread - no filename 2023-12-16T05:56:16.911 INFO:tasks.workunit.client.0.smithi155.stdout:4/10: getdents . 0 2023-12-16T05:56:16.911 INFO:tasks.workunit.client.0.smithi155.stdout:4/11: dwrite - no filename 2023-12-16T05:56:16.911 INFO:tasks.workunit.client.0.smithi155.stdout:4/12: write - no filename 2023-12-16T05:56:16.911 INFO:tasks.workunit.client.0.smithi155.stdout:4/13: link - no file 2023-12-16T05:56:16.912 INFO:tasks.workunit.client.0.smithi155.stdout:4/14: fsync - no filename 2023-12-16T05:56:16.912 INFO:tasks.workunit.client.0.smithi155.stdout:1/9: link c0 d1/c3 0 2023-12-16T05:56:16.912 INFO:tasks.workunit.client.0.smithi155.stdout:1/10: fsync - no filename 2023-12-16T05:56:16.912 INFO:tasks.workunit.client.0.smithi155.stdout:1/11: fdatasync - no filename 2023-12-16T05:56:16.912 INFO:tasks.workunit.client.0.smithi155.stdout:1/12: chown d1 0 1 2023-12-16T05:56:16.913 INFO:tasks.workunit.client.0.smithi155.stdout:1/13: write - no filename 2023-12-16T05:56:16.913 INFO:tasks.workunit.client.0.smithi155.stdout:5/0: dread - no filename 2023-12-16T05:56:16.915 INFO:tasks.workunit.client.0.smithi155.stdout:1/14: creat d1/f4 x:0 0 0 2023-12-16T05:56:16.915 INFO:tasks.workunit.client.0.smithi155.stdout:1/15: dread - d1/f4 zero size 2023-12-16T05:56:16.915 INFO:tasks.workunit.client.0.smithi155.stdout:1/16: chown d1/c3 307907 1 2023-12-16T05:56:16.916 INFO:tasks.workunit.client.0.smithi155.stdout:5/1: mkdir d0 0 2023-12-16T05:56:16.916 INFO:tasks.workunit.client.0.smithi155.stdout:5/2: read - no filename 2023-12-16T05:56:16.916 INFO:tasks.workunit.client.0.smithi155.stdout:5/3: dwrite - no filename 2023-12-16T05:56:16.916 INFO:tasks.workunit.client.0.smithi155.stdout:5/4: dwrite - no filename 2023-12-16T05:56:16.916 INFO:tasks.workunit.client.0.smithi155.stdout:5/5: unlink - no file 2023-12-16T05:56:16.922 INFO:tasks.workunit.client.0.smithi155.stdout:4/15: mkdir d0 0 2023-12-16T05:56:16.922 INFO:tasks.workunit.client.0.smithi155.stdout:4/16: rename d0 to d0/d1 22 2023-12-16T05:56:16.922 INFO:tasks.workunit.client.0.smithi155.stdout:4/17: chown d0 38 1 2023-12-16T05:56:16.925 INFO:tasks.workunit.client.0.smithi155.stdout:6/0: mkdir d0 0 2023-12-16T05:56:16.925 INFO:tasks.workunit.client.0.smithi155.stdout:6/1: dread - no filename 2023-12-16T05:56:16.926 INFO:tasks.workunit.client.0.smithi155.stdout:6/2: truncate - no filename 2023-12-16T05:56:16.926 INFO:tasks.workunit.client.0.smithi155.stdout:6/3: write - no filename 2023-12-16T05:56:16.926 INFO:tasks.workunit.client.0.smithi155.stdout:5/6: mknod d0/c1 0 2023-12-16T05:56:16.926 INFO:tasks.workunit.client.0.smithi155.stdout:5/7: dwrite - no filename 2023-12-16T05:56:16.926 INFO:tasks.workunit.client.0.smithi155.stdout:5/8: chown d0/c1 603193999 1 2023-12-16T05:56:16.927 INFO:tasks.workunit.client.0.smithi155.stdout:7/0: write - no filename 2023-12-16T05:56:16.927 INFO:tasks.workunit.client.0.smithi155.stdout:7/1: unlink - no file 2023-12-16T05:56:16.928 INFO:tasks.workunit.client.0.smithi155.stdout:4/18: mknod d0/c2 0 2023-12-16T05:56:16.928 INFO:tasks.workunit.client.0.smithi155.stdout:4/19: stat d0 0 2023-12-16T05:56:16.930 INFO:tasks.workunit.client.0.smithi155.stdout:7/2: mkdir d0 0 2023-12-16T05:56:16.930 INFO:tasks.workunit.client.0.smithi155.stdout:7/3: write - no filename 2023-12-16T05:56:16.930 INFO:tasks.workunit.client.0.smithi155.stdout:7/4: dread - no filename 2023-12-16T05:56:16.933 INFO:tasks.workunit.client.0.smithi155.stdout:7/5: mkdir d0/d1 0 2023-12-16T05:56:16.933 INFO:tasks.workunit.client.0.smithi155.stdout:7/6: fdatasync - no filename 2023-12-16T05:56:16.933 INFO:tasks.workunit.client.0.smithi155.stdout:7/7: rename d0/d1 to d0/d1/d2 22 2023-12-16T05:56:16.933 INFO:tasks.workunit.client.0.smithi155.stdout:4/20: creat d0/f3 x:0 0 0 2023-12-16T05:56:16.934 INFO:tasks.workunit.client.0.smithi155.stdout:8/0: fsync - no filename 2023-12-16T05:56:16.934 INFO:tasks.workunit.client.0.smithi155.stdout:8/1: getdents . 0 2023-12-16T05:56:16.934 INFO:tasks.workunit.client.0.smithi155.stdout:8/2: getdents . 0 2023-12-16T05:56:16.934 INFO:tasks.workunit.client.0.smithi155.stdout:8/3: truncate - no filename 2023-12-16T05:56:16.934 INFO:tasks.workunit.client.0.smithi155.stdout:8/4: read - no filename 2023-12-16T05:56:16.934 INFO:tasks.workunit.client.0.smithi155.stdout:8/5: rmdir - no directory 2023-12-16T05:56:16.934 INFO:tasks.workunit.client.0.smithi155.stdout:8/6: truncate - no filename 2023-12-16T05:56:16.934 INFO:tasks.workunit.client.0.smithi155.stdout:8/7: getdents . 0 2023-12-16T05:56:16.934 INFO:tasks.workunit.client.0.smithi155.stdout:8/8: readlink - no filename 2023-12-16T05:56:16.935 INFO:tasks.workunit.client.0.smithi155.stdout:5/9: mkdir d0/d2 0 2023-12-16T05:56:16.935 INFO:tasks.workunit.client.0.smithi155.stdout:6/4: symlink d0/l1 0 2023-12-16T05:56:16.946 INFO:tasks.workunit.client.0.smithi155.stdout:7/8: symlink d0/d1/l3 0 2023-12-16T05:56:16.946 INFO:tasks.workunit.client.0.smithi155.stdout:7/9: dwrite - no filename 2023-12-16T05:56:16.946 INFO:tasks.workunit.client.0.smithi155.stdout:7/10: write - no filename 2023-12-16T05:56:16.946 INFO:tasks.workunit.client.0.smithi155.stdout:7/11: fdatasync - no filename 2023-12-16T05:56:16.946 INFO:tasks.workunit.client.0.smithi155.stdout:7/12: stat d0/d1/l3 0 2023-12-16T05:56:16.946 INFO:tasks.workunit.client.0.smithi155.stdout:7/13: write - no filename 2023-12-16T05:56:16.946 INFO:tasks.workunit.client.0.smithi155.stdout:7/14: truncate - no filename 2023-12-16T05:56:16.946 INFO:tasks.workunit.client.0.smithi155.stdout:4/21: rename d0/f3 to d0/f4 0 2023-12-16T05:56:16.946 INFO:tasks.workunit.client.0.smithi155.stdout:8/9: creat f0 x:0 0 0 2023-12-16T05:56:16.946 INFO:tasks.workunit.client.0.smithi155.stdout:5/10: symlink d0/d2/l3 0 2023-12-16T05:56:16.946 INFO:tasks.workunit.client.0.smithi155.stdout:5/11: stat d0 0 2023-12-16T05:56:16.946 INFO:tasks.workunit.client.0.smithi155.stdout:6/5: rename d0/l1 to d0/l2 0 2023-12-16T05:56:16.953 INFO:tasks.workunit.client.0.smithi155.stdout:7/15: mknod d0/c4 0 2023-12-16T05:56:16.953 INFO:tasks.workunit.client.0.smithi155.stdout:7/16: chown d0 1707773 1 2023-12-16T05:56:16.953 INFO:tasks.workunit.client.0.smithi155.stdout:4/22: creat d0/f5 x:0 0 0 2023-12-16T05:56:16.953 INFO:tasks.workunit.client.0.smithi155.stdout:4/23: truncate d0/f4 237433 0 2023-12-16T05:56:16.954 INFO:tasks.workunit.client.0.smithi155.stdout:4/24: dread - d0/f5 zero size 2023-12-16T05:56:16.954 INFO:tasks.workunit.client.0.smithi155.stdout:4/25: write d0/f4 [406237,25600] 0 2023-12-16T05:56:16.968 INFO:tasks.workunit.client.0.smithi155.stdout:8/10: creat f1 x:0 0 0 2023-12-16T05:56:16.969 INFO:tasks.workunit.client.0.smithi155.stdout:0/3: getdents . 0 2023-12-16T05:56:16.969 INFO:tasks.workunit.client.0.smithi155.stdout:0/4: write f1 [865304,88439] 0 2023-12-16T05:56:16.971 INFO:tasks.workunit.client.0.smithi155.stdout:5/12: rename d0/d2/l3 to d0/l4 0 2023-12-16T05:56:16.971 INFO:tasks.workunit.client.0.smithi155.stdout:5/13: readlink d0/l4 0 2023-12-16T05:56:16.971 INFO:tasks.workunit.client.0.smithi155.stdout:6/6: mkdir d0/d3 0 2023-12-16T05:56:16.973 INFO:tasks.workunit.client.0.smithi155.stdout:0/5: rename f1 to f2 0 2023-12-16T05:56:16.976 INFO:tasks.workunit.client.0.smithi155.stdout:6/7: creat d0/f4 x:0 0 0 2023-12-16T05:56:16.986 INFO:tasks.workunit.client.0.smithi155.stdout:6/8: creat d0/d3/f5 x:0 0 0 2023-12-16T05:56:16.989 INFO:tasks.workunit.client.0.smithi155.stdout:6/9: creat d0/d3/f6 x:0 0 0 2023-12-16T05:56:16.992 INFO:tasks.workunit.client.0.smithi155.stdout:6/10: creat d0/f7 x:0 0 0 2023-12-16T05:56:17.216 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:17 smithi155 ceph-mon[112451]: mgrmap e23: smithi156.pclong(active, since 3s) 2023-12-16T05:56:17.291 INFO:tasks.workunit.client.0.smithi155.stdout:7/17: getdents d0/d1 0 2023-12-16T05:56:17.317 INFO:tasks.workunit.client.0.smithi155.stdout:5/14: getdents d0 0 2023-12-16T05:56:17.317 INFO:tasks.workunit.client.0.smithi155.stdout:5/15: dwrite - no filename 2023-12-16T05:56:17.317 INFO:tasks.workunit.client.0.smithi155.stdout:6/11: link d0/l2 d0/d3/l8 0 2023-12-16T05:56:17.317 INFO:tasks.workunit.client.0.smithi155.stdout:6/12: dread - d0/f4 zero size 2023-12-16T05:56:17.335 INFO:tasks.workunit.client.0.smithi155.stdout:5/16: creat d0/d2/f5 x:0 0 0 2023-12-16T05:56:17.342 INFO:tasks.workunit.client.0.smithi155.stdout:5/17: creat d0/d2/f6 x:0 0 0 2023-12-16T05:56:17.348 INFO:tasks.workunit.client.0.smithi155.stdout:5/18: mkdir d0/d2/d7 0 2023-12-16T05:56:17.348 INFO:tasks.workunit.client.0.smithi155.stdout:5/19: fdatasync d0/d2/f5 0 2023-12-16T05:56:17.348 INFO:tasks.workunit.client.0.smithi155.stdout:5/20: write d0/d2/f5 [1009072,41509] 0 2023-12-16T05:56:17.356 INFO:tasks.workunit.client.0.smithi155.stdout:5/21: creat d0/d2/d7/f8 x:0 0 0 2023-12-16T05:56:17.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:17 smithi156 ceph-mon[121001]: mgrmap e23: smithi156.pclong(active, since 3s) 2023-12-16T05:56:18.138 INFO:tasks.workunit.client.1.smithi156.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-16T05:56:18.184 INFO:tasks.workunit.client.0.smithi155.stdout:1/17: dwrite d1/f4 [0,4194304] 0 2023-12-16T05:56:18.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:18 smithi156 ceph-mon[121001]: pgmap v5: 65 pgs: 65 active+clean; 134 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:56:18.535 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:18 smithi155 ceph-mon[112451]: pgmap v5: 65 pgs: 65 active+clean; 134 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:56:18.590 INFO:tasks.workunit.client.0.smithi155.stdout:5/22: read d0/d2/f5 [91375,65204] 0 2023-12-16T05:56:18.855 INFO:tasks.workunit.client.0.smithi155.stdout:0/6: read f2 [551661,107012] 0 2023-12-16T05:56:19.016 INFO:tasks.workunit.client.0.smithi155.stdout:4/26: dread d0/f4 [0,4194304] 0 2023-12-16T05:56:19.083 INFO:tasks.workunit.client.0.smithi155.stdout:1/18: dread d1/f4 [0,4194304] 0 2023-12-16T05:56:19.208 INFO:tasks.workunit.client.0.smithi155.stdout:9/0: symlink l0 0 2023-12-16T05:56:19.209 INFO:tasks.workunit.client.0.smithi155.stdout:9/1: write - no filename 2023-12-16T05:56:19.248 INFO:tasks.workunit.client.0.smithi155.stdout:6/13: dwrite d0/d3/f6 [0,4194304] 0 2023-12-16T05:56:19.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:19 smithi156 ceph-mon[121001]: pgmap v6: 65 pgs: 65 active+clean; 134 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:56:19.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:19 smithi155 ceph-mon[112451]: pgmap v6: 65 pgs: 65 active+clean; 134 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:56:20.622 INFO:tasks.workunit.client.0.smithi155.stdout:5/23: creat d0/d2/f9 x:0 0 0 2023-12-16T05:56:20.623 INFO:tasks.workunit.client.0.smithi155.stdout:5/24: chown d0/d2 29184 1 2023-12-16T05:56:20.623 INFO:tasks.workunit.client.0.smithi155.stdout:5/25: write d0/d2/d7/f8 [796860,117397] 0 2023-12-16T05:56:20.665 INFO:tasks.workunit.client.0.smithi155.stdout:0/7: unlink c0 0 2023-12-16T05:56:20.692 INFO:tasks.workunit.client.0.smithi155.stdout:1/19: mknod d1/c5 0 2023-12-16T05:56:20.694 INFO:tasks.workunit.client.0.smithi155.stdout:9/2: mknod c1 0 2023-12-16T05:56:20.698 INFO:tasks.workunit.client.0.smithi155.stdout:6/14: creat d0/d3/f9 x:0 0 0 2023-12-16T05:56:20.704 INFO:tasks.workunit.client.0.smithi155.stdout:0/8: mknod c3 0 2023-12-16T05:56:20.704 INFO:tasks.workunit.client.0.smithi155.stdout:0/9: rmdir - no directory 2023-12-16T05:56:20.705 INFO:tasks.workunit.client.0.smithi155.stdout:0/10: stat c3 0 2023-12-16T05:56:20.705 INFO:tasks.workunit.client.0.smithi155.stdout:0/11: read f2 [674371,90093] 0 2023-12-16T05:56:20.705 INFO:tasks.workunit.client.0.smithi155.stdout:1/20: creat d1/f6 x:0 0 0 2023-12-16T05:56:20.707 INFO:tasks.workunit.client.0.smithi155.stdout:9/3: symlink l2 0 2023-12-16T05:56:20.707 INFO:tasks.workunit.client.0.smithi155.stdout:0/12: dread f2 [0,4194304] 0 2023-12-16T05:56:20.707 INFO:tasks.workunit.client.0.smithi155.stdout:9/4: chown l0 361516 1 2023-12-16T05:56:20.707 INFO:tasks.workunit.client.0.smithi155.stdout:9/5: chown l0 7320524 1 2023-12-16T05:56:20.709 INFO:tasks.workunit.client.0.smithi155.stdout:1/21: mkdir d1/d7 0 2023-12-16T05:56:20.711 INFO:tasks.workunit.client.0.smithi155.stdout:9/6: unlink c1 0 2023-12-16T05:56:20.711 INFO:tasks.workunit.client.0.smithi155.stdout:9/7: write - no filename 2023-12-16T05:56:20.712 INFO:tasks.workunit.client.0.smithi155.stdout:9/8: fsync - no filename 2023-12-16T05:56:20.712 INFO:tasks.workunit.client.0.smithi155.stdout:9/9: write - no filename 2023-12-16T05:56:20.712 INFO:tasks.workunit.client.0.smithi155.stdout:9/10: read - no filename 2023-12-16T05:56:20.713 INFO:tasks.workunit.client.0.smithi155.stdout:0/13: creat f4 x:0 0 0 2023-12-16T05:56:20.713 INFO:tasks.workunit.client.0.smithi155.stdout:0/14: fdatasync f4 0 2023-12-16T05:56:20.714 INFO:tasks.workunit.client.0.smithi155.stdout:1/22: mknod d1/c8 0 2023-12-16T05:56:20.715 INFO:tasks.workunit.client.0.smithi155.stdout:9/11: creat f3 x:0 0 0 2023-12-16T05:56:20.716 INFO:tasks.workunit.client.0.smithi155.stdout:0/15: symlink l5 0 2023-12-16T05:56:20.716 INFO:tasks.workunit.client.0.smithi155.stdout:0/16: dread - f4 zero size 2023-12-16T05:56:20.716 INFO:tasks.workunit.client.0.smithi155.stdout:0/17: dread - f4 zero size 2023-12-16T05:56:20.716 INFO:tasks.workunit.client.0.smithi155.stdout:1/23: mknod d1/c9 0 2023-12-16T05:56:20.718 INFO:tasks.workunit.client.0.smithi155.stdout:6/15: dwrite d0/d3/f6 [0,4194304] 0 2023-12-16T05:56:20.719 INFO:tasks.workunit.client.0.smithi155.stdout:0/18: rename l5 to l6 0 2023-12-16T05:56:20.721 INFO:tasks.workunit.client.0.smithi155.stdout:1/24: rename d1/c8 to d1/ca 0 2023-12-16T05:56:20.722 INFO:tasks.workunit.client.0.smithi155.stdout:6/16: creat d0/d3/fa x:0 0 0 2023-12-16T05:56:20.723 INFO:tasks.workunit.client.0.smithi155.stdout:1/25: link d1/c5 d1/d7/cb 0 2023-12-16T05:56:20.724 INFO:tasks.workunit.client.0.smithi155.stdout:1/26: symlink d1/lc 0 2023-12-16T05:56:20.736 INFO:tasks.workunit.client.0.smithi155.stdout:6/17: write d0/d3/f6 [2492491,13241] 0 2023-12-16T05:56:20.765 INFO:tasks.workunit.client.0.smithi155.stdout:0/19: dwrite f4 [0,4194304] 0 2023-12-16T05:56:20.767 INFO:tasks.workunit.client.0.smithi155.stdout:6/18: dwrite d0/f7 [0,4194304] 0 2023-12-16T05:56:20.783 INFO:tasks.workunit.client.0.smithi155.stdout:0/20: dwrite f2 [0,4194304] 0 2023-12-16T05:56:20.811 INFO:tasks.workunit.client.0.smithi155.stdout:0/21: dread f4 [0,4194304] 0 2023-12-16T05:56:20.989 INFO:tasks.workunit.client.0.smithi155.stdout:5/26: truncate d0/d2/d7/f8 191206 0 2023-12-16T05:56:20.989 INFO:tasks.workunit.client.0.smithi155.stdout:5/27: chown d0/d2 12 1 2023-12-16T05:56:20.990 INFO:tasks.workunit.client.0.smithi155.stdout:5/28: mknod d0/d2/ca 0 2023-12-16T05:56:20.992 INFO:tasks.workunit.client.0.smithi155.stdout:5/29: link d0/d2/ca d0/cb 0 2023-12-16T05:56:20.994 INFO:tasks.workunit.client.0.smithi155.stdout:5/30: rename d0/l4 to d0/d2/d7/lc 0 2023-12-16T05:56:20.998 INFO:tasks.workunit.client.0.smithi155.stdout:9/12: getdents . 0 2023-12-16T05:56:21.003 INFO:tasks.workunit.client.0.smithi155.stdout:1/27: rename d1/ca to d1/cd 0 2023-12-16T05:56:21.006 INFO:tasks.workunit.client.0.smithi155.stdout:6/19: rmdir d0/d3 39 2023-12-16T05:56:21.008 INFO:tasks.workunit.client.0.smithi155.stdout:1/28: link d1/c3 d1/d7/ce 0 2023-12-16T05:56:21.010 INFO:tasks.workunit.client.0.smithi155.stdout:1/29: creat d1/ff x:0 0 0 2023-12-16T05:56:21.011 INFO:tasks.workunit.client.0.smithi155.stdout:1/30: mknod d1/c10 0 2023-12-16T05:56:21.013 INFO:tasks.workunit.client.0.smithi155.stdout:5/31: dwrite d0/d2/f5 [0,4194304] 0 2023-12-16T05:56:21.013 INFO:tasks.workunit.client.0.smithi155.stdout:1/31: link d1/c5 d1/d7/c11 0 2023-12-16T05:56:21.017 INFO:tasks.workunit.client.0.smithi155.stdout:1/32: read d1/f4 [1900409,117891] 0 2023-12-16T05:56:21.019 INFO:tasks.workunit.client.0.smithi155.stdout:5/32: creat d0/d2/d7/fd x:0 0 0 2023-12-16T05:56:21.021 INFO:tasks.workunit.client.0.smithi155.stdout:1/33: creat d1/d7/f12 x:0 0 0 2023-12-16T05:56:21.021 INFO:tasks.workunit.client.0.smithi155.stdout:1/34: dread - d1/ff zero size 2023-12-16T05:56:21.031 INFO:tasks.workunit.client.0.smithi155.stdout:6/20: dread d0/f7 [0,4194304] 0 2023-12-16T05:56:21.031 INFO:tasks.workunit.client.0.smithi155.stdout:6/21: stat d0/f4 0 2023-12-16T05:56:21.031 INFO:tasks.workunit.client.0.smithi155.stdout:9/13: dwrite f3 [0,4194304] 0 2023-12-16T05:56:21.039 INFO:tasks.workunit.client.0.smithi155.stdout:0/22: dwrite f2 [4194304,4194304] 0 2023-12-16T05:56:21.040 INFO:tasks.workunit.client.0.smithi155.stdout:0/23: write f4 [2461902,116579] 0 2023-12-16T05:56:21.042 INFO:tasks.workunit.client.0.smithi155.stdout:0/24: mkdir d7 0 2023-12-16T05:56:21.043 INFO:tasks.workunit.client.0.smithi155.stdout:5/33: dwrite d0/d2/f5 [0,4194304] 0 2023-12-16T05:56:21.043 INFO:tasks.workunit.client.0.smithi155.stdout:5/34: truncate d0/d2/f6 971887 0 2023-12-16T05:56:21.043 INFO:tasks.workunit.client.0.smithi155.stdout:5/35: fdatasync d0/d2/f5 0 2023-12-16T05:56:21.044 INFO:tasks.workunit.client.0.smithi155.stdout:0/25: mknod d7/c8 0 2023-12-16T05:56:21.058 INFO:tasks.workunit.client.0.smithi155.stdout:0/26: dread f2 [0,4194304] 0 2023-12-16T05:56:21.059 INFO:tasks.workunit.client.0.smithi155.stdout:0/27: mknod d7/c9 0 2023-12-16T05:56:21.064 INFO:tasks.workunit.client.0.smithi155.stdout:6/22: dwrite d0/d3/f9 [0,4194304] 0 2023-12-16T05:56:21.067 INFO:tasks.workunit.client.0.smithi155.stdout:5/36: dwrite d0/d2/f9 [0,4194304] 0 2023-12-16T05:56:21.069 INFO:tasks.workunit.client.0.smithi155.stdout:6/23: creat d0/fb x:0 0 0 2023-12-16T05:56:21.069 INFO:tasks.workunit.client.0.smithi155.stdout:6/24: write d0/d3/fa [130012,91933] 0 2023-12-16T05:56:21.070 INFO:tasks.workunit.client.0.smithi155.stdout:5/37: creat d0/d2/d7/fe x:0 0 0 2023-12-16T05:56:21.070 INFO:tasks.workunit.client.0.smithi155.stdout:5/38: stat d0/d2/d7 0 2023-12-16T05:56:21.072 INFO:tasks.workunit.client.0.smithi155.stdout:6/25: creat d0/fc x:0 0 0 2023-12-16T05:56:21.081 INFO:tasks.workunit.client.0.smithi155.stdout:9/14: dwrite f3 [4194304,4194304] 0 2023-12-16T05:56:21.089 INFO:tasks.workunit.client.0.smithi155.stdout:9/15: link l0 l4 0 2023-12-16T05:56:21.090 INFO:tasks.workunit.client.0.smithi155.stdout:0/28: dwrite f2 [0,4194304] 0 2023-12-16T05:56:21.090 INFO:tasks.workunit.client.0.smithi155.stdout:0/29: readlink l6 0 2023-12-16T05:56:21.090 INFO:tasks.workunit.client.0.smithi155.stdout:0/30: chown f4 6385786 1 2023-12-16T05:56:21.091 INFO:tasks.workunit.client.0.smithi155.stdout:0/31: rename d7/c9 to d7/ca 0 2023-12-16T05:56:21.092 INFO:tasks.workunit.client.0.smithi155.stdout:0/32: creat d7/fb x:0 0 0 2023-12-16T05:56:21.093 INFO:tasks.workunit.client.0.smithi155.stdout:0/33: chown d7/c8 343 1 2023-12-16T05:56:21.099 INFO:tasks.workunit.client.0.smithi155.stdout:5/39: dwrite d0/d2/f9 [0,4194304] 0 2023-12-16T05:56:21.099 INFO:tasks.workunit.client.0.smithi155.stdout:5/40: chown d0/d2/d7/fe 104867 1 2023-12-16T05:56:21.099 INFO:tasks.workunit.client.0.smithi155.stdout:9/16: dread f3 [4194304,4194304] 0 2023-12-16T05:56:21.102 INFO:tasks.workunit.client.0.smithi155.stdout:6/26: dwrite d0/d3/fa [0,4194304] 0 2023-12-16T05:56:21.102 INFO:tasks.workunit.client.0.smithi155.stdout:6/27: dread - d0/fb zero size 2023-12-16T05:56:21.102 INFO:tasks.workunit.client.0.smithi155.stdout:6/28: fdatasync d0/d3/f9 0 2023-12-16T05:56:21.102 INFO:tasks.workunit.client.0.smithi155.stdout:9/17: rename l0 to l5 0 2023-12-16T05:56:21.102 INFO:tasks.workunit.client.0.smithi155.stdout:0/34: write f2 [1178234,26033] 0 2023-12-16T05:56:21.102 INFO:tasks.workunit.client.0.smithi155.stdout:0/35: write f4 [4926846,7659] 0 2023-12-16T05:56:21.105 INFO:tasks.workunit.client.0.smithi155.stdout:6/29: mkdir d0/d3/dd 0 2023-12-16T05:56:21.105 INFO:tasks.workunit.client.0.smithi155.stdout:6/30: fsync d0/f7 0 2023-12-16T05:56:21.106 INFO:tasks.workunit.client.0.smithi155.stdout:9/18: creat f6 x:0 0 0 2023-12-16T05:56:21.108 INFO:tasks.workunit.client.0.smithi155.stdout:0/36: creat d7/fc x:0 0 0 2023-12-16T05:56:21.110 INFO:tasks.workunit.client.0.smithi155.stdout:9/19: mknod c7 0 2023-12-16T05:56:21.118 INFO:tasks.workunit.client.0.smithi155.stdout:9/20: write f3 [6772768,113360] 0 2023-12-16T05:56:21.127 INFO:tasks.workunit.client.0.smithi155.stdout:5/41: dwrite d0/d2/d7/fd [0,4194304] 0 2023-12-16T05:56:21.127 INFO:tasks.workunit.client.0.smithi155.stdout:5/42: chown d0/d2/d7/fe 3052600 1 2023-12-16T05:56:21.129 INFO:tasks.workunit.client.0.smithi155.stdout:6/31: dwrite d0/fc [0,4194304] 0 2023-12-16T05:56:21.132 INFO:tasks.workunit.client.0.smithi155.stdout:5/43: creat d0/d2/ff x:0 0 0 2023-12-16T05:56:21.133 INFO:tasks.workunit.client.0.smithi155.stdout:6/32: write d0/d3/fa [3969420,77775] 0 2023-12-16T05:56:21.133 INFO:tasks.workunit.client.0.smithi155.stdout:6/33: chown d0/d3/f5 1 1 2023-12-16T05:56:21.135 INFO:tasks.workunit.client.0.smithi155.stdout:5/44: dread d0/d2/f6 [0,4194304] 0 2023-12-16T05:56:21.139 INFO:tasks.workunit.client.0.smithi155.stdout:9/21: dread f3 [0,4194304] 0 2023-12-16T05:56:21.140 INFO:tasks.workunit.client.0.smithi155.stdout:5/45: rmdir d0/d2/d7 39 2023-12-16T05:56:21.143 INFO:tasks.workunit.client.0.smithi155.stdout:0/37: dread f4 [0,4194304] 0 2023-12-16T05:56:21.143 INFO:tasks.workunit.client.0.smithi155.stdout:9/22: unlink f6 0 2023-12-16T05:56:21.150 INFO:tasks.workunit.client.0.smithi155.stdout:9/23: dread f3 [0,4194304] 0 2023-12-16T05:56:21.171 INFO:tasks.workunit.client.0.smithi155.stdout:5/46: dwrite d0/d2/ff [0,4194304] 0 2023-12-16T05:56:21.173 INFO:tasks.workunit.client.0.smithi155.stdout:5/47: write d0/d2/d7/fd [2455432,12816] 0 2023-12-16T05:56:21.181 INFO:tasks.workunit.client.0.smithi155.stdout:5/48: dread d0/d2/ff [0,4194304] 0 2023-12-16T05:56:21.181 INFO:tasks.workunit.client.0.smithi155.stdout:5/49: write d0/d2/f6 [1940940,33629] 0 2023-12-16T05:56:21.183 INFO:tasks.workunit.client.0.smithi155.stdout:0/38: dwrite f4 [0,4194304] 0 2023-12-16T05:56:21.183 INFO:tasks.workunit.client.0.smithi155.stdout:0/39: truncate d7/fc 25980 0 2023-12-16T05:56:21.184 INFO:tasks.workunit.client.0.smithi155.stdout:0/40: dread - d7/fb zero size 2023-12-16T05:56:21.184 INFO:tasks.workunit.client.0.smithi155.stdout:5/50: fsync d0/d2/d7/fd 0 2023-12-16T05:56:21.185 INFO:tasks.workunit.client.0.smithi155.stdout:0/41: getdents d7 0 2023-12-16T05:56:21.186 INFO:tasks.workunit.client.0.smithi155.stdout:5/51: getdents d0/d2/d7 0 2023-12-16T05:56:21.188 INFO:tasks.workunit.client.0.smithi155.stdout:5/52: symlink d0/l10 0 2023-12-16T05:56:21.188 INFO:tasks.workunit.client.0.smithi155.stdout:5/53: write d0/d2/f5 [5152870,48035] 0 2023-12-16T05:56:21.202 INFO:tasks.workunit.client.0.smithi155.stdout:0/42: dwrite f2 [4194304,4194304] 0 2023-12-16T05:56:21.204 INFO:tasks.workunit.client.0.smithi155.stdout:0/43: symlink d7/ld 0 2023-12-16T05:56:21.208 INFO:tasks.workunit.client.0.smithi155.stdout:0/44: rename f4 to d7/fe 0 2023-12-16T05:56:21.213 INFO:tasks.workunit.client.0.smithi155.stdout:0/45: mkdir d7/df 0 2023-12-16T05:56:21.213 INFO:tasks.workunit.client.0.smithi155.stdout:0/46: fdatasync d7/fe 0 2023-12-16T05:56:21.219 INFO:tasks.workunit.client.0.smithi155.stdout:5/54: dwrite d0/d2/d7/fe [0,4194304] 0 2023-12-16T05:56:21.220 INFO:tasks.workunit.client.0.smithi155.stdout:5/55: chown d0/d2 3426 1 2023-12-16T05:56:21.222 INFO:tasks.workunit.client.0.smithi155.stdout:5/56: mkdir d0/d2/d11 0 2023-12-16T05:56:21.223 INFO:tasks.workunit.client.0.smithi155.stdout:5/57: read d0/d2/f9 [931130,30999] 0 2023-12-16T05:56:21.225 INFO:tasks.workunit.client.0.smithi155.stdout:5/58: creat d0/d2/d7/f12 x:0 0 0 2023-12-16T05:56:21.225 INFO:tasks.workunit.client.0.smithi155.stdout:5/59: chown d0/d2/d7/f8 10 1 2023-12-16T05:56:21.228 INFO:tasks.workunit.client.0.smithi155.stdout:5/60: read d0/d2/ff [2289400,96061] 0 2023-12-16T05:56:21.229 INFO:tasks.workunit.client.0.smithi155.stdout:5/61: chown d0/d2/d7/fd 239736738 1 2023-12-16T05:56:21.229 INFO:tasks.workunit.client.0.smithi155.stdout:5/62: mknod d0/d2/d11/c13 0 2023-12-16T05:56:21.240 INFO:tasks.workunit.client.0.smithi155.stdout:5/63: dread d0/d2/f9 [0,4194304] 0 2023-12-16T05:56:21.240 INFO:tasks.workunit.client.0.smithi155.stdout:5/64: chown d0/d2/d7/fe 0 1 2023-12-16T05:56:21.240 INFO:tasks.workunit.client.0.smithi155.stdout:5/65: chown d0/c1 118 1 2023-12-16T05:56:21.244 INFO:tasks.workunit.client.0.smithi155.stdout:0/47: dwrite d7/fe [0,4194304] 0 2023-12-16T05:56:21.244 INFO:tasks.workunit.client.0.smithi155.stdout:0/48: chown d7/fc 0 1 2023-12-16T05:56:21.244 INFO:tasks.workunit.client.0.smithi155.stdout:0/49: getdents d7/df 0 2023-12-16T05:56:21.245 INFO:tasks.workunit.client.0.smithi155.stdout:5/66: dread d0/d2/ff [0,4194304] 0 2023-12-16T05:56:21.247 INFO:tasks.workunit.client.0.smithi155.stdout:5/67: write d0/d2/d7/fe [96197,22956] 0 2023-12-16T05:56:21.258 INFO:tasks.workunit.client.0.smithi155.stdout:5/68: dread d0/d2/f6 [0,4194304] 0 2023-12-16T05:56:21.258 INFO:tasks.workunit.client.0.smithi155.stdout:5/69: readlink d0/d2/d7/lc 0 2023-12-16T05:56:21.262 INFO:tasks.workunit.client.0.smithi155.stdout:0/50: dwrite f2 [0,4194304] 0 2023-12-16T05:56:21.264 INFO:tasks.workunit.client.0.smithi155.stdout:0/51: creat d7/df/f10 x:0 0 0 2023-12-16T05:56:21.265 INFO:tasks.workunit.client.0.smithi155.stdout:0/52: creat d7/df/f11 x:0 0 0 2023-12-16T05:56:21.266 INFO:tasks.workunit.client.0.smithi155.stdout:0/53: getdents d7 0 2023-12-16T05:56:21.268 INFO:tasks.workunit.client.0.smithi155.stdout:0/54: rename d7/c8 to d7/c12 0 2023-12-16T05:56:21.279 INFO:tasks.workunit.client.0.smithi155.stdout:5/70: dwrite d0/d2/f9 [0,4194304] 0 2023-12-16T05:56:21.279 INFO:tasks.workunit.client.0.smithi155.stdout:0/55: dread f2 [0,4194304] 0 2023-12-16T05:56:21.280 INFO:tasks.workunit.client.0.smithi155.stdout:0/56: mkdir d7/d13 0 2023-12-16T05:56:21.281 INFO:tasks.workunit.client.0.smithi155.stdout:5/71: dread d0/d2/f6 [0,4194304] 0 2023-12-16T05:56:21.282 INFO:tasks.workunit.client.0.smithi155.stdout:5/72: unlink d0/d2/d11/c13 0 2023-12-16T05:56:21.289 INFO:tasks.workunit.client.0.smithi155.stdout:0/57: dread d7/fe [0,4194304] 0 2023-12-16T05:56:21.291 INFO:tasks.workunit.client.0.smithi155.stdout:0/58: link c3 d7/c14 0 2023-12-16T05:56:21.297 INFO:tasks.workunit.client.0.smithi155.stdout:5/73: dread d0/d2/d7/fe [0,4194304] 0 2023-12-16T05:56:21.297 INFO:tasks.workunit.client.0.smithi155.stdout:5/74: rename d0 to d0/d2/d7/d14 22 2023-12-16T05:56:21.297 INFO:tasks.workunit.client.0.smithi155.stdout:0/59: write d7/fe [637933,4184] 0 2023-12-16T05:56:21.298 INFO:tasks.workunit.client.0.smithi155.stdout:5/75: read d0/d2/d7/fe [2878637,57848] 0 2023-12-16T05:56:21.298 INFO:tasks.workunit.client.0.smithi155.stdout:0/60: write d7/fb [251565,120959] 0 2023-12-16T05:56:21.302 INFO:tasks.workunit.client.0.smithi155.stdout:0/61: dread d7/fb [0,4194304] 0 2023-12-16T05:56:21.304 INFO:tasks.workunit.client.0.smithi155.stdout:0/62: mknod d7/c15 0 2023-12-16T05:56:21.307 INFO:tasks.workunit.client.0.smithi155.stdout:0/63: symlink d7/l16 0 2023-12-16T05:56:21.307 INFO:tasks.workunit.client.0.smithi155.stdout:0/64: write d7/fb [269420,117309] 0 2023-12-16T05:56:21.307 INFO:tasks.workunit.client.0.smithi155.stdout:0/65: write d7/fb [876566,129481] 0 2023-12-16T05:56:21.307 INFO:tasks.workunit.client.0.smithi155.stdout:0/66: write d7/fb [1044648,121764] 0 2023-12-16T05:56:21.308 INFO:tasks.workunit.client.0.smithi155.stdout:0/67: creat d7/d13/f17 x:0 0 0 2023-12-16T05:56:21.312 INFO:tasks.workunit.client.0.smithi155.stdout:0/68: symlink d7/l18 0 2023-12-16T05:56:21.313 INFO:tasks.workunit.client.0.smithi155.stdout:5/76: rmdir d0/d2/d11 0 2023-12-16T05:56:21.314 INFO:tasks.workunit.client.0.smithi155.stdout:5/77: truncate d0/d2/d7/fd 603522 0 2023-12-16T05:56:21.315 INFO:tasks.workunit.client.0.smithi155.stdout:0/69: rename d7/df/f11 to d7/df/f19 0 2023-12-16T05:56:21.316 INFO:tasks.workunit.client.0.smithi155.stdout:0/70: write d7/fb [1257311,125810] 0 2023-12-16T05:56:21.316 INFO:tasks.workunit.client.0.smithi155.stdout:0/71: fsync f2 0 2023-12-16T05:56:21.318 INFO:tasks.workunit.client.0.smithi155.stdout:5/78: unlink d0/d2/d7/f8 0 2023-12-16T05:56:21.319 INFO:tasks.workunit.client.0.smithi155.stdout:5/79: write d0/d2/ff [3693898,41679] 0 2023-12-16T05:56:21.319 INFO:tasks.workunit.client.0.smithi155.stdout:5/80: stat d0/d2 0 2023-12-16T05:56:21.340 INFO:tasks.workunit.client.0.smithi155.stdout:5/81: dwrite d0/d2/d7/fe [0,4194304] 0 2023-12-16T05:56:21.360 INFO:tasks.workunit.client.0.smithi155.stdout:5/82: dwrite d0/d2/f5 [0,4194304] 0 2023-12-16T05:56:21.360 INFO:tasks.workunit.client.0.smithi155.stdout:5/83: chown d0/d2/d7/fd 1694 1 2023-12-16T05:56:21.360 INFO:tasks.workunit.client.0.smithi155.stdout:5/84: fdatasync d0/d2/d7/fd 0 2023-12-16T05:56:21.360 INFO:tasks.workunit.client.0.smithi155.stdout:5/85: write d0/d2/d7/fd [1324313,111551] 0 2023-12-16T05:56:21.360 INFO:tasks.workunit.client.0.smithi155.stdout:5/86: creat d0/f15 x:0 0 0 2023-12-16T05:56:21.361 INFO:tasks.workunit.client.0.smithi155.stdout:5/87: link d0/d2/ff d0/d2/d7/f16 0 2023-12-16T05:56:21.362 INFO:tasks.workunit.client.0.smithi155.stdout:5/88: chown d0/d2/ff 3 1 2023-12-16T05:56:21.374 INFO:tasks.workunit.client.0.smithi155.stdout:5/89: dwrite d0/f15 [0,4194304] 0 2023-12-16T05:56:21.382 INFO:tasks.workunit.client.0.smithi155.stdout:5/90: dread d0/d2/d7/f16 [0,4194304] 0 2023-12-16T05:56:21.383 INFO:tasks.workunit.client.0.smithi155.stdout:5/91: mknod d0/d2/d7/c17 0 2023-12-16T05:56:22.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:22 smithi156 ceph-mon[121001]: pgmap v7: 65 pgs: 65 active+clean; 213 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 1.32k op/s 2023-12-16T05:56:22.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:22 smithi156 ceph-mon[121001]: Standby manager daemon smithi155.maowdn started 2023-12-16T05:56:22.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:22 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.155:0/2053289017' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.maowdn/crt"}]: dispatch 2023-12-16T05:56:22.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:22 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.155:0/2053289017' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T05:56:22.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:22 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.155:0/2053289017' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.maowdn/key"}]: dispatch 2023-12-16T05:56:22.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:22 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.155:0/2053289017' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T05:56:22.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:22 smithi155 ceph-mon[112451]: pgmap v7: 65 pgs: 65 active+clean; 213 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 1.32k op/s 2023-12-16T05:56:22.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:22 smithi155 ceph-mon[112451]: Standby manager daemon smithi155.maowdn started 2023-12-16T05:56:22.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:22 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.155:0/2053289017' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.maowdn/crt"}]: dispatch 2023-12-16T05:56:22.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:22 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.155:0/2053289017' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T05:56:22.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:22 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.155:0/2053289017' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.maowdn/key"}]: dispatch 2023-12-16T05:56:22.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:22 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.155:0/2053289017' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T05:56:22.760 INFO:tasks.workunit.client.1.smithi156.stderr:++ readlink -f fsstress 2023-12-16T05:56:22.760 INFO:tasks.workunit.client.1.smithi156.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-16T05:56:22.761 INFO:tasks.workunit.client.1.smithi156.stderr:+ popd 2023-12-16T05:56:22.762 INFO:tasks.workunit.client.1.smithi156.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-16T05:56:22.762 INFO:tasks.workunit.client.1.smithi156.stderr:+ popd 2023-12-16T05:56:22.762 INFO:tasks.workunit.client.1.smithi156.stdout:~/cephtest/mnt.1/client.1/tmp 2023-12-16T05:56:22.763 INFO:tasks.workunit.client.1.smithi156.stderr:++ mktemp -d -p . 2023-12-16T05:56:22.764 INFO:tasks.workunit.client.1.smithi156.stderr:+ T=./tmp.q7G600Nua7 2023-12-16T05:56:22.764 INFO:tasks.workunit.client.1.smithi156.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.q7G600Nua7 -l 1 -n 1000 -p 10 -v 2023-12-16T05:56:22.765 INFO:tasks.workunit.client.1.smithi156.stdout:seed = 1702271927 2023-12-16T05:56:22.768 INFO:tasks.workunit.client.1.smithi156.stdout:0/0: stat - no entries 2023-12-16T05:56:22.768 INFO:tasks.workunit.client.1.smithi156.stdout:0/1: truncate - no filename 2023-12-16T05:56:22.768 INFO:tasks.workunit.client.1.smithi156.stdout:0/2: write - no filename 2023-12-16T05:56:22.769 INFO:tasks.workunit.client.1.smithi156.stdout:0/3: rename - no filename 2023-12-16T05:56:22.769 INFO:tasks.workunit.client.1.smithi156.stdout:0/4: getdents . 0 2023-12-16T05:56:22.769 INFO:tasks.workunit.client.1.smithi156.stdout:0/5: unlink - no file 2023-12-16T05:56:22.769 INFO:tasks.workunit.client.1.smithi156.stdout:1/0: dwrite - no filename 2023-12-16T05:56:22.769 INFO:tasks.workunit.client.1.smithi156.stdout:1/1: write - no filename 2023-12-16T05:56:22.770 INFO:tasks.workunit.client.1.smithi156.stdout:0/6: creat f0 x:0 0 0 2023-12-16T05:56:22.770 INFO:tasks.workunit.client.1.smithi156.stdout:0/7: fdatasync f0 0 2023-12-16T05:56:22.773 INFO:tasks.workunit.client.1.smithi156.stdout:2/0: stat - no entries 2023-12-16T05:56:22.773 INFO:tasks.workunit.client.1.smithi156.stdout:2/1: truncate - no filename 2023-12-16T05:56:22.776 INFO:tasks.workunit.client.1.smithi156.stdout:2/2: creat f0 x:0 0 0 2023-12-16T05:56:22.776 INFO:tasks.workunit.client.1.smithi156.stdout:2/3: truncate f0 486625 0 2023-12-16T05:56:22.776 INFO:tasks.workunit.client.1.smithi156.stdout:2/4: chown f0 3 1 2023-12-16T05:56:22.776 INFO:tasks.workunit.client.1.smithi156.stdout:2/5: fdatasync f0 0 2023-12-16T05:56:22.776 INFO:tasks.workunit.client.1.smithi156.stdout:2/6: write f0 [132415,99044] 0 2023-12-16T05:56:22.779 INFO:tasks.workunit.client.1.smithi156.stdout:5/0: rename - no filename 2023-12-16T05:56:22.779 INFO:tasks.workunit.client.1.smithi156.stdout:5/1: link - no file 2023-12-16T05:56:22.780 INFO:tasks.workunit.client.1.smithi156.stdout:4/0: creat f0 x:0 0 0 2023-12-16T05:56:22.782 INFO:tasks.workunit.client.1.smithi156.stdout:6/0: getdents . 0 2023-12-16T05:56:22.782 INFO:tasks.workunit.client.1.smithi156.stdout:6/1: dwrite - no filename 2023-12-16T05:56:22.782 INFO:tasks.workunit.client.1.smithi156.stdout:6/2: dread - no filename 2023-12-16T05:56:22.782 INFO:tasks.workunit.client.1.smithi156.stdout:6/3: write - no filename 2023-12-16T05:56:22.782 INFO:tasks.workunit.client.1.smithi156.stdout:6/4: getdents . 0 2023-12-16T05:56:22.790 INFO:tasks.workunit.client.1.smithi156.stdout:5/2: creat f0 x:0 0 0 2023-12-16T05:56:22.790 INFO:tasks.workunit.client.1.smithi156.stdout:5/3: read - f0 zero size 2023-12-16T05:56:22.791 INFO:tasks.workunit.client.1.smithi156.stdout:5/4: write f0 [972310,104664] 0 2023-12-16T05:56:22.795 INFO:tasks.workunit.client.1.smithi156.stdout:6/5: creat f0 x:0 0 0 2023-12-16T05:56:22.795 INFO:tasks.workunit.client.1.smithi156.stdout:6/6: write f0 [237300,16046] 0 2023-12-16T05:56:22.795 INFO:tasks.workunit.client.1.smithi156.stdout:0/8: dwrite f0 [0,4194304] 0 2023-12-16T05:56:22.796 INFO:tasks.workunit.client.1.smithi156.stdout:8/0: read - no filename 2023-12-16T05:56:22.796 INFO:tasks.workunit.client.1.smithi156.stdout:8/1: write - no filename 2023-12-16T05:56:22.796 INFO:tasks.workunit.client.1.smithi156.stdout:8/2: truncate - no filename 2023-12-16T05:56:22.796 INFO:tasks.workunit.client.1.smithi156.stdout:8/3: write - no filename 2023-12-16T05:56:22.796 INFO:tasks.workunit.client.1.smithi156.stdout:7/0: creat f0 x:0 0 0 2023-12-16T05:56:22.797 INFO:tasks.workunit.client.1.smithi156.stdout:5/5: symlink l1 0 2023-12-16T05:56:22.799 INFO:tasks.workunit.client.1.smithi156.stdout:2/7: dwrite f0 [0,4194304] 0 2023-12-16T05:56:22.801 INFO:tasks.workunit.client.1.smithi156.stdout:9/0: chown . 121 1 2023-12-16T05:56:22.801 INFO:tasks.workunit.client.1.smithi156.stdout:9/1: dread - no filename 2023-12-16T05:56:22.801 INFO:tasks.workunit.client.1.smithi156.stdout:9/2: write - no filename 2023-12-16T05:56:22.802 INFO:tasks.workunit.client.1.smithi156.stdout:8/4: mkdir d0 0 2023-12-16T05:56:22.802 INFO:tasks.workunit.client.1.smithi156.stdout:8/5: chown d0 372 1 2023-12-16T05:56:22.802 INFO:tasks.workunit.client.1.smithi156.stdout:8/6: stat d0 0 2023-12-16T05:56:22.802 INFO:tasks.workunit.client.1.smithi156.stdout:8/7: write - no filename 2023-12-16T05:56:22.802 INFO:tasks.workunit.client.1.smithi156.stdout:8/8: fsync - no filename 2023-12-16T05:56:22.803 INFO:tasks.workunit.client.1.smithi156.stdout:7/1: unlink f0 0 2023-12-16T05:56:22.803 INFO:tasks.workunit.client.1.smithi156.stdout:7/2: link - no file 2023-12-16T05:56:22.803 INFO:tasks.workunit.client.1.smithi156.stdout:7/3: rename - no filename 2023-12-16T05:56:22.804 INFO:tasks.workunit.client.1.smithi156.stdout:5/6: creat f2 x:0 0 0 2023-12-16T05:56:22.804 INFO:tasks.workunit.client.1.smithi156.stdout:5/7: stat f0 0 2023-12-16T05:56:22.806 INFO:tasks.workunit.client.1.smithi156.stdout:2/8: rename f0 to f1 0 2023-12-16T05:56:22.807 INFO:tasks.workunit.client.1.smithi156.stdout:2/9: write f1 [2258789,120920] 0 2023-12-16T05:56:22.807 INFO:tasks.workunit.client.1.smithi156.stdout:9/3: creat f0 x:0 0 0 2023-12-16T05:56:22.809 INFO:tasks.workunit.client.1.smithi156.stdout:8/9: rmdir d0 0 2023-12-16T05:56:22.810 INFO:tasks.workunit.client.1.smithi156.stdout:7/4: mknod c1 0 2023-12-16T05:56:22.810 INFO:tasks.workunit.client.1.smithi156.stdout:4/1: dwrite f0 [0,4194304] 0 2023-12-16T05:56:22.813 INFO:tasks.workunit.client.1.smithi156.stdout:8/10: creat f1 x:0 0 0 2023-12-16T05:56:22.814 INFO:tasks.workunit.client.1.smithi156.stdout:8/11: readlink - no filename 2023-12-16T05:56:22.814 INFO:tasks.workunit.client.1.smithi156.stdout:8/12: dread - f1 zero size 2023-12-16T05:56:22.814 INFO:tasks.workunit.client.1.smithi156.stdout:8/13: fdatasync f1 0 2023-12-16T05:56:22.814 INFO:tasks.workunit.client.1.smithi156.stdout:5/8: dread f0 [0,4194304] 0 2023-12-16T05:56:22.815 INFO:tasks.workunit.client.1.smithi156.stdout:7/5: mknod c2 0 2023-12-16T05:56:22.815 INFO:tasks.workunit.client.1.smithi156.stdout:7/6: truncate - no filename 2023-12-16T05:56:22.815 INFO:tasks.workunit.client.1.smithi156.stdout:7/7: dwrite - no filename 2023-12-16T05:56:22.815 INFO:tasks.workunit.client.1.smithi156.stdout:7/8: truncate - no filename 2023-12-16T05:56:22.818 INFO:tasks.workunit.client.1.smithi156.stdout:4/2: creat f1 x:0 0 0 2023-12-16T05:56:22.818 INFO:tasks.workunit.client.1.smithi156.stdout:4/3: write f1 [618176,87954] 0 2023-12-16T05:56:22.819 INFO:tasks.workunit.client.1.smithi156.stdout:8/14: unlink f1 0 2023-12-16T05:56:22.819 INFO:tasks.workunit.client.1.smithi156.stdout:8/15: stat - no entries 2023-12-16T05:56:22.819 INFO:tasks.workunit.client.1.smithi156.stdout:8/16: readlink - no filename 2023-12-16T05:56:22.819 INFO:tasks.workunit.client.1.smithi156.stdout:8/17: dwrite - no filename 2023-12-16T05:56:22.820 INFO:tasks.workunit.client.1.smithi156.stdout:0/9: dread f0 [0,4194304] 0 2023-12-16T05:56:22.820 INFO:tasks.workunit.client.1.smithi156.stdout:0/10: truncate f0 4937619 0 2023-12-16T05:56:22.820 INFO:tasks.workunit.client.1.smithi156.stdout:7/9: mknod c3 0 2023-12-16T05:56:22.820 INFO:tasks.workunit.client.1.smithi156.stdout:7/10: readlink - no filename 2023-12-16T05:56:22.822 INFO:tasks.workunit.client.1.smithi156.stdout:8/18: creat f2 x:0 0 0 2023-12-16T05:56:22.826 INFO:tasks.workunit.client.1.smithi156.stdout:7/11: unlink c1 0 2023-12-16T05:56:22.826 INFO:tasks.workunit.client.1.smithi156.stdout:7/12: write - no filename 2023-12-16T05:56:22.828 INFO:tasks.workunit.client.1.smithi156.stdout:8/19: mkdir d3 0 2023-12-16T05:56:22.828 INFO:tasks.workunit.client.1.smithi156.stdout:8/20: write f2 [959761,105074] 0 2023-12-16T05:56:22.829 INFO:tasks.workunit.client.1.smithi156.stdout:7/13: unlink c2 0 2023-12-16T05:56:22.830 INFO:tasks.workunit.client.1.smithi156.stdout:8/21: mkdir d3/d4 0 2023-12-16T05:56:22.832 INFO:tasks.workunit.client.1.smithi156.stdout:7/14: creat f4 x:0 0 0 2023-12-16T05:56:22.833 INFO:tasks.workunit.client.1.smithi156.stdout:8/22: link f2 d3/d4/f5 0 2023-12-16T05:56:22.835 INFO:tasks.workunit.client.1.smithi156.stdout:7/15: symlink l5 0 2023-12-16T05:56:22.841 INFO:tasks.workunit.client.1.smithi156.stdout:5/9: dwrite f0 [0,4194304] 0 2023-12-16T05:56:22.845 INFO:tasks.workunit.client.1.smithi156.stdout:4/4: dwrite f0 [0,4194304] 0 2023-12-16T05:56:22.845 INFO:tasks.workunit.client.1.smithi156.stdout:4/5: chown f0 389 1 2023-12-16T05:56:22.845 INFO:tasks.workunit.client.1.smithi156.stdout:4/6: chown f1 262792939 1 2023-12-16T05:56:22.846 INFO:tasks.workunit.client.1.smithi156.stdout:5/10: write f0 [1441675,9438] 0 2023-12-16T05:56:22.846 INFO:tasks.workunit.client.1.smithi156.stdout:5/11: dread - f2 zero size 2023-12-16T05:56:22.850 INFO:tasks.workunit.client.1.smithi156.stdout:5/12: mknod c3 0 2023-12-16T05:56:22.852 INFO:tasks.workunit.client.1.smithi156.stdout:4/7: fdatasync f1 0 2023-12-16T05:56:22.852 INFO:tasks.workunit.client.1.smithi156.stdout:5/13: creat f4 x:0 0 0 2023-12-16T05:56:22.852 INFO:tasks.workunit.client.1.smithi156.stdout:4/8: write f1 [903238,73228] 0 2023-12-16T05:56:22.852 INFO:tasks.workunit.client.1.smithi156.stdout:7/16: dwrite f4 [0,4194304] 0 2023-12-16T05:56:22.853 INFO:tasks.workunit.client.1.smithi156.stdout:5/14: mknod c5 0 2023-12-16T05:56:22.855 INFO:tasks.workunit.client.1.smithi156.stdout:0/11: dwrite f0 [0,4194304] 0 2023-12-16T05:56:22.855 INFO:tasks.workunit.client.1.smithi156.stdout:0/12: chown f0 99908 1 2023-12-16T05:56:22.856 INFO:tasks.workunit.client.1.smithi156.stdout:5/15: creat f6 x:0 0 0 2023-12-16T05:56:22.856 INFO:tasks.workunit.client.1.smithi156.stdout:0/13: mknod c1 0 2023-12-16T05:56:22.857 INFO:tasks.workunit.client.1.smithi156.stdout:0/14: rmdir - no directory 2023-12-16T05:56:22.857 INFO:tasks.workunit.client.1.smithi156.stdout:5/16: symlink l7 0 2023-12-16T05:56:22.858 INFO:tasks.workunit.client.1.smithi156.stdout:0/15: write f0 [3786235,16856] 0 2023-12-16T05:56:22.859 INFO:tasks.workunit.client.1.smithi156.stdout:0/16: mkdir d2 0 2023-12-16T05:56:22.860 INFO:tasks.workunit.client.1.smithi156.stdout:0/17: mknod d2/c3 0 2023-12-16T05:56:22.860 INFO:tasks.workunit.client.1.smithi156.stdout:0/18: stat d2 0 2023-12-16T05:56:22.861 INFO:tasks.workunit.client.1.smithi156.stdout:0/19: symlink d2/l4 0 2023-12-16T05:56:22.875 INFO:tasks.workunit.client.1.smithi156.stdout:5/17: dwrite f4 [0,4194304] 0 2023-12-16T05:56:22.880 INFO:tasks.workunit.client.1.smithi156.stdout:4/9: dread f0 [0,4194304] 0 2023-12-16T05:56:22.881 INFO:tasks.workunit.client.1.smithi156.stdout:4/10: unlink f1 0 2023-12-16T05:56:22.882 INFO:tasks.workunit.client.1.smithi156.stdout:4/11: creat f2 x:0 0 0 2023-12-16T05:56:22.882 INFO:tasks.workunit.client.1.smithi156.stdout:4/12: rmdir - no directory 2023-12-16T05:56:22.882 INFO:tasks.workunit.client.1.smithi156.stdout:4/13: stat f0 0 2023-12-16T05:56:22.883 INFO:tasks.workunit.client.1.smithi156.stdout:4/14: creat f3 x:0 0 0 2023-12-16T05:56:22.893 INFO:tasks.workunit.client.1.smithi156.stdout:5/18: dwrite f2 [0,4194304] 0 2023-12-16T05:56:22.894 INFO:tasks.workunit.client.1.smithi156.stdout:5/19: chown c5 84595131 1 2023-12-16T05:56:22.897 INFO:tasks.workunit.client.1.smithi156.stdout:5/20: rename l7 to l8 0 2023-12-16T05:56:22.897 INFO:tasks.workunit.client.1.smithi156.stdout:5/21: readlink l8 0 2023-12-16T05:56:22.899 INFO:tasks.workunit.client.1.smithi156.stdout:0/20: dwrite f0 [0,4194304] 0 2023-12-16T05:56:22.900 INFO:tasks.workunit.client.1.smithi156.stdout:0/21: write f0 [3436573,2323] 0 2023-12-16T05:56:22.900 INFO:tasks.workunit.client.1.smithi156.stdout:0/22: stat d2 0 2023-12-16T05:56:22.904 INFO:tasks.workunit.client.1.smithi156.stdout:5/22: dread f2 [0,4194304] 0 2023-12-16T05:56:23.009 INFO:tasks.workunit.client.1.smithi156.stdout:0/23: fsync f0 0 2023-12-16T05:56:23.011 INFO:tasks.workunit.client.1.smithi156.stdout:4/15: fsync f0 0 2023-12-16T05:56:23.011 INFO:tasks.workunit.client.1.smithi156.stdout:4/16: read - f2 zero size 2023-12-16T05:56:23.013 INFO:tasks.workunit.client.1.smithi156.stdout:6/7: fsync f0 0 2023-12-16T05:56:23.014 INFO:tasks.workunit.client.1.smithi156.stdout:6/8: creat f1 x:0 0 0 2023-12-16T05:56:23.015 INFO:tasks.workunit.client.1.smithi156.stdout:6/9: stat f0 0 2023-12-16T05:56:23.016 INFO:tasks.workunit.client.1.smithi156.stdout:6/10: creat f2 x:0 0 0 2023-12-16T05:56:23.018 INFO:tasks.workunit.client.1.smithi156.stdout:6/11: rename f2 to f3 0 2023-12-16T05:56:23.018 INFO:tasks.workunit.client.1.smithi156.stdout:6/12: fdatasync f0 0 2023-12-16T05:56:23.023 INFO:tasks.workunit.client.1.smithi156.stdout:2/10: link f1 f2 0 2023-12-16T05:56:23.023 INFO:tasks.workunit.client.1.smithi156.stdout:2/11: chown f2 224 1 2023-12-16T05:56:23.024 INFO:tasks.workunit.client.1.smithi156.stdout:2/12: symlink l3 0 2023-12-16T05:56:23.025 INFO:tasks.workunit.client.1.smithi156.stdout:2/13: creat f4 x:0 0 0 2023-12-16T05:56:23.026 INFO:tasks.workunit.client.1.smithi156.stdout:9/4: getdents . 0 2023-12-16T05:56:23.028 INFO:tasks.workunit.client.1.smithi156.stdout:2/14: rename f4 to f5 0 2023-12-16T05:56:23.029 INFO:tasks.workunit.client.1.smithi156.stdout:2/15: stat f5 0 2023-12-16T05:56:23.030 INFO:tasks.workunit.client.1.smithi156.stdout:9/5: symlink l1 0 2023-12-16T05:56:23.031 INFO:tasks.workunit.client.1.smithi156.stdout:9/6: dread - f0 zero size 2023-12-16T05:56:23.031 INFO:tasks.workunit.client.1.smithi156.stdout:9/7: stat f0 0 2023-12-16T05:56:23.031 INFO:tasks.workunit.client.1.smithi156.stdout:9/8: dread - f0 zero size 2023-12-16T05:56:23.031 INFO:tasks.workunit.client.1.smithi156.stdout:9/9: fdatasync f0 0 2023-12-16T05:56:23.032 INFO:tasks.workunit.client.1.smithi156.stdout:0/24: dread f0 [0,4194304] 0 2023-12-16T05:56:23.032 INFO:tasks.workunit.client.1.smithi156.stdout:4/17: dwrite f0 [0,4194304] 0 2023-12-16T05:56:23.033 INFO:tasks.workunit.client.1.smithi156.stdout:9/10: mknod c2 0 2023-12-16T05:56:23.033 INFO:tasks.workunit.client.1.smithi156.stdout:9/11: dread - f0 zero size 2023-12-16T05:56:23.034 INFO:tasks.workunit.client.1.smithi156.stdout:4/18: creat f4 x:0 0 0 2023-12-16T05:56:23.034 INFO:tasks.workunit.client.1.smithi156.stdout:4/19: chown f0 10836822 1 2023-12-16T05:56:23.035 INFO:tasks.workunit.client.1.smithi156.stdout:4/20: write f4 [859534,32791] 0 2023-12-16T05:56:23.040 INFO:tasks.workunit.client.1.smithi156.stdout:9/12: rename f0 to f3 0 2023-12-16T05:56:23.040 INFO:tasks.workunit.client.1.smithi156.stdout:2/16: dread f1 [0,4194304] 0 2023-12-16T05:56:23.047 INFO:tasks.workunit.client.1.smithi156.stdout:9/13: mkdir d4 0 2023-12-16T05:56:23.047 INFO:tasks.workunit.client.1.smithi156.stdout:9/14: read - f3 zero size 2023-12-16T05:56:23.051 INFO:tasks.workunit.client.1.smithi156.stdout:9/15: rmdir d4 0 2023-12-16T05:56:23.052 INFO:tasks.workunit.client.1.smithi156.stdout:9/16: write f3 [327082,114628] 0 2023-12-16T05:56:23.052 INFO:tasks.workunit.client.1.smithi156.stdout:7/17: getdents . 0 2023-12-16T05:56:23.053 INFO:tasks.workunit.client.1.smithi156.stdout:8/23: rename d3/d4 to d3/d6 0 2023-12-16T05:56:23.053 INFO:tasks.workunit.client.1.smithi156.stdout:8/24: chown d3 6736 1 2023-12-16T05:56:23.054 INFO:tasks.workunit.client.1.smithi156.stdout:5/23: write f0 [5056219,51046] 0 2023-12-16T05:56:23.055 INFO:tasks.workunit.client.1.smithi156.stdout:8/25: mkdir d3/d7 0 2023-12-16T05:56:23.056 INFO:tasks.workunit.client.1.smithi156.stdout:5/24: write f0 [2333966,83761] 0 2023-12-16T05:56:23.057 INFO:tasks.workunit.client.1.smithi156.stdout:9/17: rename l1 to l5 0 2023-12-16T05:56:23.057 INFO:tasks.workunit.client.1.smithi156.stdout:9/18: truncate f3 550209 0 2023-12-16T05:56:23.057 INFO:tasks.workunit.client.1.smithi156.stdout:9/19: chown f3 348322933 1 2023-12-16T05:56:23.058 INFO:tasks.workunit.client.1.smithi156.stdout:8/26: creat d3/f8 x:0 0 0 2023-12-16T05:56:23.059 INFO:tasks.workunit.client.1.smithi156.stdout:5/25: symlink l9 0 2023-12-16T05:56:23.060 INFO:tasks.workunit.client.1.smithi156.stdout:8/27: mkdir d3/d7/d9 0 2023-12-16T05:56:23.061 INFO:tasks.workunit.client.1.smithi156.stdout:2/17: dwrite f2 [0,4194304] 0 2023-12-16T05:56:23.061 INFO:tasks.workunit.client.1.smithi156.stdout:0/25: dwrite f0 [0,4194304] 0 2023-12-16T05:56:23.065 INFO:tasks.workunit.client.1.smithi156.stdout:8/28: mknod d3/d7/d9/ca 0 2023-12-16T05:56:23.065 INFO:tasks.workunit.client.1.smithi156.stdout:8/29: write d3/d6/f5 [1288921,72344] 0 2023-12-16T05:56:23.065 INFO:tasks.workunit.client.1.smithi156.stdout:7/18: dread f4 [0,4194304] 0 2023-12-16T05:56:23.067 INFO:tasks.workunit.client.1.smithi156.stdout:2/18: symlink l6 0 2023-12-16T05:56:23.072 INFO:tasks.workunit.client.1.smithi156.stdout:0/26: creat d2/f5 x:0 0 0 2023-12-16T05:56:23.079 INFO:tasks.workunit.client.1.smithi156.stdout:2/19: dread f1 [0,4194304] 0 2023-12-16T05:56:23.080 INFO:tasks.workunit.client.1.smithi156.stdout:5/26: unlink f6 0 2023-12-16T05:56:23.080 INFO:tasks.workunit.client.1.smithi156.stdout:5/27: truncate f0 5450406 0 2023-12-16T05:56:23.080 INFO:tasks.workunit.client.1.smithi156.stdout:5/28: stat f4 0 2023-12-16T05:56:23.082 INFO:tasks.workunit.client.1.smithi156.stdout:8/30: mknod d3/cb 0 2023-12-16T05:56:23.084 INFO:tasks.workunit.client.1.smithi156.stdout:9/20: dwrite f3 [0,4194304] 0 2023-12-16T05:56:23.084 INFO:tasks.workunit.client.1.smithi156.stdout:7/19: dwrite f4 [0,4194304] 0 2023-12-16T05:56:23.085 INFO:tasks.workunit.client.1.smithi156.stdout:2/20: creat f7 x:0 0 0 2023-12-16T05:56:23.085 INFO:tasks.workunit.client.1.smithi156.stdout:9/21: write f3 [1590806,8608] 0 2023-12-16T05:56:23.087 INFO:tasks.workunit.client.1.smithi156.stdout:5/29: mkdir da 0 2023-12-16T05:56:23.091 INFO:tasks.workunit.client.1.smithi156.stdout:0/27: dwrite d2/f5 [0,4194304] 0 2023-12-16T05:56:23.093 INFO:tasks.workunit.client.1.smithi156.stdout:7/20: symlink l6 0 2023-12-16T05:56:23.093 INFO:tasks.workunit.client.1.smithi156.stdout:7/21: fdatasync f4 0 2023-12-16T05:56:23.095 INFO:tasks.workunit.client.1.smithi156.stdout:6/13: getdents . 0 2023-12-16T05:56:23.100 INFO:tasks.workunit.client.1.smithi156.stdout:9/22: mkdir d6 0 2023-12-16T05:56:23.102 INFO:tasks.workunit.client.1.smithi156.stdout:7/22: dread f4 [0,4194304] 0 2023-12-16T05:56:23.102 INFO:tasks.workunit.client.1.smithi156.stdout:9/23: write f3 [2619270,43841] 0 2023-12-16T05:56:23.102 INFO:tasks.workunit.client.1.smithi156.stdout:5/30: dread f0 [4194304,4194304] 0 2023-12-16T05:56:23.102 INFO:tasks.workunit.client.1.smithi156.stdout:5/31: fdatasync f2 0 2023-12-16T05:56:23.102 INFO:tasks.workunit.client.1.smithi156.stdout:5/32: fsync f0 0 2023-12-16T05:56:23.102 INFO:tasks.workunit.client.1.smithi156.stdout:5/33: chown l1 28762651 1 2023-12-16T05:56:23.102 INFO:tasks.workunit.client.1.smithi156.stdout:0/28: dread f0 [0,4194304] 0 2023-12-16T05:56:23.102 INFO:tasks.workunit.client.1.smithi156.stdout:0/29: fdatasync d2/f5 0 2023-12-16T05:56:23.104 INFO:tasks.workunit.client.1.smithi156.stdout:7/23: creat f7 x:0 0 0 2023-12-16T05:56:23.104 INFO:tasks.workunit.client.1.smithi156.stdout:7/24: dread - f7 zero size 2023-12-16T05:56:23.104 INFO:tasks.workunit.client.1.smithi156.stdout:7/25: chown f4 2032840805 1 2023-12-16T05:56:23.104 INFO:tasks.workunit.client.1.smithi156.stdout:7/26: write f7 [364017,105473] 0 2023-12-16T05:56:23.105 INFO:tasks.workunit.client.1.smithi156.stdout:9/24: creat d6/f7 x:0 0 0 2023-12-16T05:56:23.105 INFO:tasks.workunit.client.1.smithi156.stdout:9/25: write f3 [195336,120610] 0 2023-12-16T05:56:23.107 INFO:tasks.workunit.client.1.smithi156.stdout:5/34: mknod da/cb 0 2023-12-16T05:56:23.107 INFO:tasks.workunit.client.1.smithi156.stdout:5/35: chown l9 4 1 2023-12-16T05:56:23.108 INFO:tasks.workunit.client.1.smithi156.stdout:7/27: creat f8 x:0 0 0 2023-12-16T05:56:23.109 INFO:tasks.workunit.client.1.smithi156.stdout:9/26: mknod d6/c8 0 2023-12-16T05:56:23.111 INFO:tasks.workunit.client.1.smithi156.stdout:7/28: creat f9 x:0 0 0 2023-12-16T05:56:23.112 INFO:tasks.workunit.client.1.smithi156.stdout:9/27: creat d6/f9 x:0 0 0 2023-12-16T05:56:23.113 INFO:tasks.workunit.client.1.smithi156.stdout:5/36: write f0 [34379,116083] 0 2023-12-16T05:56:23.113 INFO:tasks.workunit.client.1.smithi156.stdout:5/37: fdatasync f2 0 2023-12-16T05:56:23.114 INFO:tasks.workunit.client.1.smithi156.stdout:7/29: rename f8 to fa 0 2023-12-16T05:56:23.114 INFO:tasks.workunit.client.1.smithi156.stdout:7/30: write fa [175195,17682] 0 2023-12-16T05:56:23.114 INFO:tasks.workunit.client.1.smithi156.stdout:7/31: chown c3 4 1 2023-12-16T05:56:23.115 INFO:tasks.workunit.client.1.smithi156.stdout:7/32: write f4 [1652615,94490] 0 2023-12-16T05:56:23.115 INFO:tasks.workunit.client.1.smithi156.stdout:0/30: dread d2/f5 [0,4194304] 0 2023-12-16T05:56:23.115 INFO:tasks.workunit.client.1.smithi156.stdout:0/31: chown d2/c3 189 1 2023-12-16T05:56:23.116 INFO:tasks.workunit.client.1.smithi156.stdout:0/32: mknod d2/c6 0 2023-12-16T05:56:23.120 INFO:tasks.workunit.client.1.smithi156.stdout:0/33: write d2/f5 [1855242,16332] 0 2023-12-16T05:56:23.125 INFO:tasks.workunit.client.1.smithi156.stdout:8/31: dwrite f2 [0,4194304] 0 2023-12-16T05:56:23.127 INFO:tasks.workunit.client.1.smithi156.stdout:8/32: mknod d3/d7/cc 0 2023-12-16T05:56:23.128 INFO:tasks.workunit.client.1.smithi156.stdout:8/33: write d3/d6/f5 [1528173,89791] 0 2023-12-16T05:56:23.129 INFO:tasks.workunit.client.1.smithi156.stdout:8/34: mknod d3/d6/cd 0 2023-12-16T05:56:23.129 INFO:tasks.workunit.client.1.smithi156.stdout:8/35: readlink - no filename 2023-12-16T05:56:23.130 INFO:tasks.workunit.client.1.smithi156.stdout:8/36: getdents d3/d7/d9 0 2023-12-16T05:56:23.132 INFO:tasks.workunit.client.1.smithi156.stdout:8/37: unlink d3/d7/cc 0 2023-12-16T05:56:23.136 INFO:tasks.workunit.client.1.smithi156.stdout:9/28: dwrite d6/f9 [0,4194304] 0 2023-12-16T05:56:23.141 INFO:tasks.workunit.client.1.smithi156.stdout:9/29: symlink d6/la 0 2023-12-16T05:56:23.141 INFO:tasks.workunit.client.1.smithi156.stdout:9/30: fdatasync d6/f9 0 2023-12-16T05:56:23.142 INFO:tasks.workunit.client.1.smithi156.stdout:9/31: mknod d6/cb 0 2023-12-16T05:56:23.142 INFO:tasks.workunit.client.1.smithi156.stdout:5/38: dread f4 [0,4194304] 0 2023-12-16T05:56:23.142 INFO:tasks.workunit.client.1.smithi156.stdout:6/14: dwrite f3 [0,4194304] 0 2023-12-16T05:56:23.143 INFO:tasks.workunit.client.1.smithi156.stdout:2/21: dwrite f2 [4194304,4194304] 0 2023-12-16T05:56:23.147 INFO:tasks.workunit.client.1.smithi156.stdout:0/34: truncate d2/f5 3354004 0 2023-12-16T05:56:23.147 INFO:tasks.workunit.client.1.smithi156.stdout:9/32: write d6/f9 [3333537,100307] 0 2023-12-16T05:56:23.147 INFO:tasks.workunit.client.1.smithi156.stdout:9/33: chown d6/la 13074 1 2023-12-16T05:56:23.149 INFO:tasks.workunit.client.1.smithi156.stdout:8/38: dread f2 [0,4194304] 0 2023-12-16T05:56:23.149 INFO:tasks.workunit.client.1.smithi156.stdout:8/39: truncate d3/f8 1311 0 2023-12-16T05:56:23.149 INFO:tasks.workunit.client.1.smithi156.stdout:5/39: dread f2 [0,4194304] 0 2023-12-16T05:56:23.151 INFO:tasks.workunit.client.1.smithi156.stdout:2/22: dread f1 [0,4194304] 0 2023-12-16T05:56:23.151 INFO:tasks.workunit.client.1.smithi156.stdout:2/23: fdatasync f1 0 2023-12-16T05:56:23.153 INFO:tasks.workunit.client.1.smithi156.stdout:8/40: creat d3/fe x:0 0 0 2023-12-16T05:56:23.153 INFO:tasks.workunit.client.1.smithi156.stdout:8/41: chown d3/d6 930977 1 2023-12-16T05:56:23.153 INFO:tasks.workunit.client.1.smithi156.stdout:8/42: chown d3 863607 1 2023-12-16T05:56:23.153 INFO:tasks.workunit.client.1.smithi156.stdout:5/40: mkdir da/dc 0 2023-12-16T05:56:23.153 INFO:tasks.workunit.client.1.smithi156.stdout:2/24: creat f8 x:0 0 0 2023-12-16T05:56:23.153 INFO:tasks.workunit.client.1.smithi156.stdout:7/33: dwrite f7 [0,4194304] 0 2023-12-16T05:56:23.153 INFO:tasks.workunit.client.1.smithi156.stdout:7/34: fsync f4 0 2023-12-16T05:56:23.153 INFO:tasks.workunit.client.1.smithi156.stdout:7/35: truncate f4 4495253 0 2023-12-16T05:56:23.154 INFO:tasks.workunit.client.1.smithi156.stdout:0/35: dread f0 [0,4194304] 0 2023-12-16T05:56:23.155 INFO:tasks.workunit.client.1.smithi156.stdout:8/43: creat d3/ff x:0 0 0 2023-12-16T05:56:23.156 INFO:tasks.workunit.client.1.smithi156.stdout:5/41: creat da/dc/fd x:0 0 0 2023-12-16T05:56:23.160 INFO:tasks.workunit.client.1.smithi156.stdout:2/25: mkdir d9 0 2023-12-16T05:56:23.160 INFO:tasks.workunit.client.1.smithi156.stdout:0/36: dread f0 [0,4194304] 0 2023-12-16T05:56:23.161 INFO:tasks.workunit.client.1.smithi156.stdout:7/36: dread f7 [0,4194304] 0 2023-12-16T05:56:23.161 INFO:tasks.workunit.client.1.smithi156.stdout:7/37: read - f9 zero size 2023-12-16T05:56:23.161 INFO:tasks.workunit.client.1.smithi156.stdout:7/38: chown c3 0 1 2023-12-16T05:56:23.161 INFO:tasks.workunit.client.1.smithi156.stdout:7/39: stat fa 0 2023-12-16T05:56:23.161 INFO:tasks.workunit.client.1.smithi156.stdout:5/42: mknod da/dc/ce 0 2023-12-16T05:56:23.162 INFO:tasks.workunit.client.1.smithi156.stdout:7/40: write f7 [4046433,53155] 0 2023-12-16T05:56:23.162 INFO:tasks.workunit.client.1.smithi156.stdout:7/41: rmdir - no directory 2023-12-16T05:56:23.162 INFO:tasks.workunit.client.1.smithi156.stdout:0/37: unlink d2/l4 0 2023-12-16T05:56:23.164 INFO:tasks.workunit.client.1.smithi156.stdout:5/43: unlink f2 0 2023-12-16T05:56:23.164 INFO:tasks.workunit.client.1.smithi156.stdout:5/44: chown l8 377 1 2023-12-16T05:56:23.166 INFO:tasks.workunit.client.1.smithi156.stdout:0/38: mkdir d2/d7 0 2023-12-16T05:56:23.166 INFO:tasks.workunit.client.1.smithi156.stdout:0/39: chown f0 2027405 1 2023-12-16T05:56:23.167 INFO:tasks.workunit.client.1.smithi156.stdout:0/40: write d2/f5 [233350,99062] 0 2023-12-16T05:56:23.167 INFO:tasks.workunit.client.1.smithi156.stdout:5/45: write f0 [1765412,78933] 0 2023-12-16T05:56:23.169 INFO:tasks.workunit.client.1.smithi156.stdout:0/41: mknod d2/d7/c8 0 2023-12-16T05:56:23.169 INFO:tasks.workunit.client.1.smithi156.stdout:0/42: readlink - no filename 2023-12-16T05:56:23.170 INFO:tasks.workunit.client.1.smithi156.stdout:5/46: unlink da/dc/ce 0 2023-12-16T05:56:23.172 INFO:tasks.workunit.client.1.smithi156.stdout:7/42: truncate fa 30323 0 2023-12-16T05:56:23.173 INFO:tasks.workunit.client.1.smithi156.stdout:7/43: mknod cb 0 2023-12-16T05:56:23.173 INFO:tasks.workunit.client.1.smithi156.stdout:7/44: fsync f9 0 2023-12-16T05:56:23.174 INFO:tasks.workunit.client.1.smithi156.stdout:7/45: mkdir dc 0 2023-12-16T05:56:23.177 INFO:tasks.workunit.client.1.smithi156.stdout:7/46: rmdir dc 0 2023-12-16T05:56:23.177 INFO:tasks.workunit.client.1.smithi156.stdout:7/47: write f9 [132714,113376] 0 2023-12-16T05:56:23.177 INFO:tasks.workunit.client.1.smithi156.stdout:0/43: dread d2/f5 [0,4194304] 0 2023-12-16T05:56:23.183 INFO:tasks.workunit.client.1.smithi156.stdout:7/48: dread f7 [0,4194304] 0 2023-12-16T05:56:23.185 INFO:tasks.workunit.client.1.smithi156.stdout:7/49: link l5 ld 0 2023-12-16T05:56:23.188 INFO:tasks.workunit.client.1.smithi156.stdout:7/50: unlink cb 0 2023-12-16T05:56:23.449 INFO:tasks.workunit.client.1.smithi156.stdout:7/51: chown f4 21425841 1 2023-12-16T05:56:23.449 INFO:tasks.workunit.client.1.smithi156.stdout:7/52: write f7 [4695497,95218] 0 2023-12-16T05:56:23.449 INFO:tasks.workunit.client.1.smithi156.stdout:7/53: chown l6 2082499659 1 2023-12-16T05:56:23.460 INFO:tasks.workunit.client.1.smithi156.stdout:5/47: dwrite f0 [0,4194304] 0 2023-12-16T05:56:23.460 INFO:tasks.workunit.client.1.smithi156.stdout:5/48: chown c5 4171 1 2023-12-16T05:56:23.460 INFO:tasks.workunit.client.1.smithi156.stdout:0/44: dwrite d2/f5 [0,4194304] 0 2023-12-16T05:56:23.460 INFO:tasks.workunit.client.1.smithi156.stdout:5/49: creat da/dc/ff x:0 0 0 2023-12-16T05:56:23.460 INFO:tasks.workunit.client.1.smithi156.stdout:0/45: unlink d2/f5 0 2023-12-16T05:56:23.460 INFO:tasks.workunit.client.1.smithi156.stdout:0/46: fdatasync f0 0 2023-12-16T05:56:23.460 INFO:tasks.workunit.client.1.smithi156.stdout:5/50: creat da/dc/f10 x:0 0 0 2023-12-16T05:56:23.460 INFO:tasks.workunit.client.1.smithi156.stdout:5/51: truncate da/dc/f10 123356 0 2023-12-16T05:56:23.461 INFO:tasks.workunit.client.1.smithi156.stdout:0/47: truncate f0 4548121 0 2023-12-16T05:56:23.461 INFO:tasks.workunit.client.1.smithi156.stdout:0/48: dread f0 [4194304,4194304] 0 2023-12-16T05:56:23.461 INFO:tasks.workunit.client.1.smithi156.stdout:0/49: creat d2/d7/f9 x:0 0 0 2023-12-16T05:56:23.461 INFO:tasks.workunit.client.1.smithi156.stdout:0/50: mkdir d2/da 0 2023-12-16T05:56:23.461 INFO:tasks.workunit.client.1.smithi156.stdout:7/54: dwrite f9 [0,4194304] 0 2023-12-16T05:56:23.461 INFO:tasks.workunit.client.1.smithi156.stdout:7/55: rename fa to fe 0 2023-12-16T05:56:23.461 INFO:tasks.workunit.client.1.smithi156.stdout:7/56: unlink l5 0 2023-12-16T05:56:23.461 INFO:tasks.workunit.client.1.smithi156.stdout:7/57: mknod cf 0 2023-12-16T05:56:23.461 INFO:tasks.workunit.client.1.smithi156.stdout:7/58: truncate fe 883569 0 2023-12-16T05:56:23.461 INFO:tasks.workunit.client.1.smithi156.stdout:7/59: readlink ld 0 2023-12-16T05:56:23.461 INFO:tasks.workunit.client.1.smithi156.stdout:7/60: fsync f7 0 2023-12-16T05:56:23.461 INFO:tasks.workunit.client.1.smithi156.stdout:0/51: dread f0 [0,4194304] 0 2023-12-16T05:56:23.461 INFO:tasks.workunit.client.1.smithi156.stdout:7/61: mknod c10 0 2023-12-16T05:56:23.461 INFO:tasks.workunit.client.1.smithi156.stdout:7/62: fdatasync f7 0 2023-12-16T05:56:23.462 INFO:tasks.workunit.client.1.smithi156.stdout:7/63: read fe [441161,37450] 0 2023-12-16T05:56:23.462 INFO:tasks.workunit.client.1.smithi156.stdout:7/64: symlink l11 0 2023-12-16T05:56:23.462 INFO:tasks.workunit.client.1.smithi156.stdout:7/65: chown f7 1836 1 2023-12-16T05:56:23.462 INFO:tasks.workunit.client.1.smithi156.stdout:7/66: read fe [643788,4828] 0 2023-12-16T05:56:23.462 INFO:tasks.workunit.client.1.smithi156.stdout:7/67: creat f12 x:0 0 0 2023-12-16T05:56:23.462 INFO:tasks.workunit.client.1.smithi156.stdout:7/68: unlink c10 0 2023-12-16T05:56:23.462 INFO:tasks.workunit.client.1.smithi156.stdout:7/69: symlink l13 0 2023-12-16T05:56:23.462 INFO:tasks.workunit.client.1.smithi156.stdout:7/70: truncate f4 1835081 0 2023-12-16T05:56:23.462 INFO:tasks.workunit.client.1.smithi156.stdout:0/52: dwrite d2/d7/f9 [0,4194304] 0 2023-12-16T05:56:23.462 INFO:tasks.workunit.client.1.smithi156.stdout:7/71: getdents . 0 2023-12-16T05:56:23.462 INFO:tasks.workunit.client.1.smithi156.stdout:7/72: write fe [36393,6278] 0 2023-12-16T05:56:23.462 INFO:tasks.workunit.client.1.smithi156.stdout:0/53: dwrite d2/d7/f9 [0,4194304] 0 2023-12-16T05:56:23.462 INFO:tasks.workunit.client.1.smithi156.stdout:0/54: truncate d2/d7/f9 4477863 0 2023-12-16T05:56:23.462 INFO:tasks.workunit.client.1.smithi156.stdout:7/73: dwrite fe [0,4194304] 0 2023-12-16T05:56:23.462 INFO:tasks.workunit.client.1.smithi156.stdout:0/55: dread d2/d7/f9 [0,4194304] 0 2023-12-16T05:56:23.463 INFO:tasks.workunit.client.1.smithi156.stdout:0/56: truncate f0 4120190 0 2023-12-16T05:56:23.463 INFO:tasks.workunit.client.1.smithi156.stdout:0/57: unlink d2/d7/f9 0 2023-12-16T05:56:23.463 INFO:tasks.workunit.client.1.smithi156.stdout:7/74: dwrite f12 [0,4194304] 0 2023-12-16T05:56:23.463 INFO:tasks.workunit.client.1.smithi156.stdout:7/75: readlink l11 0 2023-12-16T05:56:23.463 INFO:tasks.workunit.client.1.smithi156.stdout:7/76: unlink fe 0 2023-12-16T05:56:23.463 INFO:tasks.workunit.client.1.smithi156.stdout:0/58: dread f0 [0,4194304] 0 2023-12-16T05:56:23.463 INFO:tasks.workunit.client.1.smithi156.stdout:0/59: chown d2/d7 214711424 1 2023-12-16T05:56:23.463 INFO:tasks.workunit.client.1.smithi156.stdout:0/60: write f0 [1937647,124607] 0 2023-12-16T05:56:23.463 INFO:tasks.workunit.client.1.smithi156.stdout:0/61: symlink d2/lb 0 2023-12-16T05:56:23.463 INFO:tasks.workunit.client.1.smithi156.stdout:0/62: mknod d2/cc 0 2023-12-16T05:56:23.463 INFO:tasks.workunit.client.1.smithi156.stdout:0/63: fdatasync f0 0 2023-12-16T05:56:23.463 INFO:tasks.workunit.client.1.smithi156.stdout:0/64: dwrite f0 [0,4194304] 0 2023-12-16T05:56:23.463 INFO:tasks.workunit.client.1.smithi156.stdout:0/65: write f0 [4548520,16268] 0 2023-12-16T05:56:23.463 INFO:tasks.workunit.client.1.smithi156.stdout:7/77: dread f12 [0,4194304] 0 2023-12-16T05:56:23.464 INFO:tasks.workunit.client.1.smithi156.stdout:7/78: mknod c14 0 2023-12-16T05:56:23.464 INFO:tasks.workunit.client.1.smithi156.stdout:7/79: link c14 c15 0 2023-12-16T05:56:23.464 INFO:tasks.workunit.client.1.smithi156.stdout:7/80: readlink l6 0 2023-12-16T05:56:23.464 INFO:tasks.workunit.client.1.smithi156.stdout:7/81: write f7 [4260059,34379] 0 2023-12-16T05:56:23.464 INFO:tasks.workunit.client.1.smithi156.stdout:7/82: fsync f7 0 2023-12-16T05:56:23.464 INFO:tasks.workunit.client.1.smithi156.stdout:7/83: mknod c16 0 2023-12-16T05:56:23.464 INFO:tasks.workunit.client.1.smithi156.stdout:0/66: dwrite f0 [0,4194304] 0 2023-12-16T05:56:23.464 INFO:tasks.workunit.client.1.smithi156.stdout:7/84: mknod c17 0 2023-12-16T05:56:23.464 INFO:tasks.workunit.client.1.smithi156.stdout:7/85: write f9 [1355152,95061] 0 2023-12-16T05:56:23.464 INFO:tasks.workunit.client.1.smithi156.stdout:0/67: rmdir d2/da 0 2023-12-16T05:56:23.464 INFO:tasks.workunit.client.1.smithi156.stdout:7/86: mknod c18 0 2023-12-16T05:56:23.464 INFO:tasks.workunit.client.1.smithi156.stdout:7/87: creat f19 x:0 0 0 2023-12-16T05:56:23.464 INFO:tasks.workunit.client.1.smithi156.stdout:7/88: unlink f12 0 2023-12-16T05:56:23.464 INFO:tasks.workunit.client.1.smithi156.stdout:7/89: dread - f19 zero size 2023-12-16T05:56:23.464 INFO:tasks.workunit.client.1.smithi156.stdout:7/90: link l11 l1a 0 2023-12-16T05:56:23.465 INFO:tasks.workunit.client.1.smithi156.stdout:7/91: fdatasync f4 0 2023-12-16T05:56:23.465 INFO:tasks.workunit.client.1.smithi156.stdout:7/92: creat f1b x:0 0 0 2023-12-16T05:56:23.465 INFO:tasks.workunit.client.1.smithi156.stdout:7/93: dread f7 [0,4194304] 0 2023-12-16T05:56:23.465 INFO:tasks.workunit.client.1.smithi156.stdout:7/94: mknod c1c 0 2023-12-16T05:56:23.465 INFO:tasks.workunit.client.1.smithi156.stdout:0/68: dread f0 [0,4194304] 0 2023-12-16T05:56:23.465 INFO:tasks.workunit.client.1.smithi156.stdout:0/69: write f0 [648772,37219] 0 2023-12-16T05:56:23.465 INFO:tasks.workunit.client.1.smithi156.stdout:7/95: dwrite f7 [0,4194304] 0 2023-12-16T05:56:23.465 INFO:tasks.workunit.client.1.smithi156.stdout:7/96: mknod c1d 0 2023-12-16T05:56:23.465 INFO:tasks.workunit.client.1.smithi156.stdout:7/97: read - f1b zero size 2023-12-16T05:56:23.465 INFO:tasks.workunit.client.1.smithi156.stdout:7/98: chown c15 72903933 1 2023-12-16T05:56:23.465 INFO:tasks.workunit.client.1.smithi156.stdout:7/99: unlink f19 0 2023-12-16T05:56:23.465 INFO:tasks.workunit.client.1.smithi156.stdout:7/100: stat cf 0 2023-12-16T05:56:23.465 INFO:tasks.workunit.client.1.smithi156.stdout:7/101: mkdir d1e 0 2023-12-16T05:56:23.466 INFO:tasks.workunit.client.1.smithi156.stdout:7/102: mkdir d1e/d1f 0 2023-12-16T05:56:23.466 INFO:tasks.workunit.client.1.smithi156.stdout:7/103: getdents d1e/d1f 0 2023-12-16T05:56:23.466 INFO:tasks.workunit.client.1.smithi156.stdout:7/104: write f4 [2131759,117709] 0 2023-12-16T05:56:23.466 INFO:tasks.workunit.client.1.smithi156.stdout:7/105: stat d1e 0 2023-12-16T05:56:23.466 INFO:tasks.workunit.client.1.smithi156.stdout:7/106: symlink d1e/l20 0 2023-12-16T05:56:23.466 INFO:tasks.workunit.client.1.smithi156.stdout:0/70: dread f0 [0,4194304] 0 2023-12-16T05:56:23.466 INFO:tasks.workunit.client.1.smithi156.stdout:0/71: mkdir d2/d7/dd 0 2023-12-16T05:56:23.466 INFO:tasks.workunit.client.1.smithi156.stdout:7/107: dwrite f4 [0,4194304] 0 2023-12-16T05:56:23.466 INFO:tasks.workunit.client.1.smithi156.stdout:7/108: truncate f9 3294516 0 2023-12-16T05:56:23.466 INFO:tasks.workunit.client.1.smithi156.stdout:7/109: readlink d1e/l20 0 2023-12-16T05:56:23.466 INFO:tasks.workunit.client.1.smithi156.stdout:0/72: dread f0 [0,4194304] 0 2023-12-16T05:56:23.466 INFO:tasks.workunit.client.1.smithi156.stdout:0/73: readlink d2/lb 0 2023-12-16T05:56:23.466 INFO:tasks.workunit.client.1.smithi156.stdout:0/74: chown d2/d7 16 1 2023-12-16T05:56:23.466 INFO:tasks.workunit.client.1.smithi156.stdout:7/110: creat d1e/f21 x:0 0 0 2023-12-16T05:56:23.466 INFO:tasks.workunit.client.1.smithi156.stdout:7/111: unlink c1c 0 2023-12-16T05:56:23.467 INFO:tasks.workunit.client.1.smithi156.stdout:7/112: truncate f1b 412232 0 2023-12-16T05:56:23.467 INFO:tasks.workunit.client.1.smithi156.stdout:7/113: write f7 [2272289,54851] 0 2023-12-16T05:56:23.467 INFO:tasks.workunit.client.1.smithi156.stdout:7/114: mkdir d1e/d1f/d22 0 2023-12-16T05:56:23.467 INFO:tasks.workunit.client.1.smithi156.stdout:7/115: dwrite f4 [0,4194304] 0 2023-12-16T05:56:23.467 INFO:tasks.workunit.client.1.smithi156.stdout:0/75: dwrite f0 [0,4194304] 0 2023-12-16T05:56:23.467 INFO:tasks.workunit.client.1.smithi156.stdout:0/76: link f0 d2/fe 0 2023-12-16T05:56:23.467 INFO:tasks.workunit.client.1.smithi156.stdout:0/77: creat d2/ff x:0 0 0 2023-12-16T05:56:23.467 INFO:tasks.workunit.client.1.smithi156.stdout:0/78: read f0 [3438843,97269] 0 2023-12-16T05:56:23.467 INFO:tasks.workunit.client.1.smithi156.stdout:0/79: creat d2/d7/f10 x:0 0 0 2023-12-16T05:56:23.467 INFO:tasks.workunit.client.1.smithi156.stdout:7/116: dread f7 [0,4194304] 0 2023-12-16T05:56:23.467 INFO:tasks.workunit.client.1.smithi156.stdout:7/117: truncate f9 3485139 0 2023-12-16T05:56:23.467 INFO:tasks.workunit.client.1.smithi156.stdout:7/118: stat l1a 0 2023-12-16T05:56:23.468 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:23 smithi156 ceph-mon[121001]: mgrmap e24: smithi156.pclong(active, since 9s), standbys: smithi155.maowdn 2023-12-16T05:56:23.468 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:23 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mgr metadata", "who": "smithi155.maowdn", "id": "smithi155.maowdn"}]: dispatch 2023-12-16T05:56:23.468 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:23 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:23.468 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:23 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:23.469 INFO:tasks.workunit.client.1.smithi156.stdout:0/80: dwrite d2/d7/f10 [0,4194304] 0 2023-12-16T05:56:23.469 INFO:tasks.workunit.client.1.smithi156.stdout:7/119: dwrite f1b [0,4194304] 0 2023-12-16T05:56:23.469 INFO:tasks.workunit.client.1.smithi156.stdout:7/120: write f9 [1550865,105101] 0 2023-12-16T05:56:23.469 INFO:tasks.workunit.client.1.smithi156.stdout:0/81: fsync d2/ff 0 2023-12-16T05:56:23.472 INFO:tasks.workunit.client.1.smithi156.stdout:0/82: dwrite d2/fe [0,4194304] 0 2023-12-16T05:56:23.473 INFO:tasks.workunit.client.1.smithi156.stdout:0/83: symlink d2/d7/l11 0 2023-12-16T05:56:23.473 INFO:tasks.workunit.client.1.smithi156.stdout:0/84: fdatasync d2/d7/f10 0 2023-12-16T05:56:23.473 INFO:tasks.workunit.client.1.smithi156.stdout:0/85: rename d2/cc to d2/c12 0 2023-12-16T05:56:23.493 INFO:tasks.workunit.client.1.smithi156.stdout:0/86: dwrite d2/fe [0,4194304] 0 2023-12-16T05:56:23.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:23 smithi155 ceph-mon[112451]: mgrmap e24: smithi156.pclong(active, since 9s), standbys: smithi155.maowdn 2023-12-16T05:56:23.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:23 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mgr metadata", "who": "smithi155.maowdn", "id": "smithi155.maowdn"}]: dispatch 2023-12-16T05:56:23.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:23 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:23.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:23 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:24.184 INFO:tasks.workunit.client.0.smithi155.stdout:5/92: sync 2023-12-16T05:56:24.184 INFO:tasks.workunit.client.0.smithi155.stdout:1/35: sync 2023-12-16T05:56:24.184 INFO:tasks.workunit.client.0.smithi155.stdout:2/4: sync 2023-12-16T05:56:24.184 INFO:tasks.workunit.client.0.smithi155.stdout:2/5: write - no filename 2023-12-16T05:56:24.184 INFO:tasks.workunit.client.0.smithi155.stdout:7/18: sync 2023-12-16T05:56:24.184 INFO:tasks.workunit.client.0.smithi155.stdout:6/34: sync 2023-12-16T05:56:24.184 INFO:tasks.workunit.client.0.smithi155.stdout:9/24: sync 2023-12-16T05:56:24.184 INFO:tasks.workunit.client.0.smithi155.stdout:6/35: chown d0/fc 121865 1 2023-12-16T05:56:24.185 INFO:tasks.workunit.client.0.smithi155.stdout:1/36: write d1/d7/f12 [309711,19296] 0 2023-12-16T05:56:24.185 INFO:tasks.workunit.client.0.smithi155.stdout:9/25: truncate f3 9036411 0 2023-12-16T05:56:24.185 INFO:tasks.workunit.client.0.smithi155.stdout:0/72: sync 2023-12-16T05:56:24.185 INFO:tasks.workunit.client.0.smithi155.stdout:3/2: sync 2023-12-16T05:56:24.185 INFO:tasks.workunit.client.0.smithi155.stdout:4/27: sync 2023-12-16T05:56:24.185 INFO:tasks.workunit.client.0.smithi155.stdout:8/11: sync 2023-12-16T05:56:24.185 INFO:tasks.workunit.client.0.smithi155.stdout:8/12: read - f0 zero size 2023-12-16T05:56:24.185 INFO:tasks.workunit.client.0.smithi155.stdout:5/93: creat d0/d2/d7/f18 x:0 0 0 2023-12-16T05:56:24.186 INFO:tasks.workunit.client.0.smithi155.stdout:2/6: creat d0/f1 x:0 0 0 2023-12-16T05:56:24.186 INFO:tasks.workunit.client.0.smithi155.stdout:2/7: chown d0/f1 292 1 2023-12-16T05:56:24.187 INFO:tasks.workunit.client.0.smithi155.stdout:7/19: getdents d0 0 2023-12-16T05:56:24.188 INFO:tasks.workunit.client.0.smithi155.stdout:6/36: truncate d0/d3/f6 2555424 0 2023-12-16T05:56:24.190 INFO:tasks.workunit.client.0.smithi155.stdout:9/26: symlink l8 0 2023-12-16T05:56:24.190 INFO:tasks.workunit.client.0.smithi155.stdout:0/73: creat d7/df/f1a x:0 0 0 2023-12-16T05:56:24.190 INFO:tasks.workunit.client.0.smithi155.stdout:0/74: write d7/df/f1a [797083,323] 0 2023-12-16T05:56:24.191 INFO:tasks.workunit.client.0.smithi155.stdout:3/3: mkdir d0 0 2023-12-16T05:56:24.191 INFO:tasks.workunit.client.0.smithi155.stdout:3/4: read - no filename 2023-12-16T05:56:24.191 INFO:tasks.workunit.client.0.smithi155.stdout:3/5: dwrite - no filename 2023-12-16T05:56:24.192 INFO:tasks.workunit.client.0.smithi155.stdout:3/6: fdatasync - no filename 2023-12-16T05:56:24.192 INFO:tasks.workunit.client.0.smithi155.stdout:8/13: creat f2 x:0 0 0 2023-12-16T05:56:24.192 INFO:tasks.workunit.client.0.smithi155.stdout:8/14: write f1 [1305,82665] 0 2023-12-16T05:56:24.192 INFO:tasks.workunit.client.0.smithi155.stdout:8/15: chown f1 191006290 1 2023-12-16T05:56:24.193 INFO:tasks.workunit.client.0.smithi155.stdout:8/16: dread - f0 zero size 2023-12-16T05:56:24.193 INFO:tasks.workunit.client.0.smithi155.stdout:8/17: read - f0 zero size 2023-12-16T05:56:24.193 INFO:tasks.workunit.client.0.smithi155.stdout:5/94: mkdir d0/d2/d7/d19 0 2023-12-16T05:56:24.196 INFO:tasks.workunit.client.0.smithi155.stdout:7/20: mkdir d0/d1/d5 0 2023-12-16T05:56:24.196 INFO:tasks.workunit.client.0.smithi155.stdout:7/21: stat d0 0 2023-12-16T05:56:24.197 INFO:tasks.workunit.client.0.smithi155.stdout:7/22: dwrite - no filename 2023-12-16T05:56:24.197 INFO:tasks.workunit.client.0.smithi155.stdout:7/23: write - no filename 2023-12-16T05:56:24.197 INFO:tasks.workunit.client.0.smithi155.stdout:0/75: creat d7/d13/f1b x:0 0 0 2023-12-16T05:56:24.198 INFO:tasks.workunit.client.0.smithi155.stdout:3/7: symlink d0/l1 0 2023-12-16T05:56:24.199 INFO:tasks.workunit.client.0.smithi155.stdout:3/8: write - no filename 2023-12-16T05:56:24.201 INFO:tasks.workunit.client.0.smithi155.stdout:8/18: rename f1 to f3 0 2023-12-16T05:56:24.202 INFO:tasks.workunit.client.0.smithi155.stdout:5/95: creat d0/d2/f1a x:0 0 0 2023-12-16T05:56:24.202 INFO:tasks.workunit.client.0.smithi155.stdout:5/96: fdatasync d0/d2/d7/f12 0 2023-12-16T05:56:24.203 INFO:tasks.workunit.client.0.smithi155.stdout:2/8: link d0/f1 d0/f2 0 2023-12-16T05:56:24.204 INFO:tasks.workunit.client.0.smithi155.stdout:7/24: mknod d0/d1/c6 0 2023-12-16T05:56:24.206 INFO:tasks.workunit.client.0.smithi155.stdout:3/9: mknod d0/c2 0 2023-12-16T05:56:24.206 INFO:tasks.workunit.client.0.smithi155.stdout:3/10: dwrite - no filename 2023-12-16T05:56:24.206 INFO:tasks.workunit.client.0.smithi155.stdout:3/11: write - no filename 2023-12-16T05:56:24.206 INFO:tasks.workunit.client.0.smithi155.stdout:3/12: stat d0 0 2023-12-16T05:56:24.206 INFO:tasks.workunit.client.0.smithi155.stdout:3/13: dwrite - no filename 2023-12-16T05:56:24.206 INFO:tasks.workunit.client.0.smithi155.stdout:3/14: write - no filename 2023-12-16T05:56:24.206 INFO:tasks.workunit.client.0.smithi155.stdout:3/15: stat d0/c2 0 2023-12-16T05:56:24.207 INFO:tasks.workunit.client.0.smithi155.stdout:5/97: symlink d0/l1b 0 2023-12-16T05:56:24.207 INFO:tasks.workunit.client.0.smithi155.stdout:5/98: readlink d0/l1b 0 2023-12-16T05:56:24.207 INFO:tasks.workunit.client.0.smithi155.stdout:2/9: symlink d0/l3 0 2023-12-16T05:56:24.208 INFO:tasks.workunit.client.0.smithi155.stdout:7/25: mknod d0/d1/d5/c7 0 2023-12-16T05:56:24.208 INFO:tasks.workunit.client.0.smithi155.stdout:7/26: write - no filename 2023-12-16T05:56:24.209 INFO:tasks.workunit.client.0.smithi155.stdout:3/16: mknod d0/c3 0 2023-12-16T05:56:24.209 INFO:tasks.workunit.client.0.smithi155.stdout:3/17: rename d0 to d0/d4 22 2023-12-16T05:56:24.210 INFO:tasks.workunit.client.0.smithi155.stdout:2/10: link d0/f2 d0/f4 0 2023-12-16T05:56:24.211 INFO:tasks.workunit.client.0.smithi155.stdout:2/11: dread - d0/f1 zero size 2023-12-16T05:56:24.211 INFO:tasks.workunit.client.0.smithi155.stdout:2/12: stat d0/f1 0 2023-12-16T05:56:24.211 INFO:tasks.workunit.client.0.smithi155.stdout:7/27: creat d0/d1/d5/f8 x:0 0 0 2023-12-16T05:56:24.211 INFO:tasks.workunit.client.0.smithi155.stdout:3/18: symlink d0/l5 0 2023-12-16T05:56:24.212 INFO:tasks.workunit.client.0.smithi155.stdout:9/27: dwrite f3 [4194304,4194304] 0 2023-12-16T05:56:24.212 INFO:tasks.workunit.client.0.smithi155.stdout:2/13: mkdir d0/d5 0 2023-12-16T05:56:24.213 INFO:tasks.workunit.client.0.smithi155.stdout:9/28: stat f3 0 2023-12-16T05:56:24.213 INFO:tasks.workunit.client.0.smithi155.stdout:7/28: creat d0/d1/d5/f9 x:0 0 0 2023-12-16T05:56:24.214 INFO:tasks.workunit.client.0.smithi155.stdout:3/19: creat d0/f6 x:0 0 0 2023-12-16T05:56:24.214 INFO:tasks.workunit.client.0.smithi155.stdout:2/14: mkdir d0/d5/d6 0 2023-12-16T05:56:24.216 INFO:tasks.workunit.client.0.smithi155.stdout:7/29: creat d0/d1/fa x:0 0 0 2023-12-16T05:56:24.216 INFO:tasks.workunit.client.0.smithi155.stdout:7/30: truncate d0/d1/d5/f9 396742 0 2023-12-16T05:56:24.216 INFO:tasks.workunit.client.0.smithi155.stdout:3/20: mknod d0/c7 0 2023-12-16T05:56:24.217 INFO:tasks.workunit.client.0.smithi155.stdout:1/37: dwrite d1/f6 [0,4194304] 0 2023-12-16T05:56:24.218 INFO:tasks.workunit.client.0.smithi155.stdout:2/15: mkdir d0/d7 0 2023-12-16T05:56:24.219 INFO:tasks.workunit.client.0.smithi155.stdout:2/16: dread - d0/f2 zero size 2023-12-16T05:56:24.219 INFO:tasks.workunit.client.0.smithi155.stdout:6/37: dwrite d0/f4 [0,4194304] 0 2023-12-16T05:56:24.219 INFO:tasks.workunit.client.0.smithi155.stdout:4/28: dwrite d0/f5 [0,4194304] 0 2023-12-16T05:56:24.219 INFO:tasks.workunit.client.0.smithi155.stdout:4/29: rename d0 to d0/d6 22 2023-12-16T05:56:24.219 INFO:tasks.workunit.client.0.smithi155.stdout:8/19: dread f3 [0,4194304] 0 2023-12-16T05:56:24.220 INFO:tasks.workunit.client.0.smithi155.stdout:7/31: rename d0/d1/fa to d0/d1/fb 0 2023-12-16T05:56:24.220 INFO:tasks.workunit.client.0.smithi155.stdout:8/20: dread f3 [0,4194304] 0 2023-12-16T05:56:24.220 INFO:tasks.workunit.client.0.smithi155.stdout:3/21: mknod d0/c8 0 2023-12-16T05:56:24.220 INFO:tasks.workunit.client.0.smithi155.stdout:3/22: stat d0/c2 0 2023-12-16T05:56:24.221 INFO:tasks.workunit.client.0.smithi155.stdout:3/23: chown d0/c8 10938 1 2023-12-16T05:56:24.222 INFO:tasks.workunit.client.0.smithi155.stdout:1/38: mknod d1/d7/c13 0 2023-12-16T05:56:24.225 INFO:tasks.workunit.client.0.smithi155.stdout:6/38: mknod d0/ce 0 2023-12-16T05:56:24.226 INFO:tasks.workunit.client.0.smithi155.stdout:0/76: getdents d7/d13 0 2023-12-16T05:56:24.229 INFO:tasks.workunit.client.0.smithi155.stdout:4/30: creat d0/f7 x:0 0 0 2023-12-16T05:56:24.230 INFO:tasks.workunit.client.0.smithi155.stdout:4/31: dread d0/f4 [0,4194304] 0 2023-12-16T05:56:24.232 INFO:tasks.workunit.client.0.smithi155.stdout:8/21: mkdir d4 0 2023-12-16T05:56:24.232 INFO:tasks.workunit.client.0.smithi155.stdout:8/22: stat f3 0 2023-12-16T05:56:24.232 INFO:tasks.workunit.client.0.smithi155.stdout:8/23: dread - f2 zero size 2023-12-16T05:56:24.232 INFO:tasks.workunit.client.0.smithi155.stdout:8/24: stat f3 0 2023-12-16T05:56:24.232 INFO:tasks.workunit.client.0.smithi155.stdout:8/25: truncate f0 55767 0 2023-12-16T05:56:24.232 INFO:tasks.workunit.client.0.smithi155.stdout:8/26: readlink - no filename 2023-12-16T05:56:24.232 INFO:tasks.workunit.client.0.smithi155.stdout:3/24: creat d0/f9 x:0 0 0 2023-12-16T05:56:24.233 INFO:tasks.workunit.client.0.smithi155.stdout:3/25: stat d0/f9 0 2023-12-16T05:56:24.235 INFO:tasks.workunit.client.0.smithi155.stdout:5/99: getdents d0 0 2023-12-16T05:56:24.235 INFO:tasks.workunit.client.0.smithi155.stdout:5/100: stat d0/d2/d7/f16 0 2023-12-16T05:56:24.235 INFO:tasks.workunit.client.0.smithi155.stdout:2/17: dwrite d0/f4 [0,4194304] 0 2023-12-16T05:56:24.236 INFO:tasks.workunit.client.0.smithi155.stdout:6/39: truncate d0/d3/fa 1530138 0 2023-12-16T05:56:24.236 INFO:tasks.workunit.client.0.smithi155.stdout:6/40: chown d0/d3/dd 14148487 1 2023-12-16T05:56:24.238 INFO:tasks.workunit.client.0.smithi155.stdout:8/27: mknod d4/c5 0 2023-12-16T05:56:24.238 INFO:tasks.workunit.client.0.smithi155.stdout:8/28: write f2 [841070,19907] 0 2023-12-16T05:56:24.239 INFO:tasks.workunit.client.0.smithi155.stdout:5/101: stat d0/d2/ca 0 2023-12-16T05:56:24.244 INFO:tasks.workunit.client.0.smithi155.stdout:0/77: mkdir d7/d1c 0 2023-12-16T05:56:24.246 INFO:tasks.workunit.client.0.smithi155.stdout:5/102: rmdir d0/d2/d7 39 2023-12-16T05:56:24.246 INFO:tasks.workunit.client.0.smithi155.stdout:5/103: readlink d0/l10 0 2023-12-16T05:56:24.247 INFO:tasks.workunit.client.0.smithi155.stdout:9/29: truncate f3 974341 0 2023-12-16T05:56:24.248 INFO:tasks.workunit.client.0.smithi155.stdout:0/78: mkdir d7/df/d1d 0 2023-12-16T05:56:24.249 INFO:tasks.workunit.client.0.smithi155.stdout:7/32: getdents d0/d1 0 2023-12-16T05:56:24.250 INFO:tasks.workunit.client.0.smithi155.stdout:5/104: rename d0/d2/f6 to d0/f1c 0 2023-12-16T05:56:24.252 INFO:tasks.workunit.client.0.smithi155.stdout:9/30: creat f9 x:0 0 0 2023-12-16T05:56:24.253 INFO:tasks.workunit.client.0.smithi155.stdout:7/33: symlink d0/d1/lc 0 2023-12-16T05:56:24.254 INFO:tasks.workunit.client.0.smithi155.stdout:5/105: creat d0/d2/f1d x:0 0 0 2023-12-16T05:56:24.254 INFO:tasks.workunit.client.0.smithi155.stdout:5/106: chown d0/f15 1 1 2023-12-16T05:56:24.255 INFO:tasks.workunit.client.0.smithi155.stdout:1/39: rmdir d1/d7 39 2023-12-16T05:56:24.255 INFO:tasks.workunit.client.0.smithi155.stdout:1/40: truncate d1/ff 976641 0 2023-12-16T05:56:24.255 INFO:tasks.workunit.client.0.smithi155.stdout:1/41: truncate d1/f4 4874042 0 2023-12-16T05:56:24.255 INFO:tasks.workunit.client.0.smithi155.stdout:7/34: read - d0/d1/d5/f8 zero size 2023-12-16T05:56:24.256 INFO:tasks.workunit.client.0.smithi155.stdout:5/107: creat d0/d2/d7/f1e x:0 0 0 2023-12-16T05:56:24.257 INFO:tasks.workunit.client.0.smithi155.stdout:1/42: symlink d1/d7/l14 0 2023-12-16T05:56:24.258 INFO:tasks.workunit.client.0.smithi155.stdout:7/35: read - d0/d1/fb zero size 2023-12-16T05:56:24.258 INFO:tasks.workunit.client.0.smithi155.stdout:1/43: write d1/f6 [91359,96185] 0 2023-12-16T05:56:24.259 INFO:tasks.workunit.client.0.smithi155.stdout:5/108: rename d0/c1 to d0/c1f 0 2023-12-16T05:56:24.260 INFO:tasks.workunit.client.0.smithi155.stdout:7/36: creat d0/d1/d5/fd x:0 0 0 2023-12-16T05:56:24.261 INFO:tasks.workunit.client.0.smithi155.stdout:1/44: mknod d1/d7/c15 0 2023-12-16T05:56:24.262 INFO:tasks.workunit.client.0.smithi155.stdout:4/32: getdents d0 0 2023-12-16T05:56:24.262 INFO:tasks.workunit.client.0.smithi155.stdout:4/33: write d0/f7 [341102,84524] 0 2023-12-16T05:56:24.262 INFO:tasks.workunit.client.0.smithi155.stdout:4/34: chown d0 13407509 1 2023-12-16T05:56:24.263 INFO:tasks.workunit.client.0.smithi155.stdout:7/37: creat d0/d1/fe x:0 0 0 2023-12-16T05:56:24.264 INFO:tasks.workunit.client.0.smithi155.stdout:3/26: rmdir d0 39 2023-12-16T05:56:24.265 INFO:tasks.workunit.client.0.smithi155.stdout:4/35: symlink d0/l8 0 2023-12-16T05:56:24.266 INFO:tasks.workunit.client.0.smithi155.stdout:8/29: getdents d4 0 2023-12-16T05:56:24.266 INFO:tasks.workunit.client.0.smithi155.stdout:8/30: chown f3 61471 1 2023-12-16T05:56:24.266 INFO:tasks.workunit.client.0.smithi155.stdout:8/31: read f0 [34714,130618] 0 2023-12-16T05:56:24.267 INFO:tasks.workunit.client.0.smithi155.stdout:0/79: dwrite d7/df/f10 [0,4194304] 0 2023-12-16T05:56:24.268 INFO:tasks.workunit.client.0.smithi155.stdout:2/18: truncate d0/f2 2524722 0 2023-12-16T05:56:24.269 INFO:tasks.workunit.client.0.smithi155.stdout:6/41: write d0/d3/fa [696666,125282] 0 2023-12-16T05:56:24.269 INFO:tasks.workunit.client.0.smithi155.stdout:7/38: symlink d0/d1/d5/lf 0 2023-12-16T05:56:24.271 INFO:tasks.workunit.client.0.smithi155.stdout:3/27: creat d0/fa x:0 0 0 2023-12-16T05:56:24.271 INFO:tasks.workunit.client.0.smithi155.stdout:3/28: write d0/fa [412037,18834] 0 2023-12-16T05:56:24.271 INFO:tasks.workunit.client.0.smithi155.stdout:3/29: dread - d0/f6 zero size 2023-12-16T05:56:24.271 INFO:tasks.workunit.client.0.smithi155.stdout:3/30: fsync d0/f9 0 2023-12-16T05:56:24.271 INFO:tasks.workunit.client.0.smithi155.stdout:3/31: fsync d0/f6 0 2023-12-16T05:56:24.272 INFO:tasks.workunit.client.0.smithi155.stdout:3/32: truncate d0/fa 1187729 0 2023-12-16T05:56:24.274 INFO:tasks.workunit.client.0.smithi155.stdout:8/32: mknod d4/c6 0 2023-12-16T05:56:24.274 INFO:tasks.workunit.client.0.smithi155.stdout:8/33: chown f3 6431275 1 2023-12-16T05:56:24.277 INFO:tasks.workunit.client.0.smithi155.stdout:0/80: mknod d7/df/d1d/c1e 0 2023-12-16T05:56:24.278 INFO:tasks.workunit.client.0.smithi155.stdout:2/19: creat d0/f8 x:0 0 0 2023-12-16T05:56:24.279 INFO:tasks.workunit.client.0.smithi155.stdout:6/42: mkdir d0/df 0 2023-12-16T05:56:24.282 INFO:tasks.workunit.client.0.smithi155.stdout:8/34: creat d4/f7 x:0 0 0 2023-12-16T05:56:24.283 INFO:tasks.workunit.client.0.smithi155.stdout:8/35: read f3 [15239,114874] 0 2023-12-16T05:56:24.283 INFO:tasks.workunit.client.0.smithi155.stdout:7/39: getdents d0/d1 0 2023-12-16T05:56:24.284 INFO:tasks.workunit.client.0.smithi155.stdout:7/40: write d0/d1/d5/f9 [1400456,36661] 0 2023-12-16T05:56:24.285 INFO:tasks.workunit.client.0.smithi155.stdout:0/81: mknod d7/d13/c1f 0 2023-12-16T05:56:24.286 INFO:tasks.workunit.client.0.smithi155.stdout:9/31: dwrite f3 [0,4194304] 0 2023-12-16T05:56:24.286 INFO:tasks.workunit.client.0.smithi155.stdout:9/32: readlink l8 0 2023-12-16T05:56:24.286 INFO:tasks.workunit.client.0.smithi155.stdout:9/33: chown f3 0 1 2023-12-16T05:56:24.286 INFO:tasks.workunit.client.0.smithi155.stdout:2/20: creat d0/d7/f9 x:0 0 0 2023-12-16T05:56:24.286 INFO:tasks.workunit.client.0.smithi155.stdout:6/43: symlink d0/l10 0 2023-12-16T05:56:24.289 INFO:tasks.workunit.client.0.smithi155.stdout:8/36: mknod d4/c8 0 2023-12-16T05:56:24.291 INFO:tasks.workunit.client.0.smithi155.stdout:7/41: symlink d0/d1/d5/l10 0 2023-12-16T05:56:24.291 INFO:tasks.workunit.client.0.smithi155.stdout:7/42: write d0/d1/d5/fd [293962,107522] 0 2023-12-16T05:56:24.291 INFO:tasks.workunit.client.0.smithi155.stdout:7/43: truncate d0/d1/fe 952871 0 2023-12-16T05:56:24.291 INFO:tasks.workunit.client.0.smithi155.stdout:0/82: creat d7/d13/f20 x:0 0 0 2023-12-16T05:56:24.292 INFO:tasks.workunit.client.0.smithi155.stdout:3/33: getdents d0 0 2023-12-16T05:56:24.294 INFO:tasks.workunit.client.0.smithi155.stdout:2/21: mkdir d0/da 0 2023-12-16T05:56:24.296 INFO:tasks.workunit.client.0.smithi155.stdout:4/36: dwrite d0/f7 [0,4194304] 0 2023-12-16T05:56:24.296 INFO:tasks.workunit.client.0.smithi155.stdout:6/44: creat d0/d3/f11 x:0 0 0 2023-12-16T05:56:24.296 INFO:tasks.workunit.client.0.smithi155.stdout:4/37: truncate d0/f7 4574544 0 2023-12-16T05:56:24.296 INFO:tasks.workunit.client.0.smithi155.stdout:6/45: chown d0/f7 640029357 1 2023-12-16T05:56:24.297 INFO:tasks.workunit.client.0.smithi155.stdout:3/34: fdatasync d0/fa 0 2023-12-16T05:56:24.297 INFO:tasks.workunit.client.0.smithi155.stdout:3/35: dread - d0/f9 zero size 2023-12-16T05:56:24.297 INFO:tasks.workunit.client.0.smithi155.stdout:8/37: rename d4/c8 to d4/c9 0 2023-12-16T05:56:24.298 INFO:tasks.workunit.client.0.smithi155.stdout:7/44: rmdir d0/d1 39 2023-12-16T05:56:24.298 INFO:tasks.workunit.client.0.smithi155.stdout:0/83: fsync d7/fc 0 2023-12-16T05:56:24.302 INFO:tasks.workunit.client.0.smithi155.stdout:4/38: chown d0/c2 6990935 1 2023-12-16T05:56:24.303 INFO:tasks.workunit.client.0.smithi155.stdout:6/46: creat d0/d3/f12 x:0 0 0 2023-12-16T05:56:24.305 INFO:tasks.workunit.client.0.smithi155.stdout:3/36: creat d0/fb x:0 0 0 2023-12-16T05:56:24.305 INFO:tasks.workunit.client.0.smithi155.stdout:3/37: dread - d0/f9 zero size 2023-12-16T05:56:24.309 INFO:tasks.workunit.client.0.smithi155.stdout:8/38: mkdir d4/da 0 2023-12-16T05:56:24.309 INFO:tasks.workunit.client.0.smithi155.stdout:0/84: mknod d7/d1c/c21 0 2023-12-16T05:56:24.309 INFO:tasks.workunit.client.0.smithi155.stdout:4/39: fdatasync d0/f5 0 2023-12-16T05:56:24.310 INFO:tasks.workunit.client.0.smithi155.stdout:6/47: rmdir d0/d3/dd 0 2023-12-16T05:56:24.310 INFO:tasks.workunit.client.0.smithi155.stdout:6/48: write d0/fb [881544,44729] 0 2023-12-16T05:56:24.310 INFO:tasks.workunit.client.0.smithi155.stdout:6/49: fdatasync d0/d3/f9 0 2023-12-16T05:56:24.314 INFO:tasks.workunit.client.0.smithi155.stdout:8/39: creat d4/da/fb x:0 0 0 2023-12-16T05:56:24.314 INFO:tasks.workunit.client.0.smithi155.stdout:2/22: dwrite d0/d7/f9 [0,4194304] 0 2023-12-16T05:56:24.316 INFO:tasks.workunit.client.0.smithi155.stdout:7/45: dwrite d0/d1/d5/f8 [0,4194304] 0 2023-12-16T05:56:24.316 INFO:tasks.workunit.client.0.smithi155.stdout:7/46: getdents d0/d1 0 2023-12-16T05:56:24.317 INFO:tasks.workunit.client.0.smithi155.stdout:4/40: symlink d0/l9 0 2023-12-16T05:56:24.317 INFO:tasks.workunit.client.0.smithi155.stdout:4/41: fdatasync d0/f5 0 2023-12-16T05:56:24.318 INFO:tasks.workunit.client.0.smithi155.stdout:8/40: mkdir d4/dc 0 2023-12-16T05:56:24.319 INFO:tasks.workunit.client.0.smithi155.stdout:9/34: truncate f3 2762924 0 2023-12-16T05:56:24.321 INFO:tasks.workunit.client.0.smithi155.stdout:0/85: dwrite d7/df/f19 [0,4194304] 0 2023-12-16T05:56:24.322 INFO:tasks.workunit.client.0.smithi155.stdout:7/47: rename d0/d1/l3 to d0/l11 0 2023-12-16T05:56:24.322 INFO:tasks.workunit.client.0.smithi155.stdout:4/42: chown d0/f4 2 1 2023-12-16T05:56:24.324 INFO:tasks.workunit.client.0.smithi155.stdout:8/41: creat d4/fd x:0 0 0 2023-12-16T05:56:24.329 INFO:tasks.workunit.client.0.smithi155.stdout:6/50: getdents d0/d3 0 2023-12-16T05:56:24.329 INFO:tasks.workunit.client.0.smithi155.stdout:8/42: dread f2 [0,4194304] 0 2023-12-16T05:56:24.329 INFO:tasks.workunit.client.0.smithi155.stdout:0/86: mknod d7/d1c/c22 0 2023-12-16T05:56:24.330 INFO:tasks.workunit.client.0.smithi155.stdout:7/48: creat d0/f12 x:0 0 0 2023-12-16T05:56:24.330 INFO:tasks.workunit.client.0.smithi155.stdout:7/49: read d0/d1/d5/fd [373248,57825] 0 2023-12-16T05:56:24.331 INFO:tasks.workunit.client.0.smithi155.stdout:6/51: symlink d0/l13 0 2023-12-16T05:56:24.333 INFO:tasks.workunit.client.0.smithi155.stdout:0/87: mkdir d7/d1c/d23 0 2023-12-16T05:56:24.334 INFO:tasks.workunit.client.0.smithi155.stdout:6/52: dread d0/fb [0,4194304] 0 2023-12-16T05:56:24.335 INFO:tasks.workunit.client.0.smithi155.stdout:7/50: symlink d0/d1/l13 0 2023-12-16T05:56:24.336 INFO:tasks.workunit.client.0.smithi155.stdout:4/43: mkdir d0/da 0 2023-12-16T05:56:24.338 INFO:tasks.workunit.client.0.smithi155.stdout:0/88: mknod d7/df/d1d/c24 0 2023-12-16T05:56:24.339 INFO:tasks.workunit.client.0.smithi155.stdout:7/51: symlink d0/l14 0 2023-12-16T05:56:24.339 INFO:tasks.workunit.client.0.smithi155.stdout:0/89: write d7/df/f1a [492062,45981] 0 2023-12-16T05:56:24.341 INFO:tasks.workunit.client.0.smithi155.stdout:4/44: creat d0/fb x:0 0 0 2023-12-16T05:56:24.342 INFO:tasks.workunit.client.0.smithi155.stdout:0/90: mknod d7/df/c25 0 2023-12-16T05:56:24.344 INFO:tasks.workunit.client.0.smithi155.stdout:4/45: symlink d0/lc 0 2023-12-16T05:56:24.344 INFO:tasks.workunit.client.0.smithi155.stdout:4/46: chown d0/l9 7111 1 2023-12-16T05:56:24.344 INFO:tasks.workunit.client.0.smithi155.stdout:4/47: write d0/fb [641866,67165] 0 2023-12-16T05:56:24.345 INFO:tasks.workunit.client.0.smithi155.stdout:4/48: mkdir d0/da/dd 0 2023-12-16T05:56:24.347 INFO:tasks.workunit.client.0.smithi155.stdout:4/49: unlink d0/f7 0 2023-12-16T05:56:24.351 INFO:tasks.workunit.client.0.smithi155.stdout:0/91: dread d7/fe [0,4194304] 0 2023-12-16T05:56:24.351 INFO:tasks.workunit.client.0.smithi155.stdout:0/92: readlink l6 0 2023-12-16T05:56:24.351 INFO:tasks.workunit.client.0.smithi155.stdout:0/93: fdatasync d7/d13/f20 0 2023-12-16T05:56:24.352 INFO:tasks.workunit.client.0.smithi155.stdout:0/94: creat d7/df/f26 x:0 0 0 2023-12-16T05:56:24.352 INFO:tasks.workunit.client.0.smithi155.stdout:0/95: write d7/fb [1255544,107792] 0 2023-12-16T05:56:24.354 INFO:tasks.workunit.client.0.smithi155.stdout:6/53: dwrite d0/d3/f12 [0,4194304] 0 2023-12-16T05:56:24.354 INFO:tasks.workunit.client.0.smithi155.stdout:8/43: dwrite f0 [0,4194304] 0 2023-12-16T05:56:24.354 INFO:tasks.workunit.client.0.smithi155.stdout:8/44: read - d4/da/fb zero size 2023-12-16T05:56:24.354 INFO:tasks.workunit.client.0.smithi155.stdout:8/45: readlink - no filename 2023-12-16T05:56:24.354 INFO:tasks.workunit.client.0.smithi155.stdout:8/46: fdatasync d4/da/fb 0 2023-12-16T05:56:24.357 INFO:tasks.workunit.client.0.smithi155.stdout:6/54: mkdir d0/d14 0 2023-12-16T05:56:24.357 INFO:tasks.workunit.client.0.smithi155.stdout:6/55: chown d0/fc 2456 1 2023-12-16T05:56:24.357 INFO:tasks.workunit.client.0.smithi155.stdout:6/56: chown d0/d3/f9 31531 1 2023-12-16T05:56:24.358 INFO:tasks.workunit.client.0.smithi155.stdout:0/96: dread d7/fb [0,4194304] 0 2023-12-16T05:56:24.358 INFO:tasks.workunit.client.0.smithi155.stdout:4/50: dread d0/f5 [0,4194304] 0 2023-12-16T05:56:24.360 INFO:tasks.workunit.client.0.smithi155.stdout:8/47: creat d4/da/fe x:0 0 0 2023-12-16T05:56:24.361 INFO:tasks.workunit.client.0.smithi155.stdout:8/48: dread f3 [0,4194304] 0 2023-12-16T05:56:24.362 INFO:tasks.workunit.client.0.smithi155.stdout:8/49: write f3 [349541,20143] 0 2023-12-16T05:56:24.362 INFO:tasks.workunit.client.0.smithi155.stdout:6/57: creat d0/d14/f15 x:0 0 0 2023-12-16T05:56:24.363 INFO:tasks.workunit.client.0.smithi155.stdout:6/58: truncate d0/d3/f11 1043898 0 2023-12-16T05:56:24.364 INFO:tasks.workunit.client.0.smithi155.stdout:8/50: rename d4/fd to d4/ff 0 2023-12-16T05:56:24.365 INFO:tasks.workunit.client.0.smithi155.stdout:8/51: read f2 [522989,44349] 0 2023-12-16T05:56:24.366 INFO:tasks.workunit.client.0.smithi155.stdout:6/59: rename d0/d3/fa to d0/f16 0 2023-12-16T05:56:24.368 INFO:tasks.workunit.client.0.smithi155.stdout:8/52: rename d4/da/fe to d4/f10 0 2023-12-16T05:56:24.369 INFO:tasks.workunit.client.0.smithi155.stdout:6/60: rename d0/fb to d0/d14/f17 0 2023-12-16T05:56:24.370 INFO:tasks.workunit.client.0.smithi155.stdout:8/53: dread f2 [0,4194304] 0 2023-12-16T05:56:24.371 INFO:tasks.workunit.client.0.smithi155.stdout:8/54: write f3 [233713,33261] 0 2023-12-16T05:56:24.371 INFO:tasks.workunit.client.0.smithi155.stdout:8/55: mkdir d4/da/d11 0 2023-12-16T05:56:24.376 INFO:tasks.workunit.client.0.smithi155.stdout:0/97: dwrite d7/df/f10 [0,4194304] 0 2023-12-16T05:56:24.377 INFO:tasks.workunit.client.0.smithi155.stdout:0/98: unlink d7/df/f10 0 2023-12-16T05:56:24.383 INFO:tasks.workunit.client.0.smithi155.stdout:8/56: rmdir d4 39 2023-12-16T05:56:24.384 INFO:tasks.workunit.client.0.smithi155.stdout:6/61: dwrite d0/d3/f12 [0,4194304] 0 2023-12-16T05:56:24.386 INFO:tasks.workunit.client.0.smithi155.stdout:6/62: creat d0/df/f18 x:0 0 0 2023-12-16T05:56:24.387 INFO:tasks.workunit.client.0.smithi155.stdout:6/63: creat d0/d3/f19 x:0 0 0 2023-12-16T05:56:24.388 INFO:tasks.workunit.client.0.smithi155.stdout:6/64: chown d0/d3/f11 1553161 1 2023-12-16T05:56:24.388 INFO:tasks.workunit.client.0.smithi155.stdout:6/65: write d0/d3/f11 [1373389,24898] 0 2023-12-16T05:56:24.388 INFO:tasks.workunit.client.0.smithi155.stdout:6/66: truncate d0/df/f18 875862 0 2023-12-16T05:56:24.388 INFO:tasks.workunit.client.0.smithi155.stdout:6/67: truncate d0/d3/f9 4976170 0 2023-12-16T05:56:24.388 INFO:tasks.workunit.client.0.smithi155.stdout:6/68: symlink d0/l1a 0 2023-12-16T05:56:24.389 INFO:tasks.workunit.client.0.smithi155.stdout:6/69: mkdir d0/d14/d1b 0 2023-12-16T05:56:24.389 INFO:tasks.workunit.client.0.smithi155.stdout:6/70: write d0/d3/f6 [3256366,80273] 0 2023-12-16T05:56:24.398 INFO:tasks.workunit.client.0.smithi155.stdout:6/71: getdents d0 0 2023-12-16T05:56:24.399 INFO:tasks.workunit.client.0.smithi155.stdout:6/72: rmdir d0/d14 39 2023-12-16T05:56:24.400 INFO:tasks.workunit.client.0.smithi155.stdout:6/73: fsync d0/f7 0 2023-12-16T05:56:24.400 INFO:tasks.workunit.client.0.smithi155.stdout:8/57: dwrite d4/f7 [0,4194304] 0 2023-12-16T05:56:24.403 INFO:tasks.workunit.client.0.smithi155.stdout:6/74: unlink d0/f7 0 2023-12-16T05:56:24.403 INFO:tasks.workunit.client.0.smithi155.stdout:6/75: chown d0/l1a 13950 1 2023-12-16T05:56:24.404 INFO:tasks.workunit.client.0.smithi155.stdout:6/76: mknod d0/d3/c1c 0 2023-12-16T05:56:24.404 INFO:tasks.workunit.client.0.smithi155.stdout:6/77: read - d0/d3/f19 zero size 2023-12-16T05:56:24.406 INFO:tasks.workunit.client.0.smithi155.stdout:6/78: write d0/d3/f6 [1186658,117978] 0 2023-12-16T05:56:24.406 INFO:tasks.workunit.client.0.smithi155.stdout:6/79: creat d0/d14/f1d x:0 0 0 2023-12-16T05:56:24.416 INFO:tasks.workunit.client.0.smithi155.stdout:8/58: dwrite d4/f10 [0,4194304] 0 2023-12-16T05:56:24.416 INFO:tasks.workunit.client.0.smithi155.stdout:8/59: dread - d4/ff zero size 2023-12-16T05:56:24.418 INFO:tasks.workunit.client.0.smithi155.stdout:8/60: rename d4/da/d11 to d4/da/d12 0 2023-12-16T05:56:24.418 INFO:tasks.workunit.client.0.smithi155.stdout:8/61: readlink - no filename 2023-12-16T05:56:24.418 INFO:tasks.workunit.client.0.smithi155.stdout:8/62: stat f0 0 2023-12-16T05:56:24.418 INFO:tasks.workunit.client.0.smithi155.stdout:8/63: stat d4/c6 0 2023-12-16T05:56:24.418 INFO:tasks.workunit.client.0.smithi155.stdout:8/64: chown f3 101187 1 2023-12-16T05:56:24.419 INFO:tasks.workunit.client.0.smithi155.stdout:8/65: dread f3 [0,4194304] 0 2023-12-16T05:56:24.420 INFO:tasks.workunit.client.0.smithi155.stdout:8/66: read d4/f7 [2735942,16036] 0 2023-12-16T05:56:24.420 INFO:tasks.workunit.client.0.smithi155.stdout:8/67: dread - d4/ff zero size 2023-12-16T05:56:24.423 INFO:tasks.workunit.client.0.smithi155.stdout:6/80: dwrite d0/d14/f1d [0,4194304] 0 2023-12-16T05:56:24.424 INFO:tasks.workunit.client.0.smithi155.stdout:6/81: fsync d0/f4 0 2023-12-16T05:56:24.425 INFO:tasks.workunit.client.0.smithi155.stdout:6/82: fdatasync d0/fc 0 2023-12-16T05:56:24.427 INFO:tasks.workunit.client.0.smithi155.stdout:6/83: rmdir d0 39 2023-12-16T05:56:24.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:24 smithi156 ceph-mon[121001]: pgmap v8: 65 pgs: 65 active+clean; 213 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 9.1 MiB/s wr, 1.02k op/s 2023-12-16T05:56:24.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:24 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:24.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:24 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:24.430 INFO:tasks.workunit.client.0.smithi155.stdout:8/68: dread d4/f7 [0,4194304] 0 2023-12-16T05:56:24.431 INFO:tasks.workunit.client.0.smithi155.stdout:8/69: chown d4/f7 236810 1 2023-12-16T05:56:24.431 INFO:tasks.workunit.client.0.smithi155.stdout:8/70: creat d4/dc/f13 x:0 0 0 2023-12-16T05:56:24.432 INFO:tasks.workunit.client.0.smithi155.stdout:8/71: write f0 [3399636,56791] 0 2023-12-16T05:56:24.433 INFO:tasks.workunit.client.0.smithi155.stdout:8/72: mkdir d4/d14 0 2023-12-16T05:56:24.434 INFO:tasks.workunit.client.0.smithi155.stdout:8/73: truncate d4/f7 1633313 0 2023-12-16T05:56:24.436 INFO:tasks.workunit.client.0.smithi155.stdout:8/74: fsync f0 0 2023-12-16T05:56:24.437 INFO:tasks.workunit.client.0.smithi155.stdout:8/75: dread f3 [0,4194304] 0 2023-12-16T05:56:24.439 INFO:tasks.workunit.client.0.smithi155.stdout:8/76: mknod d4/da/c15 0 2023-12-16T05:56:24.447 INFO:tasks.workunit.client.0.smithi155.stdout:8/77: dread f0 [0,4194304] 0 2023-12-16T05:56:24.449 INFO:tasks.workunit.client.0.smithi155.stdout:6/84: dwrite d0/d3/f9 [0,4194304] 0 2023-12-16T05:56:24.449 INFO:tasks.workunit.client.0.smithi155.stdout:6/85: dread - d0/d3/f19 zero size 2023-12-16T05:56:24.450 INFO:tasks.workunit.client.0.smithi155.stdout:6/86: fdatasync d0/f16 0 2023-12-16T05:56:24.472 INFO:tasks.workunit.client.0.smithi155.stdout:8/78: dwrite f0 [0,4194304] 0 2023-12-16T05:56:24.472 INFO:tasks.workunit.client.0.smithi155.stdout:8/79: chown d4/dc/f13 486412400 1 2023-12-16T05:56:24.472 INFO:tasks.workunit.client.0.smithi155.stdout:8/80: readlink - no filename 2023-12-16T05:56:24.472 INFO:tasks.workunit.client.0.smithi155.stdout:6/87: dwrite d0/d14/f1d [0,4194304] 0 2023-12-16T05:56:24.472 INFO:tasks.workunit.client.0.smithi155.stdout:8/81: rmdir d4/da 39 2023-12-16T05:56:24.473 INFO:tasks.workunit.client.0.smithi155.stdout:8/82: rename d4/c6 to d4/d14/c16 0 2023-12-16T05:56:24.476 INFO:tasks.workunit.client.0.smithi155.stdout:6/88: dread d0/f16 [0,4194304] 0 2023-12-16T05:56:24.477 INFO:tasks.workunit.client.0.smithi155.stdout:6/89: creat d0/d3/f1e x:0 0 0 2023-12-16T05:56:24.502 INFO:tasks.workunit.client.0.smithi155.stdout:8/83: dwrite d4/da/fb [0,4194304] 0 2023-12-16T05:56:24.502 INFO:tasks.workunit.client.0.smithi155.stdout:8/84: chown d4/f7 156 1 2023-12-16T05:56:24.503 INFO:tasks.workunit.client.0.smithi155.stdout:6/90: dwrite d0/d3/f6 [0,4194304] 0 2023-12-16T05:56:24.504 INFO:tasks.workunit.client.0.smithi155.stdout:8/85: unlink d4/c9 0 2023-12-16T05:56:24.504 INFO:tasks.workunit.client.0.smithi155.stdout:8/86: chown d4/c5 7 1 2023-12-16T05:56:24.504 INFO:tasks.workunit.client.0.smithi155.stdout:8/87: dread - d4/dc/f13 zero size 2023-12-16T05:56:24.505 INFO:tasks.workunit.client.0.smithi155.stdout:8/88: dread - d4/dc/f13 zero size 2023-12-16T05:56:24.506 INFO:tasks.workunit.client.0.smithi155.stdout:8/89: mknod d4/da/c17 0 2023-12-16T05:56:24.516 INFO:tasks.workunit.client.0.smithi155.stdout:6/91: dwrite d0/d3/f1e [0,4194304] 0 2023-12-16T05:56:24.517 INFO:tasks.workunit.client.0.smithi155.stdout:6/92: chown d0/l10 24244847 1 2023-12-16T05:56:24.517 INFO:tasks.workunit.client.0.smithi155.stdout:6/93: dread - d0/d3/f19 zero size 2023-12-16T05:56:24.517 INFO:tasks.workunit.client.0.smithi155.stdout:6/94: getdents d0/d14 0 2023-12-16T05:56:24.517 INFO:tasks.workunit.client.0.smithi155.stdout:6/95: chown d0/f4 1 1 2023-12-16T05:56:24.518 INFO:tasks.workunit.client.0.smithi155.stdout:6/96: write d0/d14/f17 [382908,69043] 0 2023-12-16T05:56:24.520 INFO:tasks.workunit.client.0.smithi155.stdout:6/97: link d0/l1a d0/df/l1f 0 2023-12-16T05:56:24.529 INFO:tasks.workunit.client.0.smithi155.stdout:6/98: dread d0/d14/f1d [0,4194304] 0 2023-12-16T05:56:24.533 INFO:tasks.workunit.client.0.smithi155.stdout:6/99: symlink d0/d14/d1b/l20 0 2023-12-16T05:56:24.533 INFO:tasks.workunit.client.0.smithi155.stdout:6/100: fsync d0/d14/f15 0 2023-12-16T05:56:24.533 INFO:tasks.workunit.client.0.smithi155.stdout:6/101: creat d0/d14/d1b/f21 x:0 0 0 2023-12-16T05:56:24.533 INFO:tasks.workunit.client.0.smithi155.stdout:6/102: creat d0/d14/d1b/f22 x:0 0 0 2023-12-16T05:56:24.534 INFO:tasks.workunit.client.0.smithi155.stdout:6/103: truncate d0/fc 418960 0 2023-12-16T05:56:24.534 INFO:tasks.workunit.client.0.smithi155.stdout:6/104: symlink d0/d3/l23 0 2023-12-16T05:56:24.534 INFO:tasks.workunit.client.0.smithi155.stdout:6/105: symlink d0/l24 0 2023-12-16T05:56:24.535 INFO:tasks.workunit.client.0.smithi155.stdout:6/106: fdatasync d0/d3/f6 0 2023-12-16T05:56:24.535 INFO:tasks.workunit.client.0.smithi155.stdout:6/107: write d0/d3/f11 [293057,56039] 0 2023-12-16T05:56:24.535 INFO:tasks.workunit.client.0.smithi155.stdout:6/108: chown d0/d3/f19 71636318 1 2023-12-16T05:56:24.536 INFO:tasks.workunit.client.0.smithi155.stdout:6/109: chown d0/df/l1f 16955512 1 2023-12-16T05:56:24.541 INFO:tasks.workunit.client.0.smithi155.stdout:6/110: dread d0/d14/f1d [0,4194304] 0 2023-12-16T05:56:24.542 INFO:tasks.workunit.client.0.smithi155.stdout:6/111: symlink d0/d14/d1b/l25 0 2023-12-16T05:56:24.542 INFO:tasks.workunit.client.0.smithi155.stdout:6/112: chown d0/d3/f11 22 1 2023-12-16T05:56:24.542 INFO:tasks.workunit.client.0.smithi155.stdout:6/113: chown d0/f16 4027 1 2023-12-16T05:56:24.543 INFO:tasks.workunit.client.0.smithi155.stdout:6/114: creat d0/df/f26 x:0 0 0 2023-12-16T05:56:24.543 INFO:tasks.workunit.client.0.smithi155.stdout:6/115: creat d0/df/f27 x:0 0 0 2023-12-16T05:56:24.548 INFO:tasks.workunit.client.0.smithi155.stdout:6/116: dread d0/d14/f1d [0,4194304] 0 2023-12-16T05:56:24.549 INFO:tasks.workunit.client.0.smithi155.stdout:6/117: unlink d0/l13 0 2023-12-16T05:56:24.549 INFO:tasks.workunit.client.0.smithi155.stdout:6/118: chown d0/df 110029621 1 2023-12-16T05:56:24.550 INFO:tasks.workunit.client.0.smithi155.stdout:6/119: rename d0/d3/c1c to d0/d3/c28 0 2023-12-16T05:56:24.551 INFO:tasks.workunit.client.0.smithi155.stdout:6/120: symlink d0/d14/l29 0 2023-12-16T05:56:24.552 INFO:tasks.workunit.client.0.smithi155.stdout:6/121: symlink d0/d14/d1b/l2a 0 2023-12-16T05:56:24.552 INFO:tasks.workunit.client.0.smithi155.stdout:6/122: chown d0/df/l1f 165 1 2023-12-16T05:56:24.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:24 smithi155 ceph-mon[112451]: pgmap v8: 65 pgs: 65 active+clean; 213 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 9.1 MiB/s wr, 1.02k op/s 2023-12-16T05:56:24.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:24 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:24.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:24 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:24.922 INFO:tasks.workunit.client.0.smithi155.stdout:2/23: sync 2023-12-16T05:56:24.922 INFO:tasks.workunit.client.0.smithi155.stdout:7/52: sync 2023-12-16T05:56:24.923 INFO:tasks.workunit.client.0.smithi155.stdout:3/38: sync 2023-12-16T05:56:24.923 INFO:tasks.workunit.client.0.smithi155.stdout:7/53: stat d0 0 2023-12-16T05:56:24.923 INFO:tasks.workunit.client.0.smithi155.stdout:4/51: sync 2023-12-16T05:56:24.923 INFO:tasks.workunit.client.0.smithi155.stdout:3/39: fdatasync d0/f9 0 2023-12-16T05:56:24.923 INFO:tasks.workunit.client.0.smithi155.stdout:7/54: chown d0/d1/d5/f8 1731140896 1 2023-12-16T05:56:24.923 INFO:tasks.workunit.client.0.smithi155.stdout:1/45: sync 2023-12-16T05:56:24.923 INFO:tasks.workunit.client.0.smithi155.stdout:7/55: dread - d0/d1/fb zero size 2023-12-16T05:56:24.924 INFO:tasks.workunit.client.0.smithi155.stdout:5/109: sync 2023-12-16T05:56:24.924 INFO:tasks.workunit.client.0.smithi155.stdout:3/40: truncate d0/f6 811403 0 2023-12-16T05:56:24.924 INFO:tasks.workunit.client.0.smithi155.stdout:9/35: sync 2023-12-16T05:56:24.924 INFO:tasks.workunit.client.0.smithi155.stdout:7/56: write d0/d1/fe [1073857,88045] 0 2023-12-16T05:56:24.924 INFO:tasks.workunit.client.0.smithi155.stdout:4/52: read d0/f4 [17573,65673] 0 2023-12-16T05:56:24.925 INFO:tasks.workunit.client.0.smithi155.stdout:1/46: dread d1/d7/f12 [0,4194304] 0 2023-12-16T05:56:24.925 INFO:tasks.workunit.client.0.smithi155.stdout:2/24: creat d0/d5/d6/fb x:0 0 0 2023-12-16T05:56:24.925 INFO:tasks.workunit.client.0.smithi155.stdout:9/36: getdents . 0 2023-12-16T05:56:24.925 INFO:tasks.workunit.client.0.smithi155.stdout:9/37: rmdir - no directory 2023-12-16T05:56:24.925 INFO:tasks.workunit.client.0.smithi155.stdout:5/110: creat d0/d2/d7/d19/f20 x:0 0 0 2023-12-16T05:56:24.927 INFO:tasks.workunit.client.0.smithi155.stdout:7/57: creat d0/f15 x:0 0 0 2023-12-16T05:56:24.927 INFO:tasks.workunit.client.0.smithi155.stdout:7/58: stat d0/d1/c6 0 2023-12-16T05:56:24.927 INFO:tasks.workunit.client.0.smithi155.stdout:7/59: stat d0/d1/d5/c7 0 2023-12-16T05:56:24.927 INFO:tasks.workunit.client.0.smithi155.stdout:7/60: truncate d0/d1/d5/fd 955462 0 2023-12-16T05:56:24.928 INFO:tasks.workunit.client.0.smithi155.stdout:2/25: mknod d0/d7/cc 0 2023-12-16T05:56:24.929 INFO:tasks.workunit.client.0.smithi155.stdout:9/38: mkdir da 0 2023-12-16T05:56:24.930 INFO:tasks.workunit.client.0.smithi155.stdout:4/53: symlink d0/le 0 2023-12-16T05:56:24.932 INFO:tasks.workunit.client.0.smithi155.stdout:9/39: write f9 [934308,79212] 0 2023-12-16T05:56:24.932 INFO:tasks.workunit.client.0.smithi155.stdout:4/54: dread d0/f4 [0,4194304] 0 2023-12-16T05:56:24.932 INFO:tasks.workunit.client.0.smithi155.stdout:4/55: write d0/f4 [846646,113370] 0 2023-12-16T05:56:24.936 INFO:tasks.workunit.client.0.smithi155.stdout:7/61: dread d0/d1/fe [0,4194304] 0 2023-12-16T05:56:24.938 INFO:tasks.workunit.client.0.smithi155.stdout:4/56: rmdir d0 39 2023-12-16T05:56:24.940 INFO:tasks.workunit.client.0.smithi155.stdout:4/57: creat d0/da/ff x:0 0 0 2023-12-16T05:56:24.942 INFO:tasks.workunit.client.0.smithi155.stdout:4/58: rename d0/da/dd to d0/d10 0 2023-12-16T05:56:24.944 INFO:tasks.workunit.client.0.smithi155.stdout:2/26: dread d0/f1 [0,4194304] 0 2023-12-16T05:56:24.946 INFO:tasks.workunit.client.0.smithi155.stdout:2/27: mkdir d0/d7/dd 0 2023-12-16T05:56:24.947 INFO:tasks.workunit.client.0.smithi155.stdout:7/62: dread d0/d1/d5/f8 [0,4194304] 0 2023-12-16T05:56:24.949 INFO:tasks.workunit.client.0.smithi155.stdout:5/111: dwrite d0/f1c [0,4194304] 0 2023-12-16T05:56:24.949 INFO:tasks.workunit.client.0.smithi155.stdout:3/41: dwrite d0/f6 [0,4194304] 0 2023-12-16T05:56:24.949 INFO:tasks.workunit.client.0.smithi155.stdout:2/28: dread d0/f2 [0,4194304] 0 2023-12-16T05:56:24.951 INFO:tasks.workunit.client.0.smithi155.stdout:1/47: dwrite d1/f6 [0,4194304] 0 2023-12-16T05:56:24.955 INFO:tasks.workunit.client.0.smithi155.stdout:5/112: mkdir d0/d2/d7/d19/d21 0 2023-12-16T05:56:24.956 INFO:tasks.workunit.client.0.smithi155.stdout:5/113: truncate d0/d2/d7/d19/f20 67331 0 2023-12-16T05:56:24.956 INFO:tasks.workunit.client.0.smithi155.stdout:3/42: mknod d0/cc 0 2023-12-16T05:56:24.956 INFO:tasks.workunit.client.0.smithi155.stdout:3/43: fsync d0/fa 0 2023-12-16T05:56:24.956 INFO:tasks.workunit.client.0.smithi155.stdout:3/44: write d0/f9 [280697,24415] 0 2023-12-16T05:56:24.956 INFO:tasks.workunit.client.0.smithi155.stdout:3/45: chown d0/f9 11 1 2023-12-16T05:56:24.956 INFO:tasks.workunit.client.0.smithi155.stdout:3/46: truncate d0/fb 688624 0 2023-12-16T05:56:24.990 INFO:tasks.workunit.client.0.smithi155.stdout:4/59: dwrite d0/f4 [0,4194304] 0 2023-12-16T05:56:24.991 INFO:tasks.workunit.client.0.smithi155.stdout:7/63: dwrite d0/f12 [0,4194304] 0 2023-12-16T05:56:24.991 INFO:tasks.workunit.client.0.smithi155.stdout:7/64: readlink d0/d1/lc 0 2023-12-16T05:56:24.992 INFO:tasks.workunit.client.0.smithi155.stdout:4/60: mkdir d0/d11 0 2023-12-16T05:56:24.994 INFO:tasks.workunit.client.0.smithi155.stdout:4/61: creat d0/d10/f12 x:0 0 0 2023-12-16T05:56:24.994 INFO:tasks.workunit.client.0.smithi155.stdout:4/62: fdatasync d0/d10/f12 0 2023-12-16T05:56:24.995 INFO:tasks.workunit.client.0.smithi155.stdout:4/63: mknod d0/da/c13 0 2023-12-16T05:56:24.999 INFO:tasks.workunit.client.0.smithi155.stdout:5/114: dwrite d0/f1c [0,4194304] 0 2023-12-16T05:56:24.999 INFO:tasks.workunit.client.0.smithi155.stdout:5/115: write d0/d2/d7/f16 [4882960,115295] 0 2023-12-16T05:56:24.999 INFO:tasks.workunit.client.0.smithi155.stdout:3/47: dwrite d0/fb [0,4194304] 0 2023-12-16T05:56:25.000 INFO:tasks.workunit.client.0.smithi155.stdout:1/48: dwrite d1/f6 [0,4194304] 0 2023-12-16T05:56:25.000 INFO:tasks.workunit.client.0.smithi155.stdout:5/116: creat d0/d2/f22 x:0 0 0 2023-12-16T05:56:25.002 INFO:tasks.workunit.client.0.smithi155.stdout:1/49: mkdir d1/d7/d16 0 2023-12-16T05:56:25.004 INFO:tasks.workunit.client.0.smithi155.stdout:2/29: dwrite d0/d7/f9 [0,4194304] 0 2023-12-16T05:56:25.004 INFO:tasks.workunit.client.0.smithi155.stdout:9/40: dwrite f9 [0,4194304] 0 2023-12-16T05:56:25.004 INFO:tasks.workunit.client.0.smithi155.stdout:1/50: mkdir d1/d17 0 2023-12-16T05:56:25.004 INFO:tasks.workunit.client.0.smithi155.stdout:1/51: readlink d1/lc 0 2023-12-16T05:56:25.007 INFO:tasks.workunit.client.0.smithi155.stdout:9/41: mknod da/cb 0 2023-12-16T05:56:25.008 INFO:tasks.workunit.client.0.smithi155.stdout:7/65: dread d0/f12 [0,4194304] 0 2023-12-16T05:56:25.009 INFO:tasks.workunit.client.0.smithi155.stdout:2/30: mknod d0/d5/d6/ce 0 2023-12-16T05:56:25.010 INFO:tasks.workunit.client.0.smithi155.stdout:2/31: dread - d0/f8 zero size 2023-12-16T05:56:25.010 INFO:tasks.workunit.client.0.smithi155.stdout:2/32: fdatasync d0/f8 0 2023-12-16T05:56:25.010 INFO:tasks.workunit.client.0.smithi155.stdout:2/33: readlink d0/l3 0 2023-12-16T05:56:25.011 INFO:tasks.workunit.client.0.smithi155.stdout:1/52: rename d1/f4 to d1/d7/f18 0 2023-12-16T05:56:25.013 INFO:tasks.workunit.client.0.smithi155.stdout:9/42: fdatasync f3 0 2023-12-16T05:56:25.014 INFO:tasks.workunit.client.0.smithi155.stdout:7/66: mknod d0/d1/c16 0 2023-12-16T05:56:25.014 INFO:tasks.workunit.client.0.smithi155.stdout:7/67: dread - d0/d1/fb zero size 2023-12-16T05:56:25.014 INFO:tasks.workunit.client.0.smithi155.stdout:9/43: write f3 [566826,59770] 0 2023-12-16T05:56:25.014 INFO:tasks.workunit.client.0.smithi155.stdout:9/44: chown da/cb 155079 1 2023-12-16T05:56:25.015 INFO:tasks.workunit.client.0.smithi155.stdout:2/34: mkdir d0/d5/d6/df 0 2023-12-16T05:56:25.015 INFO:tasks.workunit.client.0.smithi155.stdout:2/35: dread - d0/d5/d6/fb zero size 2023-12-16T05:56:25.016 INFO:tasks.workunit.client.0.smithi155.stdout:1/53: symlink d1/l19 0 2023-12-16T05:56:25.020 INFO:tasks.workunit.client.0.smithi155.stdout:2/36: rename d0/d5/d6/fb to d0/d5/d6/f10 0 2023-12-16T05:56:25.020 INFO:tasks.workunit.client.0.smithi155.stdout:2/37: stat d0/d5/d6/ce 0 2023-12-16T05:56:25.021 INFO:tasks.workunit.client.0.smithi155.stdout:3/48: dwrite d0/fa [0,4194304] 0 2023-12-16T05:56:25.022 INFO:tasks.workunit.client.0.smithi155.stdout:4/64: dwrite d0/fb [0,4194304] 0 2023-12-16T05:56:25.024 INFO:tasks.workunit.client.0.smithi155.stdout:3/49: rename d0/c3 to d0/cd 0 2023-12-16T05:56:25.024 INFO:tasks.workunit.client.0.smithi155.stdout:3/50: readlink d0/l1 0 2023-12-16T05:56:25.024 INFO:tasks.workunit.client.0.smithi155.stdout:9/45: write f3 [2581763,87136] 0 2023-12-16T05:56:25.026 INFO:tasks.workunit.client.0.smithi155.stdout:3/51: creat d0/fe x:0 0 0 2023-12-16T05:56:25.027 INFO:tasks.workunit.client.0.smithi155.stdout:9/46: creat da/fc x:0 0 0 2023-12-16T05:56:25.027 INFO:tasks.workunit.client.0.smithi155.stdout:9/47: write f9 [4696386,45388] 0 2023-12-16T05:56:25.027 INFO:tasks.workunit.client.0.smithi155.stdout:2/38: write d0/f1 [710878,89945] 0 2023-12-16T05:56:25.029 INFO:tasks.workunit.client.0.smithi155.stdout:2/39: symlink d0/d5/l11 0 2023-12-16T05:56:25.031 INFO:tasks.workunit.client.0.smithi155.stdout:2/40: creat d0/f12 x:0 0 0 2023-12-16T05:56:25.033 INFO:tasks.workunit.client.0.smithi155.stdout:2/41: getdents d0/d7 0 2023-12-16T05:56:25.036 INFO:tasks.workunit.client.0.smithi155.stdout:2/42: link d0/d5/d6/ce d0/c13 0 2023-12-16T05:56:25.040 INFO:tasks.workunit.client.0.smithi155.stdout:3/52: link d0/cd d0/cf 0 2023-12-16T05:56:25.042 INFO:tasks.workunit.client.0.smithi155.stdout:2/43: truncate d0/f1 1483838 0 2023-12-16T05:56:25.043 INFO:tasks.workunit.client.0.smithi155.stdout:2/44: mkdir d0/d7/dd/d14 0 2023-12-16T05:56:25.043 INFO:tasks.workunit.client.0.smithi155.stdout:2/45: chown d0/f12 324 1 2023-12-16T05:56:25.045 INFO:tasks.workunit.client.0.smithi155.stdout:4/65: dread d0/f5 [0,4194304] 0 2023-12-16T05:56:25.045 INFO:tasks.workunit.client.0.smithi155.stdout:7/68: dwrite d0/d1/fb [0,4194304] 0 2023-12-16T05:56:25.045 INFO:tasks.workunit.client.0.smithi155.stdout:5/117: dwrite d0/d2/ff [0,4194304] 0 2023-12-16T05:56:25.045 INFO:tasks.workunit.client.0.smithi155.stdout:4/66: chown d0/da 12330 1 2023-12-16T05:56:25.045 INFO:tasks.workunit.client.0.smithi155.stdout:2/46: mknod d0/d7/dd/c15 0 2023-12-16T05:56:25.052 INFO:tasks.workunit.client.0.smithi155.stdout:7/69: symlink d0/d1/l17 0 2023-12-16T05:56:25.053 INFO:tasks.workunit.client.0.smithi155.stdout:2/47: creat d0/d5/d6/df/f16 x:0 0 0 2023-12-16T05:56:25.054 INFO:tasks.workunit.client.0.smithi155.stdout:7/70: mkdir d0/d1/d5/d18 0 2023-12-16T05:56:25.056 INFO:tasks.workunit.client.0.smithi155.stdout:2/48: mknod d0/d5/d6/df/c17 0 2023-12-16T05:56:25.056 INFO:tasks.workunit.client.0.smithi155.stdout:2/49: chown d0/f1 49 1 2023-12-16T05:56:25.057 INFO:tasks.workunit.client.0.smithi155.stdout:4/67: dread d0/f5 [0,4194304] 0 2023-12-16T05:56:25.058 INFO:tasks.workunit.client.0.smithi155.stdout:4/68: stat d0/l8 0 2023-12-16T05:56:25.058 INFO:tasks.workunit.client.0.smithi155.stdout:3/53: dread d0/fa [0,4194304] 0 2023-12-16T05:56:25.058 INFO:tasks.workunit.client.0.smithi155.stdout:1/54: dwrite d1/d7/f18 [4194304,4194304] 0 2023-12-16T05:56:25.058 INFO:tasks.workunit.client.0.smithi155.stdout:9/48: dread f9 [0,4194304] 0 2023-12-16T05:56:25.058 INFO:tasks.workunit.client.0.smithi155.stdout:9/49: fdatasync da/fc 0 2023-12-16T05:56:25.058 INFO:tasks.workunit.client.0.smithi155.stdout:1/55: read d1/d7/f12 [188085,96223] 0 2023-12-16T05:56:25.058 INFO:tasks.workunit.client.0.smithi155.stdout:7/71: rename d0/d1/c6 to d0/d1/d5/c19 0 2023-12-16T05:56:25.059 INFO:tasks.workunit.client.0.smithi155.stdout:2/50: creat d0/d5/d6/df/f18 x:0 0 0 2023-12-16T05:56:25.060 INFO:tasks.workunit.client.0.smithi155.stdout:3/54: creat d0/f10 x:0 0 0 2023-12-16T05:56:25.065 INFO:tasks.workunit.client.0.smithi155.stdout:5/118: dwrite d0/f15 [0,4194304] 0 2023-12-16T05:56:25.065 INFO:tasks.workunit.client.0.smithi155.stdout:5/119: write d0/d2/d7/f1e [846568,119541] 0 2023-12-16T05:56:25.067 INFO:tasks.workunit.client.0.smithi155.stdout:1/56: getdents d1 0 2023-12-16T05:56:25.068 INFO:tasks.workunit.client.0.smithi155.stdout:2/51: rename d0/d5/d6/df/f18 to d0/d7/dd/d14/f19 0 2023-12-16T05:56:25.069 INFO:tasks.workunit.client.0.smithi155.stdout:2/52: stat d0/d5/d6 0 2023-12-16T05:56:25.069 INFO:tasks.workunit.client.0.smithi155.stdout:3/55: creat d0/f11 x:0 0 0 2023-12-16T05:56:25.069 INFO:tasks.workunit.client.0.smithi155.stdout:3/56: chown d0/fb 1547951 1 2023-12-16T05:56:25.071 INFO:tasks.workunit.client.0.smithi155.stdout:5/120: truncate d0/d2/f9 360403 0 2023-12-16T05:56:25.071 INFO:tasks.workunit.client.0.smithi155.stdout:5/121: write d0/d2/d7/d19/f20 [1067225,65403] 0 2023-12-16T05:56:25.072 INFO:tasks.workunit.client.0.smithi155.stdout:7/72: dwrite d0/f15 [0,4194304] 0 2023-12-16T05:56:25.072 INFO:tasks.workunit.client.0.smithi155.stdout:1/57: symlink d1/d17/l1a 0 2023-12-16T05:56:25.073 INFO:tasks.workunit.client.0.smithi155.stdout:2/53: creat d0/f1a x:0 0 0 2023-12-16T05:56:25.075 INFO:tasks.workunit.client.0.smithi155.stdout:9/50: truncate f3 2700183 0 2023-12-16T05:56:25.075 INFO:tasks.workunit.client.0.smithi155.stdout:4/69: dread d0/fb [0,4194304] 0 2023-12-16T05:56:25.075 INFO:tasks.workunit.client.0.smithi155.stdout:4/70: write d0/f4 [4661664,118871] 0 2023-12-16T05:56:25.076 INFO:tasks.workunit.client.0.smithi155.stdout:3/57: creat d0/f12 x:0 0 0 2023-12-16T05:56:25.076 INFO:tasks.workunit.client.0.smithi155.stdout:3/58: dread - d0/f11 zero size 2023-12-16T05:56:25.079 INFO:tasks.workunit.client.0.smithi155.stdout:1/58: creat d1/d7/d16/f1b x:0 0 0 2023-12-16T05:56:25.079 INFO:tasks.workunit.client.0.smithi155.stdout:1/59: readlink d1/l19 0 2023-12-16T05:56:25.080 INFO:tasks.workunit.client.0.smithi155.stdout:9/51: rename da/cb to da/cd 0 2023-12-16T05:56:25.081 INFO:tasks.workunit.client.0.smithi155.stdout:3/59: stat d0/cd 0 2023-12-16T05:56:25.082 INFO:tasks.workunit.client.0.smithi155.stdout:7/73: truncate d0/d1/fe 935153 0 2023-12-16T05:56:25.083 INFO:tasks.workunit.client.0.smithi155.stdout:7/74: chown d0/d1/d5/c7 11 1 2023-12-16T05:56:25.084 INFO:tasks.workunit.client.0.smithi155.stdout:1/60: rename d1/d7/l14 to d1/d7/l1c 0 2023-12-16T05:56:25.086 INFO:tasks.workunit.client.0.smithi155.stdout:9/52: symlink da/le 0 2023-12-16T05:56:25.086 INFO:tasks.workunit.client.0.smithi155.stdout:9/53: dread - da/fc zero size 2023-12-16T05:56:25.086 INFO:tasks.workunit.client.0.smithi155.stdout:4/71: dread d0/fb [0,4194304] 0 2023-12-16T05:56:25.087 INFO:tasks.workunit.client.0.smithi155.stdout:3/60: rename d0/fa to d0/f13 0 2023-12-16T05:56:25.089 INFO:tasks.workunit.client.0.smithi155.stdout:8/90: sync 2023-12-16T05:56:25.090 INFO:tasks.workunit.client.0.smithi155.stdout:6/123: sync 2023-12-16T05:56:25.091 INFO:tasks.workunit.client.0.smithi155.stdout:0/99: sync 2023-12-16T05:56:25.093 INFO:tasks.workunit.client.0.smithi155.stdout:6/124: dread d0/d3/f11 [0,4194304] 0 2023-12-16T05:56:25.093 INFO:tasks.workunit.client.0.smithi155.stdout:6/125: chown d0/fc 41 1 2023-12-16T05:56:25.094 INFO:tasks.workunit.client.0.smithi155.stdout:1/61: creat d1/d7/d16/f1d x:0 0 0 2023-12-16T05:56:25.094 INFO:tasks.workunit.client.0.smithi155.stdout:1/62: dread - d1/d7/d16/f1b zero size 2023-12-16T05:56:25.095 INFO:tasks.workunit.client.0.smithi155.stdout:1/63: truncate d1/d7/d16/f1b 122224 0 2023-12-16T05:56:25.102 INFO:tasks.workunit.client.0.smithi155.stdout:7/75: dread d0/d1/fb [0,4194304] 0 2023-12-16T05:56:25.103 INFO:tasks.workunit.client.0.smithi155.stdout:7/76: stat d0/d1/d5/f9 0 2023-12-16T05:56:25.103 INFO:tasks.workunit.client.0.smithi155.stdout:9/54: read f3 [2100467,121666] 0 2023-12-16T05:56:25.104 INFO:tasks.workunit.client.0.smithi155.stdout:3/61: write d0/f9 [69146,130388] 0 2023-12-16T05:56:25.104 INFO:tasks.workunit.client.0.smithi155.stdout:3/62: dread - d0/f10 zero size 2023-12-16T05:56:25.104 INFO:tasks.workunit.client.0.smithi155.stdout:3/63: write d0/f12 [385323,84602] 0 2023-12-16T05:56:25.104 INFO:tasks.workunit.client.0.smithi155.stdout:3/64: chown d0/l1 9052 1 2023-12-16T05:56:25.105 INFO:tasks.workunit.client.0.smithi155.stdout:8/91: dread d4/da/fb [0,4194304] 0 2023-12-16T05:56:25.105 INFO:tasks.workunit.client.0.smithi155.stdout:8/92: truncate f2 1418667 0 2023-12-16T05:56:25.105 INFO:tasks.workunit.client.0.smithi155.stdout:5/122: dwrite d0/d2/ff [0,4194304] 0 2023-12-16T05:56:25.109 INFO:tasks.workunit.client.0.smithi155.stdout:1/64: dread d1/f6 [0,4194304] 0 2023-12-16T05:56:25.109 INFO:tasks.workunit.client.0.smithi155.stdout:1/65: chown d1/d17/l1a 178432 1 2023-12-16T05:56:25.113 INFO:tasks.workunit.client.0.smithi155.stdout:0/100: unlink d7/d13/f20 0 2023-12-16T05:56:25.113 INFO:tasks.workunit.client.0.smithi155.stdout:0/101: chown d7/df 30163 1 2023-12-16T05:56:25.113 INFO:tasks.workunit.client.0.smithi155.stdout:1/66: dread d1/ff [0,4194304] 0 2023-12-16T05:56:25.114 INFO:tasks.workunit.client.0.smithi155.stdout:1/67: dread d1/ff [0,4194304] 0 2023-12-16T05:56:25.114 INFO:tasks.workunit.client.0.smithi155.stdout:1/68: write d1/d7/f18 [8871086,5802] 0 2023-12-16T05:56:25.115 INFO:tasks.workunit.client.0.smithi155.stdout:6/126: creat d0/d14/d1b/f2b x:0 0 0 2023-12-16T05:56:25.117 INFO:tasks.workunit.client.0.smithi155.stdout:7/77: mkdir d0/d1/d5/d18/d1a 0 2023-12-16T05:56:25.117 INFO:tasks.workunit.client.0.smithi155.stdout:7/78: chown d0 9549 1 2023-12-16T05:56:25.118 INFO:tasks.workunit.client.0.smithi155.stdout:9/55: unlink da/fc 0 2023-12-16T05:56:25.120 INFO:tasks.workunit.client.0.smithi155.stdout:2/54: dwrite d0/f2 [0,4194304] 0 2023-12-16T05:56:25.120 INFO:tasks.workunit.client.0.smithi155.stdout:2/55: write d0/f8 [718155,20401] 0 2023-12-16T05:56:25.120 INFO:tasks.workunit.client.0.smithi155.stdout:3/65: mkdir d0/d14 0 2023-12-16T05:56:25.120 INFO:tasks.workunit.client.0.smithi155.stdout:3/66: getdents d0/d14 0 2023-12-16T05:56:25.120 INFO:tasks.workunit.client.0.smithi155.stdout:3/67: fdatasync d0/f6 0 2023-12-16T05:56:25.123 INFO:tasks.workunit.client.0.smithi155.stdout:8/93: rename d4/f7 to d4/dc/f18 0 2023-12-16T05:56:25.123 INFO:tasks.workunit.client.0.smithi155.stdout:8/94: fsync d4/f10 0 2023-12-16T05:56:25.124 INFO:tasks.workunit.client.0.smithi155.stdout:5/123: creat d0/d2/d7/d19/d21/f23 x:0 0 0 2023-12-16T05:56:25.124 INFO:tasks.workunit.client.0.smithi155.stdout:5/124: truncate d0/f1c 4882623 0 2023-12-16T05:56:25.124 INFO:tasks.workunit.client.0.smithi155.stdout:8/95: read f0 [2004823,65203] 0 2023-12-16T05:56:25.125 INFO:tasks.workunit.client.0.smithi155.stdout:0/102: mknod d7/d1c/c27 0 2023-12-16T05:56:25.126 INFO:tasks.workunit.client.0.smithi155.stdout:6/127: mkdir d0/d3/d2c 0 2023-12-16T05:56:25.126 INFO:tasks.workunit.client.0.smithi155.stdout:6/128: write d0/d14/d1b/f2b [693318,102827] 0 2023-12-16T05:56:25.128 INFO:tasks.workunit.client.0.smithi155.stdout:7/79: mkdir d0/d1b 0 2023-12-16T05:56:25.131 INFO:tasks.workunit.client.0.smithi155.stdout:2/56: creat d0/d5/d6/df/f1b x:0 0 0 2023-12-16T05:56:25.131 INFO:tasks.workunit.client.0.smithi155.stdout:2/57: chown d0/f4 205 1 2023-12-16T05:56:25.131 INFO:tasks.workunit.client.0.smithi155.stdout:2/58: truncate d0/f1 4339872 0 2023-12-16T05:56:25.131 INFO:tasks.workunit.client.0.smithi155.stdout:2/59: chown d0/f8 29731793 1 2023-12-16T05:56:25.133 INFO:tasks.workunit.client.0.smithi155.stdout:3/68: unlink d0/l1 0 2023-12-16T05:56:25.133 INFO:tasks.workunit.client.0.smithi155.stdout:3/69: readlink d0/l5 0 2023-12-16T05:56:25.134 INFO:tasks.workunit.client.0.smithi155.stdout:5/125: symlink d0/l24 0 2023-12-16T05:56:25.134 INFO:tasks.workunit.client.0.smithi155.stdout:5/126: write d0/d2/d7/f18 [664280,10324] 0 2023-12-16T05:56:25.134 INFO:tasks.workunit.client.0.smithi155.stdout:5/127: chown d0/d2/f1d 7 1 2023-12-16T05:56:25.135 INFO:tasks.workunit.client.0.smithi155.stdout:8/96: mkdir d4/dc/d19 0 2023-12-16T05:56:25.136 INFO:tasks.workunit.client.0.smithi155.stdout:7/80: creat d0/d1/d5/d18/f1c x:0 0 0 2023-12-16T05:56:25.137 INFO:tasks.workunit.client.0.smithi155.stdout:9/56: dwrite f9 [0,4194304] 0 2023-12-16T05:56:25.138 INFO:tasks.workunit.client.0.smithi155.stdout:2/60: rename d0/f8 to d0/d5/d6/f1c 0 2023-12-16T05:56:25.139 INFO:tasks.workunit.client.0.smithi155.stdout:5/128: dread d0/d2/d7/f1e [0,4194304] 0 2023-12-16T05:56:25.140 INFO:tasks.workunit.client.0.smithi155.stdout:8/97: mkdir d4/dc/d1a 0 2023-12-16T05:56:25.141 INFO:tasks.workunit.client.0.smithi155.stdout:0/103: symlink d7/l28 0 2023-12-16T05:56:25.143 INFO:tasks.workunit.client.0.smithi155.stdout:9/57: creat da/ff x:0 0 0 2023-12-16T05:56:25.145 INFO:tasks.workunit.client.0.smithi155.stdout:2/61: creat d0/d7/f1d x:0 0 0 2023-12-16T05:56:25.145 INFO:tasks.workunit.client.0.smithi155.stdout:9/58: truncate f3 1879333 0 2023-12-16T05:56:25.148 INFO:tasks.workunit.client.0.smithi155.stdout:9/59: creat da/f10 x:0 0 0 2023-12-16T05:56:25.151 INFO:tasks.workunit.client.0.smithi155.stdout:9/60: symlink da/l11 0 2023-12-16T05:56:25.152 INFO:tasks.workunit.client.0.smithi155.stdout:9/61: creat da/f12 x:0 0 0 2023-12-16T05:56:25.153 INFO:tasks.workunit.client.0.smithi155.stdout:9/62: creat da/f13 x:0 0 0 2023-12-16T05:56:25.159 INFO:tasks.workunit.client.0.smithi155.stdout:7/81: getdents d0/d1/d5/d18 0 2023-12-16T05:56:25.159 INFO:tasks.workunit.client.0.smithi155.stdout:2/62: dread d0/d7/f9 [0,4194304] 0 2023-12-16T05:56:25.161 INFO:tasks.workunit.client.0.smithi155.stdout:2/63: unlink d0/d5/d6/df/f16 0 2023-12-16T05:56:25.161 INFO:tasks.workunit.client.0.smithi155.stdout:7/82: write d0/d1/d5/f9 [1234204,100475] 0 2023-12-16T05:56:25.162 INFO:tasks.workunit.client.0.smithi155.stdout:2/64: rmdir d0/da 0 2023-12-16T05:56:25.164 INFO:tasks.workunit.client.0.smithi155.stdout:7/83: creat d0/d1/d5/f1d x:0 0 0 2023-12-16T05:56:25.165 INFO:tasks.workunit.client.0.smithi155.stdout:7/84: creat d0/d1b/f1e x:0 0 0 2023-12-16T05:56:25.166 INFO:tasks.workunit.client.0.smithi155.stdout:7/85: truncate d0/f12 4187882 0 2023-12-16T05:56:25.167 INFO:tasks.workunit.client.0.smithi155.stdout:2/65: dread d0/d5/d6/f1c [0,4194304] 0 2023-12-16T05:56:25.167 INFO:tasks.workunit.client.0.smithi155.stdout:2/66: chown d0/d5/d6/ce 954765874 1 2023-12-16T05:56:25.167 INFO:tasks.workunit.client.0.smithi155.stdout:2/67: dread - d0/d7/f1d zero size 2023-12-16T05:56:25.168 INFO:tasks.workunit.client.0.smithi155.stdout:3/70: dwrite d0/f12 [0,4194304] 0 2023-12-16T05:56:25.168 INFO:tasks.workunit.client.0.smithi155.stdout:8/98: dwrite f0 [0,4194304] 0 2023-12-16T05:56:25.168 INFO:tasks.workunit.client.0.smithi155.stdout:8/99: fdatasync d4/dc/f13 0 2023-12-16T05:56:25.168 INFO:tasks.workunit.client.0.smithi155.stdout:8/100: chown d4/d14 132543647 1 2023-12-16T05:56:25.169 INFO:tasks.workunit.client.0.smithi155.stdout:0/104: dwrite f2 [0,4194304] 0 2023-12-16T05:56:25.169 INFO:tasks.workunit.client.0.smithi155.stdout:5/129: dwrite d0/d2/f1a [0,4194304] 0 2023-12-16T05:56:25.169 INFO:tasks.workunit.client.0.smithi155.stdout:9/63: rmdir da 39 2023-12-16T05:56:25.171 INFO:tasks.workunit.client.0.smithi155.stdout:3/71: creat d0/f15 x:0 0 0 2023-12-16T05:56:25.173 INFO:tasks.workunit.client.0.smithi155.stdout:0/105: stat d7/c14 0 2023-12-16T05:56:25.175 INFO:tasks.workunit.client.0.smithi155.stdout:7/86: dread d0/f15 [0,4194304] 0 2023-12-16T05:56:25.177 INFO:tasks.workunit.client.0.smithi155.stdout:3/72: mknod d0/d14/c16 0 2023-12-16T05:56:25.179 INFO:tasks.workunit.client.0.smithi155.stdout:0/106: creat d7/f29 x:0 0 0 2023-12-16T05:56:25.181 INFO:tasks.workunit.client.0.smithi155.stdout:8/101: dread f0 [0,4194304] 0 2023-12-16T05:56:25.181 INFO:tasks.workunit.client.0.smithi155.stdout:7/87: symlink d0/d1/d5/d18/d1a/l1f 0 2023-12-16T05:56:25.182 INFO:tasks.workunit.client.0.smithi155.stdout:0/107: dread d7/df/f1a [0,4194304] 0 2023-12-16T05:56:25.184 INFO:tasks.workunit.client.0.smithi155.stdout:8/102: read f2 [350101,77558] 0 2023-12-16T05:56:25.185 INFO:tasks.workunit.client.0.smithi155.stdout:7/88: symlink d0/d1/d5/d18/l20 0 2023-12-16T05:56:25.186 INFO:tasks.workunit.client.0.smithi155.stdout:7/89: dread - d0/d1/d5/d18/f1c zero size 2023-12-16T05:56:25.189 INFO:tasks.workunit.client.0.smithi155.stdout:7/90: getdents d0 0 2023-12-16T05:56:25.189 INFO:tasks.workunit.client.0.smithi155.stdout:2/68: dwrite d0/d5/d6/df/f1b [0,4194304] 0 2023-12-16T05:56:25.189 INFO:tasks.workunit.client.0.smithi155.stdout:2/69: fdatasync d0/d7/f9 0 2023-12-16T05:56:25.189 INFO:tasks.workunit.client.0.smithi155.stdout:2/70: chown d0/l3 52708398 1 2023-12-16T05:56:25.192 INFO:tasks.workunit.client.0.smithi155.stdout:0/108: dread f2 [4194304,4194304] 0 2023-12-16T05:56:25.193 INFO:tasks.workunit.client.0.smithi155.stdout:7/91: dread d0/d1/d5/fd [0,4194304] 0 2023-12-16T05:56:25.193 INFO:tasks.workunit.client.0.smithi155.stdout:7/92: write d0/d1/fb [4977961,44109] 0 2023-12-16T05:56:25.198 INFO:tasks.workunit.client.0.smithi155.stdout:2/71: rename d0/c13 to d0/d7/c1e 0 2023-12-16T05:56:25.199 INFO:tasks.workunit.client.0.smithi155.stdout:5/130: truncate d0/f1c 4046685 0 2023-12-16T05:56:25.201 INFO:tasks.workunit.client.0.smithi155.stdout:2/72: mkdir d0/d7/d1f 0 2023-12-16T05:56:25.201 INFO:tasks.workunit.client.0.smithi155.stdout:2/73: chown d0/d5/d6 13758 1 2023-12-16T05:56:25.201 INFO:tasks.workunit.client.0.smithi155.stdout:2/74: chown d0/d7/c1e 0 1 2023-12-16T05:56:25.201 INFO:tasks.workunit.client.0.smithi155.stdout:2/75: fsync d0/d5/d6/df/f1b 0 2023-12-16T05:56:25.202 INFO:tasks.workunit.client.0.smithi155.stdout:5/131: symlink d0/d2/d7/l25 0 2023-12-16T05:56:25.202 INFO:tasks.workunit.client.0.smithi155.stdout:5/132: fdatasync d0/f15 0 2023-12-16T05:56:25.204 INFO:tasks.workunit.client.0.smithi155.stdout:2/76: symlink d0/d7/dd/d14/l20 0 2023-12-16T05:56:25.206 INFO:tasks.workunit.client.0.smithi155.stdout:5/133: unlink d0/d2/f9 0 2023-12-16T05:56:25.208 INFO:tasks.workunit.client.0.smithi155.stdout:2/77: write d0/d5/d6/df/f1b [168583,38211] 0 2023-12-16T05:56:25.209 INFO:tasks.workunit.client.0.smithi155.stdout:2/78: symlink d0/d7/dd/l21 0 2023-12-16T05:56:25.209 INFO:tasks.workunit.client.0.smithi155.stdout:2/79: truncate d0/f2 4600893 0 2023-12-16T05:56:25.210 INFO:tasks.workunit.client.0.smithi155.stdout:2/80: creat d0/f22 x:0 0 0 2023-12-16T05:56:25.210 INFO:tasks.workunit.client.0.smithi155.stdout:2/81: readlink d0/d7/dd/d14/l20 0 2023-12-16T05:56:25.210 INFO:tasks.workunit.client.0.smithi155.stdout:2/82: chown d0/d7/dd/d14 2409 1 2023-12-16T05:56:25.210 INFO:tasks.workunit.client.0.smithi155.stdout:2/83: dread - d0/d7/f1d zero size 2023-12-16T05:56:25.213 INFO:tasks.workunit.client.0.smithi155.stdout:3/73: dwrite d0/fe [0,4194304] 0 2023-12-16T05:56:25.215 INFO:tasks.workunit.client.0.smithi155.stdout:3/74: creat d0/f17 x:0 0 0 2023-12-16T05:56:25.218 INFO:tasks.workunit.client.0.smithi155.stdout:8/103: dwrite d4/f10 [4194304,4194304] 0 2023-12-16T05:56:25.220 INFO:tasks.workunit.client.0.smithi155.stdout:0/109: dwrite d7/df/f19 [0,4194304] 0 2023-12-16T05:56:25.223 INFO:tasks.workunit.client.0.smithi155.stdout:7/93: dwrite d0/d1/d5/f1d [0,4194304] 0 2023-12-16T05:56:25.223 INFO:tasks.workunit.client.0.smithi155.stdout:7/94: stat d0/c4 0 2023-12-16T05:56:25.223 INFO:tasks.workunit.client.0.smithi155.stdout:7/95: write d0/f15 [4861199,124403] 0 2023-12-16T05:56:25.223 INFO:tasks.workunit.client.0.smithi155.stdout:7/96: chown d0/d1/d5/f8 3942 1 2023-12-16T05:56:25.224 INFO:tasks.workunit.client.0.smithi155.stdout:7/97: chown d0/d1/d5/f1d 37 1 2023-12-16T05:56:25.227 INFO:tasks.workunit.client.0.smithi155.stdout:7/98: dread d0/d1/d5/f8 [0,4194304] 0 2023-12-16T05:56:25.232 INFO:tasks.workunit.client.0.smithi155.stdout:3/75: dwrite d0/f15 [0,4194304] 0 2023-12-16T05:56:25.234 INFO:tasks.workunit.client.0.smithi155.stdout:5/134: dwrite d0/d2/d7/d19/f20 [0,4194304] 0 2023-12-16T05:56:25.246 INFO:tasks.workunit.client.0.smithi155.stdout:5/135: dread d0/f15 [0,4194304] 0 2023-12-16T05:56:25.259 INFO:tasks.workunit.client.0.smithi155.stdout:5/136: dwrite d0/d2/f1a [0,4194304] 0 2023-12-16T05:56:25.381 INFO:tasks.workunit.client.0.smithi155.stdout:0/110: creat d7/f2a x:0 0 0 2023-12-16T05:56:25.384 INFO:tasks.workunit.client.0.smithi155.stdout:7/99: creat d0/d1/f21 x:0 0 0 2023-12-16T05:56:25.384 INFO:tasks.workunit.client.0.smithi155.stdout:7/100: read d0/d1/d5/f9 [208597,68425] 0 2023-12-16T05:56:25.385 INFO:tasks.workunit.client.0.smithi155.stdout:3/76: creat d0/d14/f18 x:0 0 0 2023-12-16T05:56:25.390 INFO:tasks.workunit.client.0.smithi155.stdout:5/137: unlink d0/l1b 0 2023-12-16T05:56:25.390 INFO:tasks.workunit.client.0.smithi155.stdout:5/138: write d0/d2/d7/f12 [581176,27547] 0 2023-12-16T05:56:25.390 INFO:tasks.workunit.client.0.smithi155.stdout:0/111: creat d7/d1c/f2b x:0 0 0 2023-12-16T05:56:25.391 INFO:tasks.workunit.client.0.smithi155.stdout:7/101: mkdir d0/d1/d5/d18/d1a/d22 0 2023-12-16T05:56:25.392 INFO:tasks.workunit.client.0.smithi155.stdout:5/139: mknod d0/d2/d7/c26 0 2023-12-16T05:56:25.392 INFO:tasks.workunit.client.0.smithi155.stdout:0/112: readlink d7/ld 0 2023-12-16T05:56:25.394 INFO:tasks.workunit.client.0.smithi155.stdout:7/102: creat d0/d1/d5/d18/d1a/d22/f23 x:0 0 0 2023-12-16T05:56:25.394 INFO:tasks.workunit.client.0.smithi155.stdout:7/103: readlink d0/d1/l17 0 2023-12-16T05:56:25.412 INFO:tasks.workunit.client.0.smithi155.stdout:0/113: dwrite d7/d13/f17 [0,4194304] 0 2023-12-16T05:56:25.412 INFO:tasks.workunit.client.0.smithi155.stdout:0/114: write d7/d13/f1b [597414,44399] 0 2023-12-16T05:56:25.412 INFO:tasks.workunit.client.0.smithi155.stdout:0/115: chown d7/df/f19 1 1 2023-12-16T05:56:25.412 INFO:tasks.workunit.client.0.smithi155.stdout:5/140: dwrite d0/f15 [4194304,4194304] 0 2023-12-16T05:56:25.413 INFO:tasks.workunit.client.0.smithi155.stdout:5/141: write d0/d2/d7/f16 [4096943,16735] 0 2023-12-16T05:56:25.415 INFO:tasks.workunit.client.0.smithi155.stdout:0/116: dread d7/d13/f1b [0,4194304] 0 2023-12-16T05:56:25.415 INFO:tasks.workunit.client.0.smithi155.stdout:0/117: truncate d7/d1c/f2b 847455 0 2023-12-16T05:56:25.418 INFO:tasks.workunit.client.0.smithi155.stdout:7/104: creat d0/d1/f24 x:0 0 0 2023-12-16T05:56:25.423 INFO:tasks.workunit.client.0.smithi155.stdout:3/77: rmdir d0/d14 39 2023-12-16T05:56:25.423 INFO:tasks.workunit.client.0.smithi155.stdout:0/118: dread f2 [0,4194304] 0 2023-12-16T05:56:25.423 INFO:tasks.workunit.client.0.smithi155.stdout:0/119: fdatasync d7/df/f1a 0 2023-12-16T05:56:25.424 INFO:tasks.workunit.client.0.smithi155.stdout:3/78: mknod d0/c19 0 2023-12-16T05:56:25.425 INFO:tasks.workunit.client.0.smithi155.stdout:3/79: mkdir d0/d1a 0 2023-12-16T05:56:25.426 INFO:tasks.workunit.client.0.smithi155.stdout:7/105: dread d0/d1/d5/f8 [0,4194304] 0 2023-12-16T05:56:25.426 INFO:tasks.workunit.client.0.smithi155.stdout:5/142: dwrite d0/d2/d7/d19/d21/f23 [0,4194304] 0 2023-12-16T05:56:25.427 INFO:tasks.workunit.client.0.smithi155.stdout:0/120: write d7/df/f19 [1450600,58271] 0 2023-12-16T05:56:25.427 INFO:tasks.workunit.client.0.smithi155.stdout:0/121: chown d7/d13/f1b 0 1 2023-12-16T05:56:25.427 INFO:tasks.workunit.client.0.smithi155.stdout:3/80: rename d0/f13 to d0/d14/f1b 0 2023-12-16T05:56:25.430 INFO:tasks.workunit.client.0.smithi155.stdout:5/143: unlink d0/l10 0 2023-12-16T05:56:25.433 INFO:tasks.workunit.client.0.smithi155.stdout:0/122: symlink d7/d1c/d23/l2c 0 2023-12-16T05:56:25.433 INFO:tasks.workunit.client.0.smithi155.stdout:0/123: fsync d7/fb 0 2023-12-16T05:56:25.434 INFO:tasks.workunit.client.0.smithi155.stdout:7/106: getdents d0/d1/d5/d18/d1a 0 2023-12-16T05:56:25.434 INFO:tasks.workunit.client.0.smithi155.stdout:7/107: readlink d0/d1/l17 0 2023-12-16T05:56:25.434 INFO:tasks.workunit.client.0.smithi155.stdout:7/108: fsync d0/f15 0 2023-12-16T05:56:25.435 INFO:tasks.workunit.client.0.smithi155.stdout:5/144: mknod d0/d2/d7/d19/d21/c27 0 2023-12-16T05:56:25.437 INFO:tasks.workunit.client.0.smithi155.stdout:7/109: creat d0/d1/d5/d18/d1a/d22/f25 x:0 0 0 2023-12-16T05:56:25.437 INFO:tasks.workunit.client.0.smithi155.stdout:7/110: chown d0/d1/fe 267611148 1 2023-12-16T05:56:25.438 INFO:tasks.workunit.client.0.smithi155.stdout:5/145: symlink d0/d2/d7/d19/l28 0 2023-12-16T05:56:25.438 INFO:tasks.workunit.client.0.smithi155.stdout:5/146: readlink d0/l24 0 2023-12-16T05:56:25.439 INFO:tasks.workunit.client.0.smithi155.stdout:0/124: mkdir d7/d2d 0 2023-12-16T05:56:25.439 INFO:tasks.workunit.client.0.smithi155.stdout:0/125: dread - d7/f2a zero size 2023-12-16T05:56:25.440 INFO:tasks.workunit.client.0.smithi155.stdout:7/111: symlink d0/d1/d5/d18/d1a/d22/l26 0 2023-12-16T05:56:25.440 INFO:tasks.workunit.client.0.smithi155.stdout:7/112: write d0/f12 [4227605,120300] 0 2023-12-16T05:56:25.440 INFO:tasks.workunit.client.0.smithi155.stdout:7/113: dread - d0/d1b/f1e zero size 2023-12-16T05:56:25.442 INFO:tasks.workunit.client.0.smithi155.stdout:7/114: mkdir d0/d1/d5/d18/d1a/d22/d27 0 2023-12-16T05:56:25.442 INFO:tasks.workunit.client.0.smithi155.stdout:7/115: dread - d0/d1/d5/d18/d1a/d22/f25 zero size 2023-12-16T05:56:25.442 INFO:tasks.workunit.client.0.smithi155.stdout:7/116: dread - d0/d1/f21 zero size 2023-12-16T05:56:25.442 INFO:tasks.workunit.client.0.smithi155.stdout:7/117: read d0/d1/fb [2873096,80214] 0 2023-12-16T05:56:25.443 INFO:tasks.workunit.client.0.smithi155.stdout:7/118: creat d0/d1/d5/d18/f28 x:0 0 0 2023-12-16T05:56:25.444 INFO:tasks.workunit.client.0.smithi155.stdout:7/119: truncate d0/d1/fb 5822222 0 2023-12-16T05:56:25.444 INFO:tasks.workunit.client.0.smithi155.stdout:7/120: stat d0/d1/d5/f8 0 2023-12-16T05:56:25.448 INFO:tasks.workunit.client.0.smithi155.stdout:5/147: dread d0/d2/ff [0,4194304] 0 2023-12-16T05:56:25.448 INFO:tasks.workunit.client.0.smithi155.stdout:5/148: truncate d0/d2/d7/f1e 70708 0 2023-12-16T05:56:25.457 INFO:tasks.workunit.client.0.smithi155.stdout:5/149: dread d0/d2/f5 [4194304,4194304] 0 2023-12-16T05:56:25.720 INFO:tasks.workunit.client.0.smithi155.stdout:7/121: rmdir d0/d1/d5/d18/d1a/d22 39 2023-12-16T05:56:25.723 INFO:tasks.workunit.client.0.smithi155.stdout:7/122: dread d0/d1/d5/f9 [0,4194304] 0 2023-12-16T05:56:25.746 INFO:tasks.workunit.client.0.smithi155.stdout:7/123: truncate d0/d1/d5/f8 2654339 0 2023-12-16T05:56:25.747 INFO:tasks.workunit.client.0.smithi155.stdout:7/124: link d0/d1/d5/d18/d1a/l1f d0/d1/l29 0 2023-12-16T05:56:25.748 INFO:tasks.workunit.client.0.smithi155.stdout:7/125: rmdir d0/d1/d5/d18/d1a 39 2023-12-16T05:56:25.748 INFO:tasks.workunit.client.0.smithi155.stdout:7/126: readlink d0/d1/l17 0 2023-12-16T05:56:26.060 INFO:tasks.workunit.client.0.smithi155.stdout:7/127: mknod d0/d1/d5/d18/d1a/c2a 0 2023-12-16T05:56:26.173 INFO:tasks.workunit.client.0.smithi155.stdout:4/72: sync 2023-12-16T05:56:26.175 INFO:tasks.workunit.client.0.smithi155.stdout:4/73: unlink d0/l9 0 2023-12-16T05:56:26.175 INFO:tasks.workunit.client.0.smithi155.stdout:4/74: rename d0 to d0/d14 22 2023-12-16T05:56:26.175 INFO:tasks.workunit.client.0.smithi155.stdout:4/75: chown d0 63351853 1 2023-12-16T05:56:26.199 INFO:tasks.workunit.client.0.smithi155.stdout:4/76: dwrite d0/fb [0,4194304] 0 2023-12-16T05:56:26.199 INFO:tasks.workunit.client.0.smithi155.stdout:4/77: dread - d0/da/ff zero size 2023-12-16T05:56:26.204 INFO:tasks.workunit.client.0.smithi155.stdout:4/78: dread d0/f5 [0,4194304] 0 2023-12-16T05:56:26.204 INFO:tasks.workunit.client.0.smithi155.stdout:4/79: fsync d0/fb 0 2023-12-16T05:56:26.204 INFO:tasks.workunit.client.0.smithi155.stdout:4/80: fdatasync d0/f5 0 2023-12-16T05:56:26.205 INFO:tasks.workunit.client.0.smithi155.stdout:4/81: mknod d0/da/c15 0 2023-12-16T05:56:26.206 INFO:tasks.workunit.client.0.smithi155.stdout:4/82: mkdir d0/d11/d16 0 2023-12-16T05:56:26.207 INFO:tasks.workunit.client.0.smithi155.stdout:4/83: symlink d0/da/l17 0 2023-12-16T05:56:26.209 INFO:tasks.workunit.client.0.smithi155.stdout:4/84: unlink d0/le 0 2023-12-16T05:56:26.210 INFO:tasks.workunit.client.0.smithi155.stdout:4/85: mknod d0/d11/c18 0 2023-12-16T05:56:26.210 INFO:tasks.workunit.client.0.smithi155.stdout:4/86: symlink d0/d11/l19 0 2023-12-16T05:56:26.211 INFO:tasks.workunit.client.0.smithi155.stdout:4/87: mkdir d0/d11/d16/d1a 0 2023-12-16T05:56:26.211 INFO:tasks.workunit.client.0.smithi155.stdout:4/88: stat d0/da 0 2023-12-16T05:56:26.211 INFO:tasks.workunit.client.0.smithi155.stdout:4/89: rename d0/da to d0/da/d1b 22 2023-12-16T05:56:26.212 INFO:tasks.workunit.client.0.smithi155.stdout:4/90: creat d0/d11/f1c x:0 0 0 2023-12-16T05:56:26.213 INFO:tasks.workunit.client.0.smithi155.stdout:4/91: creat d0/f1d x:0 0 0 2023-12-16T05:56:26.213 INFO:tasks.workunit.client.0.smithi155.stdout:4/92: chown d0/d11/d16 7 1 2023-12-16T05:56:26.213 INFO:tasks.workunit.client.0.smithi155.stdout:4/93: write d0/f4 [5718954,20804] 0 2023-12-16T05:56:26.214 INFO:tasks.workunit.client.0.smithi155.stdout:4/94: link d0/da/c13 d0/d11/d16/c1e 0 2023-12-16T05:56:26.228 INFO:tasks.workunit.client.0.smithi155.stdout:4/95: dwrite d0/f4 [4194304,4194304] 0 2023-12-16T05:56:26.239 INFO:tasks.workunit.client.0.smithi155.stdout:1/69: sync 2023-12-16T05:56:26.239 INFO:tasks.workunit.client.0.smithi155.stdout:6/129: sync 2023-12-16T05:56:26.239 INFO:tasks.workunit.client.0.smithi155.stdout:2/84: sync 2023-12-16T05:56:26.239 INFO:tasks.workunit.client.0.smithi155.stdout:9/64: sync 2023-12-16T05:56:26.239 INFO:tasks.workunit.client.0.smithi155.stdout:0/126: sync 2023-12-16T05:56:26.239 INFO:tasks.workunit.client.0.smithi155.stdout:6/130: chown d0/d14/f1d 1159 1 2023-12-16T05:56:26.239 INFO:tasks.workunit.client.0.smithi155.stdout:8/104: sync 2023-12-16T05:56:26.239 INFO:tasks.workunit.client.0.smithi155.stdout:3/81: sync 2023-12-16T05:56:26.239 INFO:tasks.workunit.client.0.smithi155.stdout:3/82: dread - d0/d14/f18 zero size 2023-12-16T05:56:26.240 INFO:tasks.workunit.client.0.smithi155.stdout:3/83: dread - d0/d14/f18 zero size 2023-12-16T05:56:26.240 INFO:tasks.workunit.client.0.smithi155.stdout:5/150: sync 2023-12-16T05:56:26.240 INFO:tasks.workunit.client.0.smithi155.stdout:5/151: fsync d0/f1c 0 2023-12-16T05:56:26.240 INFO:tasks.workunit.client.0.smithi155.stdout:1/70: getdents d1/d17 0 2023-12-16T05:56:26.240 INFO:tasks.workunit.client.0.smithi155.stdout:1/71: fdatasync d1/f6 0 2023-12-16T05:56:26.240 INFO:tasks.workunit.client.0.smithi155.stdout:1/72: chown d1/d7/d16 2358379 1 2023-12-16T05:56:26.241 INFO:tasks.workunit.client.0.smithi155.stdout:8/105: write f2 [1074672,43203] 0 2023-12-16T05:56:26.241 INFO:tasks.workunit.client.0.smithi155.stdout:9/65: creat da/f14 x:0 0 0 2023-12-16T05:56:26.243 INFO:tasks.workunit.client.0.smithi155.stdout:6/131: symlink d0/d14/d1b/l2d 0 2023-12-16T05:56:26.243 INFO:tasks.workunit.client.0.smithi155.stdout:0/127: write d7/df/f1a [389638,123177] 0 2023-12-16T05:56:26.243 INFO:tasks.workunit.client.0.smithi155.stdout:0/128: chown d7/l28 64883147 1 2023-12-16T05:56:26.247 INFO:tasks.workunit.client.0.smithi155.stdout:6/132: mknod d0/d14/c2e 0 2023-12-16T05:56:26.248 INFO:tasks.workunit.client.0.smithi155.stdout:1/73: truncate d1/d7/f18 3081502 0 2023-12-16T05:56:26.248 INFO:tasks.workunit.client.0.smithi155.stdout:8/106: mkdir d4/da/d1b 0 2023-12-16T05:56:26.250 INFO:tasks.workunit.client.0.smithi155.stdout:6/133: rename d0/d3/f9 to d0/d3/d2c/f2f 0 2023-12-16T05:56:26.255 INFO:tasks.workunit.client.0.smithi155.stdout:5/152: dread d0/f15 [0,4194304] 0 2023-12-16T05:56:26.256 INFO:tasks.workunit.client.0.smithi155.stdout:1/74: creat d1/f1e x:0 0 0 2023-12-16T05:56:26.258 INFO:tasks.workunit.client.0.smithi155.stdout:8/107: unlink f3 0 2023-12-16T05:56:26.259 INFO:tasks.workunit.client.0.smithi155.stdout:6/134: chown d0/l2 65662 1 2023-12-16T05:56:26.259 INFO:tasks.workunit.client.0.smithi155.stdout:6/135: chown d0/d14/l29 988634 1 2023-12-16T05:56:26.259 INFO:tasks.workunit.client.0.smithi155.stdout:6/136: truncate d0/d3/f6 4223866 0 2023-12-16T05:56:26.260 INFO:tasks.workunit.client.0.smithi155.stdout:5/153: symlink d0/l29 0 2023-12-16T05:56:26.262 INFO:tasks.workunit.client.0.smithi155.stdout:1/75: rmdir d1/d7/d16 39 2023-12-16T05:56:26.264 INFO:tasks.workunit.client.0.smithi155.stdout:8/108: truncate d4/f10 6841838 0 2023-12-16T05:56:26.264 INFO:tasks.workunit.client.0.smithi155.stdout:8/109: readlink - no filename 2023-12-16T05:56:26.266 INFO:tasks.workunit.client.0.smithi155.stdout:8/110: getdents d4/d14 0 2023-12-16T05:56:26.266 INFO:tasks.workunit.client.0.smithi155.stdout:9/66: rmdir da 39 2023-12-16T05:56:26.271 INFO:tasks.workunit.client.0.smithi155.stdout:5/154: dread d0/d2/d7/fe [0,4194304] 0 2023-12-16T05:56:26.271 INFO:tasks.workunit.client.0.smithi155.stdout:9/67: rmdir da 39 2023-12-16T05:56:26.271 INFO:tasks.workunit.client.0.smithi155.stdout:6/137: link d0/d3/d2c/f2f d0/d3/d2c/f30 0 2023-12-16T05:56:26.273 INFO:tasks.workunit.client.0.smithi155.stdout:5/155: rename d0/d2/d7 to d0/d2/d2a 0 2023-12-16T05:56:26.273 INFO:tasks.workunit.client.0.smithi155.stdout:5/156: truncate d0/d2/d2a/d19/d21/f23 4862410 0 2023-12-16T05:56:26.274 INFO:tasks.workunit.client.0.smithi155.stdout:9/68: mkdir da/d15 0 2023-12-16T05:56:26.274 INFO:tasks.workunit.client.0.smithi155.stdout:9/69: write da/f13 [927204,57837] 0 2023-12-16T05:56:26.276 INFO:tasks.workunit.client.0.smithi155.stdout:6/138: symlink d0/df/l31 0 2023-12-16T05:56:26.276 INFO:tasks.workunit.client.0.smithi155.stdout:0/129: dwrite d7/df/f19 [0,4194304] 0 2023-12-16T05:56:26.276 INFO:tasks.workunit.client.0.smithi155.stdout:3/84: dwrite d0/d14/f18 [0,4194304] 0 2023-12-16T05:56:26.276 INFO:tasks.workunit.client.0.smithi155.stdout:4/96: dwrite d0/fb [0,4194304] 0 2023-12-16T05:56:26.276 INFO:tasks.workunit.client.0.smithi155.stdout:2/85: dwrite d0/d5/d6/f10 [0,4194304] 0 2023-12-16T05:56:26.277 INFO:tasks.workunit.client.0.smithi155.stdout:6/139: read d0/d14/f1d [1819626,22757] 0 2023-12-16T05:56:26.277 INFO:tasks.workunit.client.0.smithi155.stdout:9/70: chown l5 18211 1 2023-12-16T05:56:26.284 INFO:tasks.workunit.client.0.smithi155.stdout:0/130: rename d7/c15 to d7/d2d/c2e 0 2023-12-16T05:56:26.286 INFO:tasks.workunit.client.0.smithi155.stdout:4/97: creat d0/d11/d16/d1a/f1f x:0 0 0 2023-12-16T05:56:26.288 INFO:tasks.workunit.client.0.smithi155.stdout:1/76: write d1/d7/f18 [744005,79563] 0 2023-12-16T05:56:26.289 INFO:tasks.workunit.client.0.smithi155.stdout:2/86: creat d0/d5/f23 x:0 0 0 2023-12-16T05:56:26.290 INFO:tasks.workunit.client.0.smithi155.stdout:6/140: rmdir d0/d14/d1b 39 2023-12-16T05:56:26.291 INFO:tasks.workunit.client.0.smithi155.stdout:6/141: truncate d0/df/f27 348122 0 2023-12-16T05:56:26.295 INFO:tasks.workunit.client.0.smithi155.stdout:4/98: creat d0/f20 x:0 0 0 2023-12-16T05:56:26.295 INFO:tasks.workunit.client.0.smithi155.stdout:4/99: write d0/d11/f1c [79532,83047] 0 2023-12-16T05:56:26.297 INFO:tasks.workunit.client.0.smithi155.stdout:1/77: link d1/d7/f12 d1/d7/f1f 0 2023-12-16T05:56:26.298 INFO:tasks.workunit.client.0.smithi155.stdout:4/100: getdents d0/d11 0 2023-12-16T05:56:26.300 INFO:tasks.workunit.client.0.smithi155.stdout:1/78: creat d1/d7/f20 x:0 0 0 2023-12-16T05:56:26.301 INFO:tasks.workunit.client.0.smithi155.stdout:4/101: rename d0/lc to d0/d11/d16/l21 0 2023-12-16T05:56:26.302 INFO:tasks.workunit.client.0.smithi155.stdout:4/102: chown d0/c2 389 1 2023-12-16T05:56:26.303 INFO:tasks.workunit.client.0.smithi155.stdout:1/79: creat d1/d7/d16/f21 x:0 0 0 2023-12-16T05:56:26.303 INFO:tasks.workunit.client.0.smithi155.stdout:1/80: fsync d1/f1e 0 2023-12-16T05:56:26.303 INFO:tasks.workunit.client.0.smithi155.stdout:1/81: chown d1/d7/d16/f1b 371789 1 2023-12-16T05:56:26.304 INFO:tasks.workunit.client.0.smithi155.stdout:8/111: truncate d4/f10 5624189 0 2023-12-16T05:56:26.304 INFO:tasks.workunit.client.0.smithi155.stdout:8/112: truncate d4/dc/f13 390734 0 2023-12-16T05:56:26.304 INFO:tasks.workunit.client.0.smithi155.stdout:8/113: getdents d4/da/d1b 0 2023-12-16T05:56:26.307 INFO:tasks.workunit.client.0.smithi155.stdout:6/142: dread d0/d3/d2c/f30 [0,4194304] 0 2023-12-16T05:56:26.307 INFO:tasks.workunit.client.0.smithi155.stdout:5/157: dwrite d0/d2/d2a/fd [0,4194304] 0 2023-12-16T05:56:26.308 INFO:tasks.workunit.client.0.smithi155.stdout:8/114: rename d4/dc to d4/da/d1b/d1c 0 2023-12-16T05:56:26.310 INFO:tasks.workunit.client.0.smithi155.stdout:0/131: dwrite d7/df/f19 [0,4194304] 0 2023-12-16T05:56:26.310 INFO:tasks.workunit.client.0.smithi155.stdout:0/132: fdatasync d7/df/f1a 0 2023-12-16T05:56:26.310 INFO:tasks.workunit.client.0.smithi155.stdout:0/133: write d7/f2a [617816,23285] 0 2023-12-16T05:56:26.312 INFO:tasks.workunit.client.0.smithi155.stdout:4/103: dread d0/f5 [0,4194304] 0 2023-12-16T05:56:26.312 INFO:tasks.workunit.client.0.smithi155.stdout:2/87: dwrite d0/d7/f9 [4194304,4194304] 0 2023-12-16T05:56:26.312 INFO:tasks.workunit.client.0.smithi155.stdout:4/104: read - d0/da/ff zero size 2023-12-16T05:56:26.312 INFO:tasks.workunit.client.0.smithi155.stdout:4/105: write d0/f20 [840262,130252] 0 2023-12-16T05:56:26.313 INFO:tasks.workunit.client.0.smithi155.stdout:8/115: link d4/da/c17 d4/da/c1d 0 2023-12-16T05:56:26.313 INFO:tasks.workunit.client.0.smithi155.stdout:8/116: readlink - no filename 2023-12-16T05:56:26.314 INFO:tasks.workunit.client.0.smithi155.stdout:9/71: dwrite da/f13 [0,4194304] 0 2023-12-16T05:56:26.316 INFO:tasks.workunit.client.0.smithi155.stdout:0/134: creat d7/d2d/f2f x:0 0 0 2023-12-16T05:56:26.316 INFO:tasks.workunit.client.0.smithi155.stdout:0/135: readlink d7/l28 0 2023-12-16T05:56:26.319 INFO:tasks.workunit.client.0.smithi155.stdout:2/88: creat d0/d7/f24 x:0 0 0 2023-12-16T05:56:26.319 INFO:tasks.workunit.client.0.smithi155.stdout:2/89: dread - d0/f12 zero size 2023-12-16T05:56:26.319 INFO:tasks.workunit.client.0.smithi155.stdout:2/90: read - d0/d7/f24 zero size 2023-12-16T05:56:26.319 INFO:tasks.workunit.client.0.smithi155.stdout:2/91: write d0/d5/d6/f1c [747411,125797] 0 2023-12-16T05:56:26.320 INFO:tasks.workunit.client.0.smithi155.stdout:0/136: write f2 [1080824,2410] 0 2023-12-16T05:56:26.321 INFO:tasks.workunit.client.0.smithi155.stdout:4/106: mkdir d0/d10/d22 0 2023-12-16T05:56:26.322 INFO:tasks.workunit.client.0.smithi155.stdout:5/158: dread d0/d2/d2a/fe [0,4194304] 0 2023-12-16T05:56:26.323 INFO:tasks.workunit.client.0.smithi155.stdout:8/117: mknod d4/da/d1b/d1c/d1a/c1e 0 2023-12-16T05:56:26.323 INFO:tasks.workunit.client.0.smithi155.stdout:8/118: fdatasync d4/da/d1b/d1c/f13 0 2023-12-16T05:56:26.323 INFO:tasks.workunit.client.0.smithi155.stdout:5/159: read d0/d2/d2a/f1e [1364,22617] 0 2023-12-16T05:56:26.326 INFO:tasks.workunit.client.0.smithi155.stdout:1/82: dwrite d1/d7/d16/f1d [0,4194304] 0 2023-12-16T05:56:26.327 INFO:tasks.workunit.client.0.smithi155.stdout:9/72: creat da/d15/f16 x:0 0 0 2023-12-16T05:56:26.327 INFO:tasks.workunit.client.0.smithi155.stdout:9/73: truncate f3 2131360 0 2023-12-16T05:56:26.333 INFO:tasks.workunit.client.0.smithi155.stdout:8/119: getdents d4 0 2023-12-16T05:56:26.333 INFO:tasks.workunit.client.0.smithi155.stdout:2/92: rmdir d0 39 2023-12-16T05:56:26.333 INFO:tasks.workunit.client.0.smithi155.stdout:2/93: dread - d0/f12 zero size 2023-12-16T05:56:26.333 INFO:tasks.workunit.client.0.smithi155.stdout:2/94: chown d0/f1a 150647988 1 2023-12-16T05:56:26.338 INFO:tasks.workunit.client.0.smithi155.stdout:5/160: unlink d0/d2/d2a/f1e 0 2023-12-16T05:56:26.338 INFO:tasks.workunit.client.0.smithi155.stdout:0/137: dread d7/f2a [0,4194304] 0 2023-12-16T05:56:26.341 INFO:tasks.workunit.client.0.smithi155.stdout:9/74: mkdir da/d15/d17 0 2023-12-16T05:56:26.346 INFO:tasks.workunit.client.0.smithi155.stdout:6/143: dwrite d0/df/f18 [0,4194304] 0 2023-12-16T05:56:26.346 INFO:tasks.workunit.client.0.smithi155.stdout:9/75: mknod da/c18 0 2023-12-16T05:56:26.346 INFO:tasks.workunit.client.0.smithi155.stdout:9/76: fdatasync da/ff 0 2023-12-16T05:56:26.347 INFO:tasks.workunit.client.0.smithi155.stdout:6/144: write d0/d3/d2c/f30 [3576767,5249] 0 2023-12-16T05:56:26.347 INFO:tasks.workunit.client.0.smithi155.stdout:6/145: write d0/d14/d1b/f21 [584769,57189] 0 2023-12-16T05:56:26.350 INFO:tasks.workunit.client.0.smithi155.stdout:0/138: rename d7/df/d1d to d7/d30 0 2023-12-16T05:56:26.350 INFO:tasks.workunit.client.0.smithi155.stdout:0/139: chown d7/l18 192667 1 2023-12-16T05:56:26.350 INFO:tasks.workunit.client.0.smithi155.stdout:0/140: fsync f2 0 2023-12-16T05:56:26.351 INFO:tasks.workunit.client.0.smithi155.stdout:0/141: truncate d7/d13/f17 4355308 0 2023-12-16T05:56:26.352 INFO:tasks.workunit.client.0.smithi155.stdout:0/142: creat d7/df/f31 x:0 0 0 2023-12-16T05:56:26.352 INFO:tasks.workunit.client.0.smithi155.stdout:0/143: fsync d7/d13/f1b 0 2023-12-16T05:56:26.352 INFO:tasks.workunit.client.0.smithi155.stdout:0/144: write d7/d1c/f2b [1174564,5950] 0 2023-12-16T05:56:26.353 INFO:tasks.workunit.client.0.smithi155.stdout:9/77: unlink l8 0 2023-12-16T05:56:26.354 INFO:tasks.workunit.client.0.smithi155.stdout:0/145: mknod d7/d1c/d23/c32 0 2023-12-16T05:56:26.354 INFO:tasks.workunit.client.0.smithi155.stdout:0/146: chown d7/c12 438 1 2023-12-16T05:56:26.354 INFO:tasks.workunit.client.0.smithi155.stdout:0/147: stat d7/df/f19 0 2023-12-16T05:56:26.354 INFO:tasks.workunit.client.0.smithi155.stdout:0/148: chown d7/d1c/d23/c32 7 1 2023-12-16T05:56:26.355 INFO:tasks.workunit.client.0.smithi155.stdout:9/78: mknod da/d15/c19 0 2023-12-16T05:56:26.357 INFO:tasks.workunit.client.0.smithi155.stdout:4/107: dwrite d0/fb [0,4194304] 0 2023-12-16T05:56:26.357 INFO:tasks.workunit.client.0.smithi155.stdout:9/79: mknod da/c1a 0 2023-12-16T05:56:26.358 INFO:tasks.workunit.client.0.smithi155.stdout:6/146: dread d0/d3/f1e [0,4194304] 0 2023-12-16T05:56:26.358 INFO:tasks.workunit.client.0.smithi155.stdout:6/147: truncate d0/d14/f1d 4457959 0 2023-12-16T05:56:26.360 INFO:tasks.workunit.client.0.smithi155.stdout:1/83: dwrite d1/d7/f20 [0,4194304] 0 2023-12-16T05:56:26.361 INFO:tasks.workunit.client.0.smithi155.stdout:2/95: dwrite d0/f12 [0,4194304] 0 2023-12-16T05:56:26.361 INFO:tasks.workunit.client.0.smithi155.stdout:4/108: creat d0/d10/d22/f23 x:0 0 0 2023-12-16T05:56:26.362 INFO:tasks.workunit.client.0.smithi155.stdout:5/161: dwrite d0/d2/f1a [0,4194304] 0 2023-12-16T05:56:26.363 INFO:tasks.workunit.client.0.smithi155.stdout:9/80: creat da/d15/d17/f1b x:0 0 0 2023-12-16T05:56:26.363 INFO:tasks.workunit.client.0.smithi155.stdout:9/81: write f3 [2157624,129921] 0 2023-12-16T05:56:26.363 INFO:tasks.workunit.client.0.smithi155.stdout:6/148: mknod d0/df/c32 0 2023-12-16T05:56:26.369 INFO:tasks.workunit.client.0.smithi155.stdout:1/84: rename d1/c9 to d1/d7/d16/c22 0 2023-12-16T05:56:26.370 INFO:tasks.workunit.client.0.smithi155.stdout:1/85: read d1/d7/f1f [284959,114256] 0 2023-12-16T05:56:26.370 INFO:tasks.workunit.client.0.smithi155.stdout:1/86: stat d1/d7/f1f 0 2023-12-16T05:56:26.373 INFO:tasks.workunit.client.0.smithi155.stdout:2/96: creat d0/d7/f25 x:0 0 0 2023-12-16T05:56:26.374 INFO:tasks.workunit.client.0.smithi155.stdout:4/109: getdents d0/d11/d16/d1a 0 2023-12-16T05:56:26.374 INFO:tasks.workunit.client.0.smithi155.stdout:4/110: dread - d0/d11/d16/d1a/f1f zero size 2023-12-16T05:56:26.377 INFO:tasks.workunit.client.0.smithi155.stdout:0/149: truncate d7/d1c/f2b 188658 0 2023-12-16T05:56:26.378 INFO:tasks.workunit.client.0.smithi155.stdout:5/162: getdents d0 0 2023-12-16T05:56:26.378 INFO:tasks.workunit.client.0.smithi155.stdout:9/82: dwrite da/f10 [0,4194304] 0 2023-12-16T05:56:26.389 INFO:tasks.workunit.client.0.smithi155.stdout:6/149: rmdir d0/d3 39 2023-12-16T05:56:26.391 INFO:tasks.workunit.client.0.smithi155.stdout:1/87: getdents d1/d7/d16 0 2023-12-16T05:56:26.391 INFO:tasks.workunit.client.0.smithi155.stdout:1/88: chown d1/d7/c15 604 1 2023-12-16T05:56:26.393 INFO:tasks.workunit.client.0.smithi155.stdout:2/97: creat d0/d7/dd/f26 x:0 0 0 2023-12-16T05:56:26.394 INFO:tasks.workunit.client.0.smithi155.stdout:4/111: mknod d0/da/c24 0 2023-12-16T05:56:26.394 INFO:tasks.workunit.client.0.smithi155.stdout:2/98: write d0/d5/d6/df/f1b [2184246,98368] 0 2023-12-16T05:56:26.394 INFO:tasks.workunit.client.0.smithi155.stdout:6/150: dread d0/d14/f1d [0,4194304] 0 2023-12-16T05:56:26.395 INFO:tasks.workunit.client.0.smithi155.stdout:0/150: creat d7/d30/f33 x:0 0 0 2023-12-16T05:56:26.397 INFO:tasks.workunit.client.0.smithi155.stdout:5/163: symlink d0/d2/d2a/l2b 0 2023-12-16T05:56:26.399 INFO:tasks.workunit.client.0.smithi155.stdout:9/83: creat da/d15/d17/f1c x:0 0 0 2023-12-16T05:56:26.401 INFO:tasks.workunit.client.0.smithi155.stdout:4/112: unlink d0/c2 0 2023-12-16T05:56:26.401 INFO:tasks.workunit.client.0.smithi155.stdout:4/113: dread - d0/f1d zero size 2023-12-16T05:56:26.401 INFO:tasks.workunit.client.0.smithi155.stdout:4/114: dread - d0/da/ff zero size 2023-12-16T05:56:26.404 INFO:tasks.workunit.client.0.smithi155.stdout:6/151: dread d0/fc [0,4194304] 0 2023-12-16T05:56:26.404 INFO:tasks.workunit.client.0.smithi155.stdout:2/99: creat d0/f27 x:0 0 0 2023-12-16T05:56:26.404 INFO:tasks.workunit.client.0.smithi155.stdout:1/89: dread d1/d7/d16/f1d [0,4194304] 0 2023-12-16T05:56:26.405 INFO:tasks.workunit.client.0.smithi155.stdout:2/100: read d0/f12 [3629844,5202] 0 2023-12-16T05:56:26.406 INFO:tasks.workunit.client.0.smithi155.stdout:9/84: rename f3 to da/d15/f1d 0 2023-12-16T05:56:26.407 INFO:tasks.workunit.client.0.smithi155.stdout:4/115: creat d0/d10/d22/f25 x:0 0 0 2023-12-16T05:56:26.407 INFO:tasks.workunit.client.0.smithi155.stdout:4/116: chown d0 1441855377 1 2023-12-16T05:56:26.407 INFO:tasks.workunit.client.0.smithi155.stdout:4/117: stat d0/d10/d22 0 2023-12-16T05:56:26.408 INFO:tasks.workunit.client.0.smithi155.stdout:6/152: creat d0/d14/f33 x:0 0 0 2023-12-16T05:56:26.408 INFO:tasks.workunit.client.0.smithi155.stdout:1/90: symlink d1/l23 0 2023-12-16T05:56:26.408 INFO:tasks.workunit.client.0.smithi155.stdout:6/153: write d0/d3/d2c/f2f [177669,116581] 0 2023-12-16T05:56:26.410 INFO:tasks.workunit.client.0.smithi155.stdout:2/101: creat d0/d5/f28 x:0 0 0 2023-12-16T05:56:26.412 INFO:tasks.workunit.client.0.smithi155.stdout:9/85: creat da/f1e x:0 0 0 2023-12-16T05:56:26.412 INFO:tasks.workunit.client.0.smithi155.stdout:9/86: fdatasync da/d15/f1d 0 2023-12-16T05:56:26.412 INFO:tasks.workunit.client.0.smithi155.stdout:9/87: truncate da/f14 903706 0 2023-12-16T05:56:26.412 INFO:tasks.workunit.client.0.smithi155.stdout:9/88: read - da/f1e zero size 2023-12-16T05:56:26.412 INFO:tasks.workunit.client.0.smithi155.stdout:9/89: chown da 271077 1 2023-12-16T05:56:26.413 INFO:tasks.workunit.client.0.smithi155.stdout:9/90: read da/f14 [578312,130469] 0 2023-12-16T05:56:26.413 INFO:tasks.workunit.client.0.smithi155.stdout:4/118: dread d0/f20 [0,4194304] 0 2023-12-16T05:56:26.414 INFO:tasks.workunit.client.0.smithi155.stdout:5/164: dwrite d0/d2/d2a/d19/d21/f23 [4194304,4194304] 0 2023-12-16T05:56:26.414 INFO:tasks.workunit.client.0.smithi155.stdout:5/165: dread - d0/d2/f22 zero size 2023-12-16T05:56:26.414 INFO:tasks.workunit.client.0.smithi155.stdout:5/166: fdatasync d0/d2/d2a/f18 0 2023-12-16T05:56:26.414 INFO:tasks.workunit.client.0.smithi155.stdout:5/167: readlink d0/d2/d2a/lc 0 2023-12-16T05:56:26.415 INFO:tasks.workunit.client.0.smithi155.stdout:0/151: dwrite d7/d30/f33 [0,4194304] 0 2023-12-16T05:56:26.415 INFO:tasks.workunit.client.0.smithi155.stdout:0/152: chown d7/d1c/f2b 1612 1 2023-12-16T05:56:26.415 INFO:tasks.workunit.client.0.smithi155.stdout:1/91: truncate d1/d7/d16/f1b 39530 0 2023-12-16T05:56:26.417 INFO:tasks.workunit.client.0.smithi155.stdout:9/91: symlink da/d15/l1f 0 2023-12-16T05:56:26.418 INFO:tasks.workunit.client.0.smithi155.stdout:5/168: unlink d0/cb 0 2023-12-16T05:56:26.421 INFO:tasks.workunit.client.0.smithi155.stdout:0/153: rename c3 to d7/df/c34 0 2023-12-16T05:56:26.421 INFO:tasks.workunit.client.0.smithi155.stdout:0/154: write d7/f29 [338311,125537] 0 2023-12-16T05:56:26.422 INFO:tasks.workunit.client.0.smithi155.stdout:1/92: symlink d1/d7/d16/l24 0 2023-12-16T05:56:26.422 INFO:tasks.workunit.client.0.smithi155.stdout:1/93: fdatasync d1/f6 0 2023-12-16T05:56:26.422 INFO:tasks.workunit.client.0.smithi155.stdout:6/154: mknod d0/c34 0 2023-12-16T05:56:26.424 INFO:tasks.workunit.client.0.smithi155.stdout:9/92: symlink da/d15/l20 0 2023-12-16T05:56:26.425 INFO:tasks.workunit.client.0.smithi155.stdout:9/93: truncate da/d15/f16 71649 0 2023-12-16T05:56:26.426 INFO:tasks.workunit.client.0.smithi155.stdout:5/169: rename d0/d2/d2a/lc to d0/d2/d2a/l2c 0 2023-12-16T05:56:26.426 INFO:tasks.workunit.client.0.smithi155.stdout:5/170: readlink d0/d2/d2a/l2c 0 2023-12-16T05:56:26.426 INFO:tasks.workunit.client.0.smithi155.stdout:5/171: fsync d0/d2/d2a/f18 0 2023-12-16T05:56:26.426 INFO:tasks.workunit.client.0.smithi155.stdout:5/172: fsync d0/d2/f1d 0 2023-12-16T05:56:26.429 INFO:tasks.workunit.client.0.smithi155.stdout:0/155: rename d7/l28 to d7/d30/l35 0 2023-12-16T05:56:26.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:26 smithi156 ceph-mon[121001]: pgmap v9: 65 pgs: 65 active+clean; 387 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 20 MiB/s rd, 34 MiB/s wr, 1.03k op/s 2023-12-16T05:56:26.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:26 smithi156 ceph-mon[121001]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby-replay 2023-12-16T05:56:26.431 INFO:tasks.workunit.client.0.smithi155.stdout:0/156: write f2 [3662260,21268] 0 2023-12-16T05:56:26.431 INFO:tasks.workunit.client.0.smithi155.stdout:1/94: mkdir d1/d25 0 2023-12-16T05:56:26.431 INFO:tasks.workunit.client.0.smithi155.stdout:1/95: stat d1/l23 0 2023-12-16T05:56:26.433 INFO:tasks.workunit.client.0.smithi155.stdout:1/96: dread d1/d7/f1f [0,4194304] 0 2023-12-16T05:56:26.433 INFO:tasks.workunit.client.0.smithi155.stdout:1/97: chown d1/d7/ce 21498 1 2023-12-16T05:56:26.435 INFO:tasks.workunit.client.0.smithi155.stdout:4/119: dwrite d0/da/ff [0,4194304] 0 2023-12-16T05:56:26.437 INFO:tasks.workunit.client.0.smithi155.stdout:6/155: dread d0/d3/f12 [0,4194304] 0 2023-12-16T05:56:26.437 INFO:tasks.workunit.client.0.smithi155.stdout:6/156: write d0/d14/f15 [386165,72962] 0 2023-12-16T05:56:26.437 INFO:tasks.workunit.client.0.smithi155.stdout:2/102: dwrite d0/d7/f1d [0,4194304] 0 2023-12-16T05:56:26.437 INFO:tasks.workunit.client.0.smithi155.stdout:2/103: truncate d0/d7/dd/f26 764850 0 2023-12-16T05:56:26.438 INFO:tasks.workunit.client.0.smithi155.stdout:2/104: fdatasync d0/d5/f28 0 2023-12-16T05:56:26.441 INFO:tasks.workunit.client.0.smithi155.stdout:4/120: rename d0/d11/d16/d1a/f1f to d0/d10/f26 0 2023-12-16T05:56:26.441 INFO:tasks.workunit.client.0.smithi155.stdout:4/121: truncate d0/d10/d22/f25 609190 0 2023-12-16T05:56:26.449 INFO:tasks.workunit.client.0.smithi155.stdout:6/157: creat d0/df/f35 x:0 0 0 2023-12-16T05:56:26.449 INFO:tasks.workunit.client.0.smithi155.stdout:2/105: mknod d0/d5/c29 0 2023-12-16T05:56:26.449 INFO:tasks.workunit.client.0.smithi155.stdout:1/98: unlink d1/d7/d16/f1b 0 2023-12-16T05:56:26.450 INFO:tasks.workunit.client.0.smithi155.stdout:1/99: dread - d1/d7/d16/f21 zero size 2023-12-16T05:56:26.452 INFO:tasks.workunit.client.0.smithi155.stdout:4/122: creat d0/d11/d16/d1a/f27 x:0 0 0 2023-12-16T05:56:26.455 INFO:tasks.workunit.client.0.smithi155.stdout:1/100: write d1/d7/f20 [2260507,124437] 0 2023-12-16T05:56:26.455 INFO:tasks.workunit.client.0.smithi155.stdout:1/101: write d1/f1e [872718,33639] 0 2023-12-16T05:56:26.459 INFO:tasks.workunit.client.0.smithi155.stdout:4/123: creat d0/f28 x:0 0 0 2023-12-16T05:56:26.459 INFO:tasks.workunit.client.0.smithi155.stdout:4/124: fdatasync d0/d11/d16/d1a/f27 0 2023-12-16T05:56:26.459 INFO:tasks.workunit.client.0.smithi155.stdout:4/125: truncate d0/d10/d22/f23 728293 0 2023-12-16T05:56:26.460 INFO:tasks.workunit.client.0.smithi155.stdout:4/126: write d0/d10/f26 [978073,93508] 0 2023-12-16T05:56:26.460 INFO:tasks.workunit.client.0.smithi155.stdout:4/127: write d0/f1d [179989,109536] 0 2023-12-16T05:56:26.465 INFO:tasks.workunit.client.0.smithi155.stdout:5/173: dwrite d0/d2/d2a/fe [0,4194304] 0 2023-12-16T05:56:26.469 INFO:tasks.workunit.client.0.smithi155.stdout:1/102: rename d1/d7/c15 to d1/d7/c26 0 2023-12-16T05:56:26.469 INFO:tasks.workunit.client.0.smithi155.stdout:1/103: dread - d1/d7/d16/f21 zero size 2023-12-16T05:56:26.470 INFO:tasks.workunit.client.0.smithi155.stdout:1/104: link d1/d7/c13 d1/d7/c27 0 2023-12-16T05:56:26.475 INFO:tasks.workunit.client.0.smithi155.stdout:5/174: dread d0/d2/f5 [0,4194304] 0 2023-12-16T05:56:26.482 INFO:tasks.workunit.client.0.smithi155.stdout:6/158: dwrite d0/df/f18 [0,4194304] 0 2023-12-16T05:56:26.482 INFO:tasks.workunit.client.0.smithi155.stdout:2/106: dwrite d0/f22 [0,4194304] 0 2023-12-16T05:56:26.482 INFO:tasks.workunit.client.0.smithi155.stdout:0/157: dwrite d7/d30/f33 [4194304,4194304] 0 2023-12-16T05:56:26.482 INFO:tasks.workunit.client.0.smithi155.stdout:0/158: read - d7/df/f26 zero size 2023-12-16T05:56:26.482 INFO:tasks.workunit.client.0.smithi155.stdout:0/159: stat d7/df/f1a 0 2023-12-16T05:56:26.483 INFO:tasks.workunit.client.0.smithi155.stdout:9/94: dwrite da/d15/d17/f1b [0,4194304] 0 2023-12-16T05:56:26.484 INFO:tasks.workunit.client.0.smithi155.stdout:6/159: unlink d0/f4 0 2023-12-16T05:56:26.485 INFO:tasks.workunit.client.0.smithi155.stdout:5/175: dread d0/f1c [0,4194304] 0 2023-12-16T05:56:26.486 INFO:tasks.workunit.client.0.smithi155.stdout:1/105: dwrite d1/d7/d16/f1d [4194304,4194304] 0 2023-12-16T05:56:26.486 INFO:tasks.workunit.client.0.smithi155.stdout:2/107: getdents d0/d7/dd/d14 0 2023-12-16T05:56:26.490 INFO:tasks.workunit.client.0.smithi155.stdout:9/95: mknod da/d15/d17/c21 0 2023-12-16T05:56:26.499 INFO:tasks.workunit.client.0.smithi155.stdout:6/160: getdents d0/df 0 2023-12-16T05:56:26.499 INFO:tasks.workunit.client.0.smithi155.stdout:5/176: symlink d0/l2d 0 2023-12-16T05:56:26.499 INFO:tasks.workunit.client.0.smithi155.stdout:6/161: fdatasync d0/d14/f33 0 2023-12-16T05:56:26.499 INFO:tasks.workunit.client.0.smithi155.stdout:2/108: mknod d0/d5/c2a 0 2023-12-16T05:56:26.502 INFO:tasks.workunit.client.0.smithi155.stdout:0/160: truncate d7/d30/f33 8181711 0 2023-12-16T05:56:26.503 INFO:tasks.workunit.client.0.smithi155.stdout:1/106: dwrite d1/d7/f20 [0,4194304] 0 2023-12-16T05:56:26.503 INFO:tasks.workunit.client.0.smithi155.stdout:0/161: truncate d7/df/f1a 709114 0 2023-12-16T05:56:26.503 INFO:tasks.workunit.client.0.smithi155.stdout:0/162: fdatasync d7/d13/f1b 0 2023-12-16T05:56:26.504 INFO:tasks.workunit.client.0.smithi155.stdout:1/107: mkdir d1/d17/d28 0 2023-12-16T05:56:26.505 INFO:tasks.workunit.client.0.smithi155.stdout:1/108: getdents d1/d25 0 2023-12-16T05:56:26.505 INFO:tasks.workunit.client.0.smithi155.stdout:0/163: mkdir d7/d1c/d23/d36 0 2023-12-16T05:56:26.506 INFO:tasks.workunit.client.0.smithi155.stdout:1/109: symlink d1/d25/l29 0 2023-12-16T05:56:26.507 INFO:tasks.workunit.client.0.smithi155.stdout:1/110: read d1/d7/f1f [76557,129782] 0 2023-12-16T05:56:26.507 INFO:tasks.workunit.client.0.smithi155.stdout:0/164: unlink d7/d1c/f2b 0 2023-12-16T05:56:26.509 INFO:tasks.workunit.client.0.smithi155.stdout:1/111: creat d1/f2a x:0 0 0 2023-12-16T05:56:26.510 INFO:tasks.workunit.client.0.smithi155.stdout:0/165: unlink d7/fc 0 2023-12-16T05:56:26.510 INFO:tasks.workunit.client.0.smithi155.stdout:1/112: rmdir d1/d25 39 2023-12-16T05:56:26.512 INFO:tasks.workunit.client.0.smithi155.stdout:0/166: creat d7/df/f37 x:0 0 0 2023-12-16T05:56:26.512 INFO:tasks.workunit.client.0.smithi155.stdout:0/167: fsync d7/fe 0 2023-12-16T05:56:26.512 INFO:tasks.workunit.client.0.smithi155.stdout:0/168: getdents d7/d1c/d23/d36 0 2023-12-16T05:56:26.512 INFO:tasks.workunit.client.0.smithi155.stdout:0/169: write d7/df/f31 [930186,49624] 0 2023-12-16T05:56:26.512 INFO:tasks.workunit.client.0.smithi155.stdout:1/113: mknod d1/d7/c2b 0 2023-12-16T05:56:26.516 INFO:tasks.workunit.client.0.smithi155.stdout:9/96: dwrite da/f13 [0,4194304] 0 2023-12-16T05:56:26.518 INFO:tasks.workunit.client.0.smithi155.stdout:9/97: symlink da/l22 0 2023-12-16T05:56:26.520 INFO:tasks.workunit.client.0.smithi155.stdout:9/98: symlink da/d15/d17/l23 0 2023-12-16T05:56:26.521 INFO:tasks.workunit.client.0.smithi155.stdout:5/177: dwrite d0/d2/d2a/fe [4194304,4194304] 0 2023-12-16T05:56:26.521 INFO:tasks.workunit.client.0.smithi155.stdout:5/178: stat d0/d2/d2a/c26 0 2023-12-16T05:56:26.523 INFO:tasks.workunit.client.0.smithi155.stdout:9/99: mkdir da/d15/d17/d24 0 2023-12-16T05:56:26.539 INFO:tasks.workunit.client.0.smithi155.stdout:1/114: dwrite d1/f6 [4194304,4194304] 0 2023-12-16T05:56:26.539 INFO:tasks.workunit.client.0.smithi155.stdout:1/115: chown d1/d17/d28 4636143 1 2023-12-16T05:56:26.540 INFO:tasks.workunit.client.0.smithi155.stdout:6/162: dwrite d0/df/f18 [4194304,4194304] 0 2023-12-16T05:56:26.540 INFO:tasks.workunit.client.0.smithi155.stdout:6/163: write d0/d3/f6 [5122430,83803] 0 2023-12-16T05:56:26.540 INFO:tasks.workunit.client.0.smithi155.stdout:2/109: dwrite d0/f4 [0,4194304] 0 2023-12-16T05:56:26.540 INFO:tasks.workunit.client.0.smithi155.stdout:2/110: truncate d0/d7/f25 799245 0 2023-12-16T05:56:26.540 INFO:tasks.workunit.client.0.smithi155.stdout:5/179: dwrite d0/d2/d2a/f18 [0,4194304] 0 2023-12-16T05:56:26.540 INFO:tasks.workunit.client.0.smithi155.stdout:2/111: write d0/f4 [3135815,111153] 0 2023-12-16T05:56:26.547 INFO:tasks.workunit.client.0.smithi155.stdout:2/112: dread d0/d5/d6/f10 [0,4194304] 0 2023-12-16T05:56:26.562 INFO:tasks.workunit.client.0.smithi155.stdout:9/100: unlink da/d15/c19 0 2023-12-16T05:56:26.563 INFO:tasks.workunit.client.0.smithi155.stdout:1/116: symlink d1/d7/d16/l2c 0 2023-12-16T05:56:26.565 INFO:tasks.workunit.client.0.smithi155.stdout:6/164: rmdir d0 39 2023-12-16T05:56:26.565 INFO:tasks.workunit.client.0.smithi155.stdout:6/165: chown d0/d14/f1d 8263 1 2023-12-16T05:56:26.568 INFO:tasks.workunit.client.0.smithi155.stdout:5/180: rename d0/d2/d2a/f12 to d0/d2/d2a/f2e 0 2023-12-16T05:56:26.568 INFO:tasks.workunit.client.0.smithi155.stdout:5/181: chown d0/l2d 1629 1 2023-12-16T05:56:26.569 INFO:tasks.workunit.client.0.smithi155.stdout:5/182: write d0/d2/d2a/d19/d21/f23 [2064797,86774] 0 2023-12-16T05:56:26.569 INFO:tasks.workunit.client.0.smithi155.stdout:5/183: chown d0/c1f 458696 1 2023-12-16T05:56:26.569 INFO:tasks.workunit.client.0.smithi155.stdout:5/184: write d0/d2/d2a/fe [9312822,127810] 0 2023-12-16T05:56:26.569 INFO:tasks.workunit.client.0.smithi155.stdout:2/113: rename d0/d7/f9 to d0/d5/d6/f2b 0 2023-12-16T05:56:26.575 INFO:tasks.workunit.client.0.smithi155.stdout:9/101: link da/d15/d17/f1b da/d15/d17/f25 0 2023-12-16T05:56:26.576 INFO:tasks.workunit.client.0.smithi155.stdout:9/102: write da/f12 [752334,85047] 0 2023-12-16T05:56:26.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:26 smithi155 ceph-mon[112451]: pgmap v9: 65 pgs: 65 active+clean; 387 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 20 MiB/s rd, 34 MiB/s wr, 1.03k op/s 2023-12-16T05:56:26.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:26 smithi155 ceph-mon[112451]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby-replay 2023-12-16T05:56:26.576 INFO:tasks.workunit.client.0.smithi155.stdout:1/117: mknod d1/c2d 0 2023-12-16T05:56:26.577 INFO:tasks.workunit.client.0.smithi155.stdout:6/166: mkdir d0/d3/d2c/d36 0 2023-12-16T05:56:26.577 INFO:tasks.workunit.client.0.smithi155.stdout:6/167: readlink d0/d14/l29 0 2023-12-16T05:56:26.577 INFO:tasks.workunit.client.0.smithi155.stdout:6/168: write d0/d14/f33 [344183,34591] 0 2023-12-16T05:56:26.578 INFO:tasks.workunit.client.0.smithi155.stdout:5/185: mknod d0/d2/c2f 0 2023-12-16T05:56:26.580 INFO:tasks.workunit.client.0.smithi155.stdout:2/114: symlink d0/d7/dd/d14/l2c 0 2023-12-16T05:56:26.580 INFO:tasks.workunit.client.0.smithi155.stdout:2/115: dread - d0/f1a zero size 2023-12-16T05:56:26.580 INFO:tasks.workunit.client.0.smithi155.stdout:2/116: readlink d0/d5/l11 0 2023-12-16T05:56:26.580 INFO:tasks.workunit.client.0.smithi155.stdout:2/117: write d0/d7/dd/d14/f19 [641355,40356] 0 2023-12-16T05:56:26.580 INFO:tasks.workunit.client.0.smithi155.stdout:9/103: mkdir da/d15/d17/d24/d26 0 2023-12-16T05:56:26.581 INFO:tasks.workunit.client.0.smithi155.stdout:1/118: link d1/d7/c11 d1/d7/d16/c2e 0 2023-12-16T05:56:26.582 INFO:tasks.workunit.client.0.smithi155.stdout:1/119: dread d1/ff [0,4194304] 0 2023-12-16T05:56:26.583 INFO:tasks.workunit.client.0.smithi155.stdout:5/186: mkdir d0/d2/d2a/d30 0 2023-12-16T05:56:26.584 INFO:tasks.workunit.client.0.smithi155.stdout:9/104: rmdir da/d15/d17/d24 39 2023-12-16T05:56:26.584 INFO:tasks.workunit.client.0.smithi155.stdout:9/105: chown da/d15/d17/d24/d26 0 1 2023-12-16T05:56:26.585 INFO:tasks.workunit.client.0.smithi155.stdout:9/106: dread - da/d15/d17/f1c zero size 2023-12-16T05:56:26.585 INFO:tasks.workunit.client.0.smithi155.stdout:6/169: symlink d0/l37 0 2023-12-16T05:56:26.585 INFO:tasks.workunit.client.0.smithi155.stdout:6/170: dread - d0/d3/f5 zero size 2023-12-16T05:56:26.585 INFO:tasks.workunit.client.0.smithi155.stdout:6/171: stat d0/l10 0 2023-12-16T05:56:26.586 INFO:tasks.workunit.client.0.smithi155.stdout:1/120: rename d1/d7/f12 to d1/d7/f2f 0 2023-12-16T05:56:26.586 INFO:tasks.workunit.client.0.smithi155.stdout:6/172: write d0/d3/d2c/f30 [1971223,115106] 0 2023-12-16T05:56:26.586 INFO:tasks.workunit.client.0.smithi155.stdout:6/173: write d0/d3/f19 [690258,20371] 0 2023-12-16T05:56:26.587 INFO:tasks.workunit.client.0.smithi155.stdout:5/187: symlink d0/l31 0 2023-12-16T05:56:26.587 INFO:tasks.workunit.client.0.smithi155.stdout:5/188: write d0/d2/f5 [5423599,83421] 0 2023-12-16T05:56:26.587 INFO:tasks.workunit.client.0.smithi155.stdout:5/189: chown d0/c1f 8866658 1 2023-12-16T05:56:26.589 INFO:tasks.workunit.client.0.smithi155.stdout:2/118: truncate d0/f2 1337945 0 2023-12-16T05:56:26.589 INFO:tasks.workunit.client.0.smithi155.stdout:9/107: unlink da/d15/d17/f1b 0 2023-12-16T05:56:26.590 INFO:tasks.workunit.client.0.smithi155.stdout:6/174: creat d0/d3/f38 x:0 0 0 2023-12-16T05:56:26.590 INFO:tasks.workunit.client.0.smithi155.stdout:6/175: write d0/d3/f38 [348368,4275] 0 2023-12-16T05:56:26.592 INFO:tasks.workunit.client.0.smithi155.stdout:2/119: creat d0/d7/dd/d14/f2d x:0 0 0 2023-12-16T05:56:26.593 INFO:tasks.workunit.client.0.smithi155.stdout:9/108: mknod da/d15/d17/c27 0 2023-12-16T05:56:26.593 INFO:tasks.workunit.client.0.smithi155.stdout:9/109: dread - da/ff zero size 2023-12-16T05:56:26.595 INFO:tasks.workunit.client.0.smithi155.stdout:6/176: creat d0/d3/f39 x:0 0 0 2023-12-16T05:56:26.596 INFO:tasks.workunit.client.0.smithi155.stdout:6/177: dread d0/d14/f33 [0,4194304] 0 2023-12-16T05:56:26.600 INFO:tasks.workunit.client.0.smithi155.stdout:2/120: creat d0/d5/d6/f2e x:0 0 0 2023-12-16T05:56:26.600 INFO:tasks.workunit.client.0.smithi155.stdout:2/121: write d0/d7/dd/f26 [610627,125593] 0 2023-12-16T05:56:26.601 INFO:tasks.workunit.client.0.smithi155.stdout:5/190: dwrite d0/f1c [4194304,4194304] 0 2023-12-16T05:56:26.602 INFO:tasks.workunit.client.0.smithi155.stdout:9/110: creat da/d15/d17/d24/f28 x:0 0 0 2023-12-16T05:56:26.603 INFO:tasks.workunit.client.0.smithi155.stdout:6/178: link d0/d14/l29 d0/d3/l3a 0 2023-12-16T05:56:26.608 INFO:tasks.workunit.client.0.smithi155.stdout:9/111: creat da/d15/d17/d24/d26/f29 x:0 0 0 2023-12-16T05:56:26.609 INFO:tasks.workunit.client.0.smithi155.stdout:6/179: rmdir d0/d3/d2c 39 2023-12-16T05:56:26.613 INFO:tasks.workunit.client.0.smithi155.stdout:6/180: mkdir d0/d14/d1b/d3b 0 2023-12-16T05:56:26.620 INFO:tasks.workunit.client.0.smithi155.stdout:6/181: symlink d0/d14/d1b/d3b/l3c 0 2023-12-16T05:56:26.632 INFO:tasks.workunit.client.0.smithi155.stdout:5/191: dwrite d0/d2/d2a/f2e [0,4194304] 0 2023-12-16T05:56:26.632 INFO:tasks.workunit.client.0.smithi155.stdout:9/112: dwrite da/d15/d17/f1c [0,4194304] 0 2023-12-16T05:56:26.632 INFO:tasks.workunit.client.0.smithi155.stdout:2/122: dwrite d0/d5/f23 [0,4194304] 0 2023-12-16T05:56:26.638 INFO:tasks.workunit.client.0.smithi155.stdout:5/192: creat d0/f32 x:0 0 0 2023-12-16T05:56:26.645 INFO:tasks.workunit.client.0.smithi155.stdout:2/123: mknod d0/d7/dd/c2f 0 2023-12-16T05:56:26.653 INFO:tasks.workunit.client.0.smithi155.stdout:9/113: dwrite da/f13 [4194304,4194304] 0 2023-12-16T05:56:26.653 INFO:tasks.workunit.client.0.smithi155.stdout:6/182: dwrite d0/d3/d2c/f2f [0,4194304] 0 2023-12-16T05:56:26.654 INFO:tasks.workunit.client.0.smithi155.stdout:6/183: write d0/d3/f1e [3331948,68154] 0 2023-12-16T05:56:26.654 INFO:tasks.workunit.client.0.smithi155.stdout:6/184: write d0/d14/f15 [863843,109030] 0 2023-12-16T05:56:26.656 INFO:tasks.workunit.client.0.smithi155.stdout:5/193: dwrite d0/d2/f22 [0,4194304] 0 2023-12-16T05:56:26.656 INFO:tasks.workunit.client.0.smithi155.stdout:5/194: truncate d0/f32 297182 0 2023-12-16T05:56:26.656 INFO:tasks.workunit.client.0.smithi155.stdout:5/195: fdatasync d0/f1c 0 2023-12-16T05:56:26.656 INFO:tasks.workunit.client.0.smithi155.stdout:9/114: creat da/d15/d17/d24/d26/f2a x:0 0 0 2023-12-16T05:56:26.656 INFO:tasks.workunit.client.0.smithi155.stdout:9/115: write da/d15/d17/d24/d26/f29 [101400,78502] 0 2023-12-16T05:56:26.656 INFO:tasks.workunit.client.0.smithi155.stdout:9/116: write da/d15/d17/d24/d26/f29 [110508,26830] 0 2023-12-16T05:56:26.656 INFO:tasks.workunit.client.0.smithi155.stdout:9/117: write da/d15/f1d [2149594,59763] 0 2023-12-16T05:56:26.657 INFO:tasks.workunit.client.0.smithi155.stdout:6/185: dread d0/d14/d1b/f2b [0,4194304] 0 2023-12-16T05:56:26.657 INFO:tasks.workunit.client.0.smithi155.stdout:2/124: getdents d0/d7/dd 0 2023-12-16T05:56:26.658 INFO:tasks.workunit.client.0.smithi155.stdout:2/125: fdatasync d0/d5/d6/f1c 0 2023-12-16T05:56:26.660 INFO:tasks.workunit.client.0.smithi155.stdout:5/196: rmdir d0/d2 39 2023-12-16T05:56:26.662 INFO:tasks.workunit.client.0.smithi155.stdout:9/118: creat da/d15/d17/d24/f2b x:0 0 0 2023-12-16T05:56:26.663 INFO:tasks.workunit.client.0.smithi155.stdout:5/197: mknod d0/c33 0 2023-12-16T05:56:26.664 INFO:tasks.workunit.client.0.smithi155.stdout:9/119: mkdir da/d15/d2c 0 2023-12-16T05:56:26.665 INFO:tasks.workunit.client.0.smithi155.stdout:5/198: mknod d0/c34 0 2023-12-16T05:56:26.665 INFO:tasks.workunit.client.0.smithi155.stdout:9/120: readlink l2 0 2023-12-16T05:56:26.666 INFO:tasks.workunit.client.0.smithi155.stdout:5/199: truncate d0/d2/ff 4214514 0 2023-12-16T05:56:26.667 INFO:tasks.workunit.client.0.smithi155.stdout:5/200: write d0/f32 [940505,27061] 0 2023-12-16T05:56:26.667 INFO:tasks.workunit.client.0.smithi155.stdout:5/201: write d0/f32 [1287727,32823] 0 2023-12-16T05:56:26.667 INFO:tasks.workunit.client.0.smithi155.stdout:9/121: chown da/d15/d17/f25 0 1 2023-12-16T05:56:26.676 INFO:tasks.workunit.client.0.smithi155.stdout:6/186: dwrite d0/d14/f33 [0,4194304] 0 2023-12-16T05:56:26.676 INFO:tasks.workunit.client.0.smithi155.stdout:6/187: readlink d0/l37 0 2023-12-16T05:56:26.676 INFO:tasks.workunit.client.0.smithi155.stdout:6/188: chown d0/fc 17332 1 2023-12-16T05:56:26.677 INFO:tasks.workunit.client.0.smithi155.stdout:2/126: dwrite d0/d5/d6/f2e [0,4194304] 0 2023-12-16T05:56:26.679 INFO:tasks.workunit.client.0.smithi155.stdout:6/189: rmdir d0/d14/d1b 39 2023-12-16T05:56:26.679 INFO:tasks.workunit.client.0.smithi155.stdout:2/127: write d0/d5/d6/df/f1b [4155899,102824] 0 2023-12-16T05:56:26.679 INFO:tasks.workunit.client.0.smithi155.stdout:2/128: chown d0/d7 423052523 1 2023-12-16T05:56:26.680 INFO:tasks.workunit.client.0.smithi155.stdout:6/190: read d0/d14/f33 [3835311,70237] 0 2023-12-16T05:56:26.684 INFO:tasks.workunit.client.0.smithi155.stdout:6/191: rename d0/d14/l29 to d0/d3/d2c/l3d 0 2023-12-16T05:56:26.686 INFO:tasks.workunit.client.0.smithi155.stdout:9/122: dwrite da/d15/d17/d24/f2b [0,4194304] 0 2023-12-16T05:56:26.686 INFO:tasks.workunit.client.0.smithi155.stdout:9/123: read da/d15/f16 [8455,8379] 0 2023-12-16T05:56:26.689 INFO:tasks.workunit.client.0.smithi155.stdout:9/124: creat da/d15/d17/d24/f2d x:0 0 0 2023-12-16T05:56:26.689 INFO:tasks.workunit.client.0.smithi155.stdout:9/125: write da/d15/d17/d24/f28 [492832,52131] 0 2023-12-16T05:56:26.690 INFO:tasks.workunit.client.0.smithi155.stdout:9/126: chown f9 878 1 2023-12-16T05:56:26.690 INFO:tasks.workunit.client.0.smithi155.stdout:5/202: truncate d0/d2/ff 3163396 0 2023-12-16T05:56:26.690 INFO:tasks.workunit.client.0.smithi155.stdout:5/203: stat d0/d2/d2a/fd 0 2023-12-16T05:56:26.690 INFO:tasks.workunit.client.0.smithi155.stdout:5/204: fdatasync d0/f15 0 2023-12-16T05:56:26.691 INFO:tasks.workunit.client.0.smithi155.stdout:9/127: mkdir da/d15/d17/d24/d26/d2e 0 2023-12-16T05:56:26.692 INFO:tasks.workunit.client.0.smithi155.stdout:5/205: rename d0/l31 to d0/d2/d2a/d30/l35 0 2023-12-16T05:56:26.693 INFO:tasks.workunit.client.0.smithi155.stdout:2/129: dread d0/d7/f1d [0,4194304] 0 2023-12-16T05:56:26.694 INFO:tasks.workunit.client.0.smithi155.stdout:9/128: unlink da/f12 0 2023-12-16T05:56:26.695 INFO:tasks.workunit.client.0.smithi155.stdout:5/206: creat d0/d2/d2a/d19/d21/f36 x:0 0 0 2023-12-16T05:56:26.696 INFO:tasks.workunit.client.0.smithi155.stdout:2/130: creat d0/f30 x:0 0 0 2023-12-16T05:56:26.697 INFO:tasks.workunit.client.0.smithi155.stdout:5/207: write d0/d2/f5 [866251,62993] 0 2023-12-16T05:56:26.702 INFO:tasks.workunit.client.0.smithi155.stdout:8/120: sync 2023-12-16T05:56:26.702 INFO:tasks.workunit.client.0.smithi155.stdout:3/85: sync 2023-12-16T05:56:26.702 INFO:tasks.workunit.client.0.smithi155.stdout:3/86: chown d0/d1a 57198 1 2023-12-16T05:56:26.702 INFO:tasks.workunit.client.0.smithi155.stdout:7/128: sync 2023-12-16T05:56:26.702 INFO:tasks.workunit.client.0.smithi155.stdout:2/131: dread d0/f1 [0,4194304] 0 2023-12-16T05:56:26.702 INFO:tasks.workunit.client.0.smithi155.stdout:7/129: write d0/d1b/f1e [137879,123703] 0 2023-12-16T05:56:26.704 INFO:tasks.workunit.client.0.smithi155.stdout:3/87: mknod d0/d14/c1c 0 2023-12-16T05:56:26.706 INFO:tasks.workunit.client.0.smithi155.stdout:3/88: creat d0/d1a/f1d x:0 0 0 2023-12-16T05:56:26.708 INFO:tasks.workunit.client.0.smithi155.stdout:3/89: mkdir d0/d1e 0 2023-12-16T05:56:26.708 INFO:tasks.workunit.client.0.smithi155.stdout:3/90: write d0/f11 [919229,112831] 0 2023-12-16T05:56:26.713 INFO:tasks.workunit.client.0.smithi155.stdout:7/130: dread d0/d1/d5/f1d [0,4194304] 0 2023-12-16T05:56:26.719 INFO:tasks.workunit.client.0.smithi155.stdout:6/192: dwrite d0/df/f18 [4194304,4194304] 0 2023-12-16T05:56:26.721 INFO:tasks.workunit.client.0.smithi155.stdout:6/193: rename d0/d3/d2c/d36 to d0/d3/d2c/d3e 0 2023-12-16T05:56:26.721 INFO:tasks.workunit.client.0.smithi155.stdout:6/194: truncate d0/d14/d1b/f22 922823 0 2023-12-16T05:56:26.723 INFO:tasks.workunit.client.0.smithi155.stdout:6/195: rename d0/d14/d1b/f2b to d0/d14/d1b/d3b/f3f 0 2023-12-16T05:56:26.726 INFO:tasks.workunit.client.0.smithi155.stdout:2/132: dwrite d0/d7/dd/f26 [0,4194304] 0 2023-12-16T05:56:26.736 INFO:tasks.workunit.client.0.smithi155.stdout:3/91: dread d0/fe [0,4194304] 0 2023-12-16T05:56:26.737 INFO:tasks.workunit.client.0.smithi155.stdout:3/92: symlink d0/d14/l1f 0 2023-12-16T05:56:26.740 INFO:tasks.workunit.client.0.smithi155.stdout:8/121: dwrite f0 [0,4194304] 0 2023-12-16T05:56:26.740 INFO:tasks.workunit.client.0.smithi155.stdout:8/122: chown d4/da/d12 474012900 1 2023-12-16T05:56:26.748 INFO:tasks.workunit.client.0.smithi155.stdout:9/129: dwrite da/f1e [0,4194304] 0 2023-12-16T05:56:26.750 INFO:tasks.workunit.client.0.smithi155.stdout:9/130: creat da/d15/f2f x:0 0 0 2023-12-16T05:56:26.750 INFO:tasks.workunit.client.0.smithi155.stdout:9/131: dread - da/d15/d17/d24/d26/f2a zero size 2023-12-16T05:56:26.751 INFO:tasks.workunit.client.0.smithi155.stdout:9/132: mknod da/d15/d17/c30 0 2023-12-16T05:56:26.751 INFO:tasks.workunit.client.0.smithi155.stdout:9/133: creat da/d15/f31 x:0 0 0 2023-12-16T05:56:26.752 INFO:tasks.workunit.client.0.smithi155.stdout:2/133: dwrite d0/d5/f28 [0,4194304] 0 2023-12-16T05:56:26.754 INFO:tasks.workunit.client.0.smithi155.stdout:7/131: dwrite d0/d1/d5/f9 [0,4194304] 0 2023-12-16T05:56:26.754 INFO:tasks.workunit.client.0.smithi155.stdout:7/132: chown d0/d1/lc 2 1 2023-12-16T05:56:26.754 INFO:tasks.workunit.client.0.smithi155.stdout:7/133: fsync d0/d1/d5/d18/d1a/d22/f25 0 2023-12-16T05:56:26.754 INFO:tasks.workunit.client.0.smithi155.stdout:7/134: readlink d0/d1/l29 0 2023-12-16T05:56:26.754 INFO:tasks.workunit.client.0.smithi155.stdout:6/196: dwrite d0/df/f26 [0,4194304] 0 2023-12-16T05:56:26.754 INFO:tasks.workunit.client.0.smithi155.stdout:6/197: read - d0/df/f35 zero size 2023-12-16T05:56:26.754 INFO:tasks.workunit.client.0.smithi155.stdout:5/208: dwrite d0/d2/d2a/fe [0,4194304] 0 2023-12-16T05:56:26.755 INFO:tasks.workunit.client.0.smithi155.stdout:5/209: stat d0/d2/d2a/c26 0 2023-12-16T05:56:26.755 INFO:tasks.workunit.client.0.smithi155.stdout:2/134: unlink d0/d5/d6/ce 0 2023-12-16T05:56:26.758 INFO:tasks.workunit.client.0.smithi155.stdout:9/134: dread da/d15/f1d [0,4194304] 0 2023-12-16T05:56:26.760 INFO:tasks.workunit.client.0.smithi155.stdout:3/93: dread d0/f11 [0,4194304] 0 2023-12-16T05:56:26.764 INFO:tasks.workunit.client.0.smithi155.stdout:2/135: dread d0/f2 [0,4194304] 0 2023-12-16T05:56:26.764 INFO:tasks.workunit.client.0.smithi155.stdout:7/135: mkdir d0/d1/d5/d18/d1a/d2b 0 2023-12-16T05:56:26.766 INFO:tasks.workunit.client.0.smithi155.stdout:8/123: truncate f0 3180185 0 2023-12-16T05:56:26.768 INFO:tasks.workunit.client.0.smithi155.stdout:6/198: truncate d0/d3/f1e 147052 0 2023-12-16T05:56:26.774 INFO:tasks.workunit.client.0.smithi155.stdout:2/136: symlink d0/d7/dd/l31 0 2023-12-16T05:56:26.776 INFO:tasks.workunit.client.0.smithi155.stdout:3/94: dread d0/d14/f18 [0,4194304] 0 2023-12-16T05:56:26.777 INFO:tasks.workunit.client.0.smithi155.stdout:7/136: mkdir d0/d1/d5/d18/d1a/d2b/d2c 0 2023-12-16T05:56:26.780 INFO:tasks.workunit.client.0.smithi155.stdout:8/124: unlink d4/f10 0 2023-12-16T05:56:26.784 INFO:tasks.workunit.client.0.smithi155.stdout:6/199: link d0/d14/d1b/d3b/l3c d0/d3/l40 0 2023-12-16T05:56:26.784 INFO:tasks.workunit.client.0.smithi155.stdout:6/200: truncate d0/d14/d1b/d3b/f3f 1044560 0 2023-12-16T05:56:26.784 INFO:tasks.workunit.client.0.smithi155.stdout:6/201: getdents d0/df 0 2023-12-16T05:56:26.784 INFO:tasks.workunit.client.0.smithi155.stdout:2/137: rename d0/d5/f28 to d0/f32 0 2023-12-16T05:56:26.784 INFO:tasks.workunit.client.0.smithi155.stdout:9/135: dwrite da/ff [0,4194304] 0 2023-12-16T05:56:26.785 INFO:tasks.workunit.client.0.smithi155.stdout:3/95: link d0/d14/f18 d0/d1e/f20 0 2023-12-16T05:56:26.785 INFO:tasks.workunit.client.0.smithi155.stdout:5/210: dwrite d0/d2/d2a/fd [0,4194304] 0 2023-12-16T05:56:26.785 INFO:tasks.workunit.client.0.smithi155.stdout:5/211: readlink d0/l29 0 2023-12-16T05:56:26.787 INFO:tasks.workunit.client.0.smithi155.stdout:7/137: creat d0/d1/d5/d18/d1a/f2d x:0 0 0 2023-12-16T05:56:26.793 INFO:tasks.workunit.client.0.smithi155.stdout:6/202: dread d0/df/f26 [0,4194304] 0 2023-12-16T05:56:26.794 INFO:tasks.workunit.client.0.smithi155.stdout:6/203: chown d0/d14/f15 52492985 1 2023-12-16T05:56:26.794 INFO:tasks.workunit.client.0.smithi155.stdout:6/204: write d0/d3/f11 [1841079,57686] 0 2023-12-16T05:56:26.794 INFO:tasks.workunit.client.0.smithi155.stdout:6/205: chown d0/d14/d1b/l25 216665330 1 2023-12-16T05:56:26.795 INFO:tasks.workunit.client.0.smithi155.stdout:2/138: mkdir d0/d33 0 2023-12-16T05:56:26.796 INFO:tasks.workunit.client.0.smithi155.stdout:8/125: rename d4/d14 to d4/da/d1b/d1c/d1a/d1f 0 2023-12-16T05:56:26.796 INFO:tasks.workunit.client.0.smithi155.stdout:5/212: rename d0/d2 to d0/d2/d2a/d19/d21/d37 22 2023-12-16T05:56:26.796 INFO:tasks.workunit.client.0.smithi155.stdout:8/126: truncate d4/ff 977174 0 2023-12-16T05:56:26.796 INFO:tasks.workunit.client.0.smithi155.stdout:7/138: rename d0 to d0/d2e 22 2023-12-16T05:56:26.796 INFO:tasks.workunit.client.0.smithi155.stdout:2/139: write d0/f2 [783020,19317] 0 2023-12-16T05:56:26.799 INFO:tasks.workunit.client.0.smithi155.stdout:9/136: rmdir da/d15/d17 39 2023-12-16T05:56:26.800 INFO:tasks.workunit.client.0.smithi155.stdout:3/96: mknod d0/d1a/c21 0 2023-12-16T05:56:26.804 INFO:tasks.workunit.client.0.smithi155.stdout:6/206: truncate d0/d3/f12 255437 0 2023-12-16T05:56:26.804 INFO:tasks.workunit.client.0.smithi155.stdout:6/207: readlink d0/d14/d1b/l2a 0 2023-12-16T05:56:26.805 INFO:tasks.workunit.client.0.smithi155.stdout:0/170: sync 2023-12-16T05:56:26.806 INFO:tasks.workunit.client.0.smithi155.stdout:4/128: sync 2023-12-16T05:56:26.808 INFO:tasks.workunit.client.0.smithi155.stdout:5/213: creat d0/d2/d2a/d19/f38 x:0 0 0 2023-12-16T05:56:26.810 INFO:tasks.workunit.client.0.smithi155.stdout:8/127: creat d4/da/d1b/f20 x:0 0 0 2023-12-16T05:56:26.810 INFO:tasks.workunit.client.0.smithi155.stdout:8/128: chown d4/da/c1d 238 1 2023-12-16T05:56:26.813 INFO:tasks.workunit.client.0.smithi155.stdout:0/171: read d7/df/f31 [133359,36363] 0 2023-12-16T05:56:26.817 INFO:tasks.workunit.client.0.smithi155.stdout:8/129: dread f2 [0,4194304] 0 2023-12-16T05:56:26.818 INFO:tasks.workunit.client.0.smithi155.stdout:9/137: mkdir da/d15/d17/d24/d26/d2e/d32 0 2023-12-16T05:56:26.818 INFO:tasks.workunit.client.0.smithi155.stdout:3/97: creat d0/d1a/f22 x:0 0 0 2023-12-16T05:56:26.818 INFO:tasks.workunit.client.0.smithi155.stdout:3/98: write d0/f10 [478842,31339] 0 2023-12-16T05:56:26.818 INFO:tasks.workunit.client.0.smithi155.stdout:4/129: rmdir d0/d11/d16 39 2023-12-16T05:56:26.819 INFO:tasks.workunit.client.0.smithi155.stdout:4/130: write d0/d10/f12 [606246,84862] 0 2023-12-16T05:56:26.823 INFO:tasks.workunit.client.0.smithi155.stdout:7/139: dwrite d0/d1/d5/d18/d1a/d22/f23 [0,4194304] 0 2023-12-16T05:56:26.823 INFO:tasks.workunit.client.0.smithi155.stdout:7/140: stat d0/d1/d5/l10 0 2023-12-16T05:56:26.826 INFO:tasks.workunit.client.0.smithi155.stdout:8/130: rmdir d4/da/d1b/d1c/d1a/d1f 39 2023-12-16T05:56:26.826 INFO:tasks.workunit.client.0.smithi155.stdout:8/131: truncate d4/ff 1073604 0 2023-12-16T05:56:26.828 INFO:tasks.workunit.client.0.smithi155.stdout:6/208: dwrite d0/f16 [0,4194304] 0 2023-12-16T05:56:26.828 INFO:tasks.workunit.client.0.smithi155.stdout:6/209: chown d0/l24 39882789 1 2023-12-16T05:56:26.831 INFO:tasks.workunit.client.0.smithi155.stdout:9/138: mknod da/c33 0 2023-12-16T05:56:26.831 INFO:tasks.workunit.client.0.smithi155.stdout:3/99: creat d0/d1e/f23 x:0 0 0 2023-12-16T05:56:26.834 INFO:tasks.workunit.client.0.smithi155.stdout:1/121: sync 2023-12-16T05:56:26.839 INFO:tasks.workunit.client.0.smithi155.stdout:7/141: link d0/d1/d5/fd d0/d1b/f2f 0 2023-12-16T05:56:26.839 INFO:tasks.workunit.client.0.smithi155.stdout:6/210: dread d0/f16 [0,4194304] 0 2023-12-16T05:56:26.839 INFO:tasks.workunit.client.0.smithi155.stdout:6/211: chown d0/d14/d1b/d3b/l3c 91312 1 2023-12-16T05:56:26.839 INFO:tasks.workunit.client.0.smithi155.stdout:6/212: write d0/d3/f19 [1310180,109275] 0 2023-12-16T05:56:26.840 INFO:tasks.workunit.client.0.smithi155.stdout:4/131: creat d0/d11/d16/d1a/f29 x:0 0 0 2023-12-16T05:56:26.840 INFO:tasks.workunit.client.0.smithi155.stdout:4/132: fsync d0/d10/d22/f25 0 2023-12-16T05:56:26.840 INFO:tasks.workunit.client.0.smithi155.stdout:6/213: dread d0/df/f27 [0,4194304] 0 2023-12-16T05:56:26.841 INFO:tasks.workunit.client.0.smithi155.stdout:2/140: dwrite d0/d7/f24 [0,4194304] 0 2023-12-16T05:56:26.841 INFO:tasks.workunit.client.0.smithi155.stdout:9/139: rmdir da/d15/d2c 0 2023-12-16T05:56:26.844 INFO:tasks.workunit.client.0.smithi155.stdout:7/142: creat d0/d1/d5/d18/f30 x:0 0 0 2023-12-16T05:56:26.845 INFO:tasks.workunit.client.0.smithi155.stdout:5/214: dwrite d0/f32 [0,4194304] 0 2023-12-16T05:56:26.845 INFO:tasks.workunit.client.0.smithi155.stdout:1/122: dread d1/f6 [0,4194304] 0 2023-12-16T05:56:26.846 INFO:tasks.workunit.client.0.smithi155.stdout:4/133: symlink d0/da/l2a 0 2023-12-16T05:56:26.846 INFO:tasks.workunit.client.0.smithi155.stdout:4/134: fdatasync d0/d11/d16/d1a/f27 0 2023-12-16T05:56:26.846 INFO:tasks.workunit.client.0.smithi155.stdout:4/135: stat d0/d10/d22/f25 0 2023-12-16T05:56:26.846 INFO:tasks.workunit.client.0.smithi155.stdout:4/136: chown d0/da/c13 90163 1 2023-12-16T05:56:26.848 INFO:tasks.workunit.client.0.smithi155.stdout:1/123: write d1/d7/f18 [2943607,43764] 0 2023-12-16T05:56:26.848 INFO:tasks.workunit.client.0.smithi155.stdout:1/124: fsync d1/d7/d16/f21 0 2023-12-16T05:56:26.848 INFO:tasks.workunit.client.0.smithi155.stdout:6/214: link d0/d3/f38 d0/d14/d1b/d3b/f41 0 2023-12-16T05:56:26.850 INFO:tasks.workunit.client.0.smithi155.stdout:3/100: rmdir d0/d1e 39 2023-12-16T05:56:26.852 INFO:tasks.workunit.client.0.smithi155.stdout:2/141: mkdir d0/d34 0 2023-12-16T05:56:26.854 INFO:tasks.workunit.client.0.smithi155.stdout:7/143: mkdir d0/d1/d5/d18/d31 0 2023-12-16T05:56:26.854 INFO:tasks.workunit.client.0.smithi155.stdout:7/144: readlink d0/d1/d5/lf 0 2023-12-16T05:56:26.854 INFO:tasks.workunit.client.0.smithi155.stdout:8/132: dwrite d4/da/fb [0,4194304] 0 2023-12-16T05:56:26.856 INFO:tasks.workunit.client.0.smithi155.stdout:3/101: dread d0/f10 [0,4194304] 0 2023-12-16T05:56:26.857 INFO:tasks.workunit.client.0.smithi155.stdout:3/102: write d0/d14/f18 [2968443,93251] 0 2023-12-16T05:56:26.857 INFO:tasks.workunit.client.0.smithi155.stdout:5/215: mknod d0/d2/d2a/d19/c39 0 2023-12-16T05:56:26.859 INFO:tasks.workunit.client.0.smithi155.stdout:4/137: creat d0/d11/d16/d1a/f2b x:0 0 0 2023-12-16T05:56:26.859 INFO:tasks.workunit.client.0.smithi155.stdout:1/125: stat d1/d7/c26 0 2023-12-16T05:56:26.860 INFO:tasks.workunit.client.0.smithi155.stdout:6/215: mkdir d0/d3/d2c/d42 0 2023-12-16T05:56:26.861 INFO:tasks.workunit.client.0.smithi155.stdout:2/142: mknod d0/d34/c35 0 2023-12-16T05:56:26.864 INFO:tasks.workunit.client.0.smithi155.stdout:7/145: rename d0/d1b/f1e to d0/d1/d5/d18/d31/f32 0 2023-12-16T05:56:26.866 INFO:tasks.workunit.client.0.smithi155.stdout:8/133: creat d4/da/d12/f21 x:0 0 0 2023-12-16T05:56:26.867 INFO:tasks.workunit.client.0.smithi155.stdout:3/103: symlink d0/d1a/l24 0 2023-12-16T05:56:26.868 INFO:tasks.workunit.client.0.smithi155.stdout:1/126: mkdir d1/d7/d16/d30 0 2023-12-16T05:56:26.869 INFO:tasks.workunit.client.0.smithi155.stdout:1/127: getdents d1/d17/d28 0 2023-12-16T05:56:26.870 INFO:tasks.workunit.client.0.smithi155.stdout:1/128: dread d1/ff [0,4194304] 0 2023-12-16T05:56:26.870 INFO:tasks.workunit.client.0.smithi155.stdout:1/129: chown d1/d7/f1f 31272344 1 2023-12-16T05:56:26.870 INFO:tasks.workunit.client.0.smithi155.stdout:6/216: dread d0/d3/d2c/f30 [0,4194304] 0 2023-12-16T05:56:26.870 INFO:tasks.workunit.client.0.smithi155.stdout:6/217: fsync d0/d14/d1b/d3b/f3f 0 2023-12-16T05:56:26.870 INFO:tasks.workunit.client.0.smithi155.stdout:9/140: link da/d15/d17/c21 da/d15/d17/c34 0 2023-12-16T05:56:26.870 INFO:tasks.workunit.client.0.smithi155.stdout:9/141: readlink da/le 0 2023-12-16T05:56:26.871 INFO:tasks.workunit.client.0.smithi155.stdout:9/142: read da/ff [3109214,40416] 0 2023-12-16T05:56:26.871 INFO:tasks.workunit.client.0.smithi155.stdout:9/143: read - da/d15/f31 zero size 2023-12-16T05:56:26.872 INFO:tasks.workunit.client.0.smithi155.stdout:4/138: rename d0/d11/d16/d1a/f29 to d0/d10/f2c 0 2023-12-16T05:56:26.874 INFO:tasks.workunit.client.0.smithi155.stdout:7/146: link d0/d1/d5/d18/d1a/c2a d0/d1/d5/d18/d1a/d2b/c33 0 2023-12-16T05:56:26.874 INFO:tasks.workunit.client.0.smithi155.stdout:7/147: chown d0/d1/d5/d18/d1a/d22/d27 240066270 1 2023-12-16T05:56:26.876 INFO:tasks.workunit.client.0.smithi155.stdout:3/104: link d0/cf d0/d1e/c25 0 2023-12-16T05:56:26.876 INFO:tasks.workunit.client.0.smithi155.stdout:3/105: chown d0/f15 3 1 2023-12-16T05:56:26.878 INFO:tasks.workunit.client.0.smithi155.stdout:5/216: truncate d0/f32 2885097 0 2023-12-16T05:56:26.879 INFO:tasks.workunit.client.0.smithi155.stdout:5/217: chown d0/d2 1436206 1 2023-12-16T05:56:26.881 INFO:tasks.workunit.client.0.smithi155.stdout:6/218: mkdir d0/df/d43 0 2023-12-16T05:56:26.884 INFO:tasks.workunit.client.0.smithi155.stdout:4/139: creat d0/f2d x:0 0 0 2023-12-16T05:56:26.884 INFO:tasks.workunit.client.0.smithi155.stdout:4/140: truncate d0/f2d 483656 0 2023-12-16T05:56:26.887 INFO:tasks.workunit.client.0.smithi155.stdout:7/148: mkdir d0/d1/d5/d18/d1a/d22/d27/d34 0 2023-12-16T05:56:26.889 INFO:tasks.workunit.client.0.smithi155.stdout:6/219: rmdir d0/d3/d2c 39 2023-12-16T05:56:26.890 INFO:tasks.workunit.client.0.smithi155.stdout:4/141: creat d0/d11/d16/d1a/f2e x:0 0 0 2023-12-16T05:56:26.890 INFO:tasks.workunit.client.0.smithi155.stdout:4/142: chown d0/d11/d16/d1a/f27 504001313 1 2023-12-16T05:56:26.891 INFO:tasks.workunit.client.0.smithi155.stdout:4/143: fdatasync d0/da/ff 0 2023-12-16T05:56:26.891 INFO:tasks.workunit.client.0.smithi155.stdout:8/134: rename d4/da to d4/da/d22 22 2023-12-16T05:56:26.892 INFO:tasks.workunit.client.0.smithi155.stdout:2/143: rename d0/d7/f1d to d0/d33/f36 0 2023-12-16T05:56:26.893 INFO:tasks.workunit.client.0.smithi155.stdout:7/149: link d0/f15 d0/f35 0 2023-12-16T05:56:26.894 INFO:tasks.workunit.client.0.smithi155.stdout:6/220: mkdir d0/d14/d44 0 2023-12-16T05:56:26.896 INFO:tasks.workunit.client.0.smithi155.stdout:8/135: mkdir d4/d23 0 2023-12-16T05:56:26.896 INFO:tasks.workunit.client.0.smithi155.stdout:8/136: chown d4/da/d1b/d1c/d19 1 1 2023-12-16T05:56:26.896 INFO:tasks.workunit.client.0.smithi155.stdout:9/144: dwrite da/f1e [0,4194304] 0 2023-12-16T05:56:26.896 INFO:tasks.workunit.client.0.smithi155.stdout:9/145: chown l2 0 1 2023-12-16T05:56:26.897 INFO:tasks.workunit.client.0.smithi155.stdout:9/146: read da/d15/f16 [66782,95032] 0 2023-12-16T05:56:26.897 INFO:tasks.workunit.client.0.smithi155.stdout:9/147: dread - da/d15/f31 zero size 2023-12-16T05:56:26.897 INFO:tasks.workunit.client.0.smithi155.stdout:9/148: fsync da/d15/f1d 0 2023-12-16T05:56:26.897 INFO:tasks.workunit.client.0.smithi155.stdout:9/149: fsync da/d15/f16 0 2023-12-16T05:56:26.897 INFO:tasks.workunit.client.0.smithi155.stdout:4/144: write d0/da/ff [994139,101165] 0 2023-12-16T05:56:26.897 INFO:tasks.workunit.client.0.smithi155.stdout:7/150: mkdir d0/d1/d5/d18/d1a/d36 0 2023-12-16T05:56:26.899 INFO:tasks.workunit.client.0.smithi155.stdout:6/221: symlink d0/d14/d44/l45 0 2023-12-16T05:56:26.900 INFO:tasks.workunit.client.0.smithi155.stdout:2/144: getdents d0/d7/dd 0 2023-12-16T05:56:26.900 INFO:tasks.workunit.client.0.smithi155.stdout:2/145: chown d0/d5/f23 212281080 1 2023-12-16T05:56:26.902 INFO:tasks.workunit.client.0.smithi155.stdout:5/218: dwrite d0/d2/f1d [0,4194304] 0 2023-12-16T05:56:26.902 INFO:tasks.workunit.client.0.smithi155.stdout:3/106: dwrite d0/fe [4194304,4194304] 0 2023-12-16T05:56:26.902 INFO:tasks.workunit.client.0.smithi155.stdout:8/137: rename d4/da/d1b/d1c/d1a/d1f/c16 to d4/d23/c24 0 2023-12-16T05:56:26.904 INFO:tasks.workunit.client.0.smithi155.stdout:9/150: creat da/d15/d17/d24/d26/d2e/d32/f35 x:0 0 0 2023-12-16T05:56:26.906 INFO:tasks.workunit.client.0.smithi155.stdout:4/145: rmdir d0/d10/d22 39 2023-12-16T05:56:26.906 INFO:tasks.workunit.client.0.smithi155.stdout:4/146: chown d0/da/l2a 1647092 1 2023-12-16T05:56:26.907 INFO:tasks.workunit.client.0.smithi155.stdout:7/151: creat d0/d1/d5/d18/d1a/f37 x:0 0 0 2023-12-16T05:56:26.908 INFO:tasks.workunit.client.0.smithi155.stdout:1/130: truncate d1/d7/f18 2595125 0 2023-12-16T05:56:26.909 INFO:tasks.workunit.client.0.smithi155.stdout:7/152: dread d0/d1/d5/fd [0,4194304] 0 2023-12-16T05:56:26.909 INFO:tasks.workunit.client.0.smithi155.stdout:7/153: write d0/d1/d5/d18/d31/f32 [496786,40573] 0 2023-12-16T05:56:26.909 INFO:tasks.workunit.client.0.smithi155.stdout:1/131: dread d1/ff [0,4194304] 0 2023-12-16T05:56:26.910 INFO:tasks.workunit.client.0.smithi155.stdout:2/146: symlink d0/d7/dd/d14/l37 0 2023-12-16T05:56:26.910 INFO:tasks.workunit.client.0.smithi155.stdout:2/147: fsync d0/d5/f23 0 2023-12-16T05:56:26.912 INFO:tasks.workunit.client.0.smithi155.stdout:5/219: mknod d0/d2/d2a/c3a 0 2023-12-16T05:56:26.914 INFO:tasks.workunit.client.0.smithi155.stdout:3/107: getdents d0/d1a 0 2023-12-16T05:56:26.914 INFO:tasks.workunit.client.0.smithi155.stdout:3/108: chown d0/d1a/f22 60 1 2023-12-16T05:56:26.915 INFO:tasks.workunit.client.0.smithi155.stdout:3/109: write d0/f10 [920491,130379] 0 2023-12-16T05:56:26.916 INFO:tasks.workunit.client.0.smithi155.stdout:7/154: dread d0/d1/d5/f8 [0,4194304] 0 2023-12-16T05:56:26.916 INFO:tasks.workunit.client.0.smithi155.stdout:7/155: fdatasync d0/d1b/f2f 0 2023-12-16T05:56:26.917 INFO:tasks.workunit.client.0.smithi155.stdout:8/138: creat d4/da/f25 x:0 0 0 2023-12-16T05:56:26.917 INFO:tasks.workunit.client.0.smithi155.stdout:8/139: write d4/da/d12/f21 [790367,46320] 0 2023-12-16T05:56:26.918 INFO:tasks.workunit.client.0.smithi155.stdout:6/222: getdents d0/d14/d44 0 2023-12-16T05:56:26.921 INFO:tasks.workunit.client.0.smithi155.stdout:5/220: dread d0/f32 [0,4194304] 0 2023-12-16T05:56:26.922 INFO:tasks.workunit.client.0.smithi155.stdout:4/147: unlink d0/da/c15 0 2023-12-16T05:56:26.922 INFO:tasks.workunit.client.0.smithi155.stdout:4/148: write d0/f1d [451526,120806] 0 2023-12-16T05:56:26.923 INFO:tasks.workunit.client.0.smithi155.stdout:1/132: symlink d1/d17/l31 0 2023-12-16T05:56:26.925 INFO:tasks.workunit.client.0.smithi155.stdout:2/148: rename d0/d5/c29 to d0/d33/c38 0 2023-12-16T05:56:26.926 INFO:tasks.workunit.client.0.smithi155.stdout:5/221: read d0/d2/d2a/d19/f20 [3757477,36663] 0 2023-12-16T05:56:26.927 INFO:tasks.workunit.client.0.smithi155.stdout:7/156: dread d0/d1/fb [0,4194304] 0 2023-12-16T05:56:26.927 INFO:tasks.workunit.client.0.smithi155.stdout:3/110: creat d0/d1e/f26 x:0 0 0 2023-12-16T05:56:26.928 INFO:tasks.workunit.client.0.smithi155.stdout:3/111: truncate d0/f9 1038723 0 2023-12-16T05:56:26.928 INFO:tasks.workunit.client.0.smithi155.stdout:3/112: chown d0/f17 118 1 2023-12-16T05:56:26.928 INFO:tasks.workunit.client.0.smithi155.stdout:3/113: truncate d0/f17 117339 0 2023-12-16T05:56:26.930 INFO:tasks.workunit.client.0.smithi155.stdout:8/140: unlink d4/da/d1b/d1c/f18 0 2023-12-16T05:56:26.931 INFO:tasks.workunit.client.0.smithi155.stdout:9/151: mkdir da/d15/d17/d36 0 2023-12-16T05:56:26.931 INFO:tasks.workunit.client.0.smithi155.stdout:9/152: dread - da/d15/d17/d24/d26/d2e/d32/f35 zero size 2023-12-16T05:56:26.931 INFO:tasks.workunit.client.0.smithi155.stdout:9/153: dread da/f14 [0,4194304] 0 2023-12-16T05:56:26.932 INFO:tasks.workunit.client.0.smithi155.stdout:1/133: creat d1/d25/f32 x:0 0 0 2023-12-16T05:56:26.934 INFO:tasks.workunit.client.0.smithi155.stdout:5/222: rename d0/d2/ff to d0/d2/f3b 0 2023-12-16T05:56:26.935 INFO:tasks.workunit.client.0.smithi155.stdout:7/157: write d0/d1/d5/d18/d1a/d22/f23 [2831754,70549] 0 2023-12-16T05:56:26.935 INFO:tasks.workunit.client.0.smithi155.stdout:7/158: readlink d0/d1/d5/d18/l20 0 2023-12-16T05:56:26.936 INFO:tasks.workunit.client.0.smithi155.stdout:3/114: symlink d0/l27 0 2023-12-16T05:56:26.936 INFO:tasks.workunit.client.0.smithi155.stdout:8/141: symlink d4/da/d1b/d1c/d1a/l26 0 2023-12-16T05:56:26.936 INFO:tasks.workunit.client.0.smithi155.stdout:8/142: chown d4/da/d1b/d1c/f13 4 1 2023-12-16T05:56:26.937 INFO:tasks.workunit.client.0.smithi155.stdout:9/154: mknod da/d15/c37 0 2023-12-16T05:56:26.938 INFO:tasks.workunit.client.0.smithi155.stdout:1/134: creat d1/d25/f33 x:0 0 0 2023-12-16T05:56:26.938 INFO:tasks.workunit.client.0.smithi155.stdout:9/155: dread da/d15/f16 [0,4194304] 0 2023-12-16T05:56:26.939 INFO:tasks.workunit.client.0.smithi155.stdout:9/156: dread da/f14 [0,4194304] 0 2023-12-16T05:56:26.939 INFO:tasks.workunit.client.0.smithi155.stdout:9/157: dread - da/d15/d17/d24/d26/f2a zero size 2023-12-16T05:56:26.939 INFO:tasks.workunit.client.0.smithi155.stdout:2/149: rename d0/d7/f25 to d0/d7/dd/f39 0 2023-12-16T05:56:26.939 INFO:tasks.workunit.client.0.smithi155.stdout:5/223: truncate d0/f15 93990 0 2023-12-16T05:56:26.940 INFO:tasks.workunit.client.0.smithi155.stdout:6/223: dwrite d0/d3/f5 [0,4194304] 0 2023-12-16T05:56:26.940 INFO:tasks.workunit.client.0.smithi155.stdout:4/149: dwrite d0/d10/d22/f23 [0,4194304] 0 2023-12-16T05:56:26.941 INFO:tasks.workunit.client.0.smithi155.stdout:7/159: mkdir d0/d1/d5/d18/d1a/d38 0 2023-12-16T05:56:26.941 INFO:tasks.workunit.client.0.smithi155.stdout:7/160: truncate d0/d1/d5/d18/f1c 215505 0 2023-12-16T05:56:26.941 INFO:tasks.workunit.client.0.smithi155.stdout:6/224: write d0/d3/d2c/f2f [1709619,80762] 0 2023-12-16T05:56:26.941 INFO:tasks.workunit.client.0.smithi155.stdout:6/225: readlink d0/d14/d1b/l2d 0 2023-12-16T05:56:26.945 INFO:tasks.workunit.client.0.smithi155.stdout:1/135: unlink d1/d7/l1c 0 2023-12-16T05:56:26.945 INFO:tasks.workunit.client.0.smithi155.stdout:1/136: readlink d1/l19 0 2023-12-16T05:56:26.946 INFO:tasks.workunit.client.0.smithi155.stdout:3/115: rename d0/d1a/f22 to d0/d14/f28 0 2023-12-16T05:56:26.948 INFO:tasks.workunit.client.0.smithi155.stdout:2/150: mkdir d0/d33/d3a 0 2023-12-16T05:56:26.948 INFO:tasks.workunit.client.0.smithi155.stdout:2/151: readlink d0/d7/dd/d14/l2c 0 2023-12-16T05:56:26.949 INFO:tasks.workunit.client.0.smithi155.stdout:5/224: getdents d0/d2/d2a/d30 0 2023-12-16T05:56:26.950 INFO:tasks.workunit.client.0.smithi155.stdout:2/152: dread d0/f2 [0,4194304] 0 2023-12-16T05:56:26.951 INFO:tasks.workunit.client.0.smithi155.stdout:9/158: write da/d15/d17/f1c [3189223,45074] 0 2023-12-16T05:56:26.951 INFO:tasks.workunit.client.0.smithi155.stdout:9/159: chown da/d15/d17/d24/d26 202133 1 2023-12-16T05:56:26.951 INFO:tasks.workunit.client.0.smithi155.stdout:9/160: dread - da/d15/d17/d24/d26/d2e/d32/f35 zero size 2023-12-16T05:56:26.952 INFO:tasks.workunit.client.0.smithi155.stdout:9/161: read da/d15/d17/f1c [2714313,82371] 0 2023-12-16T05:56:26.953 INFO:tasks.workunit.client.0.smithi155.stdout:7/161: creat d0/d1b/f39 x:0 0 0 2023-12-16T05:56:26.957 INFO:tasks.workunit.client.0.smithi155.stdout:1/137: creat d1/d7/f34 x:0 0 0 2023-12-16T05:56:26.957 INFO:tasks.workunit.client.0.smithi155.stdout:1/138: truncate d1/d7/f34 600544 0 2023-12-16T05:56:26.958 INFO:tasks.workunit.client.0.smithi155.stdout:2/153: dread d0/d7/dd/f26 [0,4194304] 0 2023-12-16T05:56:26.963 INFO:tasks.workunit.client.0.smithi155.stdout:6/226: rename d0/d14/d1b/d3b to d0/d3/d2c/d42/d46 0 2023-12-16T05:56:26.965 INFO:tasks.workunit.client.0.smithi155.stdout:5/225: truncate d0/d2/f22 3366717 0 2023-12-16T05:56:26.967 INFO:tasks.workunit.client.0.smithi155.stdout:9/162: rmdir da/d15/d17/d24/d26 39 2023-12-16T05:56:26.967 INFO:tasks.workunit.client.0.smithi155.stdout:9/163: truncate da/d15/d17/d24/f28 1111246 0 2023-12-16T05:56:26.969 INFO:tasks.workunit.client.0.smithi155.stdout:7/162: truncate d0/d1/d5/f1d 791386 0 2023-12-16T05:56:26.969 INFO:tasks.workunit.client.0.smithi155.stdout:8/143: truncate d4/ff 748086 0 2023-12-16T05:56:26.970 INFO:tasks.workunit.client.0.smithi155.stdout:5/226: dread d0/d2/f5 [0,4194304] 0 2023-12-16T05:56:26.971 INFO:tasks.workunit.client.0.smithi155.stdout:1/139: creat d1/f35 x:0 0 0 2023-12-16T05:56:26.971 INFO:tasks.workunit.client.0.smithi155.stdout:1/140: fsync d1/d7/f1f 0 2023-12-16T05:56:26.972 INFO:tasks.workunit.client.0.smithi155.stdout:2/154: getdents d0/d7/d1f 0 2023-12-16T05:56:26.974 INFO:tasks.workunit.client.0.smithi155.stdout:6/227: link d0/d3/d2c/f2f d0/d3/d2c/d42/d46/f47 0 2023-12-16T05:56:26.975 INFO:tasks.workunit.client.0.smithi155.stdout:6/228: write d0/d3/f38 [21375,56068] 0 2023-12-16T05:56:26.978 INFO:tasks.workunit.client.0.smithi155.stdout:9/164: mkdir da/d15/d17/d24/d38 0 2023-12-16T05:56:26.978 INFO:tasks.workunit.client.0.smithi155.stdout:9/165: chown l5 43507814 1 2023-12-16T05:56:26.979 INFO:tasks.workunit.client.0.smithi155.stdout:5/227: dread d0/d2/f1a [0,4194304] 0 2023-12-16T05:56:26.979 INFO:tasks.workunit.client.0.smithi155.stdout:7/163: mknod d0/d1/d5/d18/d1a/d22/d27/c3a 0 2023-12-16T05:56:26.979 INFO:tasks.workunit.client.0.smithi155.stdout:7/164: stat d0/d1/d5/d18/d1a/f2d 0 2023-12-16T05:56:26.980 INFO:tasks.workunit.client.0.smithi155.stdout:8/144: creat d4/da/d1b/d1c/d19/f27 x:0 0 0 2023-12-16T05:56:26.981 INFO:tasks.workunit.client.0.smithi155.stdout:8/145: write d4/da/f25 [225898,74061] 0 2023-12-16T05:56:26.981 INFO:tasks.workunit.client.0.smithi155.stdout:8/146: write f0 [4000817,84756] 0 2023-12-16T05:56:26.981 INFO:tasks.workunit.client.0.smithi155.stdout:7/165: write d0/d1/d5/f9 [2052681,16451] 0 2023-12-16T05:56:26.985 INFO:tasks.workunit.client.0.smithi155.stdout:7/166: dread d0/f35 [0,4194304] 0 2023-12-16T05:56:26.986 INFO:tasks.workunit.client.0.smithi155.stdout:7/167: write d0/d1/d5/d18/d31/f32 [1222805,17897] 0 2023-12-16T05:56:26.996 INFO:tasks.workunit.client.0.smithi155.stdout:1/141: link d1/d7/c11 d1/d7/d16/c36 0 2023-12-16T05:56:26.996 INFO:tasks.workunit.client.0.smithi155.stdout:1/142: fsync d1/d7/d16/f1d 0 2023-12-16T05:56:26.996 INFO:tasks.workunit.client.0.smithi155.stdout:1/143: fsync d1/d7/f20 0 2023-12-16T05:56:27.000 INFO:tasks.workunit.client.0.smithi155.stdout:2/155: dwrite d0/f12 [0,4194304] 0 2023-12-16T05:56:27.003 INFO:tasks.workunit.client.0.smithi155.stdout:8/147: write d4/ff [382128,103040] 0 2023-12-16T05:56:27.005 INFO:tasks.workunit.client.0.smithi155.stdout:3/116: truncate d0/f9 581859 0 2023-12-16T05:56:27.006 INFO:tasks.workunit.client.0.smithi155.stdout:3/117: write d0/d14/f1b [1951778,80489] 0 2023-12-16T05:56:27.006 INFO:tasks.workunit.client.0.smithi155.stdout:6/229: creat d0/d3/d2c/d42/f48 x:0 0 0 2023-12-16T05:56:27.008 INFO:tasks.workunit.client.0.smithi155.stdout:9/166: unlink da/l22 0 2023-12-16T05:56:27.008 INFO:tasks.workunit.client.0.smithi155.stdout:9/167: chown da/d15/l1f 0 1 2023-12-16T05:56:27.009 INFO:tasks.workunit.client.0.smithi155.stdout:5/228: mkdir d0/d2/d2a/d3c 0 2023-12-16T05:56:27.010 INFO:tasks.workunit.client.0.smithi155.stdout:5/229: write d0/d2/d2a/f2e [3690883,37042] 0 2023-12-16T05:56:27.010 INFO:tasks.workunit.client.0.smithi155.stdout:5/230: truncate d0/d2/f1d 4264819 0 2023-12-16T05:56:27.011 INFO:tasks.workunit.client.0.smithi155.stdout:7/168: rename d0/d1/d5/c19 to d0/d1/d5/c3b 0 2023-12-16T05:56:27.012 INFO:tasks.workunit.client.0.smithi155.stdout:1/144: truncate d1/ff 533556 0 2023-12-16T05:56:27.012 INFO:tasks.workunit.client.0.smithi155.stdout:1/145: write d1/f1e [875690,98798] 0 2023-12-16T05:56:27.014 INFO:tasks.workunit.client.0.smithi155.stdout:5/231: dread d0/d2/d2a/f16 [0,4194304] 0 2023-12-16T05:56:27.014 INFO:tasks.workunit.client.0.smithi155.stdout:5/232: readlink d0/d2/d2a/l25 0 2023-12-16T05:56:27.015 INFO:tasks.workunit.client.0.smithi155.stdout:2/156: rename d0/d33 to d0/d7/d1f/d3b 0 2023-12-16T05:56:27.016 INFO:tasks.workunit.client.0.smithi155.stdout:8/148: creat d4/da/f28 x:0 0 0 2023-12-16T05:56:27.017 INFO:tasks.workunit.client.0.smithi155.stdout:3/118: mknod d0/c29 0 2023-12-16T05:56:27.018 INFO:tasks.workunit.client.0.smithi155.stdout:6/230: creat d0/d3/d2c/d42/d46/f49 x:0 0 0 2023-12-16T05:56:27.018 INFO:tasks.workunit.client.0.smithi155.stdout:9/168: creat da/d15/f39 x:0 0 0 2023-12-16T05:56:27.019 INFO:tasks.workunit.client.0.smithi155.stdout:9/169: write da/d15/d17/d24/f28 [957111,93868] 0 2023-12-16T05:56:27.020 INFO:tasks.workunit.client.0.smithi155.stdout:7/169: mkdir d0/d1/d5/d18/d1a/d22/d3c 0 2023-12-16T05:56:27.021 INFO:tasks.workunit.client.0.smithi155.stdout:1/146: mkdir d1/d25/d37 0 2023-12-16T05:56:27.021 INFO:tasks.workunit.client.0.smithi155.stdout:1/147: stat d1/d7/d16/d30 0 2023-12-16T05:56:27.022 INFO:tasks.workunit.client.0.smithi155.stdout:5/233: mknod d0/d2/d2a/d3c/c3d 0 2023-12-16T05:56:27.022 INFO:tasks.workunit.client.0.smithi155.stdout:1/148: read d1/f6 [3234939,94907] 0 2023-12-16T05:56:27.024 INFO:tasks.workunit.client.0.smithi155.stdout:9/170: dread da/d15/f1d [0,4194304] 0 2023-12-16T05:56:27.024 INFO:tasks.workunit.client.0.smithi155.stdout:9/171: fsync da/d15/d17/d24/d26/f29 0 2023-12-16T05:56:27.024 INFO:tasks.workunit.client.0.smithi155.stdout:9/172: write da/d15/d17/d24/d26/f2a [512949,112518] 0 2023-12-16T05:56:27.024 INFO:tasks.workunit.client.0.smithi155.stdout:2/157: getdents d0/d7/dd/d14 0 2023-12-16T05:56:27.027 INFO:tasks.workunit.client.0.smithi155.stdout:8/149: rename d4/d23 to d4/da/d1b/d1c/d1a/d1f/d29 0 2023-12-16T05:56:27.027 INFO:tasks.workunit.client.0.smithi155.stdout:8/150: dread - d4/da/d1b/d1c/d19/f27 zero size 2023-12-16T05:56:27.029 INFO:tasks.workunit.client.0.smithi155.stdout:6/231: creat d0/df/d43/f4a x:0 0 0 2023-12-16T05:56:27.029 INFO:tasks.workunit.client.0.smithi155.stdout:6/232: chown d0/df/d43 6768 1 2023-12-16T05:56:27.030 INFO:tasks.workunit.client.0.smithi155.stdout:7/170: truncate d0/f15 1837151 0 2023-12-16T05:56:27.031 INFO:tasks.workunit.client.0.smithi155.stdout:5/234: creat d0/d2/d2a/d19/f3e x:0 0 0 2023-12-16T05:56:27.033 INFO:tasks.workunit.client.0.smithi155.stdout:9/173: symlink da/d15/l3a 0 2023-12-16T05:56:27.033 INFO:tasks.workunit.client.0.smithi155.stdout:9/174: readlink da/d15/l1f 0 2023-12-16T05:56:27.033 INFO:tasks.workunit.client.0.smithi155.stdout:9/175: truncate da/d15/d17/d24/f28 1922586 0 2023-12-16T05:56:27.033 INFO:tasks.workunit.client.0.smithi155.stdout:2/158: mkdir d0/d34/d3c 0 2023-12-16T05:56:27.035 INFO:tasks.workunit.client.0.smithi155.stdout:3/119: truncate d0/f9 997446 0 2023-12-16T05:56:27.038 INFO:tasks.workunit.client.0.smithi155.stdout:6/233: rename d0/d14/f17 to d0/d14/d1b/f4b 0 2023-12-16T05:56:27.039 INFO:tasks.workunit.client.0.smithi155.stdout:9/176: symlink da/d15/d17/d24/d26/d2e/l3b 0 2023-12-16T05:56:27.041 INFO:tasks.workunit.client.0.smithi155.stdout:2/159: link d0/d5/f23 d0/f3d 0 2023-12-16T05:56:27.041 INFO:tasks.workunit.client.0.smithi155.stdout:1/149: dwrite d1/d7/f18 [0,4194304] 0 2023-12-16T05:56:27.041 INFO:tasks.workunit.client.0.smithi155.stdout:1/150: chown d1/l19 434534 1 2023-12-16T05:56:27.043 INFO:tasks.workunit.client.0.smithi155.stdout:3/120: creat d0/d1a/f2a x:0 0 0 2023-12-16T05:56:27.044 INFO:tasks.workunit.client.0.smithi155.stdout:9/177: write da/d15/d17/f1c [908879,81481] 0 2023-12-16T05:56:27.045 INFO:tasks.workunit.client.0.smithi155.stdout:7/171: rename d0/d1/d5/lf to d0/d1/l3d 0 2023-12-16T05:56:27.045 INFO:tasks.workunit.client.0.smithi155.stdout:8/151: dwrite f2 [0,4194304] 0 2023-12-16T05:56:27.046 INFO:tasks.workunit.client.0.smithi155.stdout:7/172: write d0/d1/d5/fd [465775,71173] 0 2023-12-16T05:56:27.046 INFO:tasks.workunit.client.0.smithi155.stdout:7/173: chown d0/d1 14968909 1 2023-12-16T05:56:27.046 INFO:tasks.workunit.client.0.smithi155.stdout:2/160: rmdir d0/d7/d1f 39 2023-12-16T05:56:27.046 INFO:tasks.workunit.client.0.smithi155.stdout:2/161: getdents d0/d7/d1f/d3b/d3a 0 2023-12-16T05:56:27.048 INFO:tasks.workunit.client.0.smithi155.stdout:1/151: rmdir d1/d25/d37 0 2023-12-16T05:56:27.048 INFO:tasks.workunit.client.0.smithi155.stdout:1/152: fsync d1/f35 0 2023-12-16T05:56:27.048 INFO:tasks.workunit.client.0.smithi155.stdout:1/153: read d1/d7/f2f [140075,112424] 0 2023-12-16T05:56:27.048 INFO:tasks.workunit.client.0.smithi155.stdout:1/154: write d1/f35 [864458,15386] 0 2023-12-16T05:56:27.049 INFO:tasks.workunit.client.0.smithi155.stdout:3/121: rmdir d0/d1e 39 2023-12-16T05:56:27.050 INFO:tasks.workunit.client.0.smithi155.stdout:3/122: stat d0/f15 0 2023-12-16T05:56:27.052 INFO:tasks.workunit.client.0.smithi155.stdout:9/178: creat da/d15/d17/d24/d26/d2e/d32/f3c x:0 0 0 2023-12-16T05:56:27.054 INFO:tasks.workunit.client.0.smithi155.stdout:6/234: dwrite d0/d3/f1e [0,4194304] 0 2023-12-16T05:56:27.055 INFO:tasks.workunit.client.0.smithi155.stdout:1/155: dread d1/f1e [0,4194304] 0 2023-12-16T05:56:27.055 INFO:tasks.workunit.client.0.smithi155.stdout:1/156: chown d1/c5 12950 1 2023-12-16T05:56:27.055 INFO:tasks.workunit.client.0.smithi155.stdout:1/157: write d1/d7/f34 [1274258,117133] 0 2023-12-16T05:56:27.056 INFO:tasks.workunit.client.0.smithi155.stdout:5/235: rename d0/d2/d2a/f16 to d0/d2/d2a/d3c/f3f 0 2023-12-16T05:56:27.060 INFO:tasks.workunit.client.0.smithi155.stdout:8/152: mkdir d4/da/d1b/d2a 0 2023-12-16T05:56:27.060 INFO:tasks.workunit.client.0.smithi155.stdout:8/153: chown d4/da/d1b/d1c/d1a/l26 3881706 1 2023-12-16T05:56:27.060 INFO:tasks.workunit.client.0.smithi155.stdout:8/154: dread - d4/da/d1b/d1c/d19/f27 zero size 2023-12-16T05:56:27.061 INFO:tasks.workunit.client.0.smithi155.stdout:7/174: mknod d0/d1b/c3e 0 2023-12-16T05:56:27.065 INFO:tasks.workunit.client.0.smithi155.stdout:9/179: symlink da/d15/d17/d24/d26/d2e/l3d 0 2023-12-16T05:56:27.065 INFO:tasks.workunit.client.0.smithi155.stdout:1/158: getdents d1/d7/d16 0 2023-12-16T05:56:27.065 INFO:tasks.workunit.client.0.smithi155.stdout:1/159: write d1/d25/f33 [474886,79450] 0 2023-12-16T05:56:27.065 INFO:tasks.workunit.client.0.smithi155.stdout:1/160: stat d1/f2a 0 2023-12-16T05:56:27.067 INFO:tasks.workunit.client.0.smithi155.stdout:2/162: rename d0/d5/d6/f2b to d0/d7/dd/f3e 0 2023-12-16T05:56:27.068 INFO:tasks.workunit.client.0.smithi155.stdout:2/163: chown d0/l3 0 1 2023-12-16T05:56:27.068 INFO:tasks.workunit.client.0.smithi155.stdout:3/123: dwrite d0/d14/f28 [0,4194304] 0 2023-12-16T05:56:27.069 INFO:tasks.workunit.client.0.smithi155.stdout:9/180: write da/d15/d17/d24/f2b [4160121,30279] 0 2023-12-16T05:56:27.075 INFO:tasks.workunit.client.0.smithi155.stdout:6/235: dwrite d0/d3/d2c/d42/d46/f47 [0,4194304] 0 2023-12-16T05:56:27.092 INFO:tasks.workunit.client.0.smithi155.stdout:3/124: dwrite d0/fb [0,4194304] 0 2023-12-16T05:56:27.093 INFO:tasks.workunit.client.0.smithi155.stdout:9/181: dwrite da/d15/d17/d24/d26/f29 [0,4194304] 0 2023-12-16T05:56:27.215 INFO:tasks.workunit.client.0.smithi155.stdout:5/236: mkdir d0/d2/d40 0 2023-12-16T05:56:27.216 INFO:tasks.workunit.client.0.smithi155.stdout:8/155: symlink d4/da/d1b/d1c/d1a/d1f/l2b 0 2023-12-16T05:56:27.217 INFO:tasks.workunit.client.0.smithi155.stdout:1/161: creat d1/d7/d16/d30/f38 x:0 0 0 2023-12-16T05:56:27.218 INFO:tasks.workunit.client.0.smithi155.stdout:1/162: dread d1/d7/f2f [0,4194304] 0 2023-12-16T05:56:27.219 INFO:tasks.workunit.client.0.smithi155.stdout:1/163: read d1/d7/f34 [1256869,69585] 0 2023-12-16T05:56:27.219 INFO:tasks.workunit.client.0.smithi155.stdout:1/164: fdatasync d1/d7/d16/d30/f38 0 2023-12-16T05:56:27.219 INFO:tasks.workunit.client.0.smithi155.stdout:1/165: dread - d1/f2a zero size 2023-12-16T05:56:27.219 INFO:tasks.workunit.client.0.smithi155.stdout:1/166: chown d1/d17/d28 3989 1 2023-12-16T05:56:27.220 INFO:tasks.workunit.client.0.smithi155.stdout:2/164: symlink d0/d7/dd/l3f 0 2023-12-16T05:56:27.220 INFO:tasks.workunit.client.0.smithi155.stdout:2/165: dread - d0/f1a zero size 2023-12-16T05:56:27.232 INFO:tasks.workunit.client.0.smithi155.stdout:6/236: rename d0/d14 to d0/d3/d2c/d3e/d4c 0 2023-12-16T05:56:27.240 INFO:tasks.workunit.client.0.smithi155.stdout:5/237: mknod d0/c41 0 2023-12-16T05:56:27.242 INFO:tasks.workunit.client.0.smithi155.stdout:8/156: rmdir d4/da/d1b/d1c/d1a/d1f 39 2023-12-16T05:56:27.243 INFO:tasks.workunit.client.0.smithi155.stdout:5/238: dread d0/d2/d2a/fe [8388608,4194304] 0 2023-12-16T05:56:27.244 INFO:tasks.workunit.client.0.smithi155.stdout:1/167: symlink d1/d25/l39 0 2023-12-16T05:56:27.246 INFO:tasks.workunit.client.0.smithi155.stdout:2/166: link d0/d5/f23 d0/d34/f40 0 2023-12-16T05:56:27.248 INFO:tasks.workunit.client.0.smithi155.stdout:3/125: rename d0/d14/f1b to d0/d1e/f2b 0 2023-12-16T05:56:27.248 INFO:tasks.workunit.client.0.smithi155.stdout:9/182: rename da/d15/d17/d24/d26/d2e to da/d15/d17/d24/d26/d2e/d32/d3e 22 2023-12-16T05:56:27.248 INFO:tasks.workunit.client.0.smithi155.stdout:9/183: fsync da/ff 0 2023-12-16T05:56:27.248 INFO:tasks.workunit.client.0.smithi155.stdout:9/184: write da/d15/d17/d24/d26/f2a [104972,105678] 0 2023-12-16T05:56:27.249 INFO:tasks.workunit.client.0.smithi155.stdout:8/157: creat d4/da/d1b/d1c/d1a/f2c x:0 0 0 2023-12-16T05:56:27.251 INFO:tasks.workunit.client.0.smithi155.stdout:1/168: creat d1/d7/d16/f3a x:0 0 0 2023-12-16T05:56:27.251 INFO:tasks.workunit.client.0.smithi155.stdout:1/169: write d1/d25/f32 [495782,125868] 0 2023-12-16T05:56:27.251 INFO:tasks.workunit.client.0.smithi155.stdout:1/170: readlink d1/lc 0 2023-12-16T05:56:27.252 INFO:tasks.workunit.client.0.smithi155.stdout:5/239: dread d0/d2/d2a/d19/f20 [0,4194304] 0 2023-12-16T05:56:27.252 INFO:tasks.workunit.client.0.smithi155.stdout:6/237: dwrite d0/d3/f1e [0,4194304] 0 2023-12-16T05:56:27.252 INFO:tasks.workunit.client.0.smithi155.stdout:6/238: stat d0/l24 0 2023-12-16T05:56:27.255 INFO:tasks.workunit.client.0.smithi155.stdout:2/167: creat d0/d7/f41 x:0 0 0 2023-12-16T05:56:27.256 INFO:tasks.workunit.client.0.smithi155.stdout:2/168: read d0/d5/d6/f10 [2249185,21568] 0 2023-12-16T05:56:27.256 INFO:tasks.workunit.client.0.smithi155.stdout:2/169: read - d0/d7/dd/d14/f2d zero size 2023-12-16T05:56:27.257 INFO:tasks.workunit.client.0.smithi155.stdout:3/126: creat d0/f2c x:0 0 0 2023-12-16T05:56:27.260 INFO:tasks.workunit.client.0.smithi155.stdout:6/239: symlink d0/df/d43/l4d 0 2023-12-16T05:56:27.260 INFO:tasks.workunit.client.0.smithi155.stdout:6/240: chown d0/d3/f6 0 1 2023-12-16T05:56:27.262 INFO:tasks.workunit.client.0.smithi155.stdout:3/127: rename d0/f6 to d0/d1a/f2d 0 2023-12-16T05:56:27.265 INFO:tasks.workunit.client.0.smithi155.stdout:0/172: sync 2023-12-16T05:56:27.265 INFO:tasks.workunit.client.0.smithi155.stdout:0/173: getdents d7/d1c/d23/d36 0 2023-12-16T05:56:27.267 INFO:tasks.workunit.client.0.smithi155.stdout:0/174: symlink d7/d1c/d23/d36/l38 0 2023-12-16T05:56:27.267 INFO:tasks.workunit.client.0.smithi155.stdout:0/175: chown d7/d30/c1e 248 1 2023-12-16T05:56:27.280 INFO:tasks.workunit.client.0.smithi155.stdout:3/128: dwrite d0/d1a/f2d [4194304,4194304] 0 2023-12-16T05:56:27.282 INFO:tasks.workunit.client.0.smithi155.stdout:6/241: dwrite d0/d3/f1e [0,4194304] 0 2023-12-16T05:56:27.291 INFO:tasks.workunit.client.0.smithi155.stdout:6/242: dread d0/d3/d2c/f2f [0,4194304] 0 2023-12-16T05:56:27.323 INFO:tasks.workunit.client.0.smithi155.stdout:0/176: write f2 [2152129,37345] 0 2023-12-16T05:56:27.323 INFO:tasks.workunit.client.0.smithi155.stdout:6/243: dread d0/d3/d2c/d3e/d4c/f15 [0,4194304] 0 2023-12-16T05:56:27.325 INFO:tasks.workunit.client.0.smithi155.stdout:0/177: creat d7/d30/f39 x:0 0 0 2023-12-16T05:56:27.325 INFO:tasks.workunit.client.0.smithi155.stdout:0/178: write d7/d13/f1b [1528247,40049] 0 2023-12-16T05:56:27.325 INFO:tasks.workunit.client.0.smithi155.stdout:0/179: dread - d7/d30/f39 zero size 2023-12-16T05:56:27.325 INFO:tasks.workunit.client.0.smithi155.stdout:0/180: dread - d7/d2d/f2f zero size 2023-12-16T05:56:27.326 INFO:tasks.workunit.client.0.smithi155.stdout:0/181: write d7/df/f31 [678633,59680] 0 2023-12-16T05:56:27.326 INFO:tasks.workunit.client.0.smithi155.stdout:1/171: dwrite d1/d7/f2f [0,4194304] 0 2023-12-16T05:56:27.326 INFO:tasks.workunit.client.0.smithi155.stdout:1/172: getdents d1/d17/d28 0 2023-12-16T05:56:27.326 INFO:tasks.workunit.client.0.smithi155.stdout:6/244: rmdir d0/d3/d2c/d42/d46 39 2023-12-16T05:56:27.327 INFO:tasks.workunit.client.0.smithi155.stdout:6/245: write d0/d3/d2c/d3e/d4c/f1d [471075,24794] 0 2023-12-16T05:56:27.328 INFO:tasks.workunit.client.0.smithi155.stdout:0/182: getdents d7/d1c/d23 0 2023-12-16T05:56:27.328 INFO:tasks.workunit.client.0.smithi155.stdout:0/183: chown d7/df/f31 1 1 2023-12-16T05:56:27.329 INFO:tasks.workunit.client.0.smithi155.stdout:0/184: write d7/fe [2545336,9354] 0 2023-12-16T05:56:27.329 INFO:tasks.workunit.client.0.smithi155.stdout:0/185: truncate d7/f2a 751490 0 2023-12-16T05:56:27.331 INFO:tasks.workunit.client.0.smithi155.stdout:1/173: getdents d1/d7 0 2023-12-16T05:56:27.332 INFO:tasks.workunit.client.0.smithi155.stdout:6/246: creat d0/d3/d2c/d3e/d4c/d44/f4e x:0 0 0 2023-12-16T05:56:27.335 INFO:tasks.workunit.client.0.smithi155.stdout:1/174: rename d1/d7/d16/c2e to d1/d25/c3b 0 2023-12-16T05:56:27.335 INFO:tasks.workunit.client.0.smithi155.stdout:3/129: dwrite d0/d1e/f26 [0,4194304] 0 2023-12-16T05:56:27.335 INFO:tasks.workunit.client.0.smithi155.stdout:5/240: dwrite d0/d2/d2a/fe [4194304,4194304] 0 2023-12-16T05:56:27.335 INFO:tasks.workunit.client.0.smithi155.stdout:5/241: chown d0/d2/f5 742 1 2023-12-16T05:56:27.336 INFO:tasks.workunit.client.0.smithi155.stdout:8/158: dwrite d4/da/f25 [0,4194304] 0 2023-12-16T05:56:27.336 INFO:tasks.workunit.client.0.smithi155.stdout:8/159: dread - d4/da/f28 zero size 2023-12-16T05:56:27.337 INFO:tasks.workunit.client.0.smithi155.stdout:0/186: symlink d7/l3a 0 2023-12-16T05:56:27.344 INFO:tasks.workunit.client.0.smithi155.stdout:6/247: rename d0/d3/d2c/d42/d46/f41 to d0/d3/d2c/f4f 0 2023-12-16T05:56:27.347 INFO:tasks.workunit.client.0.smithi155.stdout:5/242: creat d0/d2/d2a/f42 x:0 0 0 2023-12-16T05:56:27.351 INFO:tasks.workunit.client.0.smithi155.stdout:0/187: mkdir d7/d30/d3b 0 2023-12-16T05:56:27.351 INFO:tasks.workunit.client.0.smithi155.stdout:6/248: rmdir d0/d3/d2c/d3e/d4c/d1b 39 2023-12-16T05:56:27.352 INFO:tasks.workunit.client.0.smithi155.stdout:6/249: fdatasync d0/d3/f1e 0 2023-12-16T05:56:27.352 INFO:tasks.workunit.client.0.smithi155.stdout:6/250: dread - d0/d3/d2c/d3e/d4c/d44/f4e zero size 2023-12-16T05:56:27.353 INFO:tasks.workunit.client.0.smithi155.stdout:6/251: creat d0/d3/d2c/d3e/d4c/d1b/f50 x:0 0 0 2023-12-16T05:56:27.353 INFO:tasks.workunit.client.0.smithi155.stdout:0/188: dread d7/fb [0,4194304] 0 2023-12-16T05:56:27.354 INFO:tasks.workunit.client.0.smithi155.stdout:6/252: creat d0/d3/d2c/d3e/d4c/f51 x:0 0 0 2023-12-16T05:56:27.356 INFO:tasks.workunit.client.0.smithi155.stdout:6/253: rename d0/d3/l8 to d0/d3/l52 0 2023-12-16T05:56:27.360 INFO:tasks.workunit.client.0.smithi155.stdout:1/175: dwrite d1/d7/d16/f21 [0,4194304] 0 2023-12-16T05:56:27.360 INFO:tasks.workunit.client.0.smithi155.stdout:3/130: dwrite d0/d1e/f2b [0,4194304] 0 2023-12-16T05:56:27.362 INFO:tasks.workunit.client.0.smithi155.stdout:8/160: dwrite d4/da/f28 [0,4194304] 0 2023-12-16T05:56:27.363 INFO:tasks.workunit.client.0.smithi155.stdout:3/131: truncate d0/f15 3848212 0 2023-12-16T05:56:27.367 INFO:tasks.workunit.client.0.smithi155.stdout:5/243: dwrite d0/d2/d2a/fd [0,4194304] 0 2023-12-16T05:56:27.369 INFO:tasks.workunit.client.0.smithi155.stdout:3/132: creat d0/f2e x:0 0 0 2023-12-16T05:56:27.369 INFO:tasks.workunit.client.0.smithi155.stdout:5/244: read d0/d2/d2a/d19/f20 [3279431,121553] 0 2023-12-16T05:56:27.370 INFO:tasks.workunit.client.0.smithi155.stdout:5/245: rename d0/l2d to d0/d2/l43 0 2023-12-16T05:56:27.371 INFO:tasks.workunit.client.0.smithi155.stdout:6/254: rmdir d0/d3/d2c/d42 39 2023-12-16T05:56:27.372 INFO:tasks.workunit.client.0.smithi155.stdout:6/255: truncate d0/d3/d2c/d42/d46/f3f 1526270 0 2023-12-16T05:56:27.372 INFO:tasks.workunit.client.0.smithi155.stdout:6/256: stat d0/d3/d2c/f30 0 2023-12-16T05:56:27.373 INFO:tasks.workunit.client.0.smithi155.stdout:6/257: link d0/l10 d0/d3/d2c/d42/l53 0 2023-12-16T05:56:27.373 INFO:tasks.workunit.client.0.smithi155.stdout:6/258: dread - d0/d3/f39 zero size 2023-12-16T05:56:27.374 INFO:tasks.workunit.client.0.smithi155.stdout:6/259: mknod d0/df/c54 0 2023-12-16T05:56:27.374 INFO:tasks.workunit.client.0.smithi155.stdout:6/260: write d0/d3/d2c/d42/d46/f3f [613782,74603] 0 2023-12-16T05:56:27.376 INFO:tasks.workunit.client.0.smithi155.stdout:6/261: creat d0/d3/f55 x:0 0 0 2023-12-16T05:56:27.376 INFO:tasks.workunit.client.0.smithi155.stdout:6/262: chown d0/c34 405020 1 2023-12-16T05:56:27.384 INFO:tasks.workunit.client.0.smithi155.stdout:0/189: dwrite d7/fb [0,4194304] 0 2023-12-16T05:56:27.384 INFO:tasks.workunit.client.0.smithi155.stdout:0/190: fsync d7/d2d/f2f 0 2023-12-16T05:56:27.386 INFO:tasks.workunit.client.0.smithi155.stdout:1/176: dwrite d1/d7/f20 [0,4194304] 0 2023-12-16T05:56:27.387 INFO:tasks.workunit.client.0.smithi155.stdout:3/133: dread d0/d14/f28 [0,4194304] 0 2023-12-16T05:56:27.389 INFO:tasks.workunit.client.0.smithi155.stdout:3/134: mkdir d0/d1a/d2f 0 2023-12-16T05:56:27.390 INFO:tasks.workunit.client.0.smithi155.stdout:1/177: write d1/d7/d16/f21 [3022529,8700] 0 2023-12-16T05:56:27.390 INFO:tasks.workunit.client.0.smithi155.stdout:3/135: creat d0/f30 x:0 0 0 2023-12-16T05:56:27.390 INFO:tasks.workunit.client.0.smithi155.stdout:3/136: truncate d0/f2c 108534 0 2023-12-16T05:56:27.396 INFO:tasks.workunit.client.0.smithi155.stdout:1/178: mknod d1/d7/d16/c3c 0 2023-12-16T05:56:27.396 INFO:tasks.workunit.client.0.smithi155.stdout:1/179: fdatasync d1/d7/f18 0 2023-12-16T05:56:27.398 INFO:tasks.workunit.client.0.smithi155.stdout:1/180: getdents d1 0 2023-12-16T05:56:27.399 INFO:tasks.workunit.client.0.smithi155.stdout:8/161: dwrite f2 [0,4194304] 0 2023-12-16T05:56:27.399 INFO:tasks.workunit.client.0.smithi155.stdout:8/162: stat d4/da/d1b/d1c/d19/f27 0 2023-12-16T05:56:27.400 INFO:tasks.workunit.client.0.smithi155.stdout:6/263: dwrite d0/d3/d2c/f30 [4194304,4194304] 0 2023-12-16T05:56:27.405 INFO:tasks.workunit.client.0.smithi155.stdout:8/163: getdents d4/da/d1b/d1c 0 2023-12-16T05:56:27.409 INFO:tasks.workunit.client.0.smithi155.stdout:6/264: rmdir d0/d3/d2c/d3e/d4c 39 2023-12-16T05:56:27.410 INFO:tasks.workunit.client.0.smithi155.stdout:8/164: creat d4/da/d1b/d1c/d1a/f2d x:0 0 0 2023-12-16T05:56:27.411 INFO:tasks.workunit.client.0.smithi155.stdout:6/265: link d0/d3/l52 d0/d3/d2c/d3e/d4c/d1b/l56 0 2023-12-16T05:56:27.412 INFO:tasks.workunit.client.0.smithi155.stdout:8/165: rename d4/da/f28 to d4/da/d12/f2e 0 2023-12-16T05:56:27.413 INFO:tasks.workunit.client.0.smithi155.stdout:6/266: rmdir d0/d3/d2c/d3e/d4c/d44 39 2023-12-16T05:56:27.413 INFO:tasks.workunit.client.0.smithi155.stdout:6/267: rmdir d0/d3/d2c/d3e/d4c 39 2023-12-16T05:56:27.413 INFO:tasks.workunit.client.0.smithi155.stdout:6/268: truncate d0/d3/f11 2119383 0 2023-12-16T05:56:27.413 INFO:tasks.workunit.client.0.smithi155.stdout:6/269: write d0/d3/f12 [980525,107272] 0 2023-12-16T05:56:27.414 INFO:tasks.workunit.client.0.smithi155.stdout:6/270: chown d0/df/c54 718 1 2023-12-16T05:56:27.419 INFO:tasks.workunit.client.0.smithi155.stdout:5/246: dwrite d0/d2/f3b [0,4194304] 0 2023-12-16T05:56:27.419 INFO:tasks.workunit.client.0.smithi155.stdout:3/137: dwrite d0/d1e/f26 [0,4194304] 0 2023-12-16T05:56:27.419 INFO:tasks.workunit.client.0.smithi155.stdout:3/138: fdatasync d0/f2e 0 2023-12-16T05:56:27.420 INFO:tasks.workunit.client.0.smithi155.stdout:5/247: creat d0/d2/d2a/f44 x:0 0 0 2023-12-16T05:56:27.420 INFO:tasks.workunit.client.0.smithi155.stdout:1/181: dwrite d1/d7/d16/f3a [0,4194304] 0 2023-12-16T05:56:27.421 INFO:tasks.workunit.client.0.smithi155.stdout:0/191: dwrite d7/df/f1a [0,4194304] 0 2023-12-16T05:56:27.421 INFO:tasks.workunit.client.0.smithi155.stdout:5/248: write d0/d2/f1a [2487041,4199] 0 2023-12-16T05:56:27.422 INFO:tasks.workunit.client.0.smithi155.stdout:3/139: creat d0/f31 x:0 0 0 2023-12-16T05:56:27.422 INFO:tasks.workunit.client.0.smithi155.stdout:3/140: write d0/d1a/f2a [790987,13354] 0 2023-12-16T05:56:27.422 INFO:tasks.workunit.client.0.smithi155.stdout:3/141: stat d0/d1e 0 2023-12-16T05:56:27.426 INFO:tasks.workunit.client.0.smithi155.stdout:0/192: dread d7/f29 [0,4194304] 0 2023-12-16T05:56:27.429 INFO:tasks.workunit.client.0.smithi155.stdout:5/249: link d0/d2/d2a/f2e d0/d2/d2a/f45 0 2023-12-16T05:56:27.431 INFO:tasks.workunit.client.0.smithi155.stdout:3/142: rename d0/f2c to d0/d1e/f32 0 2023-12-16T05:56:27.432 INFO:tasks.workunit.client.0.smithi155.stdout:3/143: stat d0/f12 0 2023-12-16T05:56:27.432 INFO:tasks.workunit.client.0.smithi155.stdout:3/144: chown d0/c8 0 1 2023-12-16T05:56:27.432 INFO:tasks.workunit.client.0.smithi155.stdout:3/145: write d0/d1a/f1d [1018941,35782] 0 2023-12-16T05:56:27.435 INFO:tasks.workunit.client.0.smithi155.stdout:8/166: dwrite d4/da/d1b/d1c/d19/f27 [0,4194304] 0 2023-12-16T05:56:27.439 INFO:tasks.workunit.client.0.smithi155.stdout:8/167: rename d4/da/d1b/d1c/d1a/d1f/l2b to d4/da/d1b/l2f 0 2023-12-16T05:56:27.439 INFO:tasks.workunit.client.0.smithi155.stdout:8/168: chown d4/c5 2012 1 2023-12-16T05:56:27.441 INFO:tasks.workunit.client.0.smithi155.stdout:8/169: link d4/ff d4/da/d1b/f30 0 2023-12-16T05:56:27.443 INFO:tasks.workunit.client.0.smithi155.stdout:8/170: unlink d4/da/c17 0 2023-12-16T05:56:27.443 INFO:tasks.workunit.client.0.smithi155.stdout:8/171: getdents d4/da/d1b/d1c/d1a/d1f/d29 0 2023-12-16T05:56:27.444 INFO:tasks.workunit.client.0.smithi155.stdout:8/172: read d4/da/f25 [3277544,14316] 0 2023-12-16T05:56:27.444 INFO:tasks.workunit.client.0.smithi155.stdout:8/173: fdatasync d4/da/fb 0 2023-12-16T05:56:27.445 INFO:tasks.workunit.client.0.smithi155.stdout:1/182: dwrite d1/d7/d16/f1d [0,4194304] 0 2023-12-16T05:56:27.445 INFO:tasks.workunit.client.0.smithi155.stdout:1/183: chown d1/f6 3977 1 2023-12-16T05:56:27.445 INFO:tasks.workunit.client.0.smithi155.stdout:1/184: fdatasync d1/d25/f33 0 2023-12-16T05:56:27.445 INFO:tasks.workunit.client.0.smithi155.stdout:1/185: truncate d1/d25/f33 1193738 0 2023-12-16T05:56:27.445 INFO:tasks.workunit.client.0.smithi155.stdout:6/271: dwrite d0/d3/d2c/d3e/d4c/d1b/f22 [0,4194304] 0 2023-12-16T05:56:27.446 INFO:tasks.workunit.client.0.smithi155.stdout:6/272: write d0/d3/d2c/d3e/d4c/f1d [2072369,115285] 0 2023-12-16T05:56:27.446 INFO:tasks.workunit.client.0.smithi155.stdout:1/186: symlink d1/d7/l3d 0 2023-12-16T05:56:27.446 INFO:tasks.workunit.client.0.smithi155.stdout:1/187: write d1/f35 [1386327,13463] 0 2023-12-16T05:56:27.448 INFO:tasks.workunit.client.0.smithi155.stdout:6/273: mknod d0/df/c57 0 2023-12-16T05:56:27.449 INFO:tasks.workunit.client.0.smithi155.stdout:1/188: getdents d1/d7/d16 0 2023-12-16T05:56:27.450 INFO:tasks.workunit.client.0.smithi155.stdout:1/189: write d1/d7/f20 [1971185,93672] 0 2023-12-16T05:56:27.450 INFO:tasks.workunit.client.0.smithi155.stdout:1/190: fdatasync d1/d7/f2f 0 2023-12-16T05:56:27.452 INFO:tasks.workunit.client.0.smithi155.stdout:3/146: dwrite d0/d1e/f23 [0,4194304] 0 2023-12-16T05:56:27.452 INFO:tasks.workunit.client.0.smithi155.stdout:3/147: write d0/d14/f28 [4677136,84827] 0 2023-12-16T05:56:27.452 INFO:tasks.workunit.client.0.smithi155.stdout:6/274: truncate d0/d3/f1e 2305839 0 2023-12-16T05:56:27.452 INFO:tasks.workunit.client.0.smithi155.stdout:3/148: read d0/f11 [83143,34825] 0 2023-12-16T05:56:27.456 INFO:tasks.workunit.client.0.smithi155.stdout:5/250: truncate d0/d2/f3b 2343550 0 2023-12-16T05:56:27.456 INFO:tasks.workunit.client.0.smithi155.stdout:5/251: truncate d0/f15 975638 0 2023-12-16T05:56:27.457 INFO:tasks.workunit.client.0.smithi155.stdout:8/174: dread d4/da/fb [0,4194304] 0 2023-12-16T05:56:27.457 INFO:tasks.workunit.client.0.smithi155.stdout:8/175: stat d4/da/f25 0 2023-12-16T05:56:27.457 INFO:tasks.workunit.client.0.smithi155.stdout:8/176: fdatasync d4/da/d1b/f20 0 2023-12-16T05:56:27.458 INFO:tasks.workunit.client.0.smithi155.stdout:8/177: chown d4/da/f25 1 1 2023-12-16T05:56:27.461 INFO:tasks.workunit.client.0.smithi155.stdout:3/149: dread d0/d1e/f23 [0,4194304] 0 2023-12-16T05:56:27.467 INFO:tasks.workunit.client.0.smithi155.stdout:8/178: truncate f0 2165577 0 2023-12-16T05:56:27.475 INFO:tasks.workunit.client.0.smithi155.stdout:1/191: dwrite d1/d7/d16/d30/f38 [0,4194304] 0 2023-12-16T05:56:27.475 INFO:tasks.workunit.client.0.smithi155.stdout:8/179: unlink d4/da/d1b/f30 0 2023-12-16T05:56:27.478 INFO:tasks.workunit.client.0.smithi155.stdout:1/192: truncate d1/f6 304671 0 2023-12-16T05:56:27.483 INFO:tasks.workunit.client.0.smithi155.stdout:6/275: dwrite d0/d3/d2c/f2f [0,4194304] 0 2023-12-16T05:56:27.485 INFO:tasks.workunit.client.0.smithi155.stdout:6/276: rename d0/d3/d2c/d42/d46/l3c to d0/d3/d2c/d3e/d4c/l58 0 2023-12-16T05:56:27.487 INFO:tasks.workunit.client.0.smithi155.stdout:8/180: symlink d4/da/l31 0 2023-12-16T05:56:27.488 INFO:tasks.workunit.client.0.smithi155.stdout:3/150: dwrite d0/d1e/f23 [0,4194304] 0 2023-12-16T05:56:27.488 INFO:tasks.workunit.client.0.smithi155.stdout:3/151: write d0/f31 [93723,97140] 0 2023-12-16T05:56:27.489 INFO:tasks.workunit.client.0.smithi155.stdout:5/252: dwrite d0/d2/f22 [4194304,4194304] 0 2023-12-16T05:56:27.506 INFO:tasks.workunit.client.0.smithi155.stdout:6/277: dwrite d0/d3/d2c/d42/f48 [0,4194304] 0 2023-12-16T05:56:27.506 INFO:tasks.workunit.client.0.smithi155.stdout:6/278: chown d0/df 970983 1 2023-12-16T05:56:27.506 INFO:tasks.workunit.client.0.smithi155.stdout:3/152: dwrite d0/d1a/f1d [0,4194304] 0 2023-12-16T05:56:27.541 INFO:tasks.workunit.client.0.smithi155.stdout:2/170: sync 2023-12-16T05:56:27.542 INFO:tasks.workunit.client.0.smithi155.stdout:4/150: sync 2023-12-16T05:56:27.542 INFO:tasks.workunit.client.0.smithi155.stdout:9/185: sync 2023-12-16T05:56:27.542 INFO:tasks.workunit.client.0.smithi155.stdout:7/175: sync 2023-12-16T05:56:27.542 INFO:tasks.workunit.client.0.smithi155.stdout:2/171: write d0/f3d [2829373,89746] 0 2023-12-16T05:56:27.546 INFO:tasks.workunit.client.0.smithi155.stdout:5/253: symlink d0/d2/d2a/d19/l46 0 2023-12-16T05:56:27.553 INFO:tasks.workunit.client.0.smithi155.stdout:6/279: mknod d0/df/d43/c59 0 2023-12-16T05:56:27.554 INFO:tasks.workunit.client.0.smithi155.stdout:3/153: mkdir d0/d1a/d33 0 2023-12-16T05:56:27.555 INFO:tasks.workunit.client.0.smithi155.stdout:8/181: dread d4/da/d12/f2e [0,4194304] 0 2023-12-16T05:56:27.555 INFO:tasks.workunit.client.0.smithi155.stdout:8/182: chown f2 426675 1 2023-12-16T05:56:27.556 INFO:tasks.workunit.client.0.smithi155.stdout:9/186: creat da/d15/d17/d36/f3f x:0 0 0 2023-12-16T05:56:27.556 INFO:tasks.workunit.client.0.smithi155.stdout:9/187: chown da/ff 11 1 2023-12-16T05:56:27.556 INFO:tasks.workunit.client.0.smithi155.stdout:1/193: dread d1/f6 [0,4194304] 0 2023-12-16T05:56:27.558 INFO:tasks.workunit.client.0.smithi155.stdout:7/176: rename d0/d1b/c3e to d0/d1/d5/d18/d1a/d22/d27/c3f 0 2023-12-16T05:56:27.558 INFO:tasks.workunit.client.0.smithi155.stdout:4/151: dwrite d0/d11/d16/d1a/f27 [0,4194304] 0 2023-12-16T05:56:27.561 INFO:tasks.workunit.client.0.smithi155.stdout:2/172: mkdir d0/d7/d1f/d3b/d42 0 2023-12-16T05:56:27.564 INFO:tasks.workunit.client.0.smithi155.stdout:6/280: truncate d0/d3/f12 168884 0 2023-12-16T05:56:27.564 INFO:tasks.workunit.client.0.smithi155.stdout:6/281: truncate d0/d3/d2c/d42/d46/f3f 2013360 0 2023-12-16T05:56:27.566 INFO:tasks.workunit.client.0.smithi155.stdout:8/183: unlink d4/c5 0 2023-12-16T05:56:27.566 INFO:tasks.workunit.client.0.smithi155.stdout:8/184: write d4/da/d12/f21 [1845742,120016] 0 2023-12-16T05:56:27.566 INFO:tasks.workunit.client.0.smithi155.stdout:8/185: write f0 [2445560,75574] 0 2023-12-16T05:56:27.567 INFO:tasks.workunit.client.0.smithi155.stdout:1/194: mknod d1/c3e 0 2023-12-16T05:56:27.567 INFO:tasks.workunit.client.0.smithi155.stdout:1/195: chown d1/f1e 0 1 2023-12-16T05:56:27.571 INFO:tasks.workunit.client.0.smithi155.stdout:9/188: rename da/d15/d17/d24/f28 to da/d15/d17/d24/d26/d2e/f40 0 2023-12-16T05:56:27.572 INFO:tasks.workunit.client.0.smithi155.stdout:7/177: mknod d0/d1/d5/c40 0 2023-12-16T05:56:27.572 INFO:tasks.workunit.client.0.smithi155.stdout:7/178: fsync d0/d1/d5/d18/f30 0 2023-12-16T05:56:27.573 INFO:tasks.workunit.client.0.smithi155.stdout:2/173: creat d0/d34/d3c/f43 x:0 0 0 2023-12-16T05:56:27.574 INFO:tasks.workunit.client.0.smithi155.stdout:6/282: rename d0/d3/c28 to d0/d3/c5a 0 2023-12-16T05:56:27.575 INFO:tasks.workunit.client.0.smithi155.stdout:1/196: mknod d1/c3f 0 2023-12-16T05:56:27.577 INFO:tasks.workunit.client.0.smithi155.stdout:7/179: unlink d0/d1/d5/d18/d1a/d22/d27/c3f 0 2023-12-16T05:56:27.578 INFO:tasks.workunit.client.0.smithi155.stdout:2/174: symlink d0/d5/d6/df/l44 0 2023-12-16T05:56:27.579 INFO:tasks.workunit.client.0.smithi155.stdout:6/283: rmdir d0/d3/d2c/d3e/d4c 39 2023-12-16T05:56:27.580 INFO:tasks.workunit.client.0.smithi155.stdout:7/180: getdents d0/d1/d5/d18/d1a 0 2023-12-16T05:56:27.580 INFO:tasks.workunit.client.0.smithi155.stdout:7/181: read - d0/d1b/f39 zero size 2023-12-16T05:56:27.584 INFO:tasks.workunit.client.0.smithi155.stdout:7/182: dread d0/d1/fb [4194304,4194304] 0 2023-12-16T05:56:27.585 INFO:tasks.workunit.client.0.smithi155.stdout:4/152: dwrite d0/d10/f12 [0,4194304] 0 2023-12-16T05:56:27.586 INFO:tasks.workunit.client.0.smithi155.stdout:4/153: chown d0/fb 13 1 2023-12-16T05:56:27.586 INFO:tasks.workunit.client.0.smithi155.stdout:4/154: readlink d0/d11/d16/l21 0 2023-12-16T05:56:27.587 INFO:tasks.workunit.client.0.smithi155.stdout:7/183: creat d0/d1/d5/d18/d1a/d38/f41 x:0 0 0 2023-12-16T05:56:27.587 INFO:tasks.workunit.client.0.smithi155.stdout:7/184: fdatasync d0/d1/d5/d18/f28 0 2023-12-16T05:56:27.587 INFO:tasks.workunit.client.0.smithi155.stdout:7/185: chown d0/d1/l13 12839721 1 2023-12-16T05:56:27.589 INFO:tasks.workunit.client.0.smithi155.stdout:1/197: dread d1/d7/d16/f21 [0,4194304] 0 2023-12-16T05:56:27.589 INFO:tasks.workunit.client.0.smithi155.stdout:1/198: fdatasync d1/d7/f34 0 2023-12-16T05:56:27.589 INFO:tasks.workunit.client.0.smithi155.stdout:8/186: dwrite d4/da/d1b/f20 [0,4194304] 0 2023-12-16T05:56:27.589 INFO:tasks.workunit.client.0.smithi155.stdout:1/199: dread d1/ff [0,4194304] 0 2023-12-16T05:56:27.590 INFO:tasks.workunit.client.0.smithi155.stdout:1/200: write d1/d7/f34 [1017117,9769] 0 2023-12-16T05:56:27.591 INFO:tasks.workunit.client.0.smithi155.stdout:6/284: dread d0/d3/d2c/d42/f48 [0,4194304] 0 2023-12-16T05:56:27.600 INFO:tasks.workunit.client.0.smithi155.stdout:9/189: dwrite da/d15/d17/d24/d26/d2e/d32/f3c [0,4194304] 0 2023-12-16T05:56:27.601 INFO:tasks.workunit.client.0.smithi155.stdout:2/175: dwrite d0/d5/d6/f1c [0,4194304] 0 2023-12-16T05:56:27.603 INFO:tasks.workunit.client.0.smithi155.stdout:1/201: dread d1/d7/d16/f3a [0,4194304] 0 2023-12-16T05:56:27.650 INFO:tasks.workunit.client.0.smithi155.stdout:4/155: creat d0/d10/d22/f2f x:0 0 0 2023-12-16T05:56:27.653 INFO:tasks.workunit.client.0.smithi155.stdout:8/187: symlink d4/da/d1b/l32 0 2023-12-16T05:56:27.655 INFO:tasks.workunit.client.0.smithi155.stdout:6/285: getdents d0/df 0 2023-12-16T05:56:27.661 INFO:tasks.workunit.client.0.smithi155.stdout:2/176: unlink d0/d5/d6/df/c17 0 2023-12-16T05:56:27.662 INFO:tasks.workunit.client.0.smithi155.stdout:1/202: creat d1/d17/d28/f40 x:0 0 0 2023-12-16T05:56:27.663 INFO:tasks.workunit.client.0.smithi155.stdout:8/188: dread f0 [0,4194304] 0 2023-12-16T05:56:27.663 INFO:tasks.workunit.client.0.smithi155.stdout:1/203: write d1/d7/f20 [2697856,92193] 0 2023-12-16T05:56:27.664 INFO:tasks.workunit.client.0.smithi155.stdout:1/204: chown d1/d17/l1a 5 1 2023-12-16T05:56:27.666 INFO:tasks.workunit.client.0.smithi155.stdout:6/286: rmdir d0/d3/d2c/d42/d46 39 2023-12-16T05:56:27.666 INFO:tasks.workunit.client.0.smithi155.stdout:6/287: chown d0/d3/d2c/d3e/d4c/d1b/l2a 2091161 1 2023-12-16T05:56:27.666 INFO:tasks.workunit.client.0.smithi155.stdout:1/205: dread d1/f1e [0,4194304] 0 2023-12-16T05:56:27.670 INFO:tasks.workunit.client.0.smithi155.stdout:6/288: mkdir d0/d3/d2c/d42/d5b 0 2023-12-16T05:56:27.670 INFO:tasks.workunit.client.0.smithi155.stdout:6/289: fdatasync d0/d3/d2c/d42/d46/f49 0 2023-12-16T05:56:27.673 INFO:tasks.workunit.client.0.smithi155.stdout:8/189: dread d4/da/fb [0,4194304] 0 2023-12-16T05:56:27.673 INFO:tasks.workunit.client.0.smithi155.stdout:4/156: dwrite d0/d10/d22/f2f [0,4194304] 0 2023-12-16T05:56:27.675 INFO:tasks.workunit.client.0.smithi155.stdout:6/290: write d0/d3/d2c/d42/d46/f47 [7724408,6604] 0 2023-12-16T05:56:27.676 INFO:tasks.workunit.client.0.smithi155.stdout:4/157: dread d0/d11/f1c [0,4194304] 0 2023-12-16T05:56:27.676 INFO:tasks.workunit.client.0.smithi155.stdout:8/190: creat d4/da/d1b/f33 x:0 0 0 2023-12-16T05:56:27.676 INFO:tasks.workunit.client.0.smithi155.stdout:8/191: fsync d4/da/d1b/d1c/f13 0 2023-12-16T05:56:27.677 INFO:tasks.workunit.client.0.smithi155.stdout:4/158: mkdir d0/d11/d16/d30 0 2023-12-16T05:56:27.678 INFO:tasks.workunit.client.0.smithi155.stdout:8/192: symlink d4/da/d1b/d1c/d1a/d1f/d29/l34 0 2023-12-16T05:56:27.678 INFO:tasks.workunit.client.0.smithi155.stdout:4/159: write d0/f5 [3726240,61940] 0 2023-12-16T05:56:27.678 INFO:tasks.workunit.client.0.smithi155.stdout:8/193: mknod d4/da/d1b/d1c/d1a/c35 0 2023-12-16T05:56:27.681 INFO:tasks.workunit.client.0.smithi155.stdout:4/160: symlink d0/da/l31 0 2023-12-16T05:56:27.682 INFO:tasks.workunit.client.0.smithi155.stdout:4/161: dread d0/f2d [0,4194304] 0 2023-12-16T05:56:27.682 INFO:tasks.workunit.client.0.smithi155.stdout:4/162: chown d0/da/l2a 1660 1 2023-12-16T05:56:27.683 INFO:tasks.workunit.client.0.smithi155.stdout:8/194: getdents d4/da/d12 0 2023-12-16T05:56:27.683 INFO:tasks.workunit.client.0.smithi155.stdout:8/195: write d4/da/d1b/d1c/d1a/f2c [459012,87292] 0 2023-12-16T05:56:27.683 INFO:tasks.workunit.client.0.smithi155.stdout:2/177: dwrite d0/f30 [0,4194304] 0 2023-12-16T05:56:27.683 INFO:tasks.workunit.client.0.smithi155.stdout:1/206: dwrite d1/d25/f33 [0,4194304] 0 2023-12-16T05:56:27.685 INFO:tasks.workunit.client.0.smithi155.stdout:4/163: unlink d0/f2d 0 2023-12-16T05:56:27.687 INFO:tasks.workunit.client.0.smithi155.stdout:8/196: symlink d4/l36 0 2023-12-16T05:56:27.687 INFO:tasks.workunit.client.0.smithi155.stdout:8/197: chown d4/ff 14447462 1 2023-12-16T05:56:27.692 INFO:tasks.workunit.client.0.smithi155.stdout:2/178: rmdir d0/d7/d1f/d3b/d42 0 2023-12-16T05:56:27.709 INFO:tasks.workunit.client.0.smithi155.stdout:1/207: dwrite d1/d25/f33 [0,4194304] 0 2023-12-16T05:56:27.709 INFO:tasks.workunit.client.0.smithi155.stdout:4/164: dwrite d0/d11/d16/d1a/f27 [4194304,4194304] 0 2023-12-16T05:56:27.709 INFO:tasks.workunit.client.0.smithi155.stdout:8/198: dwrite d4/da/d1b/f33 [0,4194304] 0 2023-12-16T05:56:27.711 INFO:tasks.workunit.client.0.smithi155.stdout:1/208: symlink d1/d17/l41 0 2023-12-16T05:56:27.713 INFO:tasks.workunit.client.0.smithi155.stdout:4/165: creat d0/d10/d22/f32 x:0 0 0 2023-12-16T05:56:27.713 INFO:tasks.workunit.client.0.smithi155.stdout:4/166: write d0/d10/f2c [828571,86375] 0 2023-12-16T05:56:27.713 INFO:tasks.workunit.client.0.smithi155.stdout:4/167: truncate d0/f28 617198 0 2023-12-16T05:56:27.716 INFO:tasks.workunit.client.0.smithi155.stdout:8/199: mkdir d4/d37 0 2023-12-16T05:56:27.717 INFO:tasks.workunit.client.0.smithi155.stdout:8/200: chown d4/da/d1b/l2f 4010534 1 2023-12-16T05:56:27.717 INFO:tasks.workunit.client.0.smithi155.stdout:1/209: symlink d1/d17/d28/l42 0 2023-12-16T05:56:27.718 INFO:tasks.workunit.client.0.smithi155.stdout:1/210: chown d1/l23 27176 1 2023-12-16T05:56:27.719 INFO:tasks.workunit.client.0.smithi155.stdout:4/168: rename d0/d10/d22/f2f to d0/d11/d16/d30/f33 0 2023-12-16T05:56:27.721 INFO:tasks.workunit.client.0.smithi155.stdout:8/201: creat d4/da/d1b/d1c/d19/f38 x:0 0 0 2023-12-16T05:56:27.722 INFO:tasks.workunit.client.0.smithi155.stdout:1/211: mkdir d1/d25/d43 0 2023-12-16T05:56:27.722 INFO:tasks.workunit.client.0.smithi155.stdout:1/212: readlink d1/lc 0 2023-12-16T05:56:27.723 INFO:tasks.workunit.client.0.smithi155.stdout:4/169: creat d0/d10/f34 x:0 0 0 2023-12-16T05:56:27.726 INFO:tasks.workunit.client.0.smithi155.stdout:4/170: creat d0/d11/d16/d1a/f35 x:0 0 0 2023-12-16T05:56:27.726 INFO:tasks.workunit.client.0.smithi155.stdout:4/171: fsync d0/d10/d22/f23 0 2023-12-16T05:56:27.727 INFO:tasks.workunit.client.0.smithi155.stdout:4/172: mkdir d0/da/d36 0 2023-12-16T05:56:27.728 INFO:tasks.workunit.client.0.smithi155.stdout:4/173: mknod d0/d10/c37 0 2023-12-16T05:56:27.728 INFO:tasks.workunit.client.0.smithi155.stdout:1/213: getdents d1/d17/d28 0 2023-12-16T05:56:27.728 INFO:tasks.workunit.client.0.smithi155.stdout:1/214: fdatasync d1/d7/d16/f3a 0 2023-12-16T05:56:27.729 INFO:tasks.workunit.client.0.smithi155.stdout:1/215: mknod d1/d7/d16/c44 0 2023-12-16T05:56:27.736 INFO:tasks.workunit.client.0.smithi155.stdout:1/216: dread d1/d25/f33 [0,4194304] 0 2023-12-16T05:56:27.758 INFO:tasks.workunit.client.0.smithi155.stdout:1/217: dwrite d1/d25/f33 [4194304,4194304] 0 2023-12-16T05:56:27.758 INFO:tasks.workunit.client.0.smithi155.stdout:1/218: dread - d1/f2a zero size 2023-12-16T05:56:27.772 INFO:tasks.workunit.client.0.smithi155.stdout:1/219: dwrite d1/f35 [0,4194304] 0 2023-12-16T05:56:27.772 INFO:tasks.workunit.client.0.smithi155.stdout:1/220: truncate d1/d7/f20 4690299 0 2023-12-16T05:56:27.776 INFO:tasks.workunit.client.0.smithi155.stdout:0/193: sync 2023-12-16T05:56:27.778 INFO:tasks.workunit.client.0.smithi155.stdout:0/194: rename d7/df/f31 to d7/d2d/f3c 0 2023-12-16T05:56:27.779 INFO:tasks.workunit.client.0.smithi155.stdout:0/195: dread d7/f2a [0,4194304] 0 2023-12-16T05:56:27.779 INFO:tasks.workunit.client.0.smithi155.stdout:0/196: stat d7/d1c/d23/d36/l38 0 2023-12-16T05:56:27.780 INFO:tasks.workunit.client.0.smithi155.stdout:0/197: unlink d7/d30/f33 0 2023-12-16T05:56:27.780 INFO:tasks.workunit.client.0.smithi155.stdout:0/198: fsync d7/d30/f39 0 2023-12-16T05:56:27.781 INFO:tasks.workunit.client.0.smithi155.stdout:0/199: write d7/df/f19 [4163219,41196] 0 2023-12-16T05:56:27.782 INFO:tasks.workunit.client.0.smithi155.stdout:1/221: dread d1/d7/f20 [0,4194304] 0 2023-12-16T05:56:27.782 INFO:tasks.workunit.client.0.smithi155.stdout:1/222: readlink d1/d25/l29 0 2023-12-16T05:56:27.783 INFO:tasks.workunit.client.0.smithi155.stdout:1/223: write d1/f35 [272447,9474] 0 2023-12-16T05:56:27.784 INFO:tasks.workunit.client.0.smithi155.stdout:1/224: chown d1/f2a 4 1 2023-12-16T05:56:27.784 INFO:tasks.workunit.client.0.smithi155.stdout:1/225: write d1/d25/f32 [1008343,52571] 0 2023-12-16T05:56:27.785 INFO:tasks.workunit.client.0.smithi155.stdout:1/226: creat d1/d7/f45 x:0 0 0 2023-12-16T05:56:27.785 INFO:tasks.workunit.client.0.smithi155.stdout:1/227: fsync d1/d7/d16/d30/f38 0 2023-12-16T05:56:27.785 INFO:tasks.workunit.client.0.smithi155.stdout:1/228: write d1/d25/f33 [4689786,103493] 0 2023-12-16T05:56:27.786 INFO:tasks.workunit.client.0.smithi155.stdout:1/229: read d1/ff [108892,122263] 0 2023-12-16T05:56:27.795 INFO:tasks.workunit.client.0.smithi155.stdout:1/230: dread d1/f35 [0,4194304] 0 2023-12-16T05:56:27.796 INFO:tasks.workunit.client.0.smithi155.stdout:1/231: rename d1/d7/c2b to d1/c46 0 2023-12-16T05:56:27.796 INFO:tasks.workunit.client.0.smithi155.stdout:1/232: fsync d1/f6 0 2023-12-16T05:56:27.797 INFO:tasks.workunit.client.0.smithi155.stdout:1/233: rename d1/f6 to d1/d7/f47 0 2023-12-16T05:56:27.813 INFO:tasks.workunit.client.0.smithi155.stdout:1/234: dwrite d1/f35 [0,4194304] 0 2023-12-16T05:56:27.814 INFO:tasks.workunit.client.0.smithi155.stdout:1/235: mknod d1/d25/d43/c48 0 2023-12-16T05:56:27.815 INFO:tasks.workunit.client.0.smithi155.stdout:1/236: rename d1/d25/l39 to d1/d25/l49 0 2023-12-16T05:56:27.822 INFO:tasks.workunit.client.0.smithi155.stdout:1/237: truncate d1/d25/f33 1305460 0 2023-12-16T05:56:27.823 INFO:tasks.workunit.client.0.smithi155.stdout:1/238: truncate d1/d7/f1f 3297235 0 2023-12-16T05:56:27.842 INFO:tasks.workunit.client.0.smithi155.stdout:1/239: dwrite d1/d7/f20 [4194304,4194304] 0 2023-12-16T05:56:27.851 INFO:tasks.workunit.client.0.smithi155.stdout:1/240: read d1/d25/f33 [1125360,96549] 0 2023-12-16T05:56:27.851 INFO:tasks.workunit.client.0.smithi155.stdout:1/241: write d1/d25/f33 [2164598,20926] 0 2023-12-16T05:56:27.851 INFO:tasks.workunit.client.0.smithi155.stdout:1/242: chown d1/d7/cb 37 1 2023-12-16T05:56:27.852 INFO:tasks.workunit.client.0.smithi155.stdout:1/243: write d1/f1e [19854,80480] 0 2023-12-16T05:56:27.854 INFO:tasks.workunit.client.0.smithi155.stdout:1/244: rename d1/c3 to d1/d17/c4a 0 2023-12-16T05:56:27.855 INFO:tasks.workunit.client.0.smithi155.stdout:1/245: mkdir d1/d7/d4b 0 2023-12-16T05:56:27.859 INFO:tasks.workunit.client.0.smithi155.stdout:1/246: symlink d1/d7/d4b/l4c 0 2023-12-16T05:56:27.860 INFO:tasks.workunit.client.0.smithi155.stdout:1/247: creat d1/d7/d4b/f4d x:0 0 0 2023-12-16T05:56:27.861 INFO:tasks.workunit.client.0.smithi155.stdout:1/248: creat d1/d7/d4b/f4e x:0 0 0 2023-12-16T05:56:27.861 INFO:tasks.workunit.client.0.smithi155.stdout:1/249: chown d1/d7/d4b 3736 1 2023-12-16T05:56:27.865 INFO:tasks.workunit.client.0.smithi155.stdout:1/250: dread d1/d7/f20 [0,4194304] 0 2023-12-16T05:56:27.866 INFO:tasks.workunit.client.0.smithi155.stdout:1/251: truncate d1/f35 478322 0 2023-12-16T05:56:27.866 INFO:tasks.workunit.client.0.smithi155.stdout:1/252: fdatasync d1/d25/f33 0 2023-12-16T05:56:27.879 INFO:tasks.workunit.client.0.smithi155.stdout:1/253: dwrite d1/f2a [0,4194304] 0 2023-12-16T05:56:27.894 INFO:tasks.workunit.client.0.smithi155.stdout:1/254: dwrite d1/ff [0,4194304] 0 2023-12-16T05:56:27.896 INFO:tasks.workunit.client.0.smithi155.stdout:1/255: unlink d1/d17/l1a 0 2023-12-16T05:56:27.897 INFO:tasks.workunit.client.0.smithi155.stdout:1/256: rename d1/d7/d4b/f4d to d1/f4f 0 2023-12-16T05:56:27.898 INFO:tasks.workunit.client.0.smithi155.stdout:1/257: creat d1/d7/d4b/f50 x:0 0 0 2023-12-16T05:56:27.899 INFO:tasks.workunit.client.0.smithi155.stdout:1/258: truncate d1/d7/f18 2373199 0 2023-12-16T05:56:27.919 INFO:tasks.workunit.client.0.smithi155.stdout:1/259: dwrite d1/d7/f18 [0,4194304] 0 2023-12-16T05:56:27.928 INFO:tasks.workunit.client.0.smithi155.stdout:1/260: dread d1/ff [0,4194304] 0 2023-12-16T05:56:27.928 INFO:tasks.workunit.client.0.smithi155.stdout:1/261: chown d1/d7/c11 2605636 1 2023-12-16T05:56:27.929 INFO:tasks.workunit.client.0.smithi155.stdout:1/262: creat d1/f51 x:0 0 0 2023-12-16T05:56:27.949 INFO:tasks.workunit.client.0.smithi155.stdout:5/254: sync 2023-12-16T05:56:27.949 INFO:tasks.workunit.client.0.smithi155.stdout:3/154: sync 2023-12-16T05:56:27.949 INFO:tasks.workunit.client.0.smithi155.stdout:3/155: readlink d0/l27 0 2023-12-16T05:56:27.950 INFO:tasks.workunit.client.0.smithi155.stdout:5/255: rename d0/d2/d40 to d0/d2/d2a/d3c/d47 0 2023-12-16T05:56:27.951 INFO:tasks.workunit.client.0.smithi155.stdout:3/156: getdents d0/d14 0 2023-12-16T05:56:27.951 INFO:tasks.workunit.client.0.smithi155.stdout:3/157: write d0/f9 [1205349,30673] 0 2023-12-16T05:56:27.951 INFO:tasks.workunit.client.0.smithi155.stdout:3/158: read d0/f31 [186946,116339] 0 2023-12-16T05:56:27.952 INFO:tasks.workunit.client.0.smithi155.stdout:5/256: mkdir d0/d2/d2a/d19/d48 0 2023-12-16T05:56:27.952 INFO:tasks.workunit.client.0.smithi155.stdout:5/257: chown d0/d2/d2a/d30/l35 132 1 2023-12-16T05:56:27.952 INFO:tasks.workunit.client.0.smithi155.stdout:5/258: chown d0/d2/f1d 26569094 1 2023-12-16T05:56:27.952 INFO:tasks.workunit.client.0.smithi155.stdout:5/259: write d0/d2/d2a/f42 [843182,126653] 0 2023-12-16T05:56:27.953 INFO:tasks.workunit.client.0.smithi155.stdout:3/159: getdents d0/d1e 0 2023-12-16T05:56:27.953 INFO:tasks.workunit.client.0.smithi155.stdout:5/260: write d0/d2/d2a/d19/d21/f23 [2752941,11629] 0 2023-12-16T05:56:27.954 INFO:tasks.workunit.client.0.smithi155.stdout:3/160: unlink d0/d1e/f26 0 2023-12-16T05:56:27.954 INFO:tasks.workunit.client.0.smithi155.stdout:3/161: stat d0/d1a/f2d 0 2023-12-16T05:56:27.954 INFO:tasks.workunit.client.0.smithi155.stdout:5/261: mknod d0/d2/c49 0 2023-12-16T05:56:27.978 INFO:tasks.workunit.client.0.smithi155.stdout:3/162: dwrite d0/f2e [0,4194304] 0 2023-12-16T05:56:27.978 INFO:tasks.workunit.client.0.smithi155.stdout:3/163: readlink d0/l5 0 2023-12-16T05:56:27.989 INFO:tasks.workunit.client.0.smithi155.stdout:5/262: dwrite d0/d2/f3b [0,4194304] 0 2023-12-16T05:56:27.993 INFO:tasks.workunit.client.0.smithi155.stdout:3/164: dwrite d0/f12 [4194304,4194304] 0 2023-12-16T05:56:27.993 INFO:tasks.workunit.client.0.smithi155.stdout:3/165: chown d0/d1a/c21 3605 1 2023-12-16T05:56:27.994 INFO:tasks.workunit.client.0.smithi155.stdout:5/263: dread d0/d2/d2a/d19/f20 [0,4194304] 0 2023-12-16T05:56:27.994 INFO:tasks.workunit.client.0.smithi155.stdout:3/166: read d0/f10 [328878,88956] 0 2023-12-16T05:56:27.995 INFO:tasks.workunit.client.0.smithi155.stdout:3/167: read d0/fb [1404251,8132] 0 2023-12-16T05:56:28.020 INFO:tasks.workunit.client.0.smithi155.stdout:5/264: mknod d0/d2/d2a/c4a 0 2023-12-16T05:56:28.023 INFO:tasks.workunit.client.0.smithi155.stdout:3/168: dwrite d0/f12 [0,4194304] 0 2023-12-16T05:56:28.023 INFO:tasks.workunit.client.0.smithi155.stdout:3/169: write d0/f30 [650387,121171] 0 2023-12-16T05:56:28.026 INFO:tasks.workunit.client.0.smithi155.stdout:3/170: creat d0/d14/f34 x:0 0 0 2023-12-16T05:56:28.040 INFO:tasks.workunit.client.0.smithi155.stdout:5/265: dwrite d0/d2/d2a/f45 [0,4194304] 0 2023-12-16T05:56:28.042 INFO:tasks.workunit.client.0.smithi155.stdout:3/171: dwrite d0/f12 [8388608,4194304] 0 2023-12-16T05:56:28.048 INFO:tasks.workunit.client.0.smithi155.stdout:3/172: creat d0/d14/f35 x:0 0 0 2023-12-16T05:56:28.049 INFO:tasks.workunit.client.0.smithi155.stdout:5/266: dread d0/d2/f1d [0,4194304] 0 2023-12-16T05:56:28.050 INFO:tasks.workunit.client.0.smithi155.stdout:5/267: write d0/d2/d2a/f45 [1657388,62896] 0 2023-12-16T05:56:28.051 INFO:tasks.workunit.client.0.smithi155.stdout:5/268: rename d0/c33 to d0/d2/c4b 0 2023-12-16T05:56:28.052 INFO:tasks.workunit.client.0.smithi155.stdout:5/269: creat d0/d2/d2a/d19/f4c x:0 0 0 2023-12-16T05:56:28.054 INFO:tasks.workunit.client.0.smithi155.stdout:5/270: read d0/d2/d2a/d3c/f3f [220317,43696] 0 2023-12-16T05:56:28.056 INFO:tasks.workunit.client.0.smithi155.stdout:5/271: write d0/d2/d2a/fe [1251568,85581] 0 2023-12-16T05:56:28.065 INFO:tasks.workunit.client.0.smithi155.stdout:7/186: sync 2023-12-16T05:56:28.065 INFO:tasks.workunit.client.0.smithi155.stdout:9/190: sync 2023-12-16T05:56:28.066 INFO:tasks.workunit.client.0.smithi155.stdout:7/187: mkdir d0/d1/d5/d18/d1a/d22/d27/d42 0 2023-12-16T05:56:28.067 INFO:tasks.workunit.client.0.smithi155.stdout:7/188: fsync d0/d1/d5/d18/d1a/d22/f25 0 2023-12-16T05:56:28.067 INFO:tasks.workunit.client.0.smithi155.stdout:7/189: truncate d0/d1/d5/d18/d31/f32 1511379 0 2023-12-16T05:56:28.067 INFO:tasks.workunit.client.0.smithi155.stdout:9/191: creat da/d15/d17/f41 x:0 0 0 2023-12-16T05:56:28.069 INFO:tasks.workunit.client.0.smithi155.stdout:7/190: unlink d0/d1/d5/d18/d1a/f37 0 2023-12-16T05:56:28.069 INFO:tasks.workunit.client.0.smithi155.stdout:7/191: dread - d0/d1/d5/d18/f30 zero size 2023-12-16T05:56:28.069 INFO:tasks.workunit.client.0.smithi155.stdout:3/173: dwrite d0/f10 [0,4194304] 0 2023-12-16T05:56:28.070 INFO:tasks.workunit.client.0.smithi155.stdout:7/192: symlink d0/d1/d5/d18/d1a/d22/d27/l43 0 2023-12-16T05:56:28.071 INFO:tasks.workunit.client.0.smithi155.stdout:5/272: dwrite d0/d2/f3b [4194304,4194304] 0 2023-12-16T05:56:28.072 INFO:tasks.workunit.client.0.smithi155.stdout:9/192: write da/f13 [675767,8197] 0 2023-12-16T05:56:28.075 INFO:tasks.workunit.client.0.smithi155.stdout:3/174: dread d0/fe [0,4194304] 0 2023-12-16T05:56:28.075 INFO:tasks.workunit.client.0.smithi155.stdout:5/273: write d0/d2/d2a/d3c/f3f [7418646,96716] 0 2023-12-16T05:56:28.075 INFO:tasks.workunit.client.0.smithi155.stdout:3/175: read d0/f2e [1185889,12716] 0 2023-12-16T05:56:28.076 INFO:tasks.workunit.client.0.smithi155.stdout:5/274: creat d0/d2/d2a/f4d x:0 0 0 2023-12-16T05:56:28.077 INFO:tasks.workunit.client.0.smithi155.stdout:3/176: mkdir d0/d14/d36 0 2023-12-16T05:56:28.078 INFO:tasks.workunit.client.0.smithi155.stdout:3/177: getdents d0/d1a 0 2023-12-16T05:56:28.080 INFO:tasks.workunit.client.0.smithi155.stdout:3/178: truncate d0/d14/f18 2114071 0 2023-12-16T05:56:28.081 INFO:tasks.workunit.client.0.smithi155.stdout:7/193: dread d0/f12 [0,4194304] 0 2023-12-16T05:56:28.083 INFO:tasks.workunit.client.0.smithi155.stdout:7/194: creat d0/d1/f44 x:0 0 0 2023-12-16T05:56:28.084 INFO:tasks.workunit.client.0.smithi155.stdout:7/195: symlink d0/d1/d5/d18/d1a/d2b/d2c/l45 0 2023-12-16T05:56:28.084 INFO:tasks.workunit.client.0.smithi155.stdout:7/196: truncate d0/d1/d5/d18/d1a/f2d 431015 0 2023-12-16T05:56:28.085 INFO:tasks.workunit.client.0.smithi155.stdout:9/193: dread da/d15/d17/d24/d26/d2e/d32/f3c [0,4194304] 0 2023-12-16T05:56:28.087 INFO:tasks.workunit.client.0.smithi155.stdout:7/197: creat d0/d1/d5/d18/d31/f46 x:0 0 0 2023-12-16T05:56:28.087 INFO:tasks.workunit.client.0.smithi155.stdout:7/198: dread - d0/d1/f44 zero size 2023-12-16T05:56:28.087 INFO:tasks.workunit.client.0.smithi155.stdout:7/199: chown d0/d1/d5/d18/l20 414543652 1 2023-12-16T05:56:28.087 INFO:tasks.workunit.client.0.smithi155.stdout:7/200: dread - d0/d1/f44 zero size 2023-12-16T05:56:28.087 INFO:tasks.workunit.client.0.smithi155.stdout:7/201: fsync d0/d1/d5/d18/d1a/d38/f41 0 2023-12-16T05:56:28.087 INFO:tasks.workunit.client.0.smithi155.stdout:9/194: unlink da/d15/f16 0 2023-12-16T05:56:28.089 INFO:tasks.workunit.client.0.smithi155.stdout:3/179: dread d0/f30 [0,4194304] 0 2023-12-16T05:56:28.089 INFO:tasks.workunit.client.0.smithi155.stdout:7/202: getdents d0/d1/d5/d18 0 2023-12-16T05:56:28.089 INFO:tasks.workunit.client.0.smithi155.stdout:7/203: chown d0/d1/fb 3713 1 2023-12-16T05:56:28.090 INFO:tasks.workunit.client.0.smithi155.stdout:9/195: symlink da/d15/l42 0 2023-12-16T05:56:28.091 INFO:tasks.workunit.client.0.smithi155.stdout:3/180: mknod d0/d14/c37 0 2023-12-16T05:56:28.093 INFO:tasks.workunit.client.0.smithi155.stdout:7/204: mknod d0/d1/d5/d18/d1a/d22/d3c/c47 0 2023-12-16T05:56:28.093 INFO:tasks.workunit.client.0.smithi155.stdout:7/205: fdatasync d0/d1/d5/d18/d31/f46 0 2023-12-16T05:56:28.093 INFO:tasks.workunit.client.0.smithi155.stdout:7/206: rename d0/d1/d5/d18/d1a/d36 to d0/d1/d5/d18/d1a/d36/d48 22 2023-12-16T05:56:28.094 INFO:tasks.workunit.client.0.smithi155.stdout:7/207: write d0/f35 [2598636,30923] 0 2023-12-16T05:56:28.094 INFO:tasks.workunit.client.0.smithi155.stdout:7/208: write d0/d1/d5/d18/f28 [923604,78937] 0 2023-12-16T05:56:28.094 INFO:tasks.workunit.client.0.smithi155.stdout:5/275: dwrite d0/d2/d2a/f4d [0,4194304] 0 2023-12-16T05:56:28.094 INFO:tasks.workunit.client.0.smithi155.stdout:9/196: mknod da/d15/d17/d36/c43 0 2023-12-16T05:56:28.094 INFO:tasks.workunit.client.0.smithi155.stdout:9/197: dread - da/d15/f2f zero size 2023-12-16T05:56:28.094 INFO:tasks.workunit.client.0.smithi155.stdout:9/198: dread - da/d15/d17/d24/f2d zero size 2023-12-16T05:56:28.094 INFO:tasks.workunit.client.0.smithi155.stdout:9/199: stat da/d15/d17/f41 0 2023-12-16T05:56:28.095 INFO:tasks.workunit.client.0.smithi155.stdout:3/181: symlink d0/d1a/d33/l38 0 2023-12-16T05:56:28.098 INFO:tasks.workunit.client.0.smithi155.stdout:7/209: mknod d0/d1/d5/d18/d1a/d2b/c49 0 2023-12-16T05:56:28.100 INFO:tasks.workunit.client.0.smithi155.stdout:5/276: dread d0/f1c [4194304,4194304] 0 2023-12-16T05:56:28.101 INFO:tasks.workunit.client.0.smithi155.stdout:9/200: creat da/d15/d17/d24/d26/f44 x:0 0 0 2023-12-16T05:56:28.102 INFO:tasks.workunit.client.0.smithi155.stdout:0/200: sync 2023-12-16T05:56:28.103 INFO:tasks.workunit.client.0.smithi155.stdout:2/179: sync 2023-12-16T05:56:28.103 INFO:tasks.workunit.client.0.smithi155.stdout:1/263: sync 2023-12-16T05:56:28.103 INFO:tasks.workunit.client.0.smithi155.stdout:6/291: sync 2023-12-16T05:56:28.103 INFO:tasks.workunit.client.0.smithi155.stdout:4/174: sync 2023-12-16T05:56:28.103 INFO:tasks.workunit.client.0.smithi155.stdout:6/292: write d0/d3/f39 [987008,30193] 0 2023-12-16T05:56:28.103 INFO:tasks.workunit.client.0.smithi155.stdout:6/293: truncate d0/d3/f55 262415 0 2023-12-16T05:56:28.103 INFO:tasks.workunit.client.0.smithi155.stdout:8/202: sync 2023-12-16T05:56:28.103 INFO:tasks.workunit.client.0.smithi155.stdout:7/210: creat d0/d1/f4a x:0 0 0 2023-12-16T05:56:28.110 INFO:tasks.workunit.client.0.smithi155.stdout:5/277: getdents d0/d2 0 2023-12-16T05:56:28.113 INFO:tasks.workunit.client.0.smithi155.stdout:2/180: mkdir d0/d7/dd/d45 0 2023-12-16T05:56:28.114 INFO:tasks.workunit.client.0.smithi155.stdout:1/264: mknod d1/d25/c52 0 2023-12-16T05:56:28.115 INFO:tasks.workunit.client.0.smithi155.stdout:9/201: dread da/d15/d17/d24/f2b [0,4194304] 0 2023-12-16T05:56:28.116 INFO:tasks.workunit.client.0.smithi155.stdout:5/278: read d0/d2/d2a/f18 [1462775,115282] 0 2023-12-16T05:56:28.116 INFO:tasks.workunit.client.0.smithi155.stdout:0/201: symlink d7/d1c/d23/d36/l3d 0 2023-12-16T05:56:28.116 INFO:tasks.workunit.client.0.smithi155.stdout:0/202: chown d7/d30/c24 99 1 2023-12-16T05:56:28.118 INFO:tasks.workunit.client.0.smithi155.stdout:4/175: unlink d0/d11/d16/d1a/f2e 0 2023-12-16T05:56:28.119 INFO:tasks.workunit.client.0.smithi155.stdout:1/265: dread d1/d7/f20 [0,4194304] 0 2023-12-16T05:56:28.119 INFO:tasks.workunit.client.0.smithi155.stdout:6/294: link d0/d3/f6 d0/d3/d2c/d3e/d4c/f5c 0 2023-12-16T05:56:28.120 INFO:tasks.workunit.client.0.smithi155.stdout:1/266: read d1/d25/f33 [1771162,73909] 0 2023-12-16T05:56:28.120 INFO:tasks.workunit.client.0.smithi155.stdout:1/267: fsync d1/d25/f32 0 2023-12-16T05:56:28.122 INFO:tasks.workunit.client.0.smithi155.stdout:9/202: creat da/d15/f45 x:0 0 0 2023-12-16T05:56:28.122 INFO:tasks.workunit.client.0.smithi155.stdout:9/203: truncate da/f14 1009049 0 2023-12-16T05:56:28.123 INFO:tasks.workunit.client.0.smithi155.stdout:3/182: dwrite d0/d1e/f32 [0,4194304] 0 2023-12-16T05:56:28.123 INFO:tasks.workunit.client.0.smithi155.stdout:3/183: getdents d0/d1a 0 2023-12-16T05:56:28.124 INFO:tasks.workunit.client.0.smithi155.stdout:4/176: unlink d0/d10/d22/f32 0 2023-12-16T05:56:28.124 INFO:tasks.workunit.client.0.smithi155.stdout:4/177: write d0/d10/f34 [606737,13764] 0 2023-12-16T05:56:28.124 INFO:tasks.workunit.client.0.smithi155.stdout:1/268: mknod d1/d7/c53 0 2023-12-16T05:56:28.124 INFO:tasks.workunit.client.0.smithi155.stdout:1/269: chown d1/d17 1898 1 2023-12-16T05:56:28.125 INFO:tasks.workunit.client.0.smithi155.stdout:1/270: stat d1/d7/d4b/f4e 0 2023-12-16T05:56:28.125 INFO:tasks.workunit.client.0.smithi155.stdout:6/295: write d0/d3/d2c/d42/d46/f47 [2706304,114844] 0 2023-12-16T05:56:28.125 INFO:tasks.workunit.client.0.smithi155.stdout:6/296: stat d0/df/c32 0 2023-12-16T05:56:28.127 INFO:tasks.workunit.client.0.smithi155.stdout:9/204: mknod da/c46 0 2023-12-16T05:56:28.130 INFO:tasks.workunit.client.0.smithi155.stdout:3/184: mknod d0/d1a/d33/c39 0 2023-12-16T05:56:28.130 INFO:tasks.workunit.client.0.smithi155.stdout:3/185: dread - d0/d14/f34 zero size 2023-12-16T05:56:28.130 INFO:tasks.workunit.client.0.smithi155.stdout:8/203: dwrite d4/da/d12/f2e [0,4194304] 0 2023-12-16T05:56:28.130 INFO:tasks.workunit.client.0.smithi155.stdout:8/204: stat d4/da/d1b/l32 0 2023-12-16T05:56:28.130 INFO:tasks.workunit.client.0.smithi155.stdout:1/271: mknod d1/d25/d43/c54 0 2023-12-16T05:56:28.131 INFO:tasks.workunit.client.0.smithi155.stdout:2/181: dread d0/d7/f24 [0,4194304] 0 2023-12-16T05:56:28.131 INFO:tasks.workunit.client.0.smithi155.stdout:2/182: chown d0/d7/dd/d14/l2c 4604 1 2023-12-16T05:56:28.132 INFO:tasks.workunit.client.0.smithi155.stdout:9/205: truncate da/d15/d17/f1c 3786855 0 2023-12-16T05:56:28.133 INFO:tasks.workunit.client.0.smithi155.stdout:8/205: unlink d4/da/d1b/l32 0 2023-12-16T05:56:28.134 INFO:tasks.workunit.client.0.smithi155.stdout:2/183: read d0/d5/d6/f1c [3206847,39102] 0 2023-12-16T05:56:28.134 INFO:tasks.workunit.client.0.smithi155.stdout:1/272: creat d1/d7/d4b/f55 x:0 0 0 2023-12-16T05:56:28.135 INFO:tasks.workunit.client.0.smithi155.stdout:6/297: symlink d0/l5d 0 2023-12-16T05:56:28.135 INFO:tasks.workunit.client.0.smithi155.stdout:0/203: dread d7/df/f1a [0,4194304] 0 2023-12-16T05:56:28.136 INFO:tasks.workunit.client.0.smithi155.stdout:9/206: write da/f1e [1232576,6777] 0 2023-12-16T05:56:28.136 INFO:tasks.workunit.client.0.smithi155.stdout:9/207: chown da/d15/d17/d24/d26/d2e/d32 2205 1 2023-12-16T05:56:28.136 INFO:tasks.workunit.client.0.smithi155.stdout:2/184: truncate d0/d5/d6/f1c 26364 0 2023-12-16T05:56:28.136 INFO:tasks.workunit.client.0.smithi155.stdout:2/185: truncate d0/d5/d6/f10 4451476 0 2023-12-16T05:56:28.136 INFO:tasks.workunit.client.0.smithi155.stdout:2/186: stat d0/d7/d1f/d3b 0 2023-12-16T05:56:28.137 INFO:tasks.workunit.client.0.smithi155.stdout:2/187: write d0/d7/f41 [962993,91504] 0 2023-12-16T05:56:28.137 INFO:tasks.workunit.client.0.smithi155.stdout:1/273: mkdir d1/d17/d56 0 2023-12-16T05:56:28.137 INFO:tasks.workunit.client.0.smithi155.stdout:3/186: write d0/fe [6571037,63785] 0 2023-12-16T05:56:28.138 INFO:tasks.workunit.client.0.smithi155.stdout:6/298: truncate d0/d3/d2c/d3e/d4c/f1d 2497929 0 2023-12-16T05:56:28.138 INFO:tasks.workunit.client.0.smithi155.stdout:0/204: mkdir d7/d30/d3b/d3e 0 2023-12-16T05:56:28.139 INFO:tasks.workunit.client.0.smithi155.stdout:9/208: write da/ff [619122,60056] 0 2023-12-16T05:56:28.140 INFO:tasks.workunit.client.0.smithi155.stdout:8/206: unlink d4/da/c15 0 2023-12-16T05:56:28.140 INFO:tasks.workunit.client.0.smithi155.stdout:8/207: chown d4/da/fb 1141599 1 2023-12-16T05:56:28.140 INFO:tasks.workunit.client.0.smithi155.stdout:1/274: truncate d1/d7/d16/f3a 3175694 0 2023-12-16T05:56:28.141 INFO:tasks.workunit.client.0.smithi155.stdout:1/275: fdatasync d1/d7/d4b/f50 0 2023-12-16T05:56:28.141 INFO:tasks.workunit.client.0.smithi155.stdout:1/276: fsync d1/ff 0 2023-12-16T05:56:28.142 INFO:tasks.workunit.client.0.smithi155.stdout:3/187: creat d0/d1a/d33/f3a x:0 0 0 2023-12-16T05:56:28.142 INFO:tasks.workunit.client.0.smithi155.stdout:3/188: chown d0/f17 74207501 1 2023-12-16T05:56:28.142 INFO:tasks.workunit.client.0.smithi155.stdout:4/178: dwrite d0/f1d [0,4194304] 0 2023-12-16T05:56:28.142 INFO:tasks.workunit.client.0.smithi155.stdout:5/279: dwrite d0/d2/f1d [0,4194304] 0 2023-12-16T05:56:28.143 INFO:tasks.workunit.client.0.smithi155.stdout:6/299: rename d0/d3/d2c/d42 to d0/df/d5e 0 2023-12-16T05:56:28.143 INFO:tasks.workunit.client.0.smithi155.stdout:6/300: dread d0/df/f27 [0,4194304] 0 2023-12-16T05:56:28.145 INFO:tasks.workunit.client.0.smithi155.stdout:0/205: creat d7/d2d/f3f x:0 0 0 2023-12-16T05:56:28.145 INFO:tasks.workunit.client.0.smithi155.stdout:0/206: read - d7/d2d/f2f zero size 2023-12-16T05:56:28.147 INFO:tasks.workunit.client.0.smithi155.stdout:9/209: creat da/d15/d17/d24/d26/d2e/f47 x:0 0 0 2023-12-16T05:56:28.147 INFO:tasks.workunit.client.0.smithi155.stdout:9/210: truncate da/d15/f31 593369 0 2023-12-16T05:56:28.147 INFO:tasks.workunit.client.0.smithi155.stdout:9/211: fdatasync da/d15/d17/d24/d26/d2e/f40 0 2023-12-16T05:56:28.147 INFO:tasks.workunit.client.0.smithi155.stdout:9/212: write da/d15/f39 [1022696,72529] 0 2023-12-16T05:56:28.150 INFO:tasks.workunit.client.0.smithi155.stdout:8/208: unlink d4/da/d1b/d1c/d1a/d1f/d29/l34 0 2023-12-16T05:56:28.153 INFO:tasks.workunit.client.0.smithi155.stdout:4/179: symlink d0/d11/d16/l38 0 2023-12-16T05:56:28.153 INFO:tasks.workunit.client.0.smithi155.stdout:4/180: write d0/d10/f26 [1852536,94363] 0 2023-12-16T05:56:28.155 INFO:tasks.workunit.client.0.smithi155.stdout:5/280: link d0/d2/c2f d0/c4e 0 2023-12-16T05:56:28.157 INFO:tasks.workunit.client.0.smithi155.stdout:1/277: rename d1/d7/d16/l2c to d1/d17/l57 0 2023-12-16T05:56:28.158 INFO:tasks.workunit.client.0.smithi155.stdout:2/188: dwrite d0/f2 [0,4194304] 0 2023-12-16T05:56:28.158 INFO:tasks.workunit.client.0.smithi155.stdout:2/189: fsync d0/f22 0 2023-12-16T05:56:28.158 INFO:tasks.workunit.client.0.smithi155.stdout:2/190: write d0/d7/f24 [4522046,47908] 0 2023-12-16T05:56:28.159 INFO:tasks.workunit.client.0.smithi155.stdout:0/207: mknod d7/d13/c40 0 2023-12-16T05:56:28.159 INFO:tasks.workunit.client.0.smithi155.stdout:0/208: chown d7/d13/f17 15701 1 2023-12-16T05:56:28.160 INFO:tasks.workunit.client.0.smithi155.stdout:9/213: mknod da/d15/c48 0 2023-12-16T05:56:28.160 INFO:tasks.workunit.client.0.smithi155.stdout:9/214: truncate da/d15/f2f 505321 0 2023-12-16T05:56:28.163 INFO:tasks.workunit.client.0.smithi155.stdout:4/181: mknod d0/d11/d16/d1a/c39 0 2023-12-16T05:56:28.163 INFO:tasks.workunit.client.0.smithi155.stdout:4/182: fsync d0/d10/d22/f23 0 2023-12-16T05:56:28.164 INFO:tasks.workunit.client.0.smithi155.stdout:5/281: mkdir d0/d2/d4f 0 2023-12-16T05:56:28.165 INFO:tasks.workunit.client.0.smithi155.stdout:3/189: dwrite d0/fb [4194304,4194304] 0 2023-12-16T05:56:28.165 INFO:tasks.workunit.client.0.smithi155.stdout:9/215: fsync da/d15/f39 0 2023-12-16T05:56:28.165 INFO:tasks.workunit.client.0.smithi155.stdout:1/278: creat d1/d7/d16/d30/f58 x:0 0 0 2023-12-16T05:56:28.166 INFO:tasks.workunit.client.0.smithi155.stdout:6/301: symlink d0/l5f 0 2023-12-16T05:56:28.166 INFO:tasks.workunit.client.0.smithi155.stdout:6/302: write d0/d3/d2c/d3e/d4c/d1b/f22 [4997248,120853] 0 2023-12-16T05:56:28.169 INFO:tasks.workunit.client.0.smithi155.stdout:2/191: rename d0/f1 to d0/d7/d1f/d3b/f46 0 2023-12-16T05:56:28.169 INFO:tasks.workunit.client.0.smithi155.stdout:5/282: mknod d0/d2/d2a/d19/c50 0 2023-12-16T05:56:28.171 INFO:tasks.workunit.client.0.smithi155.stdout:8/209: dread d4/da/f25 [0,4194304] 0 2023-12-16T05:56:28.171 INFO:tasks.workunit.client.0.smithi155.stdout:8/210: write d4/da/d1b/d1c/d1a/f2c [884722,97287] 0 2023-12-16T05:56:28.171 INFO:tasks.workunit.client.0.smithi155.stdout:8/211: chown d4/da/d1b/d1c/d1a/d1f/d29 2405119 1 2023-12-16T05:56:28.174 INFO:tasks.workunit.client.0.smithi155.stdout:3/190: link d0/c7 d0/d14/d36/c3b 0 2023-12-16T05:56:28.176 INFO:tasks.workunit.client.0.smithi155.stdout:1/279: rmdir d1/d7/d4b 39 2023-12-16T05:56:28.177 INFO:tasks.workunit.client.0.smithi155.stdout:2/192: write d0/d5/f23 [2738553,10297] 0 2023-12-16T05:56:28.178 INFO:tasks.workunit.client.0.smithi155.stdout:2/193: fdatasync d0/f27 0 2023-12-16T05:56:28.178 INFO:tasks.workunit.client.0.smithi155.stdout:2/194: read d0/d7/d1f/d3b/f46 [2561836,93188] 0 2023-12-16T05:56:28.179 INFO:tasks.workunit.client.0.smithi155.stdout:0/209: rename d7/d1c to d7/df/d41 0 2023-12-16T05:56:28.179 INFO:tasks.workunit.client.0.smithi155.stdout:4/183: rename d0/d10 to d0/d10/d3a 22 2023-12-16T05:56:28.182 INFO:tasks.workunit.client.0.smithi155.stdout:8/212: creat d4/da/d1b/d2a/f39 x:0 0 0 2023-12-16T05:56:28.182 INFO:tasks.workunit.client.0.smithi155.stdout:6/303: dwrite d0/d3/f55 [0,4194304] 0 2023-12-16T05:56:28.182 INFO:tasks.workunit.client.0.smithi155.stdout:6/304: chown d0/d3/d2c/f30 718 1 2023-12-16T05:56:28.184 INFO:tasks.workunit.client.0.smithi155.stdout:6/305: read d0/d3/d2c/d3e/d4c/f1d [600587,76920] 0 2023-12-16T05:56:28.184 INFO:tasks.workunit.client.0.smithi155.stdout:3/191: dread d0/fb [0,4194304] 0 2023-12-16T05:56:28.184 INFO:tasks.workunit.client.0.smithi155.stdout:1/280: link d1/d25/c3b d1/d7/d16/d30/c59 0 2023-12-16T05:56:28.184 INFO:tasks.workunit.client.0.smithi155.stdout:1/281: stat d1/d25/d43 0 2023-12-16T05:56:28.184 INFO:tasks.workunit.client.0.smithi155.stdout:1/282: chown d1/d7/d16/c22 584797033 1 2023-12-16T05:56:28.184 INFO:tasks.workunit.client.0.smithi155.stdout:1/283: write d1/d25/f32 [708828,91377] 0 2023-12-16T05:56:28.186 INFO:tasks.workunit.client.0.smithi155.stdout:2/195: symlink d0/d34/d3c/l47 0 2023-12-16T05:56:28.186 INFO:tasks.workunit.client.0.smithi155.stdout:2/196: write d0/d5/d6/f1c [335313,98025] 0 2023-12-16T05:56:28.186 INFO:tasks.workunit.client.0.smithi155.stdout:2/197: read - d0/f1a zero size 2023-12-16T05:56:28.188 INFO:tasks.workunit.client.0.smithi155.stdout:9/216: rename da/d15/l42 to da/l49 0 2023-12-16T05:56:28.189 INFO:tasks.workunit.client.0.smithi155.stdout:1/284: dread d1/d7/d16/f21 [0,4194304] 0 2023-12-16T05:56:28.189 INFO:tasks.workunit.client.0.smithi155.stdout:3/192: dread d0/f31 [0,4194304] 0 2023-12-16T05:56:28.189 INFO:tasks.workunit.client.0.smithi155.stdout:0/210: symlink d7/df/d41/l42 0 2023-12-16T05:56:28.193 INFO:tasks.workunit.client.0.smithi155.stdout:4/184: creat d0/d10/f3b x:0 0 0 2023-12-16T05:56:28.194 INFO:tasks.workunit.client.0.smithi155.stdout:3/193: write d0/d1a/f1d [834194,119851] 0 2023-12-16T05:56:28.195 INFO:tasks.workunit.client.0.smithi155.stdout:3/194: fsync d0/fe 0 2023-12-16T05:56:28.198 INFO:tasks.workunit.client.0.smithi155.stdout:8/213: creat d4/da/d1b/d1c/d1a/f3a x:0 0 0 2023-12-16T05:56:28.198 INFO:tasks.workunit.client.0.smithi155.stdout:8/214: stat d4/da/d1b/d1c/d1a/f2d 0 2023-12-16T05:56:28.198 INFO:tasks.workunit.client.0.smithi155.stdout:8/215: write d4/da/d1b/d1c/d1a/f2d [749383,3863] 0 2023-12-16T05:56:28.204 INFO:tasks.workunit.client.0.smithi155.stdout:6/306: creat d0/d3/d2c/f60 x:0 0 0 2023-12-16T05:56:28.204 INFO:tasks.workunit.client.0.smithi155.stdout:5/283: rename d0/d2/c49 to d0/c51 0 2023-12-16T05:56:28.205 INFO:tasks.workunit.client.0.smithi155.stdout:5/284: truncate d0/d2/f5 5527359 0 2023-12-16T05:56:28.205 INFO:tasks.workunit.client.0.smithi155.stdout:5/285: chown d0 3656 1 2023-12-16T05:56:28.205 INFO:tasks.workunit.client.0.smithi155.stdout:5/286: stat d0/d2/d2a/d19/f4c 0 2023-12-16T05:56:28.205 INFO:tasks.workunit.client.0.smithi155.stdout:9/217: creat da/d15/d17/d24/d26/d2e/f4a x:0 0 0 2023-12-16T05:56:28.206 INFO:tasks.workunit.client.0.smithi155.stdout:4/185: link d0/d11/d16/d1a/c39 d0/d11/c3c 0 2023-12-16T05:56:28.210 INFO:tasks.workunit.client.0.smithi155.stdout:1/285: dwrite d1/d7/f18 [0,4194304] 0 2023-12-16T05:56:28.210 INFO:tasks.workunit.client.0.smithi155.stdout:1/286: fdatasync d1/d7/d4b/f55 0 2023-12-16T05:56:28.211 INFO:tasks.workunit.client.0.smithi155.stdout:1/287: write d1/d7/f34 [618767,61717] 0 2023-12-16T05:56:28.214 INFO:tasks.workunit.client.0.smithi155.stdout:3/195: unlink d0/d1a/d33/c39 0 2023-12-16T05:56:28.214 INFO:tasks.workunit.client.0.smithi155.stdout:3/196: chown d0/f9 17711 1 2023-12-16T05:56:28.216 INFO:tasks.workunit.client.0.smithi155.stdout:4/186: dread d0/d11/d16/d30/f33 [0,4194304] 0 2023-12-16T05:56:28.225 INFO:tasks.workunit.client.0.smithi155.stdout:8/216: unlink d4/da/d1b/f33 0 2023-12-16T05:56:28.225 INFO:tasks.workunit.client.0.smithi155.stdout:8/217: chown f0 60074 1 2023-12-16T05:56:28.227 INFO:tasks.workunit.client.0.smithi155.stdout:6/307: creat d0/df/d5e/f61 x:0 0 0 2023-12-16T05:56:28.228 INFO:tasks.workunit.client.0.smithi155.stdout:5/287: creat d0/d2/d2a/d3c/d47/f52 x:0 0 0 2023-12-16T05:56:28.231 INFO:tasks.workunit.client.0.smithi155.stdout:2/198: rename d0/f27 to d0/d7/d1f/f48 0 2023-12-16T05:56:28.233 INFO:tasks.workunit.client.0.smithi155.stdout:9/218: chown c7 426392 1 2023-12-16T05:56:28.233 INFO:tasks.workunit.client.0.smithi155.stdout:9/219: dread - da/d15/d17/d24/d26/f44 zero size 2023-12-16T05:56:28.233 INFO:tasks.workunit.client.0.smithi155.stdout:9/220: chown da/d15/d17/c34 37499052 1 2023-12-16T05:56:28.233 INFO:tasks.workunit.client.0.smithi155.stdout:9/221: fsync da/d15/d17/d24/f2d 0 2023-12-16T05:56:28.234 INFO:tasks.workunit.client.0.smithi155.stdout:3/197: dwrite d0/f30 [0,4194304] 0 2023-12-16T05:56:28.234 INFO:tasks.workunit.client.0.smithi155.stdout:4/187: dwrite d0/f28 [0,4194304] 0 2023-12-16T05:56:28.234 INFO:tasks.workunit.client.0.smithi155.stdout:4/188: stat d0/fb 0 2023-12-16T05:56:28.235 INFO:tasks.workunit.client.0.smithi155.stdout:6/308: read d0/fc [355285,55157] 0 2023-12-16T05:56:28.235 INFO:tasks.workunit.client.0.smithi155.stdout:6/309: chown d0/d3/d2c/d3e/d4c/f51 57994 1 2023-12-16T05:56:28.244 INFO:tasks.workunit.client.0.smithi155.stdout:8/218: dwrite d4/da/d1b/d2a/f39 [0,4194304] 0 2023-12-16T05:56:28.244 INFO:tasks.workunit.client.0.smithi155.stdout:8/219: write d4/da/d1b/d1c/d1a/f2c [1269373,32516] 0 2023-12-16T05:56:28.244 INFO:tasks.workunit.client.0.smithi155.stdout:2/199: dread d0/d5/f23 [0,4194304] 0 2023-12-16T05:56:28.245 INFO:tasks.workunit.client.0.smithi155.stdout:2/200: dread - d0/f1a zero size 2023-12-16T05:56:28.246 INFO:tasks.workunit.client.0.smithi155.stdout:3/198: dread d0/f10 [0,4194304] 0 2023-12-16T05:56:28.248 INFO:tasks.workunit.client.0.smithi155.stdout:3/199: write d0/f12 [3509307,71292] 0 2023-12-16T05:56:28.255 INFO:tasks.workunit.client.0.smithi155.stdout:6/310: dwrite d0/d3/f38 [0,4194304] 0 2023-12-16T05:56:28.255 INFO:tasks.workunit.client.0.smithi155.stdout:6/311: readlink d0/d3/d2c/d3e/d4c/d1b/l2d 0 2023-12-16T05:56:28.255 INFO:tasks.workunit.client.0.smithi155.stdout:1/288: rename d1/d7/d16/d30/f38 to d1/d7/f5a 0 2023-12-16T05:56:28.256 INFO:tasks.workunit.client.0.smithi155.stdout:9/222: link da/d15/d17/d24/f2b da/d15/d17/d24/d26/d2e/f4b 0 2023-12-16T05:56:28.262 INFO:tasks.workunit.client.0.smithi155.stdout:4/189: rmdir d0/d11/d16/d30 39 2023-12-16T05:56:28.265 INFO:tasks.workunit.client.0.smithi155.stdout:8/220: rmdir d4/d37 0 2023-12-16T05:56:28.267 INFO:tasks.workunit.client.0.smithi155.stdout:8/221: dread d4/da/d1b/d1c/f13 [0,4194304] 0 2023-12-16T05:56:28.267 INFO:tasks.workunit.client.0.smithi155.stdout:8/222: stat d4/da/d1b/d1c/d1a/f2c 0 2023-12-16T05:56:28.267 INFO:tasks.workunit.client.0.smithi155.stdout:2/201: mkdir d0/d7/dd/d49 0 2023-12-16T05:56:28.267 INFO:tasks.workunit.client.0.smithi155.stdout:2/202: truncate d0/f1a 66535 0 2023-12-16T05:56:28.271 INFO:tasks.workunit.client.0.smithi155.stdout:1/289: dwrite d1/d7/d4b/f4e [0,4194304] 0 2023-12-16T05:56:28.271 INFO:tasks.workunit.client.0.smithi155.stdout:1/290: chown d1 558 1 2023-12-16T05:56:28.271 INFO:tasks.workunit.client.0.smithi155.stdout:1/291: dread - d1/d7/d4b/f55 zero size 2023-12-16T05:56:28.271 INFO:tasks.workunit.client.0.smithi155.stdout:1/292: stat d1/d7/l3d 0 2023-12-16T05:56:28.271 INFO:tasks.workunit.client.0.smithi155.stdout:6/312: symlink d0/df/d43/l62 0 2023-12-16T05:56:28.271 INFO:tasks.workunit.client.0.smithi155.stdout:6/313: fsync d0/d3/f55 0 2023-12-16T05:56:28.273 INFO:tasks.workunit.client.0.smithi155.stdout:3/200: rename d0/f9 to d0/d1a/d2f/f3c 0 2023-12-16T05:56:28.274 INFO:tasks.workunit.client.0.smithi155.stdout:9/223: creat da/d15/d17/d24/d26/d2e/d32/f4c x:0 0 0 2023-12-16T05:56:28.275 INFO:tasks.workunit.client.0.smithi155.stdout:4/190: mkdir d0/d10/d22/d3d 0 2023-12-16T05:56:28.275 INFO:tasks.workunit.client.0.smithi155.stdout:4/191: chown d0/f4 9916 1 2023-12-16T05:56:28.278 INFO:tasks.workunit.client.0.smithi155.stdout:8/223: mknod d4/da/d1b/d1c/d19/c3b 0 2023-12-16T05:56:28.280 INFO:tasks.workunit.client.0.smithi155.stdout:1/293: dread d1/f2a [0,4194304] 0 2023-12-16T05:56:28.280 INFO:tasks.workunit.client.0.smithi155.stdout:1/294: write d1/d7/f1f [3963360,21566] 0 2023-12-16T05:56:28.281 INFO:tasks.workunit.client.0.smithi155.stdout:5/288: rmdir d0 39 2023-12-16T05:56:28.287 INFO:tasks.workunit.client.0.smithi155.stdout:6/314: creat d0/d3/d2c/d3e/d4c/f63 x:0 0 0 2023-12-16T05:56:28.289 INFO:tasks.workunit.client.0.smithi155.stdout:9/224: creat da/d15/d17/d36/f4d x:0 0 0 2023-12-16T05:56:28.291 INFO:tasks.workunit.client.0.smithi155.stdout:6/315: read d0/d3/f55 [2414603,30001] 0 2023-12-16T05:56:28.291 INFO:tasks.workunit.client.0.smithi155.stdout:6/316: fdatasync d0/f16 0 2023-12-16T05:56:28.292 INFO:tasks.workunit.client.0.smithi155.stdout:3/201: dwrite d0/fe [4194304,4194304] 0 2023-12-16T05:56:28.292 INFO:tasks.workunit.client.0.smithi155.stdout:3/202: fsync d0/f11 0 2023-12-16T05:56:28.292 INFO:tasks.workunit.client.0.smithi155.stdout:5/289: mkdir d0/d2/d2a/d30/d53 0 2023-12-16T05:56:28.293 INFO:tasks.workunit.client.0.smithi155.stdout:9/225: rename da/d15/d17/d24/d26/d2e/d32/f4c to da/d15/d17/d36/f4e 0 2023-12-16T05:56:28.294 INFO:tasks.workunit.client.0.smithi155.stdout:6/317: truncate d0/d3/d2c/d3e/d4c/f1d 1999787 0 2023-12-16T05:56:28.295 INFO:tasks.workunit.client.0.smithi155.stdout:9/226: write da/f14 [761343,88201] 0 2023-12-16T05:56:28.295 INFO:tasks.workunit.client.0.smithi155.stdout:5/290: write d0/d2/d2a/fe [9271518,32854] 0 2023-12-16T05:56:28.296 INFO:tasks.workunit.client.0.smithi155.stdout:6/318: creat d0/d3/d2c/d3e/f64 x:0 0 0 2023-12-16T05:56:28.300 INFO:tasks.workunit.client.0.smithi155.stdout:6/319: creat d0/df/d5e/d46/f65 x:0 0 0 2023-12-16T05:56:28.302 INFO:tasks.workunit.client.0.smithi155.stdout:6/320: creat d0/df/d5e/f66 x:0 0 0 2023-12-16T05:56:28.303 INFO:tasks.workunit.client.0.smithi155.stdout:8/224: dwrite d4/da/d1b/d1c/d19/f27 [0,4194304] 0 2023-12-16T05:56:28.304 INFO:tasks.workunit.client.0.smithi155.stdout:6/321: mkdir d0/d3/d67 0 2023-12-16T05:56:28.304 INFO:tasks.workunit.client.0.smithi155.stdout:5/291: dread d0/d2/f1d [0,4194304] 0 2023-12-16T05:56:28.305 INFO:tasks.workunit.client.0.smithi155.stdout:1/295: dwrite d1/d7/d16/f21 [0,4194304] 0 2023-12-16T05:56:28.306 INFO:tasks.workunit.client.0.smithi155.stdout:6/322: symlink d0/df/d5e/d46/l68 0 2023-12-16T05:56:28.306 INFO:tasks.workunit.client.0.smithi155.stdout:6/323: fdatasync d0/d3/d2c/d3e/d4c/d1b/f22 0 2023-12-16T05:56:28.308 INFO:tasks.workunit.client.0.smithi155.stdout:5/292: mknod d0/d2/d2a/d3c/d47/c54 0 2023-12-16T05:56:28.308 INFO:tasks.workunit.client.0.smithi155.stdout:5/293: dread - d0/d2/d2a/d19/d21/f36 zero size 2023-12-16T05:56:28.313 INFO:tasks.workunit.client.0.smithi155.stdout:1/296: rename d1/d7/f20 to d1/d25/d43/f5b 0 2023-12-16T05:56:28.316 INFO:tasks.workunit.client.0.smithi155.stdout:5/294: dread d0/d2/d2a/d19/d21/f23 [4194304,4194304] 0 2023-12-16T05:56:28.316 INFO:tasks.workunit.client.0.smithi155.stdout:5/295: fsync d0/d2/d2a/f45 0 2023-12-16T05:56:28.319 INFO:tasks.workunit.client.0.smithi155.stdout:1/297: stat d1/d25/l49 0 2023-12-16T05:56:28.319 INFO:tasks.workunit.client.0.smithi155.stdout:1/298: chown d1 46427882 1 2023-12-16T05:56:28.320 INFO:tasks.workunit.client.0.smithi155.stdout:6/324: dwrite d0/d3/d2c/d3e/d4c/d1b/f22 [4194304,4194304] 0 2023-12-16T05:56:28.320 INFO:tasks.workunit.client.0.smithi155.stdout:4/192: rmdir d0/d10/d22 39 2023-12-16T05:56:28.323 INFO:tasks.workunit.client.0.smithi155.stdout:5/296: unlink d0/d2/d2a/d3c/d47/f52 0 2023-12-16T05:56:28.323 INFO:tasks.workunit.client.0.smithi155.stdout:1/299: dread d1/f2a [0,4194304] 0 2023-12-16T05:56:28.324 INFO:tasks.workunit.client.0.smithi155.stdout:6/325: mknod d0/df/d5e/d5b/c69 0 2023-12-16T05:56:28.324 INFO:tasks.workunit.client.0.smithi155.stdout:6/326: write d0/df/d5e/d46/f65 [205731,48406] 0 2023-12-16T05:56:28.326 INFO:tasks.workunit.client.0.smithi155.stdout:4/193: rename d0/d11/d16/d1a/f27 to d0/da/d36/f3e 0 2023-12-16T05:56:28.327 INFO:tasks.workunit.client.0.smithi155.stdout:4/194: write d0/d10/d22/f23 [4037562,82412] 0 2023-12-16T05:56:28.327 INFO:tasks.workunit.client.0.smithi155.stdout:5/297: unlink d0/d2/d2a/c26 0 2023-12-16T05:56:28.328 INFO:tasks.workunit.client.0.smithi155.stdout:5/298: dread d0/f15 [0,4194304] 0 2023-12-16T05:56:28.331 INFO:tasks.workunit.client.0.smithi155.stdout:5/299: creat d0/d2/d4f/f55 x:0 0 0 2023-12-16T05:56:28.333 INFO:tasks.workunit.client.0.smithi155.stdout:9/227: rmdir da/d15/d17 39 2023-12-16T05:56:28.333 INFO:tasks.workunit.client.0.smithi155.stdout:5/300: write d0/d2/f1d [3140899,23470] 0 2023-12-16T05:56:28.334 INFO:tasks.workunit.client.0.smithi155.stdout:5/301: chown d0/c1f 1257442 1 2023-12-16T05:56:28.334 INFO:tasks.workunit.client.0.smithi155.stdout:5/302: dread - d0/d2/d2a/f44 zero size 2023-12-16T05:56:28.334 INFO:tasks.workunit.client.0.smithi155.stdout:5/303: mkdir d0/d2/d2a/d19/d21/d56 0 2023-12-16T05:56:28.336 INFO:tasks.workunit.client.0.smithi155.stdout:5/304: link d0/c1f d0/d2/d2a/d30/d53/c57 0 2023-12-16T05:56:28.337 INFO:tasks.workunit.client.0.smithi155.stdout:5/305: creat d0/d2/d2a/d19/d48/f58 x:0 0 0 2023-12-16T05:56:28.338 INFO:tasks.workunit.client.0.smithi155.stdout:5/306: mkdir d0/d2/d2a/d19/d59 0 2023-12-16T05:56:28.338 INFO:tasks.workunit.client.0.smithi155.stdout:5/307: chown d0/d2/d2a/d3c/c3d 2926 1 2023-12-16T05:56:28.339 INFO:tasks.workunit.client.0.smithi155.stdout:5/308: rename d0/d2/d2a/d19/d21/c27 to d0/d2/d4f/c5a 0 2023-12-16T05:56:28.340 INFO:tasks.workunit.client.0.smithi155.stdout:5/309: mknod d0/d2/d2a/d19/d48/c5b 0 2023-12-16T05:56:28.342 INFO:tasks.workunit.client.0.smithi155.stdout:5/310: link d0/d2/d2a/d19/d21/f36 d0/d2/d2a/d3c/f5c 0 2023-12-16T05:56:28.345 INFO:tasks.workunit.client.0.smithi155.stdout:4/195: getdents d0/d11/d16/d1a 0 2023-12-16T05:56:28.348 INFO:tasks.workunit.client.0.smithi155.stdout:4/196: dread d0/d10/f2c [0,4194304] 0 2023-12-16T05:56:28.348 INFO:tasks.workunit.client.0.smithi155.stdout:4/197: write d0/d11/f1c [78697,96053] 0 2023-12-16T05:56:28.415 INFO:tasks.workunit.client.0.smithi155.stdout:9/228: write da/d15/d17/d24/d26/f29 [2714311,18505] 0 2023-12-16T05:56:28.416 INFO:tasks.workunit.client.0.smithi155.stdout:9/229: symlink da/d15/d17/d36/l4f 0 2023-12-16T05:56:28.417 INFO:tasks.workunit.client.0.smithi155.stdout:4/198: dread d0/fb [0,4194304] 0 2023-12-16T05:56:28.418 INFO:tasks.workunit.client.0.smithi155.stdout:6/327: dwrite d0/d3/f1e [0,4194304] 0 2023-12-16T05:56:28.418 INFO:tasks.workunit.client.0.smithi155.stdout:1/300: dwrite d1/ff [0,4194304] 0 2023-12-16T05:56:28.419 INFO:tasks.workunit.client.0.smithi155.stdout:4/199: truncate d0/f4 3941090 0 2023-12-16T05:56:28.421 INFO:tasks.workunit.client.0.smithi155.stdout:6/328: dread d0/d3/d2c/d3e/d4c/f15 [0,4194304] 0 2023-12-16T05:56:28.421 INFO:tasks.workunit.client.0.smithi155.stdout:6/329: getdents d0/d3/d67 0 2023-12-16T05:56:28.421 INFO:tasks.workunit.client.0.smithi155.stdout:1/301: mkdir d1/d7/d4b/d5c 0 2023-12-16T05:56:28.426 INFO:tasks.workunit.client.0.smithi155.stdout:1/302: stat d1/d25/c3b 0 2023-12-16T05:56:28.427 INFO:tasks.workunit.client.0.smithi155.stdout:1/303: truncate d1/d17/d28/f40 1000841 0 2023-12-16T05:56:28.429 INFO:tasks.workunit.client.0.smithi155.stdout:1/304: mkdir d1/d25/d43/d5d 0 2023-12-16T05:56:28.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:28 smithi156 ceph-mon[121001]: pgmap v10: 65 pgs: 65 active+clean; 387 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 18 MiB/s rd, 31 MiB/s wr, 945 op/s 2023-12-16T05:56:28.430 INFO:tasks.workunit.client.0.smithi155.stdout:5/311: getdents d0/d2/d4f 0 2023-12-16T05:56:28.430 INFO:tasks.workunit.client.0.smithi155.stdout:6/330: dread d0/d3/d2c/d3e/d4c/f33 [0,4194304] 0 2023-12-16T05:56:28.430 INFO:tasks.workunit.client.0.smithi155.stdout:1/305: write d1/d7/d16/f1d [7533793,75927] 0 2023-12-16T05:56:28.431 INFO:tasks.workunit.client.0.smithi155.stdout:5/312: getdents d0/d2/d2a/d19/d21 0 2023-12-16T05:56:28.432 INFO:tasks.workunit.client.0.smithi155.stdout:6/331: creat d0/d3/d2c/d3e/d4c/d1b/f6a x:0 0 0 2023-12-16T05:56:28.432 INFO:tasks.workunit.client.0.smithi155.stdout:6/332: dread - d0/df/d5e/d46/f49 zero size 2023-12-16T05:56:28.433 INFO:tasks.workunit.client.0.smithi155.stdout:4/200: dwrite d0/d10/f34 [0,4194304] 0 2023-12-16T05:56:28.434 INFO:tasks.workunit.client.0.smithi155.stdout:1/306: mkdir d1/d25/d43/d5d/d5e 0 2023-12-16T05:56:28.436 INFO:tasks.workunit.client.0.smithi155.stdout:5/313: rename d0/d2/d2a/d3c/f3f to d0/d2/d2a/d3c/f5d 0 2023-12-16T05:56:28.436 INFO:tasks.workunit.client.0.smithi155.stdout:5/314: dread - d0/d2/d2a/d19/d48/f58 zero size 2023-12-16T05:56:28.436 INFO:tasks.workunit.client.0.smithi155.stdout:5/315: truncate d0/d2/d2a/f42 1547450 0 2023-12-16T05:56:28.437 INFO:tasks.workunit.client.0.smithi155.stdout:6/333: dread d0/d3/f11 [0,4194304] 0 2023-12-16T05:56:28.438 INFO:tasks.workunit.client.0.smithi155.stdout:4/201: mknod d0/d11/d16/d1a/c3f 0 2023-12-16T05:56:28.438 INFO:tasks.workunit.client.0.smithi155.stdout:4/202: fdatasync d0/d10/d22/f25 0 2023-12-16T05:56:28.438 INFO:tasks.workunit.client.0.smithi155.stdout:4/203: write d0/f5 [4976222,103693] 0 2023-12-16T05:56:28.439 INFO:tasks.workunit.client.0.smithi155.stdout:1/307: unlink d1/d25/l29 0 2023-12-16T05:56:28.441 INFO:tasks.workunit.client.0.smithi155.stdout:5/316: stat d0/c51 0 2023-12-16T05:56:28.442 INFO:tasks.workunit.client.0.smithi155.stdout:7/211: sync 2023-12-16T05:56:28.442 INFO:tasks.workunit.client.0.smithi155.stdout:0/211: sync 2023-12-16T05:56:28.445 INFO:tasks.workunit.client.0.smithi155.stdout:6/334: mknod d0/df/c6b 0 2023-12-16T05:56:28.445 INFO:tasks.workunit.client.0.smithi155.stdout:4/204: rmdir d0/d11/d16/d30 39 2023-12-16T05:56:28.445 INFO:tasks.workunit.client.0.smithi155.stdout:4/205: fdatasync d0/d10/d22/f23 0 2023-12-16T05:56:28.445 INFO:tasks.workunit.client.0.smithi155.stdout:4/206: chown d0/d10/d22/d3d 64789 1 2023-12-16T05:56:28.446 INFO:tasks.workunit.client.0.smithi155.stdout:7/212: dread d0/d1/d5/d18/d31/f32 [0,4194304] 0 2023-12-16T05:56:28.447 INFO:tasks.workunit.client.0.smithi155.stdout:1/308: symlink d1/d7/l5f 0 2023-12-16T05:56:28.447 INFO:tasks.workunit.client.0.smithi155.stdout:1/309: truncate d1/d7/d4b/f55 725217 0 2023-12-16T05:56:28.451 INFO:tasks.workunit.client.0.smithi155.stdout:4/207: creat d0/d11/f40 x:0 0 0 2023-12-16T05:56:28.451 INFO:tasks.workunit.client.0.smithi155.stdout:4/208: stat d0/d11/d16/l38 0 2023-12-16T05:56:28.451 INFO:tasks.workunit.client.0.smithi155.stdout:7/213: dread d0/d1/d5/f8 [0,4194304] 0 2023-12-16T05:56:28.451 INFO:tasks.workunit.client.0.smithi155.stdout:7/214: dread - d0/d1/d5/d18/f30 zero size 2023-12-16T05:56:28.459 INFO:tasks.workunit.client.0.smithi155.stdout:4/209: symlink d0/d11/l41 0 2023-12-16T05:56:28.460 INFO:tasks.workunit.client.0.smithi155.stdout:4/210: symlink d0/d10/l42 0 2023-12-16T05:56:28.460 INFO:tasks.workunit.client.0.smithi155.stdout:4/211: chown d0/da/d36/f3e 5 1 2023-12-16T05:56:28.460 INFO:tasks.workunit.client.0.smithi155.stdout:4/212: dread - d0/d11/f40 zero size 2023-12-16T05:56:28.461 INFO:tasks.workunit.client.0.smithi155.stdout:4/213: read d0/d10/f26 [210664,77523] 0 2023-12-16T05:56:28.461 INFO:tasks.workunit.client.0.smithi155.stdout:4/214: fdatasync d0/d10/f3b 0 2023-12-16T05:56:28.463 INFO:tasks.workunit.client.0.smithi155.stdout:4/215: mkdir d0/d10/d22/d3d/d43 0 2023-12-16T05:56:28.471 INFO:tasks.workunit.client.0.smithi155.stdout:5/317: dwrite d0/d2/d4f/f55 [0,4194304] 0 2023-12-16T05:56:28.471 INFO:tasks.workunit.client.0.smithi155.stdout:5/318: chown d0/c4e 2 1 2023-12-16T05:56:28.473 INFO:tasks.workunit.client.0.smithi155.stdout:5/319: link d0/d2/d2a/d30/d53/c57 d0/d2/d2a/d19/d21/d56/c5e 0 2023-12-16T05:56:28.474 INFO:tasks.workunit.client.0.smithi155.stdout:4/216: dread d0/da/ff [0,4194304] 0 2023-12-16T05:56:28.474 INFO:tasks.workunit.client.0.smithi155.stdout:4/217: fdatasync d0/d11/f40 0 2023-12-16T05:56:28.476 INFO:tasks.workunit.client.0.smithi155.stdout:6/335: dwrite d0/d3/d2c/d3e/d4c/f63 [0,4194304] 0 2023-12-16T05:56:28.476 INFO:tasks.workunit.client.0.smithi155.stdout:1/310: dwrite d1/d7/d4b/f50 [0,4194304] 0 2023-12-16T05:56:28.476 INFO:tasks.workunit.client.0.smithi155.stdout:7/215: dwrite d0/d1/fb [4194304,4194304] 0 2023-12-16T05:56:28.506 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:28 smithi155 ceph-mon[112451]: pgmap v10: 65 pgs: 65 active+clean; 387 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 18 MiB/s rd, 31 MiB/s wr, 945 op/s 2023-12-16T05:56:28.512 INFO:tasks.workunit.client.0.smithi155.stdout:5/320: rename d0/d2/d2a/d19/l46 to d0/l5f 0 2023-12-16T05:56:28.513 INFO:tasks.workunit.client.0.smithi155.stdout:4/218: mknod d0/d10/d22/c44 0 2023-12-16T05:56:28.517 INFO:tasks.workunit.client.0.smithi155.stdout:6/336: creat d0/d3/d2c/f6c x:0 0 0 2023-12-16T05:56:28.520 INFO:tasks.workunit.client.0.smithi155.stdout:7/216: mkdir d0/d1/d5/d18/d1a/d22/d27/d34/d4b 0 2023-12-16T05:56:28.522 INFO:tasks.workunit.client.0.smithi155.stdout:1/311: rename d1/d7/f47 to d1/d25/d43/f60 0 2023-12-16T05:56:28.524 INFO:tasks.workunit.client.0.smithi155.stdout:5/321: mkdir d0/d60 0 2023-12-16T05:56:28.525 INFO:tasks.workunit.client.0.smithi155.stdout:5/322: write d0/d2/d2a/f2e [1578599,52158] 0 2023-12-16T05:56:28.526 INFO:tasks.workunit.client.0.smithi155.stdout:5/323: chown d0/d2/d2a/l2c 173 1 2023-12-16T05:56:28.526 INFO:tasks.workunit.client.0.smithi155.stdout:5/324: chown d0/d2/d2a/d30/d53 6 1 2023-12-16T05:56:28.526 INFO:tasks.workunit.client.0.smithi155.stdout:5/325: chown d0/d2/d2a/d19/f4c 5 1 2023-12-16T05:56:28.530 INFO:tasks.workunit.client.0.smithi155.stdout:6/337: mkdir d0/df/d5e/d46/d6d 0 2023-12-16T05:56:28.532 INFO:tasks.workunit.client.0.smithi155.stdout:5/326: mkdir d0/d2/d2a/d3c/d47/d61 0 2023-12-16T05:56:28.532 INFO:tasks.workunit.client.0.smithi155.stdout:5/327: dread - d0/d2/d2a/d19/d48/f58 zero size 2023-12-16T05:56:28.538 INFO:tasks.workunit.client.0.smithi155.stdout:4/219: dwrite d0/d10/f12 [0,4194304] 0 2023-12-16T05:56:28.542 INFO:tasks.workunit.client.0.smithi155.stdout:6/338: dread d0/d3/d2c/d3e/d4c/f63 [0,4194304] 0 2023-12-16T05:56:28.543 INFO:tasks.workunit.client.0.smithi155.stdout:6/339: creat d0/d3/d2c/f6e x:0 0 0 2023-12-16T05:56:28.544 INFO:tasks.workunit.client.0.smithi155.stdout:6/340: mknod d0/d3/d67/c6f 0 2023-12-16T05:56:28.546 INFO:tasks.workunit.client.0.smithi155.stdout:7/217: dwrite d0/f35 [0,4194304] 0 2023-12-16T05:56:28.546 INFO:tasks.workunit.client.0.smithi155.stdout:1/312: dwrite d1/d7/f5a [0,4194304] 0 2023-12-16T05:56:28.546 INFO:tasks.workunit.client.0.smithi155.stdout:1/313: write d1/d25/f32 [2063393,13910] 0 2023-12-16T05:56:28.549 INFO:tasks.workunit.client.0.smithi155.stdout:7/218: mknod d0/d1/d5/d18/d1a/d38/c4c 0 2023-12-16T05:56:28.549 INFO:tasks.workunit.client.0.smithi155.stdout:1/314: mknod d1/d7/d16/c61 0 2023-12-16T05:56:28.550 INFO:tasks.workunit.client.0.smithi155.stdout:1/315: write d1/d17/d28/f40 [276008,89402] 0 2023-12-16T05:56:28.550 INFO:tasks.workunit.client.0.smithi155.stdout:1/316: chown d1/d7/c53 483 1 2023-12-16T05:56:28.554 INFO:tasks.workunit.client.0.smithi155.stdout:1/317: creat d1/d7/d16/d30/f62 x:0 0 0 2023-12-16T05:56:28.554 INFO:tasks.workunit.client.0.smithi155.stdout:1/318: chown d1/d7/d16/c3c 66636 1 2023-12-16T05:56:28.558 INFO:tasks.workunit.client.0.smithi155.stdout:1/319: dread d1/f2a [0,4194304] 0 2023-12-16T05:56:28.558 INFO:tasks.workunit.client.0.smithi155.stdout:1/320: fdatasync d1/f4f 0 2023-12-16T05:56:28.558 INFO:tasks.workunit.client.0.smithi155.stdout:1/321: truncate d1/f2a 1673250 0 2023-12-16T05:56:28.571 INFO:tasks.workunit.client.0.smithi155.stdout:4/220: dwrite d0/d10/d22/f25 [0,4194304] 0 2023-12-16T05:56:28.571 INFO:tasks.workunit.client.0.smithi155.stdout:4/221: stat d0/d10/d22/f25 0 2023-12-16T05:56:28.571 INFO:tasks.workunit.client.0.smithi155.stdout:4/222: readlink d0/d11/d16/l38 0 2023-12-16T05:56:28.572 INFO:tasks.workunit.client.0.smithi155.stdout:6/341: dwrite d0/d3/d2c/d3e/d4c/d1b/f4b [0,4194304] 0 2023-12-16T05:56:28.572 INFO:tasks.workunit.client.0.smithi155.stdout:1/322: dwrite d1/d7/f34 [0,4194304] 0 2023-12-16T05:56:28.572 INFO:tasks.workunit.client.0.smithi155.stdout:1/323: stat d1/d17/d28/l42 0 2023-12-16T05:56:28.574 INFO:tasks.workunit.client.0.smithi155.stdout:5/328: dwrite d0/f1c [8388608,4194304] 0 2023-12-16T05:56:28.574 INFO:tasks.workunit.client.0.smithi155.stdout:7/219: dwrite d0/d1/d5/fd [0,4194304] 0 2023-12-16T05:56:28.574 INFO:tasks.workunit.client.0.smithi155.stdout:7/220: chown d0/d1/d5/d18/d1a/d22/d27 435 1 2023-12-16T05:56:28.574 INFO:tasks.workunit.client.0.smithi155.stdout:7/221: chown d0/d1/d5 0 1 2023-12-16T05:56:28.578 INFO:tasks.workunit.client.0.smithi155.stdout:6/342: rmdir d0/d3/d2c/d3e/d4c/d44 39 2023-12-16T05:56:28.578 INFO:tasks.workunit.client.0.smithi155.stdout:6/343: chown d0/d3/f38 1472 1 2023-12-16T05:56:28.578 INFO:tasks.workunit.client.0.smithi155.stdout:6/344: readlink d0/d3/d2c/d3e/d4c/d1b/l2a 0 2023-12-16T05:56:28.578 INFO:tasks.workunit.client.0.smithi155.stdout:6/345: stat d0/df/d43/c59 0 2023-12-16T05:56:28.580 INFO:tasks.workunit.client.0.smithi155.stdout:1/324: creat d1/d7/d16/f63 x:0 0 0 2023-12-16T05:56:28.581 INFO:tasks.workunit.client.0.smithi155.stdout:5/329: mknod d0/d2/d2a/d30/c62 0 2023-12-16T05:56:28.581 INFO:tasks.workunit.client.0.smithi155.stdout:5/330: read - d0/d2/d2a/d19/d21/f36 zero size 2023-12-16T05:56:28.583 INFO:tasks.workunit.client.0.smithi155.stdout:7/222: truncate d0/d1/d5/f9 346408 0 2023-12-16T05:56:28.584 INFO:tasks.workunit.client.0.smithi155.stdout:4/223: dwrite d0/d11/d16/d1a/f35 [0,4194304] 0 2023-12-16T05:56:28.585 INFO:tasks.workunit.client.0.smithi155.stdout:6/346: unlink d0/l2 0 2023-12-16T05:56:28.585 INFO:tasks.workunit.client.0.smithi155.stdout:6/347: fsync d0/df/d43/f4a 0 2023-12-16T05:56:28.587 INFO:tasks.workunit.client.0.smithi155.stdout:1/325: mkdir d1/d25/d43/d64 0 2023-12-16T05:56:28.589 INFO:tasks.workunit.client.0.smithi155.stdout:7/223: unlink d0/f12 0 2023-12-16T05:56:28.589 INFO:tasks.workunit.client.0.smithi155.stdout:7/224: dread - d0/d1/d5/d18/d31/f46 zero size 2023-12-16T05:56:28.589 INFO:tasks.workunit.client.0.smithi155.stdout:7/225: fsync d0/d1/fb 0 2023-12-16T05:56:28.592 INFO:tasks.workunit.client.0.smithi155.stdout:1/326: creat d1/d17/f65 x:0 0 0 2023-12-16T05:56:28.592 INFO:tasks.workunit.client.0.smithi155.stdout:5/331: dread d0/d2/d2a/f18 [0,4194304] 0 2023-12-16T05:56:28.592 INFO:tasks.workunit.client.0.smithi155.stdout:1/327: write d1/ff [5107492,22243] 0 2023-12-16T05:56:28.593 INFO:tasks.workunit.client.0.smithi155.stdout:2/203: sync 2023-12-16T05:56:28.593 INFO:tasks.workunit.client.0.smithi155.stdout:5/332: write d0/d2/d2a/d19/d21/f23 [1985624,92595] 0 2023-12-16T05:56:28.595 INFO:tasks.workunit.client.0.smithi155.stdout:6/348: dread d0/d3/d2c/d3e/d4c/f63 [0,4194304] 0 2023-12-16T05:56:28.595 INFO:tasks.workunit.client.0.smithi155.stdout:5/333: read d0/d2/d2a/f4d [153427,51564] 0 2023-12-16T05:56:28.595 INFO:tasks.workunit.client.0.smithi155.stdout:7/226: creat d0/d1/d5/d18/d1a/d22/f4d x:0 0 0 2023-12-16T05:56:28.595 INFO:tasks.workunit.client.0.smithi155.stdout:5/334: write d0/f1c [1221326,57970] 0 2023-12-16T05:56:28.596 INFO:tasks.workunit.client.0.smithi155.stdout:1/328: rmdir d1/d25/d43/d64 0 2023-12-16T05:56:28.597 INFO:tasks.workunit.client.0.smithi155.stdout:2/204: creat d0/d7/d1f/f4a x:0 0 0 2023-12-16T05:56:28.598 INFO:tasks.workunit.client.0.smithi155.stdout:2/205: chown d0/f4 7991 1 2023-12-16T05:56:28.598 INFO:tasks.workunit.client.0.smithi155.stdout:7/227: mknod d0/d1/d5/d18/d1a/d2b/d2c/c4e 0 2023-12-16T05:56:28.602 INFO:tasks.workunit.client.0.smithi155.stdout:7/228: dread d0/d1/d5/d18/f28 [0,4194304] 0 2023-12-16T05:56:28.604 INFO:tasks.workunit.client.0.smithi155.stdout:1/329: rename d1/d7/d4b/f4e to d1/d25/d43/d5d/f66 0 2023-12-16T05:56:28.605 INFO:tasks.workunit.client.0.smithi155.stdout:2/206: mkdir d0/d7/dd/d49/d4b 0 2023-12-16T05:56:28.605 INFO:tasks.workunit.client.0.smithi155.stdout:4/224: dwrite d0/da/ff [0,4194304] 0 2023-12-16T05:56:28.607 INFO:tasks.workunit.client.0.smithi155.stdout:4/225: write d0/f5 [1552017,96161] 0 2023-12-16T05:56:28.608 INFO:tasks.workunit.client.0.smithi155.stdout:4/226: write d0/f28 [517006,48040] 0 2023-12-16T05:56:28.608 INFO:tasks.workunit.client.0.smithi155.stdout:4/227: fsync d0/d11/f40 0 2023-12-16T05:56:28.608 INFO:tasks.workunit.client.0.smithi155.stdout:4/228: write d0/d10/f2c [1789488,24020] 0 2023-12-16T05:56:28.608 INFO:tasks.workunit.client.0.smithi155.stdout:4/229: fsync d0/d11/f1c 0 2023-12-16T05:56:28.609 INFO:tasks.workunit.client.0.smithi155.stdout:6/349: dread d0/d3/f38 [0,4194304] 0 2023-12-16T05:56:28.614 INFO:tasks.workunit.client.0.smithi155.stdout:7/229: mkdir d0/d1/d5/d18/d1a/d38/d4f 0 2023-12-16T05:56:28.614 INFO:tasks.workunit.client.0.smithi155.stdout:7/230: getdents d0/d1/d5/d18/d1a/d22/d27/d34/d4b 0 2023-12-16T05:56:28.614 INFO:tasks.workunit.client.0.smithi155.stdout:7/231: chown d0/d1/d5/d18/d1a/f2d 5009737 1 2023-12-16T05:56:28.614 INFO:tasks.workunit.client.0.smithi155.stdout:1/330: truncate d1/d7/d16/f1d 2981283 0 2023-12-16T05:56:28.616 INFO:tasks.workunit.client.0.smithi155.stdout:5/335: dwrite d0/d2/d2a/f4d [0,4194304] 0 2023-12-16T05:56:28.617 INFO:tasks.workunit.client.0.smithi155.stdout:2/207: link d0/d5/c2a d0/d34/d3c/c4c 0 2023-12-16T05:56:28.620 INFO:tasks.workunit.client.0.smithi155.stdout:4/230: link d0/d10/f2c d0/d10/d22/f45 0 2023-12-16T05:56:28.627 INFO:tasks.workunit.client.0.smithi155.stdout:1/331: symlink d1/d7/d16/d30/l67 0 2023-12-16T05:56:28.629 INFO:tasks.workunit.client.0.smithi155.stdout:2/208: symlink d0/d34/l4d 0 2023-12-16T05:56:28.629 INFO:tasks.workunit.client.0.smithi155.stdout:2/209: chown d0/d5/d6/f2e 6690 1 2023-12-16T05:56:28.629 INFO:tasks.workunit.client.0.smithi155.stdout:2/210: stat d0/d5/f23 0 2023-12-16T05:56:28.629 INFO:tasks.workunit.client.0.smithi155.stdout:2/211: chown d0/d7/d1f 0 1 2023-12-16T05:56:28.630 INFO:tasks.workunit.client.0.smithi155.stdout:5/336: truncate d0/f1c 8797059 0 2023-12-16T05:56:28.630 INFO:tasks.workunit.client.0.smithi155.stdout:7/232: dwrite d0/d1/d5/d18/f1c [0,4194304] 0 2023-12-16T05:56:28.630 INFO:tasks.workunit.client.0.smithi155.stdout:7/233: dread - d0/d1/d5/d18/d1a/d22/f4d zero size 2023-12-16T05:56:28.631 INFO:tasks.workunit.client.0.smithi155.stdout:2/212: creat d0/d5/d6/df/f4e x:0 0 0 2023-12-16T05:56:28.631 INFO:tasks.workunit.client.0.smithi155.stdout:2/213: fsync d0/d7/f24 0 2023-12-16T05:56:28.635 INFO:tasks.workunit.client.0.smithi155.stdout:7/234: rmdir d0/d1/d5/d18 39 2023-12-16T05:56:28.637 INFO:tasks.workunit.client.0.smithi155.stdout:2/214: symlink d0/d7/dd/d14/l4f 0 2023-12-16T05:56:28.637 INFO:tasks.workunit.client.0.smithi155.stdout:1/332: dread d1/d7/f2f [0,4194304] 0 2023-12-16T05:56:28.638 INFO:tasks.workunit.client.0.smithi155.stdout:7/235: rename d0/d1/d5/d18/d1a/d22/f4d to d0/d1/d5/d18/d1a/d22/d3c/f50 0 2023-12-16T05:56:28.638 INFO:tasks.workunit.client.0.smithi155.stdout:4/231: dwrite d0/d10/f12 [0,4194304] 0 2023-12-16T05:56:28.639 INFO:tasks.workunit.client.0.smithi155.stdout:5/337: dread d0/d2/d2a/d19/f20 [0,4194304] 0 2023-12-16T05:56:28.640 INFO:tasks.workunit.client.0.smithi155.stdout:2/215: mknod d0/d7/dd/d49/d4b/c50 0 2023-12-16T05:56:28.644 INFO:tasks.workunit.client.0.smithi155.stdout:7/236: creat d0/d1/d5/d18/d1a/d22/d27/d34/d4b/f51 x:0 0 0 2023-12-16T05:56:28.646 INFO:tasks.workunit.client.0.smithi155.stdout:4/232: rename d0/d11 to d0/d10/d46 0 2023-12-16T05:56:28.648 INFO:tasks.workunit.client.0.smithi155.stdout:5/338: creat d0/d2/d2a/f63 x:0 0 0 2023-12-16T05:56:28.650 INFO:tasks.workunit.client.0.smithi155.stdout:7/237: link d0/d1b/f2f d0/d1/d5/d18/d31/f52 0 2023-12-16T05:56:28.652 INFO:tasks.workunit.client.0.smithi155.stdout:5/339: getdents d0/d2/d2a/d19/d21/d56 0 2023-12-16T05:56:28.652 INFO:tasks.workunit.client.0.smithi155.stdout:5/340: chown d0/d2/d2a/d19/f38 481921 1 2023-12-16T05:56:28.653 INFO:tasks.workunit.client.0.smithi155.stdout:7/238: symlink d0/d1/d5/d18/d1a/d38/l53 0 2023-12-16T05:56:28.654 INFO:tasks.workunit.client.0.smithi155.stdout:2/216: dwrite d0/d5/d6/f10 [0,4194304] 0 2023-12-16T05:56:28.655 INFO:tasks.workunit.client.0.smithi155.stdout:7/239: unlink d0/d1/lc 0 2023-12-16T05:56:28.655 INFO:tasks.workunit.client.0.smithi155.stdout:7/240: write d0/d1/fe [1574377,100305] 0 2023-12-16T05:56:28.656 INFO:tasks.workunit.client.0.smithi155.stdout:2/217: write d0/f32 [3807253,98120] 0 2023-12-16T05:56:28.656 INFO:tasks.workunit.client.0.smithi155.stdout:7/241: truncate d0/d1b/f2f 1792183 0 2023-12-16T05:56:28.658 INFO:tasks.workunit.client.0.smithi155.stdout:2/218: getdents d0/d5/d6 0 2023-12-16T05:56:28.658 INFO:tasks.workunit.client.0.smithi155.stdout:2/219: truncate d0/d7/dd/f3e 8751422 0 2023-12-16T05:56:28.658 INFO:tasks.workunit.client.0.smithi155.stdout:4/233: getdents d0/d10 0 2023-12-16T05:56:28.660 INFO:tasks.workunit.client.0.smithi155.stdout:7/242: creat d0/d1/d5/d18/d1a/f54 x:0 0 0 2023-12-16T05:56:28.660 INFO:tasks.workunit.client.0.smithi155.stdout:7/243: readlink d0/d1/d5/d18/d1a/d38/l53 0 2023-12-16T05:56:28.661 INFO:tasks.workunit.client.0.smithi155.stdout:7/244: stat d0/d1/d5/d18/d1a/d22/d27 0 2023-12-16T05:56:28.662 INFO:tasks.workunit.client.0.smithi155.stdout:4/234: symlink d0/d10/d22/d3d/l47 0 2023-12-16T05:56:28.662 INFO:tasks.workunit.client.0.smithi155.stdout:4/235: rename d0/d10/d46 to d0/d10/d46/d16/d1a/d48 22 2023-12-16T05:56:28.662 INFO:tasks.workunit.client.0.smithi155.stdout:7/245: getdents d0/d1/d5/d18/d1a/d22/d27 0 2023-12-16T05:56:28.665 INFO:tasks.workunit.client.0.smithi155.stdout:4/236: unlink d0/d10/d46/d16/d1a/c39 0 2023-12-16T05:56:28.665 INFO:tasks.workunit.client.0.smithi155.stdout:2/220: dread d0/d5/d6/f2e [0,4194304] 0 2023-12-16T05:56:28.667 INFO:tasks.workunit.client.0.smithi155.stdout:4/237: mkdir d0/d10/d22/d3d/d49 0 2023-12-16T05:56:28.667 INFO:tasks.workunit.client.0.smithi155.stdout:4/238: readlink d0/l8 0 2023-12-16T05:56:28.667 INFO:tasks.workunit.client.0.smithi155.stdout:4/239: write d0/f20 [1079413,119328] 0 2023-12-16T05:56:28.668 INFO:tasks.workunit.client.0.smithi155.stdout:2/221: rename d0/d7/dd/d14/l2c to d0/d7/dd/d45/l51 0 2023-12-16T05:56:28.668 INFO:tasks.workunit.client.0.smithi155.stdout:7/246: fsync d0/d1b/f2f 0 2023-12-16T05:56:28.668 INFO:tasks.workunit.client.0.smithi155.stdout:7/247: chown d0/l11 48 1 2023-12-16T05:56:28.669 INFO:tasks.workunit.client.0.smithi155.stdout:4/240: dread d0/d10/d22/f45 [0,4194304] 0 2023-12-16T05:56:28.669 INFO:tasks.workunit.client.0.smithi155.stdout:2/222: creat d0/f52 x:0 0 0 2023-12-16T05:56:28.671 INFO:tasks.workunit.client.0.smithi155.stdout:7/248: rmdir d0/d1/d5/d18/d1a/d22/d27/d34/d4b 39 2023-12-16T05:56:28.673 INFO:tasks.workunit.client.0.smithi155.stdout:4/241: creat d0/d10/d22/d3d/d43/f4a x:0 0 0 2023-12-16T05:56:28.673 INFO:tasks.workunit.client.0.smithi155.stdout:4/242: fsync d0/d10/d46/d16/d1a/f2b 0 2023-12-16T05:56:28.673 INFO:tasks.workunit.client.0.smithi155.stdout:4/243: getdents d0/d10 0 2023-12-16T05:56:28.674 INFO:tasks.workunit.client.0.smithi155.stdout:2/223: symlink d0/d34/d3c/l53 0 2023-12-16T05:56:28.676 INFO:tasks.workunit.client.0.smithi155.stdout:7/249: creat d0/d1/d5/d18/d1a/d2b/d2c/f55 x:0 0 0 2023-12-16T05:56:28.676 INFO:tasks.workunit.client.0.smithi155.stdout:7/250: truncate d0/d1/d5/d18/d31/f52 2475168 0 2023-12-16T05:56:28.676 INFO:tasks.workunit.client.0.smithi155.stdout:7/251: fdatasync d0/d1/d5/d18/f28 0 2023-12-16T05:56:28.683 INFO:tasks.workunit.client.0.smithi155.stdout:4/244: creat d0/d10/d46/d16/f4b x:0 0 0 2023-12-16T05:56:28.683 INFO:tasks.workunit.client.0.smithi155.stdout:7/252: symlink d0/d1/d5/d18/d1a/d2b/d2c/l56 0 2023-12-16T05:56:28.684 INFO:tasks.workunit.client.0.smithi155.stdout:7/253: read d0/d1/d5/d18/d1a/f2d [239445,124924] 0 2023-12-16T05:56:28.686 INFO:tasks.workunit.client.0.smithi155.stdout:4/245: unlink d0/l8 0 2023-12-16T05:56:28.686 INFO:tasks.workunit.client.0.smithi155.stdout:4/246: fsync d0/d10/f3b 0 2023-12-16T05:56:28.688 INFO:tasks.workunit.client.0.smithi155.stdout:2/224: dwrite d0/f3d [0,4194304] 0 2023-12-16T05:56:28.688 INFO:tasks.workunit.client.0.smithi155.stdout:2/225: readlink d0/d7/dd/d14/l37 0 2023-12-16T05:56:28.688 INFO:tasks.workunit.client.0.smithi155.stdout:2/226: chown d0/f32 425926567 1 2023-12-16T05:56:28.689 INFO:tasks.workunit.client.0.smithi155.stdout:2/227: write d0/d5/d6/f2e [2726343,39558] 0 2023-12-16T05:56:28.689 INFO:tasks.workunit.client.0.smithi155.stdout:2/228: fdatasync d0/f3d 0 2023-12-16T05:56:28.689 INFO:tasks.workunit.client.0.smithi155.stdout:2/229: write d0/f2 [3572994,3721] 0 2023-12-16T05:56:28.703 INFO:tasks.workunit.client.0.smithi155.stdout:4/247: dwrite d0/d10/f12 [0,4194304] 0 2023-12-16T05:56:28.708 INFO:tasks.workunit.client.0.smithi155.stdout:4/248: mknod d0/d10/d22/d3d/d43/c4c 0 2023-12-16T05:56:28.708 INFO:tasks.workunit.client.0.smithi155.stdout:4/249: chown d0/d10/f2c 2 1 2023-12-16T05:56:28.708 INFO:tasks.workunit.client.0.smithi155.stdout:4/250: write d0/d10/d46/d16/f4b [698717,617] 0 2023-12-16T05:56:28.712 INFO:tasks.workunit.client.0.smithi155.stdout:2/230: dwrite d0/f2 [4194304,4194304] 0 2023-12-16T05:56:28.712 INFO:tasks.workunit.client.0.smithi155.stdout:2/231: stat d0/d7/d1f/d3b 0 2023-12-16T05:56:28.714 INFO:tasks.workunit.client.0.smithi155.stdout:2/232: chown d0/d7/cc 175 1 2023-12-16T05:56:28.717 INFO:tasks.workunit.client.0.smithi155.stdout:2/233: dread d0/d7/f41 [0,4194304] 0 2023-12-16T05:56:28.718 INFO:tasks.workunit.client.0.smithi155.stdout:2/234: creat d0/d7/d1f/d3b/f54 x:0 0 0 2023-12-16T05:56:28.724 INFO:tasks.workunit.client.0.smithi155.stdout:4/251: dwrite d0/f4 [0,4194304] 0 2023-12-16T05:56:28.725 INFO:tasks.workunit.client.0.smithi155.stdout:4/252: creat d0/d10/d22/d3d/f4d x:0 0 0 2023-12-16T05:56:28.726 INFO:tasks.workunit.client.0.smithi155.stdout:4/253: getdents d0/da/d36 0 2023-12-16T05:56:28.726 INFO:tasks.workunit.client.0.smithi155.stdout:4/254: dread - d0/d10/d46/d16/d1a/f2b zero size 2023-12-16T05:56:28.727 INFO:tasks.workunit.client.0.smithi155.stdout:4/255: fdatasync d0/d10/f34 0 2023-12-16T05:56:28.727 INFO:tasks.workunit.client.0.smithi155.stdout:4/256: creat d0/d10/d22/d3d/d43/f4e x:0 0 0 2023-12-16T05:56:28.728 INFO:tasks.workunit.client.0.smithi155.stdout:4/257: creat d0/d10/d22/d3d/d49/f4f x:0 0 0 2023-12-16T05:56:28.728 INFO:tasks.workunit.client.0.smithi155.stdout:4/258: write d0/d10/f3b [225742,98881] 0 2023-12-16T05:56:28.733 INFO:tasks.workunit.client.0.smithi155.stdout:2/235: dwrite d0/d5/d6/df/f4e [0,4194304] 0 2023-12-16T05:56:28.734 INFO:tasks.workunit.client.0.smithi155.stdout:2/236: write d0/d5/d6/f2e [928544,50895] 0 2023-12-16T05:56:28.737 INFO:tasks.workunit.client.0.smithi155.stdout:4/259: rmdir d0/d10/d22/d3d 39 2023-12-16T05:56:28.738 INFO:tasks.workunit.client.0.smithi155.stdout:4/260: mkdir d0/d10/d22/d50 0 2023-12-16T05:56:28.738 INFO:tasks.workunit.client.0.smithi155.stdout:4/261: chown d0/da/c13 895 1 2023-12-16T05:56:28.738 INFO:tasks.workunit.client.0.smithi155.stdout:4/262: fsync d0/d10/d22/d3d/d49/f4f 0 2023-12-16T05:56:28.738 INFO:tasks.workunit.client.0.smithi155.stdout:4/263: readlink d0/da/l31 0 2023-12-16T05:56:28.740 INFO:tasks.workunit.client.0.smithi155.stdout:4/264: dread d0/d10/f2c [0,4194304] 0 2023-12-16T05:56:28.742 INFO:tasks.workunit.client.0.smithi155.stdout:2/237: dread d0/f3d [0,4194304] 0 2023-12-16T05:56:28.744 INFO:tasks.workunit.client.0.smithi155.stdout:4/265: creat d0/d10/d22/f51 x:0 0 0 2023-12-16T05:56:28.744 INFO:tasks.workunit.client.0.smithi155.stdout:4/266: truncate d0/d10/f12 4493848 0 2023-12-16T05:56:28.745 INFO:tasks.workunit.client.0.smithi155.stdout:2/238: creat d0/d34/d3c/f55 x:0 0 0 2023-12-16T05:56:28.746 INFO:tasks.workunit.client.0.smithi155.stdout:4/267: dread - d0/d10/d46/f40 zero size 2023-12-16T05:56:28.747 INFO:tasks.workunit.client.0.smithi155.stdout:2/239: symlink d0/d7/d1f/d3b/l56 0 2023-12-16T05:56:28.748 INFO:tasks.workunit.client.0.smithi155.stdout:4/268: mkdir d0/d10/d46/d16/d30/d52 0 2023-12-16T05:56:28.750 INFO:tasks.workunit.client.0.smithi155.stdout:4/269: dread d0/d10/d46/d16/f4b [0,4194304] 0 2023-12-16T05:56:28.750 INFO:tasks.workunit.client.0.smithi155.stdout:2/240: truncate d0/d7/d1f/d3b/f46 6028305 0 2023-12-16T05:56:28.752 INFO:tasks.workunit.client.0.smithi155.stdout:4/270: symlink d0/d10/d22/d3d/d49/l53 0 2023-12-16T05:56:28.754 INFO:tasks.workunit.client.0.smithi155.stdout:4/271: mkdir d0/d10/d46/d16/d30/d52/d54 0 2023-12-16T05:56:28.755 INFO:tasks.workunit.client.0.smithi155.stdout:2/241: mkdir d0/d7/d57 0 2023-12-16T05:56:28.755 INFO:tasks.workunit.client.0.smithi155.stdout:2/242: chown d0/d7/d1f/d3b/f54 298 1 2023-12-16T05:56:28.757 INFO:tasks.workunit.client.0.smithi155.stdout:4/272: mknod d0/d10/c55 0 2023-12-16T05:56:28.757 INFO:tasks.workunit.client.0.smithi155.stdout:4/273: chown d0/da/l2a 6737 1 2023-12-16T05:56:28.758 INFO:tasks.workunit.client.0.smithi155.stdout:2/243: truncate d0/d5/d6/f10 2755331 0 2023-12-16T05:56:28.758 INFO:tasks.workunit.client.0.smithi155.stdout:2/244: readlink d0/d7/dd/l21 0 2023-12-16T05:56:28.760 INFO:tasks.workunit.client.0.smithi155.stdout:4/274: link d0/d10/d22/d3d/f4d d0/d10/d46/d16/d30/d52/f56 0 2023-12-16T05:56:28.761 INFO:tasks.workunit.client.0.smithi155.stdout:2/245: creat d0/d5/d6/df/f58 x:0 0 0 2023-12-16T05:56:28.762 INFO:tasks.workunit.client.0.smithi155.stdout:4/275: symlink d0/d10/d46/d16/d30/l57 0 2023-12-16T05:56:28.762 INFO:tasks.workunit.client.0.smithi155.stdout:4/276: write d0/d10/f2c [2037404,6571] 0 2023-12-16T05:56:28.763 INFO:tasks.workunit.client.0.smithi155.stdout:2/246: symlink d0/d7/d1f/d3b/l59 0 2023-12-16T05:56:28.765 INFO:tasks.workunit.client.0.smithi155.stdout:4/277: mknod d0/da/d36/c58 0 2023-12-16T05:56:28.766 INFO:tasks.workunit.client.0.smithi155.stdout:2/247: rmdir d0/d7/dd/d49 39 2023-12-16T05:56:28.766 INFO:tasks.workunit.client.0.smithi155.stdout:4/278: dread d0/d10/d46/d16/f4b [0,4194304] 0 2023-12-16T05:56:28.768 INFO:tasks.workunit.client.0.smithi155.stdout:2/248: creat d0/d34/f5a x:0 0 0 2023-12-16T05:56:28.768 INFO:tasks.workunit.client.0.smithi155.stdout:2/249: dread - d0/d7/dd/d14/f2d zero size 2023-12-16T05:56:28.768 INFO:tasks.workunit.client.0.smithi155.stdout:2/250: truncate d0/d34/d3c/f55 880303 0 2023-12-16T05:56:28.769 INFO:tasks.workunit.client.0.smithi155.stdout:4/279: symlink d0/d10/d46/d16/d30/d52/l59 0 2023-12-16T05:56:28.777 INFO:tasks.workunit.client.0.smithi155.stdout:2/251: dread d0/f12 [0,4194304] 0 2023-12-16T05:56:28.782 INFO:tasks.workunit.client.0.smithi155.stdout:8/225: sync 2023-12-16T05:56:28.782 INFO:tasks.workunit.client.0.smithi155.stdout:3/203: sync 2023-12-16T05:56:28.784 INFO:tasks.workunit.client.0.smithi155.stdout:3/204: unlink d0/d1a/f2a 0 2023-12-16T05:56:28.786 INFO:tasks.workunit.client.0.smithi155.stdout:8/226: rename d4/da/d1b/d1c/d1a/d1f/d29/c24 to d4/da/c3c 0 2023-12-16T05:56:28.787 INFO:tasks.workunit.client.0.smithi155.stdout:8/227: stat d4/da/d1b/d1c/d19/f38 0 2023-12-16T05:56:28.787 INFO:tasks.workunit.client.0.smithi155.stdout:3/205: truncate d0/d1a/f2d 7734597 0 2023-12-16T05:56:28.793 INFO:tasks.workunit.client.0.smithi155.stdout:3/206: write d0/d14/f18 [829875,16168] 0 2023-12-16T05:56:28.793 INFO:tasks.workunit.client.0.smithi155.stdout:4/280: dwrite d0/f4 [4194304,4194304] 0 2023-12-16T05:56:28.794 INFO:tasks.workunit.client.0.smithi155.stdout:2/252: dwrite d0/d7/d1f/d3b/f54 [0,4194304] 0 2023-12-16T05:56:28.794 INFO:tasks.workunit.client.0.smithi155.stdout:4/281: creat d0/da/f5a x:0 0 0 2023-12-16T05:56:28.799 INFO:tasks.workunit.client.0.smithi155.stdout:2/253: creat d0/d7/d57/f5b x:0 0 0 2023-12-16T05:56:28.801 INFO:tasks.workunit.client.0.smithi155.stdout:4/282: rename d0/da/d36/f3e to d0/d10/f5b 0 2023-12-16T05:56:28.802 INFO:tasks.workunit.client.0.smithi155.stdout:2/254: symlink d0/d7/d57/l5c 0 2023-12-16T05:56:28.802 INFO:tasks.workunit.client.0.smithi155.stdout:8/228: dwrite d4/da/d1b/d1c/d1a/f2c [0,4194304] 0 2023-12-16T05:56:28.802 INFO:tasks.workunit.client.0.smithi155.stdout:8/229: fdatasync f0 0 2023-12-16T05:56:28.803 INFO:tasks.workunit.client.0.smithi155.stdout:4/283: creat d0/d10/d46/d16/d1a/f5c x:0 0 0 2023-12-16T05:56:28.805 INFO:tasks.workunit.client.0.smithi155.stdout:2/255: rename d0/d5/c2a to d0/d7/dd/d14/c5d 0 2023-12-16T05:56:28.807 INFO:tasks.workunit.client.0.smithi155.stdout:4/284: symlink d0/d10/d22/d3d/l5d 0 2023-12-16T05:56:28.808 INFO:tasks.workunit.client.0.smithi155.stdout:2/256: creat d0/d7/f5e x:0 0 0 2023-12-16T05:56:28.809 INFO:tasks.workunit.client.0.smithi155.stdout:4/285: creat d0/da/f5e x:0 0 0 2023-12-16T05:56:28.809 INFO:tasks.workunit.client.0.smithi155.stdout:4/286: stat d0/da/ff 0 2023-12-16T05:56:28.810 INFO:tasks.workunit.client.0.smithi155.stdout:2/257: rmdir d0/d7/dd/d45 39 2023-12-16T05:56:28.810 INFO:tasks.workunit.client.0.smithi155.stdout:2/258: chown d0/d7/f5e 117 1 2023-12-16T05:56:28.821 INFO:tasks.workunit.client.0.smithi155.stdout:9/230: sync 2023-12-16T05:56:28.821 INFO:tasks.workunit.client.0.smithi155.stdout:9/231: chown da/c1a 20468449 1 2023-12-16T05:56:28.823 INFO:tasks.workunit.client.0.smithi155.stdout:0/212: sync 2023-12-16T05:56:28.824 INFO:tasks.workunit.client.0.smithi155.stdout:0/213: chown d7/l18 6158 1 2023-12-16T05:56:28.838 INFO:tasks.workunit.client.0.smithi155.stdout:4/287: dwrite d0/d10/f5b [4194304,4194304] 0 2023-12-16T05:56:28.839 INFO:tasks.workunit.client.0.smithi155.stdout:4/288: mkdir d0/da/d36/d5f 0 2023-12-16T05:56:28.839 INFO:tasks.workunit.client.0.smithi155.stdout:4/289: chown d0/da/l2a 422561417 1 2023-12-16T05:56:28.839 INFO:tasks.workunit.client.0.smithi155.stdout:4/290: truncate d0/d10/d46/f40 762733 0 2023-12-16T05:56:28.839 INFO:tasks.workunit.client.0.smithi155.stdout:4/291: fdatasync d0/d10/d46/f1c 0 2023-12-16T05:56:28.840 INFO:tasks.workunit.client.0.smithi155.stdout:4/292: mknod d0/d10/d46/d16/d30/d52/c60 0 2023-12-16T05:56:28.840 INFO:tasks.workunit.client.0.smithi155.stdout:4/293: truncate d0/d10/d22/f51 59378 0 2023-12-16T05:56:28.840 INFO:tasks.workunit.client.0.smithi155.stdout:4/294: write d0/d10/d22/d3d/d43/f4e [333073,128306] 0 2023-12-16T05:56:28.840 INFO:tasks.workunit.client.0.smithi155.stdout:4/295: read - d0/d10/d46/d16/d1a/f5c zero size 2023-12-16T05:56:28.841 INFO:tasks.workunit.client.0.smithi155.stdout:4/296: write d0/d10/d46/d16/d1a/f35 [4851140,104905] 0 2023-12-16T05:56:28.841 INFO:tasks.workunit.client.0.smithi155.stdout:4/297: chown d0/d10/d22/c44 1745 1 2023-12-16T05:56:28.841 INFO:tasks.workunit.client.0.smithi155.stdout:4/298: stat d0/d10/d46 0 2023-12-16T05:56:28.841 INFO:tasks.workunit.client.0.smithi155.stdout:8/230: dwrite d4/da/fb [0,4194304] 0 2023-12-16T05:56:28.842 INFO:tasks.workunit.client.0.smithi155.stdout:9/232: dwrite da/d15/d17/d24/d26/f2a [0,4194304] 0 2023-12-16T05:56:28.842 INFO:tasks.workunit.client.0.smithi155.stdout:0/214: dwrite d7/df/f26 [0,4194304] 0 2023-12-16T05:56:28.843 INFO:tasks.workunit.client.0.smithi155.stdout:4/299: rename d0/da/ff to d0/d10/d22/d3d/d49/f61 0 2023-12-16T05:56:28.843 INFO:tasks.workunit.client.0.smithi155.stdout:4/300: fsync d0/d10/f5b 0 2023-12-16T05:56:28.843 INFO:tasks.workunit.client.0.smithi155.stdout:4/301: chown d0/d10/d46 957152 1 2023-12-16T05:56:28.843 INFO:tasks.workunit.client.0.smithi155.stdout:9/233: symlink da/d15/d17/d36/l50 0 2023-12-16T05:56:28.847 INFO:tasks.workunit.client.0.smithi155.stdout:4/302: creat d0/d10/d22/d3d/d43/f62 x:0 0 0 2023-12-16T05:56:28.848 INFO:tasks.workunit.client.0.smithi155.stdout:9/234: getdents da/d15/d17/d24 0 2023-12-16T05:56:28.850 INFO:tasks.workunit.client.0.smithi155.stdout:4/303: rename d0/d10/c55 to d0/d10/d22/d50/c63 0 2023-12-16T05:56:28.852 INFO:tasks.workunit.client.0.smithi155.stdout:9/235: unlink da/d15/d17/d24/d26/d2e/l3d 0 2023-12-16T05:56:28.853 INFO:tasks.workunit.client.0.smithi155.stdout:4/304: symlink d0/d10/l64 0 2023-12-16T05:56:28.854 INFO:tasks.workunit.client.0.smithi155.stdout:4/305: write d0/d10/d22/d3d/f4d [904097,68575] 0 2023-12-16T05:56:28.854 INFO:tasks.workunit.client.0.smithi155.stdout:9/236: mknod da/d15/d17/d24/d26/d2e/c51 0 2023-12-16T05:56:28.854 INFO:tasks.workunit.client.0.smithi155.stdout:9/237: fdatasync da/d15/f45 0 2023-12-16T05:56:28.855 INFO:tasks.workunit.client.0.smithi155.stdout:9/238: getdents da 0 2023-12-16T05:56:28.856 INFO:tasks.workunit.client.0.smithi155.stdout:4/306: read d0/f1d [1071031,35784] 0 2023-12-16T05:56:28.857 INFO:tasks.workunit.client.0.smithi155.stdout:9/239: link da/d15/d17/c21 da/d15/c52 0 2023-12-16T05:56:28.859 INFO:tasks.workunit.client.0.smithi155.stdout:4/307: rename d0/d10/d22/d3d/l47 to d0/d10/d46/d16/d1a/l65 0 2023-12-16T05:56:28.860 INFO:tasks.workunit.client.0.smithi155.stdout:8/231: dwrite d4/da/d1b/d2a/f39 [0,4194304] 0 2023-12-16T05:56:28.861 INFO:tasks.workunit.client.0.smithi155.stdout:4/308: creat d0/da/d36/d5f/f66 x:0 0 0 2023-12-16T05:56:28.863 INFO:tasks.workunit.client.0.smithi155.stdout:9/240: dread da/d15/d17/d24/f2b [0,4194304] 0 2023-12-16T05:56:28.866 INFO:tasks.workunit.client.0.smithi155.stdout:9/241: creat da/d15/d17/d24/d26/d2e/d32/f53 x:0 0 0 2023-12-16T05:56:28.866 INFO:tasks.workunit.client.0.smithi155.stdout:0/215: dwrite d7/d13/f17 [4194304,4194304] 0 2023-12-16T05:56:28.888 INFO:tasks.workunit.client.0.smithi155.stdout:4/309: dwrite d0/f28 [0,4194304] 0 2023-12-16T05:56:28.888 INFO:tasks.workunit.client.0.smithi155.stdout:0/216: dwrite d7/df/f19 [0,4194304] 0 2023-12-16T05:56:28.889 INFO:tasks.workunit.client.0.smithi155.stdout:9/242: dwrite da/d15/d17/d24/d26/f29 [4194304,4194304] 0 2023-12-16T05:56:28.890 INFO:tasks.workunit.client.0.smithi155.stdout:4/310: symlink d0/d10/d22/d3d/l67 0 2023-12-16T05:56:28.891 INFO:tasks.workunit.client.0.smithi155.stdout:0/217: symlink d7/d30/d3b/d3e/l43 0 2023-12-16T05:56:28.891 INFO:tasks.workunit.client.0.smithi155.stdout:0/218: fdatasync d7/df/f19 0 2023-12-16T05:56:28.892 INFO:tasks.workunit.client.0.smithi155.stdout:9/243: mkdir da/d15/d17/d36/d54 0 2023-12-16T05:56:28.893 INFO:tasks.workunit.client.0.smithi155.stdout:4/311: mknod d0/d10/d22/d50/c68 0 2023-12-16T05:56:28.894 INFO:tasks.workunit.client.0.smithi155.stdout:4/312: write d0/d10/d46/d16/d30/d52/f56 [484478,41985] 0 2023-12-16T05:56:28.895 INFO:tasks.workunit.client.0.smithi155.stdout:0/219: mkdir d7/df/d41/d23/d44 0 2023-12-16T05:56:28.895 INFO:tasks.workunit.client.0.smithi155.stdout:0/220: write d7/d30/f39 [1017697,92732] 0 2023-12-16T05:56:28.895 INFO:tasks.workunit.client.0.smithi155.stdout:4/313: write d0/d10/d22/f25 [3434961,98776] 0 2023-12-16T05:56:28.896 INFO:tasks.workunit.client.0.smithi155.stdout:9/244: creat da/d15/d17/d36/f55 x:0 0 0 2023-12-16T05:56:28.896 INFO:tasks.workunit.client.0.smithi155.stdout:0/221: dread d7/f2a [0,4194304] 0 2023-12-16T05:56:28.897 INFO:tasks.workunit.client.0.smithi155.stdout:4/314: rmdir d0/d10/d22/d50 39 2023-12-16T05:56:28.902 INFO:tasks.workunit.client.0.smithi155.stdout:9/245: rmdir da/d15 39 2023-12-16T05:56:28.903 INFO:tasks.workunit.client.0.smithi155.stdout:9/246: link da/d15/d17/d36/c43 da/d15/d17/d24/d26/d2e/c56 0 2023-12-16T05:56:28.903 INFO:tasks.workunit.client.0.smithi155.stdout:9/247: chown da/d15/d17/f25 42712391 1 2023-12-16T05:56:28.904 INFO:tasks.workunit.client.0.smithi155.stdout:9/248: rmdir da/d15/d17/d24/d38 0 2023-12-16T05:56:28.913 INFO:tasks.workunit.client.0.smithi155.stdout:9/249: dread da/d15/d17/f1c [0,4194304] 0 2023-12-16T05:56:28.914 INFO:tasks.workunit.client.0.smithi155.stdout:9/250: fsync da/d15/d17/d24/d26/d2e/f47 0 2023-12-16T05:56:28.914 INFO:tasks.workunit.client.0.smithi155.stdout:9/251: write da/d15/d17/f41 [519748,85248] 0 2023-12-16T05:56:28.915 INFO:tasks.workunit.client.0.smithi155.stdout:0/222: dwrite d7/df/f1a [4194304,4194304] 0 2023-12-16T05:56:28.915 INFO:tasks.workunit.client.0.smithi155.stdout:0/223: write d7/d2d/f3f [249070,8943] 0 2023-12-16T05:56:28.915 INFO:tasks.workunit.client.0.smithi155.stdout:0/224: chown d7/f29 29 1 2023-12-16T05:56:28.915 INFO:tasks.workunit.client.0.smithi155.stdout:9/252: write da/f13 [2412985,121801] 0 2023-12-16T05:56:28.917 INFO:tasks.workunit.client.0.smithi155.stdout:0/225: dread d7/d2d/f3c [0,4194304] 0 2023-12-16T05:56:28.918 INFO:tasks.workunit.client.0.smithi155.stdout:9/253: rename da/d15/d17/c34 to da/d15/d17/d24/d26/c57 0 2023-12-16T05:56:28.918 INFO:tasks.workunit.client.0.smithi155.stdout:4/315: dwrite d0/d10/d46/d16/d1a/f2b [0,4194304] 0 2023-12-16T05:56:28.918 INFO:tasks.workunit.client.0.smithi155.stdout:4/316: truncate d0/d10/d22/d3d/d49/f61 5056967 0 2023-12-16T05:56:28.923 INFO:tasks.workunit.client.0.smithi155.stdout:4/317: getdents d0/d10/d22/d3d/d43 0 2023-12-16T05:56:28.926 INFO:tasks.workunit.client.0.smithi155.stdout:0/226: dread d7/df/f19 [0,4194304] 0 2023-12-16T05:56:28.930 INFO:tasks.workunit.client.0.smithi155.stdout:0/227: rename d7/d30/d3b to d7/d13/d45 0 2023-12-16T05:56:28.932 INFO:tasks.workunit.client.0.smithi155.stdout:0/228: write d7/df/f26 [3281937,79524] 0 2023-12-16T05:56:28.932 INFO:tasks.workunit.client.0.smithi155.stdout:9/254: dwrite da/d15/d17/d24/f2d [0,4194304] 0 2023-12-16T05:56:28.932 INFO:tasks.workunit.client.0.smithi155.stdout:0/229: fsync d7/d2d/f2f 0 2023-12-16T05:56:28.932 INFO:tasks.workunit.client.0.smithi155.stdout:0/230: truncate d7/d2d/f2f 219308 0 2023-12-16T05:56:28.940 INFO:tasks.workunit.client.0.smithi155.stdout:9/255: dread da/d15/d17/d24/d26/f2a [0,4194304] 0 2023-12-16T05:56:28.944 INFO:tasks.workunit.client.0.smithi155.stdout:0/231: dread d7/df/f26 [0,4194304] 0 2023-12-16T05:56:28.944 INFO:tasks.workunit.client.0.smithi155.stdout:0/232: chown d7/df/d41 133229 1 2023-12-16T05:56:28.957 INFO:tasks.workunit.client.0.smithi155.stdout:9/256: creat da/d15/d17/d24/d26/f58 x:0 0 0 2023-12-16T05:56:28.957 INFO:tasks.workunit.client.0.smithi155.stdout:0/233: mkdir d7/d13/d46 0 2023-12-16T05:56:28.958 INFO:tasks.workunit.client.0.smithi155.stdout:0/234: getdents d7/df/d41 0 2023-12-16T05:56:28.959 INFO:tasks.workunit.client.0.smithi155.stdout:0/235: mkdir d7/d47 0 2023-12-16T05:56:28.959 INFO:tasks.workunit.client.0.smithi155.stdout:0/236: write d7/fb [4896428,7281] 0 2023-12-16T05:56:28.959 INFO:tasks.workunit.client.0.smithi155.stdout:0/237: write d7/d30/f39 [1854144,53796] 0 2023-12-16T05:56:28.961 INFO:tasks.workunit.client.0.smithi155.stdout:6/350: sync 2023-12-16T05:56:28.968 INFO:tasks.workunit.client.0.smithi155.stdout:6/351: dread d0/d3/d2c/d3e/d4c/f63 [0,4194304] 0 2023-12-16T05:56:28.969 INFO:tasks.workunit.client.0.smithi155.stdout:6/352: creat d0/df/d43/f70 x:0 0 0 2023-12-16T05:56:28.973 INFO:tasks.workunit.client.0.smithi155.stdout:9/257: dwrite da/d15/f1d [0,4194304] 0 2023-12-16T05:56:28.975 INFO:tasks.workunit.client.0.smithi155.stdout:6/353: dread d0/d3/f5 [0,4194304] 0 2023-12-16T05:56:28.975 INFO:tasks.workunit.client.0.smithi155.stdout:6/354: dread - d0/d3/d2c/d3e/f64 zero size 2023-12-16T05:56:28.982 INFO:tasks.workunit.client.0.smithi155.stdout:9/258: dread da/f1e [0,4194304] 0 2023-12-16T05:56:28.984 INFO:tasks.workunit.client.0.smithi155.stdout:9/259: symlink da/d15/d17/l59 0 2023-12-16T05:56:29.014 INFO:tasks.workunit.client.0.smithi155.stdout:6/355: dwrite d0/d3/d2c/f60 [0,4194304] 0 2023-12-16T05:56:29.016 INFO:tasks.workunit.client.0.smithi155.stdout:6/356: creat d0/df/d5e/d46/d6d/f71 x:0 0 0 2023-12-16T05:56:29.016 INFO:tasks.workunit.client.0.smithi155.stdout:6/357: chown d0/df/f27 3848 1 2023-12-16T05:56:29.016 INFO:tasks.workunit.client.0.smithi155.stdout:6/358: write d0/df/d5e/d46/f3f [2874228,115872] 0 2023-12-16T05:56:29.017 INFO:tasks.workunit.client.0.smithi155.stdout:6/359: creat d0/d3/d67/f72 x:0 0 0 2023-12-16T05:56:29.021 INFO:tasks.workunit.client.0.smithi155.stdout:9/260: dwrite da/d15/d17/d24/d26/f2a [0,4194304] 0 2023-12-16T05:56:29.021 INFO:tasks.workunit.client.0.smithi155.stdout:9/261: read - da/d15/d17/d24/d26/d2e/d32/f53 zero size 2023-12-16T05:56:29.024 INFO:tasks.workunit.client.0.smithi155.stdout:9/262: creat da/f5a x:0 0 0 2023-12-16T05:56:29.024 INFO:tasks.workunit.client.0.smithi155.stdout:9/263: mkdir da/d15/d17/d36/d5b 0 2023-12-16T05:56:29.025 INFO:tasks.workunit.client.0.smithi155.stdout:9/264: symlink da/d15/d17/d36/l5c 0 2023-12-16T05:56:29.027 INFO:tasks.workunit.client.0.smithi155.stdout:9/265: dread da/f14 [0,4194304] 0 2023-12-16T05:56:29.028 INFO:tasks.workunit.client.0.smithi155.stdout:9/266: link l5 da/d15/d17/d36/d5b/l5d 0 2023-12-16T05:56:29.028 INFO:tasks.workunit.client.0.smithi155.stdout:9/267: creat da/d15/f5e x:0 0 0 2023-12-16T05:56:29.029 INFO:tasks.workunit.client.0.smithi155.stdout:6/360: dwrite d0/d3/f19 [0,4194304] 0 2023-12-16T05:56:29.029 INFO:tasks.workunit.client.0.smithi155.stdout:6/361: dread - d0/d3/d2c/f6e zero size 2023-12-16T05:56:29.032 INFO:tasks.workunit.client.0.smithi155.stdout:6/362: truncate d0/df/d5e/f48 2969166 0 2023-12-16T05:56:29.033 INFO:tasks.workunit.client.0.smithi155.stdout:6/363: write d0/d3/f12 [157200,117381] 0 2023-12-16T05:56:29.042 INFO:tasks.workunit.client.0.smithi155.stdout:9/268: dwrite da/d15/d17/d36/f4d [0,4194304] 0 2023-12-16T05:56:29.047 INFO:tasks.workunit.client.0.smithi155.stdout:9/269: truncate da/d15/d17/d36/f4d 2940597 0 2023-12-16T05:56:29.048 INFO:tasks.workunit.client.0.smithi155.stdout:9/270: creat da/d15/d17/d24/d26/d2e/d32/f5f x:0 0 0 2023-12-16T05:56:29.049 INFO:tasks.workunit.client.0.smithi155.stdout:9/271: unlink da/d15/d17/d24/f2b 0 2023-12-16T05:56:29.049 INFO:tasks.workunit.client.0.smithi155.stdout:9/272: chown da/d15/d17/c21 162122 1 2023-12-16T05:56:29.051 INFO:tasks.workunit.client.0.smithi155.stdout:6/364: dwrite d0/d3/d2c/d3e/d4c/d44/f4e [0,4194304] 0 2023-12-16T05:56:29.056 INFO:tasks.workunit.client.0.smithi155.stdout:6/365: rename d0/d3/d2c/f2f to d0/d3/d2c/d3e/d4c/d44/f73 0 2023-12-16T05:56:29.063 INFO:tasks.workunit.client.0.smithi155.stdout:9/273: dwrite da/d15/d17/d24/d26/f44 [0,4194304] 0 2023-12-16T05:56:29.071 INFO:tasks.workunit.client.0.smithi155.stdout:9/274: dread da/f13 [0,4194304] 0 2023-12-16T05:56:29.072 INFO:tasks.workunit.client.0.smithi155.stdout:9/275: mkdir da/d15/d17/d36/d5b/d60 0 2023-12-16T05:56:29.075 INFO:tasks.workunit.client.0.smithi155.stdout:6/366: dwrite d0/d3/f1e [0,4194304] 0 2023-12-16T05:56:29.076 INFO:tasks.workunit.client.0.smithi155.stdout:6/367: dread - d0/d3/d2c/d3e/d4c/d1b/f50 zero size 2023-12-16T05:56:29.076 INFO:tasks.workunit.client.0.smithi155.stdout:6/368: fdatasync d0/d3/d2c/d3e/d4c/d1b/f22 0 2023-12-16T05:56:29.078 INFO:tasks.workunit.client.0.smithi155.stdout:9/276: dread da/f1e [0,4194304] 0 2023-12-16T05:56:29.079 INFO:tasks.workunit.client.0.smithi155.stdout:9/277: getdents da/d15 0 2023-12-16T05:56:29.080 INFO:tasks.workunit.client.0.smithi155.stdout:9/278: dread - da/d15/d17/d24/d26/d2e/d32/f53 zero size 2023-12-16T05:56:29.080 INFO:tasks.workunit.client.0.smithi155.stdout:9/279: write da/d15/d17/f1c [3459923,30656] 0 2023-12-16T05:56:29.082 INFO:tasks.workunit.client.0.smithi155.stdout:9/280: creat da/d15/d17/d36/d5b/f61 x:0 0 0 2023-12-16T05:56:29.082 INFO:tasks.workunit.client.0.smithi155.stdout:9/281: stat c7 0 2023-12-16T05:56:29.082 INFO:tasks.workunit.client.0.smithi155.stdout:9/282: write da/d15/d17/d24/d26/d2e/d32/f35 [489370,9828] 0 2023-12-16T05:56:29.084 INFO:tasks.workunit.client.0.smithi155.stdout:9/283: truncate da/d15/d17/d24/d26/f29 5829228 0 2023-12-16T05:56:29.086 INFO:tasks.workunit.client.0.smithi155.stdout:9/284: chown da/d15/d17/d24/d26/d2e/f47 4468747 1 2023-12-16T05:56:29.086 INFO:tasks.workunit.client.0.smithi155.stdout:9/285: dread - da/d15/d17/d24/d26/d2e/d32/f53 zero size 2023-12-16T05:56:29.087 INFO:tasks.workunit.client.0.smithi155.stdout:9/286: mkdir da/d15/d17/d24/d62 0 2023-12-16T05:56:29.088 INFO:tasks.workunit.client.0.smithi155.stdout:9/287: chown da/d15/d17/d24/d26/d2e/c51 135533358 1 2023-12-16T05:56:29.089 INFO:tasks.workunit.client.0.smithi155.stdout:9/288: read da/ff [1754497,88397] 0 2023-12-16T05:56:29.089 INFO:tasks.workunit.client.0.smithi155.stdout:9/289: read - da/d15/f45 zero size 2023-12-16T05:56:29.090 INFO:tasks.workunit.client.0.smithi155.stdout:9/290: creat da/d15/d17/d24/d26/d2e/f63 x:0 0 0 2023-12-16T05:56:29.091 INFO:tasks.workunit.client.0.smithi155.stdout:9/291: dread - da/d15/d17/d36/f4e zero size 2023-12-16T05:56:29.092 INFO:tasks.workunit.client.0.smithi155.stdout:9/292: creat da/d15/d17/d24/f64 x:0 0 0 2023-12-16T05:56:29.093 INFO:tasks.workunit.client.0.smithi155.stdout:9/293: read da/d15/d17/f41 [78080,19288] 0 2023-12-16T05:56:29.095 INFO:tasks.workunit.client.0.smithi155.stdout:9/294: symlink da/d15/d17/d36/l65 0 2023-12-16T05:56:29.095 INFO:tasks.workunit.client.0.smithi155.stdout:9/295: dread - da/d15/d17/d24/d26/d2e/f47 zero size 2023-12-16T05:56:29.095 INFO:tasks.workunit.client.0.smithi155.stdout:9/296: truncate da/d15/d17/d24/d26/f58 165268 0 2023-12-16T05:56:29.095 INFO:tasks.workunit.client.0.smithi155.stdout:9/297: fdatasync da/d15/d17/d24/d26/d2e/d32/f3c 0 2023-12-16T05:56:29.095 INFO:tasks.workunit.client.0.smithi155.stdout:9/298: write da/d15/d17/d24/d26/d2e/f63 [947723,46876] 0 2023-12-16T05:56:29.097 INFO:tasks.workunit.client.0.smithi155.stdout:1/333: sync 2023-12-16T05:56:29.097 INFO:tasks.workunit.client.0.smithi155.stdout:7/254: sync 2023-12-16T05:56:29.097 INFO:tasks.workunit.client.0.smithi155.stdout:5/341: sync 2023-12-16T05:56:29.097 INFO:tasks.workunit.client.0.smithi155.stdout:5/342: dread - d0/d2/d2a/d3c/f5c zero size 2023-12-16T05:56:29.097 INFO:tasks.workunit.client.0.smithi155.stdout:7/255: truncate d0/d1/d5/d18/d31/f46 287497 0 2023-12-16T05:56:29.097 INFO:tasks.workunit.client.0.smithi155.stdout:1/334: write d1/f1e [1390351,124184] 0 2023-12-16T05:56:29.099 INFO:tasks.workunit.client.0.smithi155.stdout:5/343: dread d0/d2/d2a/fe [8388608,4194304] 0 2023-12-16T05:56:29.099 INFO:tasks.workunit.client.0.smithi155.stdout:7/256: rename d0/d1/c16 to d0/d1b/c57 0 2023-12-16T05:56:29.099 INFO:tasks.workunit.client.0.smithi155.stdout:7/257: fsync d0/d1b/f39 0 2023-12-16T05:56:29.101 INFO:tasks.workunit.client.0.smithi155.stdout:5/344: rmdir d0/d2/d2a/d3c/d47 39 2023-12-16T05:56:29.104 INFO:tasks.workunit.client.0.smithi155.stdout:5/345: symlink d0/d2/d2a/d30/l64 0 2023-12-16T05:56:29.106 INFO:tasks.workunit.client.0.smithi155.stdout:5/346: mknod d0/d2/d4f/c65 0 2023-12-16T05:56:29.108 INFO:tasks.workunit.client.0.smithi155.stdout:5/347: mkdir d0/d2/d2a/d19/d59/d66 0 2023-12-16T05:56:29.111 INFO:tasks.workunit.client.0.smithi155.stdout:5/348: mknod d0/d2/d2a/d30/c67 0 2023-12-16T05:56:29.111 INFO:tasks.workunit.client.0.smithi155.stdout:5/349: chown d0/d2/f22 18119 1 2023-12-16T05:56:29.114 INFO:tasks.workunit.client.0.smithi155.stdout:5/350: read d0/d2/d2a/fd [3722845,66810] 0 2023-12-16T05:56:29.114 INFO:tasks.workunit.client.0.smithi155.stdout:5/351: truncate d0/d2/d2a/f63 479130 0 2023-12-16T05:56:29.115 INFO:tasks.workunit.client.0.smithi155.stdout:5/352: unlink d0/d2/d2a/c3a 0 2023-12-16T05:56:29.117 INFO:tasks.workunit.client.0.smithi155.stdout:9/299: dwrite da/d15/d17/d24/d26/d2e/d32/f3c [0,4194304] 0 2023-12-16T05:56:29.118 INFO:tasks.workunit.client.0.smithi155.stdout:7/258: dwrite d0/d1/d5/d18/d1a/d38/f41 [0,4194304] 0 2023-12-16T05:56:29.118 INFO:tasks.workunit.client.0.smithi155.stdout:7/259: write d0/d1/d5/d18/d31/f46 [304123,39186] 0 2023-12-16T05:56:29.119 INFO:tasks.workunit.client.0.smithi155.stdout:7/260: write d0/d1/d5/d18/f30 [259058,56973] 0 2023-12-16T05:56:29.119 INFO:tasks.workunit.client.0.smithi155.stdout:7/261: write d0/d1/fb [6388620,55438] 0 2023-12-16T05:56:29.121 INFO:tasks.workunit.client.0.smithi155.stdout:1/335: dwrite d1/d25/d43/f5b [4194304,4194304] 0 2023-12-16T05:56:29.135 INFO:tasks.workunit.client.0.smithi155.stdout:7/262: dwrite d0/d1/d5/d18/f1c [0,4194304] 0 2023-12-16T05:56:29.185 INFO:tasks.workunit.client.0.smithi155.stdout:9/300: unlink da/cd 0 2023-12-16T05:56:29.193 INFO:tasks.workunit.client.0.smithi155.stdout:1/336: creat d1/d7/f68 x:0 0 0 2023-12-16T05:56:29.193 INFO:tasks.workunit.client.0.smithi155.stdout:1/337: readlink d1/d7/d16/l24 0 2023-12-16T05:56:29.193 INFO:tasks.workunit.client.0.smithi155.stdout:1/338: chown d1/d7/f5a 6205765 1 2023-12-16T05:56:29.196 INFO:tasks.workunit.client.0.smithi155.stdout:7/263: mknod d0/d1/d5/d18/d1a/d22/d27/d42/c58 0 2023-12-16T05:56:29.196 INFO:tasks.workunit.client.0.smithi155.stdout:7/264: chown d0/d1/d5/d18/d31/f46 123941 1 2023-12-16T05:56:29.196 INFO:tasks.workunit.client.0.smithi155.stdout:7/265: write d0/d1/f4a [237427,94620] 0 2023-12-16T05:56:29.196 INFO:tasks.workunit.client.0.smithi155.stdout:7/266: readlink d0/d1/d5/d18/d1a/d22/l26 0 2023-12-16T05:56:29.196 INFO:tasks.workunit.client.0.smithi155.stdout:7/267: write d0/d1/d5/f8 [2823844,113879] 0 2023-12-16T05:56:29.202 INFO:tasks.workunit.client.0.smithi155.stdout:9/301: creat da/d15/f66 x:0 0 0 2023-12-16T05:56:29.205 INFO:tasks.workunit.client.0.smithi155.stdout:9/302: creat da/d15/d17/d24/d62/f67 x:0 0 0 2023-12-16T05:56:29.206 INFO:tasks.workunit.client.0.smithi155.stdout:9/303: rename da/d15/d17/d24/d62/f67 to da/d15/d17/d24/d62/f68 0 2023-12-16T05:56:29.207 INFO:tasks.workunit.client.0.smithi155.stdout:9/304: creat da/d15/d17/d24/d26/d2e/d32/f69 x:0 0 0 2023-12-16T05:56:29.208 INFO:tasks.workunit.client.0.smithi155.stdout:9/305: mknod da/d15/d17/d24/d26/d2e/d32/c6a 0 2023-12-16T05:56:29.210 INFO:tasks.workunit.client.0.smithi155.stdout:1/339: dwrite d1/d7/d16/f1d [0,4194304] 0 2023-12-16T05:56:29.214 INFO:tasks.workunit.client.0.smithi155.stdout:1/340: mkdir d1/d69 0 2023-12-16T05:56:29.214 INFO:tasks.workunit.client.0.smithi155.stdout:1/341: dread - d1/f4f zero size 2023-12-16T05:56:29.214 INFO:tasks.workunit.client.0.smithi155.stdout:7/268: dwrite d0/d1/d5/f1d [0,4194304] 0 2023-12-16T05:56:29.214 INFO:tasks.workunit.client.0.smithi155.stdout:7/269: stat d0/d1/d5/d18/d1a/d2b/d2c/l56 0 2023-12-16T05:56:29.220 INFO:tasks.workunit.client.0.smithi155.stdout:1/342: write d1/d25/d43/d5d/f66 [3364643,115195] 0 2023-12-16T05:56:29.220 INFO:tasks.workunit.client.0.smithi155.stdout:1/343: fdatasync d1/d7/d4b/f50 0 2023-12-16T05:56:29.221 INFO:tasks.workunit.client.0.smithi155.stdout:1/344: rmdir d1/d7/d4b 39 2023-12-16T05:56:29.221 INFO:tasks.workunit.client.0.smithi155.stdout:1/345: stat d1/cd 0 2023-12-16T05:56:29.222 INFO:tasks.workunit.client.0.smithi155.stdout:1/346: dread d1/d7/d4b/f55 [0,4194304] 0 2023-12-16T05:56:29.223 INFO:tasks.workunit.client.0.smithi155.stdout:1/347: symlink d1/d69/l6a 0 2023-12-16T05:56:29.223 INFO:tasks.workunit.client.0.smithi155.stdout:1/348: write d1/d25/d43/f5b [1865063,61683] 0 2023-12-16T05:56:29.224 INFO:tasks.workunit.client.0.smithi155.stdout:1/349: write d1/d25/d43/f5b [849591,117559] 0 2023-12-16T05:56:29.225 INFO:tasks.workunit.client.0.smithi155.stdout:1/350: mknod d1/d7/d16/d30/c6b 0 2023-12-16T05:56:29.225 INFO:tasks.workunit.client.0.smithi155.stdout:1/351: chown d1/d17/d28/l42 5 1 2023-12-16T05:56:29.226 INFO:tasks.workunit.client.0.smithi155.stdout:1/352: truncate d1/d25/d43/f60 277192 0 2023-12-16T05:56:29.226 INFO:tasks.workunit.client.0.smithi155.stdout:1/353: write d1/d7/f68 [822862,54] 0 2023-12-16T05:56:29.228 INFO:tasks.workunit.client.0.smithi155.stdout:1/354: rename d1/d7/d16/c22 to d1/d25/d43/d5d/d5e/c6c 0 2023-12-16T05:56:29.228 INFO:tasks.workunit.client.0.smithi155.stdout:9/306: dwrite da/ff [0,4194304] 0 2023-12-16T05:56:29.229 INFO:tasks.workunit.client.0.smithi155.stdout:1/355: creat d1/d7/d4b/f6d x:0 0 0 2023-12-16T05:56:29.231 INFO:tasks.workunit.client.0.smithi155.stdout:9/307: symlink da/d15/d17/d24/l6b 0 2023-12-16T05:56:29.233 INFO:tasks.workunit.client.0.smithi155.stdout:9/308: symlink da/d15/d17/d24/d26/d2e/l6c 0 2023-12-16T05:56:29.233 INFO:tasks.workunit.client.0.smithi155.stdout:9/309: write da/d15/d17/d24/d26/d2e/d32/f53 [442578,102105] 0 2023-12-16T05:56:29.235 INFO:tasks.workunit.client.0.smithi155.stdout:9/310: rename da/d15/d17/d24/d26/d2e/f47 to da/d15/d17/d36/d5b/f6d 0 2023-12-16T05:56:29.235 INFO:tasks.workunit.client.0.smithi155.stdout:9/311: truncate da/d15/f66 13337 0 2023-12-16T05:56:29.235 INFO:tasks.workunit.client.0.smithi155.stdout:9/312: fdatasync da/d15/d17/d24/d26/d2e/d32/f3c 0 2023-12-16T05:56:29.235 INFO:tasks.workunit.client.0.smithi155.stdout:1/356: dread d1/d7/d16/f3a [0,4194304] 0 2023-12-16T05:56:29.237 INFO:tasks.workunit.client.0.smithi155.stdout:1/357: creat d1/d7/d16/d30/f6e x:0 0 0 2023-12-16T05:56:29.242 INFO:tasks.workunit.client.0.smithi155.stdout:9/313: dread da/d15/d17/d24/d26/f44 [0,4194304] 0 2023-12-16T05:56:29.243 INFO:tasks.workunit.client.0.smithi155.stdout:9/314: symlink da/d15/l6e 0 2023-12-16T05:56:29.244 INFO:tasks.workunit.client.0.smithi155.stdout:9/315: creat da/d15/d17/d36/d5b/d60/f6f x:0 0 0 2023-12-16T05:56:29.246 INFO:tasks.workunit.client.0.smithi155.stdout:9/316: fdatasync da/d15/d17/d24/d26/d2e/f4a 0 2023-12-16T05:56:29.251 INFO:tasks.workunit.client.0.smithi155.stdout:9/317: truncate da/d15/d17/d24/f2d 3814380 0 2023-12-16T05:56:29.253 INFO:tasks.workunit.client.0.smithi155.stdout:1/358: dwrite d1/d7/d4b/f55 [0,4194304] 0 2023-12-16T05:56:29.254 INFO:tasks.workunit.client.0.smithi155.stdout:2/259: sync 2023-12-16T05:56:29.254 INFO:tasks.workunit.client.0.smithi155.stdout:3/207: sync 2023-12-16T05:56:29.258 INFO:tasks.workunit.client.0.smithi155.stdout:1/359: truncate d1/d7/f1f 3544424 0 2023-12-16T05:56:29.258 INFO:tasks.workunit.client.0.smithi155.stdout:2/260: unlink d0/l3 0 2023-12-16T05:56:29.258 INFO:tasks.workunit.client.0.smithi155.stdout:2/261: read - d0/d7/dd/d14/f2d zero size 2023-12-16T05:56:29.258 INFO:tasks.workunit.client.0.smithi155.stdout:1/360: truncate d1/f4f 402828 0 2023-12-16T05:56:29.258 INFO:tasks.workunit.client.0.smithi155.stdout:3/208: truncate d0/f30 3063581 0 2023-12-16T05:56:29.273 INFO:tasks.workunit.client.0.smithi155.stdout:3/209: dread d0/f2e [0,4194304] 0 2023-12-16T05:56:29.277 INFO:tasks.workunit.client.0.smithi155.stdout:9/318: dwrite da/d15/d17/d24/f64 [0,4194304] 0 2023-12-16T05:56:29.279 INFO:tasks.workunit.client.0.smithi155.stdout:9/319: symlink da/d15/d17/d36/l70 0 2023-12-16T05:56:29.279 INFO:tasks.workunit.client.0.smithi155.stdout:9/320: write da/d15/d17/d36/f3f [1032185,4670] 0 2023-12-16T05:56:29.281 INFO:tasks.workunit.client.0.smithi155.stdout:3/210: dread d0/d1e/f20 [0,4194304] 0 2023-12-16T05:56:29.283 INFO:tasks.workunit.client.0.smithi155.stdout:3/211: creat d0/d14/d36/f3d x:0 0 0 2023-12-16T05:56:29.283 INFO:tasks.workunit.client.0.smithi155.stdout:3/212: fsync d0/d14/f35 0 2023-12-16T05:56:29.283 INFO:tasks.workunit.client.0.smithi155.stdout:3/213: creat d0/d14/d36/f3e x:0 0 0 2023-12-16T05:56:29.283 INFO:tasks.workunit.client.0.smithi155.stdout:3/214: truncate d0/d14/f28 5727439 0 2023-12-16T05:56:29.285 INFO:tasks.workunit.client.0.smithi155.stdout:3/215: mknod d0/d14/c3f 0 2023-12-16T05:56:29.285 INFO:tasks.workunit.client.0.smithi155.stdout:3/216: write d0/f10 [4873237,130277] 0 2023-12-16T05:56:29.285 INFO:tasks.workunit.client.0.smithi155.stdout:3/217: chown d0/fe 360619050 1 2023-12-16T05:56:29.285 INFO:tasks.workunit.client.0.smithi155.stdout:3/218: readlink d0/d1a/d33/l38 0 2023-12-16T05:56:29.285 INFO:tasks.workunit.client.0.smithi155.stdout:9/321: dread da/d15/d17/d24/d26/d2e/f4b [0,4194304] 0 2023-12-16T05:56:29.285 INFO:tasks.workunit.client.0.smithi155.stdout:9/322: chown da/d15/d17/d36/d5b/d60 123271 1 2023-12-16T05:56:29.285 INFO:tasks.workunit.client.0.smithi155.stdout:9/323: creat da/d15/d17/d36/d5b/f71 x:0 0 0 2023-12-16T05:56:29.287 INFO:tasks.workunit.client.0.smithi155.stdout:2/262: dwrite d0/f4 [0,4194304] 0 2023-12-16T05:56:29.287 INFO:tasks.workunit.client.0.smithi155.stdout:9/324: rename da/d15/l6e to da/d15/d17/d24/d26/d2e/d32/l72 0 2023-12-16T05:56:29.288 INFO:tasks.workunit.client.0.smithi155.stdout:1/361: dwrite d1/d7/f2f [4194304,4194304] 0 2023-12-16T05:56:29.289 INFO:tasks.workunit.client.0.smithi155.stdout:1/362: mknod d1/d7/c6f 0 2023-12-16T05:56:29.290 INFO:tasks.workunit.client.0.smithi155.stdout:1/363: creat d1/d17/d28/f70 x:0 0 0 2023-12-16T05:56:29.290 INFO:tasks.workunit.client.0.smithi155.stdout:1/364: dread - d1/d7/d4b/f6d zero size 2023-12-16T05:56:29.290 INFO:tasks.workunit.client.0.smithi155.stdout:1/365: readlink d1/d25/l49 0 2023-12-16T05:56:29.291 INFO:tasks.workunit.client.0.smithi155.stdout:1/366: rename d1/d17/l31 to d1/d25/d43/d5d/l71 0 2023-12-16T05:56:29.292 INFO:tasks.workunit.client.0.smithi155.stdout:1/367: mkdir d1/d7/d4b/d72 0 2023-12-16T05:56:29.293 INFO:tasks.workunit.client.0.smithi155.stdout:1/368: creat d1/d7/d16/d30/f73 x:0 0 0 2023-12-16T05:56:29.294 INFO:tasks.workunit.client.0.smithi155.stdout:3/219: getdents d0/d14/d36 0 2023-12-16T05:56:29.296 INFO:tasks.workunit.client.0.smithi155.stdout:3/220: symlink d0/d1a/l40 0 2023-12-16T05:56:29.297 INFO:tasks.workunit.client.0.smithi155.stdout:2/263: dread d0/f22 [0,4194304] 0 2023-12-16T05:56:29.297 INFO:tasks.workunit.client.0.smithi155.stdout:2/264: chown d0/d7/d1f/d3b/l59 2919 1 2023-12-16T05:56:29.297 INFO:tasks.workunit.client.0.smithi155.stdout:9/325: dread da/d15/d17/d24/d26/d2e/d32/f3c [0,4194304] 0 2023-12-16T05:56:29.297 INFO:tasks.workunit.client.0.smithi155.stdout:9/326: write da/d15/f66 [558178,56117] 0 2023-12-16T05:56:29.299 INFO:tasks.workunit.client.0.smithi155.stdout:9/327: dread da/d15/d17/d24/d26/d2e/f63 [0,4194304] 0 2023-12-16T05:56:29.301 INFO:tasks.workunit.client.0.smithi155.stdout:1/369: dread d1/d7/f5a [0,4194304] 0 2023-12-16T05:56:29.301 INFO:tasks.workunit.client.0.smithi155.stdout:9/328: mknod da/d15/d17/d36/d5b/c73 0 2023-12-16T05:56:29.301 INFO:tasks.workunit.client.0.smithi155.stdout:9/329: write da/d15/f2f [819076,58524] 0 2023-12-16T05:56:29.302 INFO:tasks.workunit.client.0.smithi155.stdout:1/370: mkdir d1/d17/d28/d74 0 2023-12-16T05:56:29.302 INFO:tasks.workunit.client.0.smithi155.stdout:1/371: creat d1/d7/f75 x:0 0 0 2023-12-16T05:56:29.303 INFO:tasks.workunit.client.0.smithi155.stdout:3/221: dread d0/f12 [8388608,4194304] 0 2023-12-16T05:56:29.304 INFO:tasks.workunit.client.0.smithi155.stdout:9/330: dread da/d15/d17/d24/d26/d2e/f63 [0,4194304] 0 2023-12-16T05:56:29.305 INFO:tasks.workunit.client.0.smithi155.stdout:1/372: rename d1/d7/f2f to d1/d7/d16/d30/f76 0 2023-12-16T05:56:29.306 INFO:tasks.workunit.client.0.smithi155.stdout:1/373: truncate d1/d7/f18 2192818 0 2023-12-16T05:56:29.308 INFO:tasks.workunit.client.0.smithi155.stdout:2/265: dread d0/d7/d1f/d3b/f36 [0,4194304] 0 2023-12-16T05:56:29.308 INFO:tasks.workunit.client.0.smithi155.stdout:2/266: write d0/d7/d1f/f48 [757548,14203] 0 2023-12-16T05:56:29.309 INFO:tasks.workunit.client.0.smithi155.stdout:1/374: creat d1/d25/d43/f77 x:0 0 0 2023-12-16T05:56:29.310 INFO:tasks.workunit.client.0.smithi155.stdout:2/267: mkdir d0/d5/d6/d5f 0 2023-12-16T05:56:29.310 INFO:tasks.workunit.client.0.smithi155.stdout:2/268: write d0/d7/dd/d14/f2d [1005038,90449] 0 2023-12-16T05:56:29.312 INFO:tasks.workunit.client.0.smithi155.stdout:1/375: rmdir d1/d17/d56 0 2023-12-16T05:56:29.313 INFO:tasks.workunit.client.0.smithi155.stdout:2/269: mknod d0/d34/d3c/c60 0 2023-12-16T05:56:29.313 INFO:tasks.workunit.client.0.smithi155.stdout:2/270: chown d0/d7/dd/d14/c5d 104603 1 2023-12-16T05:56:29.315 INFO:tasks.workunit.client.0.smithi155.stdout:1/376: link d1/c46 d1/d7/c78 0 2023-12-16T05:56:29.316 INFO:tasks.workunit.client.0.smithi155.stdout:2/271: write d0/d7/dd/f3e [3557202,87675] 0 2023-12-16T05:56:29.316 INFO:tasks.workunit.client.0.smithi155.stdout:2/272: write d0/d7/f41 [1309759,62625] 0 2023-12-16T05:56:29.316 INFO:tasks.workunit.client.0.smithi155.stdout:2/273: chown d0/d5/d6/df 0 1 2023-12-16T05:56:29.317 INFO:tasks.workunit.client.0.smithi155.stdout:1/377: mkdir d1/d7/d4b/d72/d79 0 2023-12-16T05:56:29.317 INFO:tasks.workunit.client.0.smithi155.stdout:1/378: chown d1/d25/d43/d5d/d5e/c6c 106129494 1 2023-12-16T05:56:29.319 INFO:tasks.workunit.client.0.smithi155.stdout:2/274: symlink d0/d7/l61 0 2023-12-16T05:56:29.334 INFO:tasks.workunit.client.0.smithi155.stdout:9/331: dwrite da/d15/d17/d24/d26/f2a [0,4194304] 0 2023-12-16T05:56:29.334 INFO:tasks.workunit.client.0.smithi155.stdout:2/275: fsync d0/d7/dd/d14/f2d 0 2023-12-16T05:56:29.337 INFO:tasks.workunit.client.0.smithi155.stdout:3/222: dwrite d0/d1e/f2b [0,4194304] 0 2023-12-16T05:56:29.337 INFO:tasks.workunit.client.0.smithi155.stdout:9/332: mknod da/d15/d17/d36/c74 0 2023-12-16T05:56:29.337 INFO:tasks.workunit.client.0.smithi155.stdout:1/379: dwrite d1/d17/f65 [0,4194304] 0 2023-12-16T05:56:29.338 INFO:tasks.workunit.client.0.smithi155.stdout:9/333: stat da/d15/d17/d24/f64 0 2023-12-16T05:56:29.338 INFO:tasks.workunit.client.0.smithi155.stdout:1/380: read - d1/d17/d28/f70 zero size 2023-12-16T05:56:29.338 INFO:tasks.workunit.client.0.smithi155.stdout:3/223: mknod d0/d1a/d33/c41 0 2023-12-16T05:56:29.338 INFO:tasks.workunit.client.0.smithi155.stdout:3/224: fdatasync d0/d1a/d33/f3a 0 2023-12-16T05:56:29.338 INFO:tasks.workunit.client.0.smithi155.stdout:3/225: fsync d0/fb 0 2023-12-16T05:56:29.339 INFO:tasks.workunit.client.0.smithi155.stdout:1/381: creat d1/d17/d28/d74/f7a x:0 0 0 2023-12-16T05:56:29.340 INFO:tasks.workunit.client.0.smithi155.stdout:3/226: mknod d0/d1a/d2f/c42 0 2023-12-16T05:56:29.341 INFO:tasks.workunit.client.0.smithi155.stdout:9/334: symlink da/d15/d17/l75 0 2023-12-16T05:56:29.341 INFO:tasks.workunit.client.0.smithi155.stdout:9/335: truncate da/d15/d17/d36/d5b/d60/f6f 279171 0 2023-12-16T05:56:29.342 INFO:tasks.workunit.client.0.smithi155.stdout:9/336: read da/d15/d17/d24/d26/f58 [28814,35010] 0 2023-12-16T05:56:29.344 INFO:tasks.workunit.client.0.smithi155.stdout:1/382: stat d1/d7/ce 0 2023-12-16T05:56:29.357 INFO:tasks.workunit.client.0.smithi155.stdout:9/337: mkdir da/d15/d17/d36/d54/d76 0 2023-12-16T05:56:29.358 INFO:tasks.workunit.client.0.smithi155.stdout:9/338: write da/d15/d17/d36/d5b/f71 [916848,59817] 0 2023-12-16T05:56:29.358 INFO:tasks.workunit.client.0.smithi155.stdout:1/383: creat d1/d7/d16/d30/f7b x:0 0 0 2023-12-16T05:56:29.358 INFO:tasks.workunit.client.0.smithi155.stdout:1/384: write d1/f51 [561891,87632] 0 2023-12-16T05:56:29.360 INFO:tasks.workunit.client.0.smithi155.stdout:9/339: unlink f9 0 2023-12-16T05:56:29.360 INFO:tasks.workunit.client.0.smithi155.stdout:9/340: write da/d15/d17/d24/d26/d2e/f63 [1415840,41977] 0 2023-12-16T05:56:29.360 INFO:tasks.workunit.client.0.smithi155.stdout:9/341: truncate da/d15/f39 1576402 0 2023-12-16T05:56:29.360 INFO:tasks.workunit.client.0.smithi155.stdout:9/342: write da/d15/f39 [189205,5800] 0 2023-12-16T05:56:29.361 INFO:tasks.workunit.client.0.smithi155.stdout:1/385: creat d1/d25/d43/d5d/f7c x:0 0 0 2023-12-16T05:56:29.364 INFO:tasks.workunit.client.0.smithi155.stdout:4/318: sync 2023-12-16T05:56:29.364 INFO:tasks.workunit.client.0.smithi155.stdout:0/238: sync 2023-12-16T05:56:29.364 INFO:tasks.workunit.client.0.smithi155.stdout:8/232: sync 2023-12-16T05:56:29.364 INFO:tasks.workunit.client.0.smithi155.stdout:8/233: read - d4/da/d1b/d1c/d1a/f3a zero size 2023-12-16T05:56:29.366 INFO:tasks.workunit.client.0.smithi155.stdout:0/239: write d7/df/f19 [2723237,88764] 0 2023-12-16T05:56:29.366 INFO:tasks.workunit.client.0.smithi155.stdout:4/319: creat d0/d10/d46/d16/d1a/f69 x:0 0 0 2023-12-16T05:56:29.366 INFO:tasks.workunit.client.0.smithi155.stdout:4/320: fdatasync d0/f28 0 2023-12-16T05:56:29.366 INFO:tasks.workunit.client.0.smithi155.stdout:4/321: truncate d0/d10/d22/d3d/d43/f4e 1062071 0 2023-12-16T05:56:29.366 INFO:tasks.workunit.client.0.smithi155.stdout:4/322: chown d0/f20 15234071 1 2023-12-16T05:56:29.366 INFO:tasks.workunit.client.0.smithi155.stdout:3/227: dwrite d0/f2e [0,4194304] 0 2023-12-16T05:56:29.366 INFO:tasks.workunit.client.0.smithi155.stdout:3/228: readlink d0/l27 0 2023-12-16T05:56:29.366 INFO:tasks.workunit.client.0.smithi155.stdout:3/229: chown d0/d14/d36 170743168 1 2023-12-16T05:56:29.366 INFO:tasks.workunit.client.0.smithi155.stdout:9/343: write da/d15/d17/d36/f4d [1879723,55819] 0 2023-12-16T05:56:29.366 INFO:tasks.workunit.client.0.smithi155.stdout:0/240: symlink d7/d30/l48 0 2023-12-16T05:56:29.366 INFO:tasks.workunit.client.0.smithi155.stdout:9/344: rename da/d15/d17/d36/d5b/d60/f6f to da/d15/d17/d36/d5b/d60/f77 0 2023-12-16T05:56:29.367 INFO:tasks.workunit.client.0.smithi155.stdout:0/241: creat d7/d13/d45/f49 x:0 0 0 2023-12-16T05:56:29.368 INFO:tasks.workunit.client.0.smithi155.stdout:4/323: write d0/f4 [3376979,47973] 0 2023-12-16T05:56:29.368 INFO:tasks.workunit.client.0.smithi155.stdout:4/324: fsync d0/d10/d46/d16/f4b 0 2023-12-16T05:56:29.368 INFO:tasks.workunit.client.0.smithi155.stdout:3/230: dread d0/f11 [0,4194304] 0 2023-12-16T05:56:29.368 INFO:tasks.workunit.client.0.smithi155.stdout:3/231: truncate d0/d1a/d33/f3a 644755 0 2023-12-16T05:56:29.369 INFO:tasks.workunit.client.0.smithi155.stdout:8/234: dread f0 [0,4194304] 0 2023-12-16T05:56:29.372 INFO:tasks.workunit.client.0.smithi155.stdout:0/242: mknod d7/df/c4a 0 2023-12-16T05:56:29.372 INFO:tasks.workunit.client.0.smithi155.stdout:3/232: mknod d0/d1a/d2f/c43 0 2023-12-16T05:56:29.373 INFO:tasks.workunit.client.0.smithi155.stdout:8/235: creat d4/da/d1b/d1c/d1a/f3d x:0 0 0 2023-12-16T05:56:29.373 INFO:tasks.workunit.client.0.smithi155.stdout:1/386: dread d1/ff [0,4194304] 0 2023-12-16T05:56:29.373 INFO:tasks.workunit.client.0.smithi155.stdout:1/387: truncate d1/d7/f75 459863 0 2023-12-16T05:56:29.373 INFO:tasks.workunit.client.0.smithi155.stdout:1/388: chown d1/d7/d16/f21 1989099780 1 2023-12-16T05:56:29.374 INFO:tasks.workunit.client.0.smithi155.stdout:1/389: chown d1/l23 7 1 2023-12-16T05:56:29.375 INFO:tasks.workunit.client.0.smithi155.stdout:0/243: write d7/df/f19 [3667888,15996] 0 2023-12-16T05:56:29.375 INFO:tasks.workunit.client.0.smithi155.stdout:9/345: write da/d15/d17/d24/d26/d2e/d32/f35 [94590,109550] 0 2023-12-16T05:56:29.377 INFO:tasks.workunit.client.0.smithi155.stdout:1/390: link d1/d7/f1f d1/d7/d4b/d72/f7d 0 2023-12-16T05:56:29.377 INFO:tasks.workunit.client.0.smithi155.stdout:1/391: dread - d1/d17/d28/f70 zero size 2023-12-16T05:56:29.378 INFO:tasks.workunit.client.0.smithi155.stdout:9/346: link da/d15/d17/d24/f64 da/d15/f78 0 2023-12-16T05:56:29.379 INFO:tasks.workunit.client.0.smithi155.stdout:9/347: write da/d15/d17/d36/d5b/f61 [717049,6343] 0 2023-12-16T05:56:29.380 INFO:tasks.workunit.client.0.smithi155.stdout:0/244: dread d7/d2d/f3c [0,4194304] 0 2023-12-16T05:56:29.380 INFO:tasks.workunit.client.0.smithi155.stdout:1/392: unlink d1/c5 0 2023-12-16T05:56:29.381 INFO:tasks.workunit.client.0.smithi155.stdout:9/348: truncate da/d15/d17/d24/d26/d2e/d32/f53 59794 0 2023-12-16T05:56:29.384 INFO:tasks.workunit.client.0.smithi155.stdout:0/245: mkdir d7/d13/d45/d4b 0 2023-12-16T05:56:29.386 INFO:tasks.workunit.client.0.smithi155.stdout:0/246: write d7/f2a [219423,30446] 0 2023-12-16T05:56:29.388 INFO:tasks.workunit.client.0.smithi155.stdout:0/247: creat d7/d47/f4c x:0 0 0 2023-12-16T05:56:29.389 INFO:tasks.workunit.client.0.smithi155.stdout:0/248: fsync d7/d2d/f3f 0 2023-12-16T05:56:29.391 INFO:tasks.workunit.client.0.smithi155.stdout:0/249: dread d7/d2d/f2f [0,4194304] 0 2023-12-16T05:56:29.391 INFO:tasks.workunit.client.0.smithi155.stdout:8/236: dwrite d4/da/d1b/d2a/f39 [0,4194304] 0 2023-12-16T05:56:29.396 INFO:tasks.workunit.client.0.smithi155.stdout:0/250: write f2 [2457129,73457] 0 2023-12-16T05:56:29.396 INFO:tasks.workunit.client.0.smithi155.stdout:0/251: fsync d7/d13/f1b 0 2023-12-16T05:56:29.397 INFO:tasks.workunit.client.0.smithi155.stdout:0/252: mkdir d7/df/d41/d23/d44/d4d 0 2023-12-16T05:56:29.423 INFO:tasks.workunit.client.0.smithi155.stdout:1/393: dwrite d1/d7/d16/d30/f73 [0,4194304] 0 2023-12-16T05:56:29.423 INFO:tasks.workunit.client.0.smithi155.stdout:3/233: dwrite d0/d14/f35 [0,4194304] 0 2023-12-16T05:56:29.424 INFO:tasks.workunit.client.0.smithi155.stdout:8/237: dwrite d4/da/d1b/d2a/f39 [4194304,4194304] 0 2023-12-16T05:56:29.424 INFO:tasks.workunit.client.0.smithi155.stdout:9/349: dwrite da/d15/d17/d24/d26/d2e/d32/f69 [0,4194304] 0 2023-12-16T05:56:29.424 INFO:tasks.workunit.client.0.smithi155.stdout:9/350: chown da/d15/l3a 23842633 1 2023-12-16T05:56:29.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:29 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:56:29.437 INFO:tasks.workunit.client.0.smithi155.stdout:1/394: mkdir d1/d7/d4b/d72/d7e 0 2023-12-16T05:56:29.437 INFO:tasks.workunit.client.0.smithi155.stdout:3/234: link d0/f17 d0/d1a/d2f/f44 0 2023-12-16T05:56:29.438 INFO:tasks.workunit.client.0.smithi155.stdout:0/253: dwrite d7/df/f19 [4194304,4194304] 0 2023-12-16T05:56:29.439 INFO:tasks.workunit.client.0.smithi155.stdout:8/238: symlink d4/da/d1b/d1c/d1a/d1f/l3e 0 2023-12-16T05:56:29.443 INFO:tasks.workunit.client.0.smithi155.stdout:9/351: rename da/c1a to da/d15/d17/d36/d5b/c79 0 2023-12-16T05:56:29.448 INFO:tasks.workunit.client.0.smithi155.stdout:0/254: link d7/d30/l35 d7/df/d41/d23/d44/l4e 0 2023-12-16T05:56:29.449 INFO:tasks.workunit.client.0.smithi155.stdout:8/239: creat d4/da/d1b/d1c/d1a/f3f x:0 0 0 2023-12-16T05:56:29.449 INFO:tasks.workunit.client.0.smithi155.stdout:8/240: dread - d4/da/d1b/d1c/d1a/f3d zero size 2023-12-16T05:56:29.456 INFO:tasks.workunit.client.0.smithi155.stdout:9/352: symlink da/d15/d17/d36/l7a 0 2023-12-16T05:56:29.456 INFO:tasks.workunit.client.0.smithi155.stdout:1/395: creat d1/d7/d16/d30/f7f x:0 0 0 2023-12-16T05:56:29.457 INFO:tasks.workunit.client.0.smithi155.stdout:0/255: creat d7/d13/d45/f4f x:0 0 0 2023-12-16T05:56:29.458 INFO:tasks.workunit.client.0.smithi155.stdout:0/256: write d7/df/f19 [3815658,91127] 0 2023-12-16T05:56:29.458 INFO:tasks.workunit.client.0.smithi155.stdout:8/241: symlink d4/da/d1b/d1c/d1a/d1f/d29/l40 0 2023-12-16T05:56:29.458 INFO:tasks.workunit.client.0.smithi155.stdout:8/242: dread - d4/da/d1b/d1c/d1a/f3d zero size 2023-12-16T05:56:29.458 INFO:tasks.workunit.client.0.smithi155.stdout:8/243: stat d4/da/d1b/d1c/d1a/d1f/d29 0 2023-12-16T05:56:29.459 INFO:tasks.workunit.client.0.smithi155.stdout:9/353: rmdir da/d15/d17 39 2023-12-16T05:56:29.459 INFO:tasks.workunit.client.0.smithi155.stdout:1/396: truncate d1/f1e 186800 0 2023-12-16T05:56:29.461 INFO:tasks.workunit.client.0.smithi155.stdout:0/257: unlink d7/df/f1a 0 2023-12-16T05:56:29.461 INFO:tasks.workunit.client.0.smithi155.stdout:0/258: chown f2 20962724 1 2023-12-16T05:56:29.461 INFO:tasks.workunit.client.0.smithi155.stdout:0/259: write d7/f29 [732238,85737] 0 2023-12-16T05:56:29.462 INFO:tasks.workunit.client.0.smithi155.stdout:8/244: truncate d4/da/d1b/d1c/f13 24456 0 2023-12-16T05:56:29.462 INFO:tasks.workunit.client.0.smithi155.stdout:8/245: chown d4/da/d1b/d1c/d1a/d1f 1979270 1 2023-12-16T05:56:29.462 INFO:tasks.workunit.client.0.smithi155.stdout:8/246: truncate d4/da/d1b/d1c/d19/f38 776772 0 2023-12-16T05:56:29.463 INFO:tasks.workunit.client.0.smithi155.stdout:9/354: symlink da/d15/d17/d36/l7b 0 2023-12-16T05:56:29.464 INFO:tasks.workunit.client.0.smithi155.stdout:1/397: link d1/c3f d1/d25/d43/d5d/c80 0 2023-12-16T05:56:29.465 INFO:tasks.workunit.client.0.smithi155.stdout:8/247: rename f0 to d4/f41 0 2023-12-16T05:56:29.467 INFO:tasks.workunit.client.0.smithi155.stdout:1/398: dread - d1/d7/d16/f63 zero size 2023-12-16T05:56:29.469 INFO:tasks.workunit.client.0.smithi155.stdout:8/248: creat d4/f42 x:0 0 0 2023-12-16T05:56:29.489 INFO:tasks.workunit.client.0.smithi155.stdout:0/260: dwrite d7/df/f19 [0,4194304] 0 2023-12-16T05:56:29.489 INFO:tasks.workunit.client.0.smithi155.stdout:0/261: chown d7/df/d41/d23 321 1 2023-12-16T05:56:29.490 INFO:tasks.workunit.client.0.smithi155.stdout:9/355: dwrite da/d15/d17/d24/d26/f44 [0,4194304] 0 2023-12-16T05:56:29.490 INFO:tasks.workunit.client.0.smithi155.stdout:8/249: dwrite d4/da/d1b/d1c/d1a/f3d [0,4194304] 0 2023-12-16T05:56:29.505 INFO:tasks.workunit.client.0.smithi155.stdout:0/262: dwrite d7/df/f37 [0,4194304] 0 2023-12-16T05:56:29.505 INFO:tasks.workunit.client.0.smithi155.stdout:0/263: readlink d7/d13/d45/d3e/l43 0 2023-12-16T05:56:29.505 INFO:tasks.workunit.client.0.smithi155.stdout:0/264: chown d7/fb 35 1 2023-12-16T05:56:29.506 INFO:tasks.workunit.client.0.smithi155.stdout:0/265: write f2 [5958385,24241] 0 2023-12-16T05:56:29.527 INFO:tasks.workunit.client.0.smithi155.stdout:1/399: rename d1/d7/cb to d1/d17/d28/c81 0 2023-12-16T05:56:29.529 INFO:tasks.workunit.client.0.smithi155.stdout:1/400: dread d1/d7/f68 [0,4194304] 0 2023-12-16T05:56:29.529 INFO:tasks.workunit.client.0.smithi155.stdout:1/401: stat d1/d25/l49 0 2023-12-16T05:56:29.533 INFO:tasks.workunit.client.0.smithi155.stdout:8/250: dread d4/da/d1b/d1c/f13 [0,4194304] 0 2023-12-16T05:56:29.534 INFO:tasks.workunit.client.0.smithi155.stdout:8/251: write d4/da/d1b/d1c/d19/f27 [3461301,48748] 0 2023-12-16T05:56:29.534 INFO:tasks.workunit.client.0.smithi155.stdout:8/252: chown d4/da/d1b/d1c/d1a/f3f 9215339 1 2023-12-16T05:56:29.534 INFO:tasks.workunit.client.0.smithi155.stdout:0/266: mknod d7/d47/c50 0 2023-12-16T05:56:29.542 INFO:tasks.workunit.client.0.smithi155.stdout:9/356: link da/l49 da/d15/d17/l7c 0 2023-12-16T05:56:29.542 INFO:tasks.workunit.client.0.smithi155.stdout:9/357: read - da/d15/f5e zero size 2023-12-16T05:56:29.543 INFO:tasks.workunit.client.0.smithi155.stdout:0/267: truncate d7/d2d/f3c 805261 0 2023-12-16T05:56:29.543 INFO:tasks.workunit.client.0.smithi155.stdout:0/268: chown d7/l18 3517966 1 2023-12-16T05:56:29.545 INFO:tasks.workunit.client.0.smithi155.stdout:0/269: link d7/df/d41/d23/l2c d7/df/d41/d23/l51 0 2023-12-16T05:56:29.545 INFO:tasks.workunit.client.0.smithi155.stdout:0/270: fsync d7/f29 0 2023-12-16T05:56:29.545 INFO:tasks.workunit.client.0.smithi155.stdout:8/253: dread d4/ff [0,4194304] 0 2023-12-16T05:56:29.545 INFO:tasks.workunit.client.0.smithi155.stdout:0/271: read d7/f2a [621230,20507] 0 2023-12-16T05:56:29.546 INFO:tasks.workunit.client.0.smithi155.stdout:8/254: mknod d4/da/d12/c43 0 2023-12-16T05:56:29.548 INFO:tasks.workunit.client.0.smithi155.stdout:0/272: symlink d7/df/d41/d23/l52 0 2023-12-16T05:56:29.548 INFO:tasks.workunit.client.0.smithi155.stdout:1/402: dwrite d1/d25/d43/f60 [0,4194304] 0 2023-12-16T05:56:29.549 INFO:tasks.workunit.client.0.smithi155.stdout:1/403: read d1/d25/d43/d5d/f66 [1983380,61786] 0 2023-12-16T05:56:29.550 INFO:tasks.workunit.client.0.smithi155.stdout:9/358: dread da/d15/d17/f1c [0,4194304] 0 2023-12-16T05:56:29.551 INFO:tasks.workunit.client.0.smithi155.stdout:9/359: creat da/d15/d17/d24/d26/f7d x:0 0 0 2023-12-16T05:56:29.556 INFO:tasks.workunit.client.0.smithi155.stdout:9/360: dread da/d15/d17/d24/d26/d2e/f4b [0,4194304] 0 2023-12-16T05:56:29.557 INFO:tasks.workunit.client.0.smithi155.stdout:9/361: mknod da/d15/d17/d24/d62/c7e 0 2023-12-16T05:56:29.557 INFO:tasks.workunit.client.0.smithi155.stdout:9/362: chown da/d15/d17/d36/d5b 4120065 1 2023-12-16T05:56:29.559 INFO:tasks.workunit.client.0.smithi155.stdout:9/363: creat da/d15/d17/d36/d54/f7f x:0 0 0 2023-12-16T05:56:29.559 INFO:tasks.workunit.client.0.smithi155.stdout:9/364: chown da/d15/d17/d24/d26/d2e/d32 111 1 2023-12-16T05:56:29.559 INFO:tasks.workunit.client.0.smithi155.stdout:9/365: truncate da/d15/f45 851850 0 2023-12-16T05:56:29.560 INFO:tasks.workunit.client.0.smithi155.stdout:9/366: creat da/f80 x:0 0 0 2023-12-16T05:56:29.560 INFO:tasks.workunit.client.0.smithi155.stdout:9/367: chown da/d15/d17/d24/l6b 1180 1 2023-12-16T05:56:29.561 INFO:tasks.workunit.client.0.smithi155.stdout:9/368: symlink da/d15/d17/d24/d26/d2e/l81 0 2023-12-16T05:56:29.563 INFO:tasks.workunit.client.0.smithi155.stdout:9/369: dread da/d15/f66 [0,4194304] 0 2023-12-16T05:56:29.565 INFO:tasks.workunit.client.0.smithi155.stdout:9/370: symlink da/d15/d17/d24/l82 0 2023-12-16T05:56:29.567 INFO:tasks.workunit.client.0.smithi155.stdout:9/371: mkdir da/d15/d17/d24/d26/d2e/d83 0 2023-12-16T05:56:29.568 INFO:tasks.workunit.client.0.smithi155.stdout:9/372: mknod da/d15/d17/c84 0 2023-12-16T05:56:29.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:29 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:56:29.588 INFO:tasks.workunit.client.0.smithi155.stdout:9/373: dwrite da/d15/f45 [0,4194304] 0 2023-12-16T05:56:29.592 INFO:tasks.workunit.client.0.smithi155.stdout:9/374: rmdir da/d15/d17/d36/d54 39 2023-12-16T05:56:29.592 INFO:tasks.workunit.client.0.smithi155.stdout:9/375: mknod da/c85 0 2023-12-16T05:56:29.593 INFO:tasks.workunit.client.0.smithi155.stdout:9/376: mknod da/d15/d17/d24/d26/d2e/d32/c86 0 2023-12-16T05:56:29.594 INFO:tasks.workunit.client.0.smithi155.stdout:9/377: truncate da/f1e 4917988 0 2023-12-16T05:56:29.594 INFO:tasks.workunit.client.0.smithi155.stdout:9/378: fsync da/f14 0 2023-12-16T05:56:29.613 INFO:tasks.workunit.client.0.smithi155.stdout:9/379: dwrite da/d15/d17/d24/d26/d2e/d32/f3c [4194304,4194304] 0 2023-12-16T05:56:29.613 INFO:tasks.workunit.client.0.smithi155.stdout:9/380: chown da/d15/d17/f25 255 1 2023-12-16T05:56:29.615 INFO:tasks.workunit.client.0.smithi155.stdout:9/381: creat da/d15/d17/d24/d26/d2e/f87 x:0 0 0 2023-12-16T05:56:29.616 INFO:tasks.workunit.client.0.smithi155.stdout:9/382: rename da/d15/d17/l7c to da/d15/d17/d36/d54/l88 0 2023-12-16T05:56:29.618 INFO:tasks.workunit.client.0.smithi155.stdout:9/383: rename da/d15/d17/d36/l50 to da/d15/d17/d36/d5b/d60/l89 0 2023-12-16T05:56:29.621 INFO:tasks.workunit.client.0.smithi155.stdout:9/384: dread da/d15/d17/d36/f3f [0,4194304] 0 2023-12-16T05:56:29.621 INFO:tasks.workunit.client.0.smithi155.stdout:9/385: write da/d15/d17/d36/d5b/f6d [569630,8503] 0 2023-12-16T05:56:29.621 INFO:tasks.workunit.client.0.smithi155.stdout:9/386: write da/d15/d17/d24/d26/d2e/d32/f69 [4457620,67509] 0 2023-12-16T05:56:29.621 INFO:tasks.workunit.client.0.smithi155.stdout:9/387: stat da/d15/f2f 0 2023-12-16T05:56:29.621 INFO:tasks.workunit.client.0.smithi155.stdout:9/388: dread da/d15/f31 [0,4194304] 0 2023-12-16T05:56:29.622 INFO:tasks.workunit.client.0.smithi155.stdout:9/389: creat da/d15/d17/d24/f8a x:0 0 0 2023-12-16T05:56:29.622 INFO:tasks.workunit.client.0.smithi155.stdout:9/390: mknod da/d15/d17/d24/d26/d2e/d83/c8b 0 2023-12-16T05:56:29.629 INFO:tasks.workunit.client.0.smithi155.stdout:9/391: dread da/d15/d17/d24/d26/f2a [0,4194304] 0 2023-12-16T05:56:29.629 INFO:tasks.workunit.client.0.smithi155.stdout:9/392: chown da/d15/d17/d24/d26/d2e/c56 21260 1 2023-12-16T05:56:29.630 INFO:tasks.workunit.client.0.smithi155.stdout:9/393: getdents da/d15/d17/d24/d26 0 2023-12-16T05:56:29.630 INFO:tasks.workunit.client.0.smithi155.stdout:9/394: stat da/l11 0 2023-12-16T05:56:29.631 INFO:tasks.workunit.client.0.smithi155.stdout:9/395: mknod da/d15/d17/d36/d5b/c8c 0 2023-12-16T05:56:29.632 INFO:tasks.workunit.client.0.smithi155.stdout:9/396: mknod da/c8d 0 2023-12-16T05:56:29.632 INFO:tasks.workunit.client.0.smithi155.stdout:6/369: sync 2023-12-16T05:56:29.634 INFO:tasks.workunit.client.0.smithi155.stdout:6/370: creat d0/df/d5e/d46/d6d/f74 x:0 0 0 2023-12-16T05:56:29.636 INFO:tasks.workunit.client.0.smithi155.stdout:6/371: symlink d0/df/d5e/d46/l75 0 2023-12-16T05:56:29.637 INFO:tasks.workunit.client.0.smithi155.stdout:6/372: write d0/d3/d2c/d3e/d4c/f33 [1423677,73513] 0 2023-12-16T05:56:29.637 INFO:tasks.workunit.client.0.smithi155.stdout:6/373: stat d0/df 0 2023-12-16T05:56:29.638 INFO:tasks.workunit.client.0.smithi155.stdout:9/397: dread da/ff [0,4194304] 0 2023-12-16T05:56:29.639 INFO:tasks.workunit.client.0.smithi155.stdout:6/374: creat d0/df/d5e/d5b/f76 x:0 0 0 2023-12-16T05:56:29.640 INFO:tasks.workunit.client.0.smithi155.stdout:9/398: creat da/d15/d17/d24/d26/d2e/f8e x:0 0 0 2023-12-16T05:56:29.640 INFO:tasks.workunit.client.0.smithi155.stdout:6/375: mkdir d0/d3/d2c/d3e/d4c/d44/d77 0 2023-12-16T05:56:29.641 INFO:tasks.workunit.client.0.smithi155.stdout:9/399: stat da/d15/d17/d24/d26/d2e/l3b 0 2023-12-16T05:56:29.643 INFO:tasks.workunit.client.0.smithi155.stdout:6/376: creat d0/d3/d2c/d3e/d4c/d1b/f78 x:0 0 0 2023-12-16T05:56:29.643 INFO:tasks.workunit.client.0.smithi155.stdout:6/377: readlink d0/d3/d2c/d3e/d4c/l58 0 2023-12-16T05:56:29.651 INFO:tasks.workunit.client.0.smithi155.stdout:6/378: dread d0/d3/f55 [0,4194304] 0 2023-12-16T05:56:29.651 INFO:tasks.workunit.client.0.smithi155.stdout:6/379: dread - d0/d3/d2c/d3e/f64 zero size 2023-12-16T05:56:29.653 INFO:tasks.workunit.client.0.smithi155.stdout:6/380: symlink d0/df/d5e/l79 0 2023-12-16T05:56:29.653 INFO:tasks.workunit.client.0.smithi155.stdout:6/381: stat d0/df/d5e/d46 0 2023-12-16T05:56:29.653 INFO:tasks.workunit.client.0.smithi155.stdout:6/382: write d0/df/d5e/f66 [900640,58820] 0 2023-12-16T05:56:29.655 INFO:tasks.workunit.client.0.smithi155.stdout:9/400: dwrite da/f10 [0,4194304] 0 2023-12-16T05:56:29.655 INFO:tasks.workunit.client.0.smithi155.stdout:9/401: chown da/d15/d17/d24/d26/d2e/l81 851 1 2023-12-16T05:56:29.656 INFO:tasks.workunit.client.0.smithi155.stdout:9/402: mkdir da/d15/d17/d24/d26/d2e/d83/d8f 0 2023-12-16T05:56:29.657 INFO:tasks.workunit.client.0.smithi155.stdout:9/403: getdents da/d15/d17 0 2023-12-16T05:56:29.657 INFO:tasks.workunit.client.0.smithi155.stdout:9/404: write da/f80 [116166,66758] 0 2023-12-16T05:56:29.658 INFO:tasks.workunit.client.0.smithi155.stdout:9/405: creat da/d15/d17/d36/d5b/f90 x:0 0 0 2023-12-16T05:56:29.671 INFO:tasks.workunit.client.0.smithi155.stdout:6/383: dwrite d0/d3/d2c/d3e/d4c/f1d [0,4194304] 0 2023-12-16T05:56:29.674 INFO:tasks.workunit.client.0.smithi155.stdout:6/384: rename d0/d3/d2c/d3e/d4c/d44 to d0/d3/d7a 0 2023-12-16T05:56:29.674 INFO:tasks.workunit.client.0.smithi155.stdout:6/385: truncate d0/df/d5e/f61 580577 0 2023-12-16T05:56:29.675 INFO:tasks.workunit.client.0.smithi155.stdout:6/386: creat d0/d3/d2c/d3e/d4c/f7b x:0 0 0 2023-12-16T05:56:29.677 INFO:tasks.workunit.client.0.smithi155.stdout:6/387: rename d0/d3/f5 to d0/f7c 0 2023-12-16T05:56:29.679 INFO:tasks.workunit.client.0.smithi155.stdout:6/388: symlink d0/d3/d2c/d3e/d4c/d1b/l7d 0 2023-12-16T05:56:29.681 INFO:tasks.workunit.client.0.smithi155.stdout:6/389: unlink d0/df/d43/f4a 0 2023-12-16T05:56:29.695 INFO:tasks.workunit.client.0.smithi155.stdout:6/390: dwrite d0/d3/d2c/f30 [4194304,4194304] 0 2023-12-16T05:56:29.696 INFO:tasks.workunit.client.0.smithi155.stdout:6/391: mkdir d0/df/d5e/d7e 0 2023-12-16T05:56:29.710 INFO:tasks.workunit.client.0.smithi155.stdout:6/392: dwrite d0/d3/d2c/d3e/d4c/d1b/f4b [0,4194304] 0 2023-12-16T05:56:29.711 INFO:tasks.workunit.client.0.smithi155.stdout:6/393: mknod d0/d3/d2c/c7f 0 2023-12-16T05:56:29.712 INFO:tasks.workunit.client.0.smithi155.stdout:6/394: mknod d0/c80 0 2023-12-16T05:56:29.713 INFO:tasks.workunit.client.0.smithi155.stdout:6/395: link d0/d3/d2c/d3e/d4c/f15 d0/df/d5e/d46/f81 0 2023-12-16T05:56:29.714 INFO:tasks.workunit.client.0.smithi155.stdout:6/396: creat d0/d3/d7a/f82 x:0 0 0 2023-12-16T05:56:29.715 INFO:tasks.workunit.client.0.smithi155.stdout:6/397: link d0/df/d5e/d46/f47 d0/d3/d7a/d77/f83 0 2023-12-16T05:56:29.716 INFO:tasks.workunit.client.0.smithi155.stdout:6/398: write d0/d3/f1e [2888876,103933] 0 2023-12-16T05:56:29.716 INFO:tasks.workunit.client.0.smithi155.stdout:6/399: truncate d0/d3/d2c/d3e/f64 696349 0 2023-12-16T05:56:29.728 INFO:tasks.workunit.client.0.smithi155.stdout:6/400: dwrite d0/d3/d2c/d3e/d4c/f15 [0,4194304] 0 2023-12-16T05:56:29.728 INFO:tasks.workunit.client.0.smithi155.stdout:6/401: fdatasync d0/d3/d2c/d3e/d4c/d1b/f50 0 2023-12-16T05:56:29.728 INFO:tasks.workunit.client.0.smithi155.stdout:6/402: truncate d0/d3/d2c/d3e/d4c/f51 522288 0 2023-12-16T05:56:29.728 INFO:tasks.workunit.client.0.smithi155.stdout:6/403: chown d0/df/d5e/l79 9873 1 2023-12-16T05:56:29.730 INFO:tasks.workunit.client.0.smithi155.stdout:6/404: rename d0/d3/d2c/d3e/d4c/d1b/l2d to d0/df/d43/l84 0 2023-12-16T05:56:29.731 INFO:tasks.workunit.client.0.smithi155.stdout:6/405: mkdir d0/d3/d67/d85 0 2023-12-16T05:56:29.748 INFO:tasks.workunit.client.0.smithi155.stdout:6/406: dwrite d0/d3/d2c/d3e/d4c/f7b [0,4194304] 0 2023-12-16T05:56:29.748 INFO:tasks.workunit.client.0.smithi155.stdout:6/407: stat d0/df/d5e/d46 0 2023-12-16T05:56:29.750 INFO:tasks.workunit.client.0.smithi155.stdout:6/408: mknod d0/d3/d7a/c86 0 2023-12-16T05:56:29.763 INFO:tasks.workunit.client.0.smithi155.stdout:6/409: dwrite d0/fc [0,4194304] 0 2023-12-16T05:56:29.763 INFO:tasks.workunit.client.0.smithi155.stdout:6/410: write d0/df/d5e/f66 [1397408,66508] 0 2023-12-16T05:56:29.764 INFO:tasks.workunit.client.0.smithi155.stdout:6/411: symlink d0/df/d5e/d5b/l87 0 2023-12-16T05:56:29.789 INFO:tasks.workunit.client.0.smithi155.stdout:5/353: sync 2023-12-16T05:56:29.789 INFO:tasks.workunit.client.0.smithi155.stdout:7/270: sync 2023-12-16T05:56:29.790 INFO:tasks.workunit.client.0.smithi155.stdout:7/271: write d0/d1/d5/d18/d1a/d38/f41 [1062582,91837] 0 2023-12-16T05:56:29.790 INFO:tasks.workunit.client.0.smithi155.stdout:5/354: symlink d0/d2/d2a/d19/d21/d56/l68 0 2023-12-16T05:56:29.791 INFO:tasks.workunit.client.0.smithi155.stdout:7/272: mknod d0/d1/d5/d18/d1a/d22/c59 0 2023-12-16T05:56:29.792 INFO:tasks.workunit.client.0.smithi155.stdout:5/355: link d0/f32 d0/f69 0 2023-12-16T05:56:29.794 INFO:tasks.workunit.client.0.smithi155.stdout:7/273: symlink d0/d1/d5/d18/d1a/d36/l5a 0 2023-12-16T05:56:29.794 INFO:tasks.workunit.client.0.smithi155.stdout:7/274: fsync d0/d1/f44 0 2023-12-16T05:56:29.794 INFO:tasks.workunit.client.0.smithi155.stdout:7/275: chown d0/d1/d5/d18/d1a/d22/d27 15792280 1 2023-12-16T05:56:29.794 INFO:tasks.workunit.client.0.smithi155.stdout:5/356: truncate d0/f1c 3181772 0 2023-12-16T05:56:29.796 INFO:tasks.workunit.client.0.smithi155.stdout:7/276: mknod d0/d1/c5b 0 2023-12-16T05:56:29.798 INFO:tasks.workunit.client.0.smithi155.stdout:7/277: getdents d0/d1/d5/d18/d1a/d22/d3c 0 2023-12-16T05:56:29.803 INFO:tasks.workunit.client.0.smithi155.stdout:5/357: link d0/f1c d0/d2/d2a/d19/d21/f6a 0 2023-12-16T05:56:29.805 INFO:tasks.workunit.client.0.smithi155.stdout:5/358: creat d0/d2/d2a/d3c/d47/f6b x:0 0 0 2023-12-16T05:56:29.805 INFO:tasks.workunit.client.0.smithi155.stdout:5/359: truncate d0/d2/d2a/fd 1520979 0 2023-12-16T05:56:29.806 INFO:tasks.workunit.client.0.smithi155.stdout:5/360: creat d0/d2/d2a/d3c/f6c x:0 0 0 2023-12-16T05:56:29.807 INFO:tasks.workunit.client.0.smithi155.stdout:5/361: symlink d0/d2/d2a/d30/d53/l6d 0 2023-12-16T05:56:29.809 INFO:tasks.workunit.client.0.smithi155.stdout:5/362: link d0/d2/d2a/f44 d0/d2/f6e 0 2023-12-16T05:56:29.861 INFO:tasks.workunit.client.0.smithi155.stdout:5/363: dwrite d0/d2/d2a/d19/f4c [0,4194304] 0 2023-12-16T05:56:29.861 INFO:tasks.workunit.client.0.smithi155.stdout:7/278: dwrite d0/d1/fb [4194304,4194304] 0 2023-12-16T05:56:29.861 INFO:tasks.workunit.client.0.smithi155.stdout:7/279: readlink d0/d1/d5/d18/d1a/d38/l53 0 2023-12-16T05:56:29.864 INFO:tasks.workunit.client.0.smithi155.stdout:7/280: creat d0/d1/d5/d18/d31/f5c x:0 0 0 2023-12-16T05:56:29.865 INFO:tasks.workunit.client.0.smithi155.stdout:7/281: unlink d0/d1/d5/c3b 0 2023-12-16T05:56:29.866 INFO:tasks.workunit.client.0.smithi155.stdout:7/282: mkdir d0/d1/d5/d18/d1a/d2b/d2c/d5d 0 2023-12-16T05:56:29.869 INFO:tasks.workunit.client.0.smithi155.stdout:7/283: dread d0/d1/d5/d18/f28 [0,4194304] 0 2023-12-16T05:56:29.870 INFO:tasks.workunit.client.0.smithi155.stdout:7/284: mknod d0/d1/d5/d18/d1a/d22/d27/d34/d4b/c5e 0 2023-12-16T05:56:29.871 INFO:tasks.workunit.client.0.smithi155.stdout:7/285: write d0/d1/d5/f8 [3236638,49619] 0 2023-12-16T05:56:29.872 INFO:tasks.workunit.client.0.smithi155.stdout:7/286: write d0/f15 [463998,127152] 0 2023-12-16T05:56:29.877 INFO:tasks.workunit.client.0.smithi155.stdout:7/287: write d0/d1/fb [558422,123558] 0 2023-12-16T05:56:29.878 INFO:tasks.workunit.client.0.smithi155.stdout:7/288: rename d0/d1/d5/d18/d1a/f2d to d0/d1/d5/d18/d1a/d22/d27/d34/f5f 0 2023-12-16T05:56:29.879 INFO:tasks.workunit.client.0.smithi155.stdout:7/289: mkdir d0/d1/d5/d18/d1a/d22/d27/d34/d4b/d60 0 2023-12-16T05:56:29.880 INFO:tasks.workunit.client.0.smithi155.stdout:7/290: creat d0/d1/f61 x:0 0 0 2023-12-16T05:56:29.880 INFO:tasks.workunit.client.0.smithi155.stdout:7/291: chown d0/d1/d5/d18/d31/f52 4388 1 2023-12-16T05:56:29.880 INFO:tasks.workunit.client.0.smithi155.stdout:7/292: chown d0/d1/d5/d18/f30 842707 1 2023-12-16T05:56:29.880 INFO:tasks.workunit.client.0.smithi155.stdout:5/364: dwrite d0/f32 [0,4194304] 0 2023-12-16T05:56:29.880 INFO:tasks.workunit.client.0.smithi155.stdout:5/365: stat d0/d2/l43 0 2023-12-16T05:56:29.880 INFO:tasks.workunit.client.0.smithi155.stdout:5/366: mknod d0/c6f 0 2023-12-16T05:56:29.899 INFO:tasks.workunit.client.0.smithi155.stdout:7/293: dwrite d0/d1/f21 [0,4194304] 0 2023-12-16T05:56:29.901 INFO:tasks.workunit.client.0.smithi155.stdout:7/294: creat d0/d1/d5/d18/d1a/d2b/d2c/d5d/f62 x:0 0 0 2023-12-16T05:56:29.901 INFO:tasks.workunit.client.0.smithi155.stdout:5/367: dwrite d0/d2/d2a/d19/d21/f23 [0,4194304] 0 2023-12-16T05:56:29.902 INFO:tasks.workunit.client.0.smithi155.stdout:5/368: creat d0/d2/d2a/d30/f70 x:0 0 0 2023-12-16T05:56:29.909 INFO:tasks.workunit.client.0.smithi155.stdout:5/369: dread d0/d2/d2a/d19/f4c [0,4194304] 0 2023-12-16T05:56:29.912 INFO:tasks.workunit.client.0.smithi155.stdout:2/276: sync 2023-12-16T05:56:29.912 INFO:tasks.workunit.client.0.smithi155.stdout:4/325: sync 2023-12-16T05:56:29.912 INFO:tasks.workunit.client.0.smithi155.stdout:4/326: truncate d0/d10/d22/d3d/d49/f4f 650637 0 2023-12-16T05:56:29.912 INFO:tasks.workunit.client.0.smithi155.stdout:4/327: chown d0/d10/d46/d16/d30/d52/f56 7254 1 2023-12-16T05:56:29.913 INFO:tasks.workunit.client.0.smithi155.stdout:2/277: mkdir d0/d7/dd/d62 0 2023-12-16T05:56:29.913 INFO:tasks.workunit.client.0.smithi155.stdout:2/278: fsync d0/d7/f24 0 2023-12-16T05:56:29.913 INFO:tasks.workunit.client.0.smithi155.stdout:4/328: write d0/d10/d46/d16/d1a/f2b [2507429,74005] 0 2023-12-16T05:56:29.914 INFO:tasks.workunit.client.0.smithi155.stdout:4/329: stat d0/da/c13 0 2023-12-16T05:56:29.914 INFO:tasks.workunit.client.0.smithi155.stdout:4/330: write d0/d10/d46/d16/d1a/f5c [271133,5847] 0 2023-12-16T05:56:29.918 INFO:tasks.workunit.client.0.smithi155.stdout:4/331: rmdir d0/d10/d46/d16/d1a 39 2023-12-16T05:56:29.922 INFO:tasks.workunit.client.0.smithi155.stdout:5/370: dread d0/d2/d2a/f18 [0,4194304] 0 2023-12-16T05:56:29.927 INFO:tasks.workunit.client.0.smithi155.stdout:4/332: dread d0/d10/d22/d3d/d49/f61 [0,4194304] 0 2023-12-16T05:56:29.932 INFO:tasks.workunit.client.0.smithi155.stdout:2/279: dwrite d0/d34/d3c/f55 [0,4194304] 0 2023-12-16T05:56:29.933 INFO:tasks.workunit.client.0.smithi155.stdout:7/295: dwrite d0/d1/d5/d18/f28 [0,4194304] 0 2023-12-16T05:56:29.933 INFO:tasks.workunit.client.0.smithi155.stdout:7/296: readlink d0/d1/d5/l10 0 2023-12-16T05:56:29.933 INFO:tasks.workunit.client.0.smithi155.stdout:7/297: truncate d0/d1/d5/d18/d1a/d22/f25 854180 0 2023-12-16T05:56:29.933 INFO:tasks.workunit.client.0.smithi155.stdout:5/371: dread d0/d2/d2a/f45 [0,4194304] 0 2023-12-16T05:56:29.935 INFO:tasks.workunit.client.0.smithi155.stdout:2/280: mkdir d0/d7/d57/d63 0 2023-12-16T05:56:29.941 INFO:tasks.workunit.client.1.smithi156.stdout:4/21: sync 2023-12-16T05:56:29.941 INFO:tasks.workunit.client.1.smithi156.stdout:4/22: write f2 [673490,88350] 0 2023-12-16T05:56:29.942 INFO:tasks.workunit.client.1.smithi156.stdout:8/44: sync 2023-12-16T05:56:29.942 INFO:tasks.workunit.client.1.smithi156.stdout:8/45: fsync d3/ff 0 2023-12-16T05:56:29.942 INFO:tasks.workunit.client.1.smithi156.stdout:8/46: write d3/ff [968834,96142] 0 2023-12-16T05:56:29.942 INFO:tasks.workunit.client.1.smithi156.stdout:6/15: sync 2023-12-16T05:56:29.942 INFO:tasks.workunit.client.1.smithi156.stdout:0/87: sync 2023-12-16T05:56:29.942 INFO:tasks.workunit.client.1.smithi156.stdout:2/26: sync 2023-12-16T05:56:29.942 INFO:tasks.workunit.client.1.smithi156.stdout:0/88: rename d2 to d2/d13 22 2023-12-16T05:56:29.942 INFO:tasks.workunit.client.1.smithi156.stdout:7/121: sync 2023-12-16T05:56:29.942 INFO:tasks.workunit.client.1.smithi156.stdout:1/2: sync 2023-12-16T05:56:29.942 INFO:tasks.workunit.client.1.smithi156.stdout:1/3: read - no filename 2023-12-16T05:56:29.942 INFO:tasks.workunit.client.1.smithi156.stdout:1/4: rmdir - no directory 2023-12-16T05:56:29.942 INFO:tasks.workunit.client.1.smithi156.stdout:1/5: unlink - no file 2023-12-16T05:56:29.942 INFO:tasks.workunit.client.1.smithi156.stdout:1/6: dread - no filename 2023-12-16T05:56:29.942 INFO:tasks.workunit.client.1.smithi156.stdout:5/52: sync 2023-12-16T05:56:29.942 INFO:tasks.workunit.client.1.smithi156.stdout:1/7: dread - no filename 2023-12-16T05:56:29.942 INFO:tasks.workunit.client.1.smithi156.stdout:5/53: fsync da/dc/f10 0 2023-12-16T05:56:29.943 INFO:tasks.workunit.client.1.smithi156.stdout:5/54: dread - da/dc/ff zero size 2023-12-16T05:56:29.943 INFO:tasks.workunit.client.1.smithi156.stdout:3/0: sync 2023-12-16T05:56:29.943 INFO:tasks.workunit.client.1.smithi156.stdout:3/1: dwrite - no filename 2023-12-16T05:56:29.943 INFO:tasks.workunit.client.1.smithi156.stdout:3/2: dwrite - no filename 2023-12-16T05:56:29.943 INFO:tasks.workunit.client.1.smithi156.stdout:9/34: sync 2023-12-16T05:56:29.943 INFO:tasks.workunit.client.1.smithi156.stdout:9/35: fdatasync d6/f7 0 2023-12-16T05:56:29.944 INFO:tasks.workunit.client.0.smithi155.stdout:7/298: symlink d0/d1/d5/d18/d31/l63 0 2023-12-16T05:56:29.944 INFO:tasks.workunit.client.0.smithi155.stdout:7/299: readlink d0/d1/d5/d18/d1a/d2b/d2c/l45 0 2023-12-16T05:56:29.944 INFO:tasks.workunit.client.0.smithi155.stdout:7/300: readlink d0/d1/l17 0 2023-12-16T05:56:29.944 INFO:tasks.workunit.client.0.smithi155.stdout:7/301: dread - d0/d1/d5/d18/d1a/d22/d27/d34/d4b/f51 zero size 2023-12-16T05:56:29.944 INFO:tasks.workunit.client.0.smithi155.stdout:7/302: write d0/d1/f61 [509296,23692] 0 2023-12-16T05:56:29.944 INFO:tasks.workunit.client.0.smithi155.stdout:5/372: mkdir d0/d2/d2a/d19/d71 0 2023-12-16T05:56:29.944 INFO:tasks.workunit.client.0.smithi155.stdout:5/373: getdents d0/d2 0 2023-12-16T05:56:29.944 INFO:tasks.workunit.client.1.smithi156.stdout:2/27: creat d9/fa x:0 0 0 2023-12-16T05:56:29.950 INFO:tasks.workunit.client.0.smithi155.stdout:2/281: dread d0/d7/d1f/d3b/f46 [0,4194304] 0 2023-12-16T05:56:29.950 INFO:tasks.workunit.client.0.smithi155.stdout:2/282: chown d0/d34/d3c 245404258 1 2023-12-16T05:56:29.952 INFO:tasks.workunit.client.1.smithi156.stdout:1/8: creat f0 x:0 0 0 2023-12-16T05:56:29.952 INFO:tasks.workunit.client.1.smithi156.stdout:5/55: creat da/dc/f11 x:0 0 0 2023-12-16T05:56:29.952 INFO:tasks.workunit.client.1.smithi156.stdout:3/3: symlink l0 0 2023-12-16T05:56:29.955 INFO:tasks.workunit.client.1.smithi156.stdout:9/36: mknod d6/cc 0 2023-12-16T05:56:29.955 INFO:tasks.workunit.client.1.smithi156.stdout:9/37: chown d6/f7 516065028 1 2023-12-16T05:56:29.957 INFO:tasks.workunit.client.1.smithi156.stdout:2/28: creat d9/fb x:0 0 0 2023-12-16T05:56:29.960 INFO:tasks.workunit.client.1.smithi156.stdout:1/9: link f0 f1 0 2023-12-16T05:56:29.961 INFO:tasks.workunit.client.1.smithi156.stdout:1/10: write f0 [395042,36334] 0 2023-12-16T05:56:29.961 INFO:tasks.workunit.client.1.smithi156.stdout:1/11: truncate f1 1149158 0 2023-12-16T05:56:29.961 INFO:tasks.workunit.client.0.smithi155.stdout:2/283: mknod d0/d7/d1f/d3b/c64 0 2023-12-16T05:56:29.961 INFO:tasks.workunit.client.0.smithi155.stdout:2/284: read - d0/f52 zero size 2023-12-16T05:56:29.965 INFO:tasks.workunit.client.0.smithi155.stdout:2/285: creat d0/d5/d6/df/f65 x:0 0 0 2023-12-16T05:56:29.965 INFO:tasks.workunit.client.0.smithi155.stdout:2/286: chown d0/f30 79238783 1 2023-12-16T05:56:29.965 INFO:tasks.workunit.client.0.smithi155.stdout:2/287: readlink d0/d34/l4d 0 2023-12-16T05:56:29.965 INFO:tasks.workunit.client.0.smithi155.stdout:2/288: read - d0/d5/d6/df/f58 zero size 2023-12-16T05:56:29.965 INFO:tasks.workunit.client.1.smithi156.stdout:9/38: rename d6/f7 to d6/fd 0 2023-12-16T05:56:29.965 INFO:tasks.workunit.client.1.smithi156.stdout:9/39: chown d6 27 1 2023-12-16T05:56:29.965 INFO:tasks.workunit.client.1.smithi156.stdout:9/40: write d6/f9 [4842328,75215] 0 2023-12-16T05:56:29.966 INFO:tasks.workunit.client.1.smithi156.stdout:2/29: mkdir d9/dc 0 2023-12-16T05:56:29.966 INFO:tasks.workunit.client.1.smithi156.stdout:2/30: truncate f8 51766 0 2023-12-16T05:56:29.966 INFO:tasks.workunit.client.1.smithi156.stdout:2/31: readlink l6 0 2023-12-16T05:56:29.966 INFO:tasks.workunit.client.1.smithi156.stdout:2/32: chown d9/fb 4 1 2023-12-16T05:56:29.966 INFO:tasks.workunit.client.1.smithi156.stdout:2/33: dread - d9/fa zero size 2023-12-16T05:56:29.967 INFO:tasks.workunit.client.0.smithi155.stdout:4/333: dwrite d0/d10/f3b [0,4194304] 0 2023-12-16T05:56:29.968 INFO:tasks.workunit.client.1.smithi156.stdout:0/89: write d2/fe [1664577,31790] 0 2023-12-16T05:56:29.968 INFO:tasks.workunit.client.1.smithi156.stdout:1/12: symlink l2 0 2023-12-16T05:56:29.969 INFO:tasks.workunit.client.0.smithi155.stdout:8/255: sync 2023-12-16T05:56:29.970 INFO:tasks.workunit.client.1.smithi156.stdout:9/41: creat d6/fe x:0 0 0 2023-12-16T05:56:29.970 INFO:tasks.workunit.client.1.smithi156.stdout:9/42: read - d6/fe zero size 2023-12-16T05:56:29.972 INFO:tasks.workunit.client.1.smithi156.stdout:2/34: mkdir d9/dd 0 2023-12-16T05:56:29.972 INFO:tasks.workunit.client.0.smithi155.stdout:3/235: sync 2023-12-16T05:56:29.972 INFO:tasks.workunit.client.0.smithi155.stdout:3/236: chown d0/d14 28 1 2023-12-16T05:56:29.974 INFO:tasks.workunit.client.0.smithi155.stdout:7/303: dwrite d0/d1/d5/d18/d1a/d22/f23 [0,4194304] 0 2023-12-16T05:56:29.974 INFO:tasks.workunit.client.0.smithi155.stdout:7/304: chown d0/d1/d5/d18/d1a/d22/d27/l43 63303001 1 2023-12-16T05:56:29.976 INFO:tasks.workunit.client.1.smithi156.stdout:7/122: rename f1b to d1e/d1f/d22/f23 0 2023-12-16T05:56:29.976 INFO:tasks.workunit.client.1.smithi156.stdout:7/123: chown f4 205176887 1 2023-12-16T05:56:29.976 INFO:tasks.workunit.client.1.smithi156.stdout:7/124: chown c18 25601908 1 2023-12-16T05:56:29.976 INFO:tasks.workunit.client.1.smithi156.stdout:7/125: dread - d1e/f21 zero size 2023-12-16T05:56:29.976 INFO:tasks.workunit.client.1.smithi156.stdout:2/35: link f7 d9/dc/fe 0 2023-12-16T05:56:29.976 INFO:tasks.workunit.client.1.smithi156.stdout:2/36: truncate d9/fa 262242 0 2023-12-16T05:56:29.976 INFO:tasks.workunit.client.1.smithi156.stdout:2/37: dread - d9/dc/fe zero size 2023-12-16T05:56:29.978 INFO:tasks.workunit.client.0.smithi155.stdout:7/305: mkdir d0/d1/d5/d18/d1a/d22/d27/d34/d4b/d64 0 2023-12-16T05:56:29.978 INFO:tasks.workunit.client.0.smithi155.stdout:8/256: symlink d4/da/l44 0 2023-12-16T05:56:29.979 INFO:tasks.workunit.client.0.smithi155.stdout:7/306: mkdir d0/d1/d5/d18/d1a/d2b/d65 0 2023-12-16T05:56:29.980 INFO:tasks.workunit.client.1.smithi156.stdout:7/126: unlink c18 0 2023-12-16T05:56:29.982 INFO:tasks.workunit.client.0.smithi155.stdout:7/307: mknod d0/d1/d5/d18/c66 0 2023-12-16T05:56:29.983 INFO:tasks.workunit.client.0.smithi155.stdout:8/257: creat d4/da/d1b/d1c/f45 x:0 0 0 2023-12-16T05:56:29.984 INFO:tasks.workunit.client.1.smithi156.stdout:8/47: dwrite d3/ff [0,4194304] 0 2023-12-16T05:56:29.984 INFO:tasks.workunit.client.1.smithi156.stdout:2/38: symlink d9/dc/lf 0 2023-12-16T05:56:29.985 INFO:tasks.workunit.client.1.smithi156.stdout:7/127: creat d1e/f24 x:0 0 0 2023-12-16T05:56:29.985 INFO:tasks.workunit.client.1.smithi156.stdout:2/39: chown d9/dc 45 1 2023-12-16T05:56:29.985 INFO:tasks.workunit.client.0.smithi155.stdout:8/258: unlink d4/da/d1b/d1c/d1a/d1f/l3e 0 2023-12-16T05:56:29.986 INFO:tasks.workunit.client.0.smithi155.stdout:5/374: dwrite d0/d2/d2a/f4d [0,4194304] 0 2023-12-16T05:56:29.988 INFO:tasks.workunit.client.1.smithi156.stdout:6/16: dwrite f0 [0,4194304] 0 2023-12-16T05:56:29.988 INFO:tasks.workunit.client.0.smithi155.stdout:8/259: mkdir d4/da/d1b/d1c/d46 0 2023-12-16T05:56:29.990 INFO:tasks.workunit.client.0.smithi155.stdout:5/375: symlink d0/d2/d2a/d19/d71/l72 0 2023-12-16T05:56:29.990 INFO:tasks.workunit.client.0.smithi155.stdout:5/376: truncate d0/d2/d2a/d30/f70 1036287 0 2023-12-16T05:56:29.990 INFO:tasks.workunit.client.0.smithi155.stdout:5/377: write d0/f1c [4006268,11676] 0 2023-12-16T05:56:29.990 INFO:tasks.workunit.client.0.smithi155.stdout:5/378: creat d0/d2/d2a/d3c/d47/f73 x:0 0 0 2023-12-16T05:56:29.991 INFO:tasks.workunit.client.0.smithi155.stdout:5/379: getdents d0/d2/d2a/d3c/d47/d61 0 2023-12-16T05:56:29.993 INFO:tasks.workunit.client.1.smithi156.stdout:4/23: dwrite f3 [0,4194304] 0 2023-12-16T05:56:29.993 INFO:tasks.workunit.client.1.smithi156.stdout:4/24: truncate f3 4634327 0 2023-12-16T05:56:29.994 INFO:tasks.workunit.client.1.smithi156.stdout:9/43: write d6/f9 [4237428,112929] 0 2023-12-16T05:56:29.999 INFO:tasks.workunit.client.1.smithi156.stdout:6/17: mknod c4 0 2023-12-16T05:56:30.000 INFO:tasks.workunit.client.1.smithi156.stdout:3/4: getdents . 0 2023-12-16T05:56:30.001 INFO:tasks.workunit.client.0.smithi155.stdout:2/289: dwrite d0/d7/d1f/f4a [0,4194304] 0 2023-12-16T05:56:30.001 INFO:tasks.workunit.client.0.smithi155.stdout:2/290: chown d0/d5/d6/df/f65 9766974 1 2023-12-16T05:56:30.005 INFO:tasks.workunit.client.1.smithi156.stdout:9/44: rename d6/f9 to d6/ff 0 2023-12-16T05:56:30.006 INFO:tasks.workunit.client.1.smithi156.stdout:1/13: fsync f1 0 2023-12-16T05:56:30.007 INFO:tasks.workunit.client.0.smithi155.stdout:8/260: dread d4/da/d1b/d1c/d1a/f3d [0,4194304] 0 2023-12-16T05:56:30.007 INFO:tasks.workunit.client.0.smithi155.stdout:8/261: fsync d4/da/d1b/d1c/d1a/f3a 0 2023-12-16T05:56:30.008 INFO:tasks.workunit.client.1.smithi156.stdout:6/18: rename f3 to f5 0 2023-12-16T05:56:30.010 INFO:tasks.workunit.client.1.smithi156.stdout:3/5: link l0 l1 0 2023-12-16T05:56:30.010 INFO:tasks.workunit.client.1.smithi156.stdout:3/6: fdatasync - no filename 2023-12-16T05:56:30.014 INFO:tasks.workunit.client.0.smithi155.stdout:5/380: creat d0/d60/f74 x:0 0 0 2023-12-16T05:56:30.014 INFO:tasks.workunit.client.0.smithi155.stdout:5/381: fdatasync d0/f69 0 2023-12-16T05:56:30.015 INFO:tasks.workunit.client.1.smithi156.stdout:3/7: rename l0 to l2 0 2023-12-16T05:56:30.015 INFO:tasks.workunit.client.1.smithi156.stdout:3/8: read - no filename 2023-12-16T05:56:30.015 INFO:tasks.workunit.client.1.smithi156.stdout:3/9: dread - no filename 2023-12-16T05:56:30.015 INFO:tasks.workunit.client.1.smithi156.stdout:9/45: creat d6/f10 x:0 0 0 2023-12-16T05:56:30.016 INFO:tasks.workunit.client.1.smithi156.stdout:1/14: mkdir d3 0 2023-12-16T05:56:30.016 INFO:tasks.workunit.client.1.smithi156.stdout:1/15: fdatasync f0 0 2023-12-16T05:56:30.016 INFO:tasks.workunit.client.1.smithi156.stdout:1/16: fsync f1 0 2023-12-16T05:56:30.019 INFO:tasks.workunit.client.0.smithi155.stdout:5/382: rename d0/d2/d2a/d19/f3e to d0/d2/d2a/d30/f75 0 2023-12-16T05:56:30.019 INFO:tasks.workunit.client.0.smithi155.stdout:1/404: sync 2023-12-16T05:56:30.020 INFO:tasks.workunit.client.0.smithi155.stdout:5/383: symlink d0/d2/l76 0 2023-12-16T05:56:30.021 INFO:tasks.workunit.client.1.smithi156.stdout:9/46: symlink d6/l11 0 2023-12-16T05:56:30.021 INFO:tasks.workunit.client.1.smithi156.stdout:3/10: creat f3 x:0 0 0 2023-12-16T05:56:30.021 INFO:tasks.workunit.client.0.smithi155.stdout:7/308: dwrite d0/d1/d5/d18/d1a/d38/f41 [4194304,4194304] 0 2023-12-16T05:56:30.022 INFO:tasks.workunit.client.1.smithi156.stdout:1/17: creat d3/f4 x:0 0 0 2023-12-16T05:56:30.023 INFO:tasks.workunit.client.0.smithi155.stdout:5/384: creat d0/d2/d2a/d30/f77 x:0 0 0 2023-12-16T05:56:30.024 INFO:tasks.workunit.client.1.smithi156.stdout:2/40: rmdir d9 39 2023-12-16T05:56:30.024 INFO:tasks.workunit.client.0.smithi155.stdout:1/405: rmdir d1/d17/d28 39 2023-12-16T05:56:30.024 INFO:tasks.workunit.client.0.smithi155.stdout:8/262: dread d4/da/fb [0,4194304] 0 2023-12-16T05:56:30.025 INFO:tasks.workunit.client.1.smithi156.stdout:1/18: dread f1 [0,4194304] 0 2023-12-16T05:56:30.025 INFO:tasks.workunit.client.1.smithi156.stdout:1/19: chown l2 0 1 2023-12-16T05:56:30.025 INFO:tasks.workunit.client.1.smithi156.stdout:1/20: chown f0 46 1 2023-12-16T05:56:30.025 INFO:tasks.workunit.client.1.smithi156.stdout:1/21: chown d3 254666978 1 2023-12-16T05:56:30.027 INFO:tasks.workunit.client.0.smithi155.stdout:7/309: unlink d0/d1/d5/d18/d1a/d2b/d2c/f55 0 2023-12-16T05:56:30.027 INFO:tasks.workunit.client.0.smithi155.stdout:7/310: dread - d0/d1/d5/d18/d31/f5c zero size 2023-12-16T05:56:30.027 INFO:tasks.workunit.client.1.smithi156.stdout:9/47: symlink d6/l12 0 2023-12-16T05:56:30.030 INFO:tasks.workunit.client.0.smithi155.stdout:8/263: symlink d4/da/d1b/l47 0 2023-12-16T05:56:30.030 INFO:tasks.workunit.client.1.smithi156.stdout:1/22: rename d3/f4 to d3/f5 0 2023-12-16T05:56:30.032 INFO:tasks.workunit.client.0.smithi155.stdout:8/264: unlink d4/da/d1b/d1c/f13 0 2023-12-16T05:56:30.032 INFO:tasks.workunit.client.1.smithi156.stdout:9/48: creat d6/f13 x:0 0 0 2023-12-16T05:56:30.032 INFO:tasks.workunit.client.1.smithi156.stdout:2/41: creat d9/dc/f10 x:0 0 0 2023-12-16T05:56:30.032 INFO:tasks.workunit.client.1.smithi156.stdout:2/42: chown d9 22971 1 2023-12-16T05:56:30.033 INFO:tasks.workunit.client.1.smithi156.stdout:2/43: getdents d9/dd 0 2023-12-16T05:56:30.033 INFO:tasks.workunit.client.0.smithi155.stdout:8/265: symlink d4/da/d1b/d1c/d1a/d1f/d29/l48 0 2023-12-16T05:56:30.033 INFO:tasks.workunit.client.1.smithi156.stdout:9/49: truncate f3 1236635 0 2023-12-16T05:56:30.034 INFO:tasks.workunit.client.0.smithi155.stdout:8/266: mknod d4/da/d1b/d1c/d46/c49 0 2023-12-16T05:56:30.036 INFO:tasks.workunit.client.1.smithi156.stdout:4/25: write f3 [5145547,114075] 0 2023-12-16T05:56:30.037 INFO:tasks.workunit.client.0.smithi155.stdout:8/267: mknod d4/da/d1b/d1c/d1a/d1f/d29/c4a 0 2023-12-16T05:56:30.037 INFO:tasks.workunit.client.1.smithi156.stdout:4/26: creat f5 x:0 0 0 2023-12-16T05:56:30.037 INFO:tasks.workunit.client.1.smithi156.stdout:4/27: readlink - no filename 2023-12-16T05:56:30.038 INFO:tasks.workunit.client.1.smithi156.stdout:4/28: stat f3 0 2023-12-16T05:56:30.038 INFO:tasks.workunit.client.1.smithi156.stdout:4/29: chown f0 83 1 2023-12-16T05:56:30.038 INFO:tasks.workunit.client.0.smithi155.stdout:8/268: mknod d4/da/d1b/d1c/d46/c4b 0 2023-12-16T05:56:30.038 INFO:tasks.workunit.client.1.smithi156.stdout:4/30: creat f6 x:0 0 0 2023-12-16T05:56:30.040 INFO:tasks.workunit.client.1.smithi156.stdout:4/31: creat f7 x:0 0 0 2023-12-16T05:56:30.040 INFO:tasks.workunit.client.1.smithi156.stdout:6/19: dread f0 [0,4194304] 0 2023-12-16T05:56:30.041 INFO:tasks.workunit.client.0.smithi155.stdout:8/269: creat d4/da/f4c x:0 0 0 2023-12-16T05:56:30.041 INFO:tasks.workunit.client.1.smithi156.stdout:4/32: creat f8 x:0 0 0 2023-12-16T05:56:30.041 INFO:tasks.workunit.client.1.smithi156.stdout:4/33: write f2 [1686323,48065] 0 2023-12-16T05:56:30.041 INFO:tasks.workunit.client.1.smithi156.stdout:6/20: truncate f5 2714161 0 2023-12-16T05:56:30.042 INFO:tasks.workunit.client.0.smithi155.stdout:7/311: dread d0/d1/f21 [0,4194304] 0 2023-12-16T05:56:30.044 INFO:tasks.workunit.client.1.smithi156.stdout:4/34: mkdir d9 0 2023-12-16T05:56:30.045 INFO:tasks.workunit.client.1.smithi156.stdout:8/48: dwrite f2 [0,4194304] 0 2023-12-16T05:56:30.046 INFO:tasks.workunit.client.1.smithi156.stdout:8/49: creat d3/d6/f10 x:0 0 0 2023-12-16T05:56:30.048 INFO:tasks.workunit.client.1.smithi156.stdout:8/50: mknod d3/d7/d9/c11 0 2023-12-16T05:56:30.048 INFO:tasks.workunit.client.1.smithi156.stdout:8/51: write d3/fe [875463,46247] 0 2023-12-16T05:56:30.050 INFO:tasks.workunit.client.0.smithi155.stdout:7/312: creat d0/d1/f67 x:0 0 0 2023-12-16T05:56:30.052 INFO:tasks.workunit.client.0.smithi155.stdout:7/313: rename d0/d1/d5/d18/d1a/d2b/d2c/l56 to d0/d1/d5/d18/d31/l68 0 2023-12-16T05:56:30.052 INFO:tasks.workunit.client.0.smithi155.stdout:7/314: write d0/d1/d5/d18/d31/f5c [83249,31392] 0 2023-12-16T05:56:30.055 INFO:tasks.workunit.client.0.smithi155.stdout:7/315: mknod d0/d1/d5/d18/d1a/d22/c69 0 2023-12-16T05:56:30.056 INFO:tasks.workunit.client.1.smithi156.stdout:8/52: dread d3/d6/f5 [0,4194304] 0 2023-12-16T05:56:30.056 INFO:tasks.workunit.client.1.smithi156.stdout:8/53: chown f2 3545636 1 2023-12-16T05:56:30.061 INFO:tasks.workunit.client.1.smithi156.stdout:5/56: dwrite da/dc/f10 [0,4194304] 0 2023-12-16T05:56:30.062 INFO:tasks.workunit.client.0.smithi155.stdout:4/334: dwrite d0/d10/d22/d3d/d49/f61 [0,4194304] 0 2023-12-16T05:56:30.062 INFO:tasks.workunit.client.0.smithi155.stdout:2/291: dwrite d0/d5/d6/df/f1b [0,4194304] 0 2023-12-16T05:56:30.062 INFO:tasks.workunit.client.0.smithi155.stdout:2/292: chown d0/d7/dd/d14/f19 2388068 1 2023-12-16T05:56:30.065 INFO:tasks.workunit.client.1.smithi156.stdout:5/57: rename l1 to da/l12 0 2023-12-16T05:56:30.068 INFO:tasks.workunit.client.1.smithi156.stdout:3/11: dwrite f3 [0,4194304] 0 2023-12-16T05:56:30.068 INFO:tasks.workunit.client.0.smithi155.stdout:4/335: dread d0/d10/f26 [0,4194304] 0 2023-12-16T05:56:30.070 INFO:tasks.workunit.client.1.smithi156.stdout:3/12: read f3 [1071431,15991] 0 2023-12-16T05:56:30.071 INFO:tasks.workunit.client.0.smithi155.stdout:9/406: sync 2023-12-16T05:56:30.071 INFO:tasks.workunit.client.0.smithi155.stdout:9/407: dread - da/d15/f5e zero size 2023-12-16T05:56:30.071 INFO:tasks.workunit.client.0.smithi155.stdout:9/408: chown da/d15/d17/d24/d26/d2e/d83/c8b 491726 1 2023-12-16T05:56:30.071 INFO:tasks.workunit.client.0.smithi155.stdout:6/412: sync 2023-12-16T05:56:30.071 INFO:tasks.workunit.client.0.smithi155.stdout:0/273: sync 2023-12-16T05:56:30.071 INFO:tasks.workunit.client.0.smithi155.stdout:0/274: chown d7/df/d41/c21 24 1 2023-12-16T05:56:30.071 INFO:tasks.workunit.client.0.smithi155.stdout:0/275: fsync d7/fb 0 2023-12-16T05:56:30.074 INFO:tasks.workunit.client.0.smithi155.stdout:0/276: mkdir d7/d47/d53 0 2023-12-16T05:56:30.074 INFO:tasks.workunit.client.0.smithi155.stdout:0/277: write d7/f2a [1461676,124259] 0 2023-12-16T05:56:30.075 INFO:tasks.workunit.client.0.smithi155.stdout:0/278: fdatasync f2 0 2023-12-16T05:56:30.077 INFO:tasks.workunit.client.0.smithi155.stdout:5/385: dwrite d0/d2/d2a/d19/f20 [0,4194304] 0 2023-12-16T05:56:30.078 INFO:tasks.workunit.client.0.smithi155.stdout:2/293: dread d0/f32 [0,4194304] 0 2023-12-16T05:56:30.079 INFO:tasks.workunit.client.1.smithi156.stdout:2/44: dwrite f5 [0,4194304] 0 2023-12-16T05:56:30.081 INFO:tasks.workunit.client.0.smithi155.stdout:5/386: creat d0/d2/d2a/d19/d21/f78 x:0 0 0 2023-12-16T05:56:30.081 INFO:tasks.workunit.client.0.smithi155.stdout:5/387: chown d0/d2/d2a/d19/f38 1559 1 2023-12-16T05:56:30.081 INFO:tasks.workunit.client.0.smithi155.stdout:9/409: write da/d15/f45 [525398,107458] 0 2023-12-16T05:56:30.081 INFO:tasks.workunit.client.0.smithi155.stdout:8/270: dwrite d4/da/d1b/d2a/f39 [0,4194304] 0 2023-12-16T05:56:30.081 INFO:tasks.workunit.client.0.smithi155.stdout:8/271: chown d4/da/d1b/d1c/d1a/d1f/d29/c4a 16756 1 2023-12-16T05:56:30.081 INFO:tasks.workunit.client.0.smithi155.stdout:2/294: mkdir d0/d7/dd/d62/d66 0 2023-12-16T05:56:30.082 INFO:tasks.workunit.client.0.smithi155.stdout:5/388: mkdir d0/d60/d79 0 2023-12-16T05:56:30.083 INFO:tasks.workunit.client.0.smithi155.stdout:8/272: symlink d4/da/d1b/d1c/d1a/l4d 0 2023-12-16T05:56:30.085 INFO:tasks.workunit.client.0.smithi155.stdout:2/295: rename d0/d5/l11 to d0/l67 0 2023-12-16T05:56:30.088 INFO:tasks.workunit.client.0.smithi155.stdout:5/389: rename d0/d2/d2a/d30/d53/l6d to d0/d2/d2a/d3c/l7a 0 2023-12-16T05:56:30.089 INFO:tasks.workunit.client.0.smithi155.stdout:5/390: write d0/d2/d2a/d3c/f5c [285500,48107] 0 2023-12-16T05:56:30.089 INFO:tasks.workunit.client.0.smithi155.stdout:5/391: read - d0/d2/d2a/d19/d48/f58 zero size 2023-12-16T05:56:30.091 INFO:tasks.workunit.client.0.smithi155.stdout:5/392: write d0/d2/d2a/fe [6546332,50370] 0 2023-12-16T05:56:30.091 INFO:tasks.workunit.client.0.smithi155.stdout:8/273: link d4/da/c1d d4/da/d1b/d1c/c4e 0 2023-12-16T05:56:30.092 INFO:tasks.workunit.client.1.smithi156.stdout:3/13: dread f3 [0,4194304] 0 2023-12-16T05:56:30.092 INFO:tasks.workunit.client.0.smithi155.stdout:2/296: mknod d0/d7/c68 0 2023-12-16T05:56:30.093 INFO:tasks.workunit.client.1.smithi156.stdout:1/23: dwrite d3/f5 [0,4194304] 0 2023-12-16T05:56:30.093 INFO:tasks.workunit.client.0.smithi155.stdout:8/274: dread d4/da/d1b/d1c/d1a/f2d [0,4194304] 0 2023-12-16T05:56:30.095 INFO:tasks.workunit.client.1.smithi156.stdout:1/24: dread f0 [0,4194304] 0 2023-12-16T05:56:30.095 INFO:tasks.workunit.client.1.smithi156.stdout:1/25: chown f0 0 1 2023-12-16T05:56:30.095 INFO:tasks.workunit.client.1.smithi156.stdout:1/26: chown d3 90 1 2023-12-16T05:56:30.095 INFO:tasks.workunit.client.1.smithi156.stdout:1/27: chown l2 258119857 1 2023-12-16T05:56:30.095 INFO:tasks.workunit.client.1.smithi156.stdout:1/28: stat d3/f5 0 2023-12-16T05:56:30.096 INFO:tasks.workunit.client.0.smithi155.stdout:6/413: dwrite d0/d3/d2c/d3e/d4c/f33 [0,4194304] 0 2023-12-16T05:56:30.097 INFO:tasks.workunit.client.0.smithi155.stdout:6/414: mknod d0/d3/d2c/d3e/c88 0 2023-12-16T05:56:30.098 INFO:tasks.workunit.client.1.smithi156.stdout:1/29: creat d3/f6 x:0 0 0 2023-12-16T05:56:30.098 INFO:tasks.workunit.client.1.smithi156.stdout:1/30: chown f0 165 1 2023-12-16T05:56:30.098 INFO:tasks.workunit.client.1.smithi156.stdout:6/21: dwrite f0 [0,4194304] 0 2023-12-16T05:56:30.099 INFO:tasks.workunit.client.0.smithi155.stdout:6/415: creat d0/df/d5e/d7e/f89 x:0 0 0 2023-12-16T05:56:30.099 INFO:tasks.workunit.client.0.smithi155.stdout:6/416: readlink d0/d3/d2c/d3e/d4c/d1b/l7d 0 2023-12-16T05:56:30.099 INFO:tasks.workunit.client.0.smithi155.stdout:6/417: stat d0/d3/d2c/d3e/d4c 0 2023-12-16T05:56:30.100 INFO:tasks.workunit.client.0.smithi155.stdout:4/336: dwrite d0/d10/f12 [4194304,4194304] 0 2023-12-16T05:56:30.100 INFO:tasks.workunit.client.0.smithi155.stdout:4/337: chown d0/d10/d46/d16/c1e 0 1 2023-12-16T05:56:30.100 INFO:tasks.workunit.client.0.smithi155.stdout:4/338: fsync d0/d10/d22/d3d/d49/f4f 0 2023-12-16T05:56:30.101 INFO:tasks.workunit.client.1.smithi156.stdout:6/22: link f1 f6 0 2023-12-16T05:56:30.101 INFO:tasks.workunit.client.1.smithi156.stdout:6/23: stat f6 0 2023-12-16T05:56:30.101 INFO:tasks.workunit.client.1.smithi156.stdout:6/24: rmdir - no directory 2023-12-16T05:56:30.101 INFO:tasks.workunit.client.1.smithi156.stdout:6/25: write f0 [4784891,100444] 0 2023-12-16T05:56:30.101 INFO:tasks.workunit.client.0.smithi155.stdout:7/316: dwrite d0/d1/d5/f9 [0,4194304] 0 2023-12-16T05:56:30.102 INFO:tasks.workunit.client.1.smithi156.stdout:9/50: rmdir d6 39 2023-12-16T05:56:30.105 INFO:tasks.workunit.client.0.smithi155.stdout:2/297: write d0/f4 [2372345,98995] 0 2023-12-16T05:56:30.106 INFO:tasks.workunit.client.1.smithi156.stdout:9/51: creat d6/f14 x:0 0 0 2023-12-16T05:56:30.108 INFO:tasks.workunit.client.0.smithi155.stdout:2/298: unlink d0/d7/d1f/d3b/l59 0 2023-12-16T05:56:30.108 INFO:tasks.workunit.client.0.smithi155.stdout:2/299: readlink d0/d7/dd/d14/l37 0 2023-12-16T05:56:30.108 INFO:tasks.workunit.client.0.smithi155.stdout:2/300: chown d0/d7/dd/d45 2042188 1 2023-12-16T05:56:30.108 INFO:tasks.workunit.client.0.smithi155.stdout:2/301: chown d0/f30 1760014014 1 2023-12-16T05:56:30.110 INFO:tasks.workunit.client.0.smithi155.stdout:8/275: write d4/da/f25 [3341765,100109] 0 2023-12-16T05:56:30.110 INFO:tasks.workunit.client.0.smithi155.stdout:8/276: truncate d4/da/d1b/d1c/d1a/f3f 860331 0 2023-12-16T05:56:30.110 INFO:tasks.workunit.client.0.smithi155.stdout:8/277: write d4/ff [991147,19009] 0 2023-12-16T05:56:30.110 INFO:tasks.workunit.client.0.smithi155.stdout:8/278: dread - d4/da/f4c zero size 2023-12-16T05:56:30.110 INFO:tasks.workunit.client.0.smithi155.stdout:8/279: chown d4/da/d1b 13 1 2023-12-16T05:56:30.110 INFO:tasks.workunit.client.0.smithi155.stdout:7/317: dread d0/d1/d5/fd [0,4194304] 0 2023-12-16T05:56:30.111 INFO:tasks.workunit.client.0.smithi155.stdout:2/302: rename d0/d5/d6/df to d0/d7/d69 0 2023-12-16T05:56:30.114 INFO:tasks.workunit.client.0.smithi155.stdout:8/280: mkdir d4/da/d1b/d1c/d1a/d1f/d4f 0 2023-12-16T05:56:30.114 INFO:tasks.workunit.client.0.smithi155.stdout:8/281: dread - d4/da/d1b/d1c/f45 zero size 2023-12-16T05:56:30.118 INFO:tasks.workunit.client.1.smithi156.stdout:9/52: creat d6/f15 x:0 0 0 2023-12-16T05:56:30.118 INFO:tasks.workunit.client.1.smithi156.stdout:9/53: truncate d6/fe 612855 0 2023-12-16T05:56:30.118 INFO:tasks.workunit.client.1.smithi156.stdout:6/26: fsync f5 0 2023-12-16T05:56:30.118 INFO:tasks.workunit.client.1.smithi156.stdout:3/14: write f3 [4380128,25361] 0 2023-12-16T05:56:30.120 INFO:tasks.workunit.client.0.smithi155.stdout:9/410: dwrite da/d15/d17/d24/d26/f58 [0,4194304] 0 2023-12-16T05:56:30.121 INFO:tasks.workunit.client.1.smithi156.stdout:9/54: symlink d6/l16 0 2023-12-16T05:56:30.121 INFO:tasks.workunit.client.1.smithi156.stdout:9/55: chown d6/f13 6 1 2023-12-16T05:56:30.121 INFO:tasks.workunit.client.1.smithi156.stdout:6/27: unlink f0 0 2023-12-16T05:56:30.123 INFO:tasks.workunit.client.0.smithi155.stdout:0/279: dwrite d7/fe [0,4194304] 0 2023-12-16T05:56:30.124 INFO:tasks.workunit.client.1.smithi156.stdout:9/56: creat d6/f17 x:0 0 0 2023-12-16T05:56:30.125 INFO:tasks.workunit.client.0.smithi155.stdout:5/393: dwrite d0/d2/d2a/f18 [4194304,4194304] 0 2023-12-16T05:56:30.126 INFO:tasks.workunit.client.0.smithi155.stdout:6/418: dwrite d0/d3/d7a/d77/f83 [4194304,4194304] 0 2023-12-16T05:56:30.127 INFO:tasks.workunit.client.0.smithi155.stdout:9/411: write da/f10 [2448765,122508] 0 2023-12-16T05:56:30.127 INFO:tasks.workunit.client.0.smithi155.stdout:5/394: mkdir d0/d2/d2a/d30/d53/d7b 0 2023-12-16T05:56:30.127 INFO:tasks.workunit.client.1.smithi156.stdout:9/57: creat d6/f18 x:0 0 0 2023-12-16T05:56:30.127 INFO:tasks.workunit.client.1.smithi156.stdout:9/58: read - d6/f15 zero size 2023-12-16T05:56:30.127 INFO:tasks.workunit.client.1.smithi156.stdout:9/59: stat d6/f18 0 2023-12-16T05:56:30.127 INFO:tasks.workunit.client.1.smithi156.stdout:2/45: write f2 [8758081,58939] 0 2023-12-16T05:56:30.127 INFO:tasks.workunit.client.1.smithi156.stdout:2/46: truncate d9/fa 302124 0 2023-12-16T05:56:30.127 INFO:tasks.workunit.client.1.smithi156.stdout:2/47: chown d9 531111918 1 2023-12-16T05:56:30.127 INFO:tasks.workunit.client.1.smithi156.stdout:2/48: stat d9/fb 0 2023-12-16T05:56:30.128 INFO:tasks.workunit.client.1.smithi156.stdout:2/49: write d9/dc/fe [571566,27301] 0 2023-12-16T05:56:30.128 INFO:tasks.workunit.client.0.smithi155.stdout:4/339: dwrite d0/f5 [0,4194304] 0 2023-12-16T05:56:30.134 INFO:tasks.workunit.client.1.smithi156.stdout:5/58: write f0 [566985,54906] 0 2023-12-16T05:56:30.134 INFO:tasks.workunit.client.1.smithi156.stdout:5/59: readlink l9 0 2023-12-16T05:56:30.134 INFO:tasks.workunit.client.1.smithi156.stdout:5/60: truncate da/dc/ff 188932 0 2023-12-16T05:56:30.135 INFO:tasks.workunit.client.1.smithi156.stdout:2/50: rename f7 to d9/dd/f11 0 2023-12-16T05:56:30.135 INFO:tasks.workunit.client.1.smithi156.stdout:2/51: stat d9/dd 0 2023-12-16T05:56:30.135 INFO:tasks.workunit.client.1.smithi156.stdout:5/61: creat da/dc/f13 x:0 0 0 2023-12-16T05:56:30.137 INFO:tasks.workunit.client.0.smithi155.stdout:9/412: dread da/d15/d17/d24/f2d [0,4194304] 0 2023-12-16T05:56:30.138 INFO:tasks.workunit.client.0.smithi155.stdout:7/318: rename d0/d1/d5/d18 to d0/d6a 0 2023-12-16T05:56:30.138 INFO:tasks.workunit.client.0.smithi155.stdout:8/282: rename d4 to d4/da/d1b/d1c/d1a/d1f/d4f/d50 22 2023-12-16T05:56:30.139 INFO:tasks.workunit.client.0.smithi155.stdout:8/283: read d4/da/d1b/d1c/d1a/f2d [269996,107328] 0 2023-12-16T05:56:30.141 INFO:tasks.workunit.client.0.smithi155.stdout:9/413: mkdir da/d15/d17/d24/d62/d91 0 2023-12-16T05:56:30.144 INFO:tasks.workunit.client.0.smithi155.stdout:6/419: dread d0/df/f18 [4194304,4194304] 0 2023-12-16T05:56:30.144 INFO:tasks.workunit.client.0.smithi155.stdout:8/284: mkdir d4/da/d1b/d2a/d51 0 2023-12-16T05:56:30.146 INFO:tasks.workunit.client.0.smithi155.stdout:6/420: mknod d0/d3/d2c/d3e/d4c/d1b/c8a 0 2023-12-16T05:56:30.146 INFO:tasks.workunit.client.0.smithi155.stdout:5/395: dread d0/d2/d2a/d19/f20 [0,4194304] 0 2023-12-16T05:56:30.148 INFO:tasks.workunit.client.1.smithi156.stdout:6/28: dread f5 [0,4194304] 0 2023-12-16T05:56:30.148 INFO:tasks.workunit.client.1.smithi156.stdout:6/29: fdatasync f6 0 2023-12-16T05:56:30.148 INFO:tasks.workunit.client.0.smithi155.stdout:8/285: rename d4/da/d1b/d1c/d1a/l26 to d4/da/d1b/d1c/d1a/d1f/l52 0 2023-12-16T05:56:30.149 INFO:tasks.workunit.client.0.smithi155.stdout:8/286: fsync d4/da/fb 0 2023-12-16T05:56:30.149 INFO:tasks.workunit.client.0.smithi155.stdout:9/414: write da/d15/d17/d24/d26/f29 [4491182,129774] 0 2023-12-16T05:56:30.150 INFO:tasks.workunit.client.1.smithi156.stdout:6/30: unlink f1 0 2023-12-16T05:56:30.152 INFO:tasks.workunit.client.0.smithi155.stdout:6/421: getdents d0/df/d5e/d46/d6d 0 2023-12-16T05:56:30.152 INFO:tasks.workunit.client.0.smithi155.stdout:6/422: stat d0/d3/d2c/d3e/d4c/f15 0 2023-12-16T05:56:30.152 INFO:tasks.workunit.client.0.smithi155.stdout:6/423: truncate d0/d3/d67/f72 28445 0 2023-12-16T05:56:30.156 INFO:tasks.workunit.client.0.smithi155.stdout:0/280: dwrite d7/d2d/f3c [0,4194304] 0 2023-12-16T05:56:30.156 INFO:tasks.workunit.client.0.smithi155.stdout:0/281: write d7/d2d/f2f [867255,11797] 0 2023-12-16T05:56:30.159 INFO:tasks.workunit.client.0.smithi155.stdout:8/287: symlink d4/l53 0 2023-12-16T05:56:30.159 INFO:tasks.workunit.client.0.smithi155.stdout:8/288: chown d4/da/d1b/d1c/d1a/d1f/d29/l40 18 1 2023-12-16T05:56:30.160 INFO:tasks.workunit.client.1.smithi156.stdout:9/60: rmdir d6 39 2023-12-16T05:56:30.160 INFO:tasks.workunit.client.1.smithi156.stdout:6/31: write f5 [2711666,12334] 0 2023-12-16T05:56:30.161 INFO:tasks.workunit.client.1.smithi156.stdout:9/61: mkdir d6/d19 0 2023-12-16T05:56:30.161 INFO:tasks.workunit.client.1.smithi156.stdout:9/62: fsync d6/fd 0 2023-12-16T05:56:30.162 INFO:tasks.workunit.client.0.smithi155.stdout:9/415: unlink da/d15/l3a 0 2023-12-16T05:56:30.162 INFO:tasks.workunit.client.1.smithi156.stdout:6/32: write f6 [222350,7218] 0 2023-12-16T05:56:30.163 INFO:tasks.workunit.client.1.smithi156.stdout:9/63: unlink d6/cc 0 2023-12-16T05:56:30.163 INFO:tasks.workunit.client.1.smithi156.stdout:3/15: dwrite f3 [4194304,4194304] 0 2023-12-16T05:56:30.164 INFO:tasks.workunit.client.1.smithi156.stdout:9/64: creat d6/d19/f1a x:0 0 0 2023-12-16T05:56:30.165 INFO:tasks.workunit.client.0.smithi155.stdout:6/424: dread d0/d3/d2c/d3e/d4c/d1b/f22 [4194304,4194304] 0 2023-12-16T05:56:30.165 INFO:tasks.workunit.client.1.smithi156.stdout:3/16: creat f4 x:0 0 0 2023-12-16T05:56:30.166 INFO:tasks.workunit.client.1.smithi156.stdout:9/65: creat d6/d19/f1b x:0 0 0 2023-12-16T05:56:30.166 INFO:tasks.workunit.client.1.smithi156.stdout:3/17: stat l1 0 2023-12-16T05:56:30.167 INFO:tasks.workunit.client.1.smithi156.stdout:3/18: creat f5 x:0 0 0 2023-12-16T05:56:30.168 INFO:tasks.workunit.client.0.smithi155.stdout:0/282: creat d7/df/d41/d23/d36/f54 x:0 0 0 2023-12-16T05:56:30.171 INFO:tasks.workunit.client.0.smithi155.stdout:8/289: creat d4/da/d1b/d1c/f54 x:0 0 0 2023-12-16T05:56:30.171 INFO:tasks.workunit.client.0.smithi155.stdout:8/290: chown d4/da/d1b/d1c/d1a/l4d 254635 1 2023-12-16T05:56:30.173 INFO:tasks.workunit.client.0.smithi155.stdout:8/291: read d4/da/d1b/d2a/f39 [1689255,46764] 0 2023-12-16T05:56:30.173 INFO:tasks.workunit.client.0.smithi155.stdout:8/292: fsync d4/da/d1b/d1c/d19/f38 0 2023-12-16T05:56:30.178 INFO:tasks.workunit.client.0.smithi155.stdout:6/425: dread d0/d3/d2c/d3e/d4c/f33 [0,4194304] 0 2023-12-16T05:56:30.178 INFO:tasks.workunit.client.0.smithi155.stdout:6/426: chown d0/l37 5808 1 2023-12-16T05:56:30.179 INFO:tasks.workunit.client.0.smithi155.stdout:7/319: getdents d0 0 2023-12-16T05:56:30.179 INFO:tasks.workunit.client.0.smithi155.stdout:7/320: readlink d0/d6a/d1a/l1f 0 2023-12-16T05:56:30.181 INFO:tasks.workunit.client.0.smithi155.stdout:0/283: dread d7/df/f37 [0,4194304] 0 2023-12-16T05:56:30.181 INFO:tasks.workunit.client.0.smithi155.stdout:7/321: symlink d0/d1/d5/l6b 0 2023-12-16T05:56:30.182 INFO:tasks.workunit.client.0.smithi155.stdout:0/284: creat d7/d30/f55 x:0 0 0 2023-12-16T05:56:30.182 INFO:tasks.workunit.client.0.smithi155.stdout:0/285: fsync d7/d2d/f3f 0 2023-12-16T05:56:30.183 INFO:tasks.workunit.client.0.smithi155.stdout:0/286: chown d7/d13 3 1 2023-12-16T05:56:30.184 INFO:tasks.workunit.client.0.smithi155.stdout:7/322: unlink d0/d6a/d1a/d22/d27/l43 0 2023-12-16T05:56:30.185 INFO:tasks.workunit.client.0.smithi155.stdout:0/287: unlink d7/d47/f4c 0 2023-12-16T05:56:30.185 INFO:tasks.workunit.client.0.smithi155.stdout:0/288: chown d7/d2d/c2e 178431572 1 2023-12-16T05:56:30.185 INFO:tasks.workunit.client.0.smithi155.stdout:7/323: mkdir d0/d6a/d1a/d22/d27/d34/d6c 0 2023-12-16T05:56:30.186 INFO:tasks.workunit.client.0.smithi155.stdout:0/289: write d7/fe [6762,84680] 0 2023-12-16T05:56:30.187 INFO:tasks.workunit.client.0.smithi155.stdout:7/324: symlink d0/d6a/d1a/d2b/d2c/d5d/l6d 0 2023-12-16T05:56:30.189 INFO:tasks.workunit.client.0.smithi155.stdout:6/427: dread d0/d3/d2c/f30 [0,4194304] 0 2023-12-16T05:56:30.189 INFO:tasks.workunit.client.0.smithi155.stdout:6/428: write d0/df/d5e/d5b/f76 [501882,130662] 0 2023-12-16T05:56:30.193 INFO:tasks.workunit.client.0.smithi155.stdout:6/429: rename d0/d3/d67 to d0/d3/d2c/d8b 0 2023-12-16T05:56:30.195 INFO:tasks.workunit.client.0.smithi155.stdout:6/430: mknod d0/d3/d2c/d3e/d4c/d1b/c8c 0 2023-12-16T05:56:30.195 INFO:tasks.workunit.client.1.smithi156.stdout:9/66: dwrite d6/f13 [0,4194304] 0 2023-12-16T05:56:30.196 INFO:tasks.workunit.client.1.smithi156.stdout:5/62: dwrite da/dc/f10 [0,4194304] 0 2023-12-16T05:56:30.196 INFO:tasks.workunit.client.1.smithi156.stdout:5/63: stat da/dc 0 2023-12-16T05:56:30.197 INFO:tasks.workunit.client.0.smithi155.stdout:6/431: creat d0/d3/d2c/d8b/d85/f8d x:0 0 0 2023-12-16T05:56:30.197 INFO:tasks.workunit.client.0.smithi155.stdout:6/432: write d0/df/d5e/d46/f49 [137371,81395] 0 2023-12-16T05:56:30.197 INFO:tasks.workunit.client.0.smithi155.stdout:6/433: dread - d0/d3/d2c/f6e zero size 2023-12-16T05:56:30.197 INFO:tasks.workunit.client.0.smithi155.stdout:6/434: readlink d0/df/d43/l4d 0 2023-12-16T05:56:30.197 INFO:tasks.workunit.client.0.smithi155.stdout:8/293: rmdir d4/da/d1b/d1c/d1a/d1f 39 2023-12-16T05:56:30.199 INFO:tasks.workunit.client.1.smithi156.stdout:9/67: creat d6/f1c x:0 0 0 2023-12-16T05:56:30.199 INFO:tasks.workunit.client.0.smithi155.stdout:6/435: fdatasync d0/d3/f11 0 2023-12-16T05:56:30.201 INFO:tasks.workunit.client.0.smithi155.stdout:6/436: symlink d0/l8e 0 2023-12-16T05:56:30.201 INFO:tasks.workunit.client.0.smithi155.stdout:6/437: chown d0/d3/d2c/d3e/f64 1 1 2023-12-16T05:56:30.202 INFO:tasks.workunit.client.0.smithi155.stdout:9/416: dwrite da/d15/d17/d36/f3f [0,4194304] 0 2023-12-16T05:56:30.204 INFO:tasks.workunit.client.1.smithi156.stdout:2/52: dwrite f1 [8388608,4194304] 0 2023-12-16T05:56:30.204 INFO:tasks.workunit.client.1.smithi156.stdout:2/53: chown d9/dc/f10 782257 1 2023-12-16T05:56:30.204 INFO:tasks.workunit.client.1.smithi156.stdout:2/54: chown d9 74742 1 2023-12-16T05:56:30.204 INFO:tasks.workunit.client.1.smithi156.stdout:2/55: chown f1 13307929 1 2023-12-16T05:56:30.205 INFO:tasks.workunit.client.1.smithi156.stdout:5/64: creat da/f14 x:0 0 0 2023-12-16T05:56:30.205 INFO:tasks.workunit.client.1.smithi156.stdout:9/68: symlink d6/d19/l1d 0 2023-12-16T05:56:30.206 INFO:tasks.workunit.client.0.smithi155.stdout:9/417: symlink da/d15/d17/l92 0 2023-12-16T05:56:30.210 INFO:tasks.workunit.client.1.smithi156.stdout:5/65: link da/dc/fd da/dc/f15 0 2023-12-16T05:56:30.210 INFO:tasks.workunit.client.1.smithi156.stdout:9/69: creat d6/f1e x:0 0 0 2023-12-16T05:56:30.210 INFO:tasks.workunit.client.1.smithi156.stdout:9/70: truncate d6/f10 669900 0 2023-12-16T05:56:30.213 INFO:tasks.workunit.client.1.smithi156.stdout:5/66: mknod da/c16 0 2023-12-16T05:56:30.213 INFO:tasks.workunit.client.1.smithi156.stdout:5/67: fdatasync f0 0 2023-12-16T05:56:30.216 INFO:tasks.workunit.client.0.smithi155.stdout:0/290: dwrite d7/f2a [0,4194304] 0 2023-12-16T05:56:30.218 INFO:tasks.workunit.client.0.smithi155.stdout:0/291: truncate d7/d2d/f2f 624351 0 2023-12-16T05:56:30.219 INFO:tasks.workunit.client.0.smithi155.stdout:0/292: rename d7/d47 to d7/d47/d53/d56 22 2023-12-16T05:56:30.219 INFO:tasks.workunit.client.0.smithi155.stdout:7/325: dwrite d0/d6a/d31/f52 [0,4194304] 0 2023-12-16T05:56:30.219 INFO:tasks.workunit.client.0.smithi155.stdout:7/326: dread - d0/d6a/d1a/f54 zero size 2023-12-16T05:56:30.219 INFO:tasks.workunit.client.0.smithi155.stdout:0/293: getdents d7/df/d41/d23/d44 0 2023-12-16T05:56:30.220 INFO:tasks.workunit.client.0.smithi155.stdout:7/327: mkdir d0/d6a/d1a/d22/d27/d34/d4b/d64/d6e 0 2023-12-16T05:56:30.221 INFO:tasks.workunit.client.1.smithi156.stdout:6/33: truncate f5 1850463 0 2023-12-16T05:56:30.221 INFO:tasks.workunit.client.0.smithi155.stdout:0/294: mknod d7/df/d41/d23/d44/c57 0 2023-12-16T05:56:30.221 INFO:tasks.workunit.client.0.smithi155.stdout:7/328: rmdir d0/d6a/d1a/d2b/d2c/d5d 39 2023-12-16T05:56:30.222 INFO:tasks.workunit.client.0.smithi155.stdout:7/329: mkdir d0/d6a/d1a/d22/d27/d34/d4b/d64/d6f 0 2023-12-16T05:56:30.223 INFO:tasks.workunit.client.0.smithi155.stdout:7/330: mknod d0/d6a/c70 0 2023-12-16T05:56:30.223 INFO:tasks.workunit.client.0.smithi155.stdout:7/331: fsync d0/d6a/d31/f32 0 2023-12-16T05:56:30.248 INFO:tasks.workunit.client.0.smithi155.stdout:6/438: dwrite d0/df/f35 [0,4194304] 0 2023-12-16T05:56:30.249 INFO:tasks.workunit.client.0.smithi155.stdout:6/439: dread - d0/d3/d2c/d3e/d4c/d1b/f6a zero size 2023-12-16T05:56:30.250 INFO:tasks.workunit.client.0.smithi155.stdout:7/332: dwrite d0/d1/f61 [0,4194304] 0 2023-12-16T05:56:30.250 INFO:tasks.workunit.client.0.smithi155.stdout:0/295: dwrite d7/df/f19 [0,4194304] 0 2023-12-16T05:56:30.250 INFO:tasks.workunit.client.0.smithi155.stdout:9/418: dwrite da/f13 [0,4194304] 0 2023-12-16T05:56:30.250 INFO:tasks.workunit.client.0.smithi155.stdout:8/294: dwrite d4/da/d1b/d1c/f45 [0,4194304] 0 2023-12-16T05:56:30.250 INFO:tasks.workunit.client.0.smithi155.stdout:8/295: chown d4/da/d1b/d1c/d1a/d1f/l52 63529524 1 2023-12-16T05:56:30.252 INFO:tasks.workunit.client.0.smithi155.stdout:6/440: link d0/f7c d0/df/d5e/d46/f8f 0 2023-12-16T05:56:30.253 INFO:tasks.workunit.client.0.smithi155.stdout:0/296: dread d7/f29 [0,4194304] 0 2023-12-16T05:56:30.253 INFO:tasks.workunit.client.1.smithi156.stdout:5/68: rmdir da 39 2023-12-16T05:56:30.254 INFO:tasks.workunit.client.0.smithi155.stdout:6/441: dread d0/d3/d2c/d3e/d4c/f51 [0,4194304] 0 2023-12-16T05:56:30.254 INFO:tasks.workunit.client.0.smithi155.stdout:6/442: stat d0/l5d 0 2023-12-16T05:56:30.254 INFO:tasks.workunit.client.0.smithi155.stdout:6/443: write d0/df/d5e/d46/f65 [312164,78149] 0 2023-12-16T05:56:30.254 INFO:tasks.workunit.client.0.smithi155.stdout:6/444: dread - d0/df/d5e/d46/d6d/f74 zero size 2023-12-16T05:56:30.255 INFO:tasks.workunit.client.0.smithi155.stdout:7/333: mknod d0/c71 0 2023-12-16T05:56:30.256 INFO:tasks.workunit.client.1.smithi156.stdout:6/34: mknod c7 0 2023-12-16T05:56:30.257 INFO:tasks.workunit.client.1.smithi156.stdout:5/69: read da/dc/f10 [3904494,78892] 0 2023-12-16T05:56:30.257 INFO:tasks.workunit.client.1.smithi156.stdout:5/70: write da/dc/f11 [1040635,34362] 0 2023-12-16T05:56:30.258 INFO:tasks.workunit.client.0.smithi155.stdout:9/419: mknod da/d15/d17/d36/d54/c93 0 2023-12-16T05:56:30.258 INFO:tasks.workunit.client.0.smithi155.stdout:9/420: fdatasync da/d15/d17/d24/d26/d2e/d32/f69 0 2023-12-16T05:56:30.258 INFO:tasks.workunit.client.0.smithi155.stdout:9/421: stat da/d15/d17/d36/c43 0 2023-12-16T05:56:30.259 INFO:tasks.workunit.client.0.smithi155.stdout:8/296: symlink d4/da/d1b/d1c/d1a/d1f/d4f/l55 0 2023-12-16T05:56:30.260 INFO:tasks.workunit.client.0.smithi155.stdout:0/297: creat d7/df/f58 x:0 0 0 2023-12-16T05:56:30.261 INFO:tasks.workunit.client.1.smithi156.stdout:6/35: creat f8 x:0 0 0 2023-12-16T05:56:30.263 INFO:tasks.workunit.client.0.smithi155.stdout:6/445: creat d0/df/f90 x:0 0 0 2023-12-16T05:56:30.264 INFO:tasks.workunit.client.0.smithi155.stdout:7/334: creat d0/d6a/d1a/f72 x:0 0 0 2023-12-16T05:56:30.264 INFO:tasks.workunit.client.0.smithi155.stdout:7/335: readlink d0/d6a/d31/l63 0 2023-12-16T05:56:30.266 INFO:tasks.workunit.client.0.smithi155.stdout:9/422: creat da/d15/d17/d36/d54/f94 x:0 0 0 2023-12-16T05:56:30.268 INFO:tasks.workunit.client.0.smithi155.stdout:8/297: symlink d4/da/d1b/d1c/d1a/d1f/d4f/l56 0 2023-12-16T05:56:30.268 INFO:tasks.workunit.client.0.smithi155.stdout:9/423: dread da/f80 [0,4194304] 0 2023-12-16T05:56:30.270 INFO:tasks.workunit.client.0.smithi155.stdout:6/446: creat d0/df/d5e/d46/d6d/f91 x:0 0 0 2023-12-16T05:56:30.272 INFO:tasks.workunit.client.0.smithi155.stdout:7/336: creat d0/d6a/d1a/d22/d27/d34/f73 x:0 0 0 2023-12-16T05:56:30.272 INFO:tasks.workunit.client.0.smithi155.stdout:7/337: fsync d0/d6a/d31/f32 0 2023-12-16T05:56:30.273 INFO:tasks.workunit.client.0.smithi155.stdout:8/298: symlink d4/da/d1b/d1c/d1a/l57 0 2023-12-16T05:56:30.273 INFO:tasks.workunit.client.0.smithi155.stdout:9/424: truncate da/d15/d17/d24/d26/d2e/d32/f3c 7662228 0 2023-12-16T05:56:30.275 INFO:tasks.workunit.client.0.smithi155.stdout:7/338: creat d0/d6a/d1a/d22/d3c/f74 x:0 0 0 2023-12-16T05:56:30.275 INFO:tasks.workunit.client.0.smithi155.stdout:9/425: read da/f13 [3768902,16432] 0 2023-12-16T05:56:30.275 INFO:tasks.workunit.client.1.smithi156.stdout:5/71: read f4 [1476480,122932] 0 2023-12-16T05:56:30.275 INFO:tasks.workunit.client.1.smithi156.stdout:5/72: dread - da/dc/f15 zero size 2023-12-16T05:56:30.275 INFO:tasks.workunit.client.1.smithi156.stdout:5/73: fdatasync f0 0 2023-12-16T05:56:30.276 INFO:tasks.workunit.client.0.smithi155.stdout:8/299: symlink d4/da/d1b/d1c/d1a/d1f/d29/l58 0 2023-12-16T05:56:30.276 INFO:tasks.workunit.client.0.smithi155.stdout:6/447: mknod d0/d3/c92 0 2023-12-16T05:56:30.277 INFO:tasks.workunit.client.0.smithi155.stdout:7/339: creat d0/d6a/d1a/d22/d27/f75 x:0 0 0 2023-12-16T05:56:30.277 INFO:tasks.workunit.client.1.smithi156.stdout:5/74: link f4 da/dc/f17 0 2023-12-16T05:56:30.278 INFO:tasks.workunit.client.0.smithi155.stdout:9/426: unlink da/d15/d17/d36/l65 0 2023-12-16T05:56:30.279 INFO:tasks.workunit.client.0.smithi155.stdout:6/448: getdents d0/df/d43 0 2023-12-16T05:56:30.280 INFO:tasks.workunit.client.0.smithi155.stdout:7/340: symlink d0/l76 0 2023-12-16T05:56:30.280 INFO:tasks.workunit.client.1.smithi156.stdout:5/75: rename da/dc/f10 to da/f18 0 2023-12-16T05:56:30.280 INFO:tasks.workunit.client.1.smithi156.stdout:5/76: write da/dc/f15 [794056,67629] 0 2023-12-16T05:56:30.281 INFO:tasks.workunit.client.0.smithi155.stdout:8/300: write d4/da/d1b/d1c/f45 [337807,18559] 0 2023-12-16T05:56:30.281 INFO:tasks.workunit.client.0.smithi155.stdout:9/427: symlink da/d15/d17/d24/d26/d2e/d83/d8f/l95 0 2023-12-16T05:56:30.281 INFO:tasks.workunit.client.0.smithi155.stdout:0/298: dwrite d7/df/f26 [0,4194304] 0 2023-12-16T05:56:30.281 INFO:tasks.workunit.client.0.smithi155.stdout:0/299: stat d7/d30/c24 0 2023-12-16T05:56:30.281 INFO:tasks.workunit.client.0.smithi155.stdout:0/300: stat d7/l3a 0 2023-12-16T05:56:30.282 INFO:tasks.workunit.client.1.smithi156.stdout:5/77: creat da/dc/f19 x:0 0 0 2023-12-16T05:56:30.282 INFO:tasks.workunit.client.1.smithi156.stdout:5/78: rename da to da/dc/d1a 22 2023-12-16T05:56:30.282 INFO:tasks.workunit.client.1.smithi156.stdout:6/36: dwrite f8 [0,4194304] 0 2023-12-16T05:56:30.284 INFO:tasks.workunit.client.0.smithi155.stdout:7/341: link d0/d6a/d1a/d22/d27/d34/d4b/c5e d0/d6a/d1a/d22/d27/d34/d4b/c77 0 2023-12-16T05:56:30.284 INFO:tasks.workunit.client.0.smithi155.stdout:7/342: stat d0/d6a/d1a/d22/d27/f75 0 2023-12-16T05:56:30.284 INFO:tasks.workunit.client.0.smithi155.stdout:8/301: creat d4/da/d1b/d1c/d1a/d1f/f59 x:0 0 0 2023-12-16T05:56:30.284 INFO:tasks.workunit.client.0.smithi155.stdout:6/449: dread d0/d3/f55 [0,4194304] 0 2023-12-16T05:56:30.285 INFO:tasks.workunit.client.1.smithi156.stdout:5/79: write da/f18 [536945,18164] 0 2023-12-16T05:56:30.285 INFO:tasks.workunit.client.1.smithi156.stdout:6/37: mkdir d9 0 2023-12-16T05:56:30.286 INFO:tasks.workunit.client.0.smithi155.stdout:9/428: rename da/d15/d17/d24/d26/d2e/d32/f69 to da/d15/d17/f96 0 2023-12-16T05:56:30.286 INFO:tasks.workunit.client.0.smithi155.stdout:9/429: dread - da/d15/d17/d24/d26/d2e/d32/f5f zero size 2023-12-16T05:56:30.287 INFO:tasks.workunit.client.1.smithi156.stdout:6/38: write f5 [2061654,83918] 0 2023-12-16T05:56:30.287 INFO:tasks.workunit.client.0.smithi155.stdout:7/343: rmdir d0/d6a/d1a/d2b/d2c 39 2023-12-16T05:56:30.288 INFO:tasks.workunit.client.1.smithi156.stdout:5/80: getdents da 0 2023-12-16T05:56:30.289 INFO:tasks.workunit.client.0.smithi155.stdout:0/301: dread d7/d13/f17 [4194304,4194304] 0 2023-12-16T05:56:30.289 INFO:tasks.workunit.client.0.smithi155.stdout:8/302: symlink d4/da/d1b/d1c/d1a/d1f/d29/l5a 0 2023-12-16T05:56:30.289 INFO:tasks.workunit.client.0.smithi155.stdout:8/303: truncate d4/da/d1b/d1c/f54 624484 0 2023-12-16T05:56:30.291 INFO:tasks.workunit.client.0.smithi155.stdout:6/450: unlink d0/df/d5e/d46/d6d/f91 0 2023-12-16T05:56:30.293 INFO:tasks.workunit.client.0.smithi155.stdout:9/430: creat da/d15/d17/d24/d62/f97 x:0 0 0 2023-12-16T05:56:30.294 INFO:tasks.workunit.client.1.smithi156.stdout:5/81: dread da/dc/f11 [0,4194304] 0 2023-12-16T05:56:30.294 INFO:tasks.workunit.client.1.smithi156.stdout:5/82: write da/dc/f17 [4330082,103398] 0 2023-12-16T05:56:30.295 INFO:tasks.workunit.client.1.smithi156.stdout:5/83: getdents da/dc 0 2023-12-16T05:56:30.295 INFO:tasks.workunit.client.0.smithi155.stdout:7/344: mkdir d0/d1b/d78 0 2023-12-16T05:56:30.295 INFO:tasks.workunit.client.0.smithi155.stdout:7/345: chown d0/d1/c5b 112731 1 2023-12-16T05:56:30.296 INFO:tasks.workunit.client.0.smithi155.stdout:8/304: truncate d4/ff 152822 0 2023-12-16T05:56:30.296 INFO:tasks.workunit.client.1.smithi156.stdout:5/84: symlink da/dc/l1b 0 2023-12-16T05:56:30.296 INFO:tasks.workunit.client.1.smithi156.stdout:5/85: dread - da/dc/f19 zero size 2023-12-16T05:56:30.297 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:30 smithi155 ceph-mon[112451]: pgmap v11: 65 pgs: 65 active+clean; 387 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 18 MiB/s rd, 31 MiB/s wr, 945 op/s 2023-12-16T05:56:30.297 INFO:tasks.workunit.client.1.smithi156.stdout:5/86: rmdir da/dc 39 2023-12-16T05:56:30.299 INFO:tasks.workunit.client.1.smithi156.stdout:5/87: symlink da/l1c 0 2023-12-16T05:56:30.300 INFO:tasks.workunit.client.1.smithi156.stdout:5/88: chown da/dc/f11 115470865 1 2023-12-16T05:56:30.300 INFO:tasks.workunit.client.0.smithi155.stdout:9/431: mkdir da/d15/d17/d36/d5b/d98 0 2023-12-16T05:56:30.301 INFO:tasks.workunit.client.0.smithi155.stdout:9/432: write da/d15/f66 [373400,6315] 0 2023-12-16T05:56:30.302 INFO:tasks.workunit.client.0.smithi155.stdout:9/433: truncate da/d15/d17/d36/d54/f94 316276 0 2023-12-16T05:56:30.302 INFO:tasks.workunit.client.1.smithi156.stdout:6/39: dread f8 [0,4194304] 0 2023-12-16T05:56:30.308 INFO:tasks.workunit.client.1.smithi156.stdout:5/89: getdents da 0 2023-12-16T05:56:30.308 INFO:tasks.workunit.client.1.smithi156.stdout:5/90: write da/f18 [4622060,109357] 0 2023-12-16T05:56:30.313 INFO:tasks.workunit.client.0.smithi155.stdout:6/451: dwrite d0/d3/d2c/f6e [0,4194304] 0 2023-12-16T05:56:30.317 INFO:tasks.workunit.client.0.smithi155.stdout:7/346: link d0/d1/l3d d0/d6a/d1a/d22/d27/l79 0 2023-12-16T05:56:30.319 INFO:tasks.workunit.client.0.smithi155.stdout:9/434: mkdir da/d15/d17/d36/d5b/d60/d99 0 2023-12-16T05:56:30.321 INFO:tasks.workunit.client.0.smithi155.stdout:8/305: dwrite d4/da/d1b/d1c/f54 [0,4194304] 0 2023-12-16T05:56:30.323 INFO:tasks.workunit.client.0.smithi155.stdout:7/347: mknod d0/d6a/d1a/d2b/d2c/d5d/c7a 0 2023-12-16T05:56:30.325 INFO:tasks.workunit.client.0.smithi155.stdout:9/435: creat da/d15/d17/f9a x:0 0 0 2023-12-16T05:56:30.325 INFO:tasks.workunit.client.0.smithi155.stdout:9/436: chown da/d15/c37 249284 1 2023-12-16T05:56:30.328 INFO:tasks.workunit.client.0.smithi155.stdout:8/306: symlink d4/l5b 0 2023-12-16T05:56:30.329 INFO:tasks.workunit.client.0.smithi155.stdout:8/307: read d4/da/d1b/d1c/d1a/f2c [3439502,86743] 0 2023-12-16T05:56:30.329 INFO:tasks.workunit.client.0.smithi155.stdout:6/452: mknod d0/c93 0 2023-12-16T05:56:30.330 INFO:tasks.workunit.client.0.smithi155.stdout:6/453: fdatasync d0/df/d5e/d7e/f89 0 2023-12-16T05:56:30.331 INFO:tasks.workunit.client.0.smithi155.stdout:7/348: creat d0/d6a/d1a/d22/d27/d34/d4b/d60/f7b x:0 0 0 2023-12-16T05:56:30.331 INFO:tasks.workunit.client.0.smithi155.stdout:7/349: dread - d0/d6a/d1a/d22/d3c/f74 zero size 2023-12-16T05:56:30.331 INFO:tasks.workunit.client.0.smithi155.stdout:7/350: write d0/d1/d5/f8 [3738669,21611] 0 2023-12-16T05:56:30.331 INFO:tasks.workunit.client.0.smithi155.stdout:7/351: write d0/d6a/d31/f32 [818037,96735] 0 2023-12-16T05:56:30.332 INFO:tasks.workunit.client.0.smithi155.stdout:7/352: chown d0/d6a/d1a/d22/d27/d34/f73 234850 1 2023-12-16T05:56:30.333 INFO:tasks.workunit.client.0.smithi155.stdout:9/437: unlink da/d15/d17/l75 0 2023-12-16T05:56:30.334 INFO:tasks.workunit.client.0.smithi155.stdout:8/308: creat d4/da/d1b/d1c/f5c x:0 0 0 2023-12-16T05:56:30.336 INFO:tasks.workunit.client.0.smithi155.stdout:8/309: write f2 [795500,23480] 0 2023-12-16T05:56:30.336 INFO:tasks.workunit.client.0.smithi155.stdout:6/454: rename d0/df/d5e/l53 to d0/d3/d2c/d8b/l94 0 2023-12-16T05:56:30.336 INFO:tasks.workunit.client.0.smithi155.stdout:6/455: write d0/d3/d2c/f6c [431864,99837] 0 2023-12-16T05:56:30.336 INFO:tasks.workunit.client.0.smithi155.stdout:6/456: readlink d0/df/l1f 0 2023-12-16T05:56:30.337 INFO:tasks.workunit.client.1.smithi156.stdout:5/91: dread da/f18 [0,4194304] 0 2023-12-16T05:56:30.337 INFO:tasks.workunit.client.0.smithi155.stdout:7/353: creat d0/d6a/d1a/d22/d27/f7c x:0 0 0 2023-12-16T05:56:30.337 INFO:tasks.workunit.client.0.smithi155.stdout:7/354: readlink d0/d6a/d31/l68 0 2023-12-16T05:56:30.338 INFO:tasks.workunit.client.0.smithi155.stdout:9/438: mknod da/d15/d17/d24/d26/d2e/d32/c9b 0 2023-12-16T05:56:30.339 INFO:tasks.workunit.client.0.smithi155.stdout:9/439: dread da/f1e [4194304,4194304] 0 2023-12-16T05:56:30.340 INFO:tasks.workunit.client.0.smithi155.stdout:8/310: symlink d4/l5d 0 2023-12-16T05:56:30.342 INFO:tasks.workunit.client.0.smithi155.stdout:9/440: mkdir da/d15/d17/d24/d26/d2e/d83/d8f/d9c 0 2023-12-16T05:56:30.343 INFO:tasks.workunit.client.0.smithi155.stdout:7/355: dread d0/d6a/d31/f46 [0,4194304] 0 2023-12-16T05:56:30.344 INFO:tasks.workunit.client.0.smithi155.stdout:9/441: unlink da/d15/d17/d24/d26/f7d 0 2023-12-16T05:56:30.354 INFO:tasks.workunit.client.1.smithi156.stdout:5/92: dwrite da/dc/f11 [0,4194304] 0 2023-12-16T05:56:30.354 INFO:tasks.workunit.client.1.smithi156.stdout:5/93: chown da/dc/l1b 101839 1 2023-12-16T05:56:30.354 INFO:tasks.workunit.client.1.smithi156.stdout:5/94: write da/dc/f19 [143437,86276] 0 2023-12-16T05:56:30.355 INFO:tasks.workunit.client.1.smithi156.stdout:5/95: readlink da/l12 0 2023-12-16T05:56:30.355 INFO:tasks.workunit.client.0.smithi155.stdout:9/442: dread da/f10 [0,4194304] 0 2023-12-16T05:56:30.356 INFO:tasks.workunit.client.1.smithi156.stdout:5/96: creat da/dc/f1d x:0 0 0 2023-12-16T05:56:30.356 INFO:tasks.workunit.client.1.smithi156.stdout:5/97: readlink da/dc/l1b 0 2023-12-16T05:56:30.356 INFO:tasks.workunit.client.0.smithi155.stdout:9/443: symlink da/d15/d17/d24/d26/d2e/d83/d8f/d9c/l9d 0 2023-12-16T05:56:30.357 INFO:tasks.workunit.client.1.smithi156.stdout:5/98: creat da/f1e x:0 0 0 2023-12-16T05:56:30.357 INFO:tasks.workunit.client.0.smithi155.stdout:9/444: mkdir da/d15/d17/d36/d5b/d60/d9e 0 2023-12-16T05:56:30.358 INFO:tasks.workunit.client.0.smithi155.stdout:9/445: creat da/d15/d17/d24/d62/d91/f9f x:0 0 0 2023-12-16T05:56:30.359 INFO:tasks.workunit.client.0.smithi155.stdout:9/446: unlink da/d15/l20 0 2023-12-16T05:56:30.361 INFO:tasks.workunit.client.1.smithi156.stdout:5/99: write da/dc/f11 [664834,23411] 0 2023-12-16T05:56:30.361 INFO:tasks.workunit.client.1.smithi156.stdout:5/100: fsync da/f14 0 2023-12-16T05:56:30.361 INFO:tasks.workunit.client.0.smithi155.stdout:7/356: dwrite d0/d6a/d1a/d22/d27/f75 [0,4194304] 0 2023-12-16T05:56:30.362 INFO:tasks.workunit.client.0.smithi155.stdout:7/357: truncate d0/d1/fb 8785534 0 2023-12-16T05:56:30.362 INFO:tasks.workunit.client.0.smithi155.stdout:7/358: write d0/d6a/d1a/d22/d3c/f50 [903278,38239] 0 2023-12-16T05:56:30.362 INFO:tasks.workunit.client.0.smithi155.stdout:7/359: chown d0/d1/d5/c7 15159066 1 2023-12-16T05:56:30.363 INFO:tasks.workunit.client.0.smithi155.stdout:7/360: rename d0/d6a/d1a/d36/l5a to d0/d6a/d1a/d22/d27/d34/d4b/l7d 0 2023-12-16T05:56:30.364 INFO:tasks.workunit.client.0.smithi155.stdout:7/361: link d0/d1/fb d0/d6a/d1a/d22/d27/d34/d4b/d64/d6e/f7e 0 2023-12-16T05:56:30.365 INFO:tasks.workunit.client.0.smithi155.stdout:7/362: creat d0/d6a/d1a/d22/d27/d34/d4b/f7f x:0 0 0 2023-12-16T05:56:30.366 INFO:tasks.workunit.client.0.smithi155.stdout:7/363: truncate d0/d1b/f2f 217938 0 2023-12-16T05:56:30.368 INFO:tasks.workunit.client.0.smithi155.stdout:9/447: dread da/d15/f78 [0,4194304] 0 2023-12-16T05:56:30.368 INFO:tasks.workunit.client.0.smithi155.stdout:6/457: dwrite d0/d3/d2c/d3e/d4c/f63 [0,4194304] 0 2023-12-16T05:56:30.368 INFO:tasks.workunit.client.0.smithi155.stdout:8/311: dwrite d4/f42 [0,4194304] 0 2023-12-16T05:56:30.368 INFO:tasks.workunit.client.0.smithi155.stdout:6/458: stat d0/df/d43/l4d 0 2023-12-16T05:56:30.370 INFO:tasks.workunit.client.0.smithi155.stdout:6/459: write d0/d3/d2c/d3e/d4c/f63 [1707540,104634] 0 2023-12-16T05:56:30.370 INFO:tasks.workunit.client.0.smithi155.stdout:6/460: write d0/d3/d2c/d3e/d4c/f63 [4364943,97702] 0 2023-12-16T05:56:30.373 INFO:tasks.workunit.client.0.smithi155.stdout:6/461: dread d0/d3/f11 [0,4194304] 0 2023-12-16T05:56:30.373 INFO:tasks.workunit.client.0.smithi155.stdout:8/312: mkdir d4/da/d1b/d2a/d5e 0 2023-12-16T05:56:30.373 INFO:tasks.workunit.client.0.smithi155.stdout:8/313: chown d4/da/d1b 8535667 1 2023-12-16T05:56:30.374 INFO:tasks.workunit.client.1.smithi156.stdout:5/101: dread f4 [0,4194304] 0 2023-12-16T05:56:30.374 INFO:tasks.workunit.client.1.smithi156.stdout:5/102: chown da/dc 223 1 2023-12-16T05:56:30.374 INFO:tasks.workunit.client.0.smithi155.stdout:9/448: symlink da/d15/d17/d24/d62/la0 0 2023-12-16T05:56:30.375 INFO:tasks.workunit.client.1.smithi156.stdout:5/103: write f4 [1830650,22320] 0 2023-12-16T05:56:30.375 INFO:tasks.workunit.client.0.smithi155.stdout:7/364: dread d0/d6a/f28 [0,4194304] 0 2023-12-16T05:56:30.375 INFO:tasks.workunit.client.0.smithi155.stdout:6/462: mknod d0/df/d5e/d46/d6d/c95 0 2023-12-16T05:56:30.376 INFO:tasks.workunit.client.0.smithi155.stdout:9/449: write da/d15/d17/d24/f64 [3049331,107494] 0 2023-12-16T05:56:30.376 INFO:tasks.workunit.client.1.smithi156.stdout:5/104: fsync da/dc/f11 0 2023-12-16T05:56:30.377 INFO:tasks.workunit.client.0.smithi155.stdout:8/314: mkdir d4/da/d1b/d5f 0 2023-12-16T05:56:30.378 INFO:tasks.workunit.client.1.smithi156.stdout:5/105: symlink da/dc/l1f 0 2023-12-16T05:56:30.379 INFO:tasks.workunit.client.0.smithi155.stdout:7/365: getdents d0/d1/d5 0 2023-12-16T05:56:30.379 INFO:tasks.workunit.client.1.smithi156.stdout:5/106: mknod da/dc/c20 0 2023-12-16T05:56:30.382 INFO:tasks.workunit.client.1.smithi156.stdout:5/107: dread da/dc/fd [0,4194304] 0 2023-12-16T05:56:30.383 INFO:tasks.workunit.client.0.smithi155.stdout:9/450: creat da/d15/d17/d36/fa1 x:0 0 0 2023-12-16T05:56:30.383 INFO:tasks.workunit.client.1.smithi156.stdout:5/108: stat da/dc/f13 0 2023-12-16T05:56:30.383 INFO:tasks.workunit.client.1.smithi156.stdout:5/109: write da/dc/f13 [940251,87108] 0 2023-12-16T05:56:30.385 INFO:tasks.workunit.client.0.smithi155.stdout:9/451: rmdir da/d15/d17/d36/d5b 39 2023-12-16T05:56:30.385 INFO:tasks.workunit.client.0.smithi155.stdout:9/452: getdents da/d15/d17/d36/d5b/d60/d9e 0 2023-12-16T05:56:30.385 INFO:tasks.workunit.client.0.smithi155.stdout:9/453: read - da/d15/d17/d24/d62/f68 zero size 2023-12-16T05:56:30.387 INFO:tasks.workunit.client.0.smithi155.stdout:7/366: dread d0/d1/f21 [0,4194304] 0 2023-12-16T05:56:30.387 INFO:tasks.workunit.client.0.smithi155.stdout:9/454: creat da/d15/d17/d36/d5b/fa2 x:0 0 0 2023-12-16T05:56:30.388 INFO:tasks.workunit.client.0.smithi155.stdout:9/455: write da/d15/f66 [783828,60084] 0 2023-12-16T05:56:30.390 INFO:tasks.workunit.client.0.smithi155.stdout:7/367: rmdir d0/d6a/d1a/d22/d27 39 2023-12-16T05:56:30.391 INFO:tasks.workunit.client.0.smithi155.stdout:9/456: truncate da/d15/d17/f96 3784566 0 2023-12-16T05:56:30.393 INFO:tasks.workunit.client.0.smithi155.stdout:7/368: creat d0/d6a/d1a/d22/d27/d42/f80 x:0 0 0 2023-12-16T05:56:30.394 INFO:tasks.workunit.client.0.smithi155.stdout:9/457: link da/d15/d17/d36/l7a da/d15/d17/d24/d26/d2e/d83/d8f/la3 0 2023-12-16T05:56:30.397 INFO:tasks.workunit.client.0.smithi155.stdout:7/369: link d0/d6a/d1a/f54 d0/d6a/d1a/d22/d27/d34/d4b/d64/d6f/f81 0 2023-12-16T05:56:30.397 INFO:tasks.workunit.client.0.smithi155.stdout:7/370: truncate d0/d6a/d1a/d22/f25 1643172 0 2023-12-16T05:56:30.397 INFO:tasks.workunit.client.0.smithi155.stdout:7/371: fsync d0/d6a/f1c 0 2023-12-16T05:56:30.398 INFO:tasks.workunit.client.0.smithi155.stdout:9/458: rename da/d15/d17/d24/d62/d91/f9f to da/d15/d17/d24/d26/d2e/d83/d8f/d9c/fa4 0 2023-12-16T05:56:30.398 INFO:tasks.workunit.client.0.smithi155.stdout:9/459: fdatasync da/d15/d17/d36/d5b/f90 0 2023-12-16T05:56:30.399 INFO:tasks.workunit.client.0.smithi155.stdout:7/372: creat d0/d6a/f82 x:0 0 0 2023-12-16T05:56:30.400 INFO:tasks.workunit.client.0.smithi155.stdout:9/460: creat da/d15/d17/d36/d5b/d60/d9e/fa5 x:0 0 0 2023-12-16T05:56:30.403 INFO:tasks.workunit.client.0.smithi155.stdout:7/373: read d0/f15 [3918983,123631] 0 2023-12-16T05:56:30.403 INFO:tasks.workunit.client.1.smithi156.stdout:5/110: dwrite da/dc/fd [0,4194304] 0 2023-12-16T05:56:30.404 INFO:tasks.workunit.client.0.smithi155.stdout:6/463: dwrite d0/d3/d2c/d3e/d4c/d1b/f21 [0,4194304] 0 2023-12-16T05:56:30.404 INFO:tasks.workunit.client.0.smithi155.stdout:9/461: dread da/d15/d17/f41 [0,4194304] 0 2023-12-16T05:56:30.404 INFO:tasks.workunit.client.0.smithi155.stdout:8/315: dwrite d4/da/d1b/d1c/d1a/f2c [4194304,4194304] 0 2023-12-16T05:56:30.406 INFO:tasks.workunit.client.1.smithi156.stdout:5/111: creat da/dc/f21 x:0 0 0 2023-12-16T05:56:30.420 INFO:tasks.workunit.client.0.smithi155.stdout:9/462: dwrite da/f10 [0,4194304] 0 2023-12-16T05:56:30.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:30 smithi156 ceph-mon[121001]: pgmap v11: 65 pgs: 65 active+clean; 387 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 18 MiB/s rd, 31 MiB/s wr, 945 op/s 2023-12-16T05:56:30.439 INFO:tasks.workunit.client.0.smithi155.stdout:7/374: dwrite d0/d6a/f28 [0,4194304] 0 2023-12-16T05:56:30.439 INFO:tasks.workunit.client.0.smithi155.stdout:7/375: fdatasync d0/d1/f21 0 2023-12-16T05:56:30.440 INFO:tasks.workunit.client.1.smithi156.stdout:5/112: dwrite da/f18 [0,4194304] 0 2023-12-16T05:56:30.440 INFO:tasks.workunit.client.1.smithi156.stdout:5/113: readlink da/l1c 0 2023-12-16T05:56:30.443 INFO:tasks.workunit.client.1.smithi156.stdout:5/114: read da/f18 [1178474,81985] 0 2023-12-16T05:56:30.446 INFO:tasks.workunit.client.1.smithi156.stdout:5/115: rmdir da 39 2023-12-16T05:56:30.465 INFO:tasks.workunit.client.1.smithi156.stdout:5/116: dwrite da/dc/f17 [0,4194304] 0 2023-12-16T05:56:30.465 INFO:tasks.workunit.client.1.smithi156.stdout:5/117: stat da/dc/c20 0 2023-12-16T05:56:30.465 INFO:tasks.workunit.client.1.smithi156.stdout:5/118: write da/dc/f1d [494465,81876] 0 2023-12-16T05:56:30.466 INFO:tasks.workunit.client.1.smithi156.stdout:5/119: write da/dc/f15 [5158092,51032] 0 2023-12-16T05:56:30.466 INFO:tasks.workunit.client.1.smithi156.stdout:5/120: symlink da/dc/l22 0 2023-12-16T05:56:30.467 INFO:tasks.workunit.client.1.smithi156.stdout:5/121: write da/dc/f11 [3470592,22197] 0 2023-12-16T05:56:30.469 INFO:tasks.workunit.client.1.smithi156.stdout:5/122: rename da/f18 to da/dc/f23 0 2023-12-16T05:56:30.472 INFO:tasks.workunit.client.1.smithi156.stdout:5/123: getdents da 0 2023-12-16T05:56:30.490 INFO:tasks.workunit.client.1.smithi156.stdout:5/124: dwrite da/dc/f19 [0,4194304] 0 2023-12-16T05:56:30.490 INFO:tasks.workunit.client.1.smithi156.stdout:5/125: write da/dc/f15 [1672572,48402] 0 2023-12-16T05:56:30.491 INFO:tasks.workunit.client.1.smithi156.stdout:5/126: fsync da/dc/f11 0 2023-12-16T05:56:30.497 INFO:tasks.workunit.client.1.smithi156.stdout:5/127: dread da/dc/f11 [0,4194304] 0 2023-12-16T05:56:30.497 INFO:tasks.workunit.client.1.smithi156.stdout:5/128: readlink l9 0 2023-12-16T05:56:30.498 INFO:tasks.workunit.client.1.smithi156.stdout:5/129: mkdir da/d24 0 2023-12-16T05:56:30.498 INFO:tasks.workunit.client.1.smithi156.stdout:5/130: fsync da/dc/f1d 0 2023-12-16T05:56:30.499 INFO:tasks.workunit.client.1.smithi156.stdout:5/131: write da/dc/f15 [2446335,45552] 0 2023-12-16T05:56:30.499 INFO:tasks.workunit.client.1.smithi156.stdout:5/132: write da/dc/f23 [5517083,122394] 0 2023-12-16T05:56:30.499 INFO:tasks.workunit.client.1.smithi156.stdout:5/133: write da/f14 [530709,34901] 0 2023-12-16T05:56:30.500 INFO:tasks.workunit.client.1.smithi156.stdout:5/134: write da/dc/f17 [1711604,43280] 0 2023-12-16T05:56:30.502 INFO:tasks.workunit.client.0.smithi155.stdout:6/464: symlink d0/d3/d7a/d77/l96 0 2023-12-16T05:56:30.502 INFO:tasks.workunit.client.0.smithi155.stdout:6/465: readlink d0/d3/d7a/d77/l96 0 2023-12-16T05:56:30.502 INFO:tasks.workunit.client.0.smithi155.stdout:6/466: write d0/df/f18 [8578786,43989] 0 2023-12-16T05:56:30.502 INFO:tasks.workunit.client.0.smithi155.stdout:6/467: write d0/d3/d2c/d3e/d4c/f15 [4533058,23338] 0 2023-12-16T05:56:30.503 INFO:tasks.workunit.client.1.smithi156.stdout:5/135: symlink da/l25 0 2023-12-16T05:56:30.504 INFO:tasks.workunit.client.1.smithi156.stdout:5/136: getdents da/d24 0 2023-12-16T05:56:30.504 INFO:tasks.workunit.client.0.smithi155.stdout:8/316: unlink d4/da/c3c 0 2023-12-16T05:56:30.505 INFO:tasks.workunit.client.1.smithi156.stdout:5/137: write da/dc/f17 [1813886,53261] 0 2023-12-16T05:56:30.505 INFO:tasks.workunit.client.1.smithi156.stdout:5/138: fsync da/dc/f21 0 2023-12-16T05:56:30.505 INFO:tasks.workunit.client.0.smithi155.stdout:9/463: creat da/d15/d17/d36/d5b/fa6 x:0 0 0 2023-12-16T05:56:30.507 INFO:tasks.workunit.client.1.smithi156.stdout:5/139: link da/dc/f19 da/f26 0 2023-12-16T05:56:30.568 INFO:tasks.workunit.client.0.smithi155.stdout:7/376: creat d0/d1/f83 x:0 0 0 2023-12-16T05:56:30.568 INFO:tasks.workunit.client.0.smithi155.stdout:7/377: chown d0/d1/f61 1315387 1 2023-12-16T05:56:30.581 INFO:tasks.workunit.client.0.smithi155.stdout:6/468: rmdir d0/d3/d2c/d3e 39 2023-12-16T05:56:30.582 INFO:tasks.workunit.client.0.smithi155.stdout:6/469: chown d0/d3/d7a/f4e 31909 1 2023-12-16T05:56:30.582 INFO:tasks.workunit.client.0.smithi155.stdout:6/470: write d0/d3/d2c/f30 [7999216,10073] 0 2023-12-16T05:56:30.582 INFO:tasks.workunit.client.0.smithi155.stdout:6/471: readlink d0/d3/d7a/d77/l96 0 2023-12-16T05:56:30.583 INFO:tasks.workunit.client.0.smithi155.stdout:8/317: creat d4/da/d1b/d1c/d1a/d1f/d4f/f60 x:0 0 0 2023-12-16T05:56:30.583 INFO:tasks.workunit.client.0.smithi155.stdout:8/318: readlink d4/da/d1b/d1c/d1a/d1f/d4f/l55 0 2023-12-16T05:56:30.585 INFO:tasks.workunit.client.0.smithi155.stdout:9/464: mknod da/d15/d17/d36/d5b/ca7 0 2023-12-16T05:56:30.585 INFO:tasks.workunit.client.0.smithi155.stdout:9/465: readlink da/d15/d17/l23 0 2023-12-16T05:56:30.585 INFO:tasks.workunit.client.0.smithi155.stdout:9/466: write da/d15/d17/d24/d26/d2e/f8e [489557,10570] 0 2023-12-16T05:56:30.585 INFO:tasks.workunit.client.0.smithi155.stdout:8/319: dread d4/da/d1b/d1c/d1a/f2d [0,4194304] 0 2023-12-16T05:56:30.586 INFO:tasks.workunit.client.0.smithi155.stdout:7/378: symlink d0/d6a/d1a/d22/l84 0 2023-12-16T05:56:30.587 INFO:tasks.workunit.client.0.smithi155.stdout:7/379: chown d0/d1/f83 235 1 2023-12-16T05:56:30.589 INFO:tasks.workunit.client.0.smithi155.stdout:6/472: creat d0/d3/d2c/d3e/d4c/f97 x:0 0 0 2023-12-16T05:56:30.596 INFO:tasks.workunit.client.0.smithi155.stdout:8/320: dread d4/da/d1b/d1c/d1a/f2c [0,4194304] 0 2023-12-16T05:56:30.597 INFO:tasks.workunit.client.0.smithi155.stdout:8/321: creat d4/da/d1b/f61 x:0 0 0 2023-12-16T05:56:30.598 INFO:tasks.workunit.client.0.smithi155.stdout:7/380: dread d0/d1/fb [4194304,4194304] 0 2023-12-16T05:56:30.598 INFO:tasks.workunit.client.0.smithi155.stdout:8/322: chown d4/da/l31 41123 1 2023-12-16T05:56:30.598 INFO:tasks.workunit.client.0.smithi155.stdout:8/323: chown d4/da/d1b/l47 51058460 1 2023-12-16T05:56:30.599 INFO:tasks.workunit.client.0.smithi155.stdout:7/381: mkdir d0/d6a/d85 0 2023-12-16T05:56:30.599 INFO:tasks.workunit.client.0.smithi155.stdout:6/473: dread d0/d3/f19 [0,4194304] 0 2023-12-16T05:56:30.599 INFO:tasks.workunit.client.0.smithi155.stdout:6/474: chown d0/d3/d2c/f60 358567 1 2023-12-16T05:56:30.599 INFO:tasks.workunit.client.0.smithi155.stdout:8/324: mkdir d4/d62 0 2023-12-16T05:56:30.600 INFO:tasks.workunit.client.0.smithi155.stdout:8/325: stat d4/da/d1b/d1c/d1a/d1f/d29/l48 0 2023-12-16T05:56:30.601 INFO:tasks.workunit.client.0.smithi155.stdout:8/326: stat d4/da/d1b/d1c/d1a/d1f/l52 0 2023-12-16T05:56:30.602 INFO:tasks.workunit.client.0.smithi155.stdout:9/467: dwrite da/d15/d17/d24/d62/f97 [0,4194304] 0 2023-12-16T05:56:30.602 INFO:tasks.workunit.client.0.smithi155.stdout:9/468: stat da/d15/d17/d36/f4e 0 2023-12-16T05:56:30.609 INFO:tasks.workunit.client.0.smithi155.stdout:3/237: sync 2023-12-16T05:56:30.610 INFO:tasks.workunit.client.0.smithi155.stdout:3/238: truncate d0/d14/d36/f3d 141955 0 2023-12-16T05:56:30.611 INFO:tasks.workunit.client.0.smithi155.stdout:3/239: mkdir d0/d14/d45 0 2023-12-16T05:56:30.613 INFO:tasks.workunit.client.0.smithi155.stdout:3/240: creat d0/d1a/d33/f46 x:0 0 0 2023-12-16T05:56:30.614 INFO:tasks.workunit.client.0.smithi155.stdout:3/241: read d0/d14/d36/f3d [108775,93492] 0 2023-12-16T05:56:30.615 INFO:tasks.workunit.client.0.smithi155.stdout:8/327: write d4/ff [49692,70023] 0 2023-12-16T05:56:30.615 INFO:tasks.workunit.client.0.smithi155.stdout:8/328: write d4/da/d1b/d1c/d1a/f3d [4488915,39023] 0 2023-12-16T05:56:30.616 INFO:tasks.workunit.client.0.smithi155.stdout:3/242: mkdir d0/d14/d36/d47 0 2023-12-16T05:56:30.617 INFO:tasks.workunit.client.0.smithi155.stdout:8/329: creat d4/da/d1b/d1c/d1a/d1f/d4f/f63 x:0 0 0 2023-12-16T05:56:30.619 INFO:tasks.workunit.client.0.smithi155.stdout:7/382: dwrite d0/d1/d5/f9 [0,4194304] 0 2023-12-16T05:56:30.619 INFO:tasks.workunit.client.0.smithi155.stdout:7/383: truncate d0/d1/f4a 523554 0 2023-12-16T05:56:30.620 INFO:tasks.workunit.client.0.smithi155.stdout:3/243: mknod d0/d14/d36/c48 0 2023-12-16T05:56:30.620 INFO:tasks.workunit.client.0.smithi155.stdout:8/330: mkdir d4/da/d1b/d1c/d19/d64 0 2023-12-16T05:56:30.621 INFO:tasks.workunit.client.0.smithi155.stdout:7/384: unlink d0/d1/d5/c7 0 2023-12-16T05:56:30.622 INFO:tasks.workunit.client.0.smithi155.stdout:8/331: creat d4/da/d1b/d2a/d51/f65 x:0 0 0 2023-12-16T05:56:30.623 INFO:tasks.workunit.client.0.smithi155.stdout:7/385: creat d0/d6a/d1a/d22/f86 x:0 0 0 2023-12-16T05:56:30.624 INFO:tasks.workunit.client.0.smithi155.stdout:3/244: rename d0/f17 to d0/d1e/f49 0 2023-12-16T05:56:30.626 INFO:tasks.workunit.client.0.smithi155.stdout:6/475: dwrite d0/df/d5e/d46/d6d/f71 [0,4194304] 0 2023-12-16T05:56:30.627 INFO:tasks.workunit.client.0.smithi155.stdout:6/476: dread - d0/d3/d2c/d3e/d4c/d1b/f78 zero size 2023-12-16T05:56:30.627 INFO:tasks.workunit.client.0.smithi155.stdout:6/477: chown d0/df/d5e/d46/d6d/f74 168775 1 2023-12-16T05:56:30.627 INFO:tasks.workunit.client.0.smithi155.stdout:7/386: creat d0/d6a/d1a/d22/f87 x:0 0 0 2023-12-16T05:56:30.629 INFO:tasks.workunit.client.0.smithi155.stdout:3/245: creat d0/d1a/d2f/f4a x:0 0 0 2023-12-16T05:56:30.629 INFO:tasks.workunit.client.0.smithi155.stdout:3/246: stat d0/f2e 0 2023-12-16T05:56:30.629 INFO:tasks.workunit.client.0.smithi155.stdout:3/247: write d0/d1e/f20 [1299567,1713] 0 2023-12-16T05:56:30.629 INFO:tasks.workunit.client.0.smithi155.stdout:3/248: readlink d0/d14/l1f 0 2023-12-16T05:56:30.630 INFO:tasks.workunit.client.0.smithi155.stdout:9/469: dwrite da/d15/d17/d24/d62/f97 [4194304,4194304] 0 2023-12-16T05:56:30.630 INFO:tasks.workunit.client.0.smithi155.stdout:6/478: dread d0/df/d5e/d5b/f76 [0,4194304] 0 2023-12-16T05:56:30.630 INFO:tasks.workunit.client.0.smithi155.stdout:6/479: chown d0/d3/f55 93154770 1 2023-12-16T05:56:30.632 INFO:tasks.workunit.client.0.smithi155.stdout:3/249: link d0/cc d0/c4b 0 2023-12-16T05:56:30.635 INFO:tasks.workunit.client.0.smithi155.stdout:9/470: unlink da/d15/d17/d36/d5b/f90 0 2023-12-16T05:56:30.635 INFO:tasks.workunit.client.0.smithi155.stdout:9/471: read da/d15/d17/d24/d26/d2e/d32/f35 [157787,43370] 0 2023-12-16T05:56:30.636 INFO:tasks.workunit.client.0.smithi155.stdout:6/480: rmdir d0/df/d5e/d7e 39 2023-12-16T05:56:30.638 INFO:tasks.workunit.client.0.smithi155.stdout:3/250: mknod d0/d1a/c4c 0 2023-12-16T05:56:30.639 INFO:tasks.workunit.client.0.smithi155.stdout:9/472: mkdir da/d15/d17/d24/d62/da8 0 2023-12-16T05:56:30.639 INFO:tasks.workunit.client.0.smithi155.stdout:9/473: truncate da/d15/d17/d36/f4e 803189 0 2023-12-16T05:56:30.640 INFO:tasks.workunit.client.0.smithi155.stdout:6/481: creat d0/d3/d7a/d77/f98 x:0 0 0 2023-12-16T05:56:30.640 INFO:tasks.workunit.client.0.smithi155.stdout:6/482: write d0/d3/f12 [993884,63984] 0 2023-12-16T05:56:30.641 INFO:tasks.workunit.client.0.smithi155.stdout:3/251: write d0/fb [7162373,116320] 0 2023-12-16T05:56:30.641 INFO:tasks.workunit.client.0.smithi155.stdout:6/483: write d0/d3/d2c/f6e [2486698,125151] 0 2023-12-16T05:56:30.643 INFO:tasks.workunit.client.0.smithi155.stdout:7/387: dwrite d0/d6a/d1a/d22/d27/d34/d4b/d64/d6e/f7e [4194304,4194304] 0 2023-12-16T05:56:30.645 INFO:tasks.workunit.client.0.smithi155.stdout:8/332: rmdir d4 39 2023-12-16T05:56:30.645 INFO:tasks.workunit.client.0.smithi155.stdout:8/333: fsync d4/da/d1b/d2a/f39 0 2023-12-16T05:56:30.657 INFO:tasks.workunit.client.0.smithi155.stdout:3/252: dwrite d0/d1a/f2d [4194304,4194304] 0 2023-12-16T05:56:30.657 INFO:tasks.workunit.client.0.smithi155.stdout:7/388: dread d0/f35 [0,4194304] 0 2023-12-16T05:56:30.658 INFO:tasks.workunit.client.0.smithi155.stdout:7/389: chown d0/d1/f4a 6624 1 2023-12-16T05:56:30.658 INFO:tasks.workunit.client.0.smithi155.stdout:3/253: chown d0/c4b 8179582 1 2023-12-16T05:56:30.658 INFO:tasks.workunit.client.0.smithi155.stdout:3/254: fsync d0/d1a/f2d 0 2023-12-16T05:56:30.658 INFO:tasks.workunit.client.0.smithi155.stdout:3/255: chown d0/c19 15229335 1 2023-12-16T05:56:30.659 INFO:tasks.workunit.client.0.smithi155.stdout:3/256: rename d0/d14/l1f to d0/d1a/d33/l4d 0 2023-12-16T05:56:30.661 INFO:tasks.workunit.client.0.smithi155.stdout:3/257: dread d0/d1a/d33/f3a [0,4194304] 0 2023-12-16T05:56:30.661 INFO:tasks.workunit.client.0.smithi155.stdout:3/258: dread - d0/d14/f34 zero size 2023-12-16T05:56:30.661 INFO:tasks.workunit.client.0.smithi155.stdout:3/259: stat d0/f31 0 2023-12-16T05:56:30.675 INFO:tasks.workunit.client.0.smithi155.stdout:7/390: dwrite d0/d6a/d1a/f72 [0,4194304] 0 2023-12-16T05:56:30.677 INFO:tasks.workunit.client.0.smithi155.stdout:3/260: dwrite d0/f11 [0,4194304] 0 2023-12-16T05:56:30.677 INFO:tasks.workunit.client.0.smithi155.stdout:7/391: mknod d0/d6a/d1a/d22/d27/d34/d6c/c88 0 2023-12-16T05:56:30.681 INFO:tasks.workunit.client.0.smithi155.stdout:7/392: creat d0/d6a/d1a/f89 x:0 0 0 2023-12-16T05:56:30.683 INFO:tasks.workunit.client.0.smithi155.stdout:7/393: rename d0/d6a/f82 to d0/d6a/d31/f8a 0 2023-12-16T05:56:30.684 INFO:tasks.workunit.client.0.smithi155.stdout:7/394: symlink d0/d6a/d1a/d22/d27/l8b 0 2023-12-16T05:56:30.690 INFO:tasks.workunit.client.0.smithi155.stdout:3/261: dwrite d0/d14/f18 [0,4194304] 0 2023-12-16T05:56:30.691 INFO:tasks.workunit.client.0.smithi155.stdout:7/395: rename d0/d6a/d1a/d22/d27 to d0/d6a/d1a/d8c 0 2023-12-16T05:56:30.693 INFO:tasks.workunit.client.0.smithi155.stdout:3/262: write d0/d14/f28 [2189461,83508] 0 2023-12-16T05:56:30.695 INFO:tasks.workunit.client.0.smithi155.stdout:3/263: mkdir d0/d1e/d4e 0 2023-12-16T05:56:30.696 INFO:tasks.workunit.client.0.smithi155.stdout:3/264: write d0/f30 [3519599,112065] 0 2023-12-16T05:56:30.697 INFO:tasks.workunit.client.0.smithi155.stdout:3/265: mknod d0/d14/c4f 0 2023-12-16T05:56:30.698 INFO:tasks.workunit.client.0.smithi155.stdout:3/266: write d0/fb [4408919,92699] 0 2023-12-16T05:56:30.699 INFO:tasks.workunit.client.0.smithi155.stdout:3/267: creat d0/d14/f50 x:0 0 0 2023-12-16T05:56:30.700 INFO:tasks.workunit.client.0.smithi155.stdout:3/268: rmdir d0/d1a/d33 39 2023-12-16T05:56:30.703 INFO:tasks.workunit.client.1.smithi156.stdout:0/90: sync 2023-12-16T05:56:30.703 INFO:tasks.workunit.client.1.smithi156.stdout:0/91: write d2/ff [179668,130600] 0 2023-12-16T05:56:30.703 INFO:tasks.workunit.client.1.smithi156.stdout:0/92: chown d2/d7/l11 1284364593 1 2023-12-16T05:56:30.708 INFO:tasks.workunit.client.0.smithi155.stdout:7/396: dwrite d0/d1/f24 [0,4194304] 0 2023-12-16T05:56:30.708 INFO:tasks.workunit.client.0.smithi155.stdout:7/397: truncate d0/d6a/d1a/d8c/d34/d4b/d64/d6f/f81 848316 0 2023-12-16T05:56:30.708 INFO:tasks.workunit.client.0.smithi155.stdout:7/398: write d0/d1/f21 [5091331,98738] 0 2023-12-16T05:56:30.710 INFO:tasks.workunit.client.0.smithi155.stdout:7/399: creat d0/d6a/f8d x:0 0 0 2023-12-16T05:56:30.710 INFO:tasks.workunit.client.0.smithi155.stdout:7/400: write d0/d6a/d1a/d8c/d34/f73 [31586,1148] 0 2023-12-16T05:56:30.711 INFO:tasks.workunit.client.0.smithi155.stdout:7/401: creat d0/d6a/d1a/d2b/d2c/d5d/f8e x:0 0 0 2023-12-16T05:56:30.716 INFO:tasks.workunit.client.0.smithi155.stdout:7/402: dread d0/d6a/d1a/d8c/d34/f73 [0,4194304] 0 2023-12-16T05:56:30.716 INFO:tasks.workunit.client.0.smithi155.stdout:7/403: fdatasync d0/d6a/d1a/d2b/d2c/d5d/f62 0 2023-12-16T05:56:30.716 INFO:tasks.workunit.client.0.smithi155.stdout:7/404: write d0/d6a/d1a/f89 [336326,82615] 0 2023-12-16T05:56:30.724 INFO:tasks.workunit.client.1.smithi156.stdout:0/93: dwrite f0 [0,4194304] 0 2023-12-16T05:56:30.725 INFO:tasks.workunit.client.0.smithi155.stdout:7/405: dread d0/d1/d5/f9 [0,4194304] 0 2023-12-16T05:56:30.725 INFO:tasks.workunit.client.0.smithi155.stdout:7/406: write d0/d6a/f1c [4712759,45194] 0 2023-12-16T05:56:30.726 INFO:tasks.workunit.client.0.smithi155.stdout:7/407: rename d0/d6a/d1a/d2b/d2c/c4e to d0/c8f 0 2023-12-16T05:56:30.727 INFO:tasks.workunit.client.0.smithi155.stdout:7/408: write d0/f15 [2822499,34501] 0 2023-12-16T05:56:30.727 INFO:tasks.workunit.client.0.smithi155.stdout:7/409: write d0/d6a/d1a/d8c/f7c [936061,97758] 0 2023-12-16T05:56:30.728 INFO:tasks.workunit.client.0.smithi155.stdout:7/410: link d0/d1/d5/l6b d0/d6a/d1a/d8c/d34/d4b/d64/d6e/l90 0 2023-12-16T05:56:30.729 INFO:tasks.workunit.client.0.smithi155.stdout:7/411: link d0/d1/f4a d0/d6a/d1a/d22/f91 0 2023-12-16T05:56:30.729 INFO:tasks.workunit.client.0.smithi155.stdout:7/412: chown d0/d1/f83 32 1 2023-12-16T05:56:30.733 INFO:tasks.workunit.client.1.smithi156.stdout:0/94: dread d2/fe [0,4194304] 0 2023-12-16T05:56:30.735 INFO:tasks.workunit.client.1.smithi156.stdout:0/95: rename d2/lb to d2/d7/l14 0 2023-12-16T05:56:30.735 INFO:tasks.workunit.client.1.smithi156.stdout:0/96: creat d2/d7/f15 x:0 0 0 2023-12-16T05:56:30.736 INFO:tasks.workunit.client.1.smithi156.stdout:0/97: symlink d2/d7/dd/l16 0 2023-12-16T05:56:30.736 INFO:tasks.workunit.client.1.smithi156.stdout:0/98: fsync f0 0 2023-12-16T05:56:30.737 INFO:tasks.workunit.client.1.smithi156.stdout:0/99: write d2/d7/f10 [3860173,109512] 0 2023-12-16T05:56:30.737 INFO:tasks.workunit.client.1.smithi156.stdout:0/100: read - d2/d7/f15 zero size 2023-12-16T05:56:30.739 INFO:tasks.workunit.client.1.smithi156.stdout:0/101: unlink d2/d7/dd/l16 0 2023-12-16T05:56:30.739 INFO:tasks.workunit.client.1.smithi156.stdout:0/102: chown d2/d7 740011 1 2023-12-16T05:56:30.752 INFO:tasks.workunit.client.1.smithi156.stdout:0/103: dwrite d2/d7/f15 [0,4194304] 0 2023-12-16T05:56:30.756 INFO:tasks.workunit.client.0.smithi155.stdout:1/406: sync 2023-12-16T05:56:30.758 INFO:tasks.workunit.client.0.smithi155.stdout:1/407: creat d1/d7/d4b/d5c/f82 x:0 0 0 2023-12-16T05:56:30.826 INFO:tasks.workunit.client.0.smithi155.stdout:2/303: sync 2023-12-16T05:56:30.826 INFO:tasks.workunit.client.0.smithi155.stdout:4/340: sync 2023-12-16T05:56:30.827 INFO:tasks.workunit.client.1.smithi156.stdout:0/104: dwrite d2/fe [0,4194304] 0 2023-12-16T05:56:30.827 INFO:tasks.workunit.client.1.smithi156.stdout:0/105: chown d2/d7/l11 0 1 2023-12-16T05:56:30.827 INFO:tasks.workunit.client.0.smithi155.stdout:1/408: dwrite d1/d25/d43/d5d/f7c [0,4194304] 0 2023-12-16T05:56:30.827 INFO:tasks.workunit.client.0.smithi155.stdout:1/409: dread - d1/d7/d16/f63 zero size 2023-12-16T05:56:30.827 INFO:tasks.workunit.client.0.smithi155.stdout:4/341: truncate d0/d10/d22/f25 354053 0 2023-12-16T05:56:30.827 INFO:tasks.workunit.client.0.smithi155.stdout:2/304: creat d0/d7/dd/d62/d66/f6a x:0 0 0 2023-12-16T05:56:30.828 INFO:tasks.workunit.client.0.smithi155.stdout:2/305: stat d0/d34/f40 0 2023-12-16T05:56:30.828 INFO:tasks.workunit.client.1.smithi156.stdout:0/106: rename d2/d7/l14 to d2/d7/dd/l17 0 2023-12-16T05:56:30.830 INFO:tasks.workunit.client.0.smithi155.stdout:1/410: symlink d1/d17/d28/l83 0 2023-12-16T05:56:30.830 INFO:tasks.workunit.client.0.smithi155.stdout:1/411: stat d1/cd 0 2023-12-16T05:56:30.831 INFO:tasks.workunit.client.0.smithi155.stdout:4/342: creat d0/d10/d22/d50/f6a x:0 0 0 2023-12-16T05:56:30.832 INFO:tasks.workunit.client.0.smithi155.stdout:4/343: write d0/d10/f5b [4998996,5930] 0 2023-12-16T05:56:30.833 INFO:tasks.workunit.client.0.smithi155.stdout:1/412: dread d1/d25/f32 [0,4194304] 0 2023-12-16T05:56:30.833 INFO:tasks.workunit.client.0.smithi155.stdout:1/413: read - d1/d17/d28/f70 zero size 2023-12-16T05:56:30.834 INFO:tasks.workunit.client.0.smithi155.stdout:4/344: readlink d0/d10/d46/l19 0 2023-12-16T05:56:30.834 INFO:tasks.workunit.client.0.smithi155.stdout:4/345: chown d0/da/c24 6187781 1 2023-12-16T05:56:30.835 INFO:tasks.workunit.client.0.smithi155.stdout:4/346: write d0/d10/d46/f40 [1380185,112883] 0 2023-12-16T05:56:30.836 INFO:tasks.workunit.client.1.smithi156.stdout:0/107: dread d2/ff [0,4194304] 0 2023-12-16T05:56:30.837 INFO:tasks.workunit.client.0.smithi155.stdout:1/414: mknod d1/d25/d43/d5d/d5e/c84 0 2023-12-16T05:56:30.840 INFO:tasks.workunit.client.0.smithi155.stdout:2/306: dread d0/d34/d3c/f55 [0,4194304] 0 2023-12-16T05:56:30.840 INFO:tasks.workunit.client.0.smithi155.stdout:2/307: fdatasync d0/d7/d1f/d3b/f54 0 2023-12-16T05:56:30.842 INFO:tasks.workunit.client.0.smithi155.stdout:2/308: rename d0/d7/dd/l31 to d0/d5/d6/l6b 0 2023-12-16T05:56:30.844 INFO:tasks.workunit.client.0.smithi155.stdout:2/309: mknod d0/d7/c6c 0 2023-12-16T05:56:30.844 INFO:tasks.workunit.client.1.smithi156.stdout:0/108: dread d2/d7/f15 [0,4194304] 0 2023-12-16T05:56:30.846 INFO:tasks.workunit.client.1.smithi156.stdout:0/109: creat d2/d7/f18 x:0 0 0 2023-12-16T05:56:30.848 INFO:tasks.workunit.client.1.smithi156.stdout:0/110: link f0 d2/d7/dd/f19 0 2023-12-16T05:56:30.849 INFO:tasks.workunit.client.1.smithi156.stdout:0/111: mknod d2/d7/c1a 0 2023-12-16T05:56:30.851 INFO:tasks.workunit.client.1.smithi156.stdout:0/112: creat d2/f1b x:0 0 0 2023-12-16T05:56:30.851 INFO:tasks.workunit.client.1.smithi156.stdout:0/113: fdatasync d2/d7/dd/f19 0 2023-12-16T05:56:30.851 INFO:tasks.workunit.client.1.smithi156.stdout:0/114: dread - d2/f1b zero size 2023-12-16T05:56:30.855 INFO:tasks.workunit.client.0.smithi155.stdout:4/347: dwrite d0/d10/d46/d16/d1a/f5c [0,4194304] 0 2023-12-16T05:56:30.867 INFO:tasks.workunit.client.0.smithi155.stdout:4/348: dread d0/d10/d46/d16/d1a/f35 [0,4194304] 0 2023-12-16T05:56:30.868 INFO:tasks.workunit.client.0.smithi155.stdout:1/415: dwrite d1/d17/d28/f70 [0,4194304] 0 2023-12-16T05:56:30.868 INFO:tasks.workunit.client.0.smithi155.stdout:4/349: readlink d0/d10/d46/d16/d30/l57 0 2023-12-16T05:56:30.868 INFO:tasks.workunit.client.0.smithi155.stdout:2/310: dwrite d0/f52 [0,4194304] 0 2023-12-16T05:56:30.870 INFO:tasks.workunit.client.1.smithi156.stdout:0/115: getdents d2/d7 0 2023-12-16T05:56:30.870 INFO:tasks.workunit.client.0.smithi155.stdout:1/416: mkdir d1/d17/d28/d85 0 2023-12-16T05:56:30.870 INFO:tasks.workunit.client.0.smithi155.stdout:1/417: readlink d1/d25/d43/d5d/l71 0 2023-12-16T05:56:30.871 INFO:tasks.workunit.client.1.smithi156.stdout:0/116: mkdir d2/d7/dd/d1c 0 2023-12-16T05:56:30.872 INFO:tasks.workunit.client.0.smithi155.stdout:2/311: symlink d0/d7/d57/d63/l6d 0 2023-12-16T05:56:30.873 INFO:tasks.workunit.client.1.smithi156.stdout:0/117: symlink d2/l1d 0 2023-12-16T05:56:30.873 INFO:tasks.workunit.client.0.smithi155.stdout:1/418: creat d1/d17/f86 x:0 0 0 2023-12-16T05:56:30.873 INFO:tasks.workunit.client.0.smithi155.stdout:1/419: fdatasync d1/d7/d16/f63 0 2023-12-16T05:56:30.875 INFO:tasks.workunit.client.0.smithi155.stdout:2/312: write d0/d7/dd/f3e [1299311,29901] 0 2023-12-16T05:56:30.875 INFO:tasks.workunit.client.1.smithi156.stdout:1/31: sync 2023-12-16T05:56:30.875 INFO:tasks.workunit.client.1.smithi156.stdout:2/56: sync 2023-12-16T05:56:30.876 INFO:tasks.workunit.client.1.smithi156.stdout:7/128: sync 2023-12-16T05:56:30.876 INFO:tasks.workunit.client.1.smithi156.stdout:4/35: sync 2023-12-16T05:56:30.876 INFO:tasks.workunit.client.1.smithi156.stdout:2/57: stat l3 0 2023-12-16T05:56:30.876 INFO:tasks.workunit.client.1.smithi156.stdout:3/19: sync 2023-12-16T05:56:30.876 INFO:tasks.workunit.client.1.smithi156.stdout:3/20: readlink l1 0 2023-12-16T05:56:30.876 INFO:tasks.workunit.client.1.smithi156.stdout:8/54: sync 2023-12-16T05:56:30.876 INFO:tasks.workunit.client.1.smithi156.stdout:9/71: sync 2023-12-16T05:56:30.876 INFO:tasks.workunit.client.1.smithi156.stdout:6/40: sync 2023-12-16T05:56:30.876 INFO:tasks.workunit.client.1.smithi156.stdout:8/55: fsync f2 0 2023-12-16T05:56:30.876 INFO:tasks.workunit.client.1.smithi156.stdout:8/56: chown d3/ff 1 1 2023-12-16T05:56:30.876 INFO:tasks.workunit.client.1.smithi156.stdout:5/140: sync 2023-12-16T05:56:30.876 INFO:tasks.workunit.client.1.smithi156.stdout:5/141: write da/dc/f23 [6217560,123192] 0 2023-12-16T05:56:30.876 INFO:tasks.workunit.client.1.smithi156.stdout:0/118: rename d2/d7/c8 to d2/d7/dd/c1e 0 2023-12-16T05:56:30.877 INFO:tasks.workunit.client.1.smithi156.stdout:2/58: mkdir d9/d12 0 2023-12-16T05:56:30.877 INFO:tasks.workunit.client.0.smithi155.stdout:2/313: write d0/d34/d3c/f55 [3957930,64833] 0 2023-12-16T05:56:30.877 INFO:tasks.workunit.client.0.smithi155.stdout:2/314: creat d0/d7/dd/f6e x:0 0 0 2023-12-16T05:56:30.878 INFO:tasks.workunit.client.0.smithi155.stdout:2/315: creat d0/d7/d69/f6f x:0 0 0 2023-12-16T05:56:30.878 INFO:tasks.workunit.client.1.smithi156.stdout:4/36: creat d9/fa x:0 0 0 2023-12-16T05:56:30.880 INFO:tasks.workunit.client.1.smithi156.stdout:4/37: read f3 [3407429,786] 0 2023-12-16T05:56:30.880 INFO:tasks.workunit.client.1.smithi156.stdout:1/32: link l2 d3/l7 0 2023-12-16T05:56:30.881 INFO:tasks.workunit.client.1.smithi156.stdout:3/21: rename l2 to l6 0 2023-12-16T05:56:30.883 INFO:tasks.workunit.client.1.smithi156.stdout:9/72: creat d6/d19/f1f x:0 0 0 2023-12-16T05:56:30.883 INFO:tasks.workunit.client.1.smithi156.stdout:1/33: dread f0 [0,4194304] 0 2023-12-16T05:56:30.883 INFO:tasks.workunit.client.1.smithi156.stdout:9/73: dread - d6/f15 zero size 2023-12-16T05:56:30.884 INFO:tasks.workunit.client.1.smithi156.stdout:8/57: mkdir d3/d12 0 2023-12-16T05:56:30.885 INFO:tasks.workunit.client.1.smithi156.stdout:5/142: getdents da/dc 0 2023-12-16T05:56:30.885 INFO:tasks.workunit.client.1.smithi156.stdout:5/143: fdatasync da/dc/ff 0 2023-12-16T05:56:30.887 INFO:tasks.workunit.client.0.smithi155.stdout:4/350: dwrite d0/d10/f12 [4194304,4194304] 0 2023-12-16T05:56:30.888 INFO:tasks.workunit.client.1.smithi156.stdout:2/59: read f8 [36,18950] 0 2023-12-16T05:56:30.888 INFO:tasks.workunit.client.1.smithi156.stdout:2/60: write d9/dd/f11 [816560,53034] 0 2023-12-16T05:56:30.888 INFO:tasks.workunit.client.1.smithi156.stdout:3/22: link f3 f7 0 2023-12-16T05:56:30.889 INFO:tasks.workunit.client.0.smithi155.stdout:4/351: mkdir d0/d10/d22/d3d/d49/d6b 0 2023-12-16T05:56:30.889 INFO:tasks.workunit.client.0.smithi155.stdout:4/352: write d0/da/f5e [98652,8799] 0 2023-12-16T05:56:30.889 INFO:tasks.workunit.client.0.smithi155.stdout:2/316: read d0/d7/dd/f3e [6261026,25720] 0 2023-12-16T05:56:30.889 INFO:tasks.workunit.client.0.smithi155.stdout:2/317: fsync d0/d7/d1f/f48 0 2023-12-16T05:56:30.889 INFO:tasks.workunit.client.0.smithi155.stdout:2/318: fsync d0/f2 0 2023-12-16T05:56:30.890 INFO:tasks.workunit.client.1.smithi156.stdout:1/34: mknod d3/c8 0 2023-12-16T05:56:30.892 INFO:tasks.workunit.client.1.smithi156.stdout:6/41: dread f6 [0,4194304] 0 2023-12-16T05:56:30.892 INFO:tasks.workunit.client.1.smithi156.stdout:9/74: rename d6/f1c to d6/d19/f20 0 2023-12-16T05:56:30.892 INFO:tasks.workunit.client.1.smithi156.stdout:6/42: chown d9 9876481 1 2023-12-16T05:56:30.892 INFO:tasks.workunit.client.1.smithi156.stdout:6/43: chown f8 3565 1 2023-12-16T05:56:30.895 INFO:tasks.workunit.client.1.smithi156.stdout:8/58: unlink d3/d6/f10 0 2023-12-16T05:56:30.895 INFO:tasks.workunit.client.1.smithi156.stdout:8/59: fdatasync d3/d6/f5 0 2023-12-16T05:56:30.895 INFO:tasks.workunit.client.0.smithi155.stdout:4/353: read d0/d10/d22/f25 [241810,130967] 0 2023-12-16T05:56:30.895 INFO:tasks.workunit.client.1.smithi156.stdout:6/44: write f8 [4058269,81186] 0 2023-12-16T05:56:30.896 INFO:tasks.workunit.client.0.smithi155.stdout:4/354: mkdir d0/d10/d22/d3d/d6c 0 2023-12-16T05:56:30.897 INFO:tasks.workunit.client.1.smithi156.stdout:3/23: rename f5 to f8 0 2023-12-16T05:56:30.897 INFO:tasks.workunit.client.0.smithi155.stdout:4/355: creat d0/da/d36/d5f/f6d x:0 0 0 2023-12-16T05:56:30.898 INFO:tasks.workunit.client.1.smithi156.stdout:1/35: mknod d3/c9 0 2023-12-16T05:56:30.899 INFO:tasks.workunit.client.1.smithi156.stdout:9/75: mknod d6/c21 0 2023-12-16T05:56:30.899 INFO:tasks.workunit.client.1.smithi156.stdout:9/76: readlink l5 0 2023-12-16T05:56:30.899 INFO:tasks.workunit.client.1.smithi156.stdout:9/77: read - d6/f1e zero size 2023-12-16T05:56:30.899 INFO:tasks.workunit.client.1.smithi156.stdout:9/78: chown d6/l12 103232 1 2023-12-16T05:56:30.900 INFO:tasks.workunit.client.1.smithi156.stdout:8/60: symlink d3/d12/l13 0 2023-12-16T05:56:30.900 INFO:tasks.workunit.client.1.smithi156.stdout:6/45: symlink d9/la 0 2023-12-16T05:56:30.900 INFO:tasks.workunit.client.1.smithi156.stdout:3/24: stat l1 0 2023-12-16T05:56:30.900 INFO:tasks.workunit.client.1.smithi156.stdout:3/25: stat f8 0 2023-12-16T05:56:30.901 INFO:tasks.workunit.client.1.smithi156.stdout:1/36: creat d3/fa x:0 0 0 2023-12-16T05:56:30.903 INFO:tasks.workunit.client.1.smithi156.stdout:9/79: rename d6/f18 to d6/d19/f22 0 2023-12-16T05:56:30.906 INFO:tasks.workunit.client.1.smithi156.stdout:3/26: symlink l9 0 2023-12-16T05:56:30.906 INFO:tasks.workunit.client.1.smithi156.stdout:1/37: creat d3/fb x:0 0 0 2023-12-16T05:56:30.907 INFO:tasks.workunit.client.1.smithi156.stdout:3/27: symlink la 0 2023-12-16T05:56:30.909 INFO:tasks.workunit.client.1.smithi156.stdout:1/38: rename d3/fa to d3/fc 0 2023-12-16T05:56:30.910 INFO:tasks.workunit.client.1.smithi156.stdout:3/28: rename f3 to fb 0 2023-12-16T05:56:30.910 INFO:tasks.workunit.client.1.smithi156.stdout:3/29: rmdir - no directory 2023-12-16T05:56:30.911 INFO:tasks.workunit.client.0.smithi155.stdout:1/420: dwrite d1/d7/f45 [0,4194304] 0 2023-12-16T05:56:30.911 INFO:tasks.workunit.client.1.smithi156.stdout:9/80: dread d6/f13 [0,4194304] 0 2023-12-16T05:56:30.911 INFO:tasks.workunit.client.1.smithi156.stdout:9/81: truncate d6/d19/f20 347197 0 2023-12-16T05:56:30.912 INFO:tasks.workunit.client.1.smithi156.stdout:1/39: mknod d3/cd 0 2023-12-16T05:56:30.912 INFO:tasks.workunit.client.1.smithi156.stdout:1/40: truncate d3/fb 1002015 0 2023-12-16T05:56:30.912 INFO:tasks.workunit.client.1.smithi156.stdout:7/129: dwrite d1e/f24 [0,4194304] 0 2023-12-16T05:56:30.913 INFO:tasks.workunit.client.1.smithi156.stdout:2/61: dread d9/dd/f11 [0,4194304] 0 2023-12-16T05:56:30.913 INFO:tasks.workunit.client.1.smithi156.stdout:2/62: fsync f2 0 2023-12-16T05:56:30.913 INFO:tasks.workunit.client.1.smithi156.stdout:2/63: write d9/fa [456844,107330] 0 2023-12-16T05:56:30.913 INFO:tasks.workunit.client.1.smithi156.stdout:4/38: dwrite f8 [0,4194304] 0 2023-12-16T05:56:30.914 INFO:tasks.workunit.client.1.smithi156.stdout:4/39: chown f0 896 1 2023-12-16T05:56:30.914 INFO:tasks.workunit.client.1.smithi156.stdout:4/40: write f6 [814805,121979] 0 2023-12-16T05:56:30.914 INFO:tasks.workunit.client.1.smithi156.stdout:5/144: dwrite da/dc/fd [0,4194304] 0 2023-12-16T05:56:30.914 INFO:tasks.workunit.client.0.smithi155.stdout:1/421: mknod d1/d17/c87 0 2023-12-16T05:56:30.915 INFO:tasks.workunit.client.1.smithi156.stdout:1/41: write f0 [682330,16651] 0 2023-12-16T05:56:30.915 INFO:tasks.workunit.client.1.smithi156.stdout:2/64: dread d9/dc/fe [0,4194304] 0 2023-12-16T05:56:30.915 INFO:tasks.workunit.client.1.smithi156.stdout:1/42: write f0 [1123111,105748] 0 2023-12-16T05:56:30.915 INFO:tasks.workunit.client.1.smithi156.stdout:1/43: rename d3 to d3/de 22 2023-12-16T05:56:30.915 INFO:tasks.workunit.client.1.smithi156.stdout:7/130: creat d1e/d1f/d22/f25 x:0 0 0 2023-12-16T05:56:30.915 INFO:tasks.workunit.client.1.smithi156.stdout:9/82: symlink d6/l23 0 2023-12-16T05:56:30.916 INFO:tasks.workunit.client.1.smithi156.stdout:9/83: write d6/f14 [754735,87446] 0 2023-12-16T05:56:30.916 INFO:tasks.workunit.client.0.smithi155.stdout:1/422: rename d1/d7/f45 to d1/d7/d4b/d5c/f88 0 2023-12-16T05:56:30.916 INFO:tasks.workunit.client.0.smithi155.stdout:1/423: getdents d1/d7/d4b/d72 0 2023-12-16T05:56:30.918 INFO:tasks.workunit.client.0.smithi155.stdout:1/424: symlink d1/l89 0 2023-12-16T05:56:30.918 INFO:tasks.workunit.client.0.smithi155.stdout:4/356: dread d0/da/f5e [0,4194304] 0 2023-12-16T05:56:30.920 INFO:tasks.workunit.client.1.smithi156.stdout:4/41: unlink f7 0 2023-12-16T05:56:30.920 INFO:tasks.workunit.client.1.smithi156.stdout:4/42: truncate f5 482163 0 2023-12-16T05:56:30.920 INFO:tasks.workunit.client.1.smithi156.stdout:4/43: readlink - no filename 2023-12-16T05:56:30.920 INFO:tasks.workunit.client.1.smithi156.stdout:3/30: dread f7 [4194304,4194304] 0 2023-12-16T05:56:30.921 INFO:tasks.workunit.client.0.smithi155.stdout:2/319: getdents d0/d7/dd 0 2023-12-16T05:56:30.921 INFO:tasks.workunit.client.1.smithi156.stdout:6/46: dread f8 [0,4194304] 0 2023-12-16T05:56:30.922 INFO:tasks.workunit.client.1.smithi156.stdout:5/145: creat da/f27 x:0 0 0 2023-12-16T05:56:30.924 INFO:tasks.workunit.client.1.smithi156.stdout:2/65: mkdir d9/dc/d13 0 2023-12-16T05:56:30.925 INFO:tasks.workunit.client.0.smithi155.stdout:4/357: rename d0/d10/d22 to d0/da/d36/d6e 0 2023-12-16T05:56:30.925 INFO:tasks.workunit.client.1.smithi156.stdout:1/44: stat l2 0 2023-12-16T05:56:30.929 INFO:tasks.workunit.client.1.smithi156.stdout:7/131: rename l6 to d1e/d1f/l26 0 2023-12-16T05:56:30.930 INFO:tasks.workunit.client.1.smithi156.stdout:4/44: mknod d9/cb 0 2023-12-16T05:56:30.933 INFO:tasks.workunit.client.1.smithi156.stdout:3/31: mkdir dc 0 2023-12-16T05:56:30.935 INFO:tasks.workunit.client.1.smithi156.stdout:5/146: truncate da/f14 183570 0 2023-12-16T05:56:30.935 INFO:tasks.workunit.client.1.smithi156.stdout:5/147: fdatasync da/f26 0 2023-12-16T05:56:30.937 INFO:tasks.workunit.client.1.smithi156.stdout:7/132: creat d1e/f27 x:0 0 0 2023-12-16T05:56:30.940 INFO:tasks.workunit.client.1.smithi156.stdout:9/84: rename d6/f17 to d6/d19/f24 0 2023-12-16T05:56:30.940 INFO:tasks.workunit.client.1.smithi156.stdout:8/61: rmdir d3/d6 39 2023-12-16T05:56:30.940 INFO:tasks.workunit.client.1.smithi156.stdout:8/62: readlink d3/d12/l13 0 2023-12-16T05:56:30.940 INFO:tasks.workunit.client.1.smithi156.stdout:8/63: stat d3 0 2023-12-16T05:56:30.945 INFO:tasks.workunit.client.1.smithi156.stdout:9/85: dread d6/f13 [0,4194304] 0 2023-12-16T05:56:30.946 INFO:tasks.workunit.client.1.smithi156.stdout:4/45: creat d9/fc x:0 0 0 2023-12-16T05:56:30.947 INFO:tasks.workunit.client.0.smithi155.stdout:1/425: dwrite d1/d25/d43/d5d/f7c [0,4194304] 0 2023-12-16T05:56:30.947 INFO:tasks.workunit.client.0.smithi155.stdout:1/426: fdatasync d1/f2a 0 2023-12-16T05:56:30.947 INFO:tasks.workunit.client.0.smithi155.stdout:1/427: truncate d1/d7/d16/f63 1007529 0 2023-12-16T05:56:30.948 INFO:tasks.workunit.client.0.smithi155.stdout:2/320: dwrite d0/f2 [0,4194304] 0 2023-12-16T05:56:30.948 INFO:tasks.workunit.client.1.smithi156.stdout:3/32: mknod dc/cd 0 2023-12-16T05:56:30.948 INFO:tasks.workunit.client.1.smithi156.stdout:3/33: read - f8 zero size 2023-12-16T05:56:30.949 INFO:tasks.workunit.client.0.smithi155.stdout:2/321: mknod d0/d7/dd/d62/c70 0 2023-12-16T05:56:30.950 INFO:tasks.workunit.client.1.smithi156.stdout:5/148: creat da/f28 x:0 0 0 2023-12-16T05:56:30.950 INFO:tasks.workunit.client.1.smithi156.stdout:5/149: getdents da/d24 0 2023-12-16T05:56:30.952 INFO:tasks.workunit.client.1.smithi156.stdout:7/133: mknod d1e/d1f/d22/c28 0 2023-12-16T05:56:30.952 INFO:tasks.workunit.client.1.smithi156.stdout:7/134: truncate d1e/f21 387681 0 2023-12-16T05:56:30.955 INFO:tasks.workunit.client.1.smithi156.stdout:6/47: dwrite f5 [0,4194304] 0 2023-12-16T05:56:30.955 INFO:tasks.workunit.client.1.smithi156.stdout:6/48: readlink d9/la 0 2023-12-16T05:56:30.955 INFO:tasks.workunit.client.1.smithi156.stdout:2/66: rename d9/dd/f11 to d9/d12/f14 0 2023-12-16T05:56:30.955 INFO:tasks.workunit.client.1.smithi156.stdout:2/67: stat f2 0 2023-12-16T05:56:30.957 INFO:tasks.workunit.client.1.smithi156.stdout:8/64: symlink d3/d7/l14 0 2023-12-16T05:56:30.959 INFO:tasks.workunit.client.0.smithi155.stdout:4/358: dwrite d0/f4 [4194304,4194304] 0 2023-12-16T05:56:30.960 INFO:tasks.workunit.client.0.smithi155.stdout:1/428: dread d1/d7/d16/f21 [0,4194304] 0 2023-12-16T05:56:30.961 INFO:tasks.workunit.client.0.smithi155.stdout:1/429: fsync d1/d17/f86 0 2023-12-16T05:56:30.961 INFO:tasks.workunit.client.1.smithi156.stdout:4/46: mknod d9/cd 0 2023-12-16T05:56:30.963 INFO:tasks.workunit.client.0.smithi155.stdout:4/359: creat d0/d10/d46/d16/d1a/f6f x:0 0 0 2023-12-16T05:56:30.963 INFO:tasks.workunit.client.1.smithi156.stdout:3/34: symlink dc/le 0 2023-12-16T05:56:30.963 INFO:tasks.workunit.client.1.smithi156.stdout:3/35: read fb [4594302,25518] 0 2023-12-16T05:56:30.963 INFO:tasks.workunit.client.0.smithi155.stdout:1/430: truncate d1/d25/f32 1725281 0 2023-12-16T05:56:30.964 INFO:tasks.workunit.client.1.smithi156.stdout:5/150: mknod da/dc/c29 0 2023-12-16T05:56:30.964 INFO:tasks.workunit.client.1.smithi156.stdout:5/151: fdatasync da/dc/f19 0 2023-12-16T05:56:30.965 INFO:tasks.workunit.client.0.smithi155.stdout:4/360: unlink d0/d10/d46/d16/d30/d52/f56 0 2023-12-16T05:56:30.966 INFO:tasks.workunit.client.1.smithi156.stdout:7/135: mkdir d1e/d1f/d22/d29 0 2023-12-16T05:56:30.966 INFO:tasks.workunit.client.1.smithi156.stdout:7/136: rename d1e/d1f/d22 to d1e/d1f/d22/d2a 22 2023-12-16T05:56:30.968 INFO:tasks.workunit.client.0.smithi155.stdout:4/361: truncate d0/d10/f5b 3782749 0 2023-12-16T05:56:30.969 INFO:tasks.workunit.client.0.smithi155.stdout:2/322: dread d0/d7/dd/f26 [0,4194304] 0 2023-12-16T05:56:30.969 INFO:tasks.workunit.client.1.smithi156.stdout:6/49: mknod d9/cb 0 2023-12-16T05:56:30.970 INFO:tasks.workunit.client.0.smithi155.stdout:2/323: read d0/d34/d3c/f55 [3127992,23804] 0 2023-12-16T05:56:30.970 INFO:tasks.workunit.client.0.smithi155.stdout:2/324: chown d0/f1a 70698 1 2023-12-16T05:56:30.971 INFO:tasks.workunit.client.1.smithi156.stdout:8/65: mknod d3/d7/c15 0 2023-12-16T05:56:30.971 INFO:tasks.workunit.client.1.smithi156.stdout:4/47: mknod d9/ce 0 2023-12-16T05:56:30.971 INFO:tasks.workunit.client.1.smithi156.stdout:4/48: write f5 [734616,29830] 0 2023-12-16T05:56:30.971 INFO:tasks.workunit.client.1.smithi156.stdout:4/49: stat f3 0 2023-12-16T05:56:30.971 INFO:tasks.workunit.client.1.smithi156.stdout:4/50: fdatasync d9/fa 0 2023-12-16T05:56:30.971 INFO:tasks.workunit.client.1.smithi156.stdout:4/51: chown f2 125 1 2023-12-16T05:56:30.972 INFO:tasks.workunit.client.0.smithi155.stdout:2/325: truncate d0/d7/d69/f1b 4181629 0 2023-12-16T05:56:30.972 INFO:tasks.workunit.client.0.smithi155.stdout:2/326: truncate d0/d7/dd/f6e 1023468 0 2023-12-16T05:56:30.972 INFO:tasks.workunit.client.0.smithi155.stdout:2/327: readlink d0/d7/dd/d14/l4f 0 2023-12-16T05:56:30.972 INFO:tasks.workunit.client.0.smithi155.stdout:2/328: mknod d0/d34/d3c/c71 0 2023-12-16T05:56:30.972 INFO:tasks.workunit.client.0.smithi155.stdout:2/329: read - d0/d7/d69/f58 zero size 2023-12-16T05:56:30.973 INFO:tasks.workunit.client.1.smithi156.stdout:3/36: unlink dc/cd 0 2023-12-16T05:56:30.973 INFO:tasks.workunit.client.0.smithi155.stdout:2/330: getdents d0/d7/d57/d63 0 2023-12-16T05:56:30.976 INFO:tasks.workunit.client.1.smithi156.stdout:7/137: rename l1a to d1e/l2b 0 2023-12-16T05:56:30.977 INFO:tasks.workunit.client.1.smithi156.stdout:3/37: dread f7 [0,4194304] 0 2023-12-16T05:56:30.977 INFO:tasks.workunit.client.0.smithi155.stdout:1/431: dread d1/d7/d16/f1d [0,4194304] 0 2023-12-16T05:56:30.979 INFO:tasks.workunit.client.0.smithi155.stdout:1/432: link d1/d7/d4b/d72/f7d d1/d69/f8a 0 2023-12-16T05:56:30.979 INFO:tasks.workunit.client.0.smithi155.stdout:1/433: stat d1/d7/d16/d30/f62 0 2023-12-16T05:56:30.980 INFO:tasks.workunit.client.0.smithi155.stdout:1/434: write d1/d7/f18 [172717,72843] 0 2023-12-16T05:56:30.982 INFO:tasks.workunit.client.1.smithi156.stdout:6/50: rmdir d9 39 2023-12-16T05:56:30.982 INFO:tasks.workunit.client.0.smithi155.stdout:1/435: write d1/d7/f5a [2955561,71760] 0 2023-12-16T05:56:30.982 INFO:tasks.workunit.client.0.smithi155.stdout:1/436: write d1/d25/f32 [2328179,67357] 0 2023-12-16T05:56:30.983 INFO:tasks.workunit.client.0.smithi155.stdout:1/437: creat d1/d25/f8b x:0 0 0 2023-12-16T05:56:30.983 INFO:tasks.workunit.client.1.smithi156.stdout:2/68: dwrite f1 [0,4194304] 0 2023-12-16T05:56:30.984 INFO:tasks.workunit.client.0.smithi155.stdout:0/302: sync 2023-12-16T05:56:30.984 INFO:tasks.workunit.client.1.smithi156.stdout:5/152: dwrite da/dc/f11 [4194304,4194304] 0 2023-12-16T05:56:30.984 INFO:tasks.workunit.client.1.smithi156.stdout:8/66: unlink d3/d7/d9/c11 0 2023-12-16T05:56:30.985 INFO:tasks.workunit.client.0.smithi155.stdout:5/396: sync 2023-12-16T05:56:30.985 INFO:tasks.workunit.client.0.smithi155.stdout:1/438: link d1/d7/f75 d1/d17/d28/f8c 0 2023-12-16T05:56:30.985 INFO:tasks.workunit.client.1.smithi156.stdout:8/67: write f2 [171374,18941] 0 2023-12-16T05:56:30.986 INFO:tasks.workunit.client.0.smithi155.stdout:5/397: truncate d0/d2/d2a/f42 1235895 0 2023-12-16T05:56:30.987 INFO:tasks.workunit.client.1.smithi156.stdout:4/52: creat d9/ff x:0 0 0 2023-12-16T05:56:30.988 INFO:tasks.workunit.client.0.smithi155.stdout:1/439: read d1/f4f [38081,114614] 0 2023-12-16T05:56:30.988 INFO:tasks.workunit.client.0.smithi155.stdout:1/440: write d1/d7/d16/d30/f6e [882688,119468] 0 2023-12-16T05:56:30.989 INFO:tasks.workunit.client.1.smithi156.stdout:7/138: rmdir d1e/d1f/d22/d29 0 2023-12-16T05:56:30.991 INFO:tasks.workunit.client.1.smithi156.stdout:3/38: mkdir dc/df 0 2023-12-16T05:56:30.993 INFO:tasks.workunit.client.1.smithi156.stdout:6/51: rename d9/cb to d9/cc 0 2023-12-16T05:56:30.993 INFO:tasks.workunit.client.1.smithi156.stdout:6/52: fdatasync f8 0 2023-12-16T05:56:30.996 INFO:tasks.workunit.client.1.smithi156.stdout:2/69: creat d9/dd/f15 x:0 0 0 2023-12-16T05:56:30.998 INFO:tasks.workunit.client.1.smithi156.stdout:9/86: getdents d6/d19 0 2023-12-16T05:56:31.003 INFO:tasks.workunit.client.1.smithi156.stdout:5/153: unlink da/dc/fd 0 2023-12-16T05:56:31.004 INFO:tasks.workunit.client.1.smithi156.stdout:8/68: mkdir d3/d12/d16 0 2023-12-16T05:56:31.007 INFO:tasks.workunit.client.1.smithi156.stdout:3/39: mkdir dc/d10 0 2023-12-16T05:56:31.011 INFO:tasks.workunit.client.1.smithi156.stdout:2/70: symlink d9/l16 0 2023-12-16T05:56:31.012 INFO:tasks.workunit.client.0.smithi155.stdout:4/362: dwrite d0/d10/d46/f40 [0,4194304] 0 2023-12-16T05:56:31.012 INFO:tasks.workunit.client.1.smithi156.stdout:9/87: mkdir d6/d19/d25 0 2023-12-16T05:56:31.014 INFO:tasks.workunit.client.1.smithi156.stdout:8/69: creat d3/f17 x:0 0 0 2023-12-16T05:56:31.014 INFO:tasks.workunit.client.1.smithi156.stdout:8/70: chown d3/d12/l13 6008 1 2023-12-16T05:56:31.014 INFO:tasks.workunit.client.1.smithi156.stdout:8/71: fdatasync d3/f17 0 2023-12-16T05:56:31.015 INFO:tasks.workunit.client.0.smithi155.stdout:4/363: mkdir d0/d10/d46/d16/d1a/d70 0 2023-12-16T05:56:31.015 INFO:tasks.workunit.client.1.smithi156.stdout:9/88: dread d6/f14 [0,4194304] 0 2023-12-16T05:56:31.015 INFO:tasks.workunit.client.1.smithi156.stdout:3/40: link f8 dc/d10/f11 0 2023-12-16T05:56:31.015 INFO:tasks.workunit.client.1.smithi156.stdout:3/41: chown l9 0 1 2023-12-16T05:56:31.016 INFO:tasks.workunit.client.0.smithi155.stdout:0/303: dwrite d7/f29 [0,4194304] 0 2023-12-16T05:56:31.016 INFO:tasks.workunit.client.0.smithi155.stdout:0/304: stat d7/f29 0 2023-12-16T05:56:31.017 INFO:tasks.workunit.client.1.smithi156.stdout:4/53: dwrite d9/fc [0,4194304] 0 2023-12-16T05:56:31.017 INFO:tasks.workunit.client.1.smithi156.stdout:2/71: rename d9/dc/d13 to d9/dd/d17 0 2023-12-16T05:56:31.017 INFO:tasks.workunit.client.0.smithi155.stdout:4/364: symlink d0/da/d36/d6e/d3d/d49/d6b/l71 0 2023-12-16T05:56:31.018 INFO:tasks.workunit.client.1.smithi156.stdout:9/89: chown d6/d19/f1f 1 1 2023-12-16T05:56:31.020 INFO:tasks.workunit.client.1.smithi156.stdout:4/54: mknod d9/c10 0 2023-12-16T05:56:31.020 INFO:tasks.workunit.client.1.smithi156.stdout:4/55: fdatasync f0 0 2023-12-16T05:56:31.023 INFO:tasks.workunit.client.1.smithi156.stdout:8/72: dread f2 [0,4194304] 0 2023-12-16T05:56:31.024 INFO:tasks.workunit.client.1.smithi156.stdout:2/72: link f2 d9/d12/f18 0 2023-12-16T05:56:31.025 INFO:tasks.workunit.client.0.smithi155.stdout:5/398: dwrite d0/d2/f1a [0,4194304] 0 2023-12-16T05:56:31.026 INFO:tasks.workunit.client.0.smithi155.stdout:5/399: chown d0/d2/d2a/l2b 463 1 2023-12-16T05:56:31.026 INFO:tasks.workunit.client.0.smithi155.stdout:5/400: truncate d0/d2/d2a/d3c/f6c 479700 0 2023-12-16T05:56:31.026 INFO:tasks.workunit.client.1.smithi156.stdout:3/42: rename la to dc/d10/l12 0 2023-12-16T05:56:31.026 INFO:tasks.workunit.client.1.smithi156.stdout:3/43: dread - f8 zero size 2023-12-16T05:56:31.027 INFO:tasks.workunit.client.0.smithi155.stdout:0/305: dread d7/f2a [0,4194304] 0 2023-12-16T05:56:31.027 INFO:tasks.workunit.client.1.smithi156.stdout:5/154: dwrite da/f28 [0,4194304] 0 2023-12-16T05:56:31.027 INFO:tasks.workunit.client.1.smithi156.stdout:9/90: mknod d6/d19/d25/c26 0 2023-12-16T05:56:31.027 INFO:tasks.workunit.client.1.smithi156.stdout:8/73: dread f2 [0,4194304] 0 2023-12-16T05:56:31.028 INFO:tasks.workunit.client.0.smithi155.stdout:0/306: truncate d7/fe 608322 0 2023-12-16T05:56:31.029 INFO:tasks.workunit.client.1.smithi156.stdout:8/74: dread d3/fe [0,4194304] 0 2023-12-16T05:56:31.029 INFO:tasks.workunit.client.0.smithi155.stdout:0/307: read d7/d2d/f2f [601953,102509] 0 2023-12-16T05:56:31.029 INFO:tasks.workunit.client.0.smithi155.stdout:1/441: dwrite d1/d7/d4b/f55 [4194304,4194304] 0 2023-12-16T05:56:31.029 INFO:tasks.workunit.client.1.smithi156.stdout:8/75: write d3/fe [141759,57950] 0 2023-12-16T05:56:31.031 INFO:tasks.workunit.client.0.smithi155.stdout:0/308: mknod d7/d47/c59 0 2023-12-16T05:56:31.031 INFO:tasks.workunit.client.0.smithi155.stdout:0/309: write d7/d30/f55 [214871,50994] 0 2023-12-16T05:56:31.031 INFO:tasks.workunit.client.1.smithi156.stdout:2/73: unlink d9/l16 0 2023-12-16T05:56:31.032 INFO:tasks.workunit.client.0.smithi155.stdout:1/442: link d1/l23 d1/d17/d28/d85/l8d 0 2023-12-16T05:56:31.032 INFO:tasks.workunit.client.0.smithi155.stdout:1/443: getdents d1/d7/d4b/d72 0 2023-12-16T05:56:31.033 INFO:tasks.workunit.client.0.smithi155.stdout:0/310: mknod d7/d47/d53/c5a 0 2023-12-16T05:56:31.034 INFO:tasks.workunit.client.0.smithi155.stdout:0/311: fsync d7/df/f58 0 2023-12-16T05:56:31.035 INFO:tasks.workunit.client.0.smithi155.stdout:4/365: rmdir d0 39 2023-12-16T05:56:31.037 INFO:tasks.workunit.client.0.smithi155.stdout:0/312: link d7/c12 d7/d2d/c5b 0 2023-12-16T05:56:31.037 INFO:tasks.workunit.client.1.smithi156.stdout:9/91: stat f3 0 2023-12-16T05:56:31.039 INFO:tasks.workunit.client.0.smithi155.stdout:4/366: link d0/da/d36/d6e/d50/f6a d0/d10/d46/d16/d1a/f72 0 2023-12-16T05:56:31.040 INFO:tasks.workunit.client.1.smithi156.stdout:5/155: dread da/dc/f17 [0,4194304] 0 2023-12-16T05:56:31.040 INFO:tasks.workunit.client.1.smithi156.stdout:8/76: mkdir d3/d18 0 2023-12-16T05:56:31.041 INFO:tasks.workunit.client.1.smithi156.stdout:8/77: write d3/ff [3199782,97561] 0 2023-12-16T05:56:31.041 INFO:tasks.workunit.client.1.smithi156.stdout:2/74: creat d9/dd/f19 x:0 0 0 2023-12-16T05:56:31.041 INFO:tasks.workunit.client.0.smithi155.stdout:1/444: dread d1/d17/f65 [0,4194304] 0 2023-12-16T05:56:31.042 INFO:tasks.workunit.client.0.smithi155.stdout:4/367: creat d0/da/f73 x:0 0 0 2023-12-16T05:56:31.042 INFO:tasks.workunit.client.0.smithi155.stdout:4/368: fsync d0/d10/d46/d16/f4b 0 2023-12-16T05:56:31.042 INFO:tasks.workunit.client.0.smithi155.stdout:4/369: stat d0/da/d36/d5f 0 2023-12-16T05:56:31.043 INFO:tasks.workunit.client.1.smithi156.stdout:9/92: symlink d6/d19/d25/l27 0 2023-12-16T05:56:31.046 INFO:tasks.workunit.client.0.smithi155.stdout:1/445: read d1/f1e [77703,48684] 0 2023-12-16T05:56:31.047 INFO:tasks.workunit.client.0.smithi155.stdout:1/446: unlink d1/d7/l5f 0 2023-12-16T05:56:31.048 INFO:tasks.workunit.client.0.smithi155.stdout:1/447: mkdir d1/d7/d4b/d8e 0 2023-12-16T05:56:31.049 INFO:tasks.workunit.client.0.smithi155.stdout:1/448: mkdir d1/d17/d28/d8f 0 2023-12-16T05:56:31.049 INFO:tasks.workunit.client.1.smithi156.stdout:9/93: creat d6/f28 x:0 0 0 2023-12-16T05:56:31.050 INFO:tasks.workunit.client.0.smithi155.stdout:1/449: rmdir d1/d7/d16 39 2023-12-16T05:56:31.051 INFO:tasks.workunit.client.0.smithi155.stdout:1/450: mknod d1/d17/d28/d74/c90 0 2023-12-16T05:56:31.052 INFO:tasks.workunit.client.0.smithi155.stdout:1/451: link c0 d1/d17/c91 0 2023-12-16T05:56:31.052 INFO:tasks.workunit.client.0.smithi155.stdout:4/370: dread d0/da/d36/d6e/d3d/d49/f61 [0,4194304] 0 2023-12-16T05:56:31.053 INFO:tasks.workunit.client.0.smithi155.stdout:4/371: chown d0/d10/d46/d16/d1a/d70 981 1 2023-12-16T05:56:31.053 INFO:tasks.workunit.client.0.smithi155.stdout:1/452: mkdir d1/d92 0 2023-12-16T05:56:31.054 INFO:tasks.workunit.client.0.smithi155.stdout:1/453: creat d1/d17/d28/f93 x:0 0 0 2023-12-16T05:56:31.055 INFO:tasks.workunit.client.1.smithi156.stdout:3/44: getdents dc 0 2023-12-16T05:56:31.055 INFO:tasks.workunit.client.1.smithi156.stdout:3/45: truncate f8 698131 0 2023-12-16T05:56:31.055 INFO:tasks.workunit.client.1.smithi156.stdout:7/139: write d1e/d1f/d22/f23 [736434,115047] 0 2023-12-16T05:56:31.055 INFO:tasks.workunit.client.1.smithi156.stdout:7/140: chown c17 752364 1 2023-12-16T05:56:31.055 INFO:tasks.workunit.client.1.smithi156.stdout:9/94: truncate d6/d19/f20 1331194 0 2023-12-16T05:56:31.056 INFO:tasks.workunit.client.0.smithi155.stdout:1/454: creat d1/d17/f94 x:0 0 0 2023-12-16T05:56:31.056 INFO:tasks.workunit.client.0.smithi155.stdout:1/455: getdents d1/d17/d28/d8f 0 2023-12-16T05:56:31.056 INFO:tasks.workunit.client.0.smithi155.stdout:1/456: read d1/d7/d4b/d72/f7d [3542144,105034] 0 2023-12-16T05:56:31.057 INFO:tasks.workunit.client.0.smithi155.stdout:5/401: dwrite d0/d2/d2a/f44 [0,4194304] 0 2023-12-16T05:56:31.058 INFO:tasks.workunit.client.0.smithi155.stdout:4/372: dread d0/f20 [0,4194304] 0 2023-12-16T05:56:31.058 INFO:tasks.workunit.client.0.smithi155.stdout:4/373: dread - d0/da/f73 zero size 2023-12-16T05:56:31.058 INFO:tasks.workunit.client.0.smithi155.stdout:4/374: chown d0/d10/d46/d16 5008725 1 2023-12-16T05:56:31.059 INFO:tasks.workunit.client.1.smithi156.stdout:5/156: rmdir da/d24 0 2023-12-16T05:56:31.059 INFO:tasks.workunit.client.0.smithi155.stdout:0/313: dwrite d7/d13/d45/f4f [0,4194304] 0 2023-12-16T05:56:31.059 INFO:tasks.workunit.client.0.smithi155.stdout:0/314: chown d7/d2d/f3c 307 1 2023-12-16T05:56:31.061 INFO:tasks.workunit.client.0.smithi155.stdout:5/402: link d0/d2/d2a/d19/d71/l72 d0/d2/d2a/d3c/d47/l7c 0 2023-12-16T05:56:31.065 INFO:tasks.workunit.client.1.smithi156.stdout:7/141: mkdir d1e/d1f/d22/d2c 0 2023-12-16T05:56:31.065 INFO:tasks.workunit.client.1.smithi156.stdout:7/142: write d1e/d1f/d22/f25 [481075,109303] 0 2023-12-16T05:56:31.065 INFO:tasks.workunit.client.0.smithi155.stdout:4/375: rename d0/d10/d46/d16/d30/l57 to d0/d10/d46/d16/d30/d52/d54/l74 0 2023-12-16T05:56:31.065 INFO:tasks.workunit.client.0.smithi155.stdout:4/376: dread - d0/da/d36/d6e/d50/f6a zero size 2023-12-16T05:56:31.065 INFO:tasks.workunit.client.0.smithi155.stdout:5/403: truncate d0/d2/d2a/f18 5348716 0 2023-12-16T05:56:31.065 INFO:tasks.workunit.client.0.smithi155.stdout:5/404: readlink d0/d2/d2a/d19/d71/l72 0 2023-12-16T05:56:31.066 INFO:tasks.workunit.client.0.smithi155.stdout:5/405: symlink d0/d2/d2a/d3c/d47/l7d 0 2023-12-16T05:56:31.068 INFO:tasks.workunit.client.1.smithi156.stdout:6/53: truncate f8 2005942 0 2023-12-16T05:56:31.068 INFO:tasks.workunit.client.1.smithi156.stdout:6/54: truncate f6 710371 0 2023-12-16T05:56:31.068 INFO:tasks.workunit.client.1.smithi156.stdout:6/55: fdatasync f6 0 2023-12-16T05:56:31.071 INFO:tasks.workunit.client.1.smithi156.stdout:6/56: mknod d9/cd 0 2023-12-16T05:56:31.077 INFO:tasks.workunit.client.1.smithi156.stdout:6/57: rename d9/la to d9/le 0 2023-12-16T05:56:31.080 INFO:tasks.workunit.client.1.smithi156.stdout:3/46: dwrite f8 [0,4194304] 0 2023-12-16T05:56:31.083 INFO:tasks.workunit.client.1.smithi156.stdout:6/58: rmdir d9 39 2023-12-16T05:56:31.087 INFO:tasks.workunit.client.1.smithi156.stdout:2/75: truncate d9/d12/f18 1269310 0 2023-12-16T05:56:31.088 INFO:tasks.workunit.client.1.smithi156.stdout:6/59: creat d9/ff x:0 0 0 2023-12-16T05:56:31.089 INFO:tasks.workunit.client.1.smithi156.stdout:7/143: dread d1e/f24 [0,4194304] 0 2023-12-16T05:56:31.090 INFO:tasks.workunit.client.0.smithi155.stdout:4/377: rename d0/da/d36/d6e to d0/da/d36/d5f/d75 0 2023-12-16T05:56:31.092 INFO:tasks.workunit.client.1.smithi156.stdout:5/157: dwrite da/dc/f11 [4194304,4194304] 0 2023-12-16T05:56:31.092 INFO:tasks.workunit.client.1.smithi156.stdout:5/158: chown f0 35673709 1 2023-12-16T05:56:31.093 INFO:tasks.workunit.client.1.smithi156.stdout:6/60: write f5 [1826685,21895] 0 2023-12-16T05:56:31.094 INFO:tasks.workunit.client.0.smithi155.stdout:1/457: dwrite d1/d7/f75 [0,4194304] 0 2023-12-16T05:56:31.095 INFO:tasks.workunit.client.1.smithi156.stdout:7/144: unlink c17 0 2023-12-16T05:56:31.097 INFO:tasks.workunit.client.1.smithi156.stdout:6/61: chown c4 0 1 2023-12-16T05:56:31.099 INFO:tasks.workunit.client.1.smithi156.stdout:7/145: mknod d1e/d1f/c2d 0 2023-12-16T05:56:31.099 INFO:tasks.workunit.client.1.smithi156.stdout:8/78: truncate d3/ff 141571 0 2023-12-16T05:56:31.100 INFO:tasks.workunit.client.0.smithi155.stdout:1/458: rename d1/d7/d16/f63 to d1/d7/f95 0 2023-12-16T05:56:31.101 INFO:tasks.workunit.client.0.smithi155.stdout:5/406: dwrite d0/d2/d2a/d19/f20 [0,4194304] 0 2023-12-16T05:56:31.102 INFO:tasks.workunit.client.1.smithi156.stdout:6/62: mknod d9/c10 0 2023-12-16T05:56:31.102 INFO:tasks.workunit.client.1.smithi156.stdout:6/63: write d9/ff [201479,42586] 0 2023-12-16T05:56:31.104 INFO:tasks.workunit.client.1.smithi156.stdout:7/146: mkdir d1e/d1f/d22/d2c/d2e 0 2023-12-16T05:56:31.107 INFO:tasks.workunit.client.1.smithi156.stdout:0/119: sync 2023-12-16T05:56:31.107 INFO:tasks.workunit.client.1.smithi156.stdout:0/120: chown d2/d7/dd/d1c 386583725 1 2023-12-16T05:56:31.107 INFO:tasks.workunit.client.1.smithi156.stdout:8/79: creat d3/d18/f19 x:0 0 0 2023-12-16T05:56:31.107 INFO:tasks.workunit.client.1.smithi156.stdout:5/159: link da/dc/f19 da/dc/f2a 0 2023-12-16T05:56:31.109 INFO:tasks.workunit.client.0.smithi155.stdout:1/459: getdents d1/d69 0 2023-12-16T05:56:31.109 INFO:tasks.workunit.client.1.smithi156.stdout:0/121: write d2/fe [4397014,43330] 0 2023-12-16T05:56:31.111 INFO:tasks.workunit.client.1.smithi156.stdout:0/122: getdents d2/d7 0 2023-12-16T05:56:31.111 INFO:tasks.workunit.client.1.smithi156.stdout:8/80: dread d3/f8 [0,4194304] 0 2023-12-16T05:56:31.111 INFO:tasks.workunit.client.1.smithi156.stdout:8/81: fdatasync d3/ff 0 2023-12-16T05:56:31.111 INFO:tasks.workunit.client.1.smithi156.stdout:8/82: readlink d3/d7/l14 0 2023-12-16T05:56:31.112 INFO:tasks.workunit.client.0.smithi155.stdout:5/407: creat d0/d2/d2a/d19/d71/f7e x:0 0 0 2023-12-16T05:56:31.113 INFO:tasks.workunit.client.0.smithi155.stdout:5/408: creat d0/d2/d2a/f7f x:0 0 0 2023-12-16T05:56:31.113 INFO:tasks.workunit.client.1.smithi156.stdout:0/123: creat d2/d7/dd/f1f x:0 0 0 2023-12-16T05:56:31.114 INFO:tasks.workunit.client.1.smithi156.stdout:5/160: symlink da/dc/l2b 0 2023-12-16T05:56:31.118 INFO:tasks.workunit.client.1.smithi156.stdout:5/161: unlink da/dc/c29 0 2023-12-16T05:56:31.119 INFO:tasks.workunit.client.1.smithi156.stdout:5/162: creat da/dc/f2c x:0 0 0 2023-12-16T05:56:31.172 INFO:tasks.workunit.client.0.smithi155.stdout:1/460: dread d1/d7/d16/d30/f76 [0,4194304] 0 2023-12-16T05:56:31.183 INFO:tasks.workunit.client.1.smithi156.stdout:3/47: dwrite fb [0,4194304] 0 2023-12-16T05:56:31.184 INFO:tasks.workunit.client.1.smithi156.stdout:3/48: symlink dc/d10/l13 0 2023-12-16T05:56:31.185 INFO:tasks.workunit.client.1.smithi156.stdout:3/49: write f7 [2619548,102403] 0 2023-12-16T05:56:31.189 INFO:tasks.workunit.client.1.smithi156.stdout:6/64: dread d9/ff [0,4194304] 0 2023-12-16T05:56:31.194 INFO:tasks.workunit.client.1.smithi156.stdout:5/163: dwrite da/f1e [0,4194304] 0 2023-12-16T05:56:31.197 INFO:tasks.workunit.client.0.smithi155.stdout:0/315: dwrite d7/fe [0,4194304] 0 2023-12-16T05:56:31.198 INFO:tasks.workunit.client.1.smithi156.stdout:2/76: dwrite d9/dd/f19 [0,4194304] 0 2023-12-16T05:56:31.198 INFO:tasks.workunit.client.1.smithi156.stdout:2/77: fdatasync d9/dc/fe 0 2023-12-16T05:56:31.199 INFO:tasks.workunit.client.0.smithi155.stdout:5/409: dwrite d0/d2/d2a/f63 [0,4194304] 0 2023-12-16T05:56:31.199 INFO:tasks.workunit.client.0.smithi155.stdout:5/410: fdatasync d0/d2/f6e 0 2023-12-16T05:56:31.199 INFO:tasks.workunit.client.1.smithi156.stdout:7/147: dwrite d1e/f24 [4194304,4194304] 0 2023-12-16T05:56:31.200 INFO:tasks.workunit.client.1.smithi156.stdout:0/124: dwrite d2/d7/f15 [0,4194304] 0 2023-12-16T05:56:31.200 INFO:tasks.workunit.client.1.smithi156.stdout:0/125: fsync d2/d7/f15 0 2023-12-16T05:56:31.200 INFO:tasks.workunit.client.1.smithi156.stdout:0/126: fdatasync f0 0 2023-12-16T05:56:31.202 INFO:tasks.workunit.client.0.smithi155.stdout:5/411: read d0/d2/f1a [4046020,40612] 0 2023-12-16T05:56:31.202 INFO:tasks.workunit.client.0.smithi155.stdout:5/412: read - d0/d2/d2a/d19/d48/f58 zero size 2023-12-16T05:56:31.202 INFO:tasks.workunit.client.1.smithi156.stdout:2/78: creat d9/d12/f1a x:0 0 0 2023-12-16T05:56:31.203 INFO:tasks.workunit.client.0.smithi155.stdout:5/413: read d0/d2/d2a/fe [770788,47880] 0 2023-12-16T05:56:31.203 INFO:tasks.workunit.client.0.smithi155.stdout:5/414: dread - d0/d60/f74 zero size 2023-12-16T05:56:31.204 INFO:tasks.workunit.client.1.smithi156.stdout:2/79: dread d9/dc/fe [0,4194304] 0 2023-12-16T05:56:31.204 INFO:tasks.workunit.client.1.smithi156.stdout:2/80: chown d9/d12/f1a 28252659 1 2023-12-16T05:56:31.204 INFO:tasks.workunit.client.1.smithi156.stdout:2/81: chown l3 27 1 2023-12-16T05:56:31.204 INFO:tasks.workunit.client.1.smithi156.stdout:5/164: dread da/dc/f15 [0,4194304] 0 2023-12-16T05:56:31.206 INFO:tasks.workunit.client.0.smithi155.stdout:5/415: creat d0/d2/d2a/d30/d53/d7b/f80 x:0 0 0 2023-12-16T05:56:31.206 INFO:tasks.workunit.client.1.smithi156.stdout:7/148: truncate d1e/d1f/d22/f23 603280 0 2023-12-16T05:56:31.207 INFO:tasks.workunit.client.1.smithi156.stdout:7/149: fsync d1e/d1f/d22/f25 0 2023-12-16T05:56:31.209 INFO:tasks.workunit.client.0.smithi155.stdout:5/416: mknod d0/d2/d2a/d19/d59/d66/c81 0 2023-12-16T05:56:31.209 INFO:tasks.workunit.client.0.smithi155.stdout:5/417: truncate d0/d2/d2a/d3c/f6c 1009554 0 2023-12-16T05:56:31.211 INFO:tasks.workunit.client.0.smithi155.stdout:5/418: rename d0/d2/f3b to d0/d2/d2a/d3c/d47/f82 0 2023-12-16T05:56:31.213 INFO:tasks.workunit.client.0.smithi155.stdout:3/269: sync 2023-12-16T05:56:31.213 INFO:tasks.workunit.client.0.smithi155.stdout:3/270: dread - d0/d1a/d2f/f4a zero size 2023-12-16T05:56:31.213 INFO:tasks.workunit.client.0.smithi155.stdout:3/271: write d0/d14/f34 [813917,66707] 0 2023-12-16T05:56:31.213 INFO:tasks.workunit.client.0.smithi155.stdout:0/316: dread d7/df/f26 [0,4194304] 0 2023-12-16T05:56:31.214 INFO:tasks.workunit.client.0.smithi155.stdout:8/334: sync 2023-12-16T05:56:31.214 INFO:tasks.workunit.client.0.smithi155.stdout:9/474: sync 2023-12-16T05:56:31.214 INFO:tasks.workunit.client.0.smithi155.stdout:8/335: truncate d4/da/d1b/d1c/d1a/f2d 1429391 0 2023-12-16T05:56:31.214 INFO:tasks.workunit.client.0.smithi155.stdout:6/484: sync 2023-12-16T05:56:31.214 INFO:tasks.workunit.client.0.smithi155.stdout:8/336: write d4/da/d1b/d1c/d1a/d1f/f59 [450515,114994] 0 2023-12-16T05:56:31.214 INFO:tasks.workunit.client.0.smithi155.stdout:7/413: sync 2023-12-16T05:56:31.215 INFO:tasks.workunit.client.0.smithi155.stdout:6/485: dread d0/df/d5e/d5b/f76 [0,4194304] 0 2023-12-16T05:56:31.217 INFO:tasks.workunit.client.1.smithi156.stdout:2/82: creat d9/dd/f1b x:0 0 0 2023-12-16T05:56:31.217 INFO:tasks.workunit.client.1.smithi156.stdout:2/83: chown f1 1 1 2023-12-16T05:56:31.217 INFO:tasks.workunit.client.1.smithi156.stdout:2/84: truncate d9/fa 713190 0 2023-12-16T05:56:31.217 INFO:tasks.workunit.client.1.smithi156.stdout:2/85: chown d9/dc/f10 75 1 2023-12-16T05:56:31.218 INFO:tasks.workunit.client.1.smithi156.stdout:7/150: dread d1e/f24 [0,4194304] 0 2023-12-16T05:56:31.219 INFO:tasks.workunit.client.1.smithi156.stdout:5/165: truncate da/dc/f17 1737981 0 2023-12-16T05:56:31.220 INFO:tasks.workunit.client.0.smithi155.stdout:3/272: rename d0/d1a/d2f to d0/d14/d51 0 2023-12-16T05:56:31.220 INFO:tasks.workunit.client.1.smithi156.stdout:3/50: truncate fb 7348582 0 2023-12-16T05:56:31.221 INFO:tasks.workunit.client.1.smithi156.stdout:3/51: write f4 [435788,44029] 0 2023-12-16T05:56:31.222 INFO:tasks.workunit.client.0.smithi155.stdout:9/475: rmdir da/d15/d17/d36/d5b/d60/d99 0 2023-12-16T05:56:31.223 INFO:tasks.workunit.client.1.smithi156.stdout:7/151: link c16 d1e/d1f/c2f 0 2023-12-16T05:56:31.225 INFO:tasks.workunit.client.0.smithi155.stdout:0/317: dread d7/f2a [0,4194304] 0 2023-12-16T05:56:31.225 INFO:tasks.workunit.client.0.smithi155.stdout:0/318: chown d7/l18 4 1 2023-12-16T05:56:31.225 INFO:tasks.workunit.client.0.smithi155.stdout:3/273: rename d0/c4b to d0/d1e/d4e/c52 0 2023-12-16T05:56:31.226 INFO:tasks.workunit.client.0.smithi155.stdout:0/319: creat d7/d30/f5c x:0 0 0 2023-12-16T05:56:31.226 INFO:tasks.workunit.client.1.smithi156.stdout:5/166: truncate f0 5260353 0 2023-12-16T05:56:31.226 INFO:tasks.workunit.client.1.smithi156.stdout:5/167: write da/dc/f11 [8567652,81231] 0 2023-12-16T05:56:31.228 INFO:tasks.workunit.client.1.smithi156.stdout:3/52: creat dc/f14 x:0 0 0 2023-12-16T05:56:31.228 INFO:tasks.workunit.client.1.smithi156.stdout:7/152: truncate f9 2137176 0 2023-12-16T05:56:31.231 INFO:tasks.workunit.client.1.smithi156.stdout:0/127: dwrite f0 [0,4194304] 0 2023-12-16T05:56:31.231 INFO:tasks.workunit.client.1.smithi156.stdout:0/128: write d2/f1b [134497,42513] 0 2023-12-16T05:56:31.232 INFO:tasks.workunit.client.1.smithi156.stdout:0/129: truncate d2/d7/f15 4666421 0 2023-12-16T05:56:31.232 INFO:tasks.workunit.client.0.smithi155.stdout:8/337: dread d4/da/d12/f2e [0,4194304] 0 2023-12-16T05:56:31.232 INFO:tasks.workunit.client.0.smithi155.stdout:8/338: truncate d4/da/f4c 365639 0 2023-12-16T05:56:31.232 INFO:tasks.workunit.client.0.smithi155.stdout:6/486: read d0/d3/f6 [4718830,101511] 0 2023-12-16T05:56:31.232 INFO:tasks.workunit.client.0.smithi155.stdout:6/487: readlink d0/d3/d7a/l45 0 2023-12-16T05:56:31.233 INFO:tasks.workunit.client.0.smithi155.stdout:3/274: read d0/fe [3247226,130594] 0 2023-12-16T05:56:31.233 INFO:tasks.workunit.client.0.smithi155.stdout:8/339: mkdir d4/d62/d66 0 2023-12-16T05:56:31.233 INFO:tasks.workunit.client.1.smithi156.stdout:3/53: mknod dc/df/c15 0 2023-12-16T05:56:31.233 INFO:tasks.workunit.client.0.smithi155.stdout:6/488: mkdir d0/df/d5e/d99 0 2023-12-16T05:56:31.234 INFO:tasks.workunit.client.0.smithi155.stdout:6/489: fdatasync d0/df/d5e/f61 0 2023-12-16T05:56:31.234 INFO:tasks.workunit.client.0.smithi155.stdout:3/275: rename d0/l27 to d0/d1a/l53 0 2023-12-16T05:56:31.235 INFO:tasks.workunit.client.1.smithi156.stdout:6/65: dread f5 [0,4194304] 0 2023-12-16T05:56:31.235 INFO:tasks.workunit.client.1.smithi156.stdout:7/153: symlink d1e/d1f/l30 0 2023-12-16T05:56:31.235 INFO:tasks.workunit.client.0.smithi155.stdout:8/340: symlink d4/da/d1b/d1c/l67 0 2023-12-16T05:56:31.235 INFO:tasks.workunit.client.0.smithi155.stdout:8/341: readlink d4/l5b 0 2023-12-16T05:56:31.236 INFO:tasks.workunit.client.0.smithi155.stdout:8/342: write d4/da/f4c [416237,111748] 0 2023-12-16T05:56:31.237 INFO:tasks.workunit.client.0.smithi155.stdout:3/276: creat d0/d14/d45/f54 x:0 0 0 2023-12-16T05:56:31.237 INFO:tasks.workunit.client.0.smithi155.stdout:8/343: getdents d4/da/d1b/d1c/d1a/d1f/d29 0 2023-12-16T05:56:31.238 INFO:tasks.workunit.client.0.smithi155.stdout:8/344: write d4/da/d1b/d1c/d1a/d1f/d4f/f63 [1031517,77834] 0 2023-12-16T05:56:31.238 INFO:tasks.workunit.client.0.smithi155.stdout:8/345: fsync f2 0 2023-12-16T05:56:31.238 INFO:tasks.workunit.client.1.smithi156.stdout:3/54: write dc/d10/f11 [194281,100108] 0 2023-12-16T05:56:31.239 INFO:tasks.workunit.client.0.smithi155.stdout:3/277: unlink d0/d14/c1c 0 2023-12-16T05:56:31.239 INFO:tasks.workunit.client.0.smithi155.stdout:8/346: symlink d4/d62/l68 0 2023-12-16T05:56:31.241 INFO:tasks.workunit.client.1.smithi156.stdout:6/66: rmdir d9 39 2023-12-16T05:56:31.242 INFO:tasks.workunit.client.0.smithi155.stdout:3/278: unlink d0/f15 0 2023-12-16T05:56:31.242 INFO:tasks.workunit.client.0.smithi155.stdout:3/279: write d0/d14/d45/f54 [313625,45559] 0 2023-12-16T05:56:31.243 INFO:tasks.workunit.client.0.smithi155.stdout:3/280: link d0/d14/d36/f3e d0/f55 0 2023-12-16T05:56:31.244 INFO:tasks.workunit.client.1.smithi156.stdout:7/154: rename d1e/d1f/d22/c28 to d1e/d1f/d22/c31 0 2023-12-16T05:56:31.245 INFO:tasks.workunit.client.0.smithi155.stdout:3/281: creat d0/d1a/d33/f56 x:0 0 0 2023-12-16T05:56:31.245 INFO:tasks.workunit.client.1.smithi156.stdout:7/155: creat d1e/f32 x:0 0 0 2023-12-16T05:56:31.245 INFO:tasks.workunit.client.1.smithi156.stdout:7/156: chown l11 0 1 2023-12-16T05:56:31.246 INFO:tasks.workunit.client.0.smithi155.stdout:3/282: mkdir d0/d1a/d33/d57 0 2023-12-16T05:56:31.246 INFO:tasks.workunit.client.0.smithi155.stdout:3/283: write d0/f55 [644809,72699] 0 2023-12-16T05:56:31.248 INFO:tasks.workunit.client.0.smithi155.stdout:3/284: link d0/d14/d36/c3b d0/d14/d45/c58 0 2023-12-16T05:56:31.249 INFO:tasks.workunit.client.0.smithi155.stdout:3/285: creat d0/d1e/f59 x:0 0 0 2023-12-16T05:56:31.256 INFO:tasks.workunit.client.1.smithi156.stdout:3/55: dread f8 [0,4194304] 0 2023-12-16T05:56:31.261 INFO:tasks.workunit.client.0.smithi155.stdout:6/490: dwrite d0/d3/f39 [0,4194304] 0 2023-12-16T05:56:31.264 INFO:tasks.workunit.client.0.smithi155.stdout:6/491: mknod d0/d3/d2c/c9a 0 2023-12-16T05:56:31.267 INFO:tasks.workunit.client.1.smithi156.stdout:7/157: dwrite f4 [0,4194304] 0 2023-12-16T05:56:31.267 INFO:tasks.workunit.client.1.smithi156.stdout:6/67: dwrite f8 [0,4194304] 0 2023-12-16T05:56:31.267 INFO:tasks.workunit.client.1.smithi156.stdout:6/68: write f8 [4370008,110907] 0 2023-12-16T05:56:31.271 INFO:tasks.workunit.client.1.smithi156.stdout:6/69: write f8 [1457975,71400] 0 2023-12-16T05:56:31.273 INFO:tasks.workunit.client.1.smithi156.stdout:6/70: creat d9/f11 x:0 0 0 2023-12-16T05:56:31.273 INFO:tasks.workunit.client.1.smithi156.stdout:6/71: creat d9/f12 x:0 0 0 2023-12-16T05:56:31.280 INFO:tasks.workunit.client.0.smithi155.stdout:6/492: dwrite d0/d3/f11 [0,4194304] 0 2023-12-16T05:56:31.280 INFO:tasks.workunit.client.0.smithi155.stdout:6/493: write d0/df/f26 [4628069,51615] 0 2023-12-16T05:56:31.281 INFO:tasks.workunit.client.0.smithi155.stdout:6/494: creat d0/df/d5e/d99/f9b x:0 0 0 2023-12-16T05:56:31.281 INFO:tasks.workunit.client.0.smithi155.stdout:6/495: stat d0/d3/d2c/c9a 0 2023-12-16T05:56:31.281 INFO:tasks.workunit.client.0.smithi155.stdout:6/496: chown d0/d3/d2c 17195180 1 2023-12-16T05:56:31.281 INFO:tasks.workunit.client.0.smithi155.stdout:6/497: chown d0/d3/d2c/d3e/d4c/d1b/l56 5 1 2023-12-16T05:56:31.288 INFO:tasks.workunit.client.0.smithi155.stdout:6/498: dread d0/df/f35 [0,4194304] 0 2023-12-16T05:56:31.289 INFO:tasks.workunit.client.0.smithi155.stdout:6/499: creat d0/d3/d7a/f9c x:0 0 0 2023-12-16T05:56:31.291 INFO:tasks.workunit.client.0.smithi155.stdout:6/500: link d0/df/d43/f70 d0/df/f9d 0 2023-12-16T05:56:31.293 INFO:tasks.workunit.client.0.smithi155.stdout:6/501: rename d0/df/d5e/d46/d6d/c95 to d0/d3/d7a/d77/c9e 0 2023-12-16T05:56:31.293 INFO:tasks.workunit.client.0.smithi155.stdout:6/502: fdatasync d0/d3/d2c/d3e/d4c/f1d 0 2023-12-16T05:56:31.293 INFO:tasks.workunit.client.0.smithi155.stdout:6/503: stat d0/d3/d2c/d3e/d4c/d1b/l20 0 2023-12-16T05:56:31.298 INFO:tasks.workunit.client.0.smithi155.stdout:8/347: fdatasync d4/da/d1b/d1c/d1a/d1f/f59 0 2023-12-16T05:56:31.299 INFO:tasks.workunit.client.0.smithi155.stdout:8/348: readlink d4/da/d1b/l47 0 2023-12-16T05:56:31.299 INFO:tasks.workunit.client.0.smithi155.stdout:5/419: dwrite d0/d2/d2a/d19/d21/f23 [0,4194304] 0 2023-12-16T05:56:31.301 INFO:tasks.workunit.client.1.smithi156.stdout:7/158: truncate d1e/d1f/d22/f25 421759 0 2023-12-16T05:56:31.302 INFO:tasks.workunit.client.1.smithi156.stdout:7/159: write d1e/f27 [252097,125691] 0 2023-12-16T05:56:31.302 INFO:tasks.workunit.client.1.smithi156.stdout:7/160: chown d1e/l2b 6164 1 2023-12-16T05:56:31.302 INFO:tasks.workunit.client.0.smithi155.stdout:7/414: dwrite d0/d6a/d1a/d22/d3c/f50 [0,4194304] 0 2023-12-16T05:56:31.302 INFO:tasks.workunit.client.0.smithi155.stdout:0/320: dread d7/d13/d45/f4f [0,4194304] 0 2023-12-16T05:56:31.302 INFO:tasks.workunit.client.0.smithi155.stdout:7/415: stat d0/d1/f24 0 2023-12-16T05:56:31.307 INFO:tasks.workunit.client.1.smithi156.stdout:2/86: dwrite f2 [0,4194304] 0 2023-12-16T05:56:31.312 INFO:tasks.workunit.client.1.smithi156.stdout:1/45: sync 2023-12-16T05:56:31.313 INFO:tasks.workunit.client.1.smithi156.stdout:1/46: chown d3/f5 3 1 2023-12-16T05:56:31.315 INFO:tasks.workunit.client.0.smithi155.stdout:7/416: dread d0/d6a/d1a/d22/d3c/f50 [0,4194304] 0 2023-12-16T05:56:31.315 INFO:tasks.workunit.client.0.smithi155.stdout:7/417: fsync d0/d6a/d1a/d22/d3c/f74 0 2023-12-16T05:56:31.315 INFO:tasks.workunit.client.0.smithi155.stdout:7/418: stat d0/d1/d5/f8 0 2023-12-16T05:56:31.315 INFO:tasks.workunit.client.0.smithi155.stdout:7/419: write d0/d6a/d1a/f89 [728670,80689] 0 2023-12-16T05:56:31.315 INFO:tasks.workunit.client.1.smithi156.stdout:2/87: read f5 [1248656,21705] 0 2023-12-16T05:56:31.315 INFO:tasks.workunit.client.1.smithi156.stdout:2/88: truncate d9/dd/f1b 1036453 0 2023-12-16T05:56:31.318 INFO:tasks.workunit.client.1.smithi156.stdout:7/161: getdents d1e/d1f/d22 0 2023-12-16T05:56:31.319 INFO:tasks.workunit.client.0.smithi155.stdout:0/321: mkdir d7/d47/d5d 0 2023-12-16T05:56:31.321 INFO:tasks.workunit.client.1.smithi156.stdout:6/72: truncate f8 83366 0 2023-12-16T05:56:31.322 INFO:tasks.workunit.client.1.smithi156.stdout:2/89: read d9/dd/f19 [2599167,70026] 0 2023-12-16T05:56:31.323 INFO:tasks.workunit.client.0.smithi155.stdout:3/286: dwrite d0/f2e [0,4194304] 0 2023-12-16T05:56:31.325 INFO:tasks.workunit.client.1.smithi156.stdout:5/168: dwrite da/dc/f11 [0,4194304] 0 2023-12-16T05:56:31.326 INFO:tasks.workunit.client.1.smithi156.stdout:7/162: truncate d1e/f24 4567177 0 2023-12-16T05:56:31.327 INFO:tasks.workunit.client.1.smithi156.stdout:6/73: mkdir d9/d13 0 2023-12-16T05:56:31.328 INFO:tasks.workunit.client.1.smithi156.stdout:2/90: mkdir d9/dc/d1c 0 2023-12-16T05:56:31.330 INFO:tasks.workunit.client.1.smithi156.stdout:7/163: mkdir d1e/d1f/d22/d2c/d33 0 2023-12-16T05:56:31.333 INFO:tasks.workunit.client.1.smithi156.stdout:7/164: symlink d1e/d1f/d22/d2c/d33/l34 0 2023-12-16T05:56:31.333 INFO:tasks.workunit.client.1.smithi156.stdout:7/165: truncate d1e/f32 971525 0 2023-12-16T05:56:31.333 INFO:tasks.workunit.client.0.smithi155.stdout:7/420: mknod d0/d6a/d1a/d2b/d2c/c92 0 2023-12-16T05:56:31.334 INFO:tasks.workunit.client.0.smithi155.stdout:7/421: chown d0/d1/d5/f8 10561 1 2023-12-16T05:56:31.335 INFO:tasks.workunit.client.1.smithi156.stdout:5/169: mkdir da/dc/d2d 0 2023-12-16T05:56:31.335 INFO:tasks.workunit.client.0.smithi155.stdout:0/322: getdents d7/d30 0 2023-12-16T05:56:31.336 INFO:tasks.workunit.client.0.smithi155.stdout:3/287: dread d0/f11 [0,4194304] 0 2023-12-16T05:56:31.337 INFO:tasks.workunit.client.0.smithi155.stdout:5/420: dwrite d0/d2/d2a/f2e [0,4194304] 0 2023-12-16T05:56:31.338 INFO:tasks.workunit.client.1.smithi156.stdout:1/47: dwrite f0 [0,4194304] 0 2023-12-16T05:56:31.338 INFO:tasks.workunit.client.0.smithi155.stdout:8/349: dwrite d4/da/d1b/d1c/f5c [0,4194304] 0 2023-12-16T05:56:31.339 INFO:tasks.workunit.client.1.smithi156.stdout:3/56: dwrite fb [0,4194304] 0 2023-12-16T05:56:31.339 INFO:tasks.workunit.client.1.smithi156.stdout:3/57: chown dc/d10/l12 27531 1 2023-12-16T05:56:31.340 INFO:tasks.workunit.client.0.smithi155.stdout:7/422: rename d0/d6a/d1a/d8c/d34/f5f to d0/d6a/d1a/d8c/d42/f93 0 2023-12-16T05:56:31.340 INFO:tasks.workunit.client.0.smithi155.stdout:7/423: chown d0/d6a/d1a/d2b/d2c/d5d/c7a 108639897 1 2023-12-16T05:56:31.340 INFO:tasks.workunit.client.0.smithi155.stdout:7/424: truncate d0/d1/f21 5415301 0 2023-12-16T05:56:31.340 INFO:tasks.workunit.client.1.smithi156.stdout:5/170: unlink da/dc/l22 0 2023-12-16T05:56:31.342 INFO:tasks.workunit.client.0.smithi155.stdout:3/288: link d0/d1a/f2d d0/d1a/f5a 0 2023-12-16T05:56:31.343 INFO:tasks.workunit.client.1.smithi156.stdout:3/58: dread f4 [0,4194304] 0 2023-12-16T05:56:31.344 INFO:tasks.workunit.client.0.smithi155.stdout:5/421: unlink d0/d2/d2a/fd 0 2023-12-16T05:56:31.347 INFO:tasks.workunit.client.0.smithi155.stdout:7/425: rmdir d0/d6a/d1a/d8c 39 2023-12-16T05:56:31.349 INFO:tasks.workunit.client.1.smithi156.stdout:5/171: write f4 [463274,29920] 0 2023-12-16T05:56:31.349 INFO:tasks.workunit.client.1.smithi156.stdout:6/74: dwrite f6 [0,4194304] 0 2023-12-16T05:56:31.349 INFO:tasks.workunit.client.1.smithi156.stdout:6/75: stat f6 0 2023-12-16T05:56:31.352 INFO:tasks.workunit.client.0.smithi155.stdout:6/504: rmdir d0/d3/d2c 39 2023-12-16T05:56:31.352 INFO:tasks.workunit.client.0.smithi155.stdout:5/422: creat d0/d2/d2a/d3c/f83 x:0 0 0 2023-12-16T05:56:31.352 INFO:tasks.workunit.client.0.smithi155.stdout:5/423: chown d0/d2/d2a/d19/d48/f58 16379631 1 2023-12-16T05:56:31.352 INFO:tasks.workunit.client.0.smithi155.stdout:6/505: dread - d0/df/d5e/d46/d6d/f74 zero size 2023-12-16T05:56:31.353 INFO:tasks.workunit.client.0.smithi155.stdout:7/426: symlink d0/d6a/d1a/d2b/d65/l94 0 2023-12-16T05:56:31.354 INFO:tasks.workunit.client.1.smithi156.stdout:4/56: sync 2023-12-16T05:56:31.355 INFO:tasks.workunit.client.0.smithi155.stdout:7/427: write d0/d6a/d31/f46 [297388,96616] 0 2023-12-16T05:56:31.355 INFO:tasks.workunit.client.1.smithi156.stdout:3/59: read fb [4486829,27285] 0 2023-12-16T05:56:31.356 INFO:tasks.workunit.client.0.smithi155.stdout:5/424: mknod d0/d2/d2a/d19/d48/c84 0 2023-12-16T05:56:31.356 INFO:tasks.workunit.client.0.smithi155.stdout:8/350: write d4/da/d1b/d1c/d1a/f2c [2058021,120786] 0 2023-12-16T05:56:31.359 INFO:tasks.workunit.client.0.smithi155.stdout:7/428: link d0/d6a/d1a/d8c/d34/d4b/c77 d0/d1b/d78/c95 0 2023-12-16T05:56:31.359 INFO:tasks.workunit.client.1.smithi156.stdout:5/172: readlink da/dc/l1f 0 2023-12-16T05:56:31.360 INFO:tasks.workunit.client.0.smithi155.stdout:6/506: write d0/d3/d2c/d3e/d4c/f7b [2320579,5290] 0 2023-12-16T05:56:31.361 INFO:tasks.workunit.client.0.smithi155.stdout:5/425: rename d0/f15 to d0/d2/d2a/d3c/d47/d61/f85 0 2023-12-16T05:56:31.361 INFO:tasks.workunit.client.0.smithi155.stdout:5/426: write d0/d2/d2a/d3c/d47/d61/f85 [1954142,12015] 0 2023-12-16T05:56:31.362 INFO:tasks.workunit.client.1.smithi156.stdout:6/76: link f5 d9/d13/f14 0 2023-12-16T05:56:31.362 INFO:tasks.workunit.client.1.smithi156.stdout:6/77: fdatasync f6 0 2023-12-16T05:56:31.362 INFO:tasks.workunit.client.0.smithi155.stdout:0/323: dwrite d7/d30/f39 [0,4194304] 0 2023-12-16T05:56:31.362 INFO:tasks.workunit.client.0.smithi155.stdout:0/324: fsync d7/d30/f5c 0 2023-12-16T05:56:31.363 INFO:tasks.workunit.client.0.smithi155.stdout:7/429: write d0/d1/f61 [3100413,39001] 0 2023-12-16T05:56:31.363 INFO:tasks.workunit.client.0.smithi155.stdout:8/351: link d4/da/d1b/d1c/d19/f38 d4/d62/f69 0 2023-12-16T05:56:31.367 INFO:tasks.workunit.client.0.smithi155.stdout:6/507: creat d0/d3/d2c/d3e/f9f x:0 0 0 2023-12-16T05:56:31.367 INFO:tasks.workunit.client.0.smithi155.stdout:6/508: read - d0/d3/d2c/d3e/f9f zero size 2023-12-16T05:56:31.367 INFO:tasks.workunit.client.0.smithi155.stdout:6/509: chown d0/d3/d2c/d3e/c88 4959 1 2023-12-16T05:56:31.368 INFO:tasks.workunit.client.1.smithi156.stdout:7/166: dwrite d1e/f32 [0,4194304] 0 2023-12-16T05:56:31.368 INFO:tasks.workunit.client.0.smithi155.stdout:5/427: creat d0/d2/d2a/d30/d53/d7b/f86 x:0 0 0 2023-12-16T05:56:31.372 INFO:tasks.workunit.client.1.smithi156.stdout:4/57: creat d9/f11 x:0 0 0 2023-12-16T05:56:31.372 INFO:tasks.workunit.client.1.smithi156.stdout:4/58: truncate d9/fa 83068 0 2023-12-16T05:56:31.372 INFO:tasks.workunit.client.1.smithi156.stdout:3/60: getdents dc/d10 0 2023-12-16T05:56:31.372 INFO:tasks.workunit.client.1.smithi156.stdout:6/78: link d9/d13/f14 d9/f15 0 2023-12-16T05:56:31.372 INFO:tasks.workunit.client.1.smithi156.stdout:5/173: creat da/dc/f2e x:0 0 0 2023-12-16T05:56:31.372 INFO:tasks.workunit.client.1.smithi156.stdout:1/48: dwrite f1 [0,4194304] 0 2023-12-16T05:56:31.373 INFO:tasks.workunit.client.0.smithi155.stdout:0/325: unlink d7/df/d41/c21 0 2023-12-16T05:56:31.374 INFO:tasks.workunit.client.1.smithi156.stdout:9/95: sync 2023-12-16T05:56:31.375 INFO:tasks.workunit.client.0.smithi155.stdout:8/352: symlink d4/da/d1b/d1c/d19/l6a 0 2023-12-16T05:56:31.375 INFO:tasks.workunit.client.0.smithi155.stdout:8/353: readlink d4/l5d 0 2023-12-16T05:56:31.376 INFO:tasks.workunit.client.0.smithi155.stdout:6/510: rename d0/d3/d2c/d3e/d4c/d1b/f50 to d0/d3/d2c/fa0 0 2023-12-16T05:56:31.376 INFO:tasks.workunit.client.0.smithi155.stdout:6/511: fdatasync d0/df/d5e/d46/f3f 0 2023-12-16T05:56:31.378 INFO:tasks.workunit.client.0.smithi155.stdout:5/428: mknod d0/d2/d2a/d3c/d47/d61/c87 0 2023-12-16T05:56:31.378 INFO:tasks.workunit.client.0.smithi155.stdout:5/429: fdatasync d0/d2/d2a/f42 0 2023-12-16T05:56:31.379 INFO:tasks.workunit.client.0.smithi155.stdout:6/512: mknod d0/df/d5e/d5b/ca1 0 2023-12-16T05:56:31.379 INFO:tasks.workunit.client.1.smithi156.stdout:4/59: write f0 [1001937,27075] 0 2023-12-16T05:56:31.380 INFO:tasks.workunit.client.1.smithi156.stdout:6/79: read f8 [3798,6242] 0 2023-12-16T05:56:31.380 INFO:tasks.workunit.client.1.smithi156.stdout:8/83: sync 2023-12-16T05:56:31.380 INFO:tasks.workunit.client.0.smithi155.stdout:6/513: chown d0/ce 352328 1 2023-12-16T05:56:31.383 INFO:tasks.workunit.client.0.smithi155.stdout:6/514: rmdir d0/df/d5e/d7e 39 2023-12-16T05:56:31.385 INFO:tasks.workunit.client.1.smithi156.stdout:1/49: rename d3/l7 to d3/lf 0 2023-12-16T05:56:31.385 INFO:tasks.workunit.client.1.smithi156.stdout:8/84: getdents d3/d7/d9 0 2023-12-16T05:56:31.385 INFO:tasks.workunit.client.1.smithi156.stdout:6/80: chown c7 187534 1 2023-12-16T05:56:31.386 INFO:tasks.workunit.client.1.smithi156.stdout:5/174: dread da/f28 [0,4194304] 0 2023-12-16T05:56:31.387 INFO:tasks.workunit.client.1.smithi156.stdout:6/81: write d9/d13/f14 [3849365,57550] 0 2023-12-16T05:56:31.390 INFO:tasks.workunit.client.1.smithi156.stdout:1/50: symlink d3/l10 0 2023-12-16T05:56:31.392 INFO:tasks.workunit.client.1.smithi156.stdout:5/175: mknod da/c2f 0 2023-12-16T05:56:31.392 INFO:tasks.workunit.client.0.smithi155.stdout:6/515: dread d0/d3/f12 [0,4194304] 0 2023-12-16T05:56:31.392 INFO:tasks.workunit.client.0.smithi155.stdout:0/326: dread d7/d2d/f3c [0,4194304] 0 2023-12-16T05:56:31.394 INFO:tasks.workunit.client.0.smithi155.stdout:0/327: mknod d7/d2d/c5e 0 2023-12-16T05:56:31.395 INFO:tasks.workunit.client.1.smithi156.stdout:6/82: dread f8 [0,4194304] 0 2023-12-16T05:56:31.396 INFO:tasks.workunit.client.0.smithi155.stdout:6/516: creat d0/d3/d2c/d3e/d4c/fa2 x:0 0 0 2023-12-16T05:56:31.397 INFO:tasks.workunit.client.0.smithi155.stdout:0/328: link d7/d13/d45/f49 d7/d13/d45/d4b/f5f 0 2023-12-16T05:56:31.398 INFO:tasks.workunit.client.0.smithi155.stdout:6/517: creat d0/d3/d7a/d77/fa3 x:0 0 0 2023-12-16T05:56:31.400 INFO:tasks.workunit.client.1.smithi156.stdout:6/83: mknod d9/d13/c16 0 2023-12-16T05:56:31.400 INFO:tasks.workunit.client.1.smithi156.stdout:6/84: chown d9/cc 11832 1 2023-12-16T05:56:31.400 INFO:tasks.workunit.client.1.smithi156.stdout:6/85: truncate f8 1101761 0 2023-12-16T05:56:31.400 INFO:tasks.workunit.client.1.smithi156.stdout:6/86: write d9/ff [720825,33848] 0 2023-12-16T05:56:31.400 INFO:tasks.workunit.client.1.smithi156.stdout:2/91: dwrite f8 [0,4194304] 0 2023-12-16T05:56:31.400 INFO:tasks.workunit.client.1.smithi156.stdout:5/176: symlink da/dc/l30 0 2023-12-16T05:56:31.401 INFO:tasks.workunit.client.0.smithi155.stdout:0/329: creat d7/d13/d45/d4b/f60 x:0 0 0 2023-12-16T05:56:31.401 INFO:tasks.workunit.client.0.smithi155.stdout:0/330: dread - d7/d13/d45/d4b/f60 zero size 2023-12-16T05:56:31.401 INFO:tasks.workunit.client.0.smithi155.stdout:3/289: dwrite d0/f55 [0,4194304] 0 2023-12-16T05:56:31.401 INFO:tasks.workunit.client.1.smithi156.stdout:6/87: write f5 [3171788,109393] 0 2023-12-16T05:56:31.402 INFO:tasks.workunit.client.1.smithi156.stdout:0/130: sync 2023-12-16T05:56:31.403 INFO:tasks.workunit.client.0.smithi155.stdout:0/331: mknod d7/d47/d5d/c61 0 2023-12-16T05:56:31.407 INFO:tasks.workunit.client.1.smithi156.stdout:2/92: write d9/dd/f19 [1970791,96656] 0 2023-12-16T05:56:31.409 INFO:tasks.workunit.client.1.smithi156.stdout:9/96: dwrite d6/f10 [0,4194304] 0 2023-12-16T05:56:31.409 INFO:tasks.workunit.client.1.smithi156.stdout:9/97: truncate d6/fd 560517 0 2023-12-16T05:56:31.411 INFO:tasks.workunit.client.0.smithi155.stdout:3/290: stat d0/d1a/l53 0 2023-12-16T05:56:31.413 INFO:tasks.workunit.client.1.smithi156.stdout:6/88: creat d9/d13/f17 x:0 0 0 2023-12-16T05:56:31.414 INFO:tasks.workunit.client.0.smithi155.stdout:3/291: rename d0/d14/d51/c42 to d0/d14/c5b 0 2023-12-16T05:56:31.415 INFO:tasks.workunit.client.1.smithi156.stdout:2/93: rename d9/d12/f1a to d9/dd/d17/f1d 0 2023-12-16T05:56:31.416 INFO:tasks.workunit.client.1.smithi156.stdout:4/60: dwrite f2 [0,4194304] 0 2023-12-16T05:56:31.418 INFO:tasks.workunit.client.1.smithi156.stdout:9/98: creat d6/d19/f29 x:0 0 0 2023-12-16T05:56:31.418 INFO:tasks.workunit.client.1.smithi156.stdout:6/89: creat d9/d13/f18 x:0 0 0 2023-12-16T05:56:31.418 INFO:tasks.workunit.client.1.smithi156.stdout:6/90: stat f5 0 2023-12-16T05:56:31.418 INFO:tasks.workunit.client.1.smithi156.stdout:6/91: chown d9/le 22892 1 2023-12-16T05:56:31.419 INFO:tasks.workunit.client.0.smithi155.stdout:3/292: mknod d0/d1a/d33/d57/c5c 0 2023-12-16T05:56:31.420 INFO:tasks.workunit.client.1.smithi156.stdout:4/61: creat d9/f12 x:0 0 0 2023-12-16T05:56:31.421 INFO:tasks.workunit.client.0.smithi155.stdout:8/354: dwrite d4/f42 [0,4194304] 0 2023-12-16T05:56:31.421 INFO:tasks.workunit.client.0.smithi155.stdout:8/355: chown d4/da/d1b/l2f 1703 1 2023-12-16T05:56:31.421 INFO:tasks.workunit.client.1.smithi156.stdout:2/94: dread d9/fa [0,4194304] 0 2023-12-16T05:56:31.422 INFO:tasks.workunit.client.0.smithi155.stdout:3/293: dread d0/f31 [0,4194304] 0 2023-12-16T05:56:31.422 INFO:tasks.workunit.client.0.smithi155.stdout:8/356: creat d4/da/d12/f6b x:0 0 0 2023-12-16T05:56:31.423 INFO:tasks.workunit.client.1.smithi156.stdout:2/95: dread d9/dc/fe [0,4194304] 0 2023-12-16T05:56:31.424 INFO:tasks.workunit.client.1.smithi156.stdout:4/62: rename d9/ce to d9/c13 0 2023-12-16T05:56:31.425 INFO:tasks.workunit.client.0.smithi155.stdout:3/294: rename d0/d14/c4f to d0/d1a/d33/d57/c5d 0 2023-12-16T05:56:31.425 INFO:tasks.workunit.client.0.smithi155.stdout:3/295: chown d0/d1e/f49 391238570 1 2023-12-16T05:56:31.426 INFO:tasks.workunit.client.1.smithi156.stdout:9/99: unlink d6/la 0 2023-12-16T05:56:31.426 INFO:tasks.workunit.client.1.smithi156.stdout:9/100: write d6/f13 [4781663,40662] 0 2023-12-16T05:56:31.426 INFO:tasks.workunit.client.1.smithi156.stdout:2/96: mknod d9/c1e 0 2023-12-16T05:56:31.427 INFO:tasks.workunit.client.0.smithi155.stdout:3/296: truncate d0/fb 3485359 0 2023-12-16T05:56:31.427 INFO:tasks.workunit.client.0.smithi155.stdout:3/297: chown d0/f10 1640 1 2023-12-16T05:56:31.428 INFO:tasks.workunit.client.0.smithi155.stdout:6/518: dwrite d0/df/d5e/f61 [0,4194304] 0 2023-12-16T05:56:31.428 INFO:tasks.workunit.client.0.smithi155.stdout:6/519: chown d0/df/d5e/d46/f81 2930035 1 2023-12-16T05:56:31.429 INFO:tasks.workunit.client.1.smithi156.stdout:5/177: rmdir da/dc 39 2023-12-16T05:56:31.430 INFO:tasks.workunit.client.0.smithi155.stdout:8/357: rename d4/da/fb to d4/da/d1b/d1c/d19/d64/f6c 0 2023-12-16T05:56:31.430 INFO:tasks.workunit.client.1.smithi156.stdout:0/131: dwrite d2/d7/f10 [0,4194304] 0 2023-12-16T05:56:31.430 INFO:tasks.workunit.client.1.smithi156.stdout:0/132: dread - d2/d7/f18 zero size 2023-12-16T05:56:31.431 INFO:tasks.workunit.client.1.smithi156.stdout:5/178: chown da/dc/f21 13 1 2023-12-16T05:56:31.431 INFO:tasks.workunit.client.1.smithi156.stdout:2/97: write f8 [4137455,58026] 0 2023-12-16T05:56:31.431 INFO:tasks.workunit.client.1.smithi156.stdout:2/98: fsync d9/dc/fe 0 2023-12-16T05:56:31.432 INFO:tasks.workunit.client.1.smithi156.stdout:0/133: link d2/c12 d2/d7/dd/c20 0 2023-12-16T05:56:31.432 INFO:tasks.workunit.client.1.smithi156.stdout:0/134: readlink d2/d7/l11 0 2023-12-16T05:56:31.432 INFO:tasks.workunit.client.1.smithi156.stdout:2/99: write f1 [1624416,72872] 0 2023-12-16T05:56:31.433 INFO:tasks.workunit.client.1.smithi156.stdout:5/179: creat da/dc/f31 x:0 0 0 2023-12-16T05:56:31.434 INFO:tasks.workunit.client.1.smithi156.stdout:0/135: mknod d2/d7/dd/d1c/c21 0 2023-12-16T05:56:31.435 INFO:tasks.workunit.client.0.smithi155.stdout:6/520: mkdir d0/d3/d2c/d8b/d85/da4 0 2023-12-16T05:56:31.435 INFO:tasks.workunit.client.0.smithi155.stdout:6/521: stat d0/df/d5e/d5b 0 2023-12-16T05:56:31.435 INFO:tasks.workunit.client.1.smithi156.stdout:2/100: creat d9/f1f x:0 0 0 2023-12-16T05:56:31.436 INFO:tasks.workunit.client.1.smithi156.stdout:8/85: dwrite d3/f8 [0,4194304] 0 2023-12-16T05:56:31.436 INFO:tasks.workunit.client.1.smithi156.stdout:8/86: truncate d3/ff 549605 0 2023-12-16T05:56:31.436 INFO:tasks.workunit.client.1.smithi156.stdout:5/180: symlink da/l32 0 2023-12-16T05:56:31.437 INFO:tasks.workunit.client.1.smithi156.stdout:1/51: dwrite d3/fc [0,4194304] 0 2023-12-16T05:56:31.438 INFO:tasks.workunit.client.1.smithi156.stdout:0/136: rename d2/fe to d2/f22 0 2023-12-16T05:56:31.439 INFO:tasks.workunit.client.0.smithi155.stdout:3/298: rename d0/fe to d0/d14/f5e 0 2023-12-16T05:56:31.439 INFO:tasks.workunit.client.0.smithi155.stdout:3/299: truncate d0/d14/d51/f4a 752818 0 2023-12-16T05:56:31.439 INFO:tasks.workunit.client.0.smithi155.stdout:5/430: truncate d0/d2/d2a/d3c/d47/d61/f85 1401344 0 2023-12-16T05:56:31.440 INFO:tasks.workunit.client.0.smithi155.stdout:8/358: mknod d4/da/d1b/c6d 0 2023-12-16T05:56:31.440 INFO:tasks.workunit.client.1.smithi156.stdout:2/101: creat d9/f20 x:0 0 0 2023-12-16T05:56:31.440 INFO:tasks.workunit.client.1.smithi156.stdout:9/101: read d6/ff [6129,34352] 0 2023-12-16T05:56:31.442 INFO:tasks.workunit.client.1.smithi156.stdout:9/102: write d6/fd [74373,86141] 0 2023-12-16T05:56:31.445 INFO:tasks.workunit.client.1.smithi156.stdout:8/87: creat d3/d7/d9/f1a x:0 0 0 2023-12-16T05:56:31.445 INFO:tasks.workunit.client.0.smithi155.stdout:3/300: write d0/d14/d36/f3e [2790140,43756] 0 2023-12-16T05:56:31.446 INFO:tasks.workunit.client.0.smithi155.stdout:5/431: mkdir d0/d2/d2a/d19/d88 0 2023-12-16T05:56:31.448 INFO:tasks.workunit.client.1.smithi156.stdout:6/92: rmdir d9 39 2023-12-16T05:56:31.449 INFO:tasks.workunit.client.1.smithi156.stdout:6/93: write d9/ff [1117686,3529] 0 2023-12-16T05:56:31.449 INFO:tasks.workunit.client.1.smithi156.stdout:6/94: write d9/f12 [937036,16418] 0 2023-12-16T05:56:31.449 INFO:tasks.workunit.client.1.smithi156.stdout:8/88: write d3/f8 [3027810,90983] 0 2023-12-16T05:56:31.449 INFO:tasks.workunit.client.0.smithi155.stdout:8/359: creat d4/da/d1b/d2a/d51/f6e x:0 0 0 2023-12-16T05:56:31.449 INFO:tasks.workunit.client.0.smithi155.stdout:8/360: chown d4/l5d 369259 1 2023-12-16T05:56:31.451 INFO:tasks.workunit.client.1.smithi156.stdout:0/137: mkdir d2/d23 0 2023-12-16T05:56:31.451 INFO:tasks.workunit.client.0.smithi155.stdout:0/332: dwrite d7/df/f58 [0,4194304] 0 2023-12-16T05:56:31.451 INFO:tasks.workunit.client.1.smithi156.stdout:2/102: creat d9/dd/f21 x:0 0 0 2023-12-16T05:56:31.452 INFO:tasks.workunit.client.0.smithi155.stdout:3/301: mkdir d0/d14/d36/d47/d5f 0 2023-12-16T05:56:31.452 INFO:tasks.workunit.client.0.smithi155.stdout:3/302: chown d0/d1a/d33 4 1 2023-12-16T05:56:31.454 INFO:tasks.workunit.client.0.smithi155.stdout:8/361: symlink d4/d62/d66/l6f 0 2023-12-16T05:56:31.454 INFO:tasks.workunit.client.0.smithi155.stdout:8/362: fsync d4/f42 0 2023-12-16T05:56:31.457 INFO:tasks.workunit.client.1.smithi156.stdout:0/138: creat d2/f24 x:0 0 0 2023-12-16T05:56:31.458 INFO:tasks.workunit.client.1.smithi156.stdout:2/103: creat d9/f22 x:0 0 0 2023-12-16T05:56:31.459 INFO:tasks.workunit.client.1.smithi156.stdout:5/181: dread da/f1e [0,4194304] 0 2023-12-16T05:56:31.459 INFO:tasks.workunit.client.1.smithi156.stdout:6/95: dread f6 [0,4194304] 0 2023-12-16T05:56:31.459 INFO:tasks.workunit.client.0.smithi155.stdout:3/303: getdents d0/d1e/d4e 0 2023-12-16T05:56:31.460 INFO:tasks.workunit.client.1.smithi156.stdout:9/103: rename d6/f10 to d6/d19/f2a 0 2023-12-16T05:56:31.461 INFO:tasks.workunit.client.1.smithi156.stdout:0/139: creat d2/d7/dd/d1c/f25 x:0 0 0 2023-12-16T05:56:31.462 INFO:tasks.workunit.client.1.smithi156.stdout:2/104: rename d9/d12/f14 to d9/d12/f23 0 2023-12-16T05:56:31.463 INFO:tasks.workunit.client.0.smithi155.stdout:8/363: rename d4/da/d1b/d1c/d1a/d1f to d4/d62/d70 0 2023-12-16T05:56:31.463 INFO:tasks.workunit.client.0.smithi155.stdout:8/364: fsync d4/d62/d70/f59 0 2023-12-16T05:56:31.464 INFO:tasks.workunit.client.1.smithi156.stdout:5/182: creat da/dc/d2d/f33 x:0 0 0 2023-12-16T05:56:31.465 INFO:tasks.workunit.client.1.smithi156.stdout:6/96: mknod d9/d13/c19 0 2023-12-16T05:56:31.466 INFO:tasks.workunit.client.0.smithi155.stdout:8/365: link d4/da/d1b/d1c/d1a/c35 d4/da/d1b/d1c/d46/c71 0 2023-12-16T05:56:31.467 INFO:tasks.workunit.client.0.smithi155.stdout:8/366: stat d4/da/f4c 0 2023-12-16T05:56:31.467 INFO:tasks.workunit.client.0.smithi155.stdout:8/367: dread - d4/da/d1b/d2a/d51/f65 zero size 2023-12-16T05:56:31.468 INFO:tasks.workunit.client.1.smithi156.stdout:9/104: symlink d6/d19/d25/l2b 0 2023-12-16T05:56:31.469 INFO:tasks.workunit.client.1.smithi156.stdout:4/63: dwrite f6 [0,4194304] 0 2023-12-16T05:56:31.469 INFO:tasks.workunit.client.1.smithi156.stdout:4/64: chown f5 207 1 2023-12-16T05:56:31.469 INFO:tasks.workunit.client.1.smithi156.stdout:4/65: chown f4 0 1 2023-12-16T05:56:31.470 INFO:tasks.workunit.client.0.smithi155.stdout:6/522: dwrite d0/df/d5e/d7e/f89 [0,4194304] 0 2023-12-16T05:56:31.471 INFO:tasks.workunit.client.0.smithi155.stdout:8/368: unlink d4/da/d1b/d1c/d19/c3b 0 2023-12-16T05:56:31.472 INFO:tasks.workunit.client.1.smithi156.stdout:8/89: dwrite d3/f17 [0,4194304] 0 2023-12-16T05:56:31.473 INFO:tasks.workunit.client.1.smithi156.stdout:1/52: dwrite d3/fb [0,4194304] 0 2023-12-16T05:56:31.473 INFO:tasks.workunit.client.1.smithi156.stdout:1/53: dread - d3/f6 zero size 2023-12-16T05:56:31.474 INFO:tasks.workunit.client.0.smithi155.stdout:5/432: dread d0/d2/f6e [0,4194304] 0 2023-12-16T05:56:31.477 INFO:tasks.workunit.client.0.smithi155.stdout:0/333: dwrite d7/f29 [0,4194304] 0 2023-12-16T05:56:31.477 INFO:tasks.workunit.client.0.smithi155.stdout:5/433: symlink d0/d60/l89 0 2023-12-16T05:56:31.480 INFO:tasks.workunit.client.0.smithi155.stdout:2/331: sync 2023-12-16T05:56:31.480 INFO:tasks.workunit.client.0.smithi155.stdout:4/378: sync 2023-12-16T05:56:31.480 INFO:tasks.workunit.client.0.smithi155.stdout:2/332: chown d0/d7/c6c 307487 1 2023-12-16T05:56:31.481 INFO:tasks.workunit.client.0.smithi155.stdout:2/333: chown d0/d34/d3c/c71 3748 1 2023-12-16T05:56:31.481 INFO:tasks.workunit.client.0.smithi155.stdout:2/334: fsync d0/d7/dd/d14/f2d 0 2023-12-16T05:56:31.481 INFO:tasks.workunit.client.0.smithi155.stdout:5/434: mknod d0/d60/d79/c8a 0 2023-12-16T05:56:31.487 INFO:tasks.workunit.client.0.smithi155.stdout:3/304: dread d0/d1a/f1d [0,4194304] 0 2023-12-16T05:56:31.488 INFO:tasks.workunit.client.0.smithi155.stdout:9/476: sync 2023-12-16T05:56:31.488 INFO:tasks.workunit.client.0.smithi155.stdout:6/523: dread d0/d3/d2c/d3e/d4c/f5c [0,4194304] 0 2023-12-16T05:56:31.491 INFO:tasks.workunit.client.0.smithi155.stdout:8/369: dread d4/da/f25 [0,4194304] 0 2023-12-16T05:56:31.492 INFO:tasks.workunit.client.0.smithi155.stdout:8/370: dread - d4/da/d1b/d1c/d1a/f3a zero size 2023-12-16T05:56:31.492 INFO:tasks.workunit.client.0.smithi155.stdout:8/371: fdatasync d4/da/d1b/d1c/f45 0 2023-12-16T05:56:31.492 INFO:tasks.workunit.client.0.smithi155.stdout:9/477: symlink da/d15/d17/d36/d5b/d98/la9 0 2023-12-16T05:56:31.492 INFO:tasks.workunit.client.0.smithi155.stdout:8/372: read d4/d62/f69 [594912,48000] 0 2023-12-16T05:56:31.494 INFO:tasks.workunit.client.0.smithi155.stdout:6/524: creat d0/d3/d7a/d77/fa5 x:0 0 0 2023-12-16T05:56:31.494 INFO:tasks.workunit.client.0.smithi155.stdout:6/525: dread - d0/d3/d7a/f82 zero size 2023-12-16T05:56:31.495 INFO:tasks.workunit.client.0.smithi155.stdout:9/478: link da/d15/d17/c27 da/d15/d17/d36/d5b/d60/d9e/caa 0 2023-12-16T05:56:31.497 INFO:tasks.workunit.client.0.smithi155.stdout:8/373: creat d4/da/d1b/d2a/d5e/f72 x:0 0 0 2023-12-16T05:56:31.500 INFO:tasks.workunit.client.0.smithi155.stdout:5/435: write d0/d2/d2a/f63 [2392961,25950] 0 2023-12-16T05:56:31.500 INFO:tasks.workunit.client.0.smithi155.stdout:6/526: symlink d0/df/d5e/d5b/la6 0 2023-12-16T05:56:31.500 INFO:tasks.workunit.client.0.smithi155.stdout:9/479: mknod da/d15/cab 0 2023-12-16T05:56:31.503 INFO:tasks.workunit.client.0.smithi155.stdout:5/436: symlink d0/d2/d2a/d30/d53/l8b 0 2023-12-16T05:56:31.504 INFO:tasks.workunit.client.0.smithi155.stdout:9/480: dread da/d15/d17/d24/d26/d2e/d32/f35 [0,4194304] 0 2023-12-16T05:56:31.505 INFO:tasks.workunit.client.0.smithi155.stdout:6/527: rename d0/df/c54 to d0/df/d43/ca7 0 2023-12-16T05:56:31.505 INFO:tasks.workunit.client.0.smithi155.stdout:6/528: write d0/d3/d2c/d8b/d85/f8d [1013197,27352] 0 2023-12-16T05:56:31.506 INFO:tasks.workunit.client.0.smithi155.stdout:5/437: creat d0/d2/d2a/d30/d53/f8c x:0 0 0 2023-12-16T05:56:31.509 INFO:tasks.workunit.client.0.smithi155.stdout:5/438: mknod d0/d2/d2a/c8d 0 2023-12-16T05:56:31.509 INFO:tasks.workunit.client.0.smithi155.stdout:5/439: stat d0/d2/d2a/d30/c67 0 2023-12-16T05:56:31.509 INFO:tasks.workunit.client.1.smithi156.stdout:0/140: unlink d2/d7/c1a 0 2023-12-16T05:56:31.511 INFO:tasks.workunit.client.0.smithi155.stdout:5/440: mkdir d0/d60/d79/d8e 0 2023-12-16T05:56:31.511 INFO:tasks.workunit.client.1.smithi156.stdout:2/105: unlink d9/dd/f15 0 2023-12-16T05:56:31.518 INFO:tasks.workunit.client.1.smithi156.stdout:6/97: creat d9/d13/f1a x:0 0 0 2023-12-16T05:56:31.520 INFO:tasks.workunit.client.0.smithi155.stdout:1/461: sync 2023-12-16T05:56:31.521 INFO:tasks.workunit.client.0.smithi155.stdout:1/462: creat d1/d17/d28/d8f/f96 x:0 0 0 2023-12-16T05:56:31.523 INFO:tasks.workunit.client.0.smithi155.stdout:0/334: dwrite d7/df/d41/d23/d36/f54 [0,4194304] 0 2023-12-16T05:56:31.523 INFO:tasks.workunit.client.0.smithi155.stdout:0/335: fdatasync d7/f2a 0 2023-12-16T05:56:31.528 INFO:tasks.workunit.client.1.smithi156.stdout:4/66: symlink d9/l14 0 2023-12-16T05:56:31.529 INFO:tasks.workunit.client.0.smithi155.stdout:3/305: dwrite d0/d1a/d33/f46 [0,4194304] 0 2023-12-16T05:56:31.529 INFO:tasks.workunit.client.0.smithi155.stdout:7/430: sync 2023-12-16T05:56:31.533 INFO:tasks.workunit.client.0.smithi155.stdout:0/336: rename d7/d30/f5c to d7/d47/f62 0 2023-12-16T05:56:31.535 INFO:tasks.workunit.client.0.smithi155.stdout:8/374: dwrite d4/d62/d70/d4f/f63 [0,4194304] 0 2023-12-16T05:56:31.535 INFO:tasks.workunit.client.0.smithi155.stdout:8/375: write d4/f42 [4286789,77332] 0 2023-12-16T05:56:31.535 INFO:tasks.workunit.client.0.smithi155.stdout:8/376: dread - d4/da/d12/f6b zero size 2023-12-16T05:56:31.535 INFO:tasks.workunit.client.0.smithi155.stdout:2/335: dwrite d0/f32 [4194304,4194304] 0 2023-12-16T05:56:31.536 INFO:tasks.workunit.client.0.smithi155.stdout:2/336: fdatasync d0/d7/dd/f6e 0 2023-12-16T05:56:31.536 INFO:tasks.workunit.client.1.smithi156.stdout:8/90: dwrite d3/d18/f19 [0,4194304] 0 2023-12-16T05:56:31.536 INFO:tasks.workunit.client.1.smithi156.stdout:1/54: mknod d3/c11 0 2023-12-16T05:56:31.537 INFO:tasks.workunit.client.1.smithi156.stdout:0/141: rename d2/c12 to d2/d7/c26 0 2023-12-16T05:56:31.538 INFO:tasks.workunit.client.0.smithi155.stdout:7/431: creat d0/d1b/d78/f96 x:0 0 0 2023-12-16T05:56:31.538 INFO:tasks.workunit.client.0.smithi155.stdout:7/432: truncate d0/d6a/d31/f46 550444 0 2023-12-16T05:56:31.539 INFO:tasks.workunit.client.0.smithi155.stdout:7/433: truncate d0/d6a/d31/f46 1140646 0 2023-12-16T05:56:31.539 INFO:tasks.workunit.client.0.smithi155.stdout:6/529: dwrite d0/d3/d2c/d3e/f64 [0,4194304] 0 2023-12-16T05:56:31.541 INFO:tasks.workunit.client.1.smithi156.stdout:8/91: creat d3/d18/f1b x:0 0 0 2023-12-16T05:56:31.541 INFO:tasks.workunit.client.0.smithi155.stdout:0/337: dread d7/d2d/f3c [0,4194304] 0 2023-12-16T05:56:31.542 INFO:tasks.workunit.client.1.smithi156.stdout:1/55: mknod d3/c12 0 2023-12-16T05:56:31.542 INFO:tasks.workunit.client.0.smithi155.stdout:3/306: dread d0/f12 [4194304,4194304] 0 2023-12-16T05:56:31.544 INFO:tasks.workunit.client.1.smithi156.stdout:2/106: dread f1 [0,4194304] 0 2023-12-16T05:56:31.545 INFO:tasks.workunit.client.0.smithi155.stdout:2/337: creat d0/d34/f72 x:0 0 0 2023-12-16T05:56:31.546 INFO:tasks.workunit.client.0.smithi155.stdout:7/434: mkdir d0/d6a/d1a/d2b/d2c/d97 0 2023-12-16T05:56:31.546 INFO:tasks.workunit.client.0.smithi155.stdout:8/377: rename d4/da/d1b/d2a/d51/f65 to d4/da/d1b/d1c/d19/f73 0 2023-12-16T05:56:31.547 INFO:tasks.workunit.client.1.smithi156.stdout:0/142: creat d2/d23/f27 x:0 0 0 2023-12-16T05:56:31.547 INFO:tasks.workunit.client.1.smithi156.stdout:2/107: dread d9/dc/fe [0,4194304] 0 2023-12-16T05:56:31.547 INFO:tasks.workunit.client.1.smithi156.stdout:2/108: truncate d9/dc/f10 420325 0 2023-12-16T05:56:31.547 INFO:tasks.workunit.client.1.smithi156.stdout:0/143: write d2/f24 [655869,129059] 0 2023-12-16T05:56:31.548 INFO:tasks.workunit.client.1.smithi156.stdout:8/92: rename d3/d7/l14 to d3/d6/l1c 0 2023-12-16T05:56:31.549 INFO:tasks.workunit.client.1.smithi156.stdout:8/93: write f2 [2607448,89700] 0 2023-12-16T05:56:31.550 INFO:tasks.workunit.client.1.smithi156.stdout:2/109: mkdir d9/d12/d24 0 2023-12-16T05:56:31.550 INFO:tasks.workunit.client.1.smithi156.stdout:2/110: write f8 [4831679,68288] 0 2023-12-16T05:56:31.550 INFO:tasks.workunit.client.0.smithi155.stdout:0/338: creat d7/df/d41/d23/d44/f63 x:0 0 0 2023-12-16T05:56:31.551 INFO:tasks.workunit.client.0.smithi155.stdout:2/338: creat d0/d7/f73 x:0 0 0 2023-12-16T05:56:31.551 INFO:tasks.workunit.client.0.smithi155.stdout:8/378: mknod d4/da/d1b/d5f/c74 0 2023-12-16T05:56:31.553 INFO:tasks.workunit.client.0.smithi155.stdout:6/530: write d0/d3/d2c/d3e/d4c/d1b/f4b [3347159,53605] 0 2023-12-16T05:56:31.553 INFO:tasks.workunit.client.0.smithi155.stdout:0/339: read d7/fb [4107775,87417] 0 2023-12-16T05:56:31.554 INFO:tasks.workunit.client.0.smithi155.stdout:6/531: mkdir d0/df/d5e/d7e/da8 0 2023-12-16T05:56:31.554 INFO:tasks.workunit.client.0.smithi155.stdout:6/532: read - d0/d3/d2c/d3e/d4c/fa2 zero size 2023-12-16T05:56:31.554 INFO:tasks.workunit.client.1.smithi156.stdout:8/94: rename d3/fe to d3/d12/d16/f1d 0 2023-12-16T05:56:31.555 INFO:tasks.workunit.client.0.smithi155.stdout:0/340: mknod d7/d47/c64 0 2023-12-16T05:56:31.557 INFO:tasks.workunit.client.0.smithi155.stdout:6/533: unlink d0/df/d5e/d46/f8f 0 2023-12-16T05:56:31.558 INFO:tasks.workunit.client.1.smithi156.stdout:0/144: getdents d2/d7/dd/d1c 0 2023-12-16T05:56:31.558 INFO:tasks.workunit.client.1.smithi156.stdout:0/145: write d2/d7/f15 [5295924,24889] 0 2023-12-16T05:56:31.559 INFO:tasks.workunit.client.0.smithi155.stdout:2/339: write d0/f22 [1660967,86901] 0 2023-12-16T05:56:31.559 INFO:tasks.workunit.client.0.smithi155.stdout:2/340: write d0/d7/f5e [512279,45] 0 2023-12-16T05:56:31.559 INFO:tasks.workunit.client.1.smithi156.stdout:8/95: mknod d3/d6/c1e 0 2023-12-16T05:56:31.560 INFO:tasks.workunit.client.1.smithi156.stdout:0/146: creat d2/f28 x:0 0 0 2023-12-16T05:56:31.561 INFO:tasks.workunit.client.0.smithi155.stdout:5/441: dwrite d0/d2/d2a/f7f [0,4194304] 0 2023-12-16T05:56:31.561 INFO:tasks.workunit.client.0.smithi155.stdout:6/534: mknod d0/d3/d2c/d3e/d4c/ca9 0 2023-12-16T05:56:31.563 INFO:tasks.workunit.client.0.smithi155.stdout:1/463: dwrite d1/d7/d16/f1d [0,4194304] 0 2023-12-16T05:56:31.564 INFO:tasks.workunit.client.1.smithi156.stdout:6/98: dwrite d9/d13/f18 [0,4194304] 0 2023-12-16T05:56:31.565 INFO:tasks.workunit.client.0.smithi155.stdout:2/341: rename d0/d7/d1f/d3b to d0/d7/d1f/d74 0 2023-12-16T05:56:31.567 INFO:tasks.workunit.client.0.smithi155.stdout:8/379: dread d4/da/d1b/f20 [0,4194304] 0 2023-12-16T05:56:31.567 INFO:tasks.workunit.client.0.smithi155.stdout:8/380: chown d4/d62/d70/d4f/f60 3 1 2023-12-16T05:56:31.567 INFO:tasks.workunit.client.1.smithi156.stdout:5/183: dwrite da/dc/ff [0,4194304] 0 2023-12-16T05:56:31.568 INFO:tasks.workunit.client.1.smithi156.stdout:6/99: rename d9/f12 to d9/d13/f1b 0 2023-12-16T05:56:31.569 INFO:tasks.workunit.client.0.smithi155.stdout:2/342: unlink d0/d7/dd/d14/l4f 0 2023-12-16T05:56:31.569 INFO:tasks.workunit.client.0.smithi155.stdout:2/343: chown d0/d7/d1f/d74/d3a 6719 1 2023-12-16T05:56:31.570 INFO:tasks.workunit.client.1.smithi156.stdout:9/105: dwrite d6/d19/f1a [0,4194304] 0 2023-12-16T05:56:31.572 INFO:tasks.workunit.client.0.smithi155.stdout:3/307: dwrite d0/fb [0,4194304] 0 2023-12-16T05:56:31.572 INFO:tasks.workunit.client.0.smithi155.stdout:8/381: write d4/da/d1b/d1c/f45 [2041013,55775] 0 2023-12-16T05:56:31.573 INFO:tasks.workunit.client.1.smithi156.stdout:6/100: mkdir d9/d1c 0 2023-12-16T05:56:31.573 INFO:tasks.workunit.client.1.smithi156.stdout:6/101: truncate d9/d13/f17 209157 0 2023-12-16T05:56:31.574 INFO:tasks.workunit.client.0.smithi155.stdout:3/308: write d0/f10 [282983,75265] 0 2023-12-16T05:56:31.575 INFO:tasks.workunit.client.1.smithi156.stdout:8/96: dwrite d3/d7/d9/f1a [0,4194304] 0 2023-12-16T05:56:31.576 INFO:tasks.workunit.client.1.smithi156.stdout:6/102: write d9/d13/f18 [2639930,80387] 0 2023-12-16T05:56:31.576 INFO:tasks.workunit.client.1.smithi156.stdout:6/103: stat d9/f11 0 2023-12-16T05:56:31.577 INFO:tasks.workunit.client.1.smithi156.stdout:8/97: write d3/f17 [1384443,76922] 0 2023-12-16T05:56:31.579 INFO:tasks.workunit.client.0.smithi155.stdout:1/464: dread d1/d7/d16/d30/f73 [0,4194304] 0 2023-12-16T05:56:31.583 INFO:tasks.workunit.client.1.smithi156.stdout:4/67: getdents d9 0 2023-12-16T05:56:31.583 INFO:tasks.workunit.client.1.smithi156.stdout:4/68: write d9/ff [182187,6170] 0 2023-12-16T05:56:31.584 INFO:tasks.workunit.client.0.smithi155.stdout:1/465: creat d1/d7/d4b/d72/d79/f97 x:0 0 0 2023-12-16T05:56:31.587 INFO:tasks.workunit.client.0.smithi155.stdout:3/309: creat d0/d14/d36/d47/d5f/f60 x:0 0 0 2023-12-16T05:56:31.587 INFO:tasks.workunit.client.0.smithi155.stdout:0/341: rename d7/d30 to d7/df/d65 0 2023-12-16T05:56:31.590 INFO:tasks.workunit.client.1.smithi156.stdout:9/106: symlink d6/d19/l2c 0 2023-12-16T05:56:31.591 INFO:tasks.workunit.client.1.smithi156.stdout:0/147: rmdir d2/d7 39 2023-12-16T05:56:31.592 INFO:tasks.workunit.client.1.smithi156.stdout:0/148: getdents d2/d7/dd/d1c 0 2023-12-16T05:56:31.594 INFO:tasks.workunit.client.0.smithi155.stdout:3/310: read d0/d1a/f2d [1506741,88237] 0 2023-12-16T05:56:31.598 INFO:tasks.workunit.client.0.smithi155.stdout:5/442: dwrite d0/d2/d2a/f7f [0,4194304] 0 2023-12-16T05:56:31.602 INFO:tasks.workunit.client.0.smithi155.stdout:3/311: dread d0/d1a/d33/f3a [0,4194304] 0 2023-12-16T05:56:31.602 INFO:tasks.workunit.client.0.smithi155.stdout:3/312: write d0/d14/d51/f3c [2166660,6015] 0 2023-12-16T05:56:31.604 INFO:tasks.workunit.client.1.smithi156.stdout:3/61: sync 2023-12-16T05:56:31.604 INFO:tasks.workunit.client.1.smithi156.stdout:3/62: chown dc/df/c15 792534 1 2023-12-16T05:56:31.604 INFO:tasks.workunit.client.1.smithi156.stdout:3/63: fsync f4 0 2023-12-16T05:56:31.604 INFO:tasks.workunit.client.1.smithi156.stdout:3/64: chown dc/le 5 1 2023-12-16T05:56:31.604 INFO:tasks.workunit.client.1.smithi156.stdout:3/65: chown fb 1325 1 2023-12-16T05:56:31.604 INFO:tasks.workunit.client.1.smithi156.stdout:3/66: chown l1 425432603 1 2023-12-16T05:56:31.608 INFO:tasks.workunit.client.0.smithi155.stdout:5/443: mknod d0/d2/d2a/d19/d88/c8f 0 2023-12-16T05:56:31.610 INFO:tasks.workunit.client.1.smithi156.stdout:3/67: symlink dc/df/l16 0 2023-12-16T05:56:31.611 INFO:tasks.workunit.client.0.smithi155.stdout:0/342: rmdir d7/df/d41 39 2023-12-16T05:56:31.611 INFO:tasks.workunit.client.1.smithi156.stdout:3/68: symlink dc/df/l17 0 2023-12-16T05:56:31.612 INFO:tasks.workunit.client.1.smithi156.stdout:0/149: dread d2/ff [0,4194304] 0 2023-12-16T05:56:31.612 INFO:tasks.workunit.client.1.smithi156.stdout:0/150: write d2/f28 [31900,2006] 0 2023-12-16T05:56:31.614 INFO:tasks.workunit.client.1.smithi156.stdout:3/69: write f7 [1491167,94884] 0 2023-12-16T05:56:31.615 INFO:tasks.workunit.client.1.smithi156.stdout:4/69: dread f0 [0,4194304] 0 2023-12-16T05:56:31.615 INFO:tasks.workunit.client.1.smithi156.stdout:4/70: write f4 [1237261,73849] 0 2023-12-16T05:56:31.616 INFO:tasks.workunit.client.0.smithi155.stdout:5/444: truncate d0/d2/d2a/fe 8308215 0 2023-12-16T05:56:31.616 INFO:tasks.workunit.client.1.smithi156.stdout:3/70: creat dc/d10/f18 x:0 0 0 2023-12-16T05:56:31.617 INFO:tasks.workunit.client.0.smithi155.stdout:0/343: mknod d7/d13/d45/d4b/c66 0 2023-12-16T05:56:31.617 INFO:tasks.workunit.client.0.smithi155.stdout:0/344: stat d7/df/d65/f39 0 2023-12-16T05:56:31.617 INFO:tasks.workunit.client.0.smithi155.stdout:0/345: fsync f2 0 2023-12-16T05:56:31.620 INFO:tasks.workunit.client.0.smithi155.stdout:5/445: symlink d0/d2/d2a/d19/d59/d66/l90 0 2023-12-16T05:56:31.620 INFO:tasks.workunit.client.0.smithi155.stdout:0/346: creat d7/d13/d45/d4b/f67 x:0 0 0 2023-12-16T05:56:31.623 INFO:tasks.workunit.client.0.smithi155.stdout:5/446: mknod d0/d2/d2a/d19/d59/d66/c91 0 2023-12-16T05:56:31.623 INFO:tasks.workunit.client.0.smithi155.stdout:5/447: fsync d0/d2/d2a/d30/f70 0 2023-12-16T05:56:31.626 INFO:tasks.workunit.client.0.smithi155.stdout:3/313: write d0/d1e/f23 [1584228,119405] 0 2023-12-16T05:56:31.629 INFO:tasks.workunit.client.0.smithi155.stdout:2/344: rmdir d0 39 2023-12-16T05:56:31.632 INFO:tasks.workunit.client.0.smithi155.stdout:3/314: read d0/d1e/f49 [56429,59917] 0 2023-12-16T05:56:31.638 INFO:tasks.workunit.client.0.smithi155.stdout:6/535: dwrite d0/d3/f1e [0,4194304] 0 2023-12-16T05:56:31.639 INFO:tasks.workunit.client.1.smithi156.stdout:7/167: sync 2023-12-16T05:56:31.639 INFO:tasks.workunit.client.1.smithi156.stdout:5/184: dwrite da/dc/d2d/f33 [0,4194304] 0 2023-12-16T05:56:31.639 INFO:tasks.workunit.client.1.smithi156.stdout:5/185: write da/dc/f31 [335715,95824] 0 2023-12-16T05:56:31.640 INFO:tasks.workunit.client.0.smithi155.stdout:6/536: symlink d0/d3/d2c/d3e/laa 0 2023-12-16T05:56:31.640 INFO:tasks.workunit.client.1.smithi156.stdout:7/168: creat d1e/d1f/d22/d2c/d33/f35 x:0 0 0 2023-12-16T05:56:31.640 INFO:tasks.workunit.client.0.smithi155.stdout:6/537: rename d0/ce to d0/df/d5e/d46/cab 0 2023-12-16T05:56:31.643 INFO:tasks.workunit.client.1.smithi156.stdout:5/186: mkdir da/dc/d2d/d34 0 2023-12-16T05:56:31.643 INFO:tasks.workunit.client.1.smithi156.stdout:5/187: chown da/dc/f31 929 1 2023-12-16T05:56:31.646 INFO:tasks.workunit.client.1.smithi156.stdout:7/169: creat d1e/d1f/d22/d2c/d2e/f36 x:0 0 0 2023-12-16T05:56:31.647 INFO:tasks.workunit.client.1.smithi156.stdout:7/170: write d1e/d1f/d22/f23 [1572031,16389] 0 2023-12-16T05:56:31.647 INFO:tasks.workunit.client.1.smithi156.stdout:7/171: read d1e/f27 [314315,18792] 0 2023-12-16T05:56:31.648 INFO:tasks.workunit.client.1.smithi156.stdout:7/172: creat d1e/d1f/d22/f37 x:0 0 0 2023-12-16T05:56:31.648 INFO:tasks.workunit.client.1.smithi156.stdout:7/173: fdatasync f4 0 2023-12-16T05:56:31.651 INFO:tasks.workunit.client.0.smithi155.stdout:8/382: dwrite d4/da/f25 [4194304,4194304] 0 2023-12-16T05:56:31.652 INFO:tasks.workunit.client.1.smithi156.stdout:4/71: fdatasync f4 0 2023-12-16T05:56:31.652 INFO:tasks.workunit.client.1.smithi156.stdout:4/72: chown d9/fc 94003098 1 2023-12-16T05:56:31.652 INFO:tasks.workunit.client.1.smithi156.stdout:6/104: dwrite f6 [4194304,4194304] 0 2023-12-16T05:56:31.652 INFO:tasks.workunit.client.1.smithi156.stdout:0/151: dwrite d2/d7/dd/f19 [0,4194304] 0 2023-12-16T05:56:31.653 INFO:tasks.workunit.client.1.smithi156.stdout:9/107: dwrite d6/d19/f1a [0,4194304] 0 2023-12-16T05:56:31.653 INFO:tasks.workunit.client.1.smithi156.stdout:4/73: rename d9/f11 to d9/f15 0 2023-12-16T05:56:31.653 INFO:tasks.workunit.client.1.smithi156.stdout:8/98: dwrite d3/d18/f1b [0,4194304] 0 2023-12-16T05:56:31.653 INFO:tasks.workunit.client.1.smithi156.stdout:5/188: dread da/dc/f19 [0,4194304] 0 2023-12-16T05:56:31.653 INFO:tasks.workunit.client.1.smithi156.stdout:5/189: fsync da/f1e 0 2023-12-16T05:56:31.654 INFO:tasks.workunit.client.0.smithi155.stdout:1/466: dwrite d1/d7/f75 [0,4194304] 0 2023-12-16T05:56:31.654 INFO:tasks.workunit.client.0.smithi155.stdout:8/383: creat d4/da/d1b/d2a/f75 x:0 0 0 2023-12-16T05:56:31.657 INFO:tasks.workunit.client.1.smithi156.stdout:6/105: creat d9/f1d x:0 0 0 2023-12-16T05:56:31.658 INFO:tasks.workunit.client.1.smithi156.stdout:6/106: dread - d9/f1d zero size 2023-12-16T05:56:31.658 INFO:tasks.workunit.client.1.smithi156.stdout:0/152: mkdir d2/d7/dd/d29 0 2023-12-16T05:56:31.658 INFO:tasks.workunit.client.1.smithi156.stdout:0/153: rename d2 to d2/d7/d2a 22 2023-12-16T05:56:31.659 INFO:tasks.workunit.client.1.smithi156.stdout:0/154: read - d2/d7/dd/f1f zero size 2023-12-16T05:56:31.659 INFO:tasks.workunit.client.1.smithi156.stdout:0/155: readlink d2/d7/dd/l17 0 2023-12-16T05:56:31.659 INFO:tasks.workunit.client.1.smithi156.stdout:0/156: stat d2/d23/f27 0 2023-12-16T05:56:31.659 INFO:tasks.workunit.client.1.smithi156.stdout:0/157: fsync d2/d7/f10 0 2023-12-16T05:56:31.661 INFO:tasks.workunit.client.0.smithi155.stdout:1/467: rename d1/d25/d43/c48 to d1/d7/d4b/d72/d79/c98 0 2023-12-16T05:56:31.661 INFO:tasks.workunit.client.0.smithi155.stdout:1/468: truncate d1/d17/f94 857287 0 2023-12-16T05:56:31.662 INFO:tasks.workunit.client.1.smithi156.stdout:8/99: write d3/f17 [3162235,109712] 0 2023-12-16T05:56:31.662 INFO:tasks.workunit.client.1.smithi156.stdout:5/190: symlink da/l35 0 2023-12-16T05:56:31.662 INFO:tasks.workunit.client.0.smithi155.stdout:0/347: rmdir d7/df/d65 39 2023-12-16T05:56:31.663 INFO:tasks.workunit.client.0.smithi155.stdout:0/348: fdatasync d7/f29 0 2023-12-16T05:56:31.663 INFO:tasks.workunit.client.0.smithi155.stdout:0/349: stat d7/df/d41/d23/d44 0 2023-12-16T05:56:31.663 INFO:tasks.workunit.client.0.smithi155.stdout:5/448: dwrite d0/d2/d2a/d3c/d47/f73 [0,4194304] 0 2023-12-16T05:56:31.663 INFO:tasks.workunit.client.1.smithi156.stdout:0/158: mknod d2/d23/c2b 0 2023-12-16T05:56:31.663 INFO:tasks.workunit.client.1.smithi156.stdout:0/159: stat d2/d7/f18 0 2023-12-16T05:56:31.664 INFO:tasks.workunit.client.1.smithi156.stdout:9/108: mknod d6/d19/c2d 0 2023-12-16T05:56:31.666 INFO:tasks.workunit.client.1.smithi156.stdout:5/191: truncate da/dc/f13 1094296 0 2023-12-16T05:56:31.667 INFO:tasks.workunit.client.0.smithi155.stdout:0/350: write d7/d2d/f3c [1050311,46745] 0 2023-12-16T05:56:31.668 INFO:tasks.workunit.client.1.smithi156.stdout:9/109: mkdir d6/d2e 0 2023-12-16T05:56:31.668 INFO:tasks.workunit.client.1.smithi156.stdout:9/110: stat d6/cb 0 2023-12-16T05:56:31.668 INFO:tasks.workunit.client.1.smithi156.stdout:5/192: creat da/f36 x:0 0 0 2023-12-16T05:56:31.673 INFO:tasks.workunit.client.1.smithi156.stdout:9/111: rename d6/d19/d25/c26 to d6/d2e/c2f 0 2023-12-16T05:56:31.674 INFO:tasks.workunit.client.0.smithi155.stdout:5/449: mknod d0/d2/d2a/d19/d21/c92 0 2023-12-16T05:56:31.675 INFO:tasks.workunit.client.0.smithi155.stdout:5/450: stat d0/d2/d2a/d19/d21/d56/c5e 0 2023-12-16T05:56:31.675 INFO:tasks.workunit.client.0.smithi155.stdout:5/451: dread - d0/d2/d2a/d19/d21/f78 zero size 2023-12-16T05:56:31.676 INFO:tasks.workunit.client.1.smithi156.stdout:3/71: dwrite dc/f14 [0,4194304] 0 2023-12-16T05:56:31.676 INFO:tasks.workunit.client.1.smithi156.stdout:3/72: write f7 [4501851,18703] 0 2023-12-16T05:56:31.676 INFO:tasks.workunit.client.1.smithi156.stdout:0/160: read d2/f22 [257134,103840] 0 2023-12-16T05:56:31.677 INFO:tasks.workunit.client.0.smithi155.stdout:5/452: mkdir d0/d60/d79/d8e/d93 0 2023-12-16T05:56:31.677 INFO:tasks.workunit.client.0.smithi155.stdout:2/345: dwrite d0/d7/dd/f39 [0,4194304] 0 2023-12-16T05:56:31.679 INFO:tasks.workunit.client.1.smithi156.stdout:9/112: dread f3 [0,4194304] 0 2023-12-16T05:56:31.679 INFO:tasks.workunit.client.1.smithi156.stdout:0/161: write d2/d7/f10 [3118046,62186] 0 2023-12-16T05:56:31.680 INFO:tasks.workunit.client.0.smithi155.stdout:5/453: truncate d0/d2/d2a/f2e 2176760 0 2023-12-16T05:56:31.680 INFO:tasks.workunit.client.0.smithi155.stdout:5/454: chown d0/d2/d2a/d19/d59/d66/c81 13266547 1 2023-12-16T05:56:31.681 INFO:tasks.workunit.client.1.smithi156.stdout:9/113: write d6/fd [444780,85992] 0 2023-12-16T05:56:31.681 INFO:tasks.workunit.client.0.smithi155.stdout:2/346: rename d0/d34/d3c/f55 to d0/d5/d6/f75 0 2023-12-16T05:56:31.682 INFO:tasks.workunit.client.1.smithi156.stdout:9/114: dread d6/f14 [0,4194304] 0 2023-12-16T05:56:31.684 INFO:tasks.workunit.client.0.smithi155.stdout:2/347: symlink d0/d7/dd/d45/l76 0 2023-12-16T05:56:31.685 INFO:tasks.workunit.client.0.smithi155.stdout:2/348: mkdir d0/d7/d69/d77 0 2023-12-16T05:56:31.688 INFO:tasks.workunit.client.1.smithi156.stdout:4/74: dread f8 [0,4194304] 0 2023-12-16T05:56:31.688 INFO:tasks.workunit.client.0.smithi155.stdout:2/349: symlink d0/d7/dd/d49/d4b/l78 0 2023-12-16T05:56:31.689 INFO:tasks.workunit.client.1.smithi156.stdout:4/75: creat d9/f16 x:0 0 0 2023-12-16T05:56:31.690 INFO:tasks.workunit.client.0.smithi155.stdout:2/350: creat d0/d34/d3c/f79 x:0 0 0 2023-12-16T05:56:31.692 INFO:tasks.workunit.client.0.smithi155.stdout:2/351: write d0/d5/d6/f2e [1993667,92998] 0 2023-12-16T05:56:31.699 INFO:tasks.workunit.client.1.smithi156.stdout:9/115: write d6/ff [2835234,108219] 0 2023-12-16T05:56:31.703 INFO:tasks.workunit.client.0.smithi155.stdout:8/384: dwrite d4/da/d1b/d1c/d1a/f2d [0,4194304] 0 2023-12-16T05:56:31.703 INFO:tasks.workunit.client.0.smithi155.stdout:8/385: stat d4/da/d1b/d1c/d19/l6a 0 2023-12-16T05:56:31.704 INFO:tasks.workunit.client.1.smithi156.stdout:7/174: dwrite d1e/f32 [4194304,4194304] 0 2023-12-16T05:56:31.704 INFO:tasks.workunit.client.1.smithi156.stdout:7/175: chown c1d 1270427427 1 2023-12-16T05:56:31.706 INFO:tasks.workunit.client.1.smithi156.stdout:7/176: creat d1e/d1f/d22/d2c/d2e/f38 x:0 0 0 2023-12-16T05:56:31.706 INFO:tasks.workunit.client.1.smithi156.stdout:7/177: fdatasync d1e/d1f/d22/f25 0 2023-12-16T05:56:31.707 INFO:tasks.workunit.client.0.smithi155.stdout:8/386: unlink d4/d62/d66/l6f 0 2023-12-16T05:56:31.707 INFO:tasks.workunit.client.1.smithi156.stdout:7/178: mkdir d1e/d39 0 2023-12-16T05:56:31.712 INFO:tasks.workunit.client.0.smithi155.stdout:9/481: sync 2023-12-16T05:56:31.712 INFO:tasks.workunit.client.0.smithi155.stdout:4/379: sync 2023-12-16T05:56:31.712 INFO:tasks.workunit.client.0.smithi155.stdout:9/482: dread - da/d15/d17/d24/d26/d2e/d32/f5f zero size 2023-12-16T05:56:31.714 INFO:tasks.workunit.client.0.smithi155.stdout:9/483: creat da/d15/fac x:0 0 0 2023-12-16T05:56:31.716 INFO:tasks.workunit.client.0.smithi155.stdout:9/484: unlink da/d15/d17/l23 0 2023-12-16T05:56:31.716 INFO:tasks.workunit.client.0.smithi155.stdout:8/387: dread d4/da/d12/f2e [0,4194304] 0 2023-12-16T05:56:31.718 INFO:tasks.workunit.client.0.smithi155.stdout:8/388: write d4/da/f25 [5246998,127298] 0 2023-12-16T05:56:31.718 INFO:tasks.workunit.client.0.smithi155.stdout:8/389: fsync d4/d62/d70/d4f/f60 0 2023-12-16T05:56:31.718 INFO:tasks.workunit.client.0.smithi155.stdout:8/390: write d4/da/d1b/d2a/d51/f6e [204081,8285] 0 2023-12-16T05:56:31.718 INFO:tasks.workunit.client.0.smithi155.stdout:9/485: unlink da/d15/d17/f96 0 2023-12-16T05:56:31.720 INFO:tasks.workunit.client.0.smithi155.stdout:6/538: dwrite d0/d3/d7a/d77/f83 [0,4194304] 0 2023-12-16T05:56:31.723 INFO:tasks.workunit.client.1.smithi156.stdout:9/116: truncate d6/d19/f1a 2115463 0 2023-12-16T05:56:31.723 INFO:tasks.workunit.client.0.smithi155.stdout:1/469: dwrite d1/f51 [0,4194304] 0 2023-12-16T05:56:31.725 INFO:tasks.workunit.client.1.smithi156.stdout:0/162: fdatasync d2/f28 0 2023-12-16T05:56:31.727 INFO:tasks.workunit.client.0.smithi155.stdout:3/315: dwrite d0/d14/d51/f3c [0,4194304] 0 2023-12-16T05:56:31.731 INFO:tasks.workunit.client.0.smithi155.stdout:3/316: mkdir d0/d14/d36/d47/d61 0 2023-12-16T05:56:31.735 INFO:tasks.workunit.client.1.smithi156.stdout:3/73: dwrite f4 [0,4194304] 0 2023-12-16T05:56:31.736 INFO:tasks.workunit.client.1.smithi156.stdout:4/76: dwrite f8 [0,4194304] 0 2023-12-16T05:56:31.737 INFO:tasks.workunit.client.1.smithi156.stdout:6/107: dwrite f5 [0,4194304] 0 2023-12-16T05:56:31.737 INFO:tasks.workunit.client.0.smithi155.stdout:2/352: dwrite d0/d7/d69/f58 [0,4194304] 0 2023-12-16T05:56:31.741 INFO:tasks.workunit.client.1.smithi156.stdout:3/74: creat dc/f19 x:0 0 0 2023-12-16T05:56:31.742 INFO:tasks.workunit.client.0.smithi155.stdout:2/353: creat d0/d7/d1f/d74/d3a/f7a x:0 0 0 2023-12-16T05:56:31.747 INFO:tasks.workunit.client.0.smithi155.stdout:2/354: symlink d0/d7/dd/d49/d4b/l7b 0 2023-12-16T05:56:31.747 INFO:tasks.workunit.client.0.smithi155.stdout:2/355: truncate d0/d34/d3c/f79 416046 0 2023-12-16T05:56:31.748 INFO:tasks.workunit.client.0.smithi155.stdout:0/351: dwrite d7/fe [0,4194304] 0 2023-12-16T05:56:31.751 INFO:tasks.workunit.client.0.smithi155.stdout:6/539: dwrite d0/df/f26 [0,4194304] 0 2023-12-16T05:56:31.752 INFO:tasks.workunit.client.0.smithi155.stdout:6/540: rmdir d0/df/d5e/d7e 39 2023-12-16T05:56:31.752 INFO:tasks.workunit.client.0.smithi155.stdout:2/356: write d0/f32 [2989541,36610] 0 2023-12-16T05:56:31.753 INFO:tasks.workunit.client.0.smithi155.stdout:6/541: mknod d0/cac 0 2023-12-16T05:56:31.754 INFO:tasks.workunit.client.0.smithi155.stdout:2/357: link d0/d7/d69/f1b d0/d5/d6/f7c 0 2023-12-16T05:56:31.754 INFO:tasks.workunit.client.0.smithi155.stdout:6/542: symlink d0/d3/d2c/d8b/d85/da4/lad 0 2023-12-16T05:56:31.755 INFO:tasks.workunit.client.0.smithi155.stdout:2/358: rmdir d0/d7/d1f 39 2023-12-16T05:56:31.755 INFO:tasks.workunit.client.0.smithi155.stdout:2/359: fdatasync d0/d7/dd/d14/f19 0 2023-12-16T05:56:31.756 INFO:tasks.workunit.client.0.smithi155.stdout:6/543: unlink d0/df/f9d 0 2023-12-16T05:56:31.756 INFO:tasks.workunit.client.0.smithi155.stdout:6/544: readlink d0/d3/d7a/l45 0 2023-12-16T05:56:31.756 INFO:tasks.workunit.client.0.smithi155.stdout:6/545: stat d0/df/d5e/d5b/ca1 0 2023-12-16T05:56:31.758 INFO:tasks.workunit.client.1.smithi156.stdout:6/108: unlink c7 0 2023-12-16T05:56:31.758 INFO:tasks.workunit.client.1.smithi156.stdout:6/109: readlink d9/le 0 2023-12-16T05:56:31.758 INFO:tasks.workunit.client.1.smithi156.stdout:6/110: chown d9/d13/f1a 219358676 1 2023-12-16T05:56:31.758 INFO:tasks.workunit.client.1.smithi156.stdout:6/111: chown d9/d13 417060981 1 2023-12-16T05:56:31.758 INFO:tasks.workunit.client.0.smithi155.stdout:7/435: sync 2023-12-16T05:56:31.759 INFO:tasks.workunit.client.1.smithi156.stdout:4/77: getdents d9 0 2023-12-16T05:56:31.759 INFO:tasks.workunit.client.1.smithi156.stdout:4/78: write f6 [5140520,45886] 0 2023-12-16T05:56:31.760 INFO:tasks.workunit.client.0.smithi155.stdout:4/380: dwrite d0/da/d36/d5f/f66 [0,4194304] 0 2023-12-16T05:56:31.760 INFO:tasks.workunit.client.0.smithi155.stdout:9/486: dwrite da/d15/d17/d24/d26/d2e/f4a [0,4194304] 0 2023-12-16T05:56:31.760 INFO:tasks.workunit.client.0.smithi155.stdout:9/487: truncate da/d15/d17/d36/d5b/d60/f77 1224746 0 2023-12-16T05:56:31.761 INFO:tasks.workunit.client.0.smithi155.stdout:0/352: dread f2 [4194304,4194304] 0 2023-12-16T05:56:31.761 INFO:tasks.workunit.client.0.smithi155.stdout:5/455: write d0/d2/d2a/f45 [1416162,92722] 0 2023-12-16T05:56:31.761 INFO:tasks.workunit.client.1.smithi156.stdout:6/112: read f6 [6187670,46392] 0 2023-12-16T05:56:31.762 INFO:tasks.workunit.client.0.smithi155.stdout:7/436: rename d0/d6a/d1a/d22/d3c to d0/d6a/d1a/d8c/d42/d98 0 2023-12-16T05:56:31.762 INFO:tasks.workunit.client.0.smithi155.stdout:6/546: write d0/d3/d2c/d3e/f64 [2623994,65921] 0 2023-12-16T05:56:31.763 INFO:tasks.workunit.client.1.smithi156.stdout:7/179: write f9 [576234,104380] 0 2023-12-16T05:56:31.763 INFO:tasks.workunit.client.1.smithi156.stdout:7/180: write d1e/f27 [624852,96565] 0 2023-12-16T05:56:31.764 INFO:tasks.workunit.client.1.smithi156.stdout:4/79: symlink d9/l17 0 2023-12-16T05:56:31.765 INFO:tasks.workunit.client.1.smithi156.stdout:3/75: truncate dc/f14 2398749 0 2023-12-16T05:56:31.767 INFO:tasks.workunit.client.0.smithi155.stdout:2/360: dread d0/d7/d1f/d74/f46 [0,4194304] 0 2023-12-16T05:56:31.767 INFO:tasks.workunit.client.0.smithi155.stdout:4/381: rmdir d0/da/d36/d5f/d75/d3d/d6c 0 2023-12-16T05:56:31.768 INFO:tasks.workunit.client.1.smithi156.stdout:6/113: mknod d9/d1c/c1e 0 2023-12-16T05:56:31.768 INFO:tasks.workunit.client.1.smithi156.stdout:6/114: fsync d9/f15 0 2023-12-16T05:56:31.768 INFO:tasks.workunit.client.1.smithi156.stdout:4/80: creat d9/f18 x:0 0 0 2023-12-16T05:56:31.768 INFO:tasks.workunit.client.1.smithi156.stdout:5/193: dwrite da/dc/f31 [0,4194304] 0 2023-12-16T05:56:31.768 INFO:tasks.workunit.client.0.smithi155.stdout:9/488: getdents da/d15/d17/d24/d62/d91 0 2023-12-16T05:56:31.769 INFO:tasks.workunit.client.1.smithi156.stdout:6/115: creat d9/f1f x:0 0 0 2023-12-16T05:56:31.770 INFO:tasks.workunit.client.0.smithi155.stdout:5/456: write d0/d2/f22 [4730163,107661] 0 2023-12-16T05:56:31.771 INFO:tasks.workunit.client.0.smithi155.stdout:0/353: creat d7/df/d41/d23/f68 x:0 0 0 2023-12-16T05:56:31.771 INFO:tasks.workunit.client.1.smithi156.stdout:4/81: creat d9/f19 x:0 0 0 2023-12-16T05:56:31.771 INFO:tasks.workunit.client.1.smithi156.stdout:4/82: readlink d9/l17 0 2023-12-16T05:56:31.772 INFO:tasks.workunit.client.1.smithi156.stdout:5/194: creat da/dc/f37 x:0 0 0 2023-12-16T05:56:31.772 INFO:tasks.workunit.client.1.smithi156.stdout:6/116: creat d9/d13/f20 x:0 0 0 2023-12-16T05:56:31.773 INFO:tasks.workunit.client.1.smithi156.stdout:5/195: symlink da/l38 0 2023-12-16T05:56:31.773 INFO:tasks.workunit.client.1.smithi156.stdout:5/196: readlink da/dc/l30 0 2023-12-16T05:56:31.773 INFO:tasks.workunit.client.1.smithi156.stdout:5/197: fdatasync f0 0 2023-12-16T05:56:31.774 INFO:tasks.workunit.client.0.smithi155.stdout:6/547: mknod d0/df/cae 0 2023-12-16T05:56:31.774 INFO:tasks.workunit.client.1.smithi156.stdout:6/117: mknod d9/d13/c21 0 2023-12-16T05:56:31.774 INFO:tasks.workunit.client.1.smithi156.stdout:6/118: write d9/d13/f14 [4746263,77653] 0 2023-12-16T05:56:31.775 INFO:tasks.workunit.client.1.smithi156.stdout:6/119: unlink d9/cc 0 2023-12-16T05:56:31.777 INFO:tasks.workunit.client.1.smithi156.stdout:6/120: mknod d9/d1c/c22 0 2023-12-16T05:56:31.777 INFO:tasks.workunit.client.0.smithi155.stdout:2/361: symlink d0/d5/d6/d5f/l7d 0 2023-12-16T05:56:31.778 INFO:tasks.workunit.client.1.smithi156.stdout:1/56: sync 2023-12-16T05:56:31.779 INFO:tasks.workunit.client.0.smithi155.stdout:4/382: symlink d0/d10/l76 0 2023-12-16T05:56:31.780 INFO:tasks.workunit.client.0.smithi155.stdout:9/489: symlink da/d15/d17/d36/d54/lad 0 2023-12-16T05:56:31.780 INFO:tasks.workunit.client.0.smithi155.stdout:9/490: chown da/d15/d17/d24/d26/d2e/l6c 0 1 2023-12-16T05:56:31.781 INFO:tasks.workunit.client.1.smithi156.stdout:5/198: write da/dc/f31 [1993025,67645] 0 2023-12-16T05:56:31.782 INFO:tasks.workunit.client.1.smithi156.stdout:5/199: symlink da/dc/d2d/l39 0 2023-12-16T05:56:31.782 INFO:tasks.workunit.client.0.smithi155.stdout:0/354: mkdir d7/df/d69 0 2023-12-16T05:56:31.785 INFO:tasks.workunit.client.0.smithi155.stdout:4/383: symlink d0/da/d36/l77 0 2023-12-16T05:56:31.785 INFO:tasks.workunit.client.0.smithi155.stdout:4/384: write d0/d10/f2c [2270912,24318] 0 2023-12-16T05:56:31.785 INFO:tasks.workunit.client.0.smithi155.stdout:4/385: fsync d0/d10/d46/d16/d1a/f69 0 2023-12-16T05:56:31.786 INFO:tasks.workunit.client.0.smithi155.stdout:9/491: creat da/d15/d17/d24/d62/fae x:0 0 0 2023-12-16T05:56:31.786 INFO:tasks.workunit.client.0.smithi155.stdout:9/492: fdatasync da/d15/f45 0 2023-12-16T05:56:31.786 INFO:tasks.workunit.client.0.smithi155.stdout:9/493: write da/d15/d17/d36/d5b/f71 [1069070,66172] 0 2023-12-16T05:56:31.786 INFO:tasks.workunit.client.0.smithi155.stdout:9/494: dread - da/d15/d17/d36/fa1 zero size 2023-12-16T05:56:31.786 INFO:tasks.workunit.client.0.smithi155.stdout:9/495: write da/d15/d17/d36/d5b/fa2 [185407,117998] 0 2023-12-16T05:56:31.787 INFO:tasks.workunit.client.0.smithi155.stdout:9/496: fsync da/d15/d17/d24/d26/d2e/f8e 0 2023-12-16T05:56:31.789 INFO:tasks.workunit.client.0.smithi155.stdout:0/355: dread d7/d13/d45/f4f [0,4194304] 0 2023-12-16T05:56:31.790 INFO:tasks.workunit.client.0.smithi155.stdout:0/356: chown d7/d13/d45/d4b/f67 4966 1 2023-12-16T05:56:31.836 INFO:tasks.workunit.client.1.smithi156.stdout:8/100: dwrite d3/f17 [0,4194304] 0 2023-12-16T05:56:31.836 INFO:tasks.workunit.client.0.smithi155.stdout:8/391: dwrite d4/da/d1b/d1c/d19/f38 [0,4194304] 0 2023-12-16T05:56:31.838 INFO:tasks.workunit.client.0.smithi155.stdout:1/470: dwrite d1/d7/d16/d30/f62 [0,4194304] 0 2023-12-16T05:56:31.839 INFO:tasks.workunit.client.0.smithi155.stdout:1/471: chown d1/d25/c52 109104 1 2023-12-16T05:56:31.839 INFO:tasks.workunit.client.0.smithi155.stdout:1/472: chown d1/d17/d28/d8f/f96 15560201 1 2023-12-16T05:56:31.840 INFO:tasks.workunit.client.0.smithi155.stdout:1/473: symlink d1/d25/d43/d5d/l99 0 2023-12-16T05:56:31.841 INFO:tasks.workunit.client.0.smithi155.stdout:1/474: symlink d1/d7/d4b/d5c/l9a 0 2023-12-16T05:56:31.841 INFO:tasks.workunit.client.0.smithi155.stdout:1/475: creat d1/d25/f9b x:0 0 0 2023-12-16T05:56:31.844 INFO:tasks.workunit.client.0.smithi155.stdout:2/362: read d0/d7/d69/f1b [3247170,100305] 0 2023-12-16T05:56:31.844 INFO:tasks.workunit.client.0.smithi155.stdout:2/363: dread - d0/d7/f73 zero size 2023-12-16T05:56:31.845 INFO:tasks.workunit.client.1.smithi156.stdout:8/101: creat d3/d18/f1f x:0 0 0 2023-12-16T05:56:31.845 INFO:tasks.workunit.client.1.smithi156.stdout:4/83: write f4 [635309,114764] 0 2023-12-16T05:56:31.845 INFO:tasks.workunit.client.1.smithi156.stdout:5/200: dread da/dc/f19 [0,4194304] 0 2023-12-16T05:56:31.846 INFO:tasks.workunit.client.0.smithi155.stdout:2/364: creat d0/d7/f7e x:0 0 0 2023-12-16T05:56:31.848 INFO:tasks.workunit.client.0.smithi155.stdout:2/365: mkdir d0/d7/dd/d49/d4b/d7f 0 2023-12-16T05:56:31.848 INFO:tasks.workunit.client.0.smithi155.stdout:2/366: fdatasync d0/d7/f5e 0 2023-12-16T05:56:31.850 INFO:tasks.workunit.client.0.smithi155.stdout:2/367: rename d0/d7/dd/d45 to d0/d7/dd/d49/d4b/d80 0 2023-12-16T05:56:31.850 INFO:tasks.workunit.client.0.smithi155.stdout:2/368: truncate d0/d7/dd/d62/d66/f6a 374274 0 2023-12-16T05:56:31.853 INFO:tasks.workunit.client.1.smithi156.stdout:5/201: fdatasync da/dc/f1d 0 2023-12-16T05:56:31.853 INFO:tasks.workunit.client.1.smithi156.stdout:4/84: symlink d9/l1a 0 2023-12-16T05:56:31.853 INFO:tasks.workunit.client.1.smithi156.stdout:5/202: creat da/f3a x:0 0 0 2023-12-16T05:56:31.853 INFO:tasks.workunit.client.1.smithi156.stdout:5/203: truncate da/dc/f21 464965 0 2023-12-16T05:56:31.855 INFO:tasks.workunit.client.1.smithi156.stdout:7/181: dwrite d1e/d1f/d22/f23 [0,4194304] 0 2023-12-16T05:56:31.856 INFO:tasks.workunit.client.0.smithi155.stdout:7/437: dwrite d0/d6a/d1a/d22/f86 [0,4194304] 0 2023-12-16T05:56:31.857 INFO:tasks.workunit.client.0.smithi155.stdout:7/438: write d0/d6a/d1a/d22/f25 [2160646,8801] 0 2023-12-16T05:56:31.859 INFO:tasks.workunit.client.1.smithi156.stdout:7/182: creat d1e/d1f/f3a x:0 0 0 2023-12-16T05:56:31.859 INFO:tasks.workunit.client.1.smithi156.stdout:7/183: fdatasync d1e/f27 0 2023-12-16T05:56:31.860 INFO:tasks.workunit.client.1.smithi156.stdout:7/184: fdatasync d1e/d1f/f3a 0 2023-12-16T05:56:31.860 INFO:tasks.workunit.client.1.smithi156.stdout:6/121: fsync d9/f15 0 2023-12-16T05:56:31.860 INFO:tasks.workunit.client.1.smithi156.stdout:6/122: write d9/d13/f17 [1206531,4744] 0 2023-12-16T05:56:31.861 INFO:tasks.workunit.client.1.smithi156.stdout:5/204: mknod da/dc/c3b 0 2023-12-16T05:56:31.863 INFO:tasks.workunit.client.1.smithi156.stdout:4/85: unlink d9/l14 0 2023-12-16T05:56:31.865 INFO:tasks.workunit.client.0.smithi155.stdout:5/457: dwrite d0/f1c [0,4194304] 0 2023-12-16T05:56:31.865 INFO:tasks.workunit.client.1.smithi156.stdout:6/123: link d9/f1d d9/d1c/f23 0 2023-12-16T05:56:31.867 INFO:tasks.workunit.client.1.smithi156.stdout:3/76: dwrite dc/f19 [0,4194304] 0 2023-12-16T05:56:31.869 INFO:tasks.workunit.client.0.smithi155.stdout:0/357: dread d7/fe [0,4194304] 0 2023-12-16T05:56:31.870 INFO:tasks.workunit.client.1.smithi156.stdout:8/102: dread d3/f17 [0,4194304] 0 2023-12-16T05:56:31.871 INFO:tasks.workunit.client.0.smithi155.stdout:0/358: read d7/d13/f1b [116287,117660] 0 2023-12-16T05:56:31.873 INFO:tasks.workunit.client.1.smithi156.stdout:3/77: rmdir dc/d10 39 2023-12-16T05:56:31.876 INFO:tasks.workunit.client.1.smithi156.stdout:3/78: symlink dc/df/l1a 0 2023-12-16T05:56:31.877 INFO:tasks.workunit.client.0.smithi155.stdout:0/359: mkdir d7/d47/d5d/d6a 0 2023-12-16T05:56:31.877 INFO:tasks.workunit.client.0.smithi155.stdout:0/360: dread - d7/d13/d45/f49 zero size 2023-12-16T05:56:31.880 INFO:tasks.workunit.client.0.smithi155.stdout:4/386: dwrite d0/fb [0,4194304] 0 2023-12-16T05:56:31.880 INFO:tasks.workunit.client.0.smithi155.stdout:4/387: read - d0/d10/d46/d16/d1a/f6f zero size 2023-12-16T05:56:31.880 INFO:tasks.workunit.client.0.smithi155.stdout:4/388: truncate d0/d10/f26 2295256 0 2023-12-16T05:56:31.880 INFO:tasks.workunit.client.0.smithi155.stdout:0/361: creat d7/df/d41/d23/d44/f6b x:0 0 0 2023-12-16T05:56:31.880 INFO:tasks.workunit.client.0.smithi155.stdout:8/392: dread d4/da/d1b/d1c/d19/f38 [0,4194304] 0 2023-12-16T05:56:31.881 INFO:tasks.workunit.client.1.smithi156.stdout:4/86: link d9/f19 d9/f1b 0 2023-12-16T05:56:31.881 INFO:tasks.workunit.client.0.smithi155.stdout:1/476: dwrite d1/d25/f33 [0,4194304] 0 2023-12-16T05:56:31.881 INFO:tasks.workunit.client.0.smithi155.stdout:6/548: dwrite d0/d3/d7a/f82 [0,4194304] 0 2023-12-16T05:56:31.881 INFO:tasks.workunit.client.0.smithi155.stdout:6/549: write d0/df/f90 [715385,83584] 0 2023-12-16T05:56:31.882 INFO:tasks.workunit.client.1.smithi156.stdout:3/79: truncate f4 294544 0 2023-12-16T05:56:31.882 INFO:tasks.workunit.client.1.smithi156.stdout:3/80: truncate f8 1260908 0 2023-12-16T05:56:31.882 INFO:tasks.workunit.client.0.smithi155.stdout:4/389: rmdir d0/d10/d46 39 2023-12-16T05:56:31.883 INFO:tasks.workunit.client.1.smithi156.stdout:5/205: getdents da/dc/d2d 0 2023-12-16T05:56:31.884 INFO:tasks.workunit.client.0.smithi155.stdout:1/477: write d1/d7/d16/f1d [3371508,74953] 0 2023-12-16T05:56:31.885 INFO:tasks.workunit.client.1.smithi156.stdout:3/81: symlink dc/l1b 0 2023-12-16T05:56:31.885 INFO:tasks.workunit.client.1.smithi156.stdout:6/124: dread d9/d13/f14 [0,4194304] 0 2023-12-16T05:56:31.886 INFO:tasks.workunit.client.1.smithi156.stdout:6/125: chown d9/cd 3895 1 2023-12-16T05:56:31.886 INFO:tasks.workunit.client.1.smithi156.stdout:6/126: truncate d9/f15 4994183 0 2023-12-16T05:56:31.887 INFO:tasks.workunit.client.1.smithi156.stdout:2/111: sync 2023-12-16T05:56:31.888 INFO:tasks.workunit.client.0.smithi155.stdout:8/393: rename d4/d62/f69 to d4/da/d1b/f76 0 2023-12-16T05:56:31.888 INFO:tasks.workunit.client.0.smithi155.stdout:0/362: creat d7/d13/d45/f6c x:0 0 0 2023-12-16T05:56:31.889 INFO:tasks.workunit.client.1.smithi156.stdout:6/127: rename d9/d13/f1a to d9/d1c/f24 0 2023-12-16T05:56:31.889 INFO:tasks.workunit.client.1.smithi156.stdout:6/128: dread - d9/f1f zero size 2023-12-16T05:56:31.891 INFO:tasks.workunit.client.1.smithi156.stdout:6/129: write d9/d13/f14 [3274655,112936] 0 2023-12-16T05:56:31.892 INFO:tasks.workunit.client.1.smithi156.stdout:6/130: truncate f5 5004396 0 2023-12-16T05:56:31.892 INFO:tasks.workunit.client.0.smithi155.stdout:8/394: rmdir d4/da/d1b/d1c/d19/d64 39 2023-12-16T05:56:31.892 INFO:tasks.workunit.client.0.smithi155.stdout:1/478: write d1/d7/d4b/d5c/f88 [3439510,79954] 0 2023-12-16T05:56:31.892 INFO:tasks.workunit.client.1.smithi156.stdout:2/112: rmdir d9/d12/d24 0 2023-12-16T05:56:31.893 INFO:tasks.workunit.client.0.smithi155.stdout:0/363: write d7/df/f19 [2270382,72650] 0 2023-12-16T05:56:31.894 INFO:tasks.workunit.client.0.smithi155.stdout:6/550: rename d0/d3/d2c/d3e/d4c/f5c to d0/d3/d2c/d3e/faf 0 2023-12-16T05:56:31.894 INFO:tasks.workunit.client.1.smithi156.stdout:6/131: mknod d9/c25 0 2023-12-16T05:56:31.894 INFO:tasks.workunit.client.1.smithi156.stdout:6/132: chown d9/d1c 897292 1 2023-12-16T05:56:31.894 INFO:tasks.workunit.client.1.smithi156.stdout:6/133: write d9/d1c/f23 [778222,61121] 0 2023-12-16T05:56:31.895 INFO:tasks.workunit.client.1.smithi156.stdout:2/113: symlink d9/dd/l25 0 2023-12-16T05:56:31.895 INFO:tasks.workunit.client.1.smithi156.stdout:2/114: readlink l3 0 2023-12-16T05:56:31.895 INFO:tasks.workunit.client.0.smithi155.stdout:6/551: dread d0/d3/d2c/d8b/f72 [0,4194304] 0 2023-12-16T05:56:31.896 INFO:tasks.workunit.client.0.smithi155.stdout:8/395: mknod d4/d62/d70/d4f/c77 0 2023-12-16T05:56:31.896 INFO:tasks.workunit.client.1.smithi156.stdout:2/115: rmdir d9/dd/d17 39 2023-12-16T05:56:31.897 INFO:tasks.workunit.client.0.smithi155.stdout:9/497: dwrite da/d15/d17/d24/f64 [0,4194304] 0 2023-12-16T05:56:31.897 INFO:tasks.workunit.client.0.smithi155.stdout:1/479: getdents d1/d17/d28/d8f 0 2023-12-16T05:56:31.898 INFO:tasks.workunit.client.1.smithi156.stdout:2/116: read f8 [1388740,95289] 0 2023-12-16T05:56:31.899 INFO:tasks.workunit.client.1.smithi156.stdout:2/117: mknod d9/dd/d17/c26 0 2023-12-16T05:56:31.900 INFO:tasks.workunit.client.1.smithi156.stdout:2/118: creat d9/f27 x:0 0 0 2023-12-16T05:56:31.901 INFO:tasks.workunit.client.1.smithi156.stdout:2/119: readlink d9/dc/lf 0 2023-12-16T05:56:31.901 INFO:tasks.workunit.client.1.smithi156.stdout:2/120: write d9/d12/f23 [1596173,49687] 0 2023-12-16T05:56:31.901 INFO:tasks.workunit.client.0.smithi155.stdout:0/364: symlink d7/d47/d5d/l6d 0 2023-12-16T05:56:31.901 INFO:tasks.workunit.client.0.smithi155.stdout:6/552: read d0/d3/d2c/d3e/d4c/d1b/f4b [127107,108798] 0 2023-12-16T05:56:31.902 INFO:tasks.workunit.client.1.smithi156.stdout:2/121: symlink d9/d12/l28 0 2023-12-16T05:56:31.902 INFO:tasks.workunit.client.1.smithi156.stdout:2/122: readlink d9/dc/lf 0 2023-12-16T05:56:31.902 INFO:tasks.workunit.client.1.smithi156.stdout:2/123: mknod d9/c29 0 2023-12-16T05:56:31.903 INFO:tasks.workunit.client.1.smithi156.stdout:2/124: read d9/dd/f1b [240658,84675] 0 2023-12-16T05:56:31.903 INFO:tasks.workunit.client.0.smithi155.stdout:5/458: truncate d0/d2/d2a/f45 53270 0 2023-12-16T05:56:31.903 INFO:tasks.workunit.client.0.smithi155.stdout:8/396: mkdir d4/d62/d66/d78 0 2023-12-16T05:56:31.903 INFO:tasks.workunit.client.0.smithi155.stdout:8/397: fsync d4/da/d1b/d1c/d19/f73 0 2023-12-16T05:56:31.903 INFO:tasks.workunit.client.0.smithi155.stdout:8/398: chown d4/l53 1349288 1 2023-12-16T05:56:31.903 INFO:tasks.workunit.client.0.smithi155.stdout:8/399: readlink d4/l5d 0 2023-12-16T05:56:31.906 INFO:tasks.workunit.client.0.smithi155.stdout:5/459: link d0/l24 d0/d2/l94 0 2023-12-16T05:56:31.907 INFO:tasks.workunit.client.0.smithi155.stdout:8/400: getdents d4/da/d1b/d5f 0 2023-12-16T05:56:31.909 INFO:tasks.workunit.client.0.smithi155.stdout:5/460: link d0/d2/d2a/d30/d53/d7b/f80 d0/d2/d2a/d19/d88/f95 0 2023-12-16T05:56:31.909 INFO:tasks.workunit.client.0.smithi155.stdout:5/461: write d0/d2/d2a/d3c/d47/f6b [116211,120337] 0 2023-12-16T05:56:31.909 INFO:tasks.workunit.client.0.smithi155.stdout:5/462: readlink d0/d2/d2a/d3c/d47/l7d 0 2023-12-16T05:56:31.910 INFO:tasks.workunit.client.0.smithi155.stdout:7/439: dwrite d0/d6a/d1a/d22/f87 [0,4194304] 0 2023-12-16T05:56:31.910 INFO:tasks.workunit.client.1.smithi156.stdout:7/185: dwrite d1e/f32 [8388608,4194304] 0 2023-12-16T05:56:31.910 INFO:tasks.workunit.client.1.smithi156.stdout:7/186: symlink d1e/d1f/d22/d2c/d33/l3b 0 2023-12-16T05:56:31.912 INFO:tasks.workunit.client.0.smithi155.stdout:8/401: link d4/da/d1b/d1c/d1a/c35 d4/da/d1b/d2a/d51/c79 0 2023-12-16T05:56:31.915 INFO:tasks.workunit.client.0.smithi155.stdout:7/440: dread d0/d1/f4a [0,4194304] 0 2023-12-16T05:56:31.915 INFO:tasks.workunit.client.0.smithi155.stdout:5/463: link d0/d2/d4f/f55 d0/d2/d4f/f96 0 2023-12-16T05:56:31.915 INFO:tasks.workunit.client.0.smithi155.stdout:5/464: dread - d0/d2/d2a/d30/d53/f8c zero size 2023-12-16T05:56:31.915 INFO:tasks.workunit.client.0.smithi155.stdout:2/369: dwrite d0/d7/d69/f1b [4194304,4194304] 0 2023-12-16T05:56:31.917 INFO:tasks.workunit.client.0.smithi155.stdout:6/553: dread d0/d3/d2c/d3e/d4c/f1d [0,4194304] 0 2023-12-16T05:56:31.917 INFO:tasks.workunit.client.0.smithi155.stdout:6/554: readlink d0/l5d 0 2023-12-16T05:56:31.917 INFO:tasks.workunit.client.0.smithi155.stdout:9/498: dread da/d15/d17/d24/d62/f97 [4194304,4194304] 0 2023-12-16T05:56:31.920 INFO:tasks.workunit.client.0.smithi155.stdout:4/390: dwrite d0/d10/f12 [0,4194304] 0 2023-12-16T05:56:31.921 INFO:tasks.workunit.client.0.smithi155.stdout:8/402: getdents d4/da/d1b/d1c/d19 0 2023-12-16T05:56:31.923 INFO:tasks.workunit.client.0.smithi155.stdout:2/370: dread d0/d7/dd/d14/f2d [0,4194304] 0 2023-12-16T05:56:31.923 INFO:tasks.workunit.client.0.smithi155.stdout:4/391: read d0/d10/f26 [2218120,61577] 0 2023-12-16T05:56:31.923 INFO:tasks.workunit.client.0.smithi155.stdout:6/555: dread d0/df/d5e/d5b/f76 [0,4194304] 0 2023-12-16T05:56:31.923 INFO:tasks.workunit.client.0.smithi155.stdout:0/365: dwrite d7/d13/d45/d4b/f60 [0,4194304] 0 2023-12-16T05:56:31.923 INFO:tasks.workunit.client.0.smithi155.stdout:5/465: mkdir d0/d60/d79/d97 0 2023-12-16T05:56:31.926 INFO:tasks.workunit.client.0.smithi155.stdout:7/441: read d0/d6a/d1a/d22/f25 [426943,122005] 0 2023-12-16T05:56:31.929 INFO:tasks.workunit.client.0.smithi155.stdout:9/499: creat da/d15/d17/d36/d5b/d98/faf x:0 0 0 2023-12-16T05:56:31.932 INFO:tasks.workunit.client.0.smithi155.stdout:2/371: dread d0/d7/d1f/d74/f46 [0,4194304] 0 2023-12-16T05:56:31.940 INFO:tasks.workunit.client.1.smithi156.stdout:7/187: dwrite f4 [4194304,4194304] 0 2023-12-16T05:56:31.942 INFO:tasks.workunit.client.1.smithi156.stdout:7/188: write d1e/f32 [2510715,11273] 0 2023-12-16T05:56:31.942 INFO:tasks.workunit.client.1.smithi156.stdout:2/125: dwrite d9/fb [0,4194304] 0 2023-12-16T05:56:31.942 INFO:tasks.workunit.client.1.smithi156.stdout:2/126: write d9/d12/f18 [4179062,33075] 0 2023-12-16T05:56:31.942 INFO:tasks.workunit.client.1.smithi156.stdout:2/127: chown d9/dd/d17/c26 30 1 2023-12-16T05:56:31.943 INFO:tasks.workunit.client.0.smithi155.stdout:1/480: dwrite d1/d7/d4b/f6d [0,4194304] 0 2023-12-16T05:56:31.943 INFO:tasks.workunit.client.0.smithi155.stdout:1/481: truncate d1/f1e 317685 0 2023-12-16T05:56:31.943 INFO:tasks.workunit.client.0.smithi155.stdout:8/403: unlink d4/da/f4c 0 2023-12-16T05:56:31.943 INFO:tasks.workunit.client.1.smithi156.stdout:3/82: dwrite dc/d10/f11 [0,4194304] 0 2023-12-16T05:56:31.944 INFO:tasks.workunit.client.1.smithi156.stdout:2/128: mknod d9/dc/c2a 0 2023-12-16T05:56:31.945 INFO:tasks.workunit.client.0.smithi155.stdout:4/392: rename d0/da/d36/d5f/d75/d50/c63 to d0/da/d36/d5f/d75/d3d/d49/d6b/c78 0 2023-12-16T05:56:31.946 INFO:tasks.workunit.client.0.smithi155.stdout:6/556: mkdir d0/d3/d7a/db0 0 2023-12-16T05:56:31.948 INFO:tasks.workunit.client.1.smithi156.stdout:2/129: write d9/dd/f19 [3987080,6051] 0 2023-12-16T05:56:31.949 INFO:tasks.workunit.client.1.smithi156.stdout:2/130: creat d9/dd/d17/f2b x:0 0 0 2023-12-16T05:56:31.950 INFO:tasks.workunit.client.0.smithi155.stdout:9/500: dwrite da/d15/d17/d24/d26/d2e/f4b [0,4194304] 0 2023-12-16T05:56:31.950 INFO:tasks.workunit.client.0.smithi155.stdout:9/501: fdatasync da/f80 0 2023-12-16T05:56:31.951 INFO:tasks.workunit.client.1.smithi156.stdout:2/131: unlink d9/c1e 0 2023-12-16T05:56:31.951 INFO:tasks.workunit.client.0.smithi155.stdout:0/366: symlink d7/df/d69/l6e 0 2023-12-16T05:56:31.956 INFO:tasks.workunit.client.0.smithi155.stdout:5/466: creat d0/d60/d79/d8e/f98 x:0 0 0 2023-12-16T05:56:31.956 INFO:tasks.workunit.client.0.smithi155.stdout:2/372: mknod d0/d7/dd/d49/d4b/d7f/c81 0 2023-12-16T05:56:31.960 INFO:tasks.workunit.client.0.smithi155.stdout:1/482: creat d1/d7/d4b/d72/d79/f9c x:0 0 0 2023-12-16T05:56:31.961 INFO:tasks.workunit.client.0.smithi155.stdout:1/483: dread d1/f4f [0,4194304] 0 2023-12-16T05:56:31.962 INFO:tasks.workunit.client.0.smithi155.stdout:8/404: symlink d4/da/d1b/d2a/d5e/l7a 0 2023-12-16T05:56:31.968 INFO:tasks.workunit.client.1.smithi156.stdout:3/83: dwrite f7 [0,4194304] 0 2023-12-16T05:56:31.968 INFO:tasks.workunit.client.0.smithi155.stdout:6/557: dread d0/d3/d2c/d3e/d4c/f63 [0,4194304] 0 2023-12-16T05:56:31.968 INFO:tasks.workunit.client.0.smithi155.stdout:6/558: fdatasync d0/df/d5e/d5b/f76 0 2023-12-16T05:56:31.969 INFO:tasks.workunit.client.0.smithi155.stdout:6/559: fsync d0/df/d43/f70 0 2023-12-16T05:56:31.969 INFO:tasks.workunit.client.1.smithi156.stdout:3/84: symlink dc/df/l1c 0 2023-12-16T05:56:31.969 INFO:tasks.workunit.client.0.smithi155.stdout:5/467: rename d0/d2/d2a/d3c to d0/d2/d2a/d30/d53/d7b/d99 0 2023-12-16T05:56:31.970 INFO:tasks.workunit.client.1.smithi156.stdout:3/85: mkdir dc/d10/d1d 0 2023-12-16T05:56:31.971 INFO:tasks.workunit.client.0.smithi155.stdout:9/502: dwrite da/d15/d17/d36/f4d [0,4194304] 0 2023-12-16T05:56:31.971 INFO:tasks.workunit.client.0.smithi155.stdout:9/503: fsync da/d15/d17/d24/d62/f68 0 2023-12-16T05:56:31.971 INFO:tasks.workunit.client.1.smithi156.stdout:3/86: write dc/f19 [3186661,55294] 0 2023-12-16T05:56:31.972 INFO:tasks.workunit.client.0.smithi155.stdout:6/560: dread d0/df/d5e/d46/f65 [0,4194304] 0 2023-12-16T05:56:31.972 INFO:tasks.workunit.client.0.smithi155.stdout:6/561: stat d0/d3/d2c/d3e/d4c/f33 0 2023-12-16T05:56:31.972 INFO:tasks.workunit.client.0.smithi155.stdout:2/373: link d0/d7/f73 d0/d5/d6/f82 0 2023-12-16T05:56:31.973 INFO:tasks.workunit.client.1.smithi156.stdout:3/87: symlink dc/d10/l1e 0 2023-12-16T05:56:31.973 INFO:tasks.workunit.client.0.smithi155.stdout:1/484: creat d1/d7/d4b/d72/d79/f9d x:0 0 0 2023-12-16T05:56:31.975 INFO:tasks.workunit.client.0.smithi155.stdout:8/405: dread d4/f41 [0,4194304] 0 2023-12-16T05:56:31.976 INFO:tasks.workunit.client.0.smithi155.stdout:5/468: symlink d0/d2/d2a/d19/d88/l9a 0 2023-12-16T05:56:31.976 INFO:tasks.workunit.client.0.smithi155.stdout:5/469: chown d0/d2/f6e 138 1 2023-12-16T05:56:31.977 INFO:tasks.workunit.client.0.smithi155.stdout:9/504: unlink da/d15/d17/c27 0 2023-12-16T05:56:31.979 INFO:tasks.workunit.client.0.smithi155.stdout:4/393: dwrite d0/d10/f3b [0,4194304] 0 2023-12-16T05:56:31.980 INFO:tasks.workunit.client.0.smithi155.stdout:8/406: rename d4/da/d1b/l2f to d4/d62/d66/l7b 0 2023-12-16T05:56:31.980 INFO:tasks.workunit.client.0.smithi155.stdout:3/317: sync 2023-12-16T05:56:31.985 INFO:tasks.workunit.client.1.smithi156.stdout:7/189: dwrite f7 [0,4194304] 0 2023-12-16T05:56:31.985 INFO:tasks.workunit.client.1.smithi156.stdout:7/190: read - d1e/d1f/d22/d2c/d2e/f38 zero size 2023-12-16T05:56:31.990 INFO:tasks.workunit.client.1.smithi156.stdout:7/191: rmdir d1e/d1f/d22/d2c 39 2023-12-16T05:56:31.990 INFO:tasks.workunit.client.1.smithi156.stdout:7/192: fdatasync d1e/f24 0 2023-12-16T05:56:31.990 INFO:tasks.workunit.client.0.smithi155.stdout:4/394: mknod d0/d10/d46/d16/d30/d52/d54/c79 0 2023-12-16T05:56:31.990 INFO:tasks.workunit.client.0.smithi155.stdout:8/407: creat d4/da/d1b/f7c x:0 0 0 2023-12-16T05:56:31.991 INFO:tasks.workunit.client.0.smithi155.stdout:2/374: write d0/d7/d1f/d74/f36 [1552326,54430] 0 2023-12-16T05:56:31.991 INFO:tasks.workunit.client.0.smithi155.stdout:3/318: symlink d0/d14/d36/d47/d5f/l62 0 2023-12-16T05:56:31.991 INFO:tasks.workunit.client.0.smithi155.stdout:3/319: chown d0/c7 48631 1 2023-12-16T05:56:31.992 INFO:tasks.workunit.client.1.smithi156.stdout:7/193: getdents d1e/d1f/d22 0 2023-12-16T05:56:31.992 INFO:tasks.workunit.client.1.smithi156.stdout:7/194: chown cf 2117 1 2023-12-16T05:56:31.993 INFO:tasks.workunit.client.0.smithi155.stdout:0/367: rename d7/df/d69 to d7/df/d6f 0 2023-12-16T05:56:31.993 INFO:tasks.workunit.client.0.smithi155.stdout:0/368: chown d7/d47/d5d 4098 1 2023-12-16T05:56:31.994 INFO:tasks.workunit.client.0.smithi155.stdout:4/395: getdents d0/da/d36/d5f/d75/d3d 0 2023-12-16T05:56:31.995 INFO:tasks.workunit.client.0.smithi155.stdout:5/470: dread d0/d2/d2a/d30/d53/d7b/d99/f5d [0,4194304] 0 2023-12-16T05:56:31.998 INFO:tasks.workunit.client.0.smithi155.stdout:2/375: rename d0/d7/d57/f5b to d0/d5/d6/f83 0 2023-12-16T05:56:31.998 INFO:tasks.workunit.client.0.smithi155.stdout:2/376: fdatasync d0/d7/d1f/d74/d3a/f7a 0 2023-12-16T05:56:32.005 INFO:tasks.workunit.client.0.smithi155.stdout:3/320: truncate d0/d1e/f20 3699750 0 2023-12-16T05:56:32.005 INFO:tasks.workunit.client.0.smithi155.stdout:3/321: truncate d0/d1e/f59 133794 0 2023-12-16T05:56:32.006 INFO:tasks.workunit.client.0.smithi155.stdout:8/408: dread d4/da/d12/f2e [0,4194304] 0 2023-12-16T05:56:32.007 INFO:tasks.workunit.client.0.smithi155.stdout:4/396: write d0/da/d36/d5f/d75/d3d/f4d [253371,33547] 0 2023-12-16T05:56:32.009 INFO:tasks.workunit.client.0.smithi155.stdout:3/322: rmdir d0/d14/d45 39 2023-12-16T05:56:32.009 INFO:tasks.workunit.client.0.smithi155.stdout:8/409: mkdir d4/da/d1b/d1c/d19/d7d 0 2023-12-16T05:56:32.009 INFO:tasks.workunit.client.0.smithi155.stdout:8/410: chown d4/da/d1b/d2a/f39 3658 1 2023-12-16T05:56:32.010 INFO:tasks.workunit.client.1.smithi156.stdout:3/88: dwrite dc/d10/f18 [0,4194304] 0 2023-12-16T05:56:32.010 INFO:tasks.workunit.client.1.smithi156.stdout:3/89: mkdir dc/d10/d1d/d1f 0 2023-12-16T05:56:32.010 INFO:tasks.workunit.client.1.smithi156.stdout:3/90: link dc/l1b dc/d10/d1d/l20 0 2023-12-16T05:56:32.012 INFO:tasks.workunit.client.0.smithi155.stdout:2/377: dread d0/f32 [0,4194304] 0 2023-12-16T05:56:32.012 INFO:tasks.workunit.client.1.smithi156.stdout:3/91: symlink dc/l21 0 2023-12-16T05:56:32.012 INFO:tasks.workunit.client.1.smithi156.stdout:2/132: dwrite d9/dd/f19 [0,4194304] 0 2023-12-16T05:56:32.012 INFO:tasks.workunit.client.1.smithi156.stdout:2/133: fdatasync d9/f22 0 2023-12-16T05:56:32.012 INFO:tasks.workunit.client.1.smithi156.stdout:2/134: write d9/f1f [387301,127158] 0 2023-12-16T05:56:32.012 INFO:tasks.workunit.client.1.smithi156.stdout:2/135: chown d9/d12 11 1 2023-12-16T05:56:32.013 INFO:tasks.workunit.client.1.smithi156.stdout:2/136: truncate d9/dd/f19 5167324 0 2023-12-16T05:56:32.013 INFO:tasks.workunit.client.1.smithi156.stdout:2/137: getdents d9/dc/d1c 0 2023-12-16T05:56:32.014 INFO:tasks.workunit.client.0.smithi155.stdout:2/378: unlink d0/d7/f24 0 2023-12-16T05:56:32.018 INFO:tasks.workunit.client.0.smithi155.stdout:6/562: dwrite d0/d3/d2c/f4f [0,4194304] 0 2023-12-16T05:56:32.018 INFO:tasks.workunit.client.1.smithi156.stdout:2/138: rmdir d9/dc/d1c 0 2023-12-16T05:56:32.019 INFO:tasks.workunit.client.1.smithi156.stdout:2/139: dread d9/dd/f19 [4194304,4194304] 0 2023-12-16T05:56:32.019 INFO:tasks.workunit.client.1.smithi156.stdout:2/140: chown d9/dc/c2a 30141 1 2023-12-16T05:56:32.019 INFO:tasks.workunit.client.1.smithi156.stdout:2/141: dread - d9/dd/d17/f2b zero size 2023-12-16T05:56:32.020 INFO:tasks.workunit.client.0.smithi155.stdout:6/563: rename d0/d3/d7a/f82 to d0/d3/fb1 0 2023-12-16T05:56:32.021 INFO:tasks.workunit.client.1.smithi156.stdout:2/142: getdents d9/dd 0 2023-12-16T05:56:32.021 INFO:tasks.workunit.client.0.smithi155.stdout:9/505: dwrite da/f13 [4194304,4194304] 0 2023-12-16T05:56:32.022 INFO:tasks.workunit.client.1.smithi156.stdout:7/195: dwrite f9 [0,4194304] 0 2023-12-16T05:56:32.022 INFO:tasks.workunit.client.0.smithi155.stdout:0/369: dwrite d7/d13/f17 [4194304,4194304] 0 2023-12-16T05:56:32.023 INFO:tasks.workunit.client.0.smithi155.stdout:5/471: dwrite d0/d2/d2a/f7f [0,4194304] 0 2023-12-16T05:56:32.023 INFO:tasks.workunit.client.1.smithi156.stdout:7/196: symlink d1e/d1f/d22/l3c 0 2023-12-16T05:56:32.023 INFO:tasks.workunit.client.0.smithi155.stdout:6/564: write d0/d3/d7a/f73 [6826084,7685] 0 2023-12-16T05:56:32.024 INFO:tasks.workunit.client.1.smithi156.stdout:7/197: creat d1e/d1f/d22/d2c/d33/f3d x:0 0 0 2023-12-16T05:56:32.024 INFO:tasks.workunit.client.1.smithi156.stdout:7/198: write d1e/d1f/f3a [651225,27257] 0 2023-12-16T05:56:32.024 INFO:tasks.workunit.client.1.smithi156.stdout:7/199: stat d1e/d1f/d22/f37 0 2023-12-16T05:56:32.024 INFO:tasks.workunit.client.1.smithi156.stdout:7/200: write d1e/f27 [1064203,63945] 0 2023-12-16T05:56:32.025 INFO:tasks.workunit.client.0.smithi155.stdout:1/485: dwrite d1/d7/d4b/d72/d79/f9d [0,4194304] 0 2023-12-16T05:56:32.025 INFO:tasks.workunit.client.0.smithi155.stdout:1/486: fsync d1/ff 0 2023-12-16T05:56:32.025 INFO:tasks.workunit.client.0.smithi155.stdout:9/506: mknod da/d15/d17/d36/d5b/d98/cb0 0 2023-12-16T05:56:32.026 INFO:tasks.workunit.client.1.smithi156.stdout:3/92: truncate f8 3887183 0 2023-12-16T05:56:32.027 INFO:tasks.workunit.client.0.smithi155.stdout:5/472: link d0/d2/d2a/d30/d53/d7b/d99/f5d d0/d2/d4f/f9b 0 2023-12-16T05:56:32.028 INFO:tasks.workunit.client.1.smithi156.stdout:3/93: mknod dc/d10/c22 0 2023-12-16T05:56:32.028 INFO:tasks.workunit.client.0.smithi155.stdout:6/565: creat d0/df/d5e/d99/fb2 x:0 0 0 2023-12-16T05:56:32.030 INFO:tasks.workunit.client.1.smithi156.stdout:2/143: dread f8 [0,4194304] 0 2023-12-16T05:56:32.031 INFO:tasks.workunit.client.1.smithi156.stdout:2/144: write d9/f27 [868301,78705] 0 2023-12-16T05:56:32.032 INFO:tasks.workunit.client.1.smithi156.stdout:2/145: rmdir d9/dd/d17 39 2023-12-16T05:56:32.032 INFO:tasks.workunit.client.1.smithi156.stdout:2/146: readlink d9/dc/lf 0 2023-12-16T05:56:32.033 INFO:tasks.workunit.client.1.smithi156.stdout:7/201: dread f7 [0,4194304] 0 2023-12-16T05:56:32.033 INFO:tasks.workunit.client.0.smithi155.stdout:1/487: creat d1/d7/f9e x:0 0 0 2023-12-16T05:56:32.034 INFO:tasks.workunit.client.0.smithi155.stdout:1/488: chown d1/d25 9731468 1 2023-12-16T05:56:32.034 INFO:tasks.workunit.client.0.smithi155.stdout:1/489: stat d1/l19 0 2023-12-16T05:56:32.034 INFO:tasks.workunit.client.0.smithi155.stdout:1/490: chown d1/d7/d16/f21 3 1 2023-12-16T05:56:32.034 INFO:tasks.workunit.client.0.smithi155.stdout:2/379: dread d0/d7/d1f/d74/f36 [0,4194304] 0 2023-12-16T05:56:32.034 INFO:tasks.workunit.client.0.smithi155.stdout:4/397: dwrite d0/da/d36/d5f/d75/d3d/d43/f4e [0,4194304] 0 2023-12-16T05:56:32.034 INFO:tasks.workunit.client.0.smithi155.stdout:1/491: write d1/d7/d16/d30/f73 [3767620,31292] 0 2023-12-16T05:56:32.035 INFO:tasks.workunit.client.0.smithi155.stdout:9/507: creat da/d15/fb1 x:0 0 0 2023-12-16T05:56:32.035 INFO:tasks.workunit.client.0.smithi155.stdout:0/370: dread d7/df/f37 [0,4194304] 0 2023-12-16T05:56:32.036 INFO:tasks.workunit.client.0.smithi155.stdout:5/473: truncate d0/d2/d2a/f4d 3796950 0 2023-12-16T05:56:32.036 INFO:tasks.workunit.client.0.smithi155.stdout:5/474: truncate d0/d2/d2a/d19/d88/f95 454930 0 2023-12-16T05:56:32.037 INFO:tasks.workunit.client.0.smithi155.stdout:6/566: fdatasync d0/d3/d2c/f30 0 2023-12-16T05:56:32.041 INFO:tasks.workunit.client.1.smithi156.stdout:7/202: mkdir d1e/d1f/d22/d2c/d33/d3e 0 2023-12-16T05:56:32.041 INFO:tasks.workunit.client.1.smithi156.stdout:7/203: chown c14 0 1 2023-12-16T05:56:32.041 INFO:tasks.workunit.client.1.smithi156.stdout:7/204: fdatasync d1e/d1f/d22/d2c/d33/f35 0 2023-12-16T05:56:32.041 INFO:tasks.workunit.client.1.smithi156.stdout:7/205: chown d1e/d1f/d22/d2c/d2e/f36 229019 1 2023-12-16T05:56:32.045 INFO:tasks.workunit.client.1.smithi156.stdout:7/206: write f7 [2239057,27298] 0 2023-12-16T05:56:32.045 INFO:tasks.workunit.client.1.smithi156.stdout:7/207: chown d1e/d1f/d22/f25 0 1 2023-12-16T05:56:32.045 INFO:tasks.workunit.client.0.smithi155.stdout:2/380: creat d0/d7/d1f/d74/d3a/f84 x:0 0 0 2023-12-16T05:56:32.046 INFO:tasks.workunit.client.0.smithi155.stdout:2/381: fsync d0/d7/f7e 0 2023-12-16T05:56:32.046 INFO:tasks.workunit.client.0.smithi155.stdout:2/382: chown d0/d7/dd/d49/d4b/l78 223801 1 2023-12-16T05:56:32.046 INFO:tasks.workunit.client.0.smithi155.stdout:2/383: dread d0/d7/dd/d62/d66/f6a [0,4194304] 0 2023-12-16T05:56:32.047 INFO:tasks.workunit.client.1.smithi156.stdout:2/147: dwrite d9/dc/fe [0,4194304] 0 2023-12-16T05:56:32.047 INFO:tasks.workunit.client.1.smithi156.stdout:2/148: chown d9/dc/f10 694269 1 2023-12-16T05:56:32.047 INFO:tasks.workunit.client.1.smithi156.stdout:2/149: chown d9/dd/l25 1 1 2023-12-16T05:56:32.047 INFO:tasks.workunit.client.1.smithi156.stdout:2/150: fsync f5 0 2023-12-16T05:56:32.047 INFO:tasks.workunit.client.1.smithi156.stdout:2/151: stat d9/dd/f19 0 2023-12-16T05:56:32.049 INFO:tasks.workunit.client.0.smithi155.stdout:1/492: rename d1/d7/d16/d30/f58 to d1/d17/d28/f9f 0 2023-12-16T05:56:32.051 INFO:tasks.workunit.client.0.smithi155.stdout:3/323: write d0/d14/f18 [2601390,41907] 0 2023-12-16T05:56:32.052 INFO:tasks.workunit.client.0.smithi155.stdout:9/508: creat da/d15/d17/d24/d26/d2e/d83/d8f/fb2 x:0 0 0 2023-12-16T05:56:32.055 INFO:tasks.workunit.client.0.smithi155.stdout:0/371: creat d7/d13/d45/d4b/f70 x:0 0 0 2023-12-16T05:56:32.056 INFO:tasks.workunit.client.0.smithi155.stdout:2/384: dread d0/d7/dd/f39 [0,4194304] 0 2023-12-16T05:56:32.056 INFO:tasks.workunit.client.1.smithi156.stdout:2/152: dread d9/d12/f23 [0,4194304] 0 2023-12-16T05:56:32.057 INFO:tasks.workunit.client.1.smithi156.stdout:2/153: creat d9/dc/f2c x:0 0 0 2023-12-16T05:56:32.057 INFO:tasks.workunit.client.1.smithi156.stdout:2/154: chown d9/dc/fe 665734 1 2023-12-16T05:56:32.058 INFO:tasks.workunit.client.0.smithi155.stdout:5/475: mkdir d0/d60/d79/d97/d9c 0 2023-12-16T05:56:32.059 INFO:tasks.workunit.client.0.smithi155.stdout:1/493: write d1/d7/d4b/f6d [2560701,14306] 0 2023-12-16T05:56:32.060 INFO:tasks.workunit.client.0.smithi155.stdout:3/324: dread d0/f30 [0,4194304] 0 2023-12-16T05:56:32.061 INFO:tasks.workunit.client.0.smithi155.stdout:6/567: rmdir d0/df/d5e/d7e/da8 0 2023-12-16T05:56:32.064 INFO:tasks.workunit.client.0.smithi155.stdout:3/325: dread d0/f30 [0,4194304] 0 2023-12-16T05:56:32.065 INFO:tasks.workunit.client.0.smithi155.stdout:2/385: getdents d0/d7/d1f 0 2023-12-16T05:56:32.065 INFO:tasks.workunit.client.0.smithi155.stdout:2/386: chown d0/d7/dd/d14/f19 466908832 1 2023-12-16T05:56:32.068 INFO:tasks.workunit.client.0.smithi155.stdout:5/476: unlink d0/d2/d2a/d30/d53/d7b/d99/l7a 0 2023-12-16T05:56:32.071 INFO:tasks.workunit.client.0.smithi155.stdout:5/477: dread d0/d2/d2a/d30/d53/d7b/d99/d47/f6b [0,4194304] 0 2023-12-16T05:56:32.071 INFO:tasks.workunit.client.0.smithi155.stdout:5/478: dread - d0/d2/d2a/d30/f75 zero size 2023-12-16T05:56:32.071 INFO:tasks.workunit.client.1.smithi156.stdout:2/155: dread d9/fb [0,4194304] 0 2023-12-16T05:56:32.072 INFO:tasks.workunit.client.1.smithi156.stdout:3/94: dwrite f8 [0,4194304] 0 2023-12-16T05:56:32.072 INFO:tasks.workunit.client.1.smithi156.stdout:2/156: creat d9/f2d x:0 0 0 2023-12-16T05:56:32.072 INFO:tasks.workunit.client.0.smithi155.stdout:1/494: creat d1/d7/fa0 x:0 0 0 2023-12-16T05:56:32.072 INFO:tasks.workunit.client.0.smithi155.stdout:1/495: write d1/d7/f95 [1001128,76338] 0 2023-12-16T05:56:32.075 INFO:tasks.workunit.client.1.smithi156.stdout:7/208: dwrite d1e/d1f/d22/d2c/d2e/f36 [0,4194304] 0 2023-12-16T05:56:32.076 INFO:tasks.workunit.client.0.smithi155.stdout:6/568: getdents d0/d3 0 2023-12-16T05:56:32.076 INFO:tasks.workunit.client.0.smithi155.stdout:6/569: rename d0/d3/d2c/d8b to d0/d3/d2c/d8b/d85/da4/db3 22 2023-12-16T05:56:32.076 INFO:tasks.workunit.client.0.smithi155.stdout:9/509: symlink da/d15/d17/d24/d26/d2e/lb3 0 2023-12-16T05:56:32.076 INFO:tasks.workunit.client.0.smithi155.stdout:3/326: dread d0/d1e/f2b [0,4194304] 0 2023-12-16T05:56:32.077 INFO:tasks.workunit.client.0.smithi155.stdout:6/570: write d0/f16 [4148890,18892] 0 2023-12-16T05:56:32.078 INFO:tasks.workunit.client.1.smithi156.stdout:7/209: creat d1e/d39/f3f x:0 0 0 2023-12-16T05:56:32.078 INFO:tasks.workunit.client.0.smithi155.stdout:0/372: creat d7/df/d41/d23/d44/d4d/f71 x:0 0 0 2023-12-16T05:56:32.079 INFO:tasks.workunit.client.0.smithi155.stdout:2/387: truncate d0/d7/dd/f3e 3821547 0 2023-12-16T05:56:32.079 INFO:tasks.workunit.client.0.smithi155.stdout:2/388: dread - d0/d34/f5a zero size 2023-12-16T05:56:32.080 INFO:tasks.workunit.client.1.smithi156.stdout:7/210: mknod d1e/d1f/d22/d2c/d2e/c40 0 2023-12-16T05:56:32.080 INFO:tasks.workunit.client.1.smithi156.stdout:7/211: fsync d1e/f21 0 2023-12-16T05:56:32.080 INFO:tasks.workunit.client.1.smithi156.stdout:7/212: readlink d1e/d1f/l30 0 2023-12-16T05:56:32.080 INFO:tasks.workunit.client.0.smithi155.stdout:3/327: dread d0/f30 [0,4194304] 0 2023-12-16T05:56:32.082 INFO:tasks.workunit.client.0.smithi155.stdout:5/479: rmdir d0/d60/d79/d8e/d93 0 2023-12-16T05:56:32.084 INFO:tasks.workunit.client.0.smithi155.stdout:6/571: write d0/df/d5e/f48 [430139,81680] 0 2023-12-16T05:56:32.090 INFO:tasks.workunit.client.1.smithi156.stdout:0/163: sync 2023-12-16T05:56:32.090 INFO:tasks.workunit.client.1.smithi156.stdout:1/57: sync 2023-12-16T05:56:32.090 INFO:tasks.workunit.client.1.smithi156.stdout:9/117: sync 2023-12-16T05:56:32.090 INFO:tasks.workunit.client.1.smithi156.stdout:1/58: chown f0 74165756 1 2023-12-16T05:56:32.090 INFO:tasks.workunit.client.1.smithi156.stdout:1/59: stat d3/cd 0 2023-12-16T05:56:32.091 INFO:tasks.workunit.client.1.smithi156.stdout:9/118: write d6/f14 [902676,64106] 0 2023-12-16T05:56:32.091 INFO:tasks.workunit.client.1.smithi156.stdout:9/119: chown d6/d19/f1f 127211193 1 2023-12-16T05:56:32.091 INFO:tasks.workunit.client.1.smithi156.stdout:1/60: getdents d3 0 2023-12-16T05:56:32.093 INFO:tasks.workunit.client.1.smithi156.stdout:9/120: mkdir d6/d19/d30 0 2023-12-16T05:56:32.094 INFO:tasks.workunit.client.1.smithi156.stdout:1/61: truncate d3/fb 26207 0 2023-12-16T05:56:32.094 INFO:tasks.workunit.client.1.smithi156.stdout:1/62: dread - d3/f6 zero size 2023-12-16T05:56:32.094 INFO:tasks.workunit.client.0.smithi155.stdout:1/496: unlink d1/d25/l49 0 2023-12-16T05:56:32.096 INFO:tasks.workunit.client.1.smithi156.stdout:9/121: creat d6/d19/d25/f31 x:0 0 0 2023-12-16T05:56:32.100 INFO:tasks.workunit.client.1.smithi156.stdout:1/63: write d3/f5 [1265764,96269] 0 2023-12-16T05:56:32.106 INFO:tasks.workunit.client.0.smithi155.stdout:2/389: mkdir d0/d7/d1f/d74/d85 0 2023-12-16T05:56:32.106 INFO:tasks.workunit.client.0.smithi155.stdout:2/390: chown d0/d7/f41 14130039 1 2023-12-16T05:56:32.108 INFO:tasks.workunit.client.0.smithi155.stdout:5/480: dread d0/d2/d4f/f96 [0,4194304] 0 2023-12-16T05:56:32.110 INFO:tasks.workunit.client.0.smithi155.stdout:6/572: mknod d0/d3/d2c/d8b/d85/cb4 0 2023-12-16T05:56:32.111 INFO:tasks.workunit.client.0.smithi155.stdout:1/497: creat d1/d25/d43/d5d/d5e/fa1 x:0 0 0 2023-12-16T05:56:32.111 INFO:tasks.workunit.client.0.smithi155.stdout:1/498: readlink d1/l23 0 2023-12-16T05:56:32.111 INFO:tasks.workunit.client.0.smithi155.stdout:2/391: mknod d0/d7/d1f/d74/d85/c86 0 2023-12-16T05:56:32.112 INFO:tasks.workunit.client.0.smithi155.stdout:5/481: mkdir d0/d2/d2a/d30/d53/d7b/d99/d47/d9d 0 2023-12-16T05:56:32.112 INFO:tasks.workunit.client.0.smithi155.stdout:5/482: truncate d0/d2/d2a/d19/f4c 4846299 0 2023-12-16T05:56:32.113 INFO:tasks.workunit.client.0.smithi155.stdout:6/573: mknod d0/df/cb5 0 2023-12-16T05:56:32.113 INFO:tasks.workunit.client.0.smithi155.stdout:6/574: write d0/d3/f38 [4592955,70661] 0 2023-12-16T05:56:32.113 INFO:tasks.workunit.client.0.smithi155.stdout:1/499: mknod d1/d25/ca2 0 2023-12-16T05:56:32.115 INFO:tasks.workunit.client.0.smithi155.stdout:2/392: rename d0/d7/d69/f65 to d0/d7/d69/f87 0 2023-12-16T05:56:32.116 INFO:tasks.workunit.client.0.smithi155.stdout:2/393: stat d0/d5/d6/f7c 0 2023-12-16T05:56:32.116 INFO:tasks.workunit.client.0.smithi155.stdout:5/483: mknod d0/d60/d79/d97/c9e 0 2023-12-16T05:56:32.117 INFO:tasks.workunit.client.0.smithi155.stdout:6/575: mkdir d0/df/d5e/d7e/db6 0 2023-12-16T05:56:32.119 INFO:tasks.workunit.client.0.smithi155.stdout:1/500: creat d1/d17/d28/d74/fa3 x:0 0 0 2023-12-16T05:56:32.119 INFO:tasks.workunit.client.0.smithi155.stdout:5/484: write d0/d2/d2a/d19/d21/f36 [177416,9614] 0 2023-12-16T05:56:32.121 INFO:tasks.workunit.client.0.smithi155.stdout:5/485: read d0/d2/d2a/d19/d21/f6a [977830,94913] 0 2023-12-16T05:56:32.121 INFO:tasks.workunit.client.0.smithi155.stdout:5/486: chown d0/d2/d2a/d30/d53/d7b/d99/d47/c54 0 1 2023-12-16T05:56:32.126 INFO:tasks.workunit.client.0.smithi155.stdout:5/487: getdents d0/d2/d4f 0 2023-12-16T05:56:32.126 INFO:tasks.workunit.client.0.smithi155.stdout:5/488: truncate d0/d2/d2a/d19/d21/f6a 5142923 0 2023-12-16T05:56:32.130 INFO:tasks.workunit.client.0.smithi155.stdout:1/501: dread d1/d7/d16/d30/f62 [0,4194304] 0 2023-12-16T05:56:32.131 INFO:tasks.workunit.client.0.smithi155.stdout:1/502: write d1/d69/f8a [935776,111552] 0 2023-12-16T05:56:32.136 INFO:tasks.workunit.client.1.smithi156.stdout:2/157: dwrite d9/f22 [0,4194304] 0 2023-12-16T05:56:32.136 INFO:tasks.workunit.client.1.smithi156.stdout:2/158: readlink l6 0 2023-12-16T05:56:32.137 INFO:tasks.workunit.client.1.smithi156.stdout:2/159: write d9/dd/f1b [62,20199] 0 2023-12-16T05:56:32.137 INFO:tasks.workunit.client.1.smithi156.stdout:2/160: stat d9/dc/lf 0 2023-12-16T05:56:32.139 INFO:tasks.workunit.client.1.smithi156.stdout:2/161: mknod d9/d12/c2e 0 2023-12-16T05:56:32.139 INFO:tasks.workunit.client.1.smithi156.stdout:2/162: readlink l6 0 2023-12-16T05:56:32.141 INFO:tasks.workunit.client.1.smithi156.stdout:3/95: dwrite dc/f14 [0,4194304] 0 2023-12-16T05:56:32.141 INFO:tasks.workunit.client.0.smithi155.stdout:0/373: dwrite d7/d13/d45/d4b/f60 [0,4194304] 0 2023-12-16T05:56:32.141 INFO:tasks.workunit.client.0.smithi155.stdout:0/374: write d7/d2d/f2f [870639,129965] 0 2023-12-16T05:56:32.142 INFO:tasks.workunit.client.0.smithi155.stdout:0/375: symlink d7/d13/d45/d3e/l72 0 2023-12-16T05:56:32.142 INFO:tasks.workunit.client.1.smithi156.stdout:2/163: rename d9/dc/fe to d9/dd/f2f 0 2023-12-16T05:56:32.143 INFO:tasks.workunit.client.0.smithi155.stdout:0/376: mkdir d7/df/d73 0 2023-12-16T05:56:32.144 INFO:tasks.workunit.client.0.smithi155.stdout:0/377: creat d7/d47/d5d/f74 x:0 0 0 2023-12-16T05:56:32.145 INFO:tasks.workunit.client.0.smithi155.stdout:0/378: mknod d7/df/c75 0 2023-12-16T05:56:32.146 INFO:tasks.workunit.client.0.smithi155.stdout:0/379: unlink d7/df/d41/d23/d44/d4d/f71 0 2023-12-16T05:56:32.147 INFO:tasks.workunit.client.1.smithi156.stdout:2/164: symlink d9/dd/l30 0 2023-12-16T05:56:32.147 INFO:tasks.workunit.client.1.smithi156.stdout:3/96: dread dc/d10/f11 [0,4194304] 0 2023-12-16T05:56:32.148 INFO:tasks.workunit.client.0.smithi155.stdout:0/380: mknod d7/df/d41/d23/d44/c76 0 2023-12-16T05:56:32.148 INFO:tasks.workunit.client.0.smithi155.stdout:0/381: truncate d7/df/f26 4579979 0 2023-12-16T05:56:32.148 INFO:tasks.workunit.client.0.smithi155.stdout:6/576: dwrite d0/d3/d2c/d3e/d4c/d1b/f21 [0,4194304] 0 2023-12-16T05:56:32.148 INFO:tasks.workunit.client.1.smithi156.stdout:2/165: symlink d9/d12/l31 0 2023-12-16T05:56:32.148 INFO:tasks.workunit.client.1.smithi156.stdout:7/213: dwrite f4 [4194304,4194304] 0 2023-12-16T05:56:32.149 INFO:tasks.workunit.client.1.smithi156.stdout:3/97: creat dc/f23 x:0 0 0 2023-12-16T05:56:32.149 INFO:tasks.workunit.client.1.smithi156.stdout:7/214: dread d1e/f21 [0,4194304] 0 2023-12-16T05:56:32.150 INFO:tasks.workunit.client.0.smithi155.stdout:3/328: dwrite d0/d14/f5e [0,4194304] 0 2023-12-16T05:56:32.150 INFO:tasks.workunit.client.0.smithi155.stdout:3/329: stat d0/l5 0 2023-12-16T05:56:32.150 INFO:tasks.workunit.client.0.smithi155.stdout:0/382: creat d7/df/d41/f77 x:0 0 0 2023-12-16T05:56:32.150 INFO:tasks.workunit.client.0.smithi155.stdout:0/383: chown d7/d13 1308 1 2023-12-16T05:56:32.150 INFO:tasks.workunit.client.0.smithi155.stdout:0/384: dread - d7/df/d41/d23/d44/f63 zero size 2023-12-16T05:56:32.150 INFO:tasks.workunit.client.1.smithi156.stdout:2/166: symlink d9/dc/l32 0 2023-12-16T05:56:32.152 INFO:tasks.workunit.client.1.smithi156.stdout:3/98: getdents dc/d10/d1d 0 2023-12-16T05:56:32.153 INFO:tasks.workunit.client.0.smithi155.stdout:6/577: read d0/d3/d2c/f30 [5488682,101048] 0 2023-12-16T05:56:32.153 INFO:tasks.workunit.client.0.smithi155.stdout:1/503: dwrite d1/d7/f75 [0,4194304] 0 2023-12-16T05:56:32.154 INFO:tasks.workunit.client.1.smithi156.stdout:7/215: mknod d1e/d1f/d22/d2c/d2e/c41 0 2023-12-16T05:56:32.154 INFO:tasks.workunit.client.1.smithi156.stdout:7/216: dread - d1e/d39/f3f zero size 2023-12-16T05:56:32.154 INFO:tasks.workunit.client.1.smithi156.stdout:7/217: chown d1e/f24 511 1 2023-12-16T05:56:32.154 INFO:tasks.workunit.client.1.smithi156.stdout:9/122: dwrite d6/d19/f2a [4194304,4194304] 0 2023-12-16T05:56:32.155 INFO:tasks.workunit.client.0.smithi155.stdout:3/330: unlink d0/d1a/l40 0 2023-12-16T05:56:32.156 INFO:tasks.workunit.client.1.smithi156.stdout:3/99: rename f7 to dc/d10/f24 0 2023-12-16T05:56:32.158 INFO:tasks.workunit.client.1.smithi156.stdout:7/218: mknod d1e/d1f/d22/c42 0 2023-12-16T05:56:32.158 INFO:tasks.workunit.client.1.smithi156.stdout:9/123: dread - d6/d19/f24 zero size 2023-12-16T05:56:32.159 INFO:tasks.workunit.client.0.smithi155.stdout:6/578: read d0/d3/d2c/d3e/d4c/f51 [249198,39345] 0 2023-12-16T05:56:32.160 INFO:tasks.workunit.client.1.smithi156.stdout:3/100: creat dc/f25 x:0 0 0 2023-12-16T05:56:32.160 INFO:tasks.workunit.client.1.smithi156.stdout:9/124: dread - d6/d19/f1b zero size 2023-12-16T05:56:32.160 INFO:tasks.workunit.client.1.smithi156.stdout:1/64: dwrite d3/f6 [0,4194304] 0 2023-12-16T05:56:32.160 INFO:tasks.workunit.client.0.smithi155.stdout:0/385: symlink d7/d47/l78 0 2023-12-16T05:56:32.161 INFO:tasks.workunit.client.1.smithi156.stdout:7/219: write f9 [740677,92225] 0 2023-12-16T05:56:32.161 INFO:tasks.workunit.client.1.smithi156.stdout:3/101: symlink dc/d10/d1d/l26 0 2023-12-16T05:56:32.162 INFO:tasks.workunit.client.0.smithi155.stdout:1/504: creat d1/d17/d28/d8f/fa4 x:0 0 0 2023-12-16T05:56:32.163 INFO:tasks.workunit.client.0.smithi155.stdout:2/394: dwrite d0/f30 [0,4194304] 0 2023-12-16T05:56:32.163 INFO:tasks.workunit.client.0.smithi155.stdout:2/395: dread - d0/d34/f5a zero size 2023-12-16T05:56:32.164 INFO:tasks.workunit.client.1.smithi156.stdout:7/220: mknod d1e/d1f/c43 0 2023-12-16T05:56:32.164 INFO:tasks.workunit.client.0.smithi155.stdout:0/386: unlink d7/d13/d45/d3e/l43 0 2023-12-16T05:56:32.165 INFO:tasks.workunit.client.1.smithi156.stdout:3/102: mknod dc/d10/c27 0 2023-12-16T05:56:32.168 INFO:tasks.workunit.client.1.smithi156.stdout:1/65: truncate d3/f5 217990 0 2023-12-16T05:56:32.169 INFO:tasks.workunit.client.1.smithi156.stdout:7/221: symlink d1e/d1f/l44 0 2023-12-16T05:56:32.169 INFO:tasks.workunit.client.0.smithi155.stdout:5/489: truncate d0/d2/d2a/f7f 1671382 0 2023-12-16T05:56:32.169 INFO:tasks.workunit.client.0.smithi155.stdout:5/490: fdatasync d0/d2/d2a/f2e 0 2023-12-16T05:56:32.170 INFO:tasks.workunit.client.0.smithi155.stdout:2/396: unlink d0/f32 0 2023-12-16T05:56:32.170 INFO:tasks.workunit.client.1.smithi156.stdout:7/222: write d1e/f21 [61363,79654] 0 2023-12-16T05:56:32.170 INFO:tasks.workunit.client.1.smithi156.stdout:1/66: symlink d3/l13 0 2023-12-16T05:56:32.173 INFO:tasks.workunit.client.1.smithi156.stdout:7/223: creat d1e/d1f/d22/d2c/f45 x:0 0 0 2023-12-16T05:56:32.173 INFO:tasks.workunit.client.1.smithi156.stdout:7/224: write d1e/f27 [1699992,83027] 0 2023-12-16T05:56:32.173 INFO:tasks.workunit.client.0.smithi155.stdout:1/505: write d1/d7/d4b/d5c/f88 [3935786,67153] 0 2023-12-16T05:56:32.175 INFO:tasks.workunit.client.1.smithi156.stdout:7/225: symlink d1e/d1f/d22/d2c/d2e/l46 0 2023-12-16T05:56:32.175 INFO:tasks.workunit.client.0.smithi155.stdout:2/397: mkdir d0/d7/d1f/d74/d85/d88 0 2023-12-16T05:56:32.175 INFO:tasks.workunit.client.0.smithi155.stdout:2/398: chown d0/d34/d3c/l53 691 1 2023-12-16T05:56:32.176 INFO:tasks.workunit.client.1.smithi156.stdout:9/125: write d6/d19/f2a [8180761,93117] 0 2023-12-16T05:56:32.176 INFO:tasks.workunit.client.1.smithi156.stdout:3/103: dread fb [0,4194304] 0 2023-12-16T05:56:32.176 INFO:tasks.workunit.client.1.smithi156.stdout:2/167: dwrite d9/f27 [0,4194304] 0 2023-12-16T05:56:32.176 INFO:tasks.workunit.client.1.smithi156.stdout:2/168: chown d9/d12/f23 2192 1 2023-12-16T05:56:32.178 INFO:tasks.workunit.client.1.smithi156.stdout:7/226: mknod d1e/d1f/d22/d2c/c47 0 2023-12-16T05:56:32.178 INFO:tasks.workunit.client.0.smithi155.stdout:1/506: creat d1/d17/fa5 x:0 0 0 2023-12-16T05:56:32.179 INFO:tasks.workunit.client.0.smithi155.stdout:2/399: creat d0/d7/d1f/d74/d85/d88/f89 x:0 0 0 2023-12-16T05:56:32.180 INFO:tasks.workunit.client.0.smithi155.stdout:2/400: dread - d0/d7/f73 zero size 2023-12-16T05:56:32.180 INFO:tasks.workunit.client.1.smithi156.stdout:3/104: rmdir dc/d10/d1d 39 2023-12-16T05:56:32.182 INFO:tasks.workunit.client.0.smithi155.stdout:2/401: mkdir d0/d5/d8a 0 2023-12-16T05:56:32.182 INFO:tasks.workunit.client.0.smithi155.stdout:2/402: readlink d0/d5/d6/d5f/l7d 0 2023-12-16T05:56:32.182 INFO:tasks.workunit.client.0.smithi155.stdout:2/403: fsync d0/d5/d6/f1c 0 2023-12-16T05:56:32.182 INFO:tasks.workunit.client.1.smithi156.stdout:3/105: write dc/d10/f18 [205413,44240] 0 2023-12-16T05:56:32.182 INFO:tasks.workunit.client.1.smithi156.stdout:3/106: chown dc/df/l16 9685 1 2023-12-16T05:56:32.182 INFO:tasks.workunit.client.1.smithi156.stdout:3/107: chown dc/df/l1a 97394 1 2023-12-16T05:56:32.185 INFO:tasks.workunit.client.0.smithi155.stdout:0/387: dread d7/fb [0,4194304] 0 2023-12-16T05:56:32.185 INFO:tasks.workunit.client.0.smithi155.stdout:2/404: symlink d0/d5/d8a/l8b 0 2023-12-16T05:56:32.185 INFO:tasks.workunit.client.0.smithi155.stdout:2/405: fdatasync d0/d7/d1f/d74/f36 0 2023-12-16T05:56:32.185 INFO:tasks.workunit.client.0.smithi155.stdout:2/406: fsync d0/d7/f5e 0 2023-12-16T05:56:32.185 INFO:tasks.workunit.client.1.smithi156.stdout:2/169: truncate d9/fb 790840 0 2023-12-16T05:56:32.185 INFO:tasks.workunit.client.1.smithi156.stdout:2/170: readlink l6 0 2023-12-16T05:56:32.185 INFO:tasks.workunit.client.1.smithi156.stdout:2/171: dread - d9/f2d zero size 2023-12-16T05:56:32.192 INFO:tasks.workunit.client.1.smithi156.stdout:3/108: rename dc/d10/c27 to dc/df/c28 0 2023-12-16T05:56:32.192 INFO:tasks.workunit.client.1.smithi156.stdout:3/109: fsync dc/f19 0 2023-12-16T05:56:32.193 INFO:tasks.workunit.client.1.smithi156.stdout:7/227: truncate f4 7671235 0 2023-12-16T05:56:32.193 INFO:tasks.workunit.client.0.smithi155.stdout:5/491: dwrite d0/d2/d2a/d30/d53/d7b/d99/d47/f73 [0,4194304] 0 2023-12-16T05:56:32.193 INFO:tasks.workunit.client.0.smithi155.stdout:2/407: mkdir d0/d7/dd/d49/d4b/d8c 0 2023-12-16T05:56:32.195 INFO:tasks.workunit.client.0.smithi155.stdout:6/579: dwrite d0/d3/d2c/fa0 [0,4194304] 0 2023-12-16T05:56:32.196 INFO:tasks.workunit.client.0.smithi155.stdout:5/492: rmdir d0/d2/d2a/d30/d53/d7b/d99 39 2023-12-16T05:56:32.197 INFO:tasks.workunit.client.0.smithi155.stdout:2/408: truncate d0/f3d 4064259 0 2023-12-16T05:56:32.197 INFO:tasks.workunit.client.0.smithi155.stdout:2/409: chown d0/d7/dd/d49/d4b/d8c 106 1 2023-12-16T05:56:32.198 INFO:tasks.workunit.client.1.smithi156.stdout:2/172: rename d9/dc to d9/dd/d17/d33 0 2023-12-16T05:56:32.200 INFO:tasks.workunit.client.1.smithi156.stdout:3/110: truncate dc/f14 3061439 0 2023-12-16T05:56:32.202 INFO:tasks.workunit.client.1.smithi156.stdout:2/173: dread f1 [0,4194304] 0 2023-12-16T05:56:32.202 INFO:tasks.workunit.client.1.smithi156.stdout:2/174: truncate d9/f1f 820426 0 2023-12-16T05:56:32.203 INFO:tasks.workunit.client.0.smithi155.stdout:5/493: getdents d0/d2/d2a/d19/d48 0 2023-12-16T05:56:32.203 INFO:tasks.workunit.client.1.smithi156.stdout:3/111: link dc/d10/f11 dc/d10/d1d/d1f/f29 0 2023-12-16T05:56:32.203 INFO:tasks.workunit.client.1.smithi156.stdout:3/112: chown dc/f19 0 1 2023-12-16T05:56:32.207 INFO:tasks.workunit.client.0.smithi155.stdout:5/494: mkdir d0/d2/d2a/d19/d59/d66/d9f 0 2023-12-16T05:56:32.208 INFO:tasks.workunit.client.0.smithi155.stdout:5/495: fsync d0/d2/d2a/d30/d53/d7b/f80 0 2023-12-16T05:56:32.210 INFO:tasks.workunit.client.0.smithi155.stdout:7/442: sync 2023-12-16T05:56:32.210 INFO:tasks.workunit.client.0.smithi155.stdout:7/443: chown d0/d6a/d1a/d8c/d34/d4b/f51 33 1 2023-12-16T05:56:32.213 INFO:tasks.workunit.client.0.smithi155.stdout:0/388: dwrite d7/df/f19 [4194304,4194304] 0 2023-12-16T05:56:32.216 INFO:tasks.workunit.client.1.smithi156.stdout:3/113: getdents dc/df 0 2023-12-16T05:56:32.218 INFO:tasks.workunit.client.0.smithi155.stdout:7/444: mknod d0/d6a/d1a/d22/c99 0 2023-12-16T05:56:32.219 INFO:tasks.workunit.client.1.smithi156.stdout:2/175: rmdir d9/dd/d17/d33 39 2023-12-16T05:56:32.219 INFO:tasks.workunit.client.1.smithi156.stdout:2/176: readlink l6 0 2023-12-16T05:56:32.221 INFO:tasks.workunit.client.0.smithi155.stdout:6/580: dwrite d0/d3/d2c/d3e/d4c/d1b/f22 [4194304,4194304] 0 2023-12-16T05:56:32.221 INFO:tasks.workunit.client.1.smithi156.stdout:2/177: creat d9/f34 x:0 0 0 2023-12-16T05:56:32.223 INFO:tasks.workunit.client.0.smithi155.stdout:0/389: truncate d7/d13/f1b 1267204 0 2023-12-16T05:56:32.226 INFO:tasks.workunit.client.0.smithi155.stdout:6/581: rmdir d0/d3/d2c/d8b 39 2023-12-16T05:56:32.226 INFO:tasks.workunit.client.0.smithi155.stdout:7/445: unlink d0/d6a/f1c 0 2023-12-16T05:56:32.226 INFO:tasks.workunit.client.0.smithi155.stdout:7/446: fsync d0/d6a/d31/f52 0 2023-12-16T05:56:32.226 INFO:tasks.workunit.client.0.smithi155.stdout:7/447: dread - d0/d6a/d1a/d2b/d2c/d5d/f8e zero size 2023-12-16T05:56:32.227 INFO:tasks.workunit.client.0.smithi155.stdout:0/390: truncate d7/df/f58 3564367 0 2023-12-16T05:56:32.229 INFO:tasks.workunit.client.0.smithi155.stdout:7/448: link d0/d1b/d78/c95 d0/d6a/d1a/d38/d4f/c9a 0 2023-12-16T05:56:32.229 INFO:tasks.workunit.client.0.smithi155.stdout:7/449: truncate d0/d6a/d1a/d8c/d34/d4b/f51 615284 0 2023-12-16T05:56:32.231 INFO:tasks.workunit.client.0.smithi155.stdout:0/391: link d7/d13/d45/f49 d7/df/d41/d23/d44/d4d/f79 0 2023-12-16T05:56:32.234 INFO:tasks.workunit.client.0.smithi155.stdout:0/392: creat d7/df/d6f/f7a x:0 0 0 2023-12-16T05:56:32.236 INFO:tasks.workunit.client.0.smithi155.stdout:1/507: dwrite d1/d7/d4b/f6d [0,4194304] 0 2023-12-16T05:56:32.236 INFO:tasks.workunit.client.1.smithi156.stdout:7/228: dwrite d1e/d1f/d22/d2c/d2e/f36 [0,4194304] 0 2023-12-16T05:56:32.236 INFO:tasks.workunit.client.0.smithi155.stdout:0/393: getdents d7/df/d41 0 2023-12-16T05:56:32.238 INFO:tasks.workunit.client.1.smithi156.stdout:7/229: symlink d1e/d1f/d22/d2c/l48 0 2023-12-16T05:56:32.239 INFO:tasks.workunit.client.0.smithi155.stdout:1/508: creat d1/d7/d4b/d72/fa6 x:0 0 0 2023-12-16T05:56:32.239 INFO:tasks.workunit.client.0.smithi155.stdout:1/509: fsync d1/d7/d4b/f6d 0 2023-12-16T05:56:32.239 INFO:tasks.workunit.client.0.smithi155.stdout:1/510: dread - d1/d17/d28/d74/f7a zero size 2023-12-16T05:56:32.239 INFO:tasks.workunit.client.0.smithi155.stdout:1/511: fsync d1/d17/d28/d8f/f96 0 2023-12-16T05:56:32.239 INFO:tasks.workunit.client.0.smithi155.stdout:1/512: dread - d1/d7/f9e zero size 2023-12-16T05:56:32.240 INFO:tasks.workunit.client.0.smithi155.stdout:1/513: fsync d1/d7/d16/d30/f62 0 2023-12-16T05:56:32.240 INFO:tasks.workunit.client.1.smithi156.stdout:7/230: truncate d1e/f27 272219 0 2023-12-16T05:56:32.240 INFO:tasks.workunit.client.1.smithi156.stdout:7/231: stat d1e/l2b 0 2023-12-16T05:56:32.241 INFO:tasks.workunit.client.0.smithi155.stdout:1/514: stat d1/d17/c4a 0 2023-12-16T05:56:32.241 INFO:tasks.workunit.client.0.smithi155.stdout:0/394: creat d7/df/f7b x:0 0 0 2023-12-16T05:56:32.242 INFO:tasks.workunit.client.0.smithi155.stdout:1/515: write d1/d7/f5a [2814762,8148] 0 2023-12-16T05:56:32.244 INFO:tasks.workunit.client.1.smithi156.stdout:3/114: dwrite dc/d10/f18 [0,4194304] 0 2023-12-16T05:56:32.244 INFO:tasks.workunit.client.1.smithi156.stdout:3/115: fsync dc/d10/f24 0 2023-12-16T05:56:32.244 INFO:tasks.workunit.client.1.smithi156.stdout:3/116: truncate dc/f25 64216 0 2023-12-16T05:56:32.244 INFO:tasks.workunit.client.1.smithi156.stdout:9/126: dwrite f3 [0,4194304] 0 2023-12-16T05:56:32.244 INFO:tasks.workunit.client.1.smithi156.stdout:9/127: dread - d6/f28 zero size 2023-12-16T05:56:32.244 INFO:tasks.workunit.client.0.smithi155.stdout:5/496: dwrite d0/d2/d2a/d19/f20 [0,4194304] 0 2023-12-16T05:56:32.248 INFO:tasks.workunit.client.0.smithi155.stdout:5/497: mknod d0/d2/d2a/d19/d59/ca0 0 2023-12-16T05:56:32.248 INFO:tasks.workunit.client.0.smithi155.stdout:5/498: dread - d0/d60/f74 zero size 2023-12-16T05:56:32.249 INFO:tasks.workunit.client.0.smithi155.stdout:7/450: dwrite d0/d6a/d1a/d8c/d42/f93 [0,4194304] 0 2023-12-16T05:56:32.250 INFO:tasks.workunit.client.0.smithi155.stdout:7/451: fdatasync d0/d6a/d31/f5c 0 2023-12-16T05:56:32.251 INFO:tasks.workunit.client.1.smithi156.stdout:9/128: write d6/d19/f1a [649581,95524] 0 2023-12-16T05:56:32.253 INFO:tasks.workunit.client.0.smithi155.stdout:7/452: creat d0/d6a/d1a/d8c/d34/d4b/d64/d6e/f9b x:0 0 0 2023-12-16T05:56:32.254 INFO:tasks.workunit.client.0.smithi155.stdout:2/410: dread d0/f3d [0,4194304] 0 2023-12-16T05:56:32.254 INFO:tasks.workunit.client.0.smithi155.stdout:2/411: write d0/d7/d1f/f48 [1446870,126771] 0 2023-12-16T05:56:32.254 INFO:tasks.workunit.client.0.smithi155.stdout:7/453: rmdir d0/d6a/d31 39 2023-12-16T05:56:32.256 INFO:tasks.workunit.client.0.smithi155.stdout:0/395: dread d7/d2d/f3c [0,4194304] 0 2023-12-16T05:56:32.258 INFO:tasks.workunit.client.0.smithi155.stdout:0/396: creat d7/d47/d5d/d6a/f7c x:0 0 0 2023-12-16T05:56:32.258 INFO:tasks.workunit.client.1.smithi156.stdout:7/232: truncate f4 2758475 0 2023-12-16T05:56:32.259 INFO:tasks.workunit.client.1.smithi156.stdout:9/129: truncate f3 1002109 0 2023-12-16T05:56:32.259 INFO:tasks.workunit.client.1.smithi156.stdout:9/130: fsync d6/d19/f20 0 2023-12-16T05:56:32.260 INFO:tasks.workunit.client.1.smithi156.stdout:7/233: stat c15 0 2023-12-16T05:56:32.261 INFO:tasks.workunit.client.1.smithi156.stdout:9/131: creat d6/d19/f32 x:0 0 0 2023-12-16T05:56:32.261 INFO:tasks.workunit.client.0.smithi155.stdout:5/499: dread d0/f32 [0,4194304] 0 2023-12-16T05:56:32.268 INFO:tasks.workunit.client.1.smithi156.stdout:3/117: dwrite dc/d10/f18 [0,4194304] 0 2023-12-16T05:56:32.270 INFO:tasks.workunit.client.1.smithi156.stdout:3/118: truncate dc/f19 2564229 0 2023-12-16T05:56:32.271 INFO:tasks.workunit.client.1.smithi156.stdout:3/119: truncate dc/f14 420417 0 2023-12-16T05:56:32.272 INFO:tasks.workunit.client.1.smithi156.stdout:3/120: symlink dc/l2a 0 2023-12-16T05:56:32.273 INFO:tasks.workunit.client.1.smithi156.stdout:3/121: rmdir dc/d10 39 2023-12-16T05:56:32.275 INFO:tasks.workunit.client.1.smithi156.stdout:3/122: creat dc/df/f2b x:0 0 0 2023-12-16T05:56:32.275 INFO:tasks.workunit.client.1.smithi156.stdout:3/123: rename dc/d10/d1d to dc/d10/d1d/d2c 22 2023-12-16T05:56:32.287 INFO:tasks.workunit.client.1.smithi156.stdout:3/124: dwrite dc/df/f2b [0,4194304] 0 2023-12-16T05:56:32.290 INFO:tasks.workunit.client.1.smithi156.stdout:3/125: getdents dc/d10 0 2023-12-16T05:56:32.292 INFO:tasks.workunit.client.1.smithi156.stdout:3/126: creat dc/df/f2d x:0 0 0 2023-12-16T05:56:32.292 INFO:tasks.workunit.client.1.smithi156.stdout:3/127: chown dc/d10/d1d/l20 31480 1 2023-12-16T05:56:32.292 INFO:tasks.workunit.client.1.smithi156.stdout:3/128: fdatasync dc/d10/f11 0 2023-12-16T05:56:32.293 INFO:tasks.workunit.client.0.smithi155.stdout:1/516: dwrite d1/d17/fa5 [0,4194304] 0 2023-12-16T05:56:32.300 INFO:tasks.workunit.client.1.smithi156.stdout:9/132: dread d6/ff [0,4194304] 0 2023-12-16T05:56:32.302 INFO:tasks.workunit.client.1.smithi156.stdout:9/133: rename d6/d19/d25/l27 to d6/l33 0 2023-12-16T05:56:32.303 INFO:tasks.workunit.client.1.smithi156.stdout:9/134: dread - d6/d19/f22 zero size 2023-12-16T05:56:32.303 INFO:tasks.workunit.client.1.smithi156.stdout:9/135: fdatasync d6/fd 0 2023-12-16T05:56:32.303 INFO:tasks.workunit.client.1.smithi156.stdout:9/136: truncate d6/f28 175932 0 2023-12-16T05:56:32.304 INFO:tasks.workunit.client.1.smithi156.stdout:9/137: fsync d6/f1e 0 2023-12-16T05:56:32.305 INFO:tasks.workunit.client.1.smithi156.stdout:7/234: dread f4 [0,4194304] 0 2023-12-16T05:56:32.307 INFO:tasks.workunit.client.1.smithi156.stdout:7/235: creat d1e/d1f/d22/d2c/d33/d3e/f49 x:0 0 0 2023-12-16T05:56:32.308 INFO:tasks.workunit.client.1.smithi156.stdout:7/236: mknod d1e/c4a 0 2023-12-16T05:56:32.312 INFO:tasks.workunit.client.0.smithi155.stdout:2/412: dwrite d0/d7/d1f/d74/d3a/f7a [0,4194304] 0 2023-12-16T05:56:32.312 INFO:tasks.workunit.client.0.smithi155.stdout:2/413: write d0/d7/f7e [1018792,62133] 0 2023-12-16T05:56:32.313 INFO:tasks.workunit.client.1.smithi156.stdout:9/138: dread d6/f13 [0,4194304] 0 2023-12-16T05:56:32.313 INFO:tasks.workunit.client.1.smithi156.stdout:9/139: write d6/fe [1579003,100792] 0 2023-12-16T05:56:32.313 INFO:tasks.workunit.client.1.smithi156.stdout:9/140: write d6/d19/f32 [688910,93842] 0 2023-12-16T05:56:32.314 INFO:tasks.workunit.client.0.smithi155.stdout:2/414: mknod d0/d7/d57/c8d 0 2023-12-16T05:56:32.316 INFO:tasks.workunit.client.1.smithi156.stdout:8/103: sync 2023-12-16T05:56:32.317 INFO:tasks.workunit.client.1.smithi156.stdout:8/104: mknod d3/d12/c20 0 2023-12-16T05:56:32.320 INFO:tasks.workunit.client.1.smithi156.stdout:3/129: dwrite dc/d10/f18 [0,4194304] 0 2023-12-16T05:56:32.320 INFO:tasks.workunit.client.0.smithi155.stdout:0/397: dwrite d7/df/d6f/f7a [0,4194304] 0 2023-12-16T05:56:32.320 INFO:tasks.workunit.client.0.smithi155.stdout:0/398: truncate d7/d47/d5d/d6a/f7c 526848 0 2023-12-16T05:56:32.320 INFO:tasks.workunit.client.0.smithi155.stdout:0/399: dread - d7/d13/d45/d4b/f67 zero size 2023-12-16T05:56:32.320 INFO:tasks.workunit.client.0.smithi155.stdout:1/517: dwrite d1/d17/f94 [0,4194304] 0 2023-12-16T05:56:32.321 INFO:tasks.workunit.client.0.smithi155.stdout:1/518: chown d1/d7/l3d 54349904 1 2023-12-16T05:56:32.321 INFO:tasks.workunit.client.0.smithi155.stdout:1/519: fdatasync d1/d17/f65 0 2023-12-16T05:56:32.322 INFO:tasks.workunit.client.0.smithi155.stdout:0/400: creat d7/d47/d53/f7d x:0 0 0 2023-12-16T05:56:32.326 INFO:tasks.workunit.client.0.smithi155.stdout:7/454: dwrite d0/d6a/d1a/d22/f91 [0,4194304] 0 2023-12-16T05:56:32.326 INFO:tasks.workunit.client.0.smithi155.stdout:1/520: write d1/d25/f33 [2318406,82567] 0 2023-12-16T05:56:32.327 INFO:tasks.workunit.client.1.smithi156.stdout:7/237: dwrite d1e/d1f/d22/d2c/f45 [0,4194304] 0 2023-12-16T05:56:32.328 INFO:tasks.workunit.client.1.smithi156.stdout:7/238: creat d1e/d1f/d22/d2c/d33/d3e/f4b x:0 0 0 2023-12-16T05:56:32.330 INFO:tasks.workunit.client.0.smithi155.stdout:0/401: dread d7/df/f58 [0,4194304] 0 2023-12-16T05:56:32.332 INFO:tasks.workunit.client.0.smithi155.stdout:5/500: dwrite d0/f69 [0,4194304] 0 2023-12-16T05:56:32.332 INFO:tasks.workunit.client.0.smithi155.stdout:5/501: write d0/d2/d2a/f44 [4822047,31283] 0 2023-12-16T05:56:32.333 INFO:tasks.workunit.client.0.smithi155.stdout:1/521: getdents d1/d7/d4b/d5c 0 2023-12-16T05:56:32.333 INFO:tasks.workunit.client.0.smithi155.stdout:1/522: fdatasync d1/d25/d43/d5d/f7c 0 2023-12-16T05:56:32.334 INFO:tasks.workunit.client.1.smithi156.stdout:3/130: write dc/f14 [259711,47830] 0 2023-12-16T05:56:32.335 INFO:tasks.workunit.client.0.smithi155.stdout:5/502: mknod d0/d2/d2a/d30/ca1 0 2023-12-16T05:56:32.336 INFO:tasks.workunit.client.1.smithi156.stdout:3/131: link dc/f25 dc/df/f2e 0 2023-12-16T05:56:32.338 INFO:tasks.workunit.client.0.smithi155.stdout:0/402: mknod d7/c7e 0 2023-12-16T05:56:32.338 INFO:tasks.workunit.client.1.smithi156.stdout:3/132: creat dc/df/f2f x:0 0 0 2023-12-16T05:56:32.339 INFO:tasks.workunit.client.0.smithi155.stdout:5/503: truncate d0/d2/d2a/d19/f20 3781798 0 2023-12-16T05:56:32.339 INFO:tasks.workunit.client.0.smithi155.stdout:5/504: stat d0/c51 0 2023-12-16T05:56:32.343 INFO:tasks.workunit.client.0.smithi155.stdout:1/523: rename d1/d17/d28/f8c to d1/d7/d16/fa7 0 2023-12-16T05:56:32.343 INFO:tasks.workunit.client.0.smithi155.stdout:8/411: sync 2023-12-16T05:56:32.343 INFO:tasks.workunit.client.0.smithi155.stdout:1/524: write d1/d25/f9b [53505,47214] 0 2023-12-16T05:56:32.343 INFO:tasks.workunit.client.0.smithi155.stdout:8/412: write d4/da/d1b/f20 [4696990,81759] 0 2023-12-16T05:56:32.343 INFO:tasks.workunit.client.0.smithi155.stdout:8/413: readlink d4/da/d1b/d1c/l67 0 2023-12-16T05:56:32.344 INFO:tasks.workunit.client.1.smithi156.stdout:8/105: dread d3/d18/f1b [0,4194304] 0 2023-12-16T05:56:32.346 INFO:tasks.workunit.client.1.smithi156.stdout:8/106: rmdir d3/d18 39 2023-12-16T05:56:32.346 INFO:tasks.workunit.client.0.smithi155.stdout:5/505: rename d0/d2/d2a/f44 to d0/d2/d2a/d19/d21/fa2 0 2023-12-16T05:56:32.347 INFO:tasks.workunit.client.0.smithi155.stdout:1/525: creat d1/d17/d28/d85/fa8 x:0 0 0 2023-12-16T05:56:32.347 INFO:tasks.workunit.client.0.smithi155.stdout:1/526: chown d1/cd 9518356 1 2023-12-16T05:56:32.348 INFO:tasks.workunit.client.0.smithi155.stdout:8/414: mknod d4/da/d1b/d2a/d5e/c7e 0 2023-12-16T05:56:32.348 INFO:tasks.workunit.client.0.smithi155.stdout:5/506: write d0/d2/f5 [4247357,108089] 0 2023-12-16T05:56:32.353 INFO:tasks.workunit.client.0.smithi155.stdout:1/527: write d1/d25/d43/f5b [2022212,115978] 0 2023-12-16T05:56:32.353 INFO:tasks.workunit.client.0.smithi155.stdout:1/528: fsync d1/d7/f9e 0 2023-12-16T05:56:32.353 INFO:tasks.workunit.client.0.smithi155.stdout:8/415: link d4/d62/d70/d4f/f60 d4/da/f7f 0 2023-12-16T05:56:32.354 INFO:tasks.workunit.client.0.smithi155.stdout:1/529: symlink d1/d7/d4b/d8e/la9 0 2023-12-16T05:56:32.355 INFO:tasks.workunit.client.0.smithi155.stdout:1/530: mkdir d1/d7/d4b/d72/d79/daa 0 2023-12-16T05:56:32.356 INFO:tasks.workunit.client.0.smithi155.stdout:1/531: stat d1/d7/d16/c61 0 2023-12-16T05:56:32.357 INFO:tasks.workunit.client.0.smithi155.stdout:1/532: mknod d1/d7/d4b/d72/d79/daa/cab 0 2023-12-16T05:56:32.357 INFO:tasks.workunit.client.0.smithi155.stdout:1/533: mknod d1/d92/cac 0 2023-12-16T05:56:32.358 INFO:tasks.workunit.client.0.smithi155.stdout:1/534: fsync d1/d7/d16/d30/f7f 0 2023-12-16T05:56:32.358 INFO:tasks.workunit.client.0.smithi155.stdout:1/535: write d1/d7/d4b/d72/d79/f97 [32614,107707] 0 2023-12-16T05:56:32.359 INFO:tasks.workunit.client.0.smithi155.stdout:1/536: write d1/d17/d28/f70 [2626015,130599] 0 2023-12-16T05:56:32.360 INFO:tasks.workunit.client.0.smithi155.stdout:1/537: mkdir d1/d17/d28/d8f/dad 0 2023-12-16T05:56:32.360 INFO:tasks.workunit.client.0.smithi155.stdout:1/538: write d1/d7/d4b/d72/fa6 [276456,94712] 0 2023-12-16T05:56:32.410 INFO:tasks.workunit.client.1.smithi156.stdout:7/239: dwrite d1e/d1f/d22/f25 [0,4194304] 0 2023-12-16T05:56:32.410 INFO:tasks.workunit.client.1.smithi156.stdout:7/240: chown d1e/f24 847 1 2023-12-16T05:56:32.411 INFO:tasks.workunit.client.0.smithi155.stdout:7/455: dwrite d0/d1/d5/f8 [0,4194304] 0 2023-12-16T05:56:32.411 INFO:tasks.workunit.client.0.smithi155.stdout:0/403: dwrite d7/df/f19 [4194304,4194304] 0 2023-12-16T05:56:32.411 INFO:tasks.workunit.client.0.smithi155.stdout:5/507: dwrite d0/d2/d2a/d19/d88/f95 [0,4194304] 0 2023-12-16T05:56:32.411 INFO:tasks.workunit.client.0.smithi155.stdout:5/508: write d0/d60/f74 [204016,18611] 0 2023-12-16T05:56:32.412 INFO:tasks.workunit.client.1.smithi156.stdout:8/107: dwrite d3/d12/d16/f1d [0,4194304] 0 2023-12-16T05:56:32.413 INFO:tasks.workunit.client.1.smithi156.stdout:7/241: rename d1e/f21 to d1e/d1f/d22/d2c/f4c 0 2023-12-16T05:56:32.414 INFO:tasks.workunit.client.1.smithi156.stdout:3/133: dwrite dc/df/f2f [0,4194304] 0 2023-12-16T05:56:32.415 INFO:tasks.workunit.client.1.smithi156.stdout:8/108: truncate d3/ff 168770 0 2023-12-16T05:56:32.415 INFO:tasks.workunit.client.1.smithi156.stdout:8/109: write f2 [5069387,118166] 0 2023-12-16T05:56:32.415 INFO:tasks.workunit.client.1.smithi156.stdout:7/242: creat d1e/d1f/d22/d2c/f4d x:0 0 0 2023-12-16T05:56:32.416 INFO:tasks.workunit.client.1.smithi156.stdout:7/243: write d1e/d1f/d22/d2c/d33/d3e/f4b [483701,72232] 0 2023-12-16T05:56:32.416 INFO:tasks.workunit.client.1.smithi156.stdout:7/244: write d1e/d1f/d22/f25 [4688694,69987] 0 2023-12-16T05:56:32.417 INFO:tasks.workunit.client.1.smithi156.stdout:3/134: link l6 dc/d10/d1d/d1f/l30 0 2023-12-16T05:56:32.418 INFO:tasks.workunit.client.1.smithi156.stdout:3/135: read f8 [3496569,113930] 0 2023-12-16T05:56:32.418 INFO:tasks.workunit.client.1.smithi156.stdout:8/110: symlink d3/l21 0 2023-12-16T05:56:32.420 INFO:tasks.workunit.client.0.smithi155.stdout:0/404: creat d7/df/f7f x:0 0 0 2023-12-16T05:56:32.420 INFO:tasks.workunit.client.1.smithi156.stdout:7/245: symlink d1e/d39/l4e 0 2023-12-16T05:56:32.420 INFO:tasks.workunit.client.1.smithi156.stdout:7/246: stat d1e/d39/f3f 0 2023-12-16T05:56:32.421 INFO:tasks.workunit.client.0.smithi155.stdout:7/456: dread d0/d6a/d1a/d22/f91 [0,4194304] 0 2023-12-16T05:56:32.426 INFO:tasks.workunit.client.1.smithi156.stdout:3/136: write dc/df/f2f [3486254,100919] 0 2023-12-16T05:56:32.428 INFO:tasks.workunit.client.0.smithi155.stdout:0/405: unlink d7/fe 0 2023-12-16T05:56:32.428 INFO:tasks.workunit.client.0.smithi155.stdout:0/406: write d7/df/d41/d23/d44/d4d/f79 [525473,109387] 0 2023-12-16T05:56:32.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:32 smithi156 ceph-mon[121001]: pgmap v12: 65 pgs: 65 active+clean; 988 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 62 MiB/s rd, 118 MiB/s wr, 1.08k op/s 2023-12-16T05:56:32.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:32 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:32.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:32 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:32.430 INFO:tasks.workunit.client.0.smithi155.stdout:7/457: truncate d0/d6a/d1a/d22/f25 2125940 0 2023-12-16T05:56:32.430 INFO:tasks.workunit.client.0.smithi155.stdout:5/509: dwrite d0/d2/d2a/d19/f4c [0,4194304] 0 2023-12-16T05:56:32.431 INFO:tasks.workunit.client.1.smithi156.stdout:3/137: dread f4 [0,4194304] 0 2023-12-16T05:56:32.431 INFO:tasks.workunit.client.0.smithi155.stdout:0/407: creat d7/df/d41/d23/d44/d4d/f80 x:0 0 0 2023-12-16T05:56:32.432 INFO:tasks.workunit.client.0.smithi155.stdout:7/458: mknod d0/d6a/d1a/d22/c9c 0 2023-12-16T05:56:32.432 INFO:tasks.workunit.client.1.smithi156.stdout:3/138: creat dc/d10/f31 x:0 0 0 2023-12-16T05:56:32.433 INFO:tasks.workunit.client.0.smithi155.stdout:5/510: fsync d0/d60/f74 0 2023-12-16T05:56:32.433 INFO:tasks.workunit.client.0.smithi155.stdout:5/511: read - d0/d2/d2a/d30/f77 zero size 2023-12-16T05:56:32.434 INFO:tasks.workunit.client.1.smithi156.stdout:3/139: creat dc/d10/d1d/f32 x:0 0 0 2023-12-16T05:56:32.439 INFO:tasks.workunit.client.0.smithi155.stdout:0/408: mkdir d7/d13/d46/d81 0 2023-12-16T05:56:32.442 INFO:tasks.workunit.client.0.smithi155.stdout:0/409: stat d7/c12 0 2023-12-16T05:56:32.442 INFO:tasks.workunit.client.0.smithi155.stdout:0/410: write d7/df/d65/f55 [483867,49482] 0 2023-12-16T05:56:32.444 INFO:tasks.workunit.client.0.smithi155.stdout:0/411: getdents d7/d47/d53 0 2023-12-16T05:56:32.444 INFO:tasks.workunit.client.0.smithi155.stdout:0/412: truncate d7/df/d41/d23/d44/f6b 266816 0 2023-12-16T05:56:32.444 INFO:tasks.workunit.client.0.smithi155.stdout:0/413: fdatasync d7/df/f19 0 2023-12-16T05:56:32.444 INFO:tasks.workunit.client.0.smithi155.stdout:0/414: write d7/fb [5907184,22281] 0 2023-12-16T05:56:32.444 INFO:tasks.workunit.client.0.smithi155.stdout:0/415: readlink d7/ld 0 2023-12-16T05:56:32.444 INFO:tasks.workunit.client.0.smithi155.stdout:0/416: truncate d7/d2d/f3c 5197009 0 2023-12-16T05:56:32.445 INFO:tasks.workunit.client.1.smithi156.stdout:5/206: sync 2023-12-16T05:56:32.445 INFO:tasks.workunit.client.1.smithi156.stdout:4/87: sync 2023-12-16T05:56:32.445 INFO:tasks.workunit.client.1.smithi156.stdout:6/134: sync 2023-12-16T05:56:32.445 INFO:tasks.workunit.client.1.smithi156.stdout:6/135: chown d9/d13/f18 230935 1 2023-12-16T05:56:32.446 INFO:tasks.workunit.client.0.smithi155.stdout:7/459: dread d0/d1/d5/f8 [0,4194304] 0 2023-12-16T05:56:32.446 INFO:tasks.workunit.client.0.smithi155.stdout:0/417: creat d7/df/d6f/f82 x:0 0 0 2023-12-16T05:56:32.447 INFO:tasks.workunit.client.1.smithi156.stdout:5/207: rename da/dc/f37 to da/dc/d2d/f3c 0 2023-12-16T05:56:32.447 INFO:tasks.workunit.client.1.smithi156.stdout:5/208: write f4 [2679112,118876] 0 2023-12-16T05:56:32.447 INFO:tasks.workunit.client.1.smithi156.stdout:4/88: creat d9/f1c x:0 0 0 2023-12-16T05:56:32.448 INFO:tasks.workunit.client.0.smithi155.stdout:7/460: creat d0/d6a/d1a/d38/f9d x:0 0 0 2023-12-16T05:56:32.449 INFO:tasks.workunit.client.1.smithi156.stdout:4/89: symlink d9/l1d 0 2023-12-16T05:56:32.449 INFO:tasks.workunit.client.0.smithi155.stdout:7/461: symlink d0/d6a/d1a/d2b/d2c/l9e 0 2023-12-16T05:56:32.450 INFO:tasks.workunit.client.0.smithi155.stdout:5/512: write d0/d2/f22 [443571,82162] 0 2023-12-16T05:56:32.451 INFO:tasks.workunit.client.1.smithi156.stdout:4/90: rename f2 to d9/f1e 0 2023-12-16T05:56:32.451 INFO:tasks.workunit.client.1.smithi156.stdout:4/91: dread - d9/f19 zero size 2023-12-16T05:56:32.451 INFO:tasks.workunit.client.0.smithi155.stdout:7/462: creat d0/d6a/d1a/d38/f9f x:0 0 0 2023-12-16T05:56:32.452 INFO:tasks.workunit.client.1.smithi156.stdout:6/136: dread d9/f1d [0,4194304] 0 2023-12-16T05:56:32.453 INFO:tasks.workunit.client.1.smithi156.stdout:4/92: chown d9/f15 7416 1 2023-12-16T05:56:32.453 INFO:tasks.workunit.client.1.smithi156.stdout:4/93: read - d9/f15 zero size 2023-12-16T05:56:32.453 INFO:tasks.workunit.client.1.smithi156.stdout:4/94: write f4 [1380536,37902] 0 2023-12-16T05:56:32.455 INFO:tasks.workunit.client.1.smithi156.stdout:4/95: symlink d9/l1f 0 2023-12-16T05:56:32.455 INFO:tasks.workunit.client.0.smithi155.stdout:5/513: symlink d0/d2/d2a/d19/d71/la3 0 2023-12-16T05:56:32.457 INFO:tasks.workunit.client.0.smithi155.stdout:7/463: rmdir d0/d6a/d1a/d2b/d2c/d97 0 2023-12-16T05:56:32.457 INFO:tasks.workunit.client.1.smithi156.stdout:4/96: rename d9/cd to d9/c20 0 2023-12-16T05:56:32.457 INFO:tasks.workunit.client.1.smithi156.stdout:4/97: truncate d9/f15 718064 0 2023-12-16T05:56:32.459 INFO:tasks.workunit.client.1.smithi156.stdout:4/98: truncate f3 940711 0 2023-12-16T05:56:32.459 INFO:tasks.workunit.client.1.smithi156.stdout:4/99: write d9/f1b [176095,71497] 0 2023-12-16T05:56:32.459 INFO:tasks.workunit.client.1.smithi156.stdout:4/100: chown d9/l1f 291 1 2023-12-16T05:56:32.459 INFO:tasks.workunit.client.0.smithi155.stdout:5/514: creat d0/d2/d4f/fa4 x:0 0 0 2023-12-16T05:56:32.461 INFO:tasks.workunit.client.0.smithi155.stdout:5/515: symlink d0/d2/d2a/d30/d53/d7b/d99/d47/la5 0 2023-12-16T05:56:32.462 INFO:tasks.workunit.client.1.smithi156.stdout:4/101: unlink d9/f12 0 2023-12-16T05:56:32.463 INFO:tasks.workunit.client.0.smithi155.stdout:5/516: creat d0/d2/fa6 x:0 0 0 2023-12-16T05:56:32.463 INFO:tasks.workunit.client.0.smithi155.stdout:5/517: readlink d0/d2/l76 0 2023-12-16T05:56:32.464 INFO:tasks.workunit.client.0.smithi155.stdout:5/518: write d0/d2/d2a/d30/f75 [526673,107157] 0 2023-12-16T05:56:32.470 INFO:tasks.workunit.client.1.smithi156.stdout:3/140: dwrite f4 [0,4194304] 0 2023-12-16T05:56:32.471 INFO:tasks.workunit.client.1.smithi156.stdout:7/247: dwrite d1e/d1f/d22/f25 [0,4194304] 0 2023-12-16T05:56:32.471 INFO:tasks.workunit.client.0.smithi155.stdout:0/418: dwrite d7/f2a [4194304,4194304] 0 2023-12-16T05:56:32.485 INFO:tasks.workunit.client.0.smithi155.stdout:0/419: dread d7/f2a [0,4194304] 0 2023-12-16T05:56:32.486 INFO:tasks.workunit.client.0.smithi155.stdout:0/420: rmdir d7/df/d41 39 2023-12-16T05:56:32.486 INFO:tasks.workunit.client.0.smithi155.stdout:0/421: dread - d7/d13/d45/d4b/f70 zero size 2023-12-16T05:56:32.488 INFO:tasks.workunit.client.0.smithi155.stdout:0/422: creat d7/f83 x:0 0 0 2023-12-16T05:56:32.489 INFO:tasks.workunit.client.0.smithi155.stdout:0/423: unlink d7/df/d41/d23/d36/l38 0 2023-12-16T05:56:32.489 INFO:tasks.workunit.client.0.smithi155.stdout:0/424: fsync d7/df/d41/d23/d44/f6b 0 2023-12-16T05:56:32.489 INFO:tasks.workunit.client.0.smithi155.stdout:0/425: readlink d7/df/d41/d23/l51 0 2023-12-16T05:56:32.493 INFO:tasks.workunit.client.1.smithi156.stdout:6/137: dwrite f5 [0,4194304] 0 2023-12-16T05:56:32.494 INFO:tasks.workunit.client.1.smithi156.stdout:6/138: creat d9/d13/f26 x:0 0 0 2023-12-16T05:56:32.494 INFO:tasks.workunit.client.1.smithi156.stdout:5/209: dwrite da/dc/f21 [0,4194304] 0 2023-12-16T05:56:32.494 INFO:tasks.workunit.client.1.smithi156.stdout:5/210: readlink da/l1c 0 2023-12-16T05:56:32.494 INFO:tasks.workunit.client.1.smithi156.stdout:5/211: chown da/dc/l30 10989373 1 2023-12-16T05:56:32.496 INFO:tasks.workunit.client.1.smithi156.stdout:7/248: dwrite d1e/d1f/d22/d2c/d33/d3e/f49 [0,4194304] 0 2023-12-16T05:56:32.496 INFO:tasks.workunit.client.1.smithi156.stdout:6/139: link d9/d13/f1b d9/d13/f27 0 2023-12-16T05:56:32.497 INFO:tasks.workunit.client.1.smithi156.stdout:3/141: dwrite dc/d10/d1d/d1f/f29 [0,4194304] 0 2023-12-16T05:56:32.497 INFO:tasks.workunit.client.1.smithi156.stdout:3/142: fdatasync dc/d10/f11 0 2023-12-16T05:56:32.497 INFO:tasks.workunit.client.0.smithi155.stdout:7/464: dwrite d0/d1b/f2f [0,4194304] 0 2023-12-16T05:56:32.497 INFO:tasks.workunit.client.1.smithi156.stdout:6/140: dread d9/d13/f1b [0,4194304] 0 2023-12-16T05:56:32.498 INFO:tasks.workunit.client.1.smithi156.stdout:6/141: write d9/d13/f26 [516865,83915] 0 2023-12-16T05:56:32.498 INFO:tasks.workunit.client.0.smithi155.stdout:7/465: rename d0/d6a/d1a/d36 to d0/d6a/d1a/da0 0 2023-12-16T05:56:32.498 INFO:tasks.workunit.client.0.smithi155.stdout:7/466: fsync d0/d1b/f39 0 2023-12-16T05:56:32.499 INFO:tasks.workunit.client.1.smithi156.stdout:5/212: getdents da/dc/d2d 0 2023-12-16T05:56:32.500 INFO:tasks.workunit.client.0.smithi155.stdout:7/467: creat d0/d6a/d1a/d8c/d34/fa1 x:0 0 0 2023-12-16T05:56:32.501 INFO:tasks.workunit.client.0.smithi155.stdout:7/468: creat d0/d6a/d1a/d38/fa2 x:0 0 0 2023-12-16T05:56:32.502 INFO:tasks.workunit.client.1.smithi156.stdout:7/249: mknod d1e/d1f/d22/d2c/d33/d3e/c4f 0 2023-12-16T05:56:32.502 INFO:tasks.workunit.client.1.smithi156.stdout:7/250: chown d1e/f24 3 1 2023-12-16T05:56:32.505 INFO:tasks.workunit.client.1.smithi156.stdout:3/143: creat dc/d10/d1d/f33 x:0 0 0 2023-12-16T05:56:32.505 INFO:tasks.workunit.client.1.smithi156.stdout:3/144: write dc/d10/d1d/f33 [673420,10511] 0 2023-12-16T05:56:32.505 INFO:tasks.workunit.client.0.smithi155.stdout:0/426: truncate d7/d2d/f3c 515961 0 2023-12-16T05:56:32.505 INFO:tasks.workunit.client.1.smithi156.stdout:3/145: write dc/d10/f11 [1685313,3024] 0 2023-12-16T05:56:32.506 INFO:tasks.workunit.client.1.smithi156.stdout:4/102: dwrite d9/f1b [0,4194304] 0 2023-12-16T05:56:32.506 INFO:tasks.workunit.client.1.smithi156.stdout:6/142: mknod d9/c28 0 2023-12-16T05:56:32.507 INFO:tasks.workunit.client.0.smithi155.stdout:0/427: mkdir d7/d47/d5d/d84 0 2023-12-16T05:56:32.507 INFO:tasks.workunit.client.0.smithi155.stdout:0/428: read - d7/d13/d45/f6c zero size 2023-12-16T05:56:32.508 INFO:tasks.workunit.client.1.smithi156.stdout:5/213: getdents da 0 2023-12-16T05:56:32.509 INFO:tasks.workunit.client.0.smithi155.stdout:5/519: dread d0/d2/f22 [0,4194304] 0 2023-12-16T05:56:32.509 INFO:tasks.workunit.client.0.smithi155.stdout:5/520: fsync d0/d2/d4f/fa4 0 2023-12-16T05:56:32.509 INFO:tasks.workunit.client.1.smithi156.stdout:3/146: mkdir dc/df/d34 0 2023-12-16T05:56:32.511 INFO:tasks.workunit.client.1.smithi156.stdout:5/214: creat da/dc/f3d x:0 0 0 2023-12-16T05:56:32.511 INFO:tasks.workunit.client.0.smithi155.stdout:0/429: rename d7/df/d41/d23/l51 to d7/d47/d5d/d84/l85 0 2023-12-16T05:56:32.511 INFO:tasks.workunit.client.0.smithi155.stdout:0/430: write d7/df/f7f [793104,76653] 0 2023-12-16T05:56:32.513 INFO:tasks.workunit.client.1.smithi156.stdout:3/147: symlink dc/d10/l35 0 2023-12-16T05:56:32.514 INFO:tasks.workunit.client.1.smithi156.stdout:5/215: mknod da/c3e 0 2023-12-16T05:56:32.515 INFO:tasks.workunit.client.1.smithi156.stdout:5/216: fdatasync da/dc/ff 0 2023-12-16T05:56:32.516 INFO:tasks.workunit.client.1.smithi156.stdout:3/148: mknod dc/d10/c36 0 2023-12-16T05:56:32.516 INFO:tasks.workunit.client.0.smithi155.stdout:5/521: link d0/c4e d0/d2/ca7 0 2023-12-16T05:56:32.518 INFO:tasks.workunit.client.0.smithi155.stdout:0/431: rename d7/df/c75 to d7/df/d41/d23/c86 0 2023-12-16T05:56:32.518 INFO:tasks.workunit.client.0.smithi155.stdout:0/432: chown d7/d47/f62 213425042 1 2023-12-16T05:56:32.518 INFO:tasks.workunit.client.0.smithi155.stdout:0/433: fdatasync d7/d2d/f2f 0 2023-12-16T05:56:32.518 INFO:tasks.workunit.client.0.smithi155.stdout:0/434: fsync d7/f2a 0 2023-12-16T05:56:32.519 INFO:tasks.workunit.client.1.smithi156.stdout:3/149: creat dc/d10/d1d/d1f/f37 x:0 0 0 2023-12-16T05:56:32.519 INFO:tasks.workunit.client.0.smithi155.stdout:5/522: symlink d0/d2/d2a/d19/d59/d66/d9f/la8 0 2023-12-16T05:56:32.519 INFO:tasks.workunit.client.0.smithi155.stdout:0/435: read d7/df/f58 [3361038,56555] 0 2023-12-16T05:56:32.520 INFO:tasks.workunit.client.1.smithi156.stdout:5/217: mkdir da/dc/d3f 0 2023-12-16T05:56:32.522 INFO:tasks.workunit.client.0.smithi155.stdout:5/523: rmdir d0/d2/d2a/d19/d71 39 2023-12-16T05:56:32.523 INFO:tasks.workunit.client.1.smithi156.stdout:5/218: mkdir da/d40 0 2023-12-16T05:56:32.523 INFO:tasks.workunit.client.0.smithi155.stdout:0/436: unlink d7/df/d41/d23/d44/d4d/f79 0 2023-12-16T05:56:32.524 INFO:tasks.workunit.client.0.smithi155.stdout:5/524: truncate d0/d2/d4f/f55 3873268 0 2023-12-16T05:56:32.524 INFO:tasks.workunit.client.1.smithi156.stdout:5/219: write da/dc/f31 [2055290,57074] 0 2023-12-16T05:56:32.524 INFO:tasks.workunit.client.0.smithi155.stdout:0/437: mknod d7/d13/d46/c87 0 2023-12-16T05:56:32.525 INFO:tasks.workunit.client.1.smithi156.stdout:5/220: truncate da/f26 3052893 0 2023-12-16T05:56:32.526 INFO:tasks.workunit.client.0.smithi155.stdout:5/525: symlink d0/d2/d2a/d30/d53/d7b/d99/d47/la9 0 2023-12-16T05:56:32.526 INFO:tasks.workunit.client.0.smithi155.stdout:5/526: write d0/d2/d2a/d30/d53/d7b/d99/f5c [991952,5635] 0 2023-12-16T05:56:32.527 INFO:tasks.workunit.client.1.smithi156.stdout:5/221: unlink da/cb 0 2023-12-16T05:56:32.528 INFO:tasks.workunit.client.0.smithi155.stdout:0/438: rename l6 to d7/d13/d45/d3e/l88 0 2023-12-16T05:56:32.528 INFO:tasks.workunit.client.0.smithi155.stdout:0/439: chown d7/d13/d45/d4b/f70 446735 1 2023-12-16T05:56:32.530 INFO:tasks.workunit.client.0.smithi155.stdout:5/527: symlink d0/d2/d2a/d19/d88/laa 0 2023-12-16T05:56:32.531 INFO:tasks.workunit.client.0.smithi155.stdout:0/440: mknod d7/df/d41/d23/d36/c89 0 2023-12-16T05:56:32.535 INFO:tasks.workunit.client.0.smithi155.stdout:5/528: unlink d0/d2/d2a/l2c 0 2023-12-16T05:56:32.535 INFO:tasks.workunit.client.0.smithi155.stdout:5/529: write d0/d2/d2a/d30/d53/d7b/f86 [85578,72476] 0 2023-12-16T05:56:32.536 INFO:tasks.workunit.client.0.smithi155.stdout:0/441: mknod d7/d13/d45/d4b/c8a 0 2023-12-16T05:56:32.537 INFO:tasks.workunit.client.0.smithi155.stdout:5/530: symlink d0/d2/d2a/d30/d53/lab 0 2023-12-16T05:56:32.537 INFO:tasks.workunit.client.0.smithi155.stdout:5/531: fdatasync d0/d2/d2a/f2e 0 2023-12-16T05:56:32.537 INFO:tasks.workunit.client.0.smithi155.stdout:5/532: chown d0/d2/d4f/c5a 24239 1 2023-12-16T05:56:32.538 INFO:tasks.workunit.client.0.smithi155.stdout:3/331: sync 2023-12-16T05:56:32.538 INFO:tasks.workunit.client.0.smithi155.stdout:4/398: sync 2023-12-16T05:56:32.538 INFO:tasks.workunit.client.0.smithi155.stdout:9/510: sync 2023-12-16T05:56:32.543 INFO:tasks.workunit.client.0.smithi155.stdout:5/533: creat d0/d2/d2a/d19/d21/d56/fac x:0 0 0 2023-12-16T05:56:32.544 INFO:tasks.workunit.client.0.smithi155.stdout:3/332: rmdir d0/d14/d36 39 2023-12-16T05:56:32.544 INFO:tasks.workunit.client.0.smithi155.stdout:3/333: stat d0/f30 0 2023-12-16T05:56:32.544 INFO:tasks.workunit.client.0.smithi155.stdout:9/511: getdents da/d15/d17/d24/d26/d2e/d83/d8f/d9c 0 2023-12-16T05:56:32.544 INFO:tasks.workunit.client.0.smithi155.stdout:9/512: truncate da/d15/d17/d36/d5b/d98/faf 666333 0 2023-12-16T05:56:32.545 INFO:tasks.workunit.client.0.smithi155.stdout:9/513: fsync da/d15/d17/d36/d5b/fa6 0 2023-12-16T05:56:32.547 INFO:tasks.workunit.client.0.smithi155.stdout:4/399: mknod d0/da/c7a 0 2023-12-16T05:56:32.548 INFO:tasks.workunit.client.0.smithi155.stdout:0/442: mknod d7/df/d41/d23/d44/c8b 0 2023-12-16T05:56:32.550 INFO:tasks.workunit.client.0.smithi155.stdout:5/534: mknod d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/cad 0 2023-12-16T05:56:32.550 INFO:tasks.workunit.client.0.smithi155.stdout:9/514: symlink da/d15/d17/d36/d5b/d60/lb4 0 2023-12-16T05:56:32.553 INFO:tasks.workunit.client.0.smithi155.stdout:4/400: rename d0/d10/d46/d16/d30/d52/d54 to d0/da/d36/d5f/d7b 0 2023-12-16T05:56:32.553 INFO:tasks.workunit.client.0.smithi155.stdout:4/401: fsync d0/d10/d46/d16/d1a/f72 0 2023-12-16T05:56:32.554 INFO:tasks.workunit.client.0.smithi155.stdout:4/402: chown d0/da/d36/d5f/d75/d3d/d43/f4e 251496 1 2023-12-16T05:56:32.554 INFO:tasks.workunit.client.1.smithi156.stdout:4/103: dread d9/f1b [0,4194304] 0 2023-12-16T05:56:32.554 INFO:tasks.workunit.client.1.smithi156.stdout:4/104: fdatasync f8 0 2023-12-16T05:56:32.555 INFO:tasks.workunit.client.1.smithi156.stdout:4/105: creat d9/f21 x:0 0 0 2023-12-16T05:56:32.555 INFO:tasks.workunit.client.1.smithi156.stdout:4/106: write f0 [4837303,23708] 0 2023-12-16T05:56:32.559 INFO:tasks.workunit.client.1.smithi156.stdout:6/143: dwrite f6 [0,4194304] 0 2023-12-16T05:56:32.559 INFO:tasks.workunit.client.1.smithi156.stdout:6/144: fsync f5 0 2023-12-16T05:56:32.559 INFO:tasks.workunit.client.0.smithi155.stdout:9/515: creat da/d15/d17/d36/d5b/d60/d9e/fb5 x:0 0 0 2023-12-16T05:56:32.559 INFO:tasks.workunit.client.0.smithi155.stdout:4/403: mknod d0/d10/c7c 0 2023-12-16T05:56:32.559 INFO:tasks.workunit.client.0.smithi155.stdout:5/535: rename d0/d2/d2a/d19/d59/d66/d9f to d0/dae 0 2023-12-16T05:56:32.560 INFO:tasks.workunit.client.1.smithi156.stdout:6/145: link d9/d1c/c22 d9/d13/c29 0 2023-12-16T05:56:32.561 INFO:tasks.workunit.client.1.smithi156.stdout:6/146: symlink d9/d1c/l2a 0 2023-12-16T05:56:32.561 INFO:tasks.workunit.client.1.smithi156.stdout:5/222: dwrite f0 [0,4194304] 0 2023-12-16T05:56:32.561 INFO:tasks.workunit.client.1.smithi156.stdout:5/223: dread - da/dc/f3d zero size 2023-12-16T05:56:32.562 INFO:tasks.workunit.client.0.smithi155.stdout:4/404: mkdir d0/d10/d46/d16/d7d 0 2023-12-16T05:56:32.562 INFO:tasks.workunit.client.1.smithi156.stdout:7/251: dwrite f9 [4194304,4194304] 0 2023-12-16T05:56:32.565 INFO:tasks.workunit.client.1.smithi156.stdout:7/252: rename d1e/d1f/d22/d2c/f4c to d1e/d1f/d22/d2c/d33/f50 0 2023-12-16T05:56:32.566 INFO:tasks.workunit.client.1.smithi156.stdout:7/253: mknod d1e/d1f/d22/d2c/d33/d3e/c51 0 2023-12-16T05:56:32.567 INFO:tasks.workunit.client.1.smithi156.stdout:7/254: truncate d1e/d39/f3f 837231 0 2023-12-16T05:56:32.569 INFO:tasks.workunit.client.0.smithi155.stdout:4/405: creat d0/d10/d46/d16/d30/f7e x:0 0 0 2023-12-16T05:56:32.570 INFO:tasks.workunit.client.1.smithi156.stdout:3/150: dread dc/d10/d1d/d1f/f29 [0,4194304] 0 2023-12-16T05:56:32.570 INFO:tasks.workunit.client.1.smithi156.stdout:3/151: dread dc/f25 [0,4194304] 0 2023-12-16T05:56:32.571 INFO:tasks.workunit.client.0.smithi155.stdout:4/406: creat d0/da/d36/f7f x:0 0 0 2023-12-16T05:56:32.573 INFO:tasks.workunit.client.1.smithi156.stdout:7/255: write d1e/d1f/d22/f25 [1837531,53786] 0 2023-12-16T05:56:32.573 INFO:tasks.workunit.client.1.smithi156.stdout:7/256: fsync d1e/d1f/d22/d2c/d33/f3d 0 2023-12-16T05:56:32.573 INFO:tasks.workunit.client.1.smithi156.stdout:7/257: chown d1e/d1f/d22/d2c/d2e 2 1 2023-12-16T05:56:32.573 INFO:tasks.workunit.client.1.smithi156.stdout:7/258: stat f9 0 2023-12-16T05:56:32.574 INFO:tasks.workunit.client.0.smithi155.stdout:4/407: write d0/f5 [3682386,117740] 0 2023-12-16T05:56:32.574 INFO:tasks.workunit.client.0.smithi155.stdout:4/408: write d0/da/d36/d5f/d75/d3d/d43/f4a [721714,44918] 0 2023-12-16T05:56:32.575 INFO:tasks.workunit.client.1.smithi156.stdout:7/259: symlink d1e/d39/l52 0 2023-12-16T05:56:32.576 INFO:tasks.workunit.client.0.smithi155.stdout:0/443: dwrite d7/df/d6f/f82 [0,4194304] 0 2023-12-16T05:56:32.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:32 smithi155 ceph-mon[112451]: pgmap v12: 65 pgs: 65 active+clean; 988 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 62 MiB/s rd, 118 MiB/s wr, 1.08k op/s 2023-12-16T05:56:32.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:32 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:32.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:32 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:32.578 INFO:tasks.workunit.client.0.smithi155.stdout:4/409: mknod d0/d10/d46/d16/d7d/c80 0 2023-12-16T05:56:32.581 INFO:tasks.workunit.client.0.smithi155.stdout:0/444: rename d7/d13/d45/d4b/f70 to d7/d13/d45/d4b/f8c 0 2023-12-16T05:56:32.581 INFO:tasks.workunit.client.0.smithi155.stdout:4/410: mkdir d0/da/d81 0 2023-12-16T05:56:32.585 INFO:tasks.workunit.client.1.smithi156.stdout:5/224: dread da/dc/d2d/f33 [0,4194304] 0 2023-12-16T05:56:32.586 INFO:tasks.workunit.client.0.smithi155.stdout:4/411: mknod d0/d10/d46/d16/d1a/d70/c82 0 2023-12-16T05:56:32.586 INFO:tasks.workunit.client.0.smithi155.stdout:4/412: write d0/da/d36/f7f [502138,57619] 0 2023-12-16T05:56:32.586 INFO:tasks.workunit.client.0.smithi155.stdout:4/413: readlink d0/d10/d46/l19 0 2023-12-16T05:56:32.586 INFO:tasks.workunit.client.0.smithi155.stdout:4/414: fsync d0/d10/f12 0 2023-12-16T05:56:32.587 INFO:tasks.workunit.client.0.smithi155.stdout:4/415: dread - d0/d10/d46/d16/d1a/f69 zero size 2023-12-16T05:56:32.587 INFO:tasks.workunit.client.1.smithi156.stdout:5/225: rmdir da/dc/d2d 39 2023-12-16T05:56:32.587 INFO:tasks.workunit.client.0.smithi155.stdout:4/416: mknod d0/d10/d46/d16/d30/d52/c83 0 2023-12-16T05:56:32.589 INFO:tasks.workunit.client.1.smithi156.stdout:5/226: rmdir da/dc/d3f 0 2023-12-16T05:56:32.591 INFO:tasks.workunit.client.1.smithi156.stdout:6/147: rmdir d9 39 2023-12-16T05:56:32.591 INFO:tasks.workunit.client.1.smithi156.stdout:6/148: fdatasync d9/f15 0 2023-12-16T05:56:32.591 INFO:tasks.workunit.client.1.smithi156.stdout:6/149: stat d9/ff 0 2023-12-16T05:56:32.592 INFO:tasks.workunit.client.0.smithi155.stdout:3/334: dwrite d0/d14/f50 [0,4194304] 0 2023-12-16T05:56:32.597 INFO:tasks.workunit.client.1.smithi156.stdout:3/152: dwrite dc/d10/f11 [4194304,4194304] 0 2023-12-16T05:56:32.598 INFO:tasks.workunit.client.0.smithi155.stdout:5/536: dwrite d0/d2/f1a [4194304,4194304] 0 2023-12-16T05:56:32.599 INFO:tasks.workunit.client.1.smithi156.stdout:4/107: dwrite d9/f16 [0,4194304] 0 2023-12-16T05:56:32.599 INFO:tasks.workunit.client.1.smithi156.stdout:3/153: rename f4 to dc/d10/d1d/d1f/f38 0 2023-12-16T05:56:32.600 INFO:tasks.workunit.client.1.smithi156.stdout:7/260: dwrite f4 [0,4194304] 0 2023-12-16T05:56:32.600 INFO:tasks.workunit.client.0.smithi155.stdout:9/516: dwrite da/d15/d17/d24/d26/d2e/d83/d8f/fb2 [0,4194304] 0 2023-12-16T05:56:32.603 INFO:tasks.workunit.client.0.smithi155.stdout:0/445: rename d7/df/d41/d23/d44 to d7/df/d73/d8d 0 2023-12-16T05:56:32.605 INFO:tasks.workunit.client.0.smithi155.stdout:9/517: write da/f10 [2046124,52412] 0 2023-12-16T05:56:32.605 INFO:tasks.workunit.client.0.smithi155.stdout:9/518: truncate da/d15/d17/d36/d54/f94 536075 0 2023-12-16T05:56:32.605 INFO:tasks.workunit.client.0.smithi155.stdout:9/519: write da/f5a [96719,18154] 0 2023-12-16T05:56:32.605 INFO:tasks.workunit.client.0.smithi155.stdout:9/520: fdatasync da/d15/d17/d24/d26/f58 0 2023-12-16T05:56:32.606 INFO:tasks.workunit.client.1.smithi156.stdout:4/108: fsync d9/ff 0 2023-12-16T05:56:32.607 INFO:tasks.workunit.client.1.smithi156.stdout:3/154: rmdir dc/df 39 2023-12-16T05:56:32.607 INFO:tasks.workunit.client.1.smithi156.stdout:3/155: chown dc/f23 302460096 1 2023-12-16T05:56:32.607 INFO:tasks.workunit.client.1.smithi156.stdout:3/156: chown dc/d10/l35 171 1 2023-12-16T05:56:32.609 INFO:tasks.workunit.client.1.smithi156.stdout:7/261: creat d1e/d1f/f53 x:0 0 0 2023-12-16T05:56:32.610 INFO:tasks.workunit.client.1.smithi156.stdout:3/157: creat dc/d10/d1d/d1f/f39 x:0 0 0 2023-12-16T05:56:32.612 INFO:tasks.workunit.client.0.smithi155.stdout:4/417: dwrite d0/da/d36/d5f/f6d [0,4194304] 0 2023-12-16T05:56:32.615 INFO:tasks.workunit.client.1.smithi156.stdout:3/158: creat dc/d10/d1d/f3a x:0 0 0 2023-12-16T05:56:32.616 INFO:tasks.workunit.client.1.smithi156.stdout:3/159: write dc/d10/d1d/d1f/f29 [3325856,126185] 0 2023-12-16T05:56:32.616 INFO:tasks.workunit.client.1.smithi156.stdout:3/160: readlink dc/l1b 0 2023-12-16T05:56:32.617 INFO:tasks.workunit.client.1.smithi156.stdout:5/227: dwrite da/dc/ff [0,4194304] 0 2023-12-16T05:56:32.617 INFO:tasks.workunit.client.1.smithi156.stdout:5/228: dread - da/f36 zero size 2023-12-16T05:56:32.618 INFO:tasks.workunit.client.0.smithi155.stdout:3/335: rename d0/d14/d51/f3c to d0/d1a/d33/d57/f63 0 2023-12-16T05:56:32.619 INFO:tasks.workunit.client.1.smithi156.stdout:3/161: symlink dc/d10/d1d/l3b 0 2023-12-16T05:56:32.620 INFO:tasks.workunit.client.0.smithi155.stdout:0/446: mknod d7/df/d6f/c8e 0 2023-12-16T05:56:32.620 INFO:tasks.workunit.client.0.smithi155.stdout:0/447: chown d7/df/d41/d23/l52 1444713 1 2023-12-16T05:56:32.620 INFO:tasks.workunit.client.0.smithi155.stdout:0/448: dread - d7/d13/d45/d4b/f67 zero size 2023-12-16T05:56:32.620 INFO:tasks.workunit.client.0.smithi155.stdout:5/537: dwrite d0/d2/d2a/d30/d53/d7b/d99/f5d [8388608,4194304] 0 2023-12-16T05:56:32.621 INFO:tasks.workunit.client.0.smithi155.stdout:0/449: write d7/d13/d45/f4f [1499453,80714] 0 2023-12-16T05:56:32.621 INFO:tasks.workunit.client.0.smithi155.stdout:0/450: write d7/df/f37 [5067826,54460] 0 2023-12-16T05:56:32.622 INFO:tasks.workunit.client.1.smithi156.stdout:7/262: rename d1e/d1f/d22/d2c/d33/d3e to d1e/d1f/d54 0 2023-12-16T05:56:32.622 INFO:tasks.workunit.client.1.smithi156.stdout:7/263: chown c16 32 1 2023-12-16T05:56:32.622 INFO:tasks.workunit.client.1.smithi156.stdout:7/264: dread - d1e/d1f/d22/f37 zero size 2023-12-16T05:56:32.623 INFO:tasks.workunit.client.1.smithi156.stdout:7/265: truncate d1e/d1f/d22/d2c/d33/f35 351976 0 2023-12-16T05:56:32.624 INFO:tasks.workunit.client.1.smithi156.stdout:5/229: unlink da/dc/f23 0 2023-12-16T05:56:32.628 INFO:tasks.workunit.client.0.smithi155.stdout:3/336: unlink d0/d1a/l53 0 2023-12-16T05:56:32.633 INFO:tasks.workunit.client.0.smithi155.stdout:9/521: dwrite da/d15/d17/d24/d26/f29 [0,4194304] 0 2023-12-16T05:56:32.634 INFO:tasks.workunit.client.1.smithi156.stdout:4/109: dwrite f8 [0,4194304] 0 2023-12-16T05:56:32.634 INFO:tasks.workunit.client.1.smithi156.stdout:5/230: dread da/dc/ff [0,4194304] 0 2023-12-16T05:56:32.634 INFO:tasks.workunit.client.1.smithi156.stdout:3/162: dread dc/d10/f11 [4194304,4194304] 0 2023-12-16T05:56:32.635 INFO:tasks.workunit.client.1.smithi156.stdout:3/163: truncate dc/df/f2d 257986 0 2023-12-16T05:56:32.635 INFO:tasks.workunit.client.1.smithi156.stdout:3/164: chown dc/le 1776770 1 2023-12-16T05:56:32.635 INFO:tasks.workunit.client.1.smithi156.stdout:4/110: unlink d9/ff 0 2023-12-16T05:56:32.636 INFO:tasks.workunit.client.1.smithi156.stdout:5/231: creat da/dc/d2d/f41 x:0 0 0 2023-12-16T05:56:32.636 INFO:tasks.workunit.client.1.smithi156.stdout:5/232: read - da/dc/f2e zero size 2023-12-16T05:56:32.636 INFO:tasks.workunit.client.1.smithi156.stdout:5/233: write da/f36 [99562,80149] 0 2023-12-16T05:56:32.636 INFO:tasks.workunit.client.1.smithi156.stdout:5/234: truncate da/f36 379167 0 2023-12-16T05:56:32.637 INFO:tasks.workunit.client.0.smithi155.stdout:5/538: unlink d0/d60/f74 0 2023-12-16T05:56:32.637 INFO:tasks.workunit.client.0.smithi155.stdout:5/539: fsync d0/d2/f1a 0 2023-12-16T05:56:32.637 INFO:tasks.workunit.client.1.smithi156.stdout:3/165: symlink dc/d10/d1d/d1f/l3c 0 2023-12-16T05:56:32.638 INFO:tasks.workunit.client.1.smithi156.stdout:4/111: creat d9/f22 x:0 0 0 2023-12-16T05:56:32.639 INFO:tasks.workunit.client.1.smithi156.stdout:5/235: rename da/dc/f2a to da/f42 0 2023-12-16T05:56:32.640 INFO:tasks.workunit.client.0.smithi155.stdout:4/418: rename d0/d10/d46/d16/d1a/c3f to d0/d10/d46/c84 0 2023-12-16T05:56:32.642 INFO:tasks.workunit.client.1.smithi156.stdout:4/112: dread d9/f19 [0,4194304] 0 2023-12-16T05:56:32.643 INFO:tasks.workunit.client.1.smithi156.stdout:4/113: creat d9/f23 x:0 0 0 2023-12-16T05:56:32.643 INFO:tasks.workunit.client.1.smithi156.stdout:4/114: write d9/f15 [1649729,101975] 0 2023-12-16T05:56:32.643 INFO:tasks.workunit.client.1.smithi156.stdout:4/115: chown d9/f21 3926769 1 2023-12-16T05:56:32.644 INFO:tasks.workunit.client.0.smithi155.stdout:0/451: rename d7/d13/d45/d3e/l72 to d7/df/d6f/l8f 0 2023-12-16T05:56:32.644 INFO:tasks.workunit.client.0.smithi155.stdout:0/452: chown d7/c7e 182622860 1 2023-12-16T05:56:32.645 INFO:tasks.workunit.client.0.smithi155.stdout:4/419: mkdir d0/da/d36/d5f/d75/d3d/d85 0 2023-12-16T05:56:32.646 INFO:tasks.workunit.client.1.smithi156.stdout:5/236: dread da/dc/f11 [4194304,4194304] 0 2023-12-16T05:56:32.647 INFO:tasks.workunit.client.1.smithi156.stdout:5/237: unlink da/dc/d2d/f33 0 2023-12-16T05:56:32.647 INFO:tasks.workunit.client.1.smithi156.stdout:5/238: creat da/dc/d2d/f43 x:0 0 0 2023-12-16T05:56:32.648 INFO:tasks.workunit.client.0.smithi155.stdout:9/522: rename da/d15/d17/d24/d26/d2e/d32/f5f to da/d15/d17/d36/d5b/fb6 0 2023-12-16T05:56:32.648 INFO:tasks.workunit.client.1.smithi156.stdout:5/239: rmdir da/d40 0 2023-12-16T05:56:32.649 INFO:tasks.workunit.client.0.smithi155.stdout:0/453: creat d7/d13/d45/d4b/f90 x:0 0 0 2023-12-16T05:56:32.650 INFO:tasks.workunit.client.1.smithi156.stdout:5/240: symlink da/dc/l44 0 2023-12-16T05:56:32.650 INFO:tasks.workunit.client.1.smithi156.stdout:5/241: fdatasync da/dc/f21 0 2023-12-16T05:56:32.650 INFO:tasks.workunit.client.1.smithi156.stdout:5/242: mknod da/c45 0 2023-12-16T05:56:32.650 INFO:tasks.workunit.client.1.smithi156.stdout:5/243: fdatasync da/dc/d2d/f41 0 2023-12-16T05:56:32.651 INFO:tasks.workunit.client.0.smithi155.stdout:4/420: mkdir d0/da/d36/d5f/d75/d86 0 2023-12-16T05:56:32.651 INFO:tasks.workunit.client.0.smithi155.stdout:9/523: mkdir da/d15/d17/d24/d26/d2e/d32/db7 0 2023-12-16T05:56:32.652 INFO:tasks.workunit.client.1.smithi156.stdout:5/244: mkdir da/d46 0 2023-12-16T05:56:32.653 INFO:tasks.workunit.client.0.smithi155.stdout:4/421: mknod d0/da/d36/d5f/c87 0 2023-12-16T05:56:32.653 INFO:tasks.workunit.client.0.smithi155.stdout:4/422: write d0/d10/f26 [2723826,40390] 0 2023-12-16T05:56:32.654 INFO:tasks.workunit.client.0.smithi155.stdout:9/524: symlink da/d15/d17/d24/lb8 0 2023-12-16T05:56:32.654 INFO:tasks.workunit.client.0.smithi155.stdout:9/525: truncate da/f5a 771096 0 2023-12-16T05:56:32.657 INFO:tasks.workunit.client.1.smithi156.stdout:4/116: dread d9/f16 [0,4194304] 0 2023-12-16T05:56:32.657 INFO:tasks.workunit.client.1.smithi156.stdout:4/117: dread - d9/f18 zero size 2023-12-16T05:56:32.658 INFO:tasks.workunit.client.0.smithi155.stdout:4/423: rename d0/da/d36/d5f/d75/d3d/d49/d6b to d0/d10/d46/d16/d30/d52/d88 0 2023-12-16T05:56:32.658 INFO:tasks.workunit.client.1.smithi156.stdout:4/118: truncate f4 874186 0 2023-12-16T05:56:32.660 INFO:tasks.workunit.client.0.smithi155.stdout:9/526: mkdir da/d15/d17/d36/d5b/d60/db9 0 2023-12-16T05:56:32.662 INFO:tasks.workunit.client.0.smithi155.stdout:4/424: mkdir d0/da/d36/d5f/d75/d89 0 2023-12-16T05:56:32.664 INFO:tasks.workunit.client.0.smithi155.stdout:9/527: mknod da/d15/d17/d24/d26/d2e/d32/db7/cba 0 2023-12-16T05:56:32.664 INFO:tasks.workunit.client.0.smithi155.stdout:9/528: chown da/d15/d17/d36/f4d 9 1 2023-12-16T05:56:32.664 INFO:tasks.workunit.client.0.smithi155.stdout:9/529: readlink da/d15/d17/d36/l7b 0 2023-12-16T05:56:32.664 INFO:tasks.workunit.client.0.smithi155.stdout:9/530: chown da/d15/d17/d24/d26/d2e 226723826 1 2023-12-16T05:56:32.664 INFO:tasks.workunit.client.0.smithi155.stdout:9/531: truncate da/d15/d17/d36/f4d 4369554 0 2023-12-16T05:56:32.664 INFO:tasks.workunit.client.0.smithi155.stdout:9/532: dread - da/d15/d17/d24/d26/d2e/d83/d8f/d9c/fa4 zero size 2023-12-16T05:56:32.664 INFO:tasks.workunit.client.0.smithi155.stdout:9/533: fdatasync da/d15/d17/d36/d5b/d98/faf 0 2023-12-16T05:56:32.665 INFO:tasks.workunit.client.0.smithi155.stdout:4/425: rename d0/da/d36/d5f/d75/d3d/d43/f4a to d0/da/d36/d5f/d75/d89/f8a 0 2023-12-16T05:56:32.667 INFO:tasks.workunit.client.0.smithi155.stdout:9/534: stat da/d15/d17/d36/d5b/d60/d9e/caa 0 2023-12-16T05:56:32.669 INFO:tasks.workunit.client.0.smithi155.stdout:4/426: write d0/f28 [1660407,67368] 0 2023-12-16T05:56:32.669 INFO:tasks.workunit.client.0.smithi155.stdout:9/535: creat da/d15/d17/d24/d62/fbb x:0 0 0 2023-12-16T05:56:32.670 INFO:tasks.workunit.client.1.smithi156.stdout:5/245: dwrite da/f27 [0,4194304] 0 2023-12-16T05:56:32.672 INFO:tasks.workunit.client.0.smithi155.stdout:9/536: mknod da/d15/d17/d36/cbc 0 2023-12-16T05:56:32.673 INFO:tasks.workunit.client.1.smithi156.stdout:5/246: symlink da/l47 0 2023-12-16T05:56:32.673 INFO:tasks.workunit.client.1.smithi156.stdout:5/247: chown da/l38 3100025 1 2023-12-16T05:56:32.673 INFO:tasks.workunit.client.1.smithi156.stdout:5/248: readlink da/dc/l30 0 2023-12-16T05:56:32.673 INFO:tasks.workunit.client.1.smithi156.stdout:5/249: chown da/dc/c3b 2 1 2023-12-16T05:56:32.673 INFO:tasks.workunit.client.1.smithi156.stdout:5/250: chown da/dc/f21 0 1 2023-12-16T05:56:32.674 INFO:tasks.workunit.client.0.smithi155.stdout:9/537: creat da/d15/d17/d36/d54/fbd x:0 0 0 2023-12-16T05:56:32.675 INFO:tasks.workunit.client.0.smithi155.stdout:0/454: dwrite d7/df/f58 [4194304,4194304] 0 2023-12-16T05:56:32.678 INFO:tasks.workunit.client.1.smithi156.stdout:5/251: dread da/dc/ff [0,4194304] 0 2023-12-16T05:56:32.680 INFO:tasks.workunit.client.1.smithi156.stdout:4/119: dwrite d9/f18 [0,4194304] 0 2023-12-16T05:56:32.681 INFO:tasks.workunit.client.1.smithi156.stdout:5/252: write da/f27 [998920,76203] 0 2023-12-16T05:56:32.683 INFO:tasks.workunit.client.0.smithi155.stdout:9/538: dread da/d15/f1d [0,4194304] 0 2023-12-16T05:56:32.684 INFO:tasks.workunit.client.1.smithi156.stdout:4/120: creat d9/f24 x:0 0 0 2023-12-16T05:56:32.684 INFO:tasks.workunit.client.0.smithi155.stdout:9/539: getdents da/d15/d17/d24/d26/d2e/d83 0 2023-12-16T05:56:32.685 INFO:tasks.workunit.client.1.smithi156.stdout:5/253: truncate da/dc/f11 6846534 0 2023-12-16T05:56:32.686 INFO:tasks.workunit.client.0.smithi155.stdout:9/540: creat da/fbe x:0 0 0 2023-12-16T05:56:32.687 INFO:tasks.workunit.client.0.smithi155.stdout:4/427: dwrite d0/d10/d46/d16/d1a/f72 [0,4194304] 0 2023-12-16T05:56:32.687 INFO:tasks.workunit.client.0.smithi155.stdout:4/428: chown d0/d10/d46/d16/d1a/f2b 2522080 1 2023-12-16T05:56:32.689 INFO:tasks.workunit.client.1.smithi156.stdout:5/254: write da/f1e [3021626,31769] 0 2023-12-16T05:56:32.690 INFO:tasks.workunit.client.0.smithi155.stdout:9/541: write da/ff [1474260,52362] 0 2023-12-16T05:56:32.690 INFO:tasks.workunit.client.0.smithi155.stdout:9/542: dread - da/d15/d17/d36/d5b/fb6 zero size 2023-12-16T05:56:32.692 INFO:tasks.workunit.client.0.smithi155.stdout:9/543: write da/d15/d17/d24/d26/d2e/d32/f35 [476073,28068] 0 2023-12-16T05:56:32.693 INFO:tasks.workunit.client.0.smithi155.stdout:4/429: rename d0/d10/d46/c18 to d0/d10/d46/d16/d1a/d70/c8b 0 2023-12-16T05:56:32.694 INFO:tasks.workunit.client.0.smithi155.stdout:9/544: symlink da/d15/d17/d24/d26/d2e/d83/lbf 0 2023-12-16T05:56:32.696 INFO:tasks.workunit.client.0.smithi155.stdout:4/430: creat d0/d10/f8c x:0 0 0 2023-12-16T05:56:32.697 INFO:tasks.workunit.client.0.smithi155.stdout:9/545: write da/d15/d17/d24/d26/f44 [4035287,12407] 0 2023-12-16T05:56:32.697 INFO:tasks.workunit.client.0.smithi155.stdout:4/431: creat d0/d10/d46/d16/d30/f8d x:0 0 0 2023-12-16T05:56:32.700 INFO:tasks.workunit.client.0.smithi155.stdout:6/582: sync 2023-12-16T05:56:32.701 INFO:tasks.workunit.client.0.smithi155.stdout:0/455: dwrite d7/d13/d45/f49 [0,4194304] 0 2023-12-16T05:56:32.701 INFO:tasks.workunit.client.0.smithi155.stdout:9/546: mkdir da/d15/d17/d24/d62/d91/dc0 0 2023-12-16T05:56:32.702 INFO:tasks.workunit.client.0.smithi155.stdout:0/456: dread d7/fb [4194304,4194304] 0 2023-12-16T05:56:32.702 INFO:tasks.workunit.client.0.smithi155.stdout:0/457: chown d7/f83 976 1 2023-12-16T05:56:32.702 INFO:tasks.workunit.client.0.smithi155.stdout:0/458: truncate d7/df/d41/f77 414739 0 2023-12-16T05:56:32.703 INFO:tasks.workunit.client.0.smithi155.stdout:0/459: write d7/d13/d45/d4b/f8c [229351,12205] 0 2023-12-16T05:56:32.703 INFO:tasks.workunit.client.0.smithi155.stdout:6/583: creat d0/d3/d7a/db0/fb7 x:0 0 0 2023-12-16T05:56:32.703 INFO:tasks.workunit.client.0.smithi155.stdout:6/584: stat d0/d3/d2c/d3e/d4c/d1b/l20 0 2023-12-16T05:56:32.709 INFO:tasks.workunit.client.0.smithi155.stdout:0/460: mknod d7/df/c91 0 2023-12-16T05:56:32.711 INFO:tasks.workunit.client.0.smithi155.stdout:6/585: rmdir d0/df/d5e/d99 39 2023-12-16T05:56:32.712 INFO:tasks.workunit.client.0.smithi155.stdout:6/586: stat d0/d3/d2c/d3e/d4c/d1b/f22 0 2023-12-16T05:56:32.712 INFO:tasks.workunit.client.1.smithi156.stdout:2/178: sync 2023-12-16T05:56:32.712 INFO:tasks.workunit.client.1.smithi156.stdout:1/67: sync 2023-12-16T05:56:32.712 INFO:tasks.workunit.client.1.smithi156.stdout:2/179: stat l3 0 2023-12-16T05:56:32.713 INFO:tasks.workunit.client.1.smithi156.stdout:2/180: read - d9/dd/d17/f1d zero size 2023-12-16T05:56:32.713 INFO:tasks.workunit.client.1.smithi156.stdout:0/164: sync 2023-12-16T05:56:32.713 INFO:tasks.workunit.client.1.smithi156.stdout:0/165: chown d2/f1b 1590043 1 2023-12-16T05:56:32.713 INFO:tasks.workunit.client.1.smithi156.stdout:0/166: write d2/d7/dd/d1c/f25 [567319,8869] 0 2023-12-16T05:56:32.713 INFO:tasks.workunit.client.1.smithi156.stdout:0/167: rename d2 to d2/d7/dd/d1c/d2c 22 2023-12-16T05:56:32.714 INFO:tasks.workunit.client.1.smithi156.stdout:1/68: creat d3/f14 x:0 0 0 2023-12-16T05:56:32.716 INFO:tasks.workunit.client.1.smithi156.stdout:2/181: unlink d9/fb 0 2023-12-16T05:56:32.718 INFO:tasks.workunit.client.0.smithi155.stdout:6/587: dread d0/df/d5e/d46/f65 [0,4194304] 0 2023-12-16T05:56:32.718 INFO:tasks.workunit.client.0.smithi155.stdout:6/588: dread - d0/d3/d2c/d3e/d4c/fa2 zero size 2023-12-16T05:56:32.719 INFO:tasks.workunit.client.1.smithi156.stdout:0/168: mkdir d2/d7/dd/d2d 0 2023-12-16T05:56:32.719 INFO:tasks.workunit.client.1.smithi156.stdout:1/69: creat d3/f15 x:0 0 0 2023-12-16T05:56:32.719 INFO:tasks.workunit.client.1.smithi156.stdout:1/70: chown d3/fb 2852283 1 2023-12-16T05:56:32.720 INFO:tasks.workunit.client.0.smithi155.stdout:6/589: mkdir d0/d3/d2c/db8 0 2023-12-16T05:56:32.721 INFO:tasks.workunit.client.1.smithi156.stdout:2/182: write d9/f27 [2356222,120832] 0 2023-12-16T05:56:32.721 INFO:tasks.workunit.client.0.smithi155.stdout:6/590: symlink d0/df/d5e/d46/d6d/lb9 0 2023-12-16T05:56:32.722 INFO:tasks.workunit.client.1.smithi156.stdout:1/71: creat d3/f16 x:0 0 0 2023-12-16T05:56:32.723 INFO:tasks.workunit.client.0.smithi155.stdout:6/591: creat d0/d3/d2c/d3e/d4c/fba x:0 0 0 2023-12-16T05:56:32.723 INFO:tasks.workunit.client.0.smithi155.stdout:6/592: dread - d0/df/d5e/d99/fb2 zero size 2023-12-16T05:56:32.724 INFO:tasks.workunit.client.0.smithi155.stdout:9/547: dwrite da/d15/d17/d24/d26/f2a [0,4194304] 0 2023-12-16T05:56:32.724 INFO:tasks.workunit.client.0.smithi155.stdout:9/548: fdatasync da/d15/d17/f9a 0 2023-12-16T05:56:32.724 INFO:tasks.workunit.client.1.smithi156.stdout:0/169: truncate d2/d7/dd/f19 2679911 0 2023-12-16T05:56:32.724 INFO:tasks.workunit.client.1.smithi156.stdout:0/170: fdatasync d2/f28 0 2023-12-16T05:56:32.724 INFO:tasks.workunit.client.1.smithi156.stdout:1/72: mkdir d3/d17 0 2023-12-16T05:56:32.725 INFO:tasks.workunit.client.1.smithi156.stdout:0/171: mkdir d2/d7/dd/d29/d2e 0 2023-12-16T05:56:32.730 INFO:tasks.workunit.client.1.smithi156.stdout:5/255: dwrite da/dc/f31 [0,4194304] 0 2023-12-16T05:56:32.731 INFO:tasks.workunit.client.0.smithi155.stdout:4/432: dwrite d0/d10/d46/d16/f4b [0,4194304] 0 2023-12-16T05:56:32.734 INFO:tasks.workunit.client.1.smithi156.stdout:5/256: creat da/f48 x:0 0 0 2023-12-16T05:56:32.734 INFO:tasks.workunit.client.1.smithi156.stdout:5/257: fdatasync da/dc/f13 0 2023-12-16T05:56:32.735 INFO:tasks.workunit.client.1.smithi156.stdout:5/258: creat da/f49 x:0 0 0 2023-12-16T05:56:32.737 INFO:tasks.workunit.client.1.smithi156.stdout:0/172: dread d2/d7/f10 [0,4194304] 0 2023-12-16T05:56:32.743 INFO:tasks.workunit.client.0.smithi155.stdout:4/433: dread d0/d10/d46/d16/d1a/f35 [0,4194304] 0 2023-12-16T05:56:32.744 INFO:tasks.workunit.client.0.smithi155.stdout:4/434: truncate d0/f4 2887565 0 2023-12-16T05:56:32.744 INFO:tasks.workunit.client.0.smithi155.stdout:4/435: chown d0/da/d36/d5f/d75/d3d/l5d 57 1 2023-12-16T05:56:32.744 INFO:tasks.workunit.client.1.smithi156.stdout:5/259: dread f4 [0,4194304] 0 2023-12-16T05:56:32.745 INFO:tasks.workunit.client.1.smithi156.stdout:5/260: chown da/l25 7 1 2023-12-16T05:56:32.745 INFO:tasks.workunit.client.1.smithi156.stdout:5/261: chown da/dc/l44 1404 1 2023-12-16T05:56:32.745 INFO:tasks.workunit.client.1.smithi156.stdout:5/262: symlink da/d46/l4a 0 2023-12-16T05:56:32.745 INFO:tasks.workunit.client.1.smithi156.stdout:5/263: chown da/dc/f17 4074083 1 2023-12-16T05:56:32.746 INFO:tasks.workunit.client.1.smithi156.stdout:5/264: fsync da/f14 0 2023-12-16T05:56:32.746 INFO:tasks.workunit.client.1.smithi156.stdout:5/265: readlink da/l32 0 2023-12-16T05:56:32.748 INFO:tasks.workunit.client.0.smithi155.stdout:0/461: dwrite d7/df/d6f/f82 [0,4194304] 0 2023-12-16T05:56:32.748 INFO:tasks.workunit.client.1.smithi156.stdout:5/266: rmdir da/dc 39 2023-12-16T05:56:32.748 INFO:tasks.workunit.client.0.smithi155.stdout:9/549: dwrite da/d15/d17/d36/d5b/d98/faf [0,4194304] 0 2023-12-16T05:56:32.748 INFO:tasks.workunit.client.0.smithi155.stdout:9/550: chown da/d15/d17/d24/d26 23017 1 2023-12-16T05:56:32.749 INFO:tasks.workunit.client.0.smithi155.stdout:9/551: write da/d15/d17/d24/d26/d2e/f63 [1063179,126602] 0 2023-12-16T05:56:32.750 INFO:tasks.workunit.client.1.smithi156.stdout:2/183: dwrite d9/f20 [0,4194304] 0 2023-12-16T05:56:32.750 INFO:tasks.workunit.client.1.smithi156.stdout:2/184: chown d9/d12/f18 33213185 1 2023-12-16T05:56:32.750 INFO:tasks.workunit.client.1.smithi156.stdout:2/185: fdatasync d9/dd/d17/f2b 0 2023-12-16T05:56:32.750 INFO:tasks.workunit.client.1.smithi156.stdout:2/186: readlink d9/dd/d17/d33/lf 0 2023-12-16T05:56:32.751 INFO:tasks.workunit.client.1.smithi156.stdout:5/267: mkdir da/dc/d4b 0 2023-12-16T05:56:32.753 INFO:tasks.workunit.client.0.smithi155.stdout:0/462: rename d7/df/c25 to d7/d47/d5d/d84/c92 0 2023-12-16T05:56:32.753 INFO:tasks.workunit.client.0.smithi155.stdout:4/436: dread d0/d10/d46/d16/d30/f33 [0,4194304] 0 2023-12-16T05:56:32.754 INFO:tasks.workunit.client.0.smithi155.stdout:4/437: write d0/d10/f26 [526840,102500] 0 2023-12-16T05:56:32.754 INFO:tasks.workunit.client.0.smithi155.stdout:4/438: fdatasync d0/d10/d46/f1c 0 2023-12-16T05:56:32.755 INFO:tasks.workunit.client.0.smithi155.stdout:0/463: read d7/df/f7f [50,97426] 0 2023-12-16T05:56:32.755 INFO:tasks.workunit.client.1.smithi156.stdout:5/268: dread da/f26 [0,4194304] 0 2023-12-16T05:56:32.756 INFO:tasks.workunit.client.1.smithi156.stdout:1/73: dread d3/fc [0,4194304] 0 2023-12-16T05:56:32.756 INFO:tasks.workunit.client.1.smithi156.stdout:1/74: chown f0 6578 1 2023-12-16T05:56:32.757 INFO:tasks.workunit.client.0.smithi155.stdout:9/552: mkdir da/d15/d17/d36/dc1 0 2023-12-16T05:56:32.758 INFO:tasks.workunit.client.1.smithi156.stdout:5/269: unlink da/dc/l2b 0 2023-12-16T05:56:32.758 INFO:tasks.workunit.client.0.smithi155.stdout:4/439: creat d0/d10/d46/d16/f8e x:0 0 0 2023-12-16T05:56:32.759 INFO:tasks.workunit.client.1.smithi156.stdout:8/111: sync 2023-12-16T05:56:32.759 INFO:tasks.workunit.client.1.smithi156.stdout:9/141: sync 2023-12-16T05:56:32.760 INFO:tasks.workunit.client.0.smithi155.stdout:9/553: dread da/d15/d17/d24/d26/d2e/d32/f35 [0,4194304] 0 2023-12-16T05:56:32.760 INFO:tasks.workunit.client.0.smithi155.stdout:0/464: creat d7/d47/d53/f93 x:0 0 0 2023-12-16T05:56:32.760 INFO:tasks.workunit.client.1.smithi156.stdout:9/142: creat d6/d19/d25/f34 x:0 0 0 2023-12-16T05:56:32.761 INFO:tasks.workunit.client.0.smithi155.stdout:4/440: mknod d0/da/d36/d5f/d75/c8f 0 2023-12-16T05:56:32.761 INFO:tasks.workunit.client.0.smithi155.stdout:4/441: fdatasync d0/da/d36/d5f/d75/f23 0 2023-12-16T05:56:32.762 INFO:tasks.workunit.client.1.smithi156.stdout:9/143: dread d6/f28 [0,4194304] 0 2023-12-16T05:56:32.763 INFO:tasks.workunit.client.1.smithi156.stdout:9/144: dread - d6/d19/f24 zero size 2023-12-16T05:56:32.763 INFO:tasks.workunit.client.1.smithi156.stdout:9/145: dread - d6/d19/f1f zero size 2023-12-16T05:56:32.763 INFO:tasks.workunit.client.1.smithi156.stdout:8/112: creat d3/d18/f22 x:0 0 0 2023-12-16T05:56:32.763 INFO:tasks.workunit.client.0.smithi155.stdout:0/465: creat d7/d13/d45/d3e/f94 x:0 0 0 2023-12-16T05:56:32.763 INFO:tasks.workunit.client.0.smithi155.stdout:0/466: fsync d7/df/d73/d8d/d4d/f80 0 2023-12-16T05:56:32.763 INFO:tasks.workunit.client.0.smithi155.stdout:0/467: fsync d7/d13/f17 0 2023-12-16T05:56:32.763 INFO:tasks.workunit.client.0.smithi155.stdout:4/442: mkdir d0/da/d36/d5f/d7b/d90 0 2023-12-16T05:56:32.763 INFO:tasks.workunit.client.1.smithi156.stdout:9/146: link d6/d19/f24 d6/d2e/f35 0 2023-12-16T05:56:32.764 INFO:tasks.workunit.client.1.smithi156.stdout:8/113: symlink d3/d18/l23 0 2023-12-16T05:56:32.764 INFO:tasks.workunit.client.1.smithi156.stdout:8/114: write d3/d18/f1f [62968,118504] 0 2023-12-16T05:56:32.764 INFO:tasks.workunit.client.0.smithi155.stdout:4/443: symlink d0/d10/d46/d16/d30/d52/l91 0 2023-12-16T05:56:32.765 INFO:tasks.workunit.client.0.smithi155.stdout:4/444: readlink d0/da/d36/d5f/d75/d3d/d49/l53 0 2023-12-16T05:56:32.765 INFO:tasks.workunit.client.0.smithi155.stdout:4/445: mkdir d0/d10/d46/d16/d1a/d70/d92 0 2023-12-16T05:56:32.766 INFO:tasks.workunit.client.0.smithi155.stdout:4/446: symlink d0/d10/d46/d16/d30/l93 0 2023-12-16T05:56:32.767 INFO:tasks.workunit.client.1.smithi156.stdout:9/147: rename d6/l12 to d6/d19/d30/l36 0 2023-12-16T05:56:32.767 INFO:tasks.workunit.client.1.smithi156.stdout:9/148: chown d6/fe 1 1 2023-12-16T05:56:32.767 INFO:tasks.workunit.client.0.smithi155.stdout:2/415: sync 2023-12-16T05:56:32.767 INFO:tasks.workunit.client.0.smithi155.stdout:8/416: sync 2023-12-16T05:56:32.768 INFO:tasks.workunit.client.1.smithi156.stdout:2/187: truncate d9/f20 852427 0 2023-12-16T05:56:32.769 INFO:tasks.workunit.client.0.smithi155.stdout:1/539: sync 2023-12-16T05:56:32.769 INFO:tasks.workunit.client.1.smithi156.stdout:8/115: mknod d3/d12/c24 0 2023-12-16T05:56:32.771 INFO:tasks.workunit.client.1.smithi156.stdout:2/188: getdents d9/dd 0 2023-12-16T05:56:32.771 INFO:tasks.workunit.client.1.smithi156.stdout:2/189: read - d9/dd/d17/d33/f2c zero size 2023-12-16T05:56:32.772 INFO:tasks.workunit.client.1.smithi156.stdout:8/116: rmdir d3/d6 39 2023-12-16T05:56:32.774 INFO:tasks.workunit.client.1.smithi156.stdout:9/149: rename d6/f28 to d6/d19/f37 0 2023-12-16T05:56:32.775 INFO:tasks.workunit.client.1.smithi156.stdout:2/190: creat d9/f35 x:0 0 0 2023-12-16T05:56:32.776 INFO:tasks.workunit.client.1.smithi156.stdout:8/117: link d3/d18/f19 d3/d12/f25 0 2023-12-16T05:56:32.776 INFO:tasks.workunit.client.1.smithi156.stdout:8/118: chown d3/d18/f1b 16042 1 2023-12-16T05:56:32.777 INFO:tasks.workunit.client.1.smithi156.stdout:8/119: chown d3/d18/l23 61000371 1 2023-12-16T05:56:32.777 INFO:tasks.workunit.client.1.smithi156.stdout:2/191: creat d9/d12/f36 x:0 0 0 2023-12-16T05:56:32.777 INFO:tasks.workunit.client.0.smithi155.stdout:2/416: truncate d0/d5/f23 1515297 0 2023-12-16T05:56:32.779 INFO:tasks.workunit.client.1.smithi156.stdout:2/192: unlink f1 0 2023-12-16T05:56:32.781 INFO:tasks.workunit.client.0.smithi155.stdout:1/540: creat d1/d7/d4b/d72/d7e/fae x:0 0 0 2023-12-16T05:56:32.781 INFO:tasks.workunit.client.1.smithi156.stdout:2/193: unlink d9/dd/l30 0 2023-12-16T05:56:32.783 INFO:tasks.workunit.client.1.smithi156.stdout:2/194: rename d9/d12/c2e to d9/dd/c37 0 2023-12-16T05:56:32.786 INFO:tasks.workunit.client.0.smithi155.stdout:1/541: link d1/d17/d28/d74/fa3 d1/d17/d28/d74/faf 0 2023-12-16T05:56:32.788 INFO:tasks.workunit.client.0.smithi155.stdout:0/468: rmdir d7/d47/d53 39 2023-12-16T05:56:32.788 INFO:tasks.workunit.client.0.smithi155.stdout:1/542: creat d1/d7/d4b/d72/d7e/fb0 x:0 0 0 2023-12-16T05:56:32.788 INFO:tasks.workunit.client.1.smithi156.stdout:2/195: dread d9/d12/f23 [0,4194304] 0 2023-12-16T05:56:32.789 INFO:tasks.workunit.client.1.smithi156.stdout:2/196: write d9/dd/f19 [6047785,98174] 0 2023-12-16T05:56:32.789 INFO:tasks.workunit.client.0.smithi155.stdout:0/469: mkdir d7/df/d73/d8d/d4d/d95 0 2023-12-16T05:56:32.789 INFO:tasks.workunit.client.0.smithi155.stdout:1/543: read d1/d25/f9b [2904,108624] 0 2023-12-16T05:56:32.789 INFO:tasks.workunit.client.0.smithi155.stdout:1/544: write d1/d7/fa0 [648325,80968] 0 2023-12-16T05:56:32.790 INFO:tasks.workunit.client.1.smithi156.stdout:2/197: rmdir d9/dd/d17 39 2023-12-16T05:56:32.790 INFO:tasks.workunit.client.0.smithi155.stdout:0/470: rmdir d7/df/d73/d8d/d4d/d95 0 2023-12-16T05:56:32.791 INFO:tasks.workunit.client.1.smithi156.stdout:2/198: mkdir d9/dd/d17/d33/d38 0 2023-12-16T05:56:32.792 INFO:tasks.workunit.client.1.smithi156.stdout:2/199: mkdir d9/dd/d17/d33/d38/d39 0 2023-12-16T05:56:32.793 INFO:tasks.workunit.client.1.smithi156.stdout:2/200: creat d9/dd/d17/f3a x:0 0 0 2023-12-16T05:56:32.794 INFO:tasks.workunit.client.1.smithi156.stdout:2/201: truncate d9/dd/f2f 3852097 0 2023-12-16T05:56:32.795 INFO:tasks.workunit.client.0.smithi155.stdout:0/471: symlink d7/df/d73/d8d/d4d/l96 0 2023-12-16T05:56:32.795 INFO:tasks.workunit.client.0.smithi155.stdout:1/545: creat d1/d17/d28/d8f/dad/fb1 x:0 0 0 2023-12-16T05:56:32.795 INFO:tasks.workunit.client.0.smithi155.stdout:1/546: chown d1/d7/d4b/d5c 304061 1 2023-12-16T05:56:32.795 INFO:tasks.workunit.client.0.smithi155.stdout:1/547: read - d1/d7/d4b/d72/d7e/fb0 zero size 2023-12-16T05:56:32.796 INFO:tasks.workunit.client.1.smithi156.stdout:2/202: read f5 [1423099,20735] 0 2023-12-16T05:56:32.797 INFO:tasks.workunit.client.0.smithi155.stdout:1/548: mkdir d1/d17/d28/d8f/db2 0 2023-12-16T05:56:32.797 INFO:tasks.workunit.client.0.smithi155.stdout:1/549: write d1/d17/f65 [3787033,1721] 0 2023-12-16T05:56:32.797 INFO:tasks.workunit.client.0.smithi155.stdout:1/550: fsync d1/d17/d28/d85/fa8 0 2023-12-16T05:56:32.798 INFO:tasks.workunit.client.1.smithi156.stdout:0/173: truncate f0 1906118 0 2023-12-16T05:56:32.798 INFO:tasks.workunit.client.1.smithi156.stdout:0/174: stat d2/d7/f15 0 2023-12-16T05:56:32.800 INFO:tasks.workunit.client.0.smithi155.stdout:1/551: write d1/d25/d43/f5b [7447672,95764] 0 2023-12-16T05:56:32.801 INFO:tasks.workunit.client.0.smithi155.stdout:1/552: read - d1/d7/d4b/d72/d79/f9c zero size 2023-12-16T05:56:32.801 INFO:tasks.workunit.client.0.smithi155.stdout:1/553: dread - d1/d17/d28/f93 zero size 2023-12-16T05:56:32.804 INFO:tasks.workunit.client.1.smithi156.stdout:2/203: write f2 [3429722,13136] 0 2023-12-16T05:56:32.804 INFO:tasks.workunit.client.1.smithi156.stdout:2/204: dread - d9/dd/d17/f2b zero size 2023-12-16T05:56:32.804 INFO:tasks.workunit.client.1.smithi156.stdout:2/205: fdatasync d9/f1f 0 2023-12-16T05:56:32.805 INFO:tasks.workunit.client.1.smithi156.stdout:2/206: symlink d9/l3b 0 2023-12-16T05:56:32.805 INFO:tasks.workunit.client.1.smithi156.stdout:2/207: read - d9/d12/f36 zero size 2023-12-16T05:56:32.806 INFO:tasks.workunit.client.1.smithi156.stdout:2/208: dread - d9/dd/f21 zero size 2023-12-16T05:56:32.808 INFO:tasks.workunit.client.1.smithi156.stdout:2/209: write f8 [2070597,7308] 0 2023-12-16T05:56:32.810 INFO:tasks.workunit.client.1.smithi156.stdout:2/210: truncate d9/dd/f1b 181788 0 2023-12-16T05:56:32.814 INFO:tasks.workunit.client.0.smithi155.stdout:0/472: dread f2 [0,4194304] 0 2023-12-16T05:56:32.814 INFO:tasks.workunit.client.0.smithi155.stdout:0/473: fsync d7/fb 0 2023-12-16T05:56:32.822 INFO:tasks.workunit.client.0.smithi155.stdout:8/417: dwrite d4/da/d1b/f7c [0,4194304] 0 2023-12-16T05:56:32.822 INFO:tasks.workunit.client.0.smithi155.stdout:4/447: dwrite d0/f20 [0,4194304] 0 2023-12-16T05:56:32.823 INFO:tasks.workunit.client.0.smithi155.stdout:4/448: write d0/d10/d46/d16/d1a/f69 [451920,31029] 0 2023-12-16T05:56:32.826 INFO:tasks.workunit.client.0.smithi155.stdout:8/418: mkdir d4/d62/d66/d78/d80 0 2023-12-16T05:56:32.829 INFO:tasks.workunit.client.0.smithi155.stdout:8/419: mknod d4/d62/c81 0 2023-12-16T05:56:32.830 INFO:tasks.workunit.client.1.smithi156.stdout:9/150: dwrite d6/f14 [0,4194304] 0 2023-12-16T05:56:32.832 INFO:tasks.workunit.client.0.smithi155.stdout:8/420: dread d4/da/d1b/d2a/d51/f6e [0,4194304] 0 2023-12-16T05:56:32.832 INFO:tasks.workunit.client.0.smithi155.stdout:9/554: dwrite da/d15/d17/d24/d26/f58 [0,4194304] 0 2023-12-16T05:56:32.833 INFO:tasks.workunit.client.1.smithi156.stdout:1/75: dwrite d3/f15 [0,4194304] 0 2023-12-16T05:56:32.834 INFO:tasks.workunit.client.0.smithi155.stdout:9/555: mkdir da/d15/d17/d36/d5b/d98/dc2 0 2023-12-16T05:56:32.834 INFO:tasks.workunit.client.0.smithi155.stdout:8/421: write d4/da/d1b/d1c/d1a/f2c [2067542,125302] 0 2023-12-16T05:56:32.835 INFO:tasks.workunit.client.0.smithi155.stdout:9/556: symlink da/lc3 0 2023-12-16T05:56:32.835 INFO:tasks.workunit.client.0.smithi155.stdout:9/557: truncate da/d15/d17/d24/d26/d2e/f87 538308 0 2023-12-16T05:56:32.836 INFO:tasks.workunit.client.1.smithi156.stdout:9/151: unlink d6/c8 0 2023-12-16T05:56:32.836 INFO:tasks.workunit.client.0.smithi155.stdout:8/422: creat d4/d62/d66/d78/f82 x:0 0 0 2023-12-16T05:56:32.839 INFO:tasks.workunit.client.0.smithi155.stdout:9/558: rename da/d15/d17/d36/f4e to da/d15/d17/d24/d62/fc4 0 2023-12-16T05:56:32.839 INFO:tasks.workunit.client.0.smithi155.stdout:8/423: symlink d4/da/d1b/d1c/l83 0 2023-12-16T05:56:32.841 INFO:tasks.workunit.client.1.smithi156.stdout:0/175: dwrite d2/d7/f15 [0,4194304] 0 2023-12-16T05:56:32.842 INFO:tasks.workunit.client.1.smithi156.stdout:9/152: creat d6/d19/d25/f38 x:0 0 0 2023-12-16T05:56:32.842 INFO:tasks.workunit.client.1.smithi156.stdout:9/153: readlink d6/d19/d25/l2b 0 2023-12-16T05:56:32.845 INFO:tasks.workunit.client.0.smithi155.stdout:0/474: dwrite d7/d13/f1b [0,4194304] 0 2023-12-16T05:56:32.845 INFO:tasks.workunit.client.0.smithi155.stdout:1/554: dwrite d1/d17/d28/d8f/fa4 [0,4194304] 0 2023-12-16T05:56:32.845 INFO:tasks.workunit.client.0.smithi155.stdout:1/555: dread - d1/d17/d28/f93 zero size 2023-12-16T05:56:32.846 INFO:tasks.workunit.client.0.smithi155.stdout:2/417: dwrite d0/d7/dd/f6e [0,4194304] 0 2023-12-16T05:56:32.846 INFO:tasks.workunit.client.0.smithi155.stdout:2/418: chown d0/d7/dd/d49/d4b/d80 8218 1 2023-12-16T05:56:32.846 INFO:tasks.workunit.client.0.smithi155.stdout:2/419: readlink d0/d34/l4d 0 2023-12-16T05:56:32.846 INFO:tasks.workunit.client.1.smithi156.stdout:5/270: dwrite da/dc/f3d [0,4194304] 0 2023-12-16T05:56:32.848 INFO:tasks.workunit.client.0.smithi155.stdout:0/475: write d7/d13/d45/d4b/f5f [1153468,73152] 0 2023-12-16T05:56:32.849 INFO:tasks.workunit.client.0.smithi155.stdout:4/449: dwrite d0/da/d36/d5f/f66 [4194304,4194304] 0 2023-12-16T05:56:32.849 INFO:tasks.workunit.client.0.smithi155.stdout:4/450: truncate d0/d10/f8c 620190 0 2023-12-16T05:56:32.849 INFO:tasks.workunit.client.0.smithi155.stdout:4/451: chown d0/d10/d46/d16/d30/d52/l59 1137 1 2023-12-16T05:56:32.849 INFO:tasks.workunit.client.0.smithi155.stdout:4/452: stat d0/da/d36/l77 0 2023-12-16T05:56:32.849 INFO:tasks.workunit.client.1.smithi156.stdout:9/154: creat d6/d19/d30/f39 x:0 0 0 2023-12-16T05:56:32.852 INFO:tasks.workunit.client.1.smithi156.stdout:1/76: dwrite d3/f14 [0,4194304] 0 2023-12-16T05:56:32.853 INFO:tasks.workunit.client.0.smithi155.stdout:1/556: creat d1/d17/d28/d8f/fb3 x:0 0 0 2023-12-16T05:56:32.857 INFO:tasks.workunit.client.1.smithi156.stdout:5/271: creat da/dc/d2d/f4c x:0 0 0 2023-12-16T05:56:32.858 INFO:tasks.workunit.client.0.smithi155.stdout:2/420: creat d0/d5/d6/d5f/f8e x:0 0 0 2023-12-16T05:56:32.862 INFO:tasks.workunit.client.0.smithi155.stdout:0/476: creat d7/df/d41/f97 x:0 0 0 2023-12-16T05:56:32.864 INFO:tasks.workunit.client.1.smithi156.stdout:1/77: creat d3/f18 x:0 0 0 2023-12-16T05:56:32.867 INFO:tasks.workunit.client.1.smithi156.stdout:2/211: link d9/dd/f1b d9/dd/d17/d33/d38/f3c 0 2023-12-16T05:56:32.870 INFO:tasks.workunit.client.0.smithi155.stdout:4/453: creat d0/d10/d46/d16/d30/d52/d88/f94 x:0 0 0 2023-12-16T05:56:32.873 INFO:tasks.workunit.client.1.smithi156.stdout:1/78: dread f0 [0,4194304] 0 2023-12-16T05:56:32.873 INFO:tasks.workunit.client.1.smithi156.stdout:9/155: dwrite d6/d19/d25/f38 [0,4194304] 0 2023-12-16T05:56:32.873 INFO:tasks.workunit.client.1.smithi156.stdout:9/156: truncate d6/d19/f1b 71837 0 2023-12-16T05:56:32.874 INFO:tasks.workunit.client.0.smithi155.stdout:1/557: rename d1/d92/cac to d1/d7/d4b/d72/d7e/cb4 0 2023-12-16T05:56:32.874 INFO:tasks.workunit.client.1.smithi156.stdout:5/272: dread da/f1e [0,4194304] 0 2023-12-16T05:56:32.874 INFO:tasks.workunit.client.1.smithi156.stdout:1/79: mkdir d3/d17/d19 0 2023-12-16T05:56:32.874 INFO:tasks.workunit.client.1.smithi156.stdout:5/273: write da/dc/f19 [765268,47037] 0 2023-12-16T05:56:32.875 INFO:tasks.workunit.client.1.smithi156.stdout:5/274: stat da/dc/f15 0 2023-12-16T05:56:32.875 INFO:tasks.workunit.client.1.smithi156.stdout:9/157: write d6/ff [2085772,127170] 0 2023-12-16T05:56:32.875 INFO:tasks.workunit.client.1.smithi156.stdout:9/158: stat d6/cb 0 2023-12-16T05:56:32.876 INFO:tasks.workunit.client.0.smithi155.stdout:2/421: link d0/d7/cc d0/c8f 0 2023-12-16T05:56:32.877 INFO:tasks.workunit.client.0.smithi155.stdout:8/424: dwrite d4/da/d1b/d2a/d51/f6e [0,4194304] 0 2023-12-16T05:56:32.877 INFO:tasks.workunit.client.0.smithi155.stdout:8/425: chown d4/da 74971 1 2023-12-16T05:56:32.877 INFO:tasks.workunit.client.0.smithi155.stdout:9/559: dwrite da/d15/d17/f41 [0,4194304] 0 2023-12-16T05:56:32.877 INFO:tasks.workunit.client.0.smithi155.stdout:9/560: stat da/d15/d17/d24/d62/la0 0 2023-12-16T05:56:32.878 INFO:tasks.workunit.client.0.smithi155.stdout:0/477: getdents d7/d2d 0 2023-12-16T05:56:32.879 INFO:tasks.workunit.client.1.smithi156.stdout:1/80: mknod d3/d17/d19/c1a 0 2023-12-16T05:56:32.880 INFO:tasks.workunit.client.0.smithi155.stdout:1/558: getdents d1/d7/d4b/d72 0 2023-12-16T05:56:32.881 INFO:tasks.workunit.client.1.smithi156.stdout:2/212: mkdir d9/d12/d3d 0 2023-12-16T05:56:32.882 INFO:tasks.workunit.client.0.smithi155.stdout:4/454: rename d0/da/d36/d5f/d75/d3d/d49/f4f to d0/da/d36/d5f/d75/d3d/d43/f95 0 2023-12-16T05:56:32.886 INFO:tasks.workunit.client.1.smithi156.stdout:5/275: getdents da/dc 0 2023-12-16T05:56:32.887 INFO:tasks.workunit.client.0.smithi155.stdout:9/561: creat da/d15/d17/d36/d5b/d60/d9e/fc5 x:0 0 0 2023-12-16T05:56:32.888 INFO:tasks.workunit.client.0.smithi155.stdout:9/562: write da/d15/f39 [995280,40137] 0 2023-12-16T05:56:32.889 INFO:tasks.workunit.client.0.smithi155.stdout:0/478: rmdir d7/df/d65 39 2023-12-16T05:56:32.890 INFO:tasks.workunit.client.0.smithi155.stdout:0/479: fdatasync d7/fb 0 2023-12-16T05:56:32.890 INFO:tasks.workunit.client.0.smithi155.stdout:0/480: dread - d7/df/d41/f97 zero size 2023-12-16T05:56:32.890 INFO:tasks.workunit.client.0.smithi155.stdout:0/481: fdatasync d7/df/f19 0 2023-12-16T05:56:32.891 INFO:tasks.workunit.client.1.smithi156.stdout:9/159: truncate d6/d19/f1a 321034 0 2023-12-16T05:56:32.892 INFO:tasks.workunit.client.0.smithi155.stdout:8/426: rename d4/da/d1b/d1c/d19/l6a to d4/da/d1b/d1c/l84 0 2023-12-16T05:56:32.896 INFO:tasks.workunit.client.1.smithi156.stdout:5/276: unlink da/f26 0 2023-12-16T05:56:32.896 INFO:tasks.workunit.client.1.smithi156.stdout:2/213: fsync d9/dd/d17/d33/d38/f3c 0 2023-12-16T05:56:32.897 INFO:tasks.workunit.client.0.smithi155.stdout:4/455: link d0/da/d36/d5f/d75/d50/c68 d0/d10/d46/d16/d30/d52/d88/c96 0 2023-12-16T05:56:32.898 INFO:tasks.workunit.client.1.smithi156.stdout:5/277: mkdir da/dc/d2d/d4d 0 2023-12-16T05:56:32.899 INFO:tasks.workunit.client.1.smithi156.stdout:2/214: link d9/dd/f19 d9/dd/d17/d33/d38/d39/f3e 0 2023-12-16T05:56:32.901 INFO:tasks.workunit.client.1.smithi156.stdout:2/215: mkdir d9/dd/d3f 0 2023-12-16T05:56:32.902 INFO:tasks.workunit.client.0.smithi155.stdout:8/427: unlink d4/da/d1b/d1c/c4e 0 2023-12-16T05:56:32.903 INFO:tasks.workunit.client.0.smithi155.stdout:4/456: mkdir d0/da/d36/d5f/d75/d3d/d85/d97 0 2023-12-16T05:56:32.906 INFO:tasks.workunit.client.1.smithi156.stdout:5/278: dread da/dc/f11 [0,4194304] 0 2023-12-16T05:56:32.906 INFO:tasks.workunit.client.1.smithi156.stdout:5/279: stat da/dc/d2d/d34 0 2023-12-16T05:56:32.908 INFO:tasks.workunit.client.1.smithi156.stdout:5/280: read da/dc/ff [1831671,91706] 0 2023-12-16T05:56:32.909 INFO:tasks.workunit.client.1.smithi156.stdout:5/281: write f0 [4763247,21712] 0 2023-12-16T05:56:32.909 INFO:tasks.workunit.client.1.smithi156.stdout:5/282: write da/f27 [4506770,120644] 0 2023-12-16T05:56:32.909 INFO:tasks.workunit.client.0.smithi155.stdout:7/469: sync 2023-12-16T05:56:32.909 INFO:tasks.workunit.client.0.smithi155.stdout:7/470: stat d0/d1/d5/f1d 0 2023-12-16T05:56:32.910 INFO:tasks.workunit.client.1.smithi156.stdout:5/283: truncate da/dc/f21 3902891 0 2023-12-16T05:56:32.910 INFO:tasks.workunit.client.1.smithi156.stdout:5/284: chown da/dc/ff 288 1 2023-12-16T05:56:32.910 INFO:tasks.workunit.client.1.smithi156.stdout:5/285: chown da/dc/f21 22 1 2023-12-16T05:56:32.912 INFO:tasks.workunit.client.1.smithi156.stdout:5/286: mknod da/dc/d2d/d34/c4e 0 2023-12-16T05:56:32.912 INFO:tasks.workunit.client.0.smithi155.stdout:7/471: symlink d0/d6a/d1a/d8c/la3 0 2023-12-16T05:56:32.912 INFO:tasks.workunit.client.0.smithi155.stdout:7/472: dread - d0/d6a/d1a/d8c/d42/f80 zero size 2023-12-16T05:56:32.913 INFO:tasks.workunit.client.1.smithi156.stdout:5/287: creat da/d46/f4f x:0 0 0 2023-12-16T05:56:32.914 INFO:tasks.workunit.client.1.smithi156.stdout:5/288: creat da/f50 x:0 0 0 2023-12-16T05:56:32.914 INFO:tasks.workunit.client.1.smithi156.stdout:5/289: dread - da/dc/d2d/f4c zero size 2023-12-16T05:56:32.915 INFO:tasks.workunit.client.1.smithi156.stdout:5/290: mknod da/dc/d2d/d4d/c51 0 2023-12-16T05:56:32.915 INFO:tasks.workunit.client.0.smithi155.stdout:4/457: dread d0/f5 [0,4194304] 0 2023-12-16T05:56:32.915 INFO:tasks.workunit.client.0.smithi155.stdout:7/473: dread d0/d6a/d31/f32 [0,4194304] 0 2023-12-16T05:56:32.916 INFO:tasks.workunit.client.0.smithi155.stdout:4/458: mknod d0/d10/d46/c98 0 2023-12-16T05:56:32.917 INFO:tasks.workunit.client.0.smithi155.stdout:7/474: write d0/d6a/d1a/d22/f87 [483216,119197] 0 2023-12-16T05:56:32.917 INFO:tasks.workunit.client.0.smithi155.stdout:7/475: readlink d0/d6a/d1a/d2b/d2c/l9e 0 2023-12-16T05:56:32.917 INFO:tasks.workunit.client.0.smithi155.stdout:4/459: symlink d0/da/d36/d5f/d75/d3d/l99 0 2023-12-16T05:56:32.919 INFO:tasks.workunit.client.0.smithi155.stdout:7/476: creat d0/d6a/d1a/d8c/d34/d4b/d64/fa4 x:0 0 0 2023-12-16T05:56:32.919 INFO:tasks.workunit.client.0.smithi155.stdout:9/563: dwrite da/d15/d17/d36/f55 [0,4194304] 0 2023-12-16T05:56:32.920 INFO:tasks.workunit.client.0.smithi155.stdout:7/477: creat d0/d6a/d1a/da0/fa5 x:0 0 0 2023-12-16T05:56:32.920 INFO:tasks.workunit.client.0.smithi155.stdout:7/478: fsync d0/d6a/d1a/f72 0 2023-12-16T05:56:32.923 INFO:tasks.workunit.client.0.smithi155.stdout:9/564: creat da/fc6 x:0 0 0 2023-12-16T05:56:32.923 INFO:tasks.workunit.client.0.smithi155.stdout:7/479: dread d0/d6a/d1a/f89 [0,4194304] 0 2023-12-16T05:56:32.925 INFO:tasks.workunit.client.0.smithi155.stdout:0/482: dwrite d7/df/d73/d8d/f63 [0,4194304] 0 2023-12-16T05:56:32.925 INFO:tasks.workunit.client.0.smithi155.stdout:8/428: dwrite d4/d62/d66/d78/f82 [0,4194304] 0 2023-12-16T05:56:32.925 INFO:tasks.workunit.client.0.smithi155.stdout:1/559: dwrite d1/d25/f32 [0,4194304] 0 2023-12-16T05:56:32.926 INFO:tasks.workunit.client.0.smithi155.stdout:7/480: truncate d0/d6a/d1a/d8c/d34/d4b/d64/d6f/f81 422230 0 2023-12-16T05:56:32.926 INFO:tasks.workunit.client.0.smithi155.stdout:2/422: dwrite d0/d7/d69/f87 [0,4194304] 0 2023-12-16T05:56:32.926 INFO:tasks.workunit.client.0.smithi155.stdout:1/560: read d1/d25/f32 [2839172,26802] 0 2023-12-16T05:56:32.926 INFO:tasks.workunit.client.0.smithi155.stdout:2/423: read d0/d7/d1f/d74/f46 [1772453,41788] 0 2023-12-16T05:56:32.926 INFO:tasks.workunit.client.0.smithi155.stdout:5/540: sync 2023-12-16T05:56:32.926 INFO:tasks.workunit.client.0.smithi155.stdout:3/337: sync 2023-12-16T05:56:32.927 INFO:tasks.workunit.client.0.smithi155.stdout:2/424: write d0/d5/d6/f2e [1749823,4400] 0 2023-12-16T05:56:32.927 INFO:tasks.workunit.client.0.smithi155.stdout:2/425: dread - d0/d34/d3c/f43 zero size 2023-12-16T05:56:32.928 INFO:tasks.workunit.client.0.smithi155.stdout:2/426: readlink d0/d7/dd/d49/d4b/d80/l76 0 2023-12-16T05:56:32.928 INFO:tasks.workunit.client.0.smithi155.stdout:2/427: fsync d0/d7/dd/f3e 0 2023-12-16T05:56:32.928 INFO:tasks.workunit.client.1.smithi156.stdout:1/81: dwrite d3/f18 [0,4194304] 0 2023-12-16T05:56:32.931 INFO:tasks.workunit.client.1.smithi156.stdout:1/82: getdents d3 0 2023-12-16T05:56:32.933 INFO:tasks.workunit.client.1.smithi156.stdout:1/83: mkdir d3/d1b 0 2023-12-16T05:56:32.934 INFO:tasks.workunit.client.0.smithi155.stdout:9/565: fsync da/d15/f39 0 2023-12-16T05:56:32.934 INFO:tasks.workunit.client.0.smithi155.stdout:7/481: mknod d0/d1/d5/ca6 0 2023-12-16T05:56:32.935 INFO:tasks.workunit.client.0.smithi155.stdout:7/482: readlink d0/d6a/d1a/d8c/l8b 0 2023-12-16T05:56:32.935 INFO:tasks.workunit.client.0.smithi155.stdout:8/429: rename d4/da/d1b/d2a/d5e/l7a to d4/da/d1b/d2a/d5e/l85 0 2023-12-16T05:56:32.935 INFO:tasks.workunit.client.1.smithi156.stdout:1/84: mkdir d3/d17/d1c 0 2023-12-16T05:56:32.936 INFO:tasks.workunit.client.1.smithi156.stdout:1/85: symlink d3/d1b/l1d 0 2023-12-16T05:56:32.939 INFO:tasks.workunit.client.1.smithi156.stdout:1/86: fdatasync d3/fb 0 2023-12-16T05:56:32.940 INFO:tasks.workunit.client.1.smithi156.stdout:5/291: dwrite da/dc/f31 [0,4194304] 0 2023-12-16T05:56:32.940 INFO:tasks.workunit.client.1.smithi156.stdout:5/292: readlink da/dc/l44 0 2023-12-16T05:56:32.941 INFO:tasks.workunit.client.1.smithi156.stdout:1/87: dread - d3/f16 zero size 2023-12-16T05:56:32.942 INFO:tasks.workunit.client.0.smithi155.stdout:1/561: creat d1/d25/fb5 x:0 0 0 2023-12-16T05:56:32.943 INFO:tasks.workunit.client.0.smithi155.stdout:1/562: write d1/d17/d28/d74/fa3 [393239,9208] 0 2023-12-16T05:56:32.945 INFO:tasks.workunit.client.0.smithi155.stdout:5/541: truncate d0/d2/d2a/d19/d21/fa2 3927540 0 2023-12-16T05:56:32.945 INFO:tasks.workunit.client.0.smithi155.stdout:5/542: write d0/d2/d2a/d30/d53/d7b/f86 [322221,54302] 0 2023-12-16T05:56:32.947 INFO:tasks.workunit.client.1.smithi156.stdout:5/293: creat da/f52 x:0 0 0 2023-12-16T05:56:32.949 INFO:tasks.workunit.client.0.smithi155.stdout:0/483: symlink d7/df/d73/d8d/l98 0 2023-12-16T05:56:32.951 INFO:tasks.workunit.client.1.smithi156.stdout:5/294: truncate da/dc/f19 2262236 0 2023-12-16T05:56:32.951 INFO:tasks.workunit.client.0.smithi155.stdout:1/563: symlink d1/d7/d16/d30/lb6 0 2023-12-16T05:56:32.951 INFO:tasks.workunit.client.0.smithi155.stdout:1/564: fdatasync d1/d7/f18 0 2023-12-16T05:56:32.951 INFO:tasks.workunit.client.0.smithi155.stdout:3/338: dwrite d0/d1e/f49 [0,4194304] 0 2023-12-16T05:56:32.951 INFO:tasks.workunit.client.0.smithi155.stdout:5/543: mkdir d0/d2/d2a/d30/d53/d7b/d99/daf 0 2023-12-16T05:56:32.951 INFO:tasks.workunit.client.1.smithi156.stdout:5/295: symlink da/dc/d4b/l53 0 2023-12-16T05:56:32.953 INFO:tasks.workunit.client.1.smithi156.stdout:5/296: rmdir da/dc/d2d/d4d 39 2023-12-16T05:56:32.953 INFO:tasks.workunit.client.0.smithi155.stdout:1/565: getdents d1/d17/d28/d74 0 2023-12-16T05:56:32.953 INFO:tasks.workunit.client.0.smithi155.stdout:8/430: dread d4/da/d1b/d1c/f5c [0,4194304] 0 2023-12-16T05:56:32.953 INFO:tasks.workunit.client.1.smithi156.stdout:5/297: mkdir da/dc/d2d/d4d/d54 0 2023-12-16T05:56:32.955 INFO:tasks.workunit.client.1.smithi156.stdout:1/88: dread d3/fc [0,4194304] 0 2023-12-16T05:56:32.957 INFO:tasks.workunit.client.1.smithi156.stdout:5/298: dread da/f28 [0,4194304] 0 2023-12-16T05:56:32.958 INFO:tasks.workunit.client.1.smithi156.stdout:5/299: rmdir da/d46 39 2023-12-16T05:56:32.958 INFO:tasks.workunit.client.1.smithi156.stdout:5/300: read - da/f52 zero size 2023-12-16T05:56:32.959 INFO:tasks.workunit.client.0.smithi155.stdout:7/483: dread d0/d6a/d1a/d8c/d34/d4b/d64/d6f/f81 [0,4194304] 0 2023-12-16T05:56:32.961 INFO:tasks.workunit.client.1.smithi156.stdout:5/301: mknod da/dc/d4b/c55 0 2023-12-16T05:56:32.962 INFO:tasks.workunit.client.0.smithi155.stdout:8/431: mknod d4/da/d1b/c86 0 2023-12-16T05:56:32.962 INFO:tasks.workunit.client.0.smithi155.stdout:3/339: write d0/d1e/f23 [2957752,51844] 0 2023-12-16T05:56:32.962 INFO:tasks.workunit.client.0.smithi155.stdout:3/340: fsync d0/fb 0 2023-12-16T05:56:32.962 INFO:tasks.workunit.client.0.smithi155.stdout:1/566: dread d1/f2a [0,4194304] 0 2023-12-16T05:56:32.962 INFO:tasks.workunit.client.0.smithi155.stdout:2/428: dwrite d0/f2 [0,4194304] 0 2023-12-16T05:56:32.963 INFO:tasks.workunit.client.0.smithi155.stdout:1/567: stat d1/d7/d4b/d72/d79/daa/cab 0 2023-12-16T05:56:32.964 INFO:tasks.workunit.client.1.smithi156.stdout:5/302: link da/c3e da/d46/c56 0 2023-12-16T05:56:32.965 INFO:tasks.workunit.client.1.smithi156.stdout:5/303: fsync da/f1e 0 2023-12-16T05:56:32.965 INFO:tasks.workunit.client.1.smithi156.stdout:3/166: sync 2023-12-16T05:56:32.966 INFO:tasks.workunit.client.1.smithi156.stdout:6/150: sync 2023-12-16T05:56:32.966 INFO:tasks.workunit.client.1.smithi156.stdout:4/121: sync 2023-12-16T05:56:32.966 INFO:tasks.workunit.client.1.smithi156.stdout:3/167: chown dc/d10/d1d/l3b 162 1 2023-12-16T05:56:32.966 INFO:tasks.workunit.client.1.smithi156.stdout:7/266: sync 2023-12-16T05:56:32.966 INFO:tasks.workunit.client.0.smithi155.stdout:8/432: mknod d4/da/d1b/d1c/d19/d7d/c87 0 2023-12-16T05:56:32.966 INFO:tasks.workunit.client.0.smithi155.stdout:2/429: write d0/d7/dd/f39 [2644335,121595] 0 2023-12-16T05:56:32.966 INFO:tasks.workunit.client.0.smithi155.stdout:2/430: write d0/d7/dd/d14/f2d [2006652,7232] 0 2023-12-16T05:56:32.966 INFO:tasks.workunit.client.1.smithi156.stdout:6/151: creat d9/d1c/f2b x:0 0 0 2023-12-16T05:56:32.967 INFO:tasks.workunit.client.1.smithi156.stdout:7/267: mkdir d1e/d55 0 2023-12-16T05:56:32.968 INFO:tasks.workunit.client.1.smithi156.stdout:6/152: getdents d9 0 2023-12-16T05:56:32.970 INFO:tasks.workunit.client.1.smithi156.stdout:6/153: creat d9/d1c/f2c x:0 0 0 2023-12-16T05:56:32.971 INFO:tasks.workunit.client.0.smithi155.stdout:1/568: unlink d1/d7/d16/d30/lb6 0 2023-12-16T05:56:32.972 INFO:tasks.workunit.client.0.smithi155.stdout:9/566: dwrite da/d15/d17/d24/f2d [0,4194304] 0 2023-12-16T05:56:32.973 INFO:tasks.workunit.client.0.smithi155.stdout:1/569: symlink d1/d7/d4b/lb7 0 2023-12-16T05:56:32.973 INFO:tasks.workunit.client.0.smithi155.stdout:1/570: chown d1/ff 1029 1 2023-12-16T05:56:32.973 INFO:tasks.workunit.client.0.smithi155.stdout:1/571: readlink d1/d7/d16/d30/l67 0 2023-12-16T05:56:32.975 INFO:tasks.workunit.client.0.smithi155.stdout:1/572: write d1/d25/d43/d5d/f7c [2377975,74825] 0 2023-12-16T05:56:32.975 INFO:tasks.workunit.client.0.smithi155.stdout:1/573: chown d1/d25/d43/d5d/d5e/c6c 3391 1 2023-12-16T05:56:32.975 INFO:tasks.workunit.client.0.smithi155.stdout:1/574: chown d1/d17/d28/f9f 2902 1 2023-12-16T05:56:32.976 INFO:tasks.workunit.client.0.smithi155.stdout:7/484: dread d0/d1/d5/f1d [0,4194304] 0 2023-12-16T05:56:32.978 INFO:tasks.workunit.client.0.smithi155.stdout:8/433: dread d4/da/d1b/d2a/f39 [0,4194304] 0 2023-12-16T05:56:32.978 INFO:tasks.workunit.client.0.smithi155.stdout:9/567: rename da/d15/d17/d24/d62/fae to da/d15/d17/d36/d5b/d98/fc7 0 2023-12-16T05:56:32.979 INFO:tasks.workunit.client.0.smithi155.stdout:1/575: mknod d1/d17/cb8 0 2023-12-16T05:56:32.980 INFO:tasks.workunit.client.1.smithi156.stdout:5/304: dread f0 [0,4194304] 0 2023-12-16T05:56:32.981 INFO:tasks.workunit.client.1.smithi156.stdout:5/305: mknod da/d46/c57 0 2023-12-16T05:56:32.982 INFO:tasks.workunit.client.0.smithi155.stdout:7/485: mknod d0/d1b/d78/ca7 0 2023-12-16T05:56:32.983 INFO:tasks.workunit.client.0.smithi155.stdout:6/593: sync 2023-12-16T05:56:32.983 INFO:tasks.workunit.client.1.smithi156.stdout:5/306: creat da/dc/d2d/f58 x:0 0 0 2023-12-16T05:56:32.983 INFO:tasks.workunit.client.1.smithi156.stdout:5/307: readlink da/dc/d4b/l53 0 2023-12-16T05:56:32.984 INFO:tasks.workunit.client.1.smithi156.stdout:5/308: symlink da/dc/d4b/l59 0 2023-12-16T05:56:32.985 INFO:tasks.workunit.client.1.smithi156.stdout:1/89: dwrite f0 [4194304,4194304] 0 2023-12-16T05:56:32.985 INFO:tasks.workunit.client.1.smithi156.stdout:5/309: symlink da/dc/d2d/d34/l5a 0 2023-12-16T05:56:32.986 INFO:tasks.workunit.client.0.smithi155.stdout:5/544: dwrite d0/d2/d2a/d30/d53/d7b/d99/d47/f73 [4194304,4194304] 0 2023-12-16T05:56:32.986 INFO:tasks.workunit.client.0.smithi155.stdout:5/545: chown d0/f69 18 1 2023-12-16T05:56:32.986 INFO:tasks.workunit.client.0.smithi155.stdout:5/546: chown d0/d2/d2a/d30/d53/d7b/d99/d47/d9d 21037 1 2023-12-16T05:56:32.986 INFO:tasks.workunit.client.0.smithi155.stdout:5/547: chown d0/d2/d2a/d30/d53/d7b/f80 591504 1 2023-12-16T05:56:32.986 INFO:tasks.workunit.client.0.smithi155.stdout:0/484: dwrite d7/df/f7b [0,4194304] 0 2023-12-16T05:56:32.988 INFO:tasks.workunit.client.0.smithi155.stdout:9/568: write da/d15/d17/d36/d5b/d98/faf [2287617,52331] 0 2023-12-16T05:56:32.991 INFO:tasks.workunit.client.0.smithi155.stdout:9/569: write da/d15/d17/d24/d26/d2e/f63 [647124,30968] 0 2023-12-16T05:56:32.991 INFO:tasks.workunit.client.1.smithi156.stdout:1/90: link d3/c9 d3/d17/c1e 0 2023-12-16T05:56:33.013 INFO:tasks.workunit.client.0.smithi155.stdout:8/434: dwrite d4/da/d1b/d1c/d19/f27 [0,4194304] 0 2023-12-16T05:56:33.013 INFO:tasks.workunit.client.0.smithi155.stdout:8/435: chown d4/d62/c81 38967764 1 2023-12-16T05:56:33.014 INFO:tasks.workunit.client.1.smithi156.stdout:6/154: dwrite d9/d13/f20 [0,4194304] 0 2023-12-16T05:56:33.014 INFO:tasks.workunit.client.1.smithi156.stdout:6/155: write d9/f11 [277680,1350] 0 2023-12-16T05:56:33.015 INFO:tasks.workunit.client.1.smithi156.stdout:6/156: mknod d9/d1c/c2d 0 2023-12-16T05:56:33.015 INFO:tasks.workunit.client.1.smithi156.stdout:6/157: chown f6 60985763 1 2023-12-16T05:56:33.015 INFO:tasks.workunit.client.1.smithi156.stdout:5/310: dwrite da/dc/f2c [0,4194304] 0 2023-12-16T05:56:33.032 INFO:tasks.workunit.client.0.smithi155.stdout:6/594: symlink d0/d3/d2c/db8/lbb 0 2023-12-16T05:56:33.035 INFO:tasks.workunit.client.0.smithi155.stdout:3/341: truncate d0/d14/d51/f44 1744995 0 2023-12-16T05:56:33.035 INFO:tasks.workunit.client.0.smithi155.stdout:3/342: fsync d0/d1e/f23 0 2023-12-16T05:56:33.042 INFO:tasks.workunit.client.0.smithi155.stdout:5/548: link d0/d2/d2a/f2e d0/d60/fb0 0 2023-12-16T05:56:33.042 INFO:tasks.workunit.client.0.smithi155.stdout:5/549: chown d0/d2/d2a/d30/d53/d7b/d99/d47 5628 1 2023-12-16T05:56:33.044 INFO:tasks.workunit.client.1.smithi156.stdout:5/311: dwrite da/f48 [0,4194304] 0 2023-12-16T05:56:33.044 INFO:tasks.workunit.client.1.smithi156.stdout:5/312: chown da/f52 47 1 2023-12-16T05:56:33.044 INFO:tasks.workunit.client.1.smithi156.stdout:5/313: chown da/dc/f21 153674858 1 2023-12-16T05:56:33.044 INFO:tasks.workunit.client.0.smithi155.stdout:0/485: symlink d7/df/d73/l99 0 2023-12-16T05:56:33.044 INFO:tasks.workunit.client.0.smithi155.stdout:9/570: creat da/d15/d17/d36/d5b/fc8 x:0 0 0 2023-12-16T05:56:33.048 INFO:tasks.workunit.client.0.smithi155.stdout:5/550: creat d0/d2/d2a/d19/d71/fb1 x:0 0 0 2023-12-16T05:56:33.049 INFO:tasks.workunit.client.1.smithi156.stdout:6/158: dwrite d9/d13/f20 [0,4194304] 0 2023-12-16T05:56:33.050 INFO:tasks.workunit.client.1.smithi156.stdout:6/159: mknod d9/d13/c2e 0 2023-12-16T05:56:33.050 INFO:tasks.workunit.client.1.smithi156.stdout:6/160: chown d9/d13/c19 0 1 2023-12-16T05:56:33.050 INFO:tasks.workunit.client.1.smithi156.stdout:6/161: fdatasync d9/f1d 0 2023-12-16T05:56:33.051 INFO:tasks.workunit.client.0.smithi155.stdout:6/595: dwrite d0/d3/d2c/d3e/d4c/fba [0,4194304] 0 2023-12-16T05:56:33.051 INFO:tasks.workunit.client.0.smithi155.stdout:3/343: symlink d0/d1e/l64 0 2023-12-16T05:56:33.051 INFO:tasks.workunit.client.1.smithi156.stdout:6/162: mkdir d9/d13/d2f 0 2023-12-16T05:56:33.051 INFO:tasks.workunit.client.1.smithi156.stdout:6/163: fdatasync d9/d13/f14 0 2023-12-16T05:56:33.051 INFO:tasks.workunit.client.1.smithi156.stdout:6/164: creat d9/d1c/f30 x:0 0 0 2023-12-16T05:56:33.053 INFO:tasks.workunit.client.1.smithi156.stdout:6/165: unlink d9/d1c/f30 0 2023-12-16T05:56:33.053 INFO:tasks.workunit.client.1.smithi156.stdout:6/166: truncate d9/f1f 414636 0 2023-12-16T05:56:33.054 INFO:tasks.workunit.client.0.smithi155.stdout:6/596: symlink d0/d3/d2c/d8b/d85/da4/lbc 0 2023-12-16T05:56:33.054 INFO:tasks.workunit.client.0.smithi155.stdout:3/344: rmdir d0/d1e/d4e 39 2023-12-16T05:56:33.055 INFO:tasks.workunit.client.1.smithi156.stdout:6/167: rename d9/c10 to d9/d1c/c31 0 2023-12-16T05:56:33.055 INFO:tasks.workunit.client.1.smithi156.stdout:6/168: chown d9/d1c/l2a 231 1 2023-12-16T05:56:33.055 INFO:tasks.workunit.client.0.smithi155.stdout:3/345: creat d0/d14/f65 x:0 0 0 2023-12-16T05:56:33.056 INFO:tasks.workunit.client.1.smithi156.stdout:6/169: link d9/d1c/f24 d9/d1c/f32 0 2023-12-16T05:56:33.057 INFO:tasks.workunit.client.0.smithi155.stdout:3/346: truncate d0/d14/f5e 5238064 0 2023-12-16T05:56:33.078 INFO:tasks.workunit.client.0.smithi155.stdout:5/551: dwrite d0/d2/d2a/d19/f38 [0,4194304] 0 2023-12-16T05:56:33.078 INFO:tasks.workunit.client.0.smithi155.stdout:3/347: dwrite d0/d1e/f32 [0,4194304] 0 2023-12-16T05:56:33.086 INFO:tasks.workunit.client.0.smithi155.stdout:9/571: write da/d15/d17/d24/d26/d2e/d32/f3c [5095070,94540] 0 2023-12-16T05:56:33.086 INFO:tasks.workunit.client.0.smithi155.stdout:9/572: chown da/d15/d17/d36/l4f 20 1 2023-12-16T05:56:33.088 INFO:tasks.workunit.client.0.smithi155.stdout:9/573: symlink da/d15/d17/d24/d62/d91/dc0/lc9 0 2023-12-16T05:56:33.090 INFO:tasks.workunit.client.0.smithi155.stdout:3/348: dread d0/d1e/f32 [0,4194304] 0 2023-12-16T05:56:33.092 INFO:tasks.workunit.client.0.smithi155.stdout:3/349: unlink d0/d1a/d33/f46 0 2023-12-16T05:56:33.097 INFO:tasks.workunit.client.0.smithi155.stdout:5/552: dwrite d0/d2/d2a/f63 [0,4194304] 0 2023-12-16T05:56:33.099 INFO:tasks.workunit.client.1.smithi156.stdout:4/122: dwrite d9/f1b [4194304,4194304] 0 2023-12-16T05:56:33.100 INFO:tasks.workunit.client.1.smithi156.stdout:5/314: dwrite da/dc/f13 [0,4194304] 0 2023-12-16T05:56:33.104 INFO:tasks.workunit.client.0.smithi155.stdout:1/576: dread d1/d25/d43/d5d/f7c [0,4194304] 0 2023-12-16T05:56:33.104 INFO:tasks.workunit.client.0.smithi155.stdout:1/577: fdatasync d1/d7/d16/d30/f76 0 2023-12-16T05:56:33.104 INFO:tasks.workunit.client.0.smithi155.stdout:1/578: write d1/d25/f8b [974076,38905] 0 2023-12-16T05:56:33.104 INFO:tasks.workunit.client.0.smithi155.stdout:3/350: mknod d0/d1a/c66 0 2023-12-16T05:56:33.104 INFO:tasks.workunit.client.1.smithi156.stdout:5/315: rename da/l1c to da/dc/d2d/d34/l5b 0 2023-12-16T05:56:33.106 INFO:tasks.workunit.client.1.smithi156.stdout:4/123: link d9/c20 d9/c25 0 2023-12-16T05:56:33.108 INFO:tasks.workunit.client.1.smithi156.stdout:4/124: write d9/f16 [2110006,85113] 0 2023-12-16T05:56:33.110 INFO:tasks.workunit.client.1.smithi156.stdout:6/170: getdents d9/d13 0 2023-12-16T05:56:33.112 INFO:tasks.workunit.client.0.smithi155.stdout:1/579: truncate d1/d17/d28/f40 495379 0 2023-12-16T05:56:33.115 INFO:tasks.workunit.client.0.smithi155.stdout:3/351: mknod d0/d14/d36/c67 0 2023-12-16T05:56:33.116 INFO:tasks.workunit.client.0.smithi155.stdout:3/352: write d0/f31 [582603,100054] 0 2023-12-16T05:56:33.116 INFO:tasks.workunit.client.0.smithi155.stdout:3/353: fdatasync d0/d1a/d33/f3a 0 2023-12-16T05:56:33.117 INFO:tasks.workunit.client.1.smithi156.stdout:5/316: link da/dc/d2d/d34/l5b da/dc/l5c 0 2023-12-16T05:56:33.117 INFO:tasks.workunit.client.1.smithi156.stdout:5/317: stat da/dc/f11 0 2023-12-16T05:56:33.117 INFO:tasks.workunit.client.1.smithi156.stdout:5/318: write da/dc/f2e [281437,50662] 0 2023-12-16T05:56:33.119 INFO:tasks.workunit.client.0.smithi155.stdout:1/580: symlink d1/d69/lb9 0 2023-12-16T05:56:33.119 INFO:tasks.workunit.client.0.smithi155.stdout:1/581: truncate d1/d7/d16/d30/f6e 1105148 0 2023-12-16T05:56:33.122 INFO:tasks.workunit.client.1.smithi156.stdout:6/171: dread f6 [4194304,4194304] 0 2023-12-16T05:56:33.122 INFO:tasks.workunit.client.1.smithi156.stdout:6/172: getdents d9/d13 0 2023-12-16T05:56:33.123 INFO:tasks.workunit.client.1.smithi156.stdout:6/173: symlink d9/d1c/l33 0 2023-12-16T05:56:33.125 INFO:tasks.workunit.client.1.smithi156.stdout:6/174: creat d9/d13/d2f/f34 x:0 0 0 2023-12-16T05:56:33.129 INFO:tasks.workunit.client.1.smithi156.stdout:6/175: dread f8 [0,4194304] 0 2023-12-16T05:56:33.131 INFO:tasks.workunit.client.1.smithi156.stdout:6/176: creat d9/f35 x:0 0 0 2023-12-16T05:56:33.132 INFO:tasks.workunit.client.1.smithi156.stdout:6/177: mkdir d9/d13/d2f/d36 0 2023-12-16T05:56:33.134 INFO:tasks.workunit.client.1.smithi156.stdout:6/178: mknod d9/d1c/c37 0 2023-12-16T05:56:33.134 INFO:tasks.workunit.client.1.smithi156.stdout:6/179: write d9/d1c/f2b [551567,86321] 0 2023-12-16T05:56:33.149 INFO:tasks.workunit.client.1.smithi156.stdout:4/125: dwrite d9/f16 [0,4194304] 0 2023-12-16T05:56:33.151 INFO:tasks.workunit.client.1.smithi156.stdout:6/180: dwrite d9/f1f [0,4194304] 0 2023-12-16T05:56:33.151 INFO:tasks.workunit.client.1.smithi156.stdout:6/181: dread - d9/d1c/f2c zero size 2023-12-16T05:56:33.152 INFO:tasks.workunit.client.0.smithi155.stdout:3/354: dwrite d0/d14/f18 [0,4194304] 0 2023-12-16T05:56:33.156 INFO:tasks.workunit.client.1.smithi156.stdout:5/319: dwrite da/dc/f13 [0,4194304] 0 2023-12-16T05:56:33.157 INFO:tasks.workunit.client.1.smithi156.stdout:4/126: dread d9/f18 [0,4194304] 0 2023-12-16T05:56:33.165 INFO:tasks.workunit.client.1.smithi156.stdout:5/320: creat da/dc/d2d/d4d/d54/f5d x:0 0 0 2023-12-16T05:56:33.168 INFO:tasks.workunit.client.1.smithi156.stdout:4/127: mknod d9/c26 0 2023-12-16T05:56:33.168 INFO:tasks.workunit.client.1.smithi156.stdout:4/128: dread - d9/f21 zero size 2023-12-16T05:56:33.168 INFO:tasks.workunit.client.1.smithi156.stdout:4/129: dread - d9/f1c zero size 2023-12-16T05:56:33.168 INFO:tasks.workunit.client.1.smithi156.stdout:4/130: truncate f0 3354766 0 2023-12-16T05:56:33.170 INFO:tasks.workunit.client.1.smithi156.stdout:5/321: write f4 [1013879,89613] 0 2023-12-16T05:56:33.170 INFO:tasks.workunit.client.1.smithi156.stdout:6/182: dwrite d9/f1d [0,4194304] 0 2023-12-16T05:56:33.171 INFO:tasks.workunit.client.1.smithi156.stdout:6/183: write d9/d13/f14 [3240599,15693] 0 2023-12-16T05:56:33.172 INFO:tasks.workunit.client.1.smithi156.stdout:6/184: read d9/d13/f18 [28621,68324] 0 2023-12-16T05:56:33.173 INFO:tasks.workunit.client.0.smithi155.stdout:9/574: getdents da/d15/d17/d24/d62/d91/dc0 0 2023-12-16T05:56:33.173 INFO:tasks.workunit.client.0.smithi155.stdout:9/575: chown da/d15/d17/d24/l82 2468712 1 2023-12-16T05:56:33.173 INFO:tasks.workunit.client.0.smithi155.stdout:9/576: fsync da/d15/d17/d24/d26/f29 0 2023-12-16T05:56:33.174 INFO:tasks.workunit.client.1.smithi156.stdout:8/120: sync 2023-12-16T05:56:33.174 INFO:tasks.workunit.client.0.smithi155.stdout:3/355: write d0/d14/f5e [2243944,129051] 0 2023-12-16T05:56:33.174 INFO:tasks.workunit.client.0.smithi155.stdout:9/577: getdents da/d15/d17/d36/d5b/d60/d9e 0 2023-12-16T05:56:33.175 INFO:tasks.workunit.client.1.smithi156.stdout:4/131: getdents d9 0 2023-12-16T05:56:33.175 INFO:tasks.workunit.client.1.smithi156.stdout:6/185: dread d9/d13/f17 [0,4194304] 0 2023-12-16T05:56:33.177 INFO:tasks.workunit.client.1.smithi156.stdout:8/121: rmdir d3/d18 39 2023-12-16T05:56:33.177 INFO:tasks.workunit.client.0.smithi155.stdout:3/356: creat d0/d1e/f68 x:0 0 0 2023-12-16T05:56:33.181 INFO:tasks.workunit.client.1.smithi156.stdout:8/122: unlink d3/d7/d9/f1a 0 2023-12-16T05:56:33.182 INFO:tasks.workunit.client.1.smithi156.stdout:8/123: symlink d3/l26 0 2023-12-16T05:56:33.183 INFO:tasks.workunit.client.1.smithi156.stdout:5/322: dread da/dc/f31 [0,4194304] 0 2023-12-16T05:56:33.185 INFO:tasks.workunit.client.1.smithi156.stdout:8/124: mkdir d3/d7/d27 0 2023-12-16T05:56:33.185 INFO:tasks.workunit.client.1.smithi156.stdout:4/132: write f0 [313819,2516] 0 2023-12-16T05:56:33.186 INFO:tasks.workunit.client.1.smithi156.stdout:4/133: dread - d9/f1c zero size 2023-12-16T05:56:33.187 INFO:tasks.workunit.client.1.smithi156.stdout:8/125: creat d3/d12/f28 x:0 0 0 2023-12-16T05:56:33.187 INFO:tasks.workunit.client.1.smithi156.stdout:4/134: creat d9/f27 x:0 0 0 2023-12-16T05:56:33.187 INFO:tasks.workunit.client.1.smithi156.stdout:4/135: write f8 [4949759,103170] 0 2023-12-16T05:56:33.188 INFO:tasks.workunit.client.0.smithi155.stdout:3/357: getdents d0/d1a 0 2023-12-16T05:56:33.191 INFO:tasks.workunit.client.0.smithi155.stdout:3/358: symlink d0/d1e/l69 0 2023-12-16T05:56:33.191 INFO:tasks.workunit.client.1.smithi156.stdout:8/126: dread d3/d18/f1f [0,4194304] 0 2023-12-16T05:56:33.196 INFO:tasks.workunit.client.1.smithi156.stdout:6/186: dwrite d9/f1d [0,4194304] 0 2023-12-16T05:56:33.199 INFO:tasks.workunit.client.1.smithi156.stdout:6/187: mknod d9/d13/d2f/d36/c38 0 2023-12-16T05:56:33.200 INFO:tasks.workunit.client.1.smithi156.stdout:6/188: creat d9/d1c/f39 x:0 0 0 2023-12-16T05:56:33.201 INFO:tasks.workunit.client.1.smithi156.stdout:6/189: creat d9/d1c/f3a x:0 0 0 2023-12-16T05:56:33.201 INFO:tasks.workunit.client.1.smithi156.stdout:6/190: chown d9/d13/f27 0 1 2023-12-16T05:56:33.202 INFO:tasks.workunit.client.1.smithi156.stdout:6/191: creat d9/f3b x:0 0 0 2023-12-16T05:56:33.206 INFO:tasks.workunit.client.0.smithi155.stdout:8/436: rename d4/da to d4/d62/d66/d78/d88 0 2023-12-16T05:56:33.207 INFO:tasks.workunit.client.1.smithi156.stdout:4/136: dread f8 [0,4194304] 0 2023-12-16T05:56:33.207 INFO:tasks.workunit.client.1.smithi156.stdout:4/137: chown d9/f24 695 1 2023-12-16T05:56:33.207 INFO:tasks.workunit.client.1.smithi156.stdout:4/138: fsync d9/f1b 0 2023-12-16T05:56:33.209 INFO:tasks.workunit.client.1.smithi156.stdout:6/192: rmdir d9/d1c 39 2023-12-16T05:56:33.209 INFO:tasks.workunit.client.1.smithi156.stdout:6/193: fsync d9/d13/f20 0 2023-12-16T05:56:33.210 INFO:tasks.workunit.client.1.smithi156.stdout:6/194: write d9/d13/f26 [544304,26614] 0 2023-12-16T05:56:33.210 INFO:tasks.workunit.client.1.smithi156.stdout:6/195: read - d9/d13/d2f/f34 zero size 2023-12-16T05:56:33.211 INFO:tasks.workunit.client.0.smithi155.stdout:5/553: unlink d0/d2/l94 0 2023-12-16T05:56:33.212 INFO:tasks.workunit.client.1.smithi156.stdout:6/196: creat d9/f3c x:0 0 0 2023-12-16T05:56:33.212 INFO:tasks.workunit.client.0.smithi155.stdout:6/597: mkdir d0/dbd 0 2023-12-16T05:56:33.213 INFO:tasks.workunit.client.1.smithi156.stdout:6/197: creat d9/d13/f3d x:0 0 0 2023-12-16T05:56:33.213 INFO:tasks.workunit.client.0.smithi155.stdout:6/598: symlink d0/df/d5e/d46/d6d/lbe 0 2023-12-16T05:56:33.214 INFO:tasks.workunit.client.0.smithi155.stdout:6/599: truncate d0/df/d5e/f66 2410658 0 2023-12-16T05:56:33.214 INFO:tasks.workunit.client.1.smithi156.stdout:6/198: read d9/d13/f14 [3638083,7655] 0 2023-12-16T05:56:33.214 INFO:tasks.workunit.client.1.smithi156.stdout:6/199: read - d9/f3c zero size 2023-12-16T05:56:33.216 INFO:tasks.workunit.client.0.smithi155.stdout:0/486: rename d7/df/f26 to d7/df/f9a 0 2023-12-16T05:56:33.216 INFO:tasks.workunit.client.1.smithi156.stdout:6/200: mkdir d9/d13/d3e 0 2023-12-16T05:56:33.217 INFO:tasks.workunit.client.0.smithi155.stdout:6/600: truncate d0/d3/d2c/f60 3468118 0 2023-12-16T05:56:33.218 INFO:tasks.workunit.client.0.smithi155.stdout:6/601: chown d0/d3/d2c/d3e/d4c/fa2 175912 1 2023-12-16T05:56:33.220 INFO:tasks.workunit.client.0.smithi155.stdout:6/602: link d0/d3/f19 d0/d3/d2c/db8/fbf 0 2023-12-16T05:56:33.220 INFO:tasks.workunit.client.0.smithi155.stdout:6/603: write d0/df/d5e/d46/d6d/f74 [302597,6766] 0 2023-12-16T05:56:33.220 INFO:tasks.workunit.client.0.smithi155.stdout:6/604: dread - d0/d3/d2c/d3e/d4c/f97 zero size 2023-12-16T05:56:33.220 INFO:tasks.workunit.client.0.smithi155.stdout:0/487: mkdir d7/df/d73/d8d/d9b 0 2023-12-16T05:56:33.222 INFO:tasks.workunit.client.0.smithi155.stdout:6/605: unlink d0/d3/c92 0 2023-12-16T05:56:33.224 INFO:tasks.workunit.client.0.smithi155.stdout:0/488: creat d7/d47/d53/f9c x:0 0 0 2023-12-16T05:56:33.227 INFO:tasks.workunit.client.0.smithi155.stdout:6/606: dread d0/df/d5e/f66 [0,4194304] 0 2023-12-16T05:56:33.228 INFO:tasks.workunit.client.0.smithi155.stdout:9/578: mknod da/d15/d17/cca 0 2023-12-16T05:56:33.230 INFO:tasks.workunit.client.1.smithi156.stdout:4/139: dwrite d9/fa [0,4194304] 0 2023-12-16T05:56:33.230 INFO:tasks.workunit.client.0.smithi155.stdout:1/582: rename d1/d7/d16/d30/c59 to d1/d17/cba 0 2023-12-16T05:56:33.230 INFO:tasks.workunit.client.0.smithi155.stdout:1/583: write d1/f1e [926451,28050] 0 2023-12-16T05:56:33.231 INFO:tasks.workunit.client.0.smithi155.stdout:5/554: dwrite d0/d2/fa6 [0,4194304] 0 2023-12-16T05:56:33.231 INFO:tasks.workunit.client.0.smithi155.stdout:5/555: chown d0/d2/l76 5402 1 2023-12-16T05:56:33.231 INFO:tasks.workunit.client.0.smithi155.stdout:5/556: chown d0/d2/d2a/d30/d53/lab 23 1 2023-12-16T05:56:33.231 INFO:tasks.workunit.client.1.smithi156.stdout:4/140: creat d9/f28 x:0 0 0 2023-12-16T05:56:33.232 INFO:tasks.workunit.client.1.smithi156.stdout:4/141: symlink d9/l29 0 2023-12-16T05:56:33.232 INFO:tasks.workunit.client.1.smithi156.stdout:4/142: chown d9/f15 0 1 2023-12-16T05:56:33.232 INFO:tasks.workunit.client.1.smithi156.stdout:4/143: fdatasync d9/f19 0 2023-12-16T05:56:33.233 INFO:tasks.workunit.client.1.smithi156.stdout:4/144: mknod d9/c2a 0 2023-12-16T05:56:33.234 INFO:tasks.workunit.client.1.smithi156.stdout:4/145: write f5 [268381,56799] 0 2023-12-16T05:56:33.236 INFO:tasks.workunit.client.0.smithi155.stdout:0/489: mknod d7/d13/d45/c9d 0 2023-12-16T05:56:33.236 INFO:tasks.workunit.client.0.smithi155.stdout:0/490: truncate d7/f83 479293 0 2023-12-16T05:56:33.236 INFO:tasks.workunit.client.0.smithi155.stdout:0/491: read d7/d2d/f3f [192557,93184] 0 2023-12-16T05:56:33.237 INFO:tasks.workunit.client.1.smithi156.stdout:4/146: mkdir d9/d2b 0 2023-12-16T05:56:33.237 INFO:tasks.workunit.client.0.smithi155.stdout:1/584: rename d1/d25/d43/f5b to d1/d17/d28/d74/fbb 0 2023-12-16T05:56:33.245 INFO:tasks.workunit.client.0.smithi155.stdout:6/607: mknod d0/cc0 0 2023-12-16T05:56:33.245 INFO:tasks.workunit.client.0.smithi155.stdout:0/492: creat d7/d2d/f9e x:0 0 0 2023-12-16T05:56:33.247 INFO:tasks.workunit.client.0.smithi155.stdout:3/359: rename d0/d14/d51/f44 to d0/d14/f6a 0 2023-12-16T05:56:33.249 INFO:tasks.workunit.client.0.smithi155.stdout:0/493: symlink d7/df/d73/d8d/d9b/l9f 0 2023-12-16T05:56:33.251 INFO:tasks.workunit.client.0.smithi155.stdout:8/437: rename f2 to d4/d62/d66/d78/d88/d1b/d1c/d46/f89 0 2023-12-16T05:56:33.253 INFO:tasks.workunit.client.1.smithi156.stdout:4/147: getdents d9 0 2023-12-16T05:56:33.253 INFO:tasks.workunit.client.0.smithi155.stdout:3/360: dread d0/f30 [0,4194304] 0 2023-12-16T05:56:33.253 INFO:tasks.workunit.client.0.smithi155.stdout:3/361: chown d0/d1e/l69 1658 1 2023-12-16T05:56:33.254 INFO:tasks.workunit.client.1.smithi156.stdout:4/148: mkdir d9/d2c 0 2023-12-16T05:56:33.254 INFO:tasks.workunit.client.1.smithi156.stdout:4/149: creat d9/d2c/f2d x:0 0 0 2023-12-16T05:56:33.256 INFO:tasks.workunit.client.0.smithi155.stdout:8/438: mknod d4/d62/d66/d78/d88/d1b/d1c/d46/c8a 0 2023-12-16T05:56:33.256 INFO:tasks.workunit.client.0.smithi155.stdout:8/439: dread - d4/d62/d66/d78/d88/f7f zero size 2023-12-16T05:56:33.257 INFO:tasks.workunit.client.0.smithi155.stdout:3/362: link d0/d14/c37 d0/c6b 0 2023-12-16T05:56:33.257 INFO:tasks.workunit.client.0.smithi155.stdout:3/363: chown d0/c2 3 1 2023-12-16T05:56:33.259 INFO:tasks.workunit.client.0.smithi155.stdout:6/608: dread d0/d3/d2c/d3e/d4c/d1b/f21 [0,4194304] 0 2023-12-16T05:56:33.259 INFO:tasks.workunit.client.0.smithi155.stdout:6/609: dread - d0/d3/d2c/d3e/d4c/fa2 zero size 2023-12-16T05:56:33.259 INFO:tasks.workunit.client.0.smithi155.stdout:1/585: dwrite d1/d17/f86 [0,4194304] 0 2023-12-16T05:56:33.260 INFO:tasks.workunit.client.0.smithi155.stdout:3/364: rename d0/d1a/d33/f3a to d0/d1a/d33/d57/f6c 0 2023-12-16T05:56:33.261 INFO:tasks.workunit.client.0.smithi155.stdout:9/579: dwrite da/d15/f39 [0,4194304] 0 2023-12-16T05:56:33.261 INFO:tasks.workunit.client.0.smithi155.stdout:3/365: read d0/d1a/d33/d57/f63 [706431,933] 0 2023-12-16T05:56:33.269 INFO:tasks.workunit.client.0.smithi155.stdout:9/580: truncate da/d15/d17/d24/d26/d2e/d83/d8f/fb2 2114375 0 2023-12-16T05:56:33.270 INFO:tasks.workunit.client.0.smithi155.stdout:9/581: link da/d15/d17/d36/c43 da/d15/d17/d24/d62/ccb 0 2023-12-16T05:56:33.272 INFO:tasks.workunit.client.0.smithi155.stdout:9/582: link da/d15/d17/d24/d26/d2e/f63 da/d15/d17/d24/d26/fcc 0 2023-12-16T05:56:33.274 INFO:tasks.workunit.client.0.smithi155.stdout:9/583: symlink da/d15/d17/d24/d62/d91/lcd 0 2023-12-16T05:56:33.274 INFO:tasks.workunit.client.0.smithi155.stdout:9/584: readlink da/d15/d17/d24/d26/d2e/lb3 0 2023-12-16T05:56:33.274 INFO:tasks.workunit.client.0.smithi155.stdout:9/585: chown da/d15/d17/d24/f64 13 1 2023-12-16T05:56:33.281 INFO:tasks.workunit.client.1.smithi156.stdout:4/150: dread d9/f16 [0,4194304] 0 2023-12-16T05:56:33.281 INFO:tasks.workunit.client.1.smithi156.stdout:4/151: chown f3 113 1 2023-12-16T05:56:33.281 INFO:tasks.workunit.client.1.smithi156.stdout:4/152: chown f3 12805606 1 2023-12-16T05:56:33.281 INFO:tasks.workunit.client.1.smithi156.stdout:4/153: write d9/f1b [9107543,121193] 0 2023-12-16T05:56:33.282 INFO:tasks.workunit.client.0.smithi155.stdout:6/610: dwrite d0/df/d5e/d46/d6d/f71 [4194304,4194304] 0 2023-12-16T05:56:33.282 INFO:tasks.workunit.client.0.smithi155.stdout:6/611: chown d0/d3/f11 13735418 1 2023-12-16T05:56:33.282 INFO:tasks.workunit.client.0.smithi155.stdout:3/366: dread d0/f2e [0,4194304] 0 2023-12-16T05:56:33.284 INFO:tasks.workunit.client.0.smithi155.stdout:3/367: write d0/d14/f35 [3106978,110885] 0 2023-12-16T05:56:33.287 INFO:tasks.workunit.client.0.smithi155.stdout:3/368: unlink d0/d1a/f2d 0 2023-12-16T05:56:33.288 INFO:tasks.workunit.client.0.smithi155.stdout:3/369: write d0/d14/f18 [3528426,122981] 0 2023-12-16T05:56:33.293 INFO:tasks.workunit.client.1.smithi156.stdout:0/176: sync 2023-12-16T05:56:33.293 INFO:tasks.workunit.client.1.smithi156.stdout:9/160: sync 2023-12-16T05:56:33.293 INFO:tasks.workunit.client.1.smithi156.stdout:9/161: chown d6/d19/l2c 4574858 1 2023-12-16T05:56:33.294 INFO:tasks.workunit.client.1.smithi156.stdout:9/162: fsync d6/f14 0 2023-12-16T05:56:33.295 INFO:tasks.workunit.client.1.smithi156.stdout:9/163: mkdir d6/d19/d25/d3a 0 2023-12-16T05:56:33.295 INFO:tasks.workunit.client.0.smithi155.stdout:1/586: dwrite d1/d7/fa0 [0,4194304] 0 2023-12-16T05:56:33.296 INFO:tasks.workunit.client.1.smithi156.stdout:9/164: mknod d6/d19/d30/c3b 0 2023-12-16T05:56:33.296 INFO:tasks.workunit.client.1.smithi156.stdout:9/165: chown d6/d19/f29 395988869 1 2023-12-16T05:56:33.296 INFO:tasks.workunit.client.0.smithi155.stdout:6/612: dread d0/df/d5e/d46/f47 [4194304,4194304] 0 2023-12-16T05:56:33.296 INFO:tasks.workunit.client.0.smithi155.stdout:9/586: dwrite da/d15/d17/d24/d26/d2e/d32/f35 [0,4194304] 0 2023-12-16T05:56:33.298 INFO:tasks.workunit.client.0.smithi155.stdout:1/587: mkdir d1/d7/d4b/d8e/dbc 0 2023-12-16T05:56:33.298 INFO:tasks.workunit.client.0.smithi155.stdout:1/588: chown d1/d17/d28/d85 618615 1 2023-12-16T05:56:33.299 INFO:tasks.workunit.client.1.smithi156.stdout:4/154: dwrite d9/f27 [0,4194304] 0 2023-12-16T05:56:33.300 INFO:tasks.workunit.client.1.smithi156.stdout:4/155: getdents d9/d2c 0 2023-12-16T05:56:33.300 INFO:tasks.workunit.client.1.smithi156.stdout:4/156: fsync d9/f28 0 2023-12-16T05:56:33.304 INFO:tasks.workunit.client.0.smithi155.stdout:9/587: unlink da/d15/d17/d24/d26/d2e/lb3 0 2023-12-16T05:56:33.305 INFO:tasks.workunit.client.0.smithi155.stdout:1/589: truncate d1/d17/d28/f70 3721980 0 2023-12-16T05:56:33.306 INFO:tasks.workunit.client.0.smithi155.stdout:1/590: fsync d1/d25/f32 0 2023-12-16T05:56:33.307 INFO:tasks.workunit.client.0.smithi155.stdout:9/588: dread da/f14 [0,4194304] 0 2023-12-16T05:56:33.307 INFO:tasks.workunit.client.0.smithi155.stdout:1/591: creat d1/d25/d43/d5d/d5e/fbd x:0 0 0 2023-12-16T05:56:33.316 INFO:tasks.workunit.client.1.smithi156.stdout:9/166: getdents d6/d19/d25 0 2023-12-16T05:56:33.317 INFO:tasks.workunit.client.1.smithi156.stdout:9/167: truncate d6/f13 1763890 0 2023-12-16T05:56:33.324 INFO:tasks.workunit.client.1.smithi156.stdout:4/157: dread f0 [0,4194304] 0 2023-12-16T05:56:33.325 INFO:tasks.workunit.client.1.smithi156.stdout:4/158: stat d9/c20 0 2023-12-16T05:56:33.327 INFO:tasks.workunit.client.0.smithi155.stdout:3/370: dwrite d0/d1a/f1d [4194304,4194304] 0 2023-12-16T05:56:33.327 INFO:tasks.workunit.client.0.smithi155.stdout:3/371: chown d0/d14/c5b 16386674 1 2023-12-16T05:56:33.328 INFO:tasks.workunit.client.0.smithi155.stdout:6/613: dwrite d0/d3/d2c/d3e/d4c/f33 [0,4194304] 0 2023-12-16T05:56:33.328 INFO:tasks.workunit.client.0.smithi155.stdout:6/614: readlink d0/l10 0 2023-12-16T05:56:33.328 INFO:tasks.workunit.client.0.smithi155.stdout:6/615: fsync d0/d3/d7a/d77/f83 0 2023-12-16T05:56:33.329 INFO:tasks.workunit.client.1.smithi156.stdout:0/177: dwrite d2/d7/dd/d1c/f25 [0,4194304] 0 2023-12-16T05:56:33.329 INFO:tasks.workunit.client.1.smithi156.stdout:0/178: read - d2/d7/f18 zero size 2023-12-16T05:56:33.329 INFO:tasks.workunit.client.1.smithi156.stdout:0/179: readlink d2/d7/dd/l17 0 2023-12-16T05:56:33.329 INFO:tasks.workunit.client.1.smithi156.stdout:4/159: truncate d9/f27 246967 0 2023-12-16T05:56:33.330 INFO:tasks.workunit.client.0.smithi155.stdout:6/616: creat d0/fc1 x:0 0 0 2023-12-16T05:56:33.331 INFO:tasks.workunit.client.0.smithi155.stdout:6/617: truncate d0/d3/d7a/d77/fa3 525061 0 2023-12-16T05:56:33.331 INFO:tasks.workunit.client.1.smithi156.stdout:0/180: mknod d2/d7/dd/d29/d2e/c2f 0 2023-12-16T05:56:33.331 INFO:tasks.workunit.client.1.smithi156.stdout:0/181: readlink d2/d7/dd/l17 0 2023-12-16T05:56:33.332 INFO:tasks.workunit.client.1.smithi156.stdout:9/168: dwrite d6/f14 [0,4194304] 0 2023-12-16T05:56:33.333 INFO:tasks.workunit.client.1.smithi156.stdout:4/160: rename f3 to d9/d2c/f2e 0 2023-12-16T05:56:33.333 INFO:tasks.workunit.client.1.smithi156.stdout:4/161: fsync d9/f22 0 2023-12-16T05:56:33.333 INFO:tasks.workunit.client.0.smithi155.stdout:6/618: mknod d0/df/d5e/d99/cc2 0 2023-12-16T05:56:33.334 INFO:tasks.workunit.client.0.smithi155.stdout:6/619: write d0/d3/d2c/f6c [1076085,93123] 0 2023-12-16T05:56:33.334 INFO:tasks.workunit.client.0.smithi155.stdout:9/589: dwrite da/d15/d17/d36/d5b/f71 [0,4194304] 0 2023-12-16T05:56:33.335 INFO:tasks.workunit.client.1.smithi156.stdout:0/182: truncate d2/d7/f10 3493224 0 2023-12-16T05:56:33.336 INFO:tasks.workunit.client.0.smithi155.stdout:4/460: sync 2023-12-16T05:56:33.336 INFO:tasks.workunit.client.0.smithi155.stdout:2/431: sync 2023-12-16T05:56:33.336 INFO:tasks.workunit.client.0.smithi155.stdout:7/486: sync 2023-12-16T05:56:33.336 INFO:tasks.workunit.client.0.smithi155.stdout:6/620: mkdir d0/d3/d7a/db0/dc3 0 2023-12-16T05:56:33.336 INFO:tasks.workunit.client.0.smithi155.stdout:7/487: write d0/d6a/f8d [868953,121918] 0 2023-12-16T05:56:33.336 INFO:tasks.workunit.client.0.smithi155.stdout:6/621: chown d0/d3/d2c/d3e/d4c 1 1 2023-12-16T05:56:33.336 INFO:tasks.workunit.client.0.smithi155.stdout:6/622: chown d0/l10 68 1 2023-12-16T05:56:33.336 INFO:tasks.workunit.client.0.smithi155.stdout:6/623: chown d0/d3/d2c/f30 1733547 1 2023-12-16T05:56:33.337 INFO:tasks.workunit.client.1.smithi156.stdout:9/169: creat d6/d19/d25/f3c x:0 0 0 2023-12-16T05:56:33.337 INFO:tasks.workunit.client.1.smithi156.stdout:9/170: stat d6/d19/f1a 0 2023-12-16T05:56:33.338 INFO:tasks.workunit.client.0.smithi155.stdout:2/432: dread d0/d7/f7e [0,4194304] 0 2023-12-16T05:56:33.340 INFO:tasks.workunit.client.1.smithi156.stdout:0/183: unlink d2/d7/c26 0 2023-12-16T05:56:33.340 INFO:tasks.workunit.client.1.smithi156.stdout:0/184: truncate d2/f1b 365170 0 2023-12-16T05:56:33.340 INFO:tasks.workunit.client.1.smithi156.stdout:0/185: fdatasync f0 0 2023-12-16T05:56:33.340 INFO:tasks.workunit.client.1.smithi156.stdout:0/186: chown d2/d7/f15 10254378 1 2023-12-16T05:56:33.341 INFO:tasks.workunit.client.1.smithi156.stdout:4/162: dread d9/f19 [0,4194304] 0 2023-12-16T05:56:33.341 INFO:tasks.workunit.client.0.smithi155.stdout:9/590: symlink da/d15/d17/lce 0 2023-12-16T05:56:33.341 INFO:tasks.workunit.client.0.smithi155.stdout:6/624: symlink d0/d3/d2c/lc4 0 2023-12-16T05:56:33.342 INFO:tasks.workunit.client.0.smithi155.stdout:2/433: rmdir d0/d7/d1f 39 2023-12-16T05:56:33.344 INFO:tasks.workunit.client.0.smithi155.stdout:9/591: link da/d15/d17/d24/d26/d2e/f4b da/d15/d17/d36/d5b/fcf 0 2023-12-16T05:56:33.345 INFO:tasks.workunit.client.0.smithi155.stdout:2/434: creat d0/d7/d1f/d74/d85/f90 x:0 0 0 2023-12-16T05:56:33.345 INFO:tasks.workunit.client.0.smithi155.stdout:6/625: write d0/df/f18 [5515665,109150] 0 2023-12-16T05:56:33.345 INFO:tasks.workunit.client.0.smithi155.stdout:6/626: fsync d0/d3/d7a/f4e 0 2023-12-16T05:56:33.348 INFO:tasks.workunit.client.0.smithi155.stdout:9/592: rename da/d15/f78 to da/d15/d17/d24/d62/d91/fd0 0 2023-12-16T05:56:33.348 INFO:tasks.workunit.client.0.smithi155.stdout:9/593: write da/d15/d17/d24/d26/d2e/f87 [741220,16620] 0 2023-12-16T05:56:33.348 INFO:tasks.workunit.client.0.smithi155.stdout:9/594: truncate da/f10 4300225 0 2023-12-16T05:56:33.352 INFO:tasks.workunit.client.0.smithi155.stdout:6/627: rename d0/d3/d2c/d3e/d4c/l58 to d0/d3/d7a/d77/lc5 0 2023-12-16T05:56:33.352 INFO:tasks.workunit.client.0.smithi155.stdout:6/628: write d0/df/d5e/d5b/f76 [573551,45779] 0 2023-12-16T05:56:33.355 INFO:tasks.workunit.client.0.smithi155.stdout:9/595: creat da/d15/d17/d36/d5b/d60/fd1 x:0 0 0 2023-12-16T05:56:33.355 INFO:tasks.workunit.client.0.smithi155.stdout:9/596: chown da/d15/d17/d24/d26/d2e/l3b 43 1 2023-12-16T05:56:33.355 INFO:tasks.workunit.client.0.smithi155.stdout:6/629: write d0/d3/d2c/d3e/d4c/fba [3287747,21522] 0 2023-12-16T05:56:33.356 INFO:tasks.workunit.client.0.smithi155.stdout:6/630: getdents d0/df/d5e/d99 0 2023-12-16T05:56:33.357 INFO:tasks.workunit.client.0.smithi155.stdout:6/631: mkdir d0/df/d5e/d7e/db6/dc6 0 2023-12-16T05:56:33.357 INFO:tasks.workunit.client.0.smithi155.stdout:6/632: chown d0/df/c32 6613215 1 2023-12-16T05:56:33.358 INFO:tasks.workunit.client.0.smithi155.stdout:6/633: creat d0/df/d5e/d99/fc7 x:0 0 0 2023-12-16T05:56:33.359 INFO:tasks.workunit.client.0.smithi155.stdout:6/634: getdents d0/df/d5e/d46/d6d 0 2023-12-16T05:56:33.361 INFO:tasks.workunit.client.0.smithi155.stdout:6/635: rename d0/d3/f39 to d0/d3/d2c/db8/fc8 0 2023-12-16T05:56:33.361 INFO:tasks.workunit.client.0.smithi155.stdout:6/636: chown d0/d3/d2c/d3e/d4c/d1b 46 1 2023-12-16T05:56:33.362 INFO:tasks.workunit.client.0.smithi155.stdout:6/637: creat d0/df/d5e/d7e/db6/dc6/fc9 x:0 0 0 2023-12-16T05:56:33.365 INFO:tasks.workunit.client.0.smithi155.stdout:9/597: dread da/d15/d17/d36/f4d [0,4194304] 0 2023-12-16T05:56:33.366 INFO:tasks.workunit.client.0.smithi155.stdout:9/598: truncate da/f5a 759918 0 2023-12-16T05:56:33.366 INFO:tasks.workunit.client.0.smithi155.stdout:9/599: chown da/d15/d17/d24/d62/f68 37293264 1 2023-12-16T05:56:33.368 INFO:tasks.workunit.client.0.smithi155.stdout:9/600: creat da/d15/d17/d24/d26/d2e/fd2 x:0 0 0 2023-12-16T05:56:33.368 INFO:tasks.workunit.client.0.smithi155.stdout:4/461: dwrite d0/da/f5e [0,4194304] 0 2023-12-16T05:56:33.368 INFO:tasks.workunit.client.0.smithi155.stdout:9/601: dread - da/d15/d17/d36/d5b/d60/d9e/fb5 zero size 2023-12-16T05:56:33.368 INFO:tasks.workunit.client.1.smithi156.stdout:9/171: dwrite d6/d19/f1a [0,4194304] 0 2023-12-16T05:56:33.369 INFO:tasks.workunit.client.1.smithi156.stdout:9/172: dread - d6/d19/f24 zero size 2023-12-16T05:56:33.369 INFO:tasks.workunit.client.1.smithi156.stdout:9/173: getdents d6/d19/d25/d3a 0 2023-12-16T05:56:33.370 INFO:tasks.workunit.client.0.smithi155.stdout:4/462: rmdir d0/da/d36/d5f/d75 39 2023-12-16T05:56:33.371 INFO:tasks.workunit.client.0.smithi155.stdout:4/463: mkdir d0/da/d36/d5f/d75/d89/d9a 0 2023-12-16T05:56:33.373 INFO:tasks.workunit.client.1.smithi156.stdout:9/174: symlink d6/l3d 0 2023-12-16T05:56:33.375 INFO:tasks.workunit.client.1.smithi156.stdout:9/175: symlink d6/d2e/l3e 0 2023-12-16T05:56:33.375 INFO:tasks.workunit.client.1.smithi156.stdout:9/176: truncate d6/d19/f1f 891516 0 2023-12-16T05:56:33.375 INFO:tasks.workunit.client.1.smithi156.stdout:0/187: dwrite f0 [0,4194304] 0 2023-12-16T05:56:33.376 INFO:tasks.workunit.client.1.smithi156.stdout:9/177: unlink d6/l16 0 2023-12-16T05:56:33.376 INFO:tasks.workunit.client.1.smithi156.stdout:0/188: stat d2/d7/dd/d1c/f25 0 2023-12-16T05:56:33.378 INFO:tasks.workunit.client.1.smithi156.stdout:9/178: unlink l5 0 2023-12-16T05:56:33.379 INFO:tasks.workunit.client.0.smithi155.stdout:4/464: write d0/d10/d46/d16/d1a/f72 [2308594,79687] 0 2023-12-16T05:56:33.379 INFO:tasks.workunit.client.0.smithi155.stdout:4/465: chown d0/d10/d46/d16/d30/d52/l59 685845803 1 2023-12-16T05:56:33.379 INFO:tasks.workunit.client.1.smithi156.stdout:0/189: chown d2/d7/dd/c20 5131 1 2023-12-16T05:56:33.379 INFO:tasks.workunit.client.1.smithi156.stdout:0/190: truncate d2/ff 678612 0 2023-12-16T05:56:33.380 INFO:tasks.workunit.client.0.smithi155.stdout:4/466: write d0/da/d36/d5f/d75/d89/f8a [127362,80385] 0 2023-12-16T05:56:33.380 INFO:tasks.workunit.client.0.smithi155.stdout:4/467: chown d0/d10/d46/l41 232 1 2023-12-16T05:56:33.380 INFO:tasks.workunit.client.1.smithi156.stdout:9/179: creat d6/d19/d30/f3f x:0 0 0 2023-12-16T05:56:33.380 INFO:tasks.workunit.client.1.smithi156.stdout:0/191: readlink d2/d7/dd/l17 0 2023-12-16T05:56:33.381 INFO:tasks.workunit.client.0.smithi155.stdout:4/468: rmdir d0/da/d36/d5f/d7b/d90 0 2023-12-16T05:56:33.382 INFO:tasks.workunit.client.1.smithi156.stdout:9/180: symlink d6/d19/l40 0 2023-12-16T05:56:33.382 INFO:tasks.workunit.client.1.smithi156.stdout:9/181: chown d6/l23 194116 1 2023-12-16T05:56:33.382 INFO:tasks.workunit.client.1.smithi156.stdout:9/182: read - d6/d19/d25/f31 zero size 2023-12-16T05:56:33.384 INFO:tasks.workunit.client.0.smithi155.stdout:6/638: dwrite d0/d3/d2c/d3e/d4c/d1b/f6a [0,4194304] 0 2023-12-16T05:56:33.384 INFO:tasks.workunit.client.0.smithi155.stdout:6/639: truncate d0/d3/f11 4349491 0 2023-12-16T05:56:33.384 INFO:tasks.workunit.client.1.smithi156.stdout:0/192: link d2/d7/f10 d2/d7/dd/f30 0 2023-12-16T05:56:33.385 INFO:tasks.workunit.client.1.smithi156.stdout:9/183: symlink d6/d19/d25/l41 0 2023-12-16T05:56:33.386 INFO:tasks.workunit.client.1.smithi156.stdout:0/193: truncate d2/d7/dd/f30 1601236 0 2023-12-16T05:56:33.386 INFO:tasks.workunit.client.1.smithi156.stdout:0/194: readlink d2/d7/dd/l17 0 2023-12-16T05:56:33.386 INFO:tasks.workunit.client.1.smithi156.stdout:0/195: dread - d2/d7/f18 zero size 2023-12-16T05:56:33.387 INFO:tasks.workunit.client.1.smithi156.stdout:9/184: mknod d6/d19/d25/c42 0 2023-12-16T05:56:33.387 INFO:tasks.workunit.client.1.smithi156.stdout:9/185: write d6/d19/f1a [4819678,9238] 0 2023-12-16T05:56:33.388 INFO:tasks.workunit.client.1.smithi156.stdout:0/196: write d2/f22 [3103674,76439] 0 2023-12-16T05:56:33.388 INFO:tasks.workunit.client.1.smithi156.stdout:9/186: creat d6/d19/d25/d3a/f43 x:0 0 0 2023-12-16T05:56:33.391 INFO:tasks.workunit.client.0.smithi155.stdout:9/602: dwrite da/d15/d17/d24/d26/d2e/f4b [0,4194304] 0 2023-12-16T05:56:33.394 INFO:tasks.workunit.client.1.smithi156.stdout:9/187: creat d6/d19/d30/f44 x:0 0 0 2023-12-16T05:56:33.404 INFO:tasks.workunit.client.0.smithi155.stdout:6/640: symlink d0/dbd/lca 0 2023-12-16T05:56:33.404 INFO:tasks.workunit.client.0.smithi155.stdout:6/641: write d0/d3/f38 [5094920,120634] 0 2023-12-16T05:56:33.424 INFO:tasks.workunit.client.0.smithi155.stdout:4/469: dwrite d0/d10/f8c [0,4194304] 0 2023-12-16T05:56:33.424 INFO:tasks.workunit.client.0.smithi155.stdout:4/470: chown d0/da/l17 825044 1 2023-12-16T05:56:33.424 INFO:tasks.workunit.client.0.smithi155.stdout:9/603: dwrite da/d15/d17/d36/d5b/d98/faf [0,4194304] 0 2023-12-16T05:56:33.430 INFO:tasks.workunit.client.1.smithi156.stdout:9/188: dwrite d6/d19/d30/f3f [0,4194304] 0 2023-12-16T05:56:33.430 INFO:tasks.workunit.client.1.smithi156.stdout:9/189: fsync d6/f15 0 2023-12-16T05:56:33.432 INFO:tasks.workunit.client.1.smithi156.stdout:0/197: dwrite d2/d7/dd/f1f [0,4194304] 0 2023-12-16T05:56:33.432 INFO:tasks.workunit.client.1.smithi156.stdout:0/198: stat d2/d7/f15 0 2023-12-16T05:56:33.432 INFO:tasks.workunit.client.0.smithi155.stdout:4/471: creat d0/d10/f9b x:0 0 0 2023-12-16T05:56:33.433 INFO:tasks.workunit.client.1.smithi156.stdout:9/190: creat d6/d2e/f45 x:0 0 0 2023-12-16T05:56:33.433 INFO:tasks.workunit.client.1.smithi156.stdout:0/199: write d2/d7/f15 [3657940,115540] 0 2023-12-16T05:56:33.433 INFO:tasks.workunit.client.0.smithi155.stdout:9/604: rename da/d15/d17/c30 to da/cd3 0 2023-12-16T05:56:33.433 INFO:tasks.workunit.client.0.smithi155.stdout:6/642: dwrite d0/d3/d2c/d3e/d4c/fa2 [0,4194304] 0 2023-12-16T05:56:33.434 INFO:tasks.workunit.client.0.smithi155.stdout:4/472: creat d0/da/d36/d5f/d75/d89/d9a/f9c x:0 0 0 2023-12-16T05:56:33.438 INFO:tasks.workunit.client.1.smithi156.stdout:9/191: getdents d6 0 2023-12-16T05:56:33.441 INFO:tasks.workunit.client.0.smithi155.stdout:9/605: creat da/d15/d17/d36/d5b/d60/d9e/fd4 x:0 0 0 2023-12-16T05:56:33.443 INFO:tasks.workunit.client.0.smithi155.stdout:6/643: rename d0/d3/d2c/d3e/d4c/f33 to d0/d3/d2c/d3e/d4c/fcb 0 2023-12-16T05:56:33.443 INFO:tasks.workunit.client.0.smithi155.stdout:6/644: fsync d0/df/d5e/d46/d6d/f74 0 2023-12-16T05:56:33.444 INFO:tasks.workunit.client.1.smithi156.stdout:0/200: mknod d2/d7/dd/d1c/c31 0 2023-12-16T05:56:33.444 INFO:tasks.workunit.client.1.smithi156.stdout:0/201: write d2/d7/dd/d1c/f25 [285335,73326] 0 2023-12-16T05:56:33.444 INFO:tasks.workunit.client.0.smithi155.stdout:9/606: creat da/d15/d17/d24/d26/fd5 x:0 0 0 2023-12-16T05:56:33.444 INFO:tasks.workunit.client.0.smithi155.stdout:9/607: fdatasync da/f10 0 2023-12-16T05:56:33.446 INFO:tasks.workunit.client.1.smithi156.stdout:9/192: creat d6/f46 x:0 0 0 2023-12-16T05:56:33.446 INFO:tasks.workunit.client.0.smithi155.stdout:9/608: link da/d15/d17/d24/d62/d91/lcd da/d15/d17/d36/d5b/d60/d9e/ld6 0 2023-12-16T05:56:33.448 INFO:tasks.workunit.client.0.smithi155.stdout:9/609: creat da/d15/d17/d36/d5b/d98/fd7 x:0 0 0 2023-12-16T05:56:33.448 INFO:tasks.workunit.client.0.smithi155.stdout:9/610: truncate da/d15/f31 1352138 0 2023-12-16T05:56:33.448 INFO:tasks.workunit.client.0.smithi155.stdout:9/611: chown da/d15/d17/d24/d26/d2e/d83/c8b 90 1 2023-12-16T05:56:33.448 INFO:tasks.workunit.client.1.smithi156.stdout:0/202: creat d2/d23/f32 x:0 0 0 2023-12-16T05:56:33.449 INFO:tasks.workunit.client.1.smithi156.stdout:9/193: write d6/f14 [4338785,111941] 0 2023-12-16T05:56:33.450 INFO:tasks.workunit.client.1.smithi156.stdout:0/203: creat d2/d7/dd/f33 x:0 0 0 2023-12-16T05:56:33.452 INFO:tasks.workunit.client.1.smithi156.stdout:9/194: stat d6/f1e 0 2023-12-16T05:56:33.453 INFO:tasks.workunit.client.0.smithi155.stdout:4/473: dwrite d0/d10/d46/d16/d1a/f2b [0,4194304] 0 2023-12-16T05:56:33.454 INFO:tasks.workunit.client.0.smithi155.stdout:6/645: dread d0/d3/d2c/f6e [0,4194304] 0 2023-12-16T05:56:33.455 INFO:tasks.workunit.client.0.smithi155.stdout:4/474: creat d0/d10/f9d x:0 0 0 2023-12-16T05:56:33.455 INFO:tasks.workunit.client.0.smithi155.stdout:4/475: stat d0/d10/d46/d16/d30/d52/c60 0 2023-12-16T05:56:33.455 INFO:tasks.workunit.client.0.smithi155.stdout:6/646: unlink d0/d3/f55 0 2023-12-16T05:56:33.456 INFO:tasks.workunit.client.1.smithi156.stdout:9/195: dread - d6/d19/d30/f44 zero size 2023-12-16T05:56:33.456 INFO:tasks.workunit.client.0.smithi155.stdout:4/476: mkdir d0/d10/d46/d16/d30/d52/d88/d9e 0 2023-12-16T05:56:33.456 INFO:tasks.workunit.client.0.smithi155.stdout:6/647: stat d0/df/d5e/d46/cab 0 2023-12-16T05:56:33.457 INFO:tasks.workunit.client.0.smithi155.stdout:6/648: write d0/d3/d2c/d3e/d4c/fa2 [5094939,117310] 0 2023-12-16T05:56:33.457 INFO:tasks.workunit.client.1.smithi156.stdout:0/204: rmdir d2/d7/dd/d29 39 2023-12-16T05:56:33.458 INFO:tasks.workunit.client.0.smithi155.stdout:4/477: rename d0/da/d81 to d0/d10/d46/d16/d1a/d70/d9f 0 2023-12-16T05:56:33.458 INFO:tasks.workunit.client.0.smithi155.stdout:4/478: write d0/da/f5a [452701,83583] 0 2023-12-16T05:56:33.458 INFO:tasks.workunit.client.0.smithi155.stdout:4/479: write d0/f20 [5065819,87076] 0 2023-12-16T05:56:33.458 INFO:tasks.workunit.client.0.smithi155.stdout:6/649: truncate d0/df/f18 6594916 0 2023-12-16T05:56:33.460 INFO:tasks.workunit.client.1.smithi156.stdout:9/196: rename d6/d19/l2c to d6/d2e/l47 0 2023-12-16T05:56:33.461 INFO:tasks.workunit.client.0.smithi155.stdout:6/650: rename d0/d3/f19 to d0/df/d5e/d7e/db6/dc6/fcc 0 2023-12-16T05:56:33.461 INFO:tasks.workunit.client.0.smithi155.stdout:6/651: chown d0/fc1 4991 1 2023-12-16T05:56:33.461 INFO:tasks.workunit.client.0.smithi155.stdout:6/652: readlink d0/d3/d2c/lc4 0 2023-12-16T05:56:33.462 INFO:tasks.workunit.client.0.smithi155.stdout:6/653: readlink d0/d3/l52 0 2023-12-16T05:56:33.462 INFO:tasks.workunit.client.1.smithi156.stdout:0/205: dread d2/f24 [0,4194304] 0 2023-12-16T05:56:33.463 INFO:tasks.workunit.client.1.smithi156.stdout:9/197: mkdir d6/d19/d30/d48 0 2023-12-16T05:56:33.463 INFO:tasks.workunit.client.0.smithi155.stdout:6/654: rename d0/d3/d2c/d3e/d4c/d1b/l7d to d0/df/d5e/d46/d6d/lcd 0 2023-12-16T05:56:33.464 INFO:tasks.workunit.client.1.smithi156.stdout:2/216: sync 2023-12-16T05:56:33.466 INFO:tasks.workunit.client.0.smithi155.stdout:4/480: dread d0/da/d36/d5f/f6d [0,4194304] 0 2023-12-16T05:56:33.466 INFO:tasks.workunit.client.0.smithi155.stdout:4/481: truncate d0/da/d36/d5f/d75/d3d/d43/f62 723413 0 2023-12-16T05:56:33.466 INFO:tasks.workunit.client.0.smithi155.stdout:9/612: dwrite da/f80 [0,4194304] 0 2023-12-16T05:56:33.467 INFO:tasks.workunit.client.0.smithi155.stdout:6/655: mkdir d0/d3/d7a/db0/dc3/dce 0 2023-12-16T05:56:33.467 INFO:tasks.workunit.client.0.smithi155.stdout:6/656: stat d0/d3/f11 0 2023-12-16T05:56:33.467 INFO:tasks.workunit.client.0.smithi155.stdout:9/613: write da/d15/d17/d24/d26/d2e/f63 [326943,54961] 0 2023-12-16T05:56:33.474 INFO:tasks.workunit.client.0.smithi155.stdout:6/657: mknod d0/df/d5e/d7e/db6/ccf 0 2023-12-16T05:56:33.480 INFO:tasks.workunit.client.0.smithi155.stdout:6/658: truncate d0/d3/f12 1051148 0 2023-12-16T05:56:33.483 INFO:tasks.workunit.client.0.smithi155.stdout:6/659: creat d0/df/d5e/d7e/db6/dc6/fd0 x:0 0 0 2023-12-16T05:56:33.484 INFO:tasks.workunit.client.0.smithi155.stdout:6/660: mknod d0/d3/d2c/d8b/d85/cd1 0 2023-12-16T05:56:33.484 INFO:tasks.workunit.client.0.smithi155.stdout:6/661: chown d0/d3/d2c/c7f 316679262 1 2023-12-16T05:56:33.485 INFO:tasks.workunit.client.0.smithi155.stdout:6/662: rmdir d0/dbd 39 2023-12-16T05:56:33.486 INFO:tasks.workunit.client.0.smithi155.stdout:6/663: creat d0/df/d5e/d99/fd2 x:0 0 0 2023-12-16T05:56:33.487 INFO:tasks.workunit.client.0.smithi155.stdout:6/664: symlink d0/d3/d7a/db0/dc3/dce/ld3 0 2023-12-16T05:56:33.487 INFO:tasks.workunit.client.0.smithi155.stdout:6/665: dread - d0/df/d5e/d99/f9b zero size 2023-12-16T05:56:33.488 INFO:tasks.workunit.client.0.smithi155.stdout:6/666: mkdir d0/d3/d2c/d3e/d4c/dd4 0 2023-12-16T05:56:33.488 INFO:tasks.workunit.client.0.smithi155.stdout:6/667: chown d0/d3/c5a 89340041 1 2023-12-16T05:56:33.495 INFO:tasks.workunit.client.0.smithi155.stdout:6/668: fsync d0/d3/d2c/d3e/d4c/fa2 0 2023-12-16T05:56:33.497 INFO:tasks.workunit.client.0.smithi155.stdout:9/614: dwrite da/d15/d17/d36/d54/f94 [0,4194304] 0 2023-12-16T05:56:33.498 INFO:tasks.workunit.client.1.smithi156.stdout:2/217: dwrite d9/dd/d17/d33/f2c [0,4194304] 0 2023-12-16T05:56:33.498 INFO:tasks.workunit.client.1.smithi156.stdout:2/218: write d9/f35 [786266,38628] 0 2023-12-16T05:56:33.501 INFO:tasks.workunit.client.1.smithi156.stdout:2/219: creat d9/dd/d17/d33/f40 x:0 0 0 2023-12-16T05:56:33.501 INFO:tasks.workunit.client.1.smithi156.stdout:2/220: write d9/dd/d17/f1d [492687,6682] 0 2023-12-16T05:56:33.503 INFO:tasks.workunit.client.1.smithi156.stdout:2/221: symlink d9/dd/d17/d33/l41 0 2023-12-16T05:56:33.505 INFO:tasks.workunit.client.0.smithi155.stdout:4/482: dwrite d0/d10/f34 [0,4194304] 0 2023-12-16T05:56:33.505 INFO:tasks.workunit.client.0.smithi155.stdout:4/483: rename d0/da/d36/d5f/d75 to d0/da/d36/d5f/d75/d50/da0 22 2023-12-16T05:56:33.505 INFO:tasks.workunit.client.0.smithi155.stdout:4/484: dread - d0/da/f73 zero size 2023-12-16T05:56:33.505 INFO:tasks.workunit.client.0.smithi155.stdout:4/485: chown d0/da/d36/d5f/c87 1999 1 2023-12-16T05:56:33.505 INFO:tasks.workunit.client.0.smithi155.stdout:4/486: chown d0/da/d36/d5f/d75/d86 117032521 1 2023-12-16T05:56:33.506 INFO:tasks.workunit.client.1.smithi156.stdout:9/198: dwrite d6/d19/f1a [0,4194304] 0 2023-12-16T05:56:33.506 INFO:tasks.workunit.client.1.smithi156.stdout:9/199: truncate d6/d19/d25/f34 347594 0 2023-12-16T05:56:33.509 INFO:tasks.workunit.client.0.smithi155.stdout:4/487: symlink d0/d10/d46/d16/d30/d52/d88/d9e/la1 0 2023-12-16T05:56:33.509 INFO:tasks.workunit.client.0.smithi155.stdout:4/488: truncate d0/d10/d46/d16/d1a/f72 4500273 0 2023-12-16T05:56:33.510 INFO:tasks.workunit.client.0.smithi155.stdout:4/489: mknod d0/da/d36/d5f/d75/d89/d9a/ca2 0 2023-12-16T05:56:33.511 INFO:tasks.workunit.client.0.smithi155.stdout:4/490: fdatasync d0/d10/d46/d16/d1a/f35 0 2023-12-16T05:56:33.512 INFO:tasks.workunit.client.0.smithi155.stdout:4/491: getdents d0/da 0 2023-12-16T05:56:33.512 INFO:tasks.workunit.client.0.smithi155.stdout:4/492: write d0/da/d36/d5f/f66 [9309582,8947] 0 2023-12-16T05:56:33.513 INFO:tasks.workunit.client.1.smithi156.stdout:2/222: dread d9/f27 [0,4194304] 0 2023-12-16T05:56:33.513 INFO:tasks.workunit.client.1.smithi156.stdout:2/223: write d9/dd/d17/f2b [191986,80203] 0 2023-12-16T05:56:33.513 INFO:tasks.workunit.client.1.smithi156.stdout:2/224: chown d9/dd/d17/d33/l41 541165 1 2023-12-16T05:56:33.513 INFO:tasks.workunit.client.1.smithi156.stdout:2/225: stat d9/f35 0 2023-12-16T05:56:33.513 INFO:tasks.workunit.client.1.smithi156.stdout:2/226: chown d9/dd/f21 12643082 1 2023-12-16T05:56:33.514 INFO:tasks.workunit.client.0.smithi155.stdout:4/493: rmdir d0/da/d36/d5f/d75/d3d/d49 39 2023-12-16T05:56:33.514 INFO:tasks.workunit.client.0.smithi155.stdout:4/494: read d0/da/d36/d5f/d75/d89/f8a [706431,116206] 0 2023-12-16T05:56:33.514 INFO:tasks.workunit.client.1.smithi156.stdout:2/227: symlink d9/dd/l42 0 2023-12-16T05:56:33.515 INFO:tasks.workunit.client.0.smithi155.stdout:4/495: write d0/d10/d46/d16/d1a/f2b [2944100,8924] 0 2023-12-16T05:56:33.516 INFO:tasks.workunit.client.0.smithi155.stdout:4/496: write d0/d10/d46/d16/d1a/f69 [204193,79666] 0 2023-12-16T05:56:33.516 INFO:tasks.workunit.client.1.smithi156.stdout:2/228: link d9/l3b d9/dd/d17/d33/d38/d39/l43 0 2023-12-16T05:56:33.518 INFO:tasks.workunit.client.1.smithi156.stdout:2/229: truncate d9/dd/d17/d33/d38/d39/f3e 4338677 0 2023-12-16T05:56:33.518 INFO:tasks.workunit.client.1.smithi156.stdout:1/91: sync 2023-12-16T05:56:33.518 INFO:tasks.workunit.client.1.smithi156.stdout:7/268: sync 2023-12-16T05:56:33.518 INFO:tasks.workunit.client.1.smithi156.stdout:5/323: sync 2023-12-16T05:56:33.518 INFO:tasks.workunit.client.1.smithi156.stdout:3/168: sync 2023-12-16T05:56:33.518 INFO:tasks.workunit.client.1.smithi156.stdout:3/169: write dc/f25 [138340,110032] 0 2023-12-16T05:56:33.518 INFO:tasks.workunit.client.1.smithi156.stdout:3/170: fdatasync dc/d10/d1d/d1f/f37 0 2023-12-16T05:56:33.518 INFO:tasks.workunit.client.1.smithi156.stdout:2/230: chown d9/d12/f36 117545 1 2023-12-16T05:56:33.520 INFO:tasks.workunit.client.0.smithi155.stdout:4/497: write d0/d10/f8c [412701,129567] 0 2023-12-16T05:56:33.520 INFO:tasks.workunit.client.0.smithi155.stdout:6/669: dwrite d0/d3/d2c/d3e/d4c/f7b [0,4194304] 0 2023-12-16T05:56:33.521 INFO:tasks.workunit.client.0.smithi155.stdout:9/615: dwrite da/d15/d17/d36/d5b/f61 [0,4194304] 0 2023-12-16T05:56:33.521 INFO:tasks.workunit.client.1.smithi156.stdout:7/269: rename d1e/l2b to d1e/l56 0 2023-12-16T05:56:33.522 INFO:tasks.workunit.client.0.smithi155.stdout:4/498: rename d0/d10/d46/c98 to d0/d10/d46/d16/d30/d52/ca3 0 2023-12-16T05:56:33.522 INFO:tasks.workunit.client.1.smithi156.stdout:5/324: rename da/l12 to da/dc/d4b/l5e 0 2023-12-16T05:56:33.523 INFO:tasks.workunit.client.0.smithi155.stdout:6/670: getdents d0/df 0 2023-12-16T05:56:33.524 INFO:tasks.workunit.client.1.smithi156.stdout:2/231: write d9/d12/f18 [4573024,31925] 0 2023-12-16T05:56:33.526 INFO:tasks.workunit.client.0.smithi155.stdout:4/499: write d0/fb [21917,17327] 0 2023-12-16T05:56:33.528 INFO:tasks.workunit.client.1.smithi156.stdout:7/270: mkdir d1e/d1f/d22/d2c/d57 0 2023-12-16T05:56:33.528 INFO:tasks.workunit.client.1.smithi156.stdout:7/271: chown d1e/d39/l52 119070647 1 2023-12-16T05:56:33.531 INFO:tasks.workunit.client.1.smithi156.stdout:3/171: rename dc/d10/d1d/d1f to dc/d10/d3d 0 2023-12-16T05:56:33.531 INFO:tasks.workunit.client.1.smithi156.stdout:3/172: write dc/f14 [1161526,80277] 0 2023-12-16T05:56:33.533 INFO:tasks.workunit.client.0.smithi155.stdout:6/671: creat d0/df/d5e/fd5 x:0 0 0 2023-12-16T05:56:33.533 INFO:tasks.workunit.client.1.smithi156.stdout:2/232: unlink d9/dd/f21 0 2023-12-16T05:56:33.534 INFO:tasks.workunit.client.1.smithi156.stdout:1/92: dread d3/f6 [0,4194304] 0 2023-12-16T05:56:33.534 INFO:tasks.workunit.client.1.smithi156.stdout:7/272: creat d1e/f58 x:0 0 0 2023-12-16T05:56:33.534 INFO:tasks.workunit.client.1.smithi156.stdout:3/173: mknod dc/df/c3e 0 2023-12-16T05:56:33.535 INFO:tasks.workunit.client.0.smithi155.stdout:4/500: mknod d0/d10/d46/d16/d30/d52/d88/ca4 0 2023-12-16T05:56:33.536 INFO:tasks.workunit.client.1.smithi156.stdout:2/233: creat d9/f44 x:0 0 0 2023-12-16T05:56:33.536 INFO:tasks.workunit.client.0.smithi155.stdout:6/672: mkdir d0/d3/d7a/dd6 0 2023-12-16T05:56:33.538 INFO:tasks.workunit.client.1.smithi156.stdout:1/93: readlink d3/l10 0 2023-12-16T05:56:33.540 INFO:tasks.workunit.client.1.smithi156.stdout:7/273: mkdir d1e/d1f/d22/d2c/d57/d59 0 2023-12-16T05:56:33.540 INFO:tasks.workunit.client.1.smithi156.stdout:7/274: fdatasync d1e/f32 0 2023-12-16T05:56:33.542 INFO:tasks.workunit.client.1.smithi156.stdout:7/275: getdents d1e/d1f/d54 0 2023-12-16T05:56:33.551 INFO:tasks.workunit.client.1.smithi156.stdout:5/325: dwrite da/d46/f4f [0,4194304] 0 2023-12-16T05:56:33.565 INFO:tasks.workunit.client.1.smithi156.stdout:7/276: dwrite f4 [0,4194304] 0 2023-12-16T05:56:33.568 INFO:tasks.workunit.client.1.smithi156.stdout:7/277: link c16 d1e/d39/c5a 0 2023-12-16T05:56:33.568 INFO:tasks.workunit.client.1.smithi156.stdout:7/278: write d1e/f58 [492087,29812] 0 2023-12-16T05:56:33.568 INFO:tasks.workunit.client.1.smithi156.stdout:7/279: write d1e/d1f/f53 [57655,109609] 0 2023-12-16T05:56:33.569 INFO:tasks.workunit.client.1.smithi156.stdout:2/234: dwrite d9/d12/f18 [0,4194304] 0 2023-12-16T05:56:33.569 INFO:tasks.workunit.client.1.smithi156.stdout:7/280: truncate d1e/d1f/d22/d2c/d2e/f36 2039510 0 2023-12-16T05:56:33.570 INFO:tasks.workunit.client.1.smithi156.stdout:5/326: dwrite da/dc/f2e [0,4194304] 0 2023-12-16T05:56:33.571 INFO:tasks.workunit.client.1.smithi156.stdout:2/235: rmdir d9/dd/d17/d33/d38/d39 39 2023-12-16T05:56:33.571 INFO:tasks.workunit.client.1.smithi156.stdout:2/236: write d9/f35 [836329,35851] 0 2023-12-16T05:56:33.571 INFO:tasks.workunit.client.1.smithi156.stdout:7/281: symlink d1e/d1f/d22/d2c/d2e/l5b 0 2023-12-16T05:56:33.573 INFO:tasks.workunit.client.1.smithi156.stdout:3/174: dwrite dc/f14 [0,4194304] 0 2023-12-16T05:56:33.573 INFO:tasks.workunit.client.1.smithi156.stdout:5/327: mkdir da/dc/d5f 0 2023-12-16T05:56:33.573 INFO:tasks.workunit.client.1.smithi156.stdout:1/94: dwrite d3/f6 [0,4194304] 0 2023-12-16T05:56:33.574 INFO:tasks.workunit.client.1.smithi156.stdout:2/237: unlink d9/dd/d17/d33/f2c 0 2023-12-16T05:56:33.575 INFO:tasks.workunit.client.1.smithi156.stdout:7/282: write d1e/f32 [6314050,125186] 0 2023-12-16T05:56:33.576 INFO:tasks.workunit.client.1.smithi156.stdout:2/238: dread d9/dd/d17/d33/d38/f3c [0,4194304] 0 2023-12-16T05:56:33.576 INFO:tasks.workunit.client.1.smithi156.stdout:3/175: creat dc/df/d34/f3f x:0 0 0 2023-12-16T05:56:33.579 INFO:tasks.workunit.client.1.smithi156.stdout:1/95: stat d3/d17/c1e 0 2023-12-16T05:56:33.579 INFO:tasks.workunit.client.1.smithi156.stdout:1/96: dread - d3/f16 zero size 2023-12-16T05:56:33.581 INFO:tasks.workunit.client.1.smithi156.stdout:3/176: mknod dc/df/d34/c40 0 2023-12-16T05:56:33.581 INFO:tasks.workunit.client.1.smithi156.stdout:3/177: write dc/df/f2d [339667,77844] 0 2023-12-16T05:56:33.582 INFO:tasks.workunit.client.1.smithi156.stdout:1/97: creat d3/d17/f1f x:0 0 0 2023-12-16T05:56:33.583 INFO:tasks.workunit.client.1.smithi156.stdout:1/98: chown d3/f16 3142 1 2023-12-16T05:56:33.583 INFO:tasks.workunit.client.1.smithi156.stdout:1/99: chown d3/c9 61210 1 2023-12-16T05:56:33.586 INFO:tasks.workunit.client.1.smithi156.stdout:5/328: dread da/dc/f21 [0,4194304] 0 2023-12-16T05:56:33.588 INFO:tasks.workunit.client.1.smithi156.stdout:3/178: mknod dc/d10/c41 0 2023-12-16T05:56:33.590 INFO:tasks.workunit.client.1.smithi156.stdout:5/329: rename da/c16 to da/dc/d2d/d34/c60 0 2023-12-16T05:56:33.592 INFO:tasks.workunit.client.1.smithi156.stdout:5/330: rename da/dc/d4b/l53 to da/dc/d5f/l61 0 2023-12-16T05:56:33.594 INFO:tasks.workunit.client.1.smithi156.stdout:7/283: dwrite d1e/d1f/d22/d2c/d33/f3d [0,4194304] 0 2023-12-16T05:56:33.594 INFO:tasks.workunit.client.1.smithi156.stdout:7/284: readlink d1e/d39/l52 0 2023-12-16T05:56:33.594 INFO:tasks.workunit.client.1.smithi156.stdout:7/285: chown d1e/d39/c5a 112526876 1 2023-12-16T05:56:33.596 INFO:tasks.workunit.client.1.smithi156.stdout:5/331: mkdir da/dc/d5f/d62 0 2023-12-16T05:56:33.600 INFO:tasks.workunit.client.1.smithi156.stdout:7/286: mknod d1e/d1f/d22/d2c/d57/d59/c5c 0 2023-12-16T05:56:33.600 INFO:tasks.workunit.client.1.smithi156.stdout:7/287: write d1e/d1f/d22/d2c/d33/f35 [1118306,26866] 0 2023-12-16T05:56:33.600 INFO:tasks.workunit.client.1.smithi156.stdout:7/288: truncate d1e/d1f/d54/f4b 1556590 0 2023-12-16T05:56:33.602 INFO:tasks.workunit.client.1.smithi156.stdout:5/332: creat da/dc/d5f/d62/f63 x:0 0 0 2023-12-16T05:56:33.605 INFO:tasks.workunit.client.1.smithi156.stdout:5/333: getdents da/dc/d2d 0 2023-12-16T05:56:33.609 INFO:tasks.workunit.client.0.smithi155.stdout:5/557: sync 2023-12-16T05:56:33.610 INFO:tasks.workunit.client.0.smithi155.stdout:5/558: rmdir d0/d2/d2a/d19/d88 39 2023-12-16T05:56:33.612 INFO:tasks.workunit.client.1.smithi156.stdout:1/100: dwrite d3/f16 [0,4194304] 0 2023-12-16T05:56:33.613 INFO:tasks.workunit.client.0.smithi155.stdout:5/559: write d0/d2/d2a/fe [6709072,61098] 0 2023-12-16T05:56:33.614 INFO:tasks.workunit.client.0.smithi155.stdout:5/560: getdents d0/d2/d2a/d19 0 2023-12-16T05:56:33.615 INFO:tasks.workunit.client.0.smithi155.stdout:5/561: symlink d0/d2/d2a/d30/d53/d7b/d99/lb2 0 2023-12-16T05:56:33.616 INFO:tasks.workunit.client.1.smithi156.stdout:3/179: dwrite dc/df/f2e [0,4194304] 0 2023-12-16T05:56:33.617 INFO:tasks.workunit.client.1.smithi156.stdout:5/334: dread da/f1e [0,4194304] 0 2023-12-16T05:56:33.640 INFO:tasks.workunit.client.1.smithi156.stdout:7/289: dwrite d1e/d1f/d22/d2c/f45 [0,4194304] 0 2023-12-16T05:56:33.641 INFO:tasks.workunit.client.0.smithi155.stdout:0/494: sync 2023-12-16T05:56:33.641 INFO:tasks.workunit.client.0.smithi155.stdout:2/435: sync 2023-12-16T05:56:33.641 INFO:tasks.workunit.client.0.smithi155.stdout:8/440: sync 2023-12-16T05:56:33.641 INFO:tasks.workunit.client.0.smithi155.stdout:7/488: sync 2023-12-16T05:56:33.642 INFO:tasks.workunit.client.0.smithi155.stdout:1/592: sync 2023-12-16T05:56:33.642 INFO:tasks.workunit.client.0.smithi155.stdout:7/489: truncate d0/d6a/d1a/d8c/d34/fa1 312533 0 2023-12-16T05:56:33.642 INFO:tasks.workunit.client.0.smithi155.stdout:3/372: sync 2023-12-16T05:56:33.643 INFO:tasks.workunit.client.0.smithi155.stdout:5/562: getdents d0/d2/d2a/d30/d53/d7b/d99 0 2023-12-16T05:56:33.643 INFO:tasks.workunit.client.0.smithi155.stdout:5/563: truncate d0/d2/d2a/d30/d53/d7b/d99/f83 524131 0 2023-12-16T05:56:33.643 INFO:tasks.workunit.client.0.smithi155.stdout:5/564: read d0/d2/d2a/d30/d53/d7b/d99/f6c [768801,24640] 0 2023-12-16T05:56:33.644 INFO:tasks.workunit.client.0.smithi155.stdout:0/495: creat d7/d13/d45/fa0 x:0 0 0 2023-12-16T05:56:33.645 INFO:tasks.workunit.client.0.smithi155.stdout:0/496: chown d7/d2d/f3c 37 1 2023-12-16T05:56:33.645 INFO:tasks.workunit.client.0.smithi155.stdout:0/497: write d7/d13/d45/d4b/f90 [391402,84593] 0 2023-12-16T05:56:33.645 INFO:tasks.workunit.client.0.smithi155.stdout:0/498: chown d7/df/d73/d8d/c57 214947 1 2023-12-16T05:56:33.646 INFO:tasks.workunit.client.1.smithi156.stdout:1/101: unlink d3/d17/d19/c1a 0 2023-12-16T05:56:33.646 INFO:tasks.workunit.client.0.smithi155.stdout:2/436: creat d0/d7/d69/f91 x:0 0 0 2023-12-16T05:56:33.648 INFO:tasks.workunit.client.0.smithi155.stdout:7/490: symlink d0/d6a/d1a/la8 0 2023-12-16T05:56:33.648 INFO:tasks.workunit.client.0.smithi155.stdout:7/491: chown d0/d6a/d31/f46 5994505 1 2023-12-16T05:56:33.648 INFO:tasks.workunit.client.0.smithi155.stdout:7/492: chown d0/d6a/d1a/d8c/d34/d4b/d64/d6f/f81 1032814065 1 2023-12-16T05:56:33.648 INFO:tasks.workunit.client.0.smithi155.stdout:0/499: dread d7/df/d65/f55 [0,4194304] 0 2023-12-16T05:56:33.649 INFO:tasks.workunit.client.0.smithi155.stdout:3/373: mknod d0/d14/d36/d47/c6d 0 2023-12-16T05:56:33.650 INFO:tasks.workunit.client.0.smithi155.stdout:5/565: mkdir d0/d2/d2a/d30/d53/d7b/db3 0 2023-12-16T05:56:33.651 INFO:tasks.workunit.client.0.smithi155.stdout:2/437: mknod d0/d7/dd/d14/c92 0 2023-12-16T05:56:33.654 INFO:tasks.workunit.client.1.smithi156.stdout:3/180: creat dc/d10/d1d/f42 x:0 0 0 2023-12-16T05:56:33.654 INFO:tasks.workunit.client.1.smithi156.stdout:3/181: write dc/d10/d3d/f37 [737892,128160] 0 2023-12-16T05:56:33.655 INFO:tasks.workunit.client.0.smithi155.stdout:0/500: link d7/d2d/c5b d7/d47/d53/ca1 0 2023-12-16T05:56:33.655 INFO:tasks.workunit.client.0.smithi155.stdout:5/566: rmdir d0 39 2023-12-16T05:56:33.656 INFO:tasks.workunit.client.1.smithi156.stdout:5/335: rename da/f27 to da/dc/d4b/f64 0 2023-12-16T05:56:33.656 INFO:tasks.workunit.client.1.smithi156.stdout:5/336: chown l8 3 1 2023-12-16T05:56:33.656 INFO:tasks.workunit.client.0.smithi155.stdout:2/438: truncate d0/d7/d1f/d74/d3a/f7a 2012800 0 2023-12-16T05:56:33.657 INFO:tasks.workunit.client.0.smithi155.stdout:3/374: mknod d0/d1a/d33/c6e 0 2023-12-16T05:56:33.657 INFO:tasks.workunit.client.0.smithi155.stdout:5/567: dread d0/d2/d2a/f45 [0,4194304] 0 2023-12-16T05:56:33.658 INFO:tasks.workunit.client.1.smithi156.stdout:7/290: rmdir d1e/d1f/d22/d2c/d57 39 2023-12-16T05:56:33.658 INFO:tasks.workunit.client.0.smithi155.stdout:0/501: mkdir d7/df/d73/da2 0 2023-12-16T05:56:33.659 INFO:tasks.workunit.client.0.smithi155.stdout:3/375: getdents d0/d14/d36 0 2023-12-16T05:56:33.660 INFO:tasks.workunit.client.1.smithi156.stdout:7/291: dread d1e/d1f/f3a [0,4194304] 0 2023-12-16T05:56:33.660 INFO:tasks.workunit.client.1.smithi156.stdout:3/182: link dc/d10/l13 dc/df/d34/l43 0 2023-12-16T05:56:33.661 INFO:tasks.workunit.client.0.smithi155.stdout:5/568: rename d0/d2/l43 to d0/d2/d2a/d30/d53/d7b/d99/daf/lb4 0 2023-12-16T05:56:33.662 INFO:tasks.workunit.client.1.smithi156.stdout:7/292: getdents d1e 0 2023-12-16T05:56:33.662 INFO:tasks.workunit.client.1.smithi156.stdout:5/337: getdents da/dc/d2d/d4d 0 2023-12-16T05:56:33.662 INFO:tasks.workunit.client.0.smithi155.stdout:0/502: rmdir d7/d47/d5d/d84 39 2023-12-16T05:56:33.662 INFO:tasks.workunit.client.0.smithi155.stdout:0/503: chown d7/d13/d45/f6c 581 1 2023-12-16T05:56:33.663 INFO:tasks.workunit.client.1.smithi156.stdout:1/102: dread d3/f6 [0,4194304] 0 2023-12-16T05:56:33.663 INFO:tasks.workunit.client.0.smithi155.stdout:5/569: mkdir d0/d2/d2a/d30/d53/db5 0 2023-12-16T05:56:33.663 INFO:tasks.workunit.client.0.smithi155.stdout:5/570: chown d0/c51 429 1 2023-12-16T05:56:33.664 INFO:tasks.workunit.client.1.smithi156.stdout:3/183: link dc/d10/d1d/l20 dc/d10/d3d/l44 0 2023-12-16T05:56:33.665 INFO:tasks.workunit.client.1.smithi156.stdout:3/184: write dc/d10/d3d/f29 [5039487,76988] 0 2023-12-16T05:56:33.665 INFO:tasks.workunit.client.1.smithi156.stdout:3/185: write dc/d10/d3d/f37 [1834062,82921] 0 2023-12-16T05:56:33.665 INFO:tasks.workunit.client.1.smithi156.stdout:7/293: creat d1e/d1f/d22/d2c/d2e/f5d x:0 0 0 2023-12-16T05:56:33.666 INFO:tasks.workunit.client.0.smithi155.stdout:1/593: dwrite d1/d7/f1f [0,4194304] 0 2023-12-16T05:56:33.666 INFO:tasks.workunit.client.0.smithi155.stdout:5/571: mkdir d0/d2/d2a/d30/d53/d7b/d99/d47/d61/db6 0 2023-12-16T05:56:33.666 INFO:tasks.workunit.client.1.smithi156.stdout:5/338: mknod da/dc/c65 0 2023-12-16T05:56:33.667 INFO:tasks.workunit.client.1.smithi156.stdout:1/103: creat d3/d17/d19/f20 x:0 0 0 2023-12-16T05:56:33.668 INFO:tasks.workunit.client.1.smithi156.stdout:5/339: truncate f0 4091453 0 2023-12-16T05:56:33.668 INFO:tasks.workunit.client.1.smithi156.stdout:5/340: fsync da/dc/ff 0 2023-12-16T05:56:33.668 INFO:tasks.workunit.client.1.smithi156.stdout:5/341: write da/f1e [3029516,10963] 0 2023-12-16T05:56:33.670 INFO:tasks.workunit.client.1.smithi156.stdout:1/104: link d3/c9 d3/d1b/c21 0 2023-12-16T05:56:33.670 INFO:tasks.workunit.client.0.smithi155.stdout:2/439: dread d0/f52 [0,4194304] 0 2023-12-16T05:56:33.673 INFO:tasks.workunit.client.0.smithi155.stdout:5/572: rename d0/d2/d2a/d30/c67 to d0/d2/d2a/d30/d53/d7b/d99/d47/d61/cb7 0 2023-12-16T05:56:33.674 INFO:tasks.workunit.client.0.smithi155.stdout:0/504: write d7/df/f7f [623162,106718] 0 2023-12-16T05:56:33.675 INFO:tasks.workunit.client.1.smithi156.stdout:5/342: write da/dc/f17 [1481774,112081] 0 2023-12-16T05:56:33.675 INFO:tasks.workunit.client.0.smithi155.stdout:2/440: creat d0/d7/d69/f93 x:0 0 0 2023-12-16T05:56:33.675 INFO:tasks.workunit.client.0.smithi155.stdout:2/441: fdatasync d0/d5/d6/f10 0 2023-12-16T05:56:33.675 INFO:tasks.workunit.client.0.smithi155.stdout:2/442: fdatasync d0/d7/f73 0 2023-12-16T05:56:33.677 INFO:tasks.workunit.client.0.smithi155.stdout:5/573: creat d0/d2/d2a/d30/d53/d7b/d99/d47/fb8 x:0 0 0 2023-12-16T05:56:33.677 INFO:tasks.workunit.client.0.smithi155.stdout:2/443: dread d0/d7/f7e [0,4194304] 0 2023-12-16T05:56:33.680 INFO:tasks.workunit.client.0.smithi155.stdout:0/505: mknod d7/df/d65/ca3 0 2023-12-16T05:56:33.682 INFO:tasks.workunit.client.0.smithi155.stdout:5/574: mkdir d0/d2/d2a/d30/d53/db5/db9 0 2023-12-16T05:56:33.683 INFO:tasks.workunit.client.0.smithi155.stdout:2/444: symlink d0/d7/d69/d77/l94 0 2023-12-16T05:56:33.683 INFO:tasks.workunit.client.0.smithi155.stdout:2/445: readlink d0/d34/d3c/l53 0 2023-12-16T05:56:33.683 INFO:tasks.workunit.client.0.smithi155.stdout:2/446: write d0/d7/d1f/d74/d85/d88/f89 [174110,87830] 0 2023-12-16T05:56:33.683 INFO:tasks.workunit.client.1.smithi156.stdout:1/105: dread d3/f18 [0,4194304] 0 2023-12-16T05:56:33.684 INFO:tasks.workunit.client.0.smithi155.stdout:5/575: creat d0/d2/d2a/d30/d53/fba x:0 0 0 2023-12-16T05:56:33.684 INFO:tasks.workunit.client.0.smithi155.stdout:2/447: getdents d0/d7/dd/d14 0 2023-12-16T05:56:33.684 INFO:tasks.workunit.client.0.smithi155.stdout:2/448: chown d0/d7/dd/d14/f2d 0 1 2023-12-16T05:56:33.686 INFO:tasks.workunit.client.0.smithi155.stdout:0/506: mkdir d7/da4 0 2023-12-16T05:56:33.687 INFO:tasks.workunit.client.0.smithi155.stdout:5/576: truncate d0/d2/d2a/d30/d53/d7b/f80 3572401 0 2023-12-16T05:56:33.688 INFO:tasks.workunit.client.0.smithi155.stdout:5/577: mkdir d0/d2/d2a/d30/d53/d7b/d99/d47/dbb 0 2023-12-16T05:56:33.688 INFO:tasks.workunit.client.0.smithi155.stdout:5/578: readlink d0/d2/d2a/d19/d88/laa 0 2023-12-16T05:56:33.690 INFO:tasks.workunit.client.1.smithi156.stdout:7/294: dread d1e/d1f/d22/f25 [0,4194304] 0 2023-12-16T05:56:33.691 INFO:tasks.workunit.client.1.smithi156.stdout:1/106: write d3/f6 [2734719,91689] 0 2023-12-16T05:56:33.692 INFO:tasks.workunit.client.1.smithi156.stdout:7/295: creat d1e/d1f/d22/d2c/f5e x:0 0 0 2023-12-16T05:56:33.692 INFO:tasks.workunit.client.1.smithi156.stdout:7/296: fdatasync d1e/d1f/d22/d2c/d33/f3d 0 2023-12-16T05:56:33.692 INFO:tasks.workunit.client.1.smithi156.stdout:7/297: dread - d1e/d1f/d22/d2c/f5e zero size 2023-12-16T05:56:33.693 INFO:tasks.workunit.client.1.smithi156.stdout:1/107: chown d3/f15 31479106 1 2023-12-16T05:56:33.694 INFO:tasks.workunit.client.1.smithi156.stdout:1/108: mkdir d3/d17/d1c/d22 0 2023-12-16T05:56:33.696 INFO:tasks.workunit.client.1.smithi156.stdout:5/343: dread da/dc/f21 [0,4194304] 0 2023-12-16T05:56:33.697 INFO:tasks.workunit.client.1.smithi156.stdout:7/298: dread d1e/d1f/d54/f4b [0,4194304] 0 2023-12-16T05:56:33.697 INFO:tasks.workunit.client.1.smithi156.stdout:7/299: rename d1e to d1e/d39/d5f 22 2023-12-16T05:56:33.697 INFO:tasks.workunit.client.1.smithi156.stdout:7/300: fsync f4 0 2023-12-16T05:56:33.699 INFO:tasks.workunit.client.1.smithi156.stdout:5/344: creat da/dc/d5f/f66 x:0 0 0 2023-12-16T05:56:33.699 INFO:tasks.workunit.client.1.smithi156.stdout:5/345: fsync da/dc/d2d/f58 0 2023-12-16T05:56:33.699 INFO:tasks.workunit.client.1.smithi156.stdout:5/346: chown da/dc/f21 60 1 2023-12-16T05:56:33.700 INFO:tasks.workunit.client.0.smithi155.stdout:0/507: dread d7/f2a [4194304,4194304] 0 2023-12-16T05:56:33.702 INFO:tasks.workunit.client.0.smithi155.stdout:0/508: rename d7/d13/d45/d3e/f94 to d7/df/d6f/fa5 0 2023-12-16T05:56:33.705 INFO:tasks.workunit.client.1.smithi156.stdout:8/127: sync 2023-12-16T05:56:33.706 INFO:tasks.workunit.client.1.smithi156.stdout:4/163: sync 2023-12-16T05:56:33.706 INFO:tasks.workunit.client.1.smithi156.stdout:6/201: sync 2023-12-16T05:56:33.707 INFO:tasks.workunit.client.1.smithi156.stdout:6/202: stat d9/d1c/l2a 0 2023-12-16T05:56:33.707 INFO:tasks.workunit.client.0.smithi155.stdout:7/493: dwrite d0/d6a/f30 [0,4194304] 0 2023-12-16T05:56:33.707 INFO:tasks.workunit.client.0.smithi155.stdout:7/494: write d0/d1b/d78/f96 [415304,40418] 0 2023-12-16T05:56:33.708 INFO:tasks.workunit.client.1.smithi156.stdout:8/128: unlink d3/d12/d16/f1d 0 2023-12-16T05:56:33.709 INFO:tasks.workunit.client.1.smithi156.stdout:4/164: creat d9/d2c/f2f x:0 0 0 2023-12-16T05:56:33.711 INFO:tasks.workunit.client.1.smithi156.stdout:8/129: getdents d3/d7/d9 0 2023-12-16T05:56:33.712 INFO:tasks.workunit.client.1.smithi156.stdout:8/130: read f2 [1271494,69688] 0 2023-12-16T05:56:33.712 INFO:tasks.workunit.client.1.smithi156.stdout:4/165: mkdir d9/d2c/d30 0 2023-12-16T05:56:33.713 INFO:tasks.workunit.client.1.smithi156.stdout:8/131: creat d3/f29 x:0 0 0 2023-12-16T05:56:33.714 INFO:tasks.workunit.client.0.smithi155.stdout:1/594: dwrite d1/d17/d28/f40 [0,4194304] 0 2023-12-16T05:56:33.714 INFO:tasks.workunit.client.0.smithi155.stdout:1/595: chown d1/d17/cba 6502298 1 2023-12-16T05:56:33.715 INFO:tasks.workunit.client.0.smithi155.stdout:7/495: creat d0/d6a/d1a/fa9 x:0 0 0 2023-12-16T05:56:33.715 INFO:tasks.workunit.client.1.smithi156.stdout:8/132: truncate d3/d6/f5 518947 0 2023-12-16T05:56:33.715 INFO:tasks.workunit.client.1.smithi156.stdout:8/133: chown d3/d6/c1e 84850272 1 2023-12-16T05:56:33.717 INFO:tasks.workunit.client.0.smithi155.stdout:1/596: truncate d1/f2a 1455592 0 2023-12-16T05:56:33.717 INFO:tasks.workunit.client.0.smithi155.stdout:1/597: truncate d1/d7/f34 4793317 0 2023-12-16T05:56:33.717 INFO:tasks.workunit.client.1.smithi156.stdout:8/134: creat d3/d7/d9/f2a x:0 0 0 2023-12-16T05:56:33.717 INFO:tasks.workunit.client.1.smithi156.stdout:8/135: fdatasync d3/d12/f28 0 2023-12-16T05:56:33.719 INFO:tasks.workunit.client.0.smithi155.stdout:8/441: dwrite d4/d62/d70/d4f/f63 [0,4194304] 0 2023-12-16T05:56:33.721 INFO:tasks.workunit.client.1.smithi156.stdout:8/136: mknod d3/d6/c2b 0 2023-12-16T05:56:33.722 INFO:tasks.workunit.client.0.smithi155.stdout:8/442: mkdir d4/d62/d70/d29/d8b 0 2023-12-16T05:56:33.724 INFO:tasks.workunit.client.0.smithi155.stdout:8/443: chown d4/d62/d66/d78/d88/d1b/d2a/d5e/c7e 258610356 1 2023-12-16T05:56:33.725 INFO:tasks.workunit.client.1.smithi156.stdout:8/137: creat d3/d7/f2c x:0 0 0 2023-12-16T05:56:33.726 INFO:tasks.workunit.client.0.smithi155.stdout:8/444: dread d4/ff [0,4194304] 0 2023-12-16T05:56:33.728 INFO:tasks.workunit.client.0.smithi155.stdout:7/496: dread d0/d6a/d1a/d38/f41 [4194304,4194304] 0 2023-12-16T05:56:33.728 INFO:tasks.workunit.client.0.smithi155.stdout:7/497: truncate d0/d1b/d78/f96 534367 0 2023-12-16T05:56:33.728 INFO:tasks.workunit.client.0.smithi155.stdout:8/445: creat d4/d62/d70/f8c x:0 0 0 2023-12-16T05:56:33.728 INFO:tasks.workunit.client.0.smithi155.stdout:8/446: chown d4 82292 1 2023-12-16T05:56:33.729 INFO:tasks.workunit.client.1.smithi156.stdout:8/138: creat d3/d12/d16/f2d x:0 0 0 2023-12-16T05:56:33.729 INFO:tasks.workunit.client.1.smithi156.stdout:4/166: dread f0 [0,4194304] 0 2023-12-16T05:56:33.729 INFO:tasks.workunit.client.1.smithi156.stdout:4/167: truncate d9/f22 322632 0 2023-12-16T05:56:33.729 INFO:tasks.workunit.client.1.smithi156.stdout:4/168: stat d9/d2c 0 2023-12-16T05:56:33.729 INFO:tasks.workunit.client.1.smithi156.stdout:4/169: write d9/d2c/f2d [961838,125391] 0 2023-12-16T05:56:33.729 INFO:tasks.workunit.client.1.smithi156.stdout:4/170: chown d9/l17 179 1 2023-12-16T05:56:33.729 INFO:tasks.workunit.client.0.smithi155.stdout:1/598: dread d1/d69/f8a [0,4194304] 0 2023-12-16T05:56:33.730 INFO:tasks.workunit.client.0.smithi155.stdout:1/599: chown d1/d7/c26 35 1 2023-12-16T05:56:33.730 INFO:tasks.workunit.client.0.smithi155.stdout:1/600: truncate d1/d7/d16/d30/f7f 236674 0 2023-12-16T05:56:33.730 INFO:tasks.workunit.client.0.smithi155.stdout:7/498: symlink d0/d1/laa 0 2023-12-16T05:56:33.730 INFO:tasks.workunit.client.0.smithi155.stdout:8/447: creat d4/d62/d66/d78/d88/d1b/d1c/f8d x:0 0 0 2023-12-16T05:56:33.731 INFO:tasks.workunit.client.0.smithi155.stdout:1/601: rename d1/d7/d16/f1d to d1/d17/d28/d8f/db2/fbe 0 2023-12-16T05:56:33.731 INFO:tasks.workunit.client.1.smithi156.stdout:7/301: rmdir d1e/d1f 39 2023-12-16T05:56:33.731 INFO:tasks.workunit.client.1.smithi156.stdout:8/139: link d3/d12/c24 d3/d12/d16/c2e 0 2023-12-16T05:56:33.732 INFO:tasks.workunit.client.0.smithi155.stdout:0/509: dwrite d7/df/f9a [0,4194304] 0 2023-12-16T05:56:33.732 INFO:tasks.workunit.client.0.smithi155.stdout:0/510: truncate d7/d47/d5d/f74 193276 0 2023-12-16T05:56:33.732 INFO:tasks.workunit.client.0.smithi155.stdout:7/499: creat d0/d1b/fab x:0 0 0 2023-12-16T05:56:33.733 INFO:tasks.workunit.client.1.smithi156.stdout:4/171: rmdir d9/d2c/d30 0 2023-12-16T05:56:33.734 INFO:tasks.workunit.client.1.smithi156.stdout:4/172: chown d9/f21 299 1 2023-12-16T05:56:33.734 INFO:tasks.workunit.client.1.smithi156.stdout:4/173: write d9/d2c/f2f [73570,21865] 0 2023-12-16T05:56:33.734 INFO:tasks.workunit.client.0.smithi155.stdout:3/376: dwrite d0/d14/d45/f54 [0,4194304] 0 2023-12-16T05:56:33.734 INFO:tasks.workunit.client.0.smithi155.stdout:0/511: rename d7/df/d73/d8d/d9b/l9f to d7/df/d41/d23/d36/la6 0 2023-12-16T05:56:33.735 INFO:tasks.workunit.client.1.smithi156.stdout:3/186: dwrite dc/d10/d1d/f3a [0,4194304] 0 2023-12-16T05:56:33.735 INFO:tasks.workunit.client.1.smithi156.stdout:3/187: stat dc/df/f2f 0 2023-12-16T05:56:33.735 INFO:tasks.workunit.client.1.smithi156.stdout:7/302: symlink d1e/d1f/d22/d2c/d33/l60 0 2023-12-16T05:56:33.735 INFO:tasks.workunit.client.1.smithi156.stdout:7/303: dread - d1e/d1f/d22/d2c/f4d zero size 2023-12-16T05:56:33.735 INFO:tasks.workunit.client.1.smithi156.stdout:7/304: chown f7 1299 1 2023-12-16T05:56:33.735 INFO:tasks.workunit.client.0.smithi155.stdout:7/500: creat d0/d6a/fac x:0 0 0 2023-12-16T05:56:33.736 INFO:tasks.workunit.client.0.smithi155.stdout:2/449: dwrite d0/d7/d1f/d74/f46 [0,4194304] 0 2023-12-16T05:56:33.737 INFO:tasks.workunit.client.0.smithi155.stdout:2/450: write d0/d5/d6/d5f/f8e [496068,96310] 0 2023-12-16T05:56:33.738 INFO:tasks.workunit.client.1.smithi156.stdout:4/174: creat d9/d2b/f31 x:0 0 0 2023-12-16T05:56:33.738 INFO:tasks.workunit.client.1.smithi156.stdout:4/175: dread - d9/f23 zero size 2023-12-16T05:56:33.740 INFO:tasks.workunit.client.1.smithi156.stdout:6/203: dwrite d9/d13/f3d [0,4194304] 0 2023-12-16T05:56:33.741 INFO:tasks.workunit.client.0.smithi155.stdout:5/579: dwrite d0/d2/d2a/d19/f38 [0,4194304] 0 2023-12-16T05:56:33.741 INFO:tasks.workunit.client.0.smithi155.stdout:5/580: chown d0/d2/d2a/d30/d53/d7b/d99/f5c 32 1 2023-12-16T05:56:33.742 INFO:tasks.workunit.client.0.smithi155.stdout:5/581: dread d0/d2/d2a/d19/f4c [4194304,4194304] 0 2023-12-16T05:56:33.742 INFO:tasks.workunit.client.1.smithi156.stdout:3/188: mknod dc/df/d34/c45 0 2023-12-16T05:56:33.743 INFO:tasks.workunit.client.0.smithi155.stdout:3/377: unlink d0/d1a/d33/d57/c5c 0 2023-12-16T05:56:33.744 INFO:tasks.workunit.client.1.smithi156.stdout:7/305: rmdir d1e/d1f/d22/d2c/d33 39 2023-12-16T05:56:33.744 INFO:tasks.workunit.client.1.smithi156.stdout:7/306: fsync d1e/d1f/d22/f37 0 2023-12-16T05:56:33.744 INFO:tasks.workunit.client.1.smithi156.stdout:7/307: truncate d1e/f58 988516 0 2023-12-16T05:56:33.748 INFO:tasks.workunit.client.1.smithi156.stdout:5/347: dwrite da/dc/d4b/f64 [0,4194304] 0 2023-12-16T05:56:33.749 INFO:tasks.workunit.client.1.smithi156.stdout:1/109: dread d3/f6 [0,4194304] 0 2023-12-16T05:56:33.749 INFO:tasks.workunit.client.1.smithi156.stdout:3/189: symlink dc/d10/l46 0 2023-12-16T05:56:33.749 INFO:tasks.workunit.client.1.smithi156.stdout:3/190: stat dc/d10/l35 0 2023-12-16T05:56:33.749 INFO:tasks.workunit.client.1.smithi156.stdout:7/308: rename d1e/d1f/d22/d2c/d2e to d1e/d1f/d54/d61 0 2023-12-16T05:56:33.750 INFO:tasks.workunit.client.1.smithi156.stdout:6/204: dread f6 [4194304,4194304] 0 2023-12-16T05:56:33.751 INFO:tasks.workunit.client.1.smithi156.stdout:4/176: link d9/d2c/f2f d9/d2c/f32 0 2023-12-16T05:56:33.751 INFO:tasks.workunit.client.1.smithi156.stdout:8/140: rmdir d3/d7/d9 39 2023-12-16T05:56:33.751 INFO:tasks.workunit.client.1.smithi156.stdout:4/177: chown d9/l1d 2 1 2023-12-16T05:56:33.751 INFO:tasks.workunit.client.1.smithi156.stdout:8/141: chown d3/f17 239942 1 2023-12-16T05:56:33.752 INFO:tasks.workunit.client.1.smithi156.stdout:8/142: read - d3/d12/f28 zero size 2023-12-16T05:56:33.752 INFO:tasks.workunit.client.1.smithi156.stdout:5/348: write da/dc/f15 [1115528,33991] 0 2023-12-16T05:56:33.752 INFO:tasks.workunit.client.1.smithi156.stdout:7/309: dread d1e/f58 [0,4194304] 0 2023-12-16T05:56:33.753 INFO:tasks.workunit.client.1.smithi156.stdout:1/110: mknod d3/d17/d1c/c23 0 2023-12-16T05:56:33.754 INFO:tasks.workunit.client.1.smithi156.stdout:1/111: write d3/f15 [4732491,3952] 0 2023-12-16T05:56:33.755 INFO:tasks.workunit.client.1.smithi156.stdout:3/191: link dc/d10/c22 dc/df/d34/c47 0 2023-12-16T05:56:33.757 INFO:tasks.workunit.client.0.smithi155.stdout:0/512: creat d7/d13/fa7 x:0 0 0 2023-12-16T05:56:33.758 INFO:tasks.workunit.client.1.smithi156.stdout:6/205: getdents d9/d13 0 2023-12-16T05:56:33.760 INFO:tasks.workunit.client.1.smithi156.stdout:4/178: creat d9/d2b/f33 x:0 0 0 2023-12-16T05:56:33.760 INFO:tasks.workunit.client.1.smithi156.stdout:4/179: fdatasync d9/d2b/f33 0 2023-12-16T05:56:33.760 INFO:tasks.workunit.client.1.smithi156.stdout:4/180: chown d9/c13 13134410 1 2023-12-16T05:56:33.761 INFO:tasks.workunit.client.1.smithi156.stdout:5/349: rmdir da/d46 39 2023-12-16T05:56:33.762 INFO:tasks.workunit.client.1.smithi156.stdout:4/181: dread f5 [0,4194304] 0 2023-12-16T05:56:33.765 INFO:tasks.workunit.client.0.smithi155.stdout:5/582: mknod d0/d2/d2a/d30/d53/d7b/db3/cbc 0 2023-12-16T05:56:33.765 INFO:tasks.workunit.client.0.smithi155.stdout:5/583: chown d0/d60/d79/d97/d9c 22196849 1 2023-12-16T05:56:33.766 INFO:tasks.workunit.client.1.smithi156.stdout:7/310: rename d1e/d1f/d22/f37 to d1e/d39/f62 0 2023-12-16T05:56:33.770 INFO:tasks.workunit.client.0.smithi155.stdout:3/378: getdents d0/d14 0 2023-12-16T05:56:33.773 INFO:tasks.workunit.client.1.smithi156.stdout:5/350: mkdir da/dc/d2d/d4d/d54/d67 0 2023-12-16T05:56:33.773 INFO:tasks.workunit.client.1.smithi156.stdout:4/182: symlink d9/l34 0 2023-12-16T05:56:33.773 INFO:tasks.workunit.client.1.smithi156.stdout:5/351: write da/dc/f1d [1341185,96993] 0 2023-12-16T05:56:33.773 INFO:tasks.workunit.client.1.smithi156.stdout:5/352: fdatasync da/dc/d5f/d62/f63 0 2023-12-16T05:56:33.774 INFO:tasks.workunit.client.1.smithi156.stdout:6/206: creat d9/d13/d2f/f3f x:0 0 0 2023-12-16T05:56:33.774 INFO:tasks.workunit.client.0.smithi155.stdout:7/501: dwrite d0/f35 [0,4194304] 0 2023-12-16T05:56:33.774 INFO:tasks.workunit.client.0.smithi155.stdout:3/379: mkdir d0/d1e/d6f 0 2023-12-16T05:56:33.774 INFO:tasks.workunit.client.0.smithi155.stdout:7/502: mknod d0/d6a/d1a/d8c/d34/d4b/cad 0 2023-12-16T05:56:33.774 INFO:tasks.workunit.client.0.smithi155.stdout:7/503: chown d0 111 1 2023-12-16T05:56:33.776 INFO:tasks.workunit.client.0.smithi155.stdout:5/584: write d0/d2/d2a/d19/f20 [1273710,18435] 0 2023-12-16T05:56:33.776 INFO:tasks.workunit.client.0.smithi155.stdout:5/585: write d0/d2/d2a/d30/d53/d7b/d99/f5c [1712913,124295] 0 2023-12-16T05:56:33.776 INFO:tasks.workunit.client.0.smithi155.stdout:7/504: rename d0/d6a/d1a/d8c/c3a to d0/d6a/d1a/d8c/d42/d98/cae 0 2023-12-16T05:56:33.776 INFO:tasks.workunit.client.0.smithi155.stdout:1/602: fsync d1/f2a 0 2023-12-16T05:56:33.777 INFO:tasks.workunit.client.0.smithi155.stdout:5/586: rename d0/d60/fb0 to d0/d2/d2a/fbd 0 2023-12-16T05:56:33.778 INFO:tasks.workunit.client.1.smithi156.stdout:7/311: symlink d1e/d1f/d54/d61/l63 0 2023-12-16T05:56:33.779 INFO:tasks.workunit.client.1.smithi156.stdout:5/353: creat da/f68 x:0 0 0 2023-12-16T05:56:33.779 INFO:tasks.workunit.client.1.smithi156.stdout:5/354: write da/f52 [901158,26355] 0 2023-12-16T05:56:33.781 INFO:tasks.workunit.client.0.smithi155.stdout:0/513: dwrite d7/df/f9a [0,4194304] 0 2023-12-16T05:56:33.781 INFO:tasks.workunit.client.1.smithi156.stdout:6/207: mknod d9/d13/d2f/c40 0 2023-12-16T05:56:33.782 INFO:tasks.workunit.client.1.smithi156.stdout:6/208: write d9/d13/d2f/f3f [41184,130803] 0 2023-12-16T05:56:33.782 INFO:tasks.workunit.client.1.smithi156.stdout:5/355: link da/dc/d2d/f4c da/dc/d2d/d34/f69 0 2023-12-16T05:56:33.785 INFO:tasks.workunit.client.1.smithi156.stdout:3/192: dwrite dc/f19 [0,4194304] 0 2023-12-16T05:56:33.786 INFO:tasks.workunit.client.0.smithi155.stdout:2/451: dwrite d0/f2 [4194304,4194304] 0 2023-12-16T05:56:33.787 INFO:tasks.workunit.client.1.smithi156.stdout:5/356: symlink da/dc/d5f/d62/l6a 0 2023-12-16T05:56:33.787 INFO:tasks.workunit.client.1.smithi156.stdout:5/357: readlink da/l32 0 2023-12-16T05:56:33.787 INFO:tasks.workunit.client.1.smithi156.stdout:7/312: dread d1e/d1f/d22/d2c/f45 [0,4194304] 0 2023-12-16T05:56:33.787 INFO:tasks.workunit.client.1.smithi156.stdout:8/143: dwrite d3/d18/f19 [0,4194304] 0 2023-12-16T05:56:33.787 INFO:tasks.workunit.client.1.smithi156.stdout:8/144: write d3/f29 [18520,127423] 0 2023-12-16T05:56:33.787 INFO:tasks.workunit.client.1.smithi156.stdout:1/112: getdents d3/d17/d1c 0 2023-12-16T05:56:33.796 INFO:tasks.workunit.client.1.smithi156.stdout:7/313: creat d1e/d1f/d22/f64 x:0 0 0 2023-12-16T05:56:33.796 INFO:tasks.workunit.client.1.smithi156.stdout:3/193: symlink dc/d10/d3d/l48 0 2023-12-16T05:56:33.799 INFO:tasks.workunit.client.1.smithi156.stdout:7/314: dread d1e/d1f/d22/d2c/d33/f50 [0,4194304] 0 2023-12-16T05:56:33.801 INFO:tasks.workunit.client.1.smithi156.stdout:8/145: mkdir d3/d7/d9/d2f 0 2023-12-16T05:56:33.801 INFO:tasks.workunit.client.1.smithi156.stdout:7/315: dread d1e/d1f/f3a [0,4194304] 0 2023-12-16T05:56:33.801 INFO:tasks.workunit.client.1.smithi156.stdout:7/316: read - d1e/d1f/d54/d61/f5d zero size 2023-12-16T05:56:33.804 INFO:tasks.workunit.client.1.smithi156.stdout:4/183: getdents d9 0 2023-12-16T05:56:33.814 INFO:tasks.workunit.client.1.smithi156.stdout:3/194: creat dc/d10/d1d/f49 x:0 0 0 2023-12-16T05:56:33.815 INFO:tasks.workunit.client.1.smithi156.stdout:8/146: rename d3/d6/cd to d3/d7/d9/c30 0 2023-12-16T05:56:33.815 INFO:tasks.workunit.client.1.smithi156.stdout:8/147: chown d3/d18 7068 1 2023-12-16T05:56:33.816 INFO:tasks.workunit.client.1.smithi156.stdout:7/317: mknod d1e/d39/c65 0 2023-12-16T05:56:33.817 INFO:tasks.workunit.client.1.smithi156.stdout:3/195: link dc/df/d34/c47 dc/df/c4a 0 2023-12-16T05:56:33.818 INFO:tasks.workunit.client.1.smithi156.stdout:8/148: creat d3/d7/f31 x:0 0 0 2023-12-16T05:56:33.819 INFO:tasks.workunit.client.1.smithi156.stdout:5/358: dwrite da/f48 [0,4194304] 0 2023-12-16T05:56:33.823 INFO:tasks.workunit.client.1.smithi156.stdout:5/359: creat da/dc/f6b x:0 0 0 2023-12-16T05:56:33.823 INFO:tasks.workunit.client.1.smithi156.stdout:5/360: chown da/l32 20 1 2023-12-16T05:56:33.823 INFO:tasks.workunit.client.1.smithi156.stdout:5/361: fsync da/dc/f13 0 2023-12-16T05:56:33.823 INFO:tasks.workunit.client.1.smithi156.stdout:5/362: chown f4 1596 1 2023-12-16T05:56:33.828 INFO:tasks.workunit.client.0.smithi155.stdout:0/514: dwrite d7/d13/f1b [4194304,4194304] 0 2023-12-16T05:56:33.831 INFO:tasks.workunit.client.1.smithi156.stdout:4/184: dwrite d9/f1e [0,4194304] 0 2023-12-16T05:56:33.831 INFO:tasks.workunit.client.1.smithi156.stdout:6/209: dwrite d9/d13/d2f/f3f [0,4194304] 0 2023-12-16T05:56:33.831 INFO:tasks.workunit.client.1.smithi156.stdout:6/210: write d9/d13/d2f/f34 [884376,115893] 0 2023-12-16T05:56:33.832 INFO:tasks.workunit.client.0.smithi155.stdout:2/452: dwrite d0/d7/d1f/d74/f46 [4194304,4194304] 0 2023-12-16T05:56:33.835 INFO:tasks.workunit.client.1.smithi156.stdout:1/113: dwrite d3/f16 [4194304,4194304] 0 2023-12-16T05:56:33.835 INFO:tasks.workunit.client.1.smithi156.stdout:1/114: chown d3/l10 0 1 2023-12-16T05:56:33.837 INFO:tasks.workunit.client.1.smithi156.stdout:1/115: mknod d3/d17/c24 0 2023-12-16T05:56:33.840 INFO:tasks.workunit.client.1.smithi156.stdout:4/185: write d9/f1b [5921917,86202] 0 2023-12-16T05:56:33.842 INFO:tasks.workunit.client.1.smithi156.stdout:6/211: write d9/f15 [3157163,71003] 0 2023-12-16T05:56:33.843 INFO:tasks.workunit.client.1.smithi156.stdout:4/186: mkdir d9/d2b/d35 0 2023-12-16T05:56:33.843 INFO:tasks.workunit.client.1.smithi156.stdout:4/187: write f4 [553113,13903] 0 2023-12-16T05:56:33.844 INFO:tasks.workunit.client.1.smithi156.stdout:7/318: rmdir d1e/d39 39 2023-12-16T05:56:33.845 INFO:tasks.workunit.client.1.smithi156.stdout:3/196: dwrite dc/df/f2b [0,4194304] 0 2023-12-16T05:56:33.846 INFO:tasks.workunit.client.1.smithi156.stdout:3/197: write dc/d10/f11 [4388384,71031] 0 2023-12-16T05:56:33.846 INFO:tasks.workunit.client.1.smithi156.stdout:6/212: rmdir d9/d13/d2f 39 2023-12-16T05:56:33.847 INFO:tasks.workunit.client.1.smithi156.stdout:8/149: dwrite d3/d18/f22 [0,4194304] 0 2023-12-16T05:56:33.848 INFO:tasks.workunit.client.1.smithi156.stdout:4/188: rename d9/c26 to d9/d2b/c36 0 2023-12-16T05:56:33.849 INFO:tasks.workunit.client.1.smithi156.stdout:3/198: write dc/d10/d3d/f38 [1442865,73914] 0 2023-12-16T05:56:33.849 INFO:tasks.workunit.client.1.smithi156.stdout:7/319: mknod d1e/d1f/d54/c66 0 2023-12-16T05:56:33.849 INFO:tasks.workunit.client.1.smithi156.stdout:7/320: read d1e/d1f/f53 [24011,22795] 0 2023-12-16T05:56:33.849 INFO:tasks.workunit.client.1.smithi156.stdout:7/321: chown d1e/d1f/d22/d2c/d33/f35 3 1 2023-12-16T05:56:33.851 INFO:tasks.workunit.client.1.smithi156.stdout:6/213: creat d9/f41 x:0 0 0 2023-12-16T05:56:33.853 INFO:tasks.workunit.client.1.smithi156.stdout:5/363: dwrite da/f14 [0,4194304] 0 2023-12-16T05:56:33.853 INFO:tasks.workunit.client.1.smithi156.stdout:5/364: write da/dc/f21 [4017455,72670] 0 2023-12-16T05:56:33.857 INFO:tasks.workunit.client.1.smithi156.stdout:7/322: symlink d1e/d1f/d22/d2c/l67 0 2023-12-16T05:56:33.857 INFO:tasks.workunit.client.1.smithi156.stdout:4/189: dread f0 [0,4194304] 0 2023-12-16T05:56:33.857 INFO:tasks.workunit.client.1.smithi156.stdout:7/323: stat d1e/d1f/c43 0 2023-12-16T05:56:33.857 INFO:tasks.workunit.client.1.smithi156.stdout:8/150: link d3/d7/d9/f2a d3/d7/d27/f32 0 2023-12-16T05:56:33.858 INFO:tasks.workunit.client.1.smithi156.stdout:5/365: getdents da/dc/d5f 0 2023-12-16T05:56:33.860 INFO:tasks.workunit.client.0.smithi155.stdout:7/505: mknod d0/d6a/d1a/d2b/d2c/d5d/caf 0 2023-12-16T05:56:33.862 INFO:tasks.workunit.client.0.smithi155.stdout:1/603: link d1/d17/f65 d1/d17/d28/d74/fbf 0 2023-12-16T05:56:33.863 INFO:tasks.workunit.client.0.smithi155.stdout:5/587: creat d0/d2/d2a/d30/d53/fbe x:0 0 0 2023-12-16T05:56:33.867 INFO:tasks.workunit.client.0.smithi155.stdout:0/515: creat d7/df/fa8 x:0 0 0 2023-12-16T05:56:33.867 INFO:tasks.workunit.client.0.smithi155.stdout:0/516: readlink d7/df/d41/d23/l2c 0 2023-12-16T05:56:33.868 INFO:tasks.workunit.client.0.smithi155.stdout:2/453: mkdir d0/d7/d57/d95 0 2023-12-16T05:56:33.869 INFO:tasks.workunit.client.1.smithi156.stdout:7/324: dread f9 [4194304,4194304] 0 2023-12-16T05:56:33.869 INFO:tasks.workunit.client.1.smithi156.stdout:7/325: stat f7 0 2023-12-16T05:56:33.869 INFO:tasks.workunit.client.1.smithi156.stdout:5/366: read da/f48 [1294139,102116] 0 2023-12-16T05:56:33.869 INFO:tasks.workunit.client.1.smithi156.stdout:5/367: chown da/dc/f19 2768822 1 2023-12-16T05:56:33.869 INFO:tasks.workunit.client.1.smithi156.stdout:5/368: chown da/l38 108 1 2023-12-16T05:56:33.870 INFO:tasks.workunit.client.0.smithi155.stdout:5/588: rmdir d0/d2/d2a/d30/d53/d7b/d99 39 2023-12-16T05:56:33.870 INFO:tasks.workunit.client.1.smithi156.stdout:7/326: rmdir d1e 39 2023-12-16T05:56:33.870 INFO:tasks.workunit.client.1.smithi156.stdout:7/327: readlink d1e/d39/l52 0 2023-12-16T05:56:33.871 INFO:tasks.workunit.client.1.smithi156.stdout:7/328: rmdir d1e/d1f/d22/d2c 39 2023-12-16T05:56:33.871 INFO:tasks.workunit.client.0.smithi155.stdout:0/517: creat d7/d47/fa9 x:0 0 0 2023-12-16T05:56:33.871 INFO:tasks.workunit.client.0.smithi155.stdout:0/518: write d7/d13/d45/f4f [4081875,114069] 0 2023-12-16T05:56:33.872 INFO:tasks.workunit.client.0.smithi155.stdout:0/519: truncate d7/d47/d53/f9c 205921 0 2023-12-16T05:56:33.872 INFO:tasks.workunit.client.1.smithi156.stdout:7/329: link d1e/d1f/d54/d61/l46 d1e/d1f/l68 0 2023-12-16T05:56:33.872 INFO:tasks.workunit.client.0.smithi155.stdout:2/454: symlink d0/d7/dd/d49/d4b/d8c/l96 0 2023-12-16T05:56:33.873 INFO:tasks.workunit.client.0.smithi155.stdout:2/455: write d0/d34/f72 [596426,118974] 0 2023-12-16T05:56:33.874 INFO:tasks.workunit.client.0.smithi155.stdout:0/520: rename d7/d2d/f2f to d7/df/d73/faa 0 2023-12-16T05:56:33.876 INFO:tasks.workunit.client.0.smithi155.stdout:2/456: creat d0/d7/d1f/f97 x:0 0 0 2023-12-16T05:56:33.877 INFO:tasks.workunit.client.0.smithi155.stdout:0/521: symlink d7/da4/lab 0 2023-12-16T05:56:33.878 INFO:tasks.workunit.client.0.smithi155.stdout:2/457: unlink d0/d34/d3c/c71 0 2023-12-16T05:56:33.879 INFO:tasks.workunit.client.0.smithi155.stdout:0/522: creat d7/df/d73/fac x:0 0 0 2023-12-16T05:56:33.880 INFO:tasks.workunit.client.0.smithi155.stdout:0/523: write d7/d13/d45/d4b/f8c [1027587,85708] 0 2023-12-16T05:56:33.880 INFO:tasks.workunit.client.0.smithi155.stdout:0/524: stat d7/df/d6f/f7a 0 2023-12-16T05:56:33.880 INFO:tasks.workunit.client.0.smithi155.stdout:0/525: truncate d7/d13/fa7 356665 0 2023-12-16T05:56:33.880 INFO:tasks.workunit.client.0.smithi155.stdout:0/526: fdatasync d7/d13/d45/d4b/f60 0 2023-12-16T05:56:33.881 INFO:tasks.workunit.client.0.smithi155.stdout:2/458: link d0/d5/d6/d5f/f8e d0/d7/dd/d62/f98 0 2023-12-16T05:56:33.882 INFO:tasks.workunit.client.0.smithi155.stdout:2/459: creat d0/d5/d6/d5f/f99 x:0 0 0 2023-12-16T05:56:33.883 INFO:tasks.workunit.client.1.smithi156.stdout:0/206: sync 2023-12-16T05:56:33.886 INFO:tasks.workunit.client.0.smithi155.stdout:7/506: dread d0/d6a/d31/f46 [0,4194304] 0 2023-12-16T05:56:33.886 INFO:tasks.workunit.client.1.smithi156.stdout:7/330: read d1e/d1f/f53 [15379,127038] 0 2023-12-16T05:56:33.887 INFO:tasks.workunit.client.1.smithi156.stdout:0/207: symlink d2/l34 0 2023-12-16T05:56:33.888 INFO:tasks.workunit.client.1.smithi156.stdout:5/369: write da/f52 [798474,91718] 0 2023-12-16T05:56:33.888 INFO:tasks.workunit.client.0.smithi155.stdout:5/589: write d0/d2/f1d [1451816,88186] 0 2023-12-16T05:56:33.888 INFO:tasks.workunit.client.1.smithi156.stdout:7/331: symlink d1e/d1f/d22/d2c/d33/l69 0 2023-12-16T05:56:33.889 INFO:tasks.workunit.client.1.smithi156.stdout:6/214: dwrite f6 [4194304,4194304] 0 2023-12-16T05:56:33.892 INFO:tasks.workunit.client.1.smithi156.stdout:0/208: dread d2/f1b [0,4194304] 0 2023-12-16T05:56:33.894 INFO:tasks.workunit.client.1.smithi156.stdout:0/209: write d2/f1b [323426,58972] 0 2023-12-16T05:56:33.895 INFO:tasks.workunit.client.1.smithi156.stdout:5/370: getdents da/dc/d2d/d34 0 2023-12-16T05:56:33.897 INFO:tasks.workunit.client.1.smithi156.stdout:7/332: rename c1d to d1e/d1f/d54/d61/c6a 0 2023-12-16T05:56:33.897 INFO:tasks.workunit.client.1.smithi156.stdout:7/333: chown d1e/d1f/d22/d2c/d33/f50 1 1 2023-12-16T05:56:33.898 INFO:tasks.workunit.client.0.smithi155.stdout:7/507: dread d0/d6a/d1a/d22/f23 [0,4194304] 0 2023-12-16T05:56:33.898 INFO:tasks.workunit.client.0.smithi155.stdout:7/508: write d0/d6a/d1a/d8c/d34/d4b/d64/fa4 [175226,11218] 0 2023-12-16T05:56:33.898 INFO:tasks.workunit.client.1.smithi156.stdout:6/215: symlink d9/l42 0 2023-12-16T05:56:33.899 INFO:tasks.workunit.client.0.smithi155.stdout:7/509: symlink d0/d6a/d1a/d8c/d34/d4b/d64/lb0 0 2023-12-16T05:56:33.899 INFO:tasks.workunit.client.0.smithi155.stdout:7/510: fdatasync d0/d6a/d1a/d38/f41 0 2023-12-16T05:56:33.900 INFO:tasks.workunit.client.1.smithi156.stdout:5/371: mkdir da/dc/d4b/d6c 0 2023-12-16T05:56:33.900 INFO:tasks.workunit.client.1.smithi156.stdout:5/372: truncate da/f68 635040 0 2023-12-16T05:56:33.900 INFO:tasks.workunit.client.0.smithi155.stdout:7/511: mkdir d0/d6a/d1a/d8c/d42/d98/db1 0 2023-12-16T05:56:33.900 INFO:tasks.workunit.client.0.smithi155.stdout:5/590: dread d0/d2/d2a/d19/f38 [0,4194304] 0 2023-12-16T05:56:33.901 INFO:tasks.workunit.client.1.smithi156.stdout:7/334: rmdir d1e/d39 39 2023-12-16T05:56:33.901 INFO:tasks.workunit.client.0.smithi155.stdout:7/512: creat d0/d6a/d1a/d8c/d34/fb2 x:0 0 0 2023-12-16T05:56:33.902 INFO:tasks.workunit.client.0.smithi155.stdout:7/513: stat d0/d1/d5/l10 0 2023-12-16T05:56:33.902 INFO:tasks.workunit.client.0.smithi155.stdout:7/514: fdatasync d0/d1/fe 0 2023-12-16T05:56:33.902 INFO:tasks.workunit.client.0.smithi155.stdout:7/515: readlink d0/d6a/d1a/l1f 0 2023-12-16T05:56:33.902 INFO:tasks.workunit.client.0.smithi155.stdout:5/591: link d0/d2/d2a/d30/c62 d0/d2/d2a/d19/d48/cbf 0 2023-12-16T05:56:33.903 INFO:tasks.workunit.client.0.smithi155.stdout:5/592: stat d0/d2/d4f/f55 0 2023-12-16T05:56:33.903 INFO:tasks.workunit.client.1.smithi156.stdout:5/373: creat da/dc/d2d/d4d/d54/d67/f6d x:0 0 0 2023-12-16T05:56:33.904 INFO:tasks.workunit.client.1.smithi156.stdout:7/335: mknod d1e/d1f/d54/c6b 0 2023-12-16T05:56:33.904 INFO:tasks.workunit.client.0.smithi155.stdout:5/593: link d0/d60/d79/d8e/f98 d0/d2/d2a/d19/d88/fc0 0 2023-12-16T05:56:33.905 INFO:tasks.workunit.client.0.smithi155.stdout:2/460: dwrite d0/d34/f40 [0,4194304] 0 2023-12-16T05:56:33.906 INFO:tasks.workunit.client.0.smithi155.stdout:2/461: write d0/d7/dd/d14/f19 [242155,92153] 0 2023-12-16T05:56:33.909 INFO:tasks.workunit.client.0.smithi155.stdout:2/462: symlink d0/d5/d6/l9a 0 2023-12-16T05:56:33.910 INFO:tasks.workunit.client.0.smithi155.stdout:2/463: mkdir d0/d7/d57/d9b 0 2023-12-16T05:56:33.910 INFO:tasks.workunit.client.0.smithi155.stdout:0/527: dwrite d7/df/f9a [0,4194304] 0 2023-12-16T05:56:33.912 INFO:tasks.workunit.client.0.smithi155.stdout:2/464: creat d0/d7/dd/d49/d4b/d80/f9c x:0 0 0 2023-12-16T05:56:33.913 INFO:tasks.workunit.client.0.smithi155.stdout:0/528: getdents d7/df/d73/d8d 0 2023-12-16T05:56:33.916 INFO:tasks.workunit.client.0.smithi155.stdout:2/465: mknod d0/d5/d6/d5f/c9d 0 2023-12-16T05:56:33.917 INFO:tasks.workunit.client.0.smithi155.stdout:2/466: truncate d0/d7/dd/f6e 3368270 0 2023-12-16T05:56:33.918 INFO:tasks.workunit.client.1.smithi156.stdout:0/210: dread d2/d7/dd/f1f [0,4194304] 0 2023-12-16T05:56:33.919 INFO:tasks.workunit.client.0.smithi155.stdout:2/467: symlink d0/d7/d57/d95/l9e 0 2023-12-16T05:56:33.934 INFO:tasks.workunit.client.1.smithi156.stdout:6/216: dwrite d9/f3b [0,4194304] 0 2023-12-16T05:56:33.938 INFO:tasks.workunit.client.0.smithi155.stdout:2/468: dread d0/d7/d1f/d74/f46 [0,4194304] 0 2023-12-16T05:56:33.939 INFO:tasks.workunit.client.1.smithi156.stdout:5/374: dwrite da/dc/f17 [0,4194304] 0 2023-12-16T05:56:33.940 INFO:tasks.workunit.client.1.smithi156.stdout:6/217: rename d9/d13/d2f/d36/c38 to d9/d13/d3e/c43 0 2023-12-16T05:56:33.940 INFO:tasks.workunit.client.1.smithi156.stdout:5/375: symlink da/d46/l6e 0 2023-12-16T05:56:33.941 INFO:tasks.workunit.client.1.smithi156.stdout:6/218: rmdir d9/d13/d3e 39 2023-12-16T05:56:33.941 INFO:tasks.workunit.client.1.smithi156.stdout:6/219: truncate f8 2078505 0 2023-12-16T05:56:33.941 INFO:tasks.workunit.client.1.smithi156.stdout:6/220: write d9/f35 [982385,20641] 0 2023-12-16T05:56:33.942 INFO:tasks.workunit.client.1.smithi156.stdout:0/211: dwrite d2/d23/f32 [0,4194304] 0 2023-12-16T05:56:33.942 INFO:tasks.workunit.client.1.smithi156.stdout:5/376: mknod da/dc/d2d/d4d/d54/c6f 0 2023-12-16T05:56:33.943 INFO:tasks.workunit.client.1.smithi156.stdout:7/336: dwrite d1e/d1f/d22/f23 [0,4194304] 0 2023-12-16T05:56:33.943 INFO:tasks.workunit.client.1.smithi156.stdout:7/337: fdatasync d1e/d1f/d22/f23 0 2023-12-16T05:56:33.944 INFO:tasks.workunit.client.1.smithi156.stdout:6/221: creat d9/d1c/f44 x:0 0 0 2023-12-16T05:56:33.946 INFO:tasks.workunit.client.0.smithi155.stdout:9/616: sync 2023-12-16T05:56:33.946 INFO:tasks.workunit.client.0.smithi155.stdout:0/529: dwrite d7/d47/fa9 [0,4194304] 0 2023-12-16T05:56:33.946 INFO:tasks.workunit.client.0.smithi155.stdout:5/594: dwrite d0/d2/d4f/f55 [4194304,4194304] 0 2023-12-16T05:56:33.946 INFO:tasks.workunit.client.0.smithi155.stdout:5/595: chown d0/d2/d4f/c5a 1066021728 1 2023-12-16T05:56:33.946 INFO:tasks.workunit.client.0.smithi155.stdout:6/673: sync 2023-12-16T05:56:33.946 INFO:tasks.workunit.client.0.smithi155.stdout:4/501: sync 2023-12-16T05:56:33.946 INFO:tasks.workunit.client.0.smithi155.stdout:4/502: chown d0/da/d36/d5f/d75/d86 0 1 2023-12-16T05:56:33.946 INFO:tasks.workunit.client.0.smithi155.stdout:4/503: fsync d0/f20 0 2023-12-16T05:56:33.947 INFO:tasks.workunit.client.1.smithi156.stdout:0/212: unlink d2/f1b 0 2023-12-16T05:56:33.947 INFO:tasks.workunit.client.1.smithi156.stdout:0/213: fdatasync d2/f24 0 2023-12-16T05:56:33.947 INFO:tasks.workunit.client.1.smithi156.stdout:7/338: creat d1e/d1f/d22/d2c/f6c x:0 0 0 2023-12-16T05:56:33.948 INFO:tasks.workunit.client.1.smithi156.stdout:6/222: symlink d9/d13/d2f/l45 0 2023-12-16T05:56:33.948 INFO:tasks.workunit.client.1.smithi156.stdout:0/214: write d2/d7/dd/f19 [4854140,117130] 0 2023-12-16T05:56:33.948 INFO:tasks.workunit.client.1.smithi156.stdout:0/215: fdatasync d2/d7/f15 0 2023-12-16T05:56:33.953 INFO:tasks.workunit.client.1.smithi156.stdout:0/216: mknod d2/d7/c35 0 2023-12-16T05:56:33.953 INFO:tasks.workunit.client.1.smithi156.stdout:6/223: creat d9/d1c/f46 x:0 0 0 2023-12-16T05:56:33.956 INFO:tasks.workunit.client.0.smithi155.stdout:9/617: dread da/d15/d17/d36/d5b/f71 [0,4194304] 0 2023-12-16T05:56:33.959 INFO:tasks.workunit.client.1.smithi156.stdout:7/339: dread d1e/d1f/d22/d2c/d33/f3d [0,4194304] 0 2023-12-16T05:56:33.961 INFO:tasks.workunit.client.1.smithi156.stdout:5/377: dread da/dc/f2e [0,4194304] 0 2023-12-16T05:56:33.961 INFO:tasks.workunit.client.1.smithi156.stdout:5/378: write f0 [4533246,89143] 0 2023-12-16T05:56:33.963 INFO:tasks.workunit.client.0.smithi155.stdout:6/674: dread d0/d3/d7a/f73 [0,4194304] 0 2023-12-16T05:56:33.964 INFO:tasks.workunit.client.0.smithi155.stdout:6/675: dread d0/df/f27 [0,4194304] 0 2023-12-16T05:56:33.965 INFO:tasks.workunit.client.1.smithi156.stdout:5/379: truncate da/dc/f11 2855043 0 2023-12-16T05:56:33.967 INFO:tasks.workunit.client.1.smithi156.stdout:6/224: dread d9/f35 [0,4194304] 0 2023-12-16T05:56:33.968 INFO:tasks.workunit.client.1.smithi156.stdout:6/225: truncate d9/d13/d2f/f3f 3004433 0 2023-12-16T05:56:33.969 INFO:tasks.workunit.client.1.smithi156.stdout:6/226: chown d9/d13/d2f/d36 2 1 2023-12-16T05:56:33.969 INFO:tasks.workunit.client.1.smithi156.stdout:6/227: chown d9/d1c/c22 888502 1 2023-12-16T05:56:33.969 INFO:tasks.workunit.client.1.smithi156.stdout:5/380: write da/dc/f31 [3319295,100887] 0 2023-12-16T05:56:33.969 INFO:tasks.workunit.client.0.smithi155.stdout:5/596: dwrite d0/d2/d2a/d30/d53/d7b/d99/f5d [8388608,4194304] 0 2023-12-16T05:56:33.972 INFO:tasks.workunit.client.1.smithi156.stdout:7/340: dread f4 [0,4194304] 0 2023-12-16T05:56:33.973 INFO:tasks.workunit.client.1.smithi156.stdout:7/341: mknod d1e/d1f/d22/d2c/d57/d59/c6d 0 2023-12-16T05:56:33.973 INFO:tasks.workunit.client.1.smithi156.stdout:7/342: truncate d1e/d1f/d54/d61/f38 571150 0 2023-12-16T05:56:33.973 INFO:tasks.workunit.client.1.smithi156.stdout:7/343: truncate d1e/d1f/d22/d2c/d33/f3d 4951583 0 2023-12-16T05:56:33.974 INFO:tasks.workunit.client.1.smithi156.stdout:7/344: read d1e/f58 [221966,116862] 0 2023-12-16T05:56:33.974 INFO:tasks.workunit.client.1.smithi156.stdout:7/345: mknod d1e/d1f/c6e 0 2023-12-16T05:56:33.974 INFO:tasks.workunit.client.0.smithi155.stdout:4/504: dwrite d0/f20 [4194304,4194304] 0 2023-12-16T05:56:33.977 INFO:tasks.workunit.client.1.smithi156.stdout:5/381: write f4 [1123470,117340] 0 2023-12-16T05:56:33.978 INFO:tasks.workunit.client.1.smithi156.stdout:5/382: dread - da/dc/d2d/d4d/d54/f5d zero size 2023-12-16T05:56:33.978 INFO:tasks.workunit.client.1.smithi156.stdout:5/383: creat da/d46/f70 x:0 0 0 2023-12-16T05:56:33.978 INFO:tasks.workunit.client.0.smithi155.stdout:9/618: dwrite da/d15/d17/d24/d62/f97 [0,4194304] 0 2023-12-16T05:56:33.978 INFO:tasks.workunit.client.1.smithi156.stdout:5/384: unlink da/f28 0 2023-12-16T05:56:33.982 INFO:tasks.workunit.client.1.smithi156.stdout:5/385: link da/l35 da/d46/l71 0 2023-12-16T05:56:33.982 INFO:tasks.workunit.client.1.smithi156.stdout:7/346: getdents d1e/d1f/d22/d2c 0 2023-12-16T05:56:33.983 INFO:tasks.workunit.client.1.smithi156.stdout:6/228: dread d9/d13/f3d [0,4194304] 0 2023-12-16T05:56:33.983 INFO:tasks.workunit.client.1.smithi156.stdout:6/229: chown d9/d1c/f2b 7 1 2023-12-16T05:56:33.983 INFO:tasks.workunit.client.0.smithi155.stdout:4/505: dread d0/d10/d46/d16/f4b [0,4194304] 0 2023-12-16T05:56:33.984 INFO:tasks.workunit.client.1.smithi156.stdout:5/386: rename da/d46/c56 to da/dc/d5f/c72 0 2023-12-16T05:56:33.985 INFO:tasks.workunit.client.1.smithi156.stdout:7/347: creat d1e/d1f/d22/d2c/d33/f6f x:0 0 0 2023-12-16T05:56:33.985 INFO:tasks.workunit.client.0.smithi155.stdout:9/619: dread da/f13 [4194304,4194304] 0 2023-12-16T05:56:33.986 INFO:tasks.workunit.client.0.smithi155.stdout:9/620: write da/d15/d17/d24/d26/f44 [2659456,19309] 0 2023-12-16T05:56:33.986 INFO:tasks.workunit.client.0.smithi155.stdout:9/621: chown da/d15/d17/d24/d26/d2e/d32/f53 32911642 1 2023-12-16T05:56:33.987 INFO:tasks.workunit.client.1.smithi156.stdout:6/230: unlink d9/d1c/c1e 0 2023-12-16T05:56:33.988 INFO:tasks.workunit.client.1.smithi156.stdout:5/387: mknod da/dc/d5f/c73 0 2023-12-16T05:56:33.990 INFO:tasks.workunit.client.1.smithi156.stdout:7/348: mknod d1e/d1f/d22/d2c/d33/c70 0 2023-12-16T05:56:33.990 INFO:tasks.workunit.client.1.smithi156.stdout:7/349: write d1e/d1f/d22/d2c/d33/f35 [2086397,117106] 0 2023-12-16T05:56:33.990 INFO:tasks.workunit.client.1.smithi156.stdout:7/350: stat d1e/f27 0 2023-12-16T05:56:33.990 INFO:tasks.workunit.client.1.smithi156.stdout:7/351: chown d1e/d1f/d22/d2c/f4d 5687 1 2023-12-16T05:56:33.992 INFO:tasks.workunit.client.1.smithi156.stdout:6/231: rename d9/f1f to d9/d1c/f47 0 2023-12-16T05:56:33.992 INFO:tasks.workunit.client.1.smithi156.stdout:6/232: readlink d9/d1c/l33 0 2023-12-16T05:56:33.993 INFO:tasks.workunit.client.0.smithi155.stdout:9/622: dread da/d15/d17/d36/f3f [0,4194304] 0 2023-12-16T05:56:33.994 INFO:tasks.workunit.client.1.smithi156.stdout:5/388: symlink da/dc/d4b/d6c/l74 0 2023-12-16T05:56:33.995 INFO:tasks.workunit.client.1.smithi156.stdout:7/352: rename d1e/d1f/d54 to d1e/d55/d71 0 2023-12-16T05:56:33.998 INFO:tasks.workunit.client.1.smithi156.stdout:7/353: dread d1e/f58 [0,4194304] 0 2023-12-16T05:56:33.999 INFO:tasks.workunit.client.1.smithi156.stdout:7/354: dread - d1e/d1f/d22/d2c/f6c zero size 2023-12-16T05:56:34.000 INFO:tasks.workunit.client.1.smithi156.stdout:7/355: write d1e/d55/d71/f49 [496182,39152] 0 2023-12-16T05:56:34.000 INFO:tasks.workunit.client.1.smithi156.stdout:6/233: dread d9/d13/f20 [0,4194304] 0 2023-12-16T05:56:34.002 INFO:tasks.workunit.client.1.smithi156.stdout:7/356: mkdir d1e/d1f/d72 0 2023-12-16T05:56:34.004 INFO:tasks.workunit.client.1.smithi156.stdout:6/234: rename d9/d13/f26 to d9/d13/f48 0 2023-12-16T05:56:34.004 INFO:tasks.workunit.client.1.smithi156.stdout:6/235: chown d9/d1c/c2d 11709 1 2023-12-16T05:56:34.005 INFO:tasks.workunit.client.1.smithi156.stdout:7/357: fsync d1e/d1f/d22/d2c/d33/f35 0 2023-12-16T05:56:34.008 INFO:tasks.workunit.client.1.smithi156.stdout:7/358: mknod d1e/d39/c73 0 2023-12-16T05:56:34.013 INFO:tasks.workunit.client.1.smithi156.stdout:7/359: dread d1e/d55/d71/d61/f36 [0,4194304] 0 2023-12-16T05:56:34.013 INFO:tasks.workunit.client.1.smithi156.stdout:7/360: write d1e/d1f/f53 [278481,101199] 0 2023-12-16T05:56:34.014 INFO:tasks.workunit.client.1.smithi156.stdout:7/361: mkdir d1e/d1f/d74 0 2023-12-16T05:56:34.016 INFO:tasks.workunit.client.1.smithi156.stdout:7/362: mkdir d1e/d1f/d22/d75 0 2023-12-16T05:56:34.022 INFO:tasks.workunit.client.1.smithi156.stdout:7/363: dread d1e/d1f/d22/d2c/d33/f35 [0,4194304] 0 2023-12-16T05:56:34.022 INFO:tasks.workunit.client.1.smithi156.stdout:5/389: dwrite f0 [0,4194304] 0 2023-12-16T05:56:34.023 INFO:tasks.workunit.client.1.smithi156.stdout:6/236: dwrite d9/f3b [0,4194304] 0 2023-12-16T05:56:34.024 INFO:tasks.workunit.client.1.smithi156.stdout:5/390: unlink da/dc/c20 0 2023-12-16T05:56:34.024 INFO:tasks.workunit.client.1.smithi156.stdout:5/391: dread - da/f49 zero size 2023-12-16T05:56:34.024 INFO:tasks.workunit.client.1.smithi156.stdout:5/392: truncate da/dc/d2d/d4d/d54/d67/f6d 636875 0 2023-12-16T05:56:34.024 INFO:tasks.workunit.client.1.smithi156.stdout:7/364: creat d1e/d1f/f76 x:0 0 0 2023-12-16T05:56:34.025 INFO:tasks.workunit.client.1.smithi156.stdout:6/237: truncate d9/d1c/f23 3425863 0 2023-12-16T05:56:34.025 INFO:tasks.workunit.client.1.smithi156.stdout:6/238: readlink d9/d13/d2f/l45 0 2023-12-16T05:56:34.026 INFO:tasks.workunit.client.0.smithi155.stdout:0/530: mkdir d7/df/d41/d23/d36/dad 0 2023-12-16T05:56:34.026 INFO:tasks.workunit.client.1.smithi156.stdout:5/393: rename da/dc/d4b/c55 to da/dc/d2d/c75 0 2023-12-16T05:56:34.027 INFO:tasks.workunit.client.1.smithi156.stdout:7/365: mkdir d1e/d1f/d22/d75/d77 0 2023-12-16T05:56:34.028 INFO:tasks.workunit.client.0.smithi155.stdout:6/676: mkdir d0/df/d5e/d5b/dd7 0 2023-12-16T05:56:34.028 INFO:tasks.workunit.client.0.smithi155.stdout:6/677: chown d0/df/d5e/d7e/f89 536857845 1 2023-12-16T05:56:34.029 INFO:tasks.workunit.client.1.smithi156.stdout:6/239: creat d9/d1c/f49 x:0 0 0 2023-12-16T05:56:34.029 INFO:tasks.workunit.client.0.smithi155.stdout:6/678: read d0/df/d5e/d7e/f89 [4046608,52455] 0 2023-12-16T05:56:34.029 INFO:tasks.workunit.client.0.smithi155.stdout:5/597: symlink d0/d2/d2a/d19/d71/lc1 0 2023-12-16T05:56:34.029 INFO:tasks.workunit.client.0.smithi155.stdout:5/598: chown d0/c4e 40557645 1 2023-12-16T05:56:34.030 INFO:tasks.workunit.client.1.smithi156.stdout:5/394: symlink da/dc/d4b/d6c/l76 0 2023-12-16T05:56:34.031 INFO:tasks.workunit.client.0.smithi155.stdout:4/506: symlink d0/d10/d46/d16/d1a/d70/d9f/la5 0 2023-12-16T05:56:34.031 INFO:tasks.workunit.client.0.smithi155.stdout:4/507: fdatasync d0/da/f73 0 2023-12-16T05:56:34.033 INFO:tasks.workunit.client.0.smithi155.stdout:9/623: creat da/d15/d17/fd8 x:0 0 0 2023-12-16T05:56:34.033 INFO:tasks.workunit.client.1.smithi156.stdout:7/366: creat d1e/d1f/f78 x:0 0 0 2023-12-16T05:56:34.034 INFO:tasks.workunit.client.0.smithi155.stdout:9/624: write da/d15/d17/d24/d62/fc4 [805730,42091] 0 2023-12-16T05:56:34.034 INFO:tasks.workunit.client.1.smithi156.stdout:7/367: read d1e/d1f/f3a [407028,44601] 0 2023-12-16T05:56:34.034 INFO:tasks.workunit.client.1.smithi156.stdout:6/240: mknod d9/d1c/c4a 0 2023-12-16T05:56:34.034 INFO:tasks.workunit.client.1.smithi156.stdout:7/368: write d1e/d1f/d22/d2c/f6c [252750,100361] 0 2023-12-16T05:56:34.035 INFO:tasks.workunit.client.0.smithi155.stdout:9/625: write da/f80 [403463,31359] 0 2023-12-16T05:56:34.036 INFO:tasks.workunit.client.1.smithi156.stdout:6/241: write d9/f3b [3944991,123228] 0 2023-12-16T05:56:34.037 INFO:tasks.workunit.client.1.smithi156.stdout:7/369: creat d1e/d1f/d22/f79 x:0 0 0 2023-12-16T05:56:34.037 INFO:tasks.workunit.client.0.smithi155.stdout:0/531: unlink d7/d47/l78 0 2023-12-16T05:56:34.038 INFO:tasks.workunit.client.0.smithi155.stdout:0/532: read d7/d13/d45/d4b/f8c [149621,50983] 0 2023-12-16T05:56:34.039 INFO:tasks.workunit.client.1.smithi156.stdout:7/370: mknod d1e/d1f/d22/d75/d77/c7a 0 2023-12-16T05:56:34.039 INFO:tasks.workunit.client.1.smithi156.stdout:7/371: chown d1e/d1f/d22/d2c/d33/l34 794142340 1 2023-12-16T05:56:34.039 INFO:tasks.workunit.client.0.smithi155.stdout:6/679: mkdir d0/df/d5e/d7e/dd8 0 2023-12-16T05:56:34.039 INFO:tasks.workunit.client.0.smithi155.stdout:6/680: fdatasync d0/d3/d2c/fa0 0 2023-12-16T05:56:34.040 INFO:tasks.workunit.client.0.smithi155.stdout:5/599: symlink d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/lc2 0 2023-12-16T05:56:34.041 INFO:tasks.workunit.client.0.smithi155.stdout:4/508: mknod d0/da/d36/d5f/d75/d3d/ca6 0 2023-12-16T05:56:34.043 INFO:tasks.workunit.client.0.smithi155.stdout:9/626: creat da/d15/d17/d24/d62/d91/dc0/fd9 x:0 0 0 2023-12-16T05:56:34.043 INFO:tasks.workunit.client.0.smithi155.stdout:9/627: chown da/d15/d17/d36/d5b/d60/l89 164053 1 2023-12-16T05:56:34.043 INFO:tasks.workunit.client.0.smithi155.stdout:9/628: write da/d15/d17/d24/d62/fbb [631066,19565] 0 2023-12-16T05:56:34.043 INFO:tasks.workunit.client.0.smithi155.stdout:9/629: write da/d15/d17/d36/d5b/fa2 [839491,98304] 0 2023-12-16T05:56:34.045 INFO:tasks.workunit.client.0.smithi155.stdout:0/533: rename d7/df/c4a to d7/d47/cae 0 2023-12-16T05:56:34.046 INFO:tasks.workunit.client.0.smithi155.stdout:6/681: unlink d0/d3/d7a/d77/l96 0 2023-12-16T05:56:34.047 INFO:tasks.workunit.client.0.smithi155.stdout:6/682: read d0/d3/d2c/d8b/d85/f8d [754450,438] 0 2023-12-16T05:56:34.049 INFO:tasks.workunit.client.0.smithi155.stdout:4/509: creat d0/da/fa7 x:0 0 0 2023-12-16T05:56:34.051 INFO:tasks.workunit.client.0.smithi155.stdout:9/630: link da/d15/l1f da/d15/d17/d36/d5b/d60/d9e/lda 0 2023-12-16T05:56:34.052 INFO:tasks.workunit.client.1.smithi156.stdout:6/242: dwrite d9/d1c/f39 [0,4194304] 0 2023-12-16T05:56:34.053 INFO:tasks.workunit.client.0.smithi155.stdout:0/534: creat d7/df/d73/d8d/d4d/faf x:0 0 0 2023-12-16T05:56:34.053 INFO:tasks.workunit.client.0.smithi155.stdout:0/535: dread - d7/d13/d45/d4b/f67 zero size 2023-12-16T05:56:34.054 INFO:tasks.workunit.client.0.smithi155.stdout:6/683: creat d0/d3/d2c/fd9 x:0 0 0 2023-12-16T05:56:34.056 INFO:tasks.workunit.client.0.smithi155.stdout:0/536: unlink d7/df/d73/d8d/c57 0 2023-12-16T05:56:34.058 INFO:tasks.workunit.client.1.smithi156.stdout:6/243: rename d9/d13/d2f/l45 to d9/d13/d3e/l4b 0 2023-12-16T05:56:34.058 INFO:tasks.workunit.client.1.smithi156.stdout:6/244: symlink d9/d13/d2f/d36/l4c 0 2023-12-16T05:56:34.060 INFO:tasks.workunit.client.1.smithi156.stdout:6/245: unlink d9/d1c/f44 0 2023-12-16T05:56:34.060 INFO:tasks.workunit.client.1.smithi156.stdout:6/246: dread - d9/f3c zero size 2023-12-16T05:56:34.060 INFO:tasks.workunit.client.1.smithi156.stdout:6/247: chown d9/d13/d2f/d36 377105464 1 2023-12-16T05:56:34.060 INFO:tasks.workunit.client.0.smithi155.stdout:6/684: rename d0/df/d5e/d46/d6d/lbe to d0/d3/d2c/d8b/lda 0 2023-12-16T05:56:34.060 INFO:tasks.workunit.client.0.smithi155.stdout:9/631: dread da/d15/d17/d24/d26/d2e/d32/f35 [0,4194304] 0 2023-12-16T05:56:34.062 INFO:tasks.workunit.client.0.smithi155.stdout:0/537: getdents d7/d47/d5d/d84 0 2023-12-16T05:56:34.062 INFO:tasks.workunit.client.0.smithi155.stdout:0/538: fdatasync d7/df/f9a 0 2023-12-16T05:56:34.062 INFO:tasks.workunit.client.0.smithi155.stdout:6/685: rmdir d0/df/d5e/d7e 39 2023-12-16T05:56:34.066 INFO:tasks.workunit.client.0.smithi155.stdout:6/686: rename d0/d3/f11 to d0/df/d43/fdb 0 2023-12-16T05:56:34.067 INFO:tasks.workunit.client.0.smithi155.stdout:0/539: mkdir d7/db0 0 2023-12-16T05:56:34.068 INFO:tasks.workunit.client.0.smithi155.stdout:6/687: mknod d0/d3/d2c/d3e/cdc 0 2023-12-16T05:56:34.068 INFO:tasks.workunit.client.0.smithi155.stdout:0/540: creat d7/df/d73/fb1 x:0 0 0 2023-12-16T05:56:34.070 INFO:tasks.workunit.client.0.smithi155.stdout:0/541: symlink d7/df/d73/lb2 0 2023-12-16T05:56:34.071 INFO:tasks.workunit.client.0.smithi155.stdout:0/542: mkdir d7/df/d73/db3 0 2023-12-16T05:56:34.072 INFO:tasks.workunit.client.0.smithi155.stdout:0/543: dread - d7/df/d6f/fa5 zero size 2023-12-16T05:56:34.073 INFO:tasks.workunit.client.0.smithi155.stdout:0/544: link d7/df/d41/l42 d7/df/d73/d8d/lb4 0 2023-12-16T05:56:34.074 INFO:tasks.workunit.client.0.smithi155.stdout:0/545: unlink d7/df/d65/c1e 0 2023-12-16T05:56:34.075 INFO:tasks.workunit.client.0.smithi155.stdout:0/546: creat d7/df/d41/d23/d36/fb5 x:0 0 0 2023-12-16T05:56:34.076 INFO:tasks.workunit.client.1.smithi156.stdout:7/372: dwrite f9 [4194304,4194304] 0 2023-12-16T05:56:34.076 INFO:tasks.workunit.client.1.smithi156.stdout:7/373: chown d1e 9993 1 2023-12-16T05:56:34.079 INFO:tasks.workunit.client.1.smithi156.stdout:6/248: dwrite d9/d1c/f2b [0,4194304] 0 2023-12-16T05:56:34.079 INFO:tasks.workunit.client.1.smithi156.stdout:6/249: fdatasync d9/d13/d2f/f34 0 2023-12-16T05:56:34.080 INFO:tasks.workunit.client.0.smithi155.stdout:6/688: dread d0/d3/d7a/f4e [0,4194304] 0 2023-12-16T05:56:34.080 INFO:tasks.workunit.client.0.smithi155.stdout:6/689: chown d0/d3/d2c/d3e/d4c/d1b 22 1 2023-12-16T05:56:34.081 INFO:tasks.workunit.client.0.smithi155.stdout:9/632: dwrite da/d15/f31 [0,4194304] 0 2023-12-16T05:56:34.082 INFO:tasks.workunit.client.1.smithi156.stdout:7/374: symlink d1e/l7b 0 2023-12-16T05:56:34.083 INFO:tasks.workunit.client.0.smithi155.stdout:9/633: write da/d15/d17/d24/d26/d2e/d83/d8f/fb2 [1717788,94297] 0 2023-12-16T05:56:34.085 INFO:tasks.workunit.client.1.smithi156.stdout:6/250: creat d9/d13/f4d x:0 0 0 2023-12-16T05:56:34.087 INFO:tasks.workunit.client.1.smithi156.stdout:7/375: getdents d1e/d39 0 2023-12-16T05:56:34.088 INFO:tasks.workunit.client.1.smithi156.stdout:6/251: mknod d9/d13/c4e 0 2023-12-16T05:56:34.090 INFO:tasks.workunit.client.1.smithi156.stdout:7/376: symlink d1e/d1f/d22/d2c/d57/l7c 0 2023-12-16T05:56:34.090 INFO:tasks.workunit.client.0.smithi155.stdout:6/690: dread d0/d3/f38 [0,4194304] 0 2023-12-16T05:56:34.091 INFO:tasks.workunit.client.1.smithi156.stdout:7/377: read d1e/d1f/d22/f25 [409037,92309] 0 2023-12-16T05:56:34.092 INFO:tasks.workunit.client.1.smithi156.stdout:6/252: rename d9/d13/c4e to d9/d13/d2f/c4f 0 2023-12-16T05:56:34.092 INFO:tasks.workunit.client.1.smithi156.stdout:7/378: truncate d1e/f58 962006 0 2023-12-16T05:56:34.093 INFO:tasks.workunit.client.0.smithi155.stdout:6/691: rename d0/d3/d2c/d3e/d4c to d0/d3/d7a/db0/dc3/dce/ddd 0 2023-12-16T05:56:34.093 INFO:tasks.workunit.client.0.smithi155.stdout:6/692: readlink d0/d3/d2c/d3e/laa 0 2023-12-16T05:56:34.093 INFO:tasks.workunit.client.0.smithi155.stdout:6/693: stat d0/df/d5e/d99/cc2 0 2023-12-16T05:56:34.094 INFO:tasks.workunit.client.1.smithi156.stdout:6/253: mkdir d9/d1c/d50 0 2023-12-16T05:56:34.094 INFO:tasks.workunit.client.0.smithi155.stdout:6/694: creat d0/d3/d7a/db0/dc3/dce/ddd/fde x:0 0 0 2023-12-16T05:56:34.096 INFO:tasks.workunit.client.1.smithi156.stdout:7/379: dread d1e/d1f/d22/d2c/d33/f35 [0,4194304] 0 2023-12-16T05:56:34.098 INFO:tasks.workunit.client.1.smithi156.stdout:9/200: sync 2023-12-16T05:56:34.101 INFO:tasks.workunit.client.0.smithi155.stdout:9/634: dwrite da/d15/f66 [0,4194304] 0 2023-12-16T05:56:34.102 INFO:tasks.workunit.client.1.smithi156.stdout:9/201: symlink d6/d19/d25/l49 0 2023-12-16T05:56:34.102 INFO:tasks.workunit.client.1.smithi156.stdout:2/239: sync 2023-12-16T05:56:34.104 INFO:tasks.workunit.client.0.smithi155.stdout:9/635: creat da/d15/d17/d36/d5b/d60/db9/fdb x:0 0 0 2023-12-16T05:56:34.106 INFO:tasks.workunit.client.1.smithi156.stdout:9/202: dread d6/fd [0,4194304] 0 2023-12-16T05:56:34.106 INFO:tasks.workunit.client.1.smithi156.stdout:9/203: fsync d6/d19/d25/f31 0 2023-12-16T05:56:34.108 INFO:tasks.workunit.client.1.smithi156.stdout:9/204: getdents d6/d2e 0 2023-12-16T05:56:34.109 INFO:tasks.workunit.client.1.smithi156.stdout:9/205: creat d6/d19/d25/d3a/f4a x:0 0 0 2023-12-16T05:56:34.109 INFO:tasks.workunit.client.1.smithi156.stdout:9/206: readlink d6/d2e/l3e 0 2023-12-16T05:56:34.109 INFO:tasks.workunit.client.1.smithi156.stdout:9/207: fsync d6/f1e 0 2023-12-16T05:56:34.110 INFO:tasks.workunit.client.0.smithi155.stdout:6/695: dread d0/d3/d7a/db0/dc3/dce/ddd/d1b/f6a [0,4194304] 0 2023-12-16T05:56:34.114 INFO:tasks.workunit.client.1.smithi156.stdout:6/254: dread d9/d1c/f23 [0,4194304] 0 2023-12-16T05:56:34.126 INFO:tasks.workunit.client.0.smithi155.stdout:9/636: dwrite da/d15/fb1 [0,4194304] 0 2023-12-16T05:56:34.133 INFO:tasks.workunit.client.1.smithi156.stdout:7/380: dwrite f9 [0,4194304] 0 2023-12-16T05:56:34.135 INFO:tasks.workunit.client.1.smithi156.stdout:2/240: dwrite d9/dd/f19 [0,4194304] 0 2023-12-16T05:56:34.135 INFO:tasks.workunit.client.1.smithi156.stdout:9/208: dwrite d6/ff [0,4194304] 0 2023-12-16T05:56:34.135 INFO:tasks.workunit.client.1.smithi156.stdout:7/381: creat d1e/d39/f7d x:0 0 0 2023-12-16T05:56:34.135 INFO:tasks.workunit.client.1.smithi156.stdout:7/382: write f4 [4334043,109581] 0 2023-12-16T05:56:34.135 INFO:tasks.workunit.client.1.smithi156.stdout:2/241: creat d9/d12/f45 x:0 0 0 2023-12-16T05:56:34.137 INFO:tasks.workunit.client.1.smithi156.stdout:7/383: creat d1e/d55/f7e x:0 0 0 2023-12-16T05:56:34.138 INFO:tasks.workunit.client.1.smithi156.stdout:2/242: mknod d9/dd/d17/d33/d38/d39/c46 0 2023-12-16T05:56:34.139 INFO:tasks.workunit.client.1.smithi156.stdout:9/209: mknod d6/d19/c4b 0 2023-12-16T05:56:34.141 INFO:tasks.workunit.client.0.smithi155.stdout:9/637: dwrite da/d15/d17/d36/f4d [0,4194304] 0 2023-12-16T05:56:34.147 INFO:tasks.workunit.client.1.smithi156.stdout:9/210: dread d6/d19/d25/f34 [0,4194304] 0 2023-12-16T05:56:34.148 INFO:tasks.workunit.client.1.smithi156.stdout:9/211: creat d6/d19/d25/f4c x:0 0 0 2023-12-16T05:56:34.150 INFO:tasks.workunit.client.1.smithi156.stdout:9/212: mknod d6/d19/c4d 0 2023-12-16T05:56:34.151 INFO:tasks.workunit.client.1.smithi156.stdout:9/213: truncate d6/d19/f2a 3847953 0 2023-12-16T05:56:34.152 INFO:tasks.workunit.client.1.smithi156.stdout:9/214: readlink d6/l11 0 2023-12-16T05:56:34.152 INFO:tasks.workunit.client.0.smithi155.stdout:6/696: rename d0/d3/d2c/db8/fbf to d0/df/d43/fdf 0 2023-12-16T05:56:34.156 INFO:tasks.workunit.client.1.smithi156.stdout:2/243: dwrite d9/dd/d17/f3a [0,4194304] 0 2023-12-16T05:56:34.156 INFO:tasks.workunit.client.0.smithi155.stdout:9/638: symlink da/d15/d17/d24/d26/d2e/d32/ldc 0 2023-12-16T05:56:34.158 INFO:tasks.workunit.client.0.smithi155.stdout:6/697: unlink d0/d3/d7a/c86 0 2023-12-16T05:56:34.159 INFO:tasks.workunit.client.1.smithi156.stdout:2/244: mkdir d9/dd/d17/d33/d47 0 2023-12-16T05:56:34.160 INFO:tasks.workunit.client.1.smithi156.stdout:9/215: dread d6/d19/d30/f3f [0,4194304] 0 2023-12-16T05:56:34.160 INFO:tasks.workunit.client.1.smithi156.stdout:9/216: dread - d6/d19/d25/d3a/f4a zero size 2023-12-16T05:56:34.160 INFO:tasks.workunit.client.1.smithi156.stdout:9/217: read d6/d19/d30/f3f [3815725,96444] 0 2023-12-16T05:56:34.160 INFO:tasks.workunit.client.1.smithi156.stdout:9/218: chown d6/d19/d25/f34 0 1 2023-12-16T05:56:34.161 INFO:tasks.workunit.client.0.smithi155.stdout:6/698: link d0/d3/d7a/d77/lc5 d0/d3/d2c/d8b/d85/le0 0 2023-12-16T05:56:34.161 INFO:tasks.workunit.client.1.smithi156.stdout:9/219: dread d6/d19/f20 [0,4194304] 0 2023-12-16T05:56:34.161 INFO:tasks.workunit.client.1.smithi156.stdout:9/220: fsync d6/d19/d30/f44 0 2023-12-16T05:56:34.162 INFO:tasks.workunit.client.1.smithi156.stdout:9/221: dread - d6/d19/f24 zero size 2023-12-16T05:56:34.162 INFO:tasks.workunit.client.0.smithi155.stdout:6/699: mkdir d0/dbd/de1 0 2023-12-16T05:56:34.162 INFO:tasks.workunit.client.1.smithi156.stdout:2/245: rename d9/f35 to d9/d12/d3d/f48 0 2023-12-16T05:56:34.163 INFO:tasks.workunit.client.0.smithi155.stdout:6/700: getdents d0/df/d5e 0 2023-12-16T05:56:34.163 INFO:tasks.workunit.client.1.smithi156.stdout:9/222: creat d6/d19/d25/d3a/f4e x:0 0 0 2023-12-16T05:56:34.164 INFO:tasks.workunit.client.1.smithi156.stdout:2/246: mkdir d9/dd/d49 0 2023-12-16T05:56:34.164 INFO:tasks.workunit.client.0.smithi155.stdout:6/701: symlink d0/df/le2 0 2023-12-16T05:56:34.167 INFO:tasks.workunit.client.0.smithi155.stdout:3/380: sync 2023-12-16T05:56:34.167 INFO:tasks.workunit.client.0.smithi155.stdout:6/702: mkdir d0/df/d5e/d46/d6d/de3 0 2023-12-16T05:56:34.167 INFO:tasks.workunit.client.1.smithi156.stdout:9/223: mknod d6/c4f 0 2023-12-16T05:56:34.167 INFO:tasks.workunit.client.1.smithi156.stdout:9/224: stat d6/d19/f22 0 2023-12-16T05:56:34.167 INFO:tasks.workunit.client.1.smithi156.stdout:9/225: chown d6/d19/f37 190361 1 2023-12-16T05:56:34.167 INFO:tasks.workunit.client.1.smithi156.stdout:9/226: write d6/d2e/f35 [178797,119381] 0 2023-12-16T05:56:34.167 INFO:tasks.workunit.client.1.smithi156.stdout:9/227: write d6/d19/d30/f44 [208405,113666] 0 2023-12-16T05:56:34.168 INFO:tasks.workunit.client.1.smithi156.stdout:9/228: creat d6/d2e/f50 x:0 0 0 2023-12-16T05:56:34.168 INFO:tasks.workunit.client.1.smithi156.stdout:9/229: stat d6/d19/d30/f39 0 2023-12-16T05:56:34.172 INFO:tasks.workunit.client.0.smithi155.stdout:8/448: sync 2023-12-16T05:56:34.173 INFO:tasks.workunit.client.1.smithi156.stdout:2/247: dread d9/f27 [0,4194304] 0 2023-12-16T05:56:34.173 INFO:tasks.workunit.client.1.smithi156.stdout:2/248: truncate d9/d12/f18 5078073 0 2023-12-16T05:56:34.173 INFO:tasks.workunit.client.1.smithi156.stdout:2/249: fsync d9/dd/f1b 0 2023-12-16T05:56:34.173 INFO:tasks.workunit.client.0.smithi155.stdout:9/639: dwrite da/d15/d17/d36/d5b/d98/fd7 [0,4194304] 0 2023-12-16T05:56:34.174 INFO:tasks.workunit.client.0.smithi155.stdout:8/449: link d4/d62/d66/d78/d88/d1b/d1c/d46/c8a d4/d62/d66/d78/d88/d1b/c8e 0 2023-12-16T05:56:34.175 INFO:tasks.workunit.client.1.smithi156.stdout:2/250: symlink d9/d12/l4a 0 2023-12-16T05:56:34.176 INFO:tasks.workunit.client.0.smithi155.stdout:9/640: creat da/d15/d17/d24/d26/d2e/d83/fdd x:0 0 0 2023-12-16T05:56:34.177 INFO:tasks.workunit.client.0.smithi155.stdout:6/703: dread d0/d3/d7a/db0/dc3/dce/ddd/f7b [0,4194304] 0 2023-12-16T05:56:34.177 INFO:tasks.workunit.client.0.smithi155.stdout:6/704: fdatasync d0/df/d5e/fd5 0 2023-12-16T05:56:34.177 INFO:tasks.workunit.client.0.smithi155.stdout:8/450: write d4/d62/d70/d4f/f63 [2531354,57669] 0 2023-12-16T05:56:34.178 INFO:tasks.workunit.client.0.smithi155.stdout:6/705: rename d0/df/d5e/d99/fc7 to d0/d3/d7a/db0/dc3/dce/ddd/dd4/fe4 0 2023-12-16T05:56:34.180 INFO:tasks.workunit.client.0.smithi155.stdout:8/451: creat d4/d62/d66/d78/d88/d1b/d1c/d46/f8f x:0 0 0 2023-12-16T05:56:34.180 INFO:tasks.workunit.client.0.smithi155.stdout:8/452: truncate d4/d62/d66/d78/d88/d1b/d1c/d46/f89 4643460 0 2023-12-16T05:56:34.180 INFO:tasks.workunit.client.0.smithi155.stdout:8/453: readlink d4/d62/d70/d29/l58 0 2023-12-16T05:56:34.180 INFO:tasks.workunit.client.0.smithi155.stdout:9/641: read da/d15/d17/d36/f4d [2555182,46990] 0 2023-12-16T05:56:34.180 INFO:tasks.workunit.client.0.smithi155.stdout:9/642: dread - da/d15/d17/d24/d26/d2e/d83/d8f/d9c/fa4 zero size 2023-12-16T05:56:34.180 INFO:tasks.workunit.client.0.smithi155.stdout:9/643: truncate da/d15/d17/d24/d62/fbb 1595022 0 2023-12-16T05:56:34.180 INFO:tasks.workunit.client.0.smithi155.stdout:9/644: dread - da/fc6 zero size 2023-12-16T05:56:34.180 INFO:tasks.workunit.client.0.smithi155.stdout:6/706: mkdir d0/df/d43/de5 0 2023-12-16T05:56:34.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:34.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:34.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: Adjusting osd_memory_target on smithi156 to 2592M 2023-12-16T05:56:34.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:34.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:34.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:34.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: Adjusting osd_memory_target on smithi155 to 1568M 2023-12-16T05:56:34.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: pgmap v13: 65 pgs: 65 active+clean; 988 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 60 MiB/s rd, 112 MiB/s wr, 315 op/s 2023-12-16T05:56:34.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:34.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:56:34.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:56:34.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: Updating smithi155:/etc/ceph/ceph.conf 2023-12-16T05:56:34.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:33 smithi156 ceph-mon[121001]: Updating smithi156:/etc/ceph/ceph.conf 2023-12-16T05:56:34.183 INFO:tasks.workunit.client.0.smithi155.stdout:8/454: link d4/d62/d66/d78/d88/d1b/d1c/d46/f8f d4/d62/d66/d78/d88/d1b/d5f/f90 0 2023-12-16T05:56:34.183 INFO:tasks.workunit.client.0.smithi155.stdout:8/455: write d4/d62/d66/d78/d88/d1b/d2a/f39 [3862001,80842] 0 2023-12-16T05:56:34.184 INFO:tasks.workunit.client.0.smithi155.stdout:9/645: symlink da/d15/d17/d36/d5b/lde 0 2023-12-16T05:56:34.184 INFO:tasks.workunit.client.0.smithi155.stdout:6/707: creat d0/dbd/fe6 x:0 0 0 2023-12-16T05:56:34.184 INFO:tasks.workunit.client.0.smithi155.stdout:6/708: write d0/d3/d7a/db0/dc3/dce/ddd/dd4/fe4 [170936,74259] 0 2023-12-16T05:56:34.184 INFO:tasks.workunit.client.0.smithi155.stdout:8/456: symlink d4/d62/l91 0 2023-12-16T05:56:34.184 INFO:tasks.workunit.client.0.smithi155.stdout:8/457: write d4/d62/d66/d78/d88/d1b/d5f/f90 [276323,97273] 0 2023-12-16T05:56:34.184 INFO:tasks.workunit.client.0.smithi155.stdout:9/646: creat da/d15/d17/d36/d5b/d60/fdf x:0 0 0 2023-12-16T05:56:34.185 INFO:tasks.workunit.client.0.smithi155.stdout:6/709: creat d0/df/d5e/d46/d6d/fe7 x:0 0 0 2023-12-16T05:56:34.187 INFO:tasks.workunit.client.0.smithi155.stdout:8/458: rename d4/d62/d70/d29/l5a to d4/d62/d66/d78/d88/d1b/d1c/d1a/l92 0 2023-12-16T05:56:34.188 INFO:tasks.workunit.client.1.smithi156.stdout:9/230: dwrite d6/d19/d30/f39 [0,4194304] 0 2023-12-16T05:56:34.188 INFO:tasks.workunit.client.1.smithi156.stdout:2/251: dread d9/dd/d17/d33/d38/d39/f3e [0,4194304] 0 2023-12-16T05:56:34.188 INFO:tasks.workunit.client.1.smithi156.stdout:2/252: write d9/dd/f2f [4067045,44522] 0 2023-12-16T05:56:34.188 INFO:tasks.workunit.client.1.smithi156.stdout:2/253: rename d9/dd/d17/d33/d38/d39 to d9/dd/d17/d33/d38/d39/d4b 22 2023-12-16T05:56:34.189 INFO:tasks.workunit.client.0.smithi155.stdout:3/381: dwrite d0/d1e/f23 [0,4194304] 0 2023-12-16T05:56:34.189 INFO:tasks.workunit.client.0.smithi155.stdout:9/647: mknod da/d15/d17/d24/ce0 0 2023-12-16T05:56:34.189 INFO:tasks.workunit.client.0.smithi155.stdout:9/648: write da/d15/d17/d24/f8a [650687,24952] 0 2023-12-16T05:56:34.189 INFO:tasks.workunit.client.1.smithi156.stdout:9/231: creat d6/f51 x:0 0 0 2023-12-16T05:56:34.190 INFO:tasks.workunit.client.0.smithi155.stdout:6/710: rename d0/d3/l23 to d0/df/d5e/le8 0 2023-12-16T05:56:34.190 INFO:tasks.workunit.client.0.smithi155.stdout:6/711: truncate d0/d3/d7a/f9c 738502 0 2023-12-16T05:56:34.191 INFO:tasks.workunit.client.1.smithi156.stdout:9/232: getdents d6/d19/d30 0 2023-12-16T05:56:34.191 INFO:tasks.workunit.client.1.smithi156.stdout:9/233: chown d6/d2e/c2f 897764 1 2023-12-16T05:56:34.191 INFO:tasks.workunit.client.0.smithi155.stdout:8/459: symlink d4/d62/d66/d78/d88/d1b/d2a/d5e/l93 0 2023-12-16T05:56:34.192 INFO:tasks.workunit.client.0.smithi155.stdout:3/382: mkdir d0/d14/d36/d47/d70 0 2023-12-16T05:56:34.192 INFO:tasks.workunit.client.0.smithi155.stdout:3/383: readlink d0/d1a/d33/l4d 0 2023-12-16T05:56:34.193 INFO:tasks.workunit.client.1.smithi156.stdout:9/234: creat d6/d2e/f52 x:0 0 0 2023-12-16T05:56:34.193 INFO:tasks.workunit.client.0.smithi155.stdout:9/649: creat da/d15/d17/d24/d26/d2e/fe1 x:0 0 0 2023-12-16T05:56:34.193 INFO:tasks.workunit.client.1.smithi156.stdout:2/254: truncate f2 3365449 0 2023-12-16T05:56:34.194 INFO:tasks.workunit.client.0.smithi155.stdout:8/460: creat d4/d62/d66/d78/d88/d12/f94 x:0 0 0 2023-12-16T05:56:34.195 INFO:tasks.workunit.client.0.smithi155.stdout:8/461: fsync d4/d62/d66/d78/f82 0 2023-12-16T05:56:34.195 INFO:tasks.workunit.client.0.smithi155.stdout:3/384: rmdir d0/d14 39 2023-12-16T05:56:34.197 INFO:tasks.workunit.client.1.smithi156.stdout:2/255: write d9/dd/d17/f3a [2605998,30804] 0 2023-12-16T05:56:34.197 INFO:tasks.workunit.client.1.smithi156.stdout:2/256: stat d9/dd/d17/d33/l32 0 2023-12-16T05:56:34.197 INFO:tasks.workunit.client.1.smithi156.stdout:2/257: write d9/f20 [1336976,117249] 0 2023-12-16T05:56:34.197 INFO:tasks.workunit.client.1.smithi156.stdout:2/258: chown d9/dd/d17/d33/l41 24411228 1 2023-12-16T05:56:34.198 INFO:tasks.workunit.client.0.smithi155.stdout:9/650: unlink da/d15/c37 0 2023-12-16T05:56:34.199 INFO:tasks.workunit.client.0.smithi155.stdout:8/462: mkdir d4/d62/d95 0 2023-12-16T05:56:34.200 INFO:tasks.workunit.client.0.smithi155.stdout:8/463: dread - d4/d62/d66/d78/d88/d1b/d1c/d19/f73 zero size 2023-12-16T05:56:34.200 INFO:tasks.workunit.client.0.smithi155.stdout:3/385: truncate d0/d14/f6a 354034 0 2023-12-16T05:56:34.200 INFO:tasks.workunit.client.0.smithi155.stdout:3/386: fsync d0/d14/f18 0 2023-12-16T05:56:34.203 INFO:tasks.workunit.client.0.smithi155.stdout:9/651: rename da/d15/fac to da/d15/d17/d24/d26/d2e/d32/fe2 0 2023-12-16T05:56:34.205 INFO:tasks.workunit.client.0.smithi155.stdout:8/464: symlink d4/d62/d66/d78/d88/d1b/d1c/l96 0 2023-12-16T05:56:34.206 INFO:tasks.workunit.client.0.smithi155.stdout:9/652: mkdir da/d15/d17/d36/d5b/d60/d9e/de3 0 2023-12-16T05:56:34.207 INFO:tasks.workunit.client.0.smithi155.stdout:6/712: getdents d0/dbd 0 2023-12-16T05:56:34.208 INFO:tasks.workunit.client.1.smithi156.stdout:9/235: dwrite d6/f46 [0,4194304] 0 2023-12-16T05:56:34.209 INFO:tasks.workunit.client.0.smithi155.stdout:9/653: stat da/d15/d17/d36/d5b/d60/d9e/ld6 0 2023-12-16T05:56:34.210 INFO:tasks.workunit.client.0.smithi155.stdout:9/654: chown da/d15/d17/d36/d5b/d60/d9e/fb5 18737 1 2023-12-16T05:56:34.211 INFO:tasks.workunit.client.0.smithi155.stdout:3/387: dread d0/fb [0,4194304] 0 2023-12-16T05:56:34.211 INFO:tasks.workunit.client.0.smithi155.stdout:6/713: mkdir d0/d3/d2c/d8b/d85/da4/de9 0 2023-12-16T05:56:34.213 INFO:tasks.workunit.client.0.smithi155.stdout:8/465: rename d4/d62/d70 to d4/d62/d66/d78/d88/d1b/d1c/d97 0 2023-12-16T05:56:34.214 INFO:tasks.workunit.client.0.smithi155.stdout:9/655: mkdir da/d15/d17/d36/d5b/d60/db9/de4 0 2023-12-16T05:56:34.214 INFO:tasks.workunit.client.0.smithi155.stdout:9/656: write da/d15/d17/d24/f2d [4841401,98774] 0 2023-12-16T05:56:34.216 INFO:tasks.workunit.client.0.smithi155.stdout:3/388: rmdir d0/d1a 39 2023-12-16T05:56:34.219 INFO:tasks.workunit.client.0.smithi155.stdout:6/714: dread d0/d3/d7a/f73 [0,4194304] 0 2023-12-16T05:56:34.219 INFO:tasks.workunit.client.0.smithi155.stdout:6/715: fdatasync d0/f16 0 2023-12-16T05:56:34.228 INFO:tasks.workunit.client.1.smithi156.stdout:9/236: dwrite d6/d19/d25/d3a/f43 [0,4194304] 0 2023-12-16T05:56:34.229 INFO:tasks.workunit.client.0.smithi155.stdout:8/466: rename d4/d62/d66/d78/d88/d1b/d2a/d5e/c7e to d4/d62/d66/d78/d88/d1b/d2a/d51/c98 0 2023-12-16T05:56:34.229 INFO:tasks.workunit.client.0.smithi155.stdout:8/467: getdents d4/d62/d95 0 2023-12-16T05:56:34.230 INFO:tasks.workunit.client.1.smithi156.stdout:9/237: symlink d6/d19/d30/d48/l53 0 2023-12-16T05:56:34.230 INFO:tasks.workunit.client.1.smithi156.stdout:9/238: truncate d6/d2e/f52 801530 0 2023-12-16T05:56:34.232 INFO:tasks.workunit.client.1.smithi156.stdout:9/239: creat d6/d19/d30/f54 x:0 0 0 2023-12-16T05:56:34.232 INFO:tasks.workunit.client.1.smithi156.stdout:9/240: fdatasync d6/d2e/f52 0 2023-12-16T05:56:34.232 INFO:tasks.workunit.client.1.smithi156.stdout:9/241: truncate d6/d19/d30/f44 864419 0 2023-12-16T05:56:34.233 INFO:tasks.workunit.client.1.smithi156.stdout:9/242: truncate d6/f51 506034 0 2023-12-16T05:56:34.233 INFO:tasks.workunit.client.0.smithi155.stdout:9/657: link l5 da/d15/d17/d36/d5b/d98/le5 0 2023-12-16T05:56:34.233 INFO:tasks.workunit.client.0.smithi155.stdout:9/658: write da/d15/d17/f9a [372846,16027] 0 2023-12-16T05:56:34.233 INFO:tasks.workunit.client.0.smithi155.stdout:6/716: mkdir d0/d3/d7a/db0/dc3/dce/ddd/d1b/dea 0 2023-12-16T05:56:34.235 INFO:tasks.workunit.client.0.smithi155.stdout:8/468: mknod d4/d62/d66/c99 0 2023-12-16T05:56:34.235 INFO:tasks.workunit.client.1.smithi156.stdout:9/243: dread d6/f13 [0,4194304] 0 2023-12-16T05:56:34.235 INFO:tasks.workunit.client.1.smithi156.stdout:9/244: dread - d6/d19/d25/f3c zero size 2023-12-16T05:56:34.235 INFO:tasks.workunit.client.1.smithi156.stdout:9/245: chown d6/d19/d25/d3a/f43 334145483 1 2023-12-16T05:56:34.237 INFO:tasks.workunit.client.0.smithi155.stdout:6/717: mkdir d0/df/d5e/d7e/deb 0 2023-12-16T05:56:34.238 INFO:tasks.workunit.client.0.smithi155.stdout:3/389: dwrite d0/d1e/f20 [4194304,4194304] 0 2023-12-16T05:56:34.239 INFO:tasks.workunit.client.0.smithi155.stdout:6/718: mknod d0/d3/d2c/d8b/d85/cec 0 2023-12-16T05:56:34.239 INFO:tasks.workunit.client.1.smithi156.stdout:9/246: dread d6/d19/d30/f3f [0,4194304] 0 2023-12-16T05:56:34.240 INFO:tasks.workunit.client.1.smithi156.stdout:9/247: chown d6/d19/l1d 0 1 2023-12-16T05:56:34.240 INFO:tasks.workunit.client.1.smithi156.stdout:9/248: read - d6/d19/d25/f4c zero size 2023-12-16T05:56:34.241 INFO:tasks.workunit.client.1.smithi156.stdout:9/249: creat d6/d19/d25/f55 x:0 0 0 2023-12-16T05:56:34.242 INFO:tasks.workunit.client.0.smithi155.stdout:8/469: write d4/d62/d66/d78/d88/d1b/d1c/d1a/f2d [2233984,21403] 0 2023-12-16T05:56:34.242 INFO:tasks.workunit.client.0.smithi155.stdout:8/470: fdatasync d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/f60 0 2023-12-16T05:56:34.242 INFO:tasks.workunit.client.0.smithi155.stdout:8/471: truncate d4/d62/d66/d78/d88/d1b/d2a/d5e/f72 681545 0 2023-12-16T05:56:34.242 INFO:tasks.workunit.client.0.smithi155.stdout:8/472: chown d4/d62/d66/d78/d88/d1b/d1c/d46/c8a 1 1 2023-12-16T05:56:34.242 INFO:tasks.workunit.client.0.smithi155.stdout:6/719: rename d0/d3/d7a/db0/dc3/dce/ddd/d1b/f22 to d0/df/d5e/d46/d6d/de3/fed 0 2023-12-16T05:56:34.244 INFO:tasks.workunit.client.1.smithi156.stdout:9/250: rename d6/d19/d25/f55 to d6/d19/f56 0 2023-12-16T05:56:34.245 INFO:tasks.workunit.client.1.smithi156.stdout:9/251: mkdir d6/d19/d25/d3a/d57 0 2023-12-16T05:56:34.245 INFO:tasks.workunit.client.1.smithi156.stdout:9/252: stat d6/d19/d25 0 2023-12-16T05:56:34.245 INFO:tasks.workunit.client.1.smithi156.stdout:9/253: stat d6/d19/f1f 0 2023-12-16T05:56:34.245 INFO:tasks.workunit.client.1.smithi156.stdout:9/254: chown d6/d19/d25/l2b 5841433 1 2023-12-16T05:56:34.246 INFO:tasks.workunit.client.0.smithi155.stdout:6/720: creat d0/d3/d7a/db0/dc3/fee x:0 0 0 2023-12-16T05:56:34.247 INFO:tasks.workunit.client.0.smithi155.stdout:9/659: dwrite da/d15/d17/d24/f64 [4194304,4194304] 0 2023-12-16T05:56:34.249 INFO:tasks.workunit.client.0.smithi155.stdout:9/660: write da/d15/f66 [2283268,111408] 0 2023-12-16T05:56:34.249 INFO:tasks.workunit.client.0.smithi155.stdout:9/661: truncate da/d15/d17/d24/d26/d2e/fe1 691761 0 2023-12-16T05:56:34.252 INFO:tasks.workunit.client.0.smithi155.stdout:3/390: dread d0/d1a/f1d [4194304,4194304] 0 2023-12-16T05:56:34.252 INFO:tasks.workunit.client.0.smithi155.stdout:6/721: mkdir d0/d3/d7a/db0/dc3/dce/ddd/d1b/dea/def 0 2023-12-16T05:56:34.252 INFO:tasks.workunit.client.0.smithi155.stdout:6/722: write d0/df/d5e/d7e/db6/dc6/fd0 [556112,119244] 0 2023-12-16T05:56:34.254 INFO:tasks.workunit.client.0.smithi155.stdout:9/662: creat da/d15/d17/d24/d26/d2e/d32/db7/fe6 x:0 0 0 2023-12-16T05:56:34.254 INFO:tasks.workunit.client.0.smithi155.stdout:1/604: sync 2023-12-16T05:56:34.254 INFO:tasks.workunit.client.0.smithi155.stdout:8/473: truncate d4/d62/d66/d78/d88/d1b/d1c/d46/f89 318814 0 2023-12-16T05:56:34.258 INFO:tasks.workunit.client.0.smithi155.stdout:9/663: mkdir da/d15/d17/d36/d5b/de7 0 2023-12-16T05:56:34.258 INFO:tasks.workunit.client.0.smithi155.stdout:9/664: dread - da/d15/d17/d36/d54/f7f zero size 2023-12-16T05:56:34.259 INFO:tasks.workunit.client.1.smithi156.stdout:4/190: sync 2023-12-16T05:56:34.259 INFO:tasks.workunit.client.1.smithi156.stdout:8/151: sync 2023-12-16T05:56:34.259 INFO:tasks.workunit.client.1.smithi156.stdout:1/116: sync 2023-12-16T05:56:34.259 INFO:tasks.workunit.client.1.smithi156.stdout:3/199: sync 2023-12-16T05:56:34.259 INFO:tasks.workunit.client.1.smithi156.stdout:3/200: fsync dc/d10/f18 0 2023-12-16T05:56:34.260 INFO:tasks.workunit.client.0.smithi155.stdout:1/605: mknod d1/cc0 0 2023-12-16T05:56:34.260 INFO:tasks.workunit.client.0.smithi155.stdout:1/606: write d1/d17/d28/f93 [544029,45112] 0 2023-12-16T05:56:34.261 INFO:tasks.workunit.client.0.smithi155.stdout:8/474: truncate d4/d62/d66/d78/d88/d1b/d1c/d19/f38 2310753 0 2023-12-16T05:56:34.261 INFO:tasks.workunit.client.1.smithi156.stdout:4/191: link d9/d2b/f33 d9/f37 0 2023-12-16T05:56:34.262 INFO:tasks.workunit.client.1.smithi156.stdout:8/152: dread d3/d18/f1f [0,4194304] 0 2023-12-16T05:56:34.263 INFO:tasks.workunit.client.0.smithi155.stdout:3/391: link d0/d1a/c4c d0/d14/d36/d47/c71 0 2023-12-16T05:56:34.263 INFO:tasks.workunit.client.1.smithi156.stdout:3/201: rmdir dc/d10/d3d 39 2023-12-16T05:56:34.264 INFO:tasks.workunit.client.0.smithi155.stdout:9/665: creat da/d15/d17/d36/d5b/d98/fe8 x:0 0 0 2023-12-16T05:56:34.265 INFO:tasks.workunit.client.1.smithi156.stdout:4/192: rename d9/fc to d9/f38 0 2023-12-16T05:56:34.265 INFO:tasks.workunit.client.1.smithi156.stdout:4/193: chown d9/f15 0 1 2023-12-16T05:56:34.266 INFO:tasks.workunit.client.0.smithi155.stdout:1/607: unlink d1/d17/d28/d8f/fa4 0 2023-12-16T05:56:34.267 INFO:tasks.workunit.client.0.smithi155.stdout:8/475: truncate d4/d62/d66/d78/d88/d1b/d1c/d97/f59 2012 0 2023-12-16T05:56:34.267 INFO:tasks.workunit.client.0.smithi155.stdout:8/476: truncate d4/d62/d66/d78/d88/d12/f6b 1027747 0 2023-12-16T05:56:34.269 INFO:tasks.workunit.client.0.smithi155.stdout:3/392: creat d0/d1a/d33/f72 x:0 0 0 2023-12-16T05:56:34.270 INFO:tasks.workunit.client.1.smithi156.stdout:1/117: dread d3/f6 [0,4194304] 0 2023-12-16T05:56:34.270 INFO:tasks.workunit.client.1.smithi156.stdout:1/118: readlink l2 0 2023-12-16T05:56:34.270 INFO:tasks.workunit.client.0.smithi155.stdout:6/723: dwrite d0/f16 [0,4194304] 0 2023-12-16T05:56:34.271 INFO:tasks.workunit.client.1.smithi156.stdout:8/153: write d3/d12/f25 [1156463,40363] 0 2023-12-16T05:56:34.271 INFO:tasks.workunit.client.0.smithi155.stdout:9/666: mkdir da/d15/d17/d24/d62/d91/dc0/de9 0 2023-12-16T05:56:34.271 INFO:tasks.workunit.client.1.smithi156.stdout:1/119: creat d3/d1b/f25 x:0 0 0 2023-12-16T05:56:34.272 INFO:tasks.workunit.client.1.smithi156.stdout:1/120: stat d3/d1b/l1d 0 2023-12-16T05:56:34.273 INFO:tasks.workunit.client.0.smithi155.stdout:1/608: creat d1/d69/fc1 x:0 0 0 2023-12-16T05:56:34.276 INFO:tasks.workunit.client.0.smithi155.stdout:8/477: mknod d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/c9a 0 2023-12-16T05:56:34.276 INFO:tasks.workunit.client.0.smithi155.stdout:9/667: dread da/d15/d17/d36/d5b/f71 [0,4194304] 0 2023-12-16T05:56:34.279 INFO:tasks.workunit.client.1.smithi156.stdout:8/154: unlink d3/d18/f1f 0 2023-12-16T05:56:34.279 INFO:tasks.workunit.client.0.smithi155.stdout:3/393: mkdir d0/d1e/d6f/d73 0 2023-12-16T05:56:34.281 INFO:tasks.workunit.client.1.smithi156.stdout:8/155: creat d3/d7/d9/f33 x:0 0 0 2023-12-16T05:56:34.282 INFO:tasks.workunit.client.0.smithi155.stdout:6/724: creat d0/d3/d7a/db0/dc3/dce/ddd/ff0 x:0 0 0 2023-12-16T05:56:34.282 INFO:tasks.workunit.client.0.smithi155.stdout:6/725: write d0/df/d5e/d46/f65 [760072,38249] 0 2023-12-16T05:56:34.282 INFO:tasks.workunit.client.0.smithi155.stdout:6/726: fdatasync d0/d3/d2c/d3e/f9f 0 2023-12-16T05:56:34.282 INFO:tasks.workunit.client.1.smithi156.stdout:8/156: link d3/d7/d9/c30 d3/d7/c34 0 2023-12-16T05:56:34.284 INFO:tasks.workunit.client.1.smithi156.stdout:8/157: symlink d3/d12/d16/l35 0 2023-12-16T05:56:34.286 INFO:tasks.workunit.client.1.smithi156.stdout:4/194: dwrite d9/f28 [0,4194304] 0 2023-12-16T05:56:34.288 INFO:tasks.workunit.client.0.smithi155.stdout:1/609: getdents d1/d17/d28/d74 0 2023-12-16T05:56:34.288 INFO:tasks.workunit.client.0.smithi155.stdout:1/610: readlink d1/d17/d28/l42 0 2023-12-16T05:56:34.289 INFO:tasks.workunit.client.1.smithi156.stdout:4/195: symlink d9/d2b/d35/l39 0 2023-12-16T05:56:34.289 INFO:tasks.workunit.client.1.smithi156.stdout:4/196: readlink d9/d2b/d35/l39 0 2023-12-16T05:56:34.289 INFO:tasks.workunit.client.1.smithi156.stdout:4/197: chown d9/f21 576660 1 2023-12-16T05:56:34.291 INFO:tasks.workunit.client.0.smithi155.stdout:6/727: read d0/d3/d7a/f73 [4653963,79252] 0 2023-12-16T05:56:34.293 INFO:tasks.workunit.client.1.smithi156.stdout:8/158: dread d3/d18/f22 [0,4194304] 0 2023-12-16T05:56:34.293 INFO:tasks.workunit.client.1.smithi156.stdout:8/159: fsync d3/d6/f5 0 2023-12-16T05:56:34.295 INFO:tasks.workunit.client.0.smithi155.stdout:8/478: dread d4/d62/d66/d78/d88/d1b/d1c/d1a/f2d [0,4194304] 0 2023-12-16T05:56:34.297 INFO:tasks.workunit.client.1.smithi156.stdout:8/160: link d3/d12/d16/f2d d3/d6/f36 0 2023-12-16T05:56:34.297 INFO:tasks.workunit.client.1.smithi156.stdout:4/198: dread d9/fa [0,4194304] 0 2023-12-16T05:56:34.298 INFO:tasks.workunit.client.1.smithi156.stdout:4/199: symlink d9/d2c/l3a 0 2023-12-16T05:56:34.298 INFO:tasks.workunit.client.1.smithi156.stdout:4/200: fdatasync d9/d2c/f32 0 2023-12-16T05:56:34.298 INFO:tasks.workunit.client.1.smithi156.stdout:3/202: dwrite dc/f23 [0,4194304] 0 2023-12-16T05:56:34.298 INFO:tasks.workunit.client.1.smithi156.stdout:3/203: readlink dc/d10/d3d/l48 0 2023-12-16T05:56:34.299 INFO:tasks.workunit.client.1.smithi156.stdout:8/161: write d3/f8 [884237,53317] 0 2023-12-16T05:56:34.301 INFO:tasks.workunit.client.0.smithi155.stdout:8/479: dread d4/d62/d66/d78/d88/d1b/d1c/d1a/f2d [0,4194304] 0 2023-12-16T05:56:34.301 INFO:tasks.workunit.client.0.smithi155.stdout:1/611: mknod d1/d92/cc2 0 2023-12-16T05:56:34.302 INFO:tasks.workunit.client.1.smithi156.stdout:3/204: mkdir dc/d10/d1d/d4b 0 2023-12-16T05:56:34.304 INFO:tasks.workunit.client.1.smithi156.stdout:3/205: dread dc/d10/d1d/f33 [0,4194304] 0 2023-12-16T05:56:34.304 INFO:tasks.workunit.client.1.smithi156.stdout:3/206: stat dc/df 0 2023-12-16T05:56:34.304 INFO:tasks.workunit.client.1.smithi156.stdout:3/207: readlink l9 0 2023-12-16T05:56:34.304 INFO:tasks.workunit.client.0.smithi155.stdout:8/480: read d4/d62/d66/d78/d88/d1b/d1c/d1a/f2c [6040195,23606] 0 2023-12-16T05:56:34.304 INFO:tasks.workunit.client.0.smithi155.stdout:6/728: creat d0/d3/d7a/db0/dc3/ff1 x:0 0 0 2023-12-16T05:56:34.305 INFO:tasks.workunit.client.1.smithi156.stdout:3/208: write dc/d10/f11 [2452336,47651] 0 2023-12-16T05:56:34.305 INFO:tasks.workunit.client.0.smithi155.stdout:1/612: symlink d1/d7/d4b/d8e/dbc/lc3 0 2023-12-16T05:56:34.307 INFO:tasks.workunit.client.1.smithi156.stdout:8/162: link d3/d7/c34 d3/d7/d27/c37 0 2023-12-16T05:56:34.307 INFO:tasks.workunit.client.1.smithi156.stdout:8/163: truncate d3/f8 4638027 0 2023-12-16T05:56:34.309 INFO:tasks.workunit.client.0.smithi155.stdout:1/613: symlink d1/d7/d16/d30/lc4 0 2023-12-16T05:56:34.320 INFO:tasks.workunit.client.0.smithi155.stdout:3/394: dwrite d0/d1e/f32 [0,4194304] 0 2023-12-16T05:56:34.321 INFO:tasks.workunit.client.1.smithi156.stdout:1/121: dwrite d3/f16 [4194304,4194304] 0 2023-12-16T05:56:34.321 INFO:tasks.workunit.client.0.smithi155.stdout:8/481: dread d4/f42 [0,4194304] 0 2023-12-16T05:56:34.321 INFO:tasks.workunit.client.0.smithi155.stdout:8/482: stat d4/d62/d66/d78/d88/d1b/d1c/d1a/f3a 0 2023-12-16T05:56:34.321 INFO:tasks.workunit.client.0.smithi155.stdout:8/483: chown d4/d62/d66/d78/d88/d1b/d2a/f39 1350415785 1 2023-12-16T05:56:34.321 INFO:tasks.workunit.client.0.smithi155.stdout:8/484: write d4/d62/d66/d78/d88/d1b/d1c/d97/f8c [26730,62320] 0 2023-12-16T05:56:34.323 INFO:tasks.workunit.client.0.smithi155.stdout:3/395: rename d0/d1a/d33/d57/c5d to d0/d1e/d6f/d73/c74 0 2023-12-16T05:56:34.326 INFO:tasks.workunit.client.0.smithi155.stdout:6/729: dread d0/d3/d7a/d77/f83 [4194304,4194304] 0 2023-12-16T05:56:34.327 INFO:tasks.workunit.client.0.smithi155.stdout:3/396: creat d0/d14/d45/f75 x:0 0 0 2023-12-16T05:56:34.327 INFO:tasks.workunit.client.0.smithi155.stdout:8/485: symlink d4/d62/d66/d78/d80/l9b 0 2023-12-16T05:56:34.327 INFO:tasks.workunit.client.0.smithi155.stdout:9/668: dwrite da/d15/d17/d24/d62/d91/fd0 [0,4194304] 0 2023-12-16T05:56:34.328 INFO:tasks.workunit.client.0.smithi155.stdout:6/730: creat d0/df/d5e/d7e/db6/ff2 x:0 0 0 2023-12-16T05:56:34.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:34.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:34.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: Adjusting osd_memory_target on smithi156 to 2592M 2023-12-16T05:56:34.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:34.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:34.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:34.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T05:56:34.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: Adjusting osd_memory_target on smithi155 to 1568M 2023-12-16T05:56:34.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: pgmap v13: 65 pgs: 65 active+clean; 988 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 60 MiB/s rd, 112 MiB/s wr, 315 op/s 2023-12-16T05:56:34.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:34.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:56:34.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:56:34.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: Updating smithi155:/etc/ceph/ceph.conf 2023-12-16T05:56:34.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:33 smithi155 ceph-mon[112451]: Updating smithi156:/etc/ceph/ceph.conf 2023-12-16T05:56:34.332 INFO:tasks.workunit.client.0.smithi155.stdout:3/397: mkdir d0/d1e/d6f/d73/d76 0 2023-12-16T05:56:34.332 INFO:tasks.workunit.client.0.smithi155.stdout:8/486: creat d4/d62/d66/d78/d88/d1b/d1c/d97/d29/f9c x:0 0 0 2023-12-16T05:56:34.334 INFO:tasks.workunit.client.0.smithi155.stdout:6/731: link d0/df/d5e/f66 d0/df/d43/de5/ff3 0 2023-12-16T05:56:34.334 INFO:tasks.workunit.client.0.smithi155.stdout:9/669: mkdir da/d15/d17/d24/d62/dea 0 2023-12-16T05:56:34.334 INFO:tasks.workunit.client.0.smithi155.stdout:9/670: getdents da/d15/d17/d36/d5b/d98/dc2 0 2023-12-16T05:56:34.334 INFO:tasks.workunit.client.0.smithi155.stdout:9/671: fsync da/d15/d17/d24/d26/f29 0 2023-12-16T05:56:34.334 INFO:tasks.workunit.client.0.smithi155.stdout:9/672: write da/d15/d17/fd8 [388948,29626] 0 2023-12-16T05:56:34.334 INFO:tasks.workunit.client.0.smithi155.stdout:9/673: stat da/d15/d17/d24/f64 0 2023-12-16T05:56:34.335 INFO:tasks.workunit.client.0.smithi155.stdout:3/398: mknod d0/d1a/d33/c77 0 2023-12-16T05:56:34.338 INFO:tasks.workunit.client.0.smithi155.stdout:9/674: symlink da/d15/d17/d36/d5b/d60/d9e/de3/leb 0 2023-12-16T05:56:34.339 INFO:tasks.workunit.client.0.smithi155.stdout:8/487: mknod d4/d62/d95/c9d 0 2023-12-16T05:56:34.339 INFO:tasks.workunit.client.0.smithi155.stdout:8/488: write d4/ff [834893,19349] 0 2023-12-16T05:56:34.343 INFO:tasks.workunit.client.1.smithi156.stdout:3/209: dwrite dc/f25 [0,4194304] 0 2023-12-16T05:56:34.344 INFO:tasks.workunit.client.1.smithi156.stdout:3/210: creat dc/f4c x:0 0 0 2023-12-16T05:56:34.346 INFO:tasks.workunit.client.0.smithi155.stdout:8/489: dread d4/d62/d66/d78/d88/d1b/d2a/f39 [0,4194304] 0 2023-12-16T05:56:34.349 INFO:tasks.workunit.client.0.smithi155.stdout:8/490: rmdir d4/d62/d66/d78/d88/d12 39 2023-12-16T05:56:34.349 INFO:tasks.workunit.client.1.smithi156.stdout:4/201: dwrite d9/d2c/f2f [0,4194304] 0 2023-12-16T05:56:34.352 INFO:tasks.workunit.client.0.smithi155.stdout:3/399: write d0/d14/f28 [3312738,24538] 0 2023-12-16T05:56:34.352 INFO:tasks.workunit.client.0.smithi155.stdout:8/491: mkdir d4/d62/d66/d78/d88/d9e 0 2023-12-16T05:56:34.352 INFO:tasks.workunit.client.0.smithi155.stdout:1/614: dwrite d1/d17/d28/d8f/db2/fbe [4194304,4194304] 0 2023-12-16T05:56:34.352 INFO:tasks.workunit.client.0.smithi155.stdout:1/615: fsync d1/d7/f5a 0 2023-12-16T05:56:34.353 INFO:tasks.workunit.client.1.smithi156.stdout:1/122: dwrite d3/f15 [0,4194304] 0 2023-12-16T05:56:34.353 INFO:tasks.workunit.client.1.smithi156.stdout:4/202: unlink d9/fa 0 2023-12-16T05:56:34.354 INFO:tasks.workunit.client.0.smithi155.stdout:8/492: rename d4/d62/d66/d78/d88/d1b/d1c/l84 to d4/d62/d66/d78/d88/d1b/d2a/d51/l9f 0 2023-12-16T05:56:34.355 INFO:tasks.workunit.client.0.smithi155.stdout:1/616: mkdir d1/d17/d28/d74/dc5 0 2023-12-16T05:56:34.355 INFO:tasks.workunit.client.0.smithi155.stdout:1/617: stat d1/cc0 0 2023-12-16T05:56:34.355 INFO:tasks.workunit.client.0.smithi155.stdout:1/618: write d1/d17/d28/d74/faf [1424455,51240] 0 2023-12-16T05:56:34.355 INFO:tasks.workunit.client.0.smithi155.stdout:1/619: stat d1/d17/d28/d8f/f96 0 2023-12-16T05:56:34.357 INFO:tasks.workunit.client.1.smithi156.stdout:4/203: symlink d9/l3b 0 2023-12-16T05:56:34.357 INFO:tasks.workunit.client.1.smithi156.stdout:4/204: readlink d9/d2b/d35/l39 0 2023-12-16T05:56:34.359 INFO:tasks.workunit.client.0.smithi155.stdout:9/675: dwrite da/d15/d17/d24/d62/f68 [0,4194304] 0 2023-12-16T05:56:34.359 INFO:tasks.workunit.client.0.smithi155.stdout:8/493: link d4/d62/d66/d78/d88/d1b/l47 d4/d62/d66/d78/d88/d1b/la0 0 2023-12-16T05:56:34.359 INFO:tasks.workunit.client.0.smithi155.stdout:8/494: chown d4/d62/d66/d78/d88/d1b/d1c/d1a/f3f 11468797 1 2023-12-16T05:56:34.359 INFO:tasks.workunit.client.1.smithi156.stdout:4/205: creat d9/d2b/f3c x:0 0 0 2023-12-16T05:56:34.360 INFO:tasks.workunit.client.0.smithi155.stdout:1/620: creat d1/d7/d4b/fc6 x:0 0 0 2023-12-16T05:56:34.364 INFO:tasks.workunit.client.0.smithi155.stdout:8/495: rename d4/d62/d66/d78/d88/d1b/f76 to d4/d62/d66/d78/d88/d1b/d1c/d97/fa1 0 2023-12-16T05:56:34.371 INFO:tasks.workunit.client.0.smithi155.stdout:9/676: dread da/d15/d17/d36/d5b/fcf [0,4194304] 0 2023-12-16T05:56:34.371 INFO:tasks.workunit.client.0.smithi155.stdout:9/677: write da/d15/d17/d24/d26/d2e/f8e [1110922,76647] 0 2023-12-16T05:56:34.371 INFO:tasks.workunit.client.0.smithi155.stdout:9/678: readlink da/d15/d17/d24/d62/d91/dc0/lc9 0 2023-12-16T05:56:34.374 INFO:tasks.workunit.client.0.smithi155.stdout:9/679: mkdir da/dec 0 2023-12-16T05:56:34.381 INFO:tasks.workunit.client.1.smithi156.stdout:8/164: dwrite d3/d12/f25 [0,4194304] 0 2023-12-16T05:56:34.381 INFO:tasks.workunit.client.1.smithi156.stdout:8/165: readlink d3/l21 0 2023-12-16T05:56:34.382 INFO:tasks.workunit.client.1.smithi156.stdout:8/166: rmdir d3/d7/d27 39 2023-12-16T05:56:34.382 INFO:tasks.workunit.client.1.smithi156.stdout:8/167: dread - d3/d7/d27/f32 zero size 2023-12-16T05:56:34.382 INFO:tasks.workunit.client.1.smithi156.stdout:1/123: dwrite d3/f15 [0,4194304] 0 2023-12-16T05:56:34.383 INFO:tasks.workunit.client.0.smithi155.stdout:1/621: rename d1/d17 to d1/d7/d4b/d8e/dc7 0 2023-12-16T05:56:34.383 INFO:tasks.workunit.client.0.smithi155.stdout:1/622: dread - d1/d7/d4b/d8e/dc7/d28/f9f zero size 2023-12-16T05:56:34.384 INFO:tasks.workunit.client.1.smithi156.stdout:4/206: dwrite d9/d2c/f32 [0,4194304] 0 2023-12-16T05:56:34.384 INFO:tasks.workunit.client.1.smithi156.stdout:1/124: creat d3/d17/d19/f26 x:0 0 0 2023-12-16T05:56:34.384 INFO:tasks.workunit.client.1.smithi156.stdout:1/125: stat d3/fb 0 2023-12-16T05:56:34.385 INFO:tasks.workunit.client.0.smithi155.stdout:9/680: rename da/d15/d17/d36/d5b/de7 to da/d15/d17/d24/d26/d2e/d32/ded 0 2023-12-16T05:56:34.385 INFO:tasks.workunit.client.1.smithi156.stdout:8/168: dread d3/d18/f22 [0,4194304] 0 2023-12-16T05:56:34.386 INFO:tasks.workunit.client.1.smithi156.stdout:4/207: mknod d9/d2b/c3d 0 2023-12-16T05:56:34.386 INFO:tasks.workunit.client.0.smithi155.stdout:1/623: dread d1/d7/d4b/d8e/dc7/d28/f93 [0,4194304] 0 2023-12-16T05:56:34.387 INFO:tasks.workunit.client.1.smithi156.stdout:8/169: rmdir d3/d18 39 2023-12-16T05:56:34.387 INFO:tasks.workunit.client.1.smithi156.stdout:8/170: write d3/d6/f5 [1042636,27132] 0 2023-12-16T05:56:34.387 INFO:tasks.workunit.client.0.smithi155.stdout:3/400: truncate d0/d1e/f32 1383075 0 2023-12-16T05:56:34.388 INFO:tasks.workunit.client.1.smithi156.stdout:4/208: rmdir d9/d2b/d35 39 2023-12-16T05:56:34.388 INFO:tasks.workunit.client.1.smithi156.stdout:8/171: dread d3/ff [0,4194304] 0 2023-12-16T05:56:34.389 INFO:tasks.workunit.client.0.smithi155.stdout:9/681: rename da/d15/d17/cca to da/d15/cee 0 2023-12-16T05:56:34.389 INFO:tasks.workunit.client.0.smithi155.stdout:9/682: write da/d15/d17/d24/d26/fd5 [768144,17732] 0 2023-12-16T05:56:34.389 INFO:tasks.workunit.client.0.smithi155.stdout:9/683: write da/d15/d17/d24/f2d [5839363,60764] 0 2023-12-16T05:56:34.390 INFO:tasks.workunit.client.0.smithi155.stdout:1/624: mkdir d1/d25/dc8 0 2023-12-16T05:56:34.391 INFO:tasks.workunit.client.1.smithi156.stdout:4/209: rename d9/f1c to d9/d2c/f3e 0 2023-12-16T05:56:34.391 INFO:tasks.workunit.client.1.smithi156.stdout:1/126: rmdir d3/d17/d19 39 2023-12-16T05:56:34.391 INFO:tasks.workunit.client.1.smithi156.stdout:1/127: chown d3/c9 0 1 2023-12-16T05:56:34.392 INFO:tasks.workunit.client.0.smithi155.stdout:3/401: getdents d0/d1e 0 2023-12-16T05:56:34.392 INFO:tasks.workunit.client.0.smithi155.stdout:3/402: chown d0/d14/d45/f54 2994486 1 2023-12-16T05:56:34.392 INFO:tasks.workunit.client.1.smithi156.stdout:4/210: creat d9/d2b/d35/f3f x:0 0 0 2023-12-16T05:56:34.393 INFO:tasks.workunit.client.1.smithi156.stdout:1/128: mkdir d3/d1b/d27 0 2023-12-16T05:56:34.393 INFO:tasks.workunit.client.1.smithi156.stdout:6/255: sync 2023-12-16T05:56:34.393 INFO:tasks.workunit.client.1.smithi156.stdout:0/217: sync 2023-12-16T05:56:34.393 INFO:tasks.workunit.client.1.smithi156.stdout:5/395: sync 2023-12-16T05:56:34.393 INFO:tasks.workunit.client.1.smithi156.stdout:6/256: dread - d9/d1c/f46 zero size 2023-12-16T05:56:34.393 INFO:tasks.workunit.client.1.smithi156.stdout:0/218: fsync d2/d7/dd/d1c/f25 0 2023-12-16T05:56:34.394 INFO:tasks.workunit.client.1.smithi156.stdout:4/211: link d9/f16 d9/d2b/f40 0 2023-12-16T05:56:34.395 INFO:tasks.workunit.client.1.smithi156.stdout:1/129: creat d3/d17/d1c/f28 x:0 0 0 2023-12-16T05:56:34.396 INFO:tasks.workunit.client.1.smithi156.stdout:5/396: mkdir da/dc/d4b/d6c/d77 0 2023-12-16T05:56:34.396 INFO:tasks.workunit.client.1.smithi156.stdout:5/397: fsync da/dc/d2d/f58 0 2023-12-16T05:56:34.397 INFO:tasks.workunit.client.0.smithi155.stdout:9/684: rename da/d15/d17/d36/d5b/d98/faf to da/d15/d17/d36/dc1/fef 0 2023-12-16T05:56:34.397 INFO:tasks.workunit.client.1.smithi156.stdout:0/219: creat d2/d7/dd/d1c/f36 x:0 0 0 2023-12-16T05:56:34.398 INFO:tasks.workunit.client.1.smithi156.stdout:5/398: write da/dc/f15 [4042406,53275] 0 2023-12-16T05:56:34.398 INFO:tasks.workunit.client.1.smithi156.stdout:5/399: readlink da/dc/l5c 0 2023-12-16T05:56:34.398 INFO:tasks.workunit.client.1.smithi156.stdout:4/212: mknod d9/d2b/c41 0 2023-12-16T05:56:34.398 INFO:tasks.workunit.client.0.smithi155.stdout:1/625: rename d1/d7/d4b/d8e/dc7/d28/d85/fa8 to d1/d7/d4b/d8e/dc7/d28/d85/fc9 0 2023-12-16T05:56:34.399 INFO:tasks.workunit.client.1.smithi156.stdout:5/400: dread da/f68 [0,4194304] 0 2023-12-16T05:56:34.399 INFO:tasks.workunit.client.1.smithi156.stdout:5/401: truncate da/f68 643871 0 2023-12-16T05:56:34.399 INFO:tasks.workunit.client.1.smithi156.stdout:5/402: chown da/dc/d2d/d4d/d54/f5d 3978 1 2023-12-16T05:56:34.399 INFO:tasks.workunit.client.1.smithi156.stdout:0/220: symlink d2/d7/dd/d1c/l37 0 2023-12-16T05:56:34.400 INFO:tasks.workunit.client.1.smithi156.stdout:1/130: write d3/f6 [21607,100160] 0 2023-12-16T05:56:34.400 INFO:tasks.workunit.client.1.smithi156.stdout:4/213: creat d9/f42 x:0 0 0 2023-12-16T05:56:34.400 INFO:tasks.workunit.client.1.smithi156.stdout:5/403: symlink da/dc/d4b/d6c/d77/l78 0 2023-12-16T05:56:34.400 INFO:tasks.workunit.client.0.smithi155.stdout:3/403: creat d0/d1a/f78 x:0 0 0 2023-12-16T05:56:34.400 INFO:tasks.workunit.client.0.smithi155.stdout:9/685: mknod da/dec/cf0 0 2023-12-16T05:56:34.401 INFO:tasks.workunit.client.0.smithi155.stdout:9/686: chown da/d15/d17/l59 5 1 2023-12-16T05:56:34.401 INFO:tasks.workunit.client.1.smithi156.stdout:0/221: mkdir d2/d7/dd/d29/d38 0 2023-12-16T05:56:34.402 INFO:tasks.workunit.client.1.smithi156.stdout:1/131: creat d3/d1b/d27/f29 x:0 0 0 2023-12-16T05:56:34.402 INFO:tasks.workunit.client.0.smithi155.stdout:1/626: chown d1/d7/d16/c44 13592 1 2023-12-16T05:56:34.402 INFO:tasks.workunit.client.0.smithi155.stdout:1/627: chown d1/d7/d16/d30 332641 1 2023-12-16T05:56:34.402 INFO:tasks.workunit.client.0.smithi155.stdout:1/628: truncate d1/d25/fb5 825709 0 2023-12-16T05:56:34.404 INFO:tasks.workunit.client.0.smithi155.stdout:9/687: unlink da/d15/d17/d24/d62/fbb 0 2023-12-16T05:56:34.404 INFO:tasks.workunit.client.1.smithi156.stdout:4/214: mkdir d9/d43 0 2023-12-16T05:56:34.404 INFO:tasks.workunit.client.1.smithi156.stdout:4/215: getdents d9/d43 0 2023-12-16T05:56:34.406 INFO:tasks.workunit.client.0.smithi155.stdout:1/629: mknod d1/d7/d4b/d72/d79/daa/cca 0 2023-12-16T05:56:34.406 INFO:tasks.workunit.client.0.smithi155.stdout:1/630: dread - d1/d7/d4b/fc6 zero size 2023-12-16T05:56:34.406 INFO:tasks.workunit.client.0.smithi155.stdout:1/631: chown d1/d7/d4b/d8e/dc7/c91 274 1 2023-12-16T05:56:34.407 INFO:tasks.workunit.client.0.smithi155.stdout:9/688: symlink da/d15/d17/d36/d5b/d98/dc2/lf1 0 2023-12-16T05:56:34.407 INFO:tasks.workunit.client.0.smithi155.stdout:9/689: dread - da/d15/d17/d36/d5b/d60/d9e/fa5 zero size 2023-12-16T05:56:34.408 INFO:tasks.workunit.client.0.smithi155.stdout:1/632: creat d1/d25/d43/fcb x:0 0 0 2023-12-16T05:56:34.409 INFO:tasks.workunit.client.0.smithi155.stdout:1/633: read - d1/d7/d4b/d8e/dc7/d28/d8f/dad/fb1 zero size 2023-12-16T05:56:34.409 INFO:tasks.workunit.client.0.smithi155.stdout:1/634: write d1/d25/d43/f60 [4941208,36324] 0 2023-12-16T05:56:34.409 INFO:tasks.workunit.client.1.smithi156.stdout:0/222: mknod d2/c39 0 2023-12-16T05:56:34.409 INFO:tasks.workunit.client.1.smithi156.stdout:4/216: unlink d9/l1a 0 2023-12-16T05:56:34.411 INFO:tasks.workunit.client.0.smithi155.stdout:9/690: getdents da/d15/d17/d36/d54 0 2023-12-16T05:56:34.412 INFO:tasks.workunit.client.1.smithi156.stdout:0/223: creat d2/d7/dd/d29/d2e/f3a x:0 0 0 2023-12-16T05:56:34.412 INFO:tasks.workunit.client.1.smithi156.stdout:0/224: fsync d2/d7/f18 0 2023-12-16T05:56:34.413 INFO:tasks.workunit.client.0.smithi155.stdout:1/635: rmdir d1/d25 39 2023-12-16T05:56:34.413 INFO:tasks.workunit.client.1.smithi156.stdout:8/172: dwrite d3/d12/f25 [0,4194304] 0 2023-12-16T05:56:34.413 INFO:tasks.workunit.client.1.smithi156.stdout:4/217: read d9/d2c/f2d [373253,110449] 0 2023-12-16T05:56:34.414 INFO:tasks.workunit.client.0.smithi155.stdout:9/691: write da/f10 [4182668,28293] 0 2023-12-16T05:56:34.415 INFO:tasks.workunit.client.0.smithi155.stdout:1/636: dread d1/d7/d4b/d8e/dc7/d28/d74/fa3 [0,4194304] 0 2023-12-16T05:56:34.415 INFO:tasks.workunit.client.0.smithi155.stdout:1/637: fdatasync d1/d7/d4b/d72/d79/f9d 0 2023-12-16T05:56:34.415 INFO:tasks.workunit.client.1.smithi156.stdout:8/173: rmdir d3/d7/d9/d2f 0 2023-12-16T05:56:34.416 INFO:tasks.workunit.client.1.smithi156.stdout:8/174: fsync d3/d6/f5 0 2023-12-16T05:56:34.416 INFO:tasks.workunit.client.1.smithi156.stdout:4/218: creat d9/d43/f44 x:0 0 0 2023-12-16T05:56:34.416 INFO:tasks.workunit.client.0.smithi155.stdout:9/692: dread da/f5a [0,4194304] 0 2023-12-16T05:56:34.417 INFO:tasks.workunit.client.0.smithi155.stdout:9/693: chown da/d15/d17/d36/d5b/d60/db9/de4 2021 1 2023-12-16T05:56:34.417 INFO:tasks.workunit.client.1.smithi156.stdout:8/175: truncate d3/ff 135464 0 2023-12-16T05:56:34.419 INFO:tasks.workunit.client.0.smithi155.stdout:1/638: fsync d1/d7/d16/f3a 0 2023-12-16T05:56:34.421 INFO:tasks.workunit.client.1.smithi156.stdout:5/404: dwrite da/f36 [0,4194304] 0 2023-12-16T05:56:34.423 INFO:tasks.workunit.client.0.smithi155.stdout:3/404: dwrite d0/d14/d36/f3d [0,4194304] 0 2023-12-16T05:56:34.424 INFO:tasks.workunit.client.1.smithi156.stdout:5/405: symlink da/dc/d2d/d34/l79 0 2023-12-16T05:56:34.426 INFO:tasks.workunit.client.1.smithi156.stdout:5/406: link da/d46/f70 da/dc/d4b/d6c/f7a 0 2023-12-16T05:56:34.426 INFO:tasks.workunit.client.0.smithi155.stdout:3/405: mkdir d0/d14/d36/d79 0 2023-12-16T05:56:34.426 INFO:tasks.workunit.client.0.smithi155.stdout:3/406: write d0/f2e [5050958,114278] 0 2023-12-16T05:56:34.427 INFO:tasks.workunit.client.0.smithi155.stdout:3/407: rmdir d0/d1e/d6f 39 2023-12-16T05:56:34.428 INFO:tasks.workunit.client.0.smithi155.stdout:3/408: chown d0/d14/f5e 1 1 2023-12-16T05:56:34.428 INFO:tasks.workunit.client.0.smithi155.stdout:3/409: dread - d0/d1a/f78 zero size 2023-12-16T05:56:34.428 INFO:tasks.workunit.client.1.smithi156.stdout:5/407: rename da/dc/d4b/d6c/d77/l78 to da/dc/d2d/d4d/d54/d67/l7b 0 2023-12-16T05:56:34.432 INFO:tasks.workunit.client.0.smithi155.stdout:3/410: creat d0/d1e/d6f/f7a x:0 0 0 2023-12-16T05:56:34.432 INFO:tasks.workunit.client.0.smithi155.stdout:3/411: stat d0/c2 0 2023-12-16T05:56:34.434 INFO:tasks.workunit.client.0.smithi155.stdout:3/412: mknod d0/d1a/d33/c7b 0 2023-12-16T05:56:34.435 INFO:tasks.workunit.client.0.smithi155.stdout:3/413: truncate d0/f11 970086 0 2023-12-16T05:56:34.437 INFO:tasks.workunit.client.0.smithi155.stdout:3/414: rename d0/d14/d36/d47/d70 to d0/d14/d36/d7c 0 2023-12-16T05:56:34.437 INFO:tasks.workunit.client.0.smithi155.stdout:3/415: dread - d0/d1e/d6f/f7a zero size 2023-12-16T05:56:34.439 INFO:tasks.workunit.client.0.smithi155.stdout:3/416: rename d0/d14/f34 to d0/d14/d36/d47/d5f/f7d 0 2023-12-16T05:56:34.439 INFO:tasks.workunit.client.0.smithi155.stdout:3/417: readlink d0/l5 0 2023-12-16T05:56:34.440 INFO:tasks.workunit.client.0.smithi155.stdout:3/418: mknod d0/d14/d36/d7c/c7e 0 2023-12-16T05:56:34.440 INFO:tasks.workunit.client.0.smithi155.stdout:3/419: write d0/d1a/d33/d57/f6c [1022560,97801] 0 2023-12-16T05:56:34.442 INFO:tasks.workunit.client.0.smithi155.stdout:3/420: creat d0/f7f x:0 0 0 2023-12-16T05:56:34.443 INFO:tasks.workunit.client.1.smithi156.stdout:5/408: dread da/dc/d4b/f64 [0,4194304] 0 2023-12-16T05:56:34.446 INFO:tasks.workunit.client.1.smithi156.stdout:5/409: rename da/dc/d5f to da/dc/d4b/d6c/d7c 0 2023-12-16T05:56:34.448 INFO:tasks.workunit.client.1.smithi156.stdout:5/410: getdents da/d46 0 2023-12-16T05:56:34.448 INFO:tasks.workunit.client.1.smithi156.stdout:5/411: write da/f50 [587672,40438] 0 2023-12-16T05:56:34.451 INFO:tasks.workunit.client.0.smithi155.stdout:1/639: dread d1/d7/d4b/d72/f7d [4194304,4194304] 0 2023-12-16T05:56:34.452 INFO:tasks.workunit.client.1.smithi156.stdout:4/219: getdents d9/d43 0 2023-12-16T05:56:34.452 INFO:tasks.workunit.client.0.smithi155.stdout:1/640: write d1/d69/f8a [6445305,118238] 0 2023-12-16T05:56:34.452 INFO:tasks.workunit.client.0.smithi155.stdout:1/641: truncate d1/d7/d4b/d72/d7e/fae 598342 0 2023-12-16T05:56:34.454 INFO:tasks.workunit.client.0.smithi155.stdout:1/642: getdents d1/d7/d4b/d8e/dc7/d28/d8f 0 2023-12-16T05:56:34.458 INFO:tasks.workunit.client.1.smithi156.stdout:5/412: write f0 [2720122,96481] 0 2023-12-16T05:56:34.459 INFO:tasks.workunit.client.1.smithi156.stdout:5/413: unlink da/dc/f15 0 2023-12-16T05:56:34.459 INFO:tasks.workunit.client.1.smithi156.stdout:5/414: dread - da/dc/d2d/d4d/d54/f5d zero size 2023-12-16T05:56:34.460 INFO:tasks.workunit.client.0.smithi155.stdout:1/643: write d1/d7/d16/fa7 [1895194,26787] 0 2023-12-16T05:56:34.461 INFO:tasks.workunit.client.1.smithi156.stdout:5/415: link l8 da/dc/d2d/d4d/d54/l7d 0 2023-12-16T05:56:34.461 INFO:tasks.workunit.client.1.smithi156.stdout:1/132: dwrite d3/fb [0,4194304] 0 2023-12-16T05:56:34.461 INFO:tasks.workunit.client.0.smithi155.stdout:1/644: getdents d1/d69 0 2023-12-16T05:56:34.462 INFO:tasks.workunit.client.1.smithi156.stdout:5/416: creat da/dc/d2d/f7e x:0 0 0 2023-12-16T05:56:34.462 INFO:tasks.workunit.client.1.smithi156.stdout:5/417: fdatasync da/dc/f2e 0 2023-12-16T05:56:34.464 INFO:tasks.workunit.client.1.smithi156.stdout:1/133: creat d3/d17/d19/f2a x:0 0 0 2023-12-16T05:56:34.464 INFO:tasks.workunit.client.1.smithi156.stdout:0/225: dwrite d2/d7/dd/d1c/f25 [0,4194304] 0 2023-12-16T05:56:34.465 INFO:tasks.workunit.client.0.smithi155.stdout:9/694: dwrite da/d15/d17/d36/d5b/d60/f77 [0,4194304] 0 2023-12-16T05:56:34.465 INFO:tasks.workunit.client.0.smithi155.stdout:9/695: write da/d15/d17/f9a [633287,52976] 0 2023-12-16T05:56:34.466 INFO:tasks.workunit.client.1.smithi156.stdout:8/176: dwrite d3/f8 [0,4194304] 0 2023-12-16T05:56:34.466 INFO:tasks.workunit.client.1.smithi156.stdout:8/177: write d3/d7/d9/f2a [580379,93445] 0 2023-12-16T05:56:34.466 INFO:tasks.workunit.client.1.smithi156.stdout:8/178: read - d3/d7/f31 zero size 2023-12-16T05:56:34.466 INFO:tasks.workunit.client.1.smithi156.stdout:1/134: creat d3/d17/d1c/f2b x:0 0 0 2023-12-16T05:56:34.466 INFO:tasks.workunit.client.1.smithi156.stdout:1/135: chown d3/d17/d1c/c23 15134604 1 2023-12-16T05:56:34.467 INFO:tasks.workunit.client.1.smithi156.stdout:0/226: creat d2/d23/f3b x:0 0 0 2023-12-16T05:56:34.467 INFO:tasks.workunit.client.1.smithi156.stdout:0/227: stat d2/d23/f3b 0 2023-12-16T05:56:34.467 INFO:tasks.workunit.client.1.smithi156.stdout:0/228: dread - d2/d7/dd/f33 zero size 2023-12-16T05:56:34.470 INFO:tasks.workunit.client.0.smithi155.stdout:3/421: dwrite d0/f10 [4194304,4194304] 0 2023-12-16T05:56:34.470 INFO:tasks.workunit.client.0.smithi155.stdout:9/696: mkdir da/d15/d17/d24/d26/d2e/d83/d8f/df2 0 2023-12-16T05:56:34.470 INFO:tasks.workunit.client.1.smithi156.stdout:0/229: write d2/d7/dd/f19 [1722242,59143] 0 2023-12-16T05:56:34.471 INFO:tasks.workunit.client.1.smithi156.stdout:0/230: creat d2/d7/f3c x:0 0 0 2023-12-16T05:56:34.473 INFO:tasks.workunit.client.1.smithi156.stdout:1/136: read d3/f14 [2959385,121741] 0 2023-12-16T05:56:34.473 INFO:tasks.workunit.client.1.smithi156.stdout:4/220: dwrite d9/f24 [0,4194304] 0 2023-12-16T05:56:34.474 INFO:tasks.workunit.client.0.smithi155.stdout:9/697: unlink da/d15/d17/d36/f4d 0 2023-12-16T05:56:34.474 INFO:tasks.workunit.client.0.smithi155.stdout:9/698: read - da/d15/d17/d36/fa1 zero size 2023-12-16T05:56:34.476 INFO:tasks.workunit.client.1.smithi156.stdout:0/231: write d2/d23/f32 [66977,66209] 0 2023-12-16T05:56:34.476 INFO:tasks.workunit.client.1.smithi156.stdout:5/418: dread da/dc/f21 [0,4194304] 0 2023-12-16T05:56:34.477 INFO:tasks.workunit.client.1.smithi156.stdout:1/137: symlink d3/d1b/d27/l2c 0 2023-12-16T05:56:34.477 INFO:tasks.workunit.client.1.smithi156.stdout:1/138: chown d3/f16 7 1 2023-12-16T05:56:34.477 INFO:tasks.workunit.client.1.smithi156.stdout:1/139: write d3/d17/d1c/f2b [285737,36803] 0 2023-12-16T05:56:34.477 INFO:tasks.workunit.client.1.smithi156.stdout:1/140: dread - d3/d1b/d27/f29 zero size 2023-12-16T05:56:34.481 INFO:tasks.workunit.client.0.smithi155.stdout:9/699: unlink da/d15/d17/d36/c74 0 2023-12-16T05:56:34.482 INFO:tasks.workunit.client.0.smithi155.stdout:9/700: mknod da/d15/d17/d24/d62/d91/dc0/de9/cf3 0 2023-12-16T05:56:34.482 INFO:tasks.workunit.client.0.smithi155.stdout:9/701: stat da/d15/d17/d24/d26/d2e/d32/db7/cba 0 2023-12-16T05:56:34.484 INFO:tasks.workunit.client.1.smithi156.stdout:5/419: rmdir da/dc/d4b 39 2023-12-16T05:56:34.484 INFO:tasks.workunit.client.1.smithi156.stdout:0/232: dread d2/f24 [0,4194304] 0 2023-12-16T05:56:34.484 INFO:tasks.workunit.client.0.smithi155.stdout:3/422: rename d0/d1e/d6f to d0/d14/d36/d79/d80 0 2023-12-16T05:56:34.486 INFO:tasks.workunit.client.0.smithi155.stdout:7/516: sync 2023-12-16T05:56:34.486 INFO:tasks.workunit.client.1.smithi156.stdout:5/420: link da/dc/d2d/d34/l79 da/dc/d4b/d6c/d7c/d62/l7f 0 2023-12-16T05:56:34.488 INFO:tasks.workunit.client.1.smithi156.stdout:8/179: dwrite d3/d12/d16/f2d [0,4194304] 0 2023-12-16T05:56:34.489 INFO:tasks.workunit.client.1.smithi156.stdout:5/421: creat da/dc/d4b/d6c/d7c/d62/f80 x:0 0 0 2023-12-16T05:56:34.493 INFO:tasks.workunit.client.0.smithi155.stdout:3/423: mkdir d0/d1e/d4e/d81 0 2023-12-16T05:56:34.495 INFO:tasks.workunit.client.0.smithi155.stdout:1/645: dwrite d1/d7/d16/d30/f76 [4194304,4194304] 0 2023-12-16T05:56:34.497 INFO:tasks.workunit.client.0.smithi155.stdout:9/702: rename da/d15/d17/d24/d62/d91/dc0/de9/cf3 to da/d15/d17/d24/d26/d2e/d83/d8f/d9c/cf4 0 2023-12-16T05:56:34.498 INFO:tasks.workunit.client.1.smithi156.stdout:5/422: dread da/dc/f19 [0,4194304] 0 2023-12-16T05:56:34.501 INFO:tasks.workunit.client.0.smithi155.stdout:3/424: rmdir d0/d14/d36/d79 39 2023-12-16T05:56:34.501 INFO:tasks.workunit.client.0.smithi155.stdout:3/425: readlink d0/d1e/l69 0 2023-12-16T05:56:34.501 INFO:tasks.workunit.client.0.smithi155.stdout:1/646: mknod d1/d25/ccc 0 2023-12-16T05:56:34.503 INFO:tasks.workunit.client.1.smithi156.stdout:0/233: getdents d2/d7 0 2023-12-16T05:56:34.504 INFO:tasks.workunit.client.0.smithi155.stdout:1/647: stat d1/d25/c3b 0 2023-12-16T05:56:34.504 INFO:tasks.workunit.client.0.smithi155.stdout:1/648: truncate d1/d25/d43/f77 819870 0 2023-12-16T05:56:34.504 INFO:tasks.workunit.client.0.smithi155.stdout:1/649: getdents d1/d7/d4b/d8e/dc7/d28/d8f 0 2023-12-16T05:56:34.505 INFO:tasks.workunit.client.1.smithi156.stdout:0/234: rename d2/d7/f15 to d2/f3d 0 2023-12-16T05:56:34.508 INFO:tasks.workunit.client.1.smithi156.stdout:0/235: creat d2/d7/dd/d29/d38/f3e x:0 0 0 2023-12-16T05:56:34.509 INFO:tasks.workunit.client.0.smithi155.stdout:3/426: dread d0/d14/f5e [4194304,4194304] 0 2023-12-16T05:56:34.510 INFO:tasks.workunit.client.1.smithi156.stdout:1/141: dwrite d3/f14 [0,4194304] 0 2023-12-16T05:56:34.511 INFO:tasks.workunit.client.1.smithi156.stdout:0/236: mkdir d2/d7/dd/d29/d38/d3f 0 2023-12-16T05:56:34.511 INFO:tasks.workunit.client.1.smithi156.stdout:4/221: dwrite d9/f21 [0,4194304] 0 2023-12-16T05:56:34.515 INFO:tasks.workunit.client.1.smithi156.stdout:0/237: mkdir d2/d7/dd/d29/d2e/d40 0 2023-12-16T05:56:34.515 INFO:tasks.workunit.client.1.smithi156.stdout:1/142: mkdir d3/d17/d2d 0 2023-12-16T05:56:34.515 INFO:tasks.workunit.client.0.smithi155.stdout:3/427: write d0/d14/f28 [352888,62155] 0 2023-12-16T05:56:34.515 INFO:tasks.workunit.client.0.smithi155.stdout:9/703: dread da/d15/d17/d24/d62/f68 [0,4194304] 0 2023-12-16T05:56:34.515 INFO:tasks.workunit.client.0.smithi155.stdout:9/704: truncate da/f14 1544488 0 2023-12-16T05:56:34.516 INFO:tasks.workunit.client.0.smithi155.stdout:3/428: creat d0/d14/d36/f82 x:0 0 0 2023-12-16T05:56:34.517 INFO:tasks.workunit.client.0.smithi155.stdout:3/429: getdents d0/d1e/d4e/d81 0 2023-12-16T05:56:34.517 INFO:tasks.workunit.client.1.smithi156.stdout:1/143: rmdir d3/d1b/d27 39 2023-12-16T05:56:34.518 INFO:tasks.workunit.client.0.smithi155.stdout:3/430: mkdir d0/d14/d36/d83 0 2023-12-16T05:56:34.519 INFO:tasks.workunit.client.1.smithi156.stdout:1/144: creat d3/d17/d19/f2e x:0 0 0 2023-12-16T05:56:34.520 INFO:tasks.workunit.client.0.smithi155.stdout:3/431: creat d0/d14/d36/d79/d80/d73/f84 x:0 0 0 2023-12-16T05:56:34.520 INFO:tasks.workunit.client.0.smithi155.stdout:3/432: readlink d0/d1e/l69 0 2023-12-16T05:56:34.520 INFO:tasks.workunit.client.0.smithi155.stdout:3/433: dread - d0/d14/f65 zero size 2023-12-16T05:56:34.521 INFO:tasks.workunit.client.0.smithi155.stdout:3/434: truncate d0/d14/d36/d47/d5f/f7d 697873 0 2023-12-16T05:56:34.522 INFO:tasks.workunit.client.1.smithi156.stdout:1/145: stat d3/f5 0 2023-12-16T05:56:34.522 INFO:tasks.workunit.client.1.smithi156.stdout:0/238: dread d2/f28 [0,4194304] 0 2023-12-16T05:56:34.523 INFO:tasks.workunit.client.0.smithi155.stdout:3/435: unlink d0/d14/d36/d47/c6d 0 2023-12-16T05:56:34.523 INFO:tasks.workunit.client.1.smithi156.stdout:0/239: creat d2/d7/dd/f41 x:0 0 0 2023-12-16T05:56:34.523 INFO:tasks.workunit.client.1.smithi156.stdout:0/240: fsync d2/d7/dd/f1f 0 2023-12-16T05:56:34.524 INFO:tasks.workunit.client.1.smithi156.stdout:0/241: dread - d2/d7/dd/d29/d2e/f3a zero size 2023-12-16T05:56:34.524 INFO:tasks.workunit.client.1.smithi156.stdout:0/242: chown d2 5 1 2023-12-16T05:56:34.529 INFO:tasks.workunit.client.1.smithi156.stdout:0/243: write d2/f3d [842722,19220] 0 2023-12-16T05:56:34.530 INFO:tasks.workunit.client.0.smithi155.stdout:7/517: dwrite d0/d1/f24 [4194304,4194304] 0 2023-12-16T05:56:34.531 INFO:tasks.workunit.client.0.smithi155.stdout:7/518: symlink d0/d6a/d1a/d8c/d42/d98/db1/lb3 0 2023-12-16T05:56:34.531 INFO:tasks.workunit.client.1.smithi156.stdout:0/244: rename d2/d7/dd/d29/d2e/c2f to d2/d7/dd/d29/d38/c42 0 2023-12-16T05:56:34.532 INFO:tasks.workunit.client.1.smithi156.stdout:0/245: creat d2/f43 x:0 0 0 2023-12-16T05:56:34.532 INFO:tasks.workunit.client.1.smithi156.stdout:1/146: dread d3/f14 [0,4194304] 0 2023-12-16T05:56:34.533 INFO:tasks.workunit.client.1.smithi156.stdout:0/246: mkdir d2/d7/dd/d29/d38/d3f/d44 0 2023-12-16T05:56:34.534 INFO:tasks.workunit.client.1.smithi156.stdout:1/147: creat d3/d17/d1c/f2f x:0 0 0 2023-12-16T05:56:34.534 INFO:tasks.workunit.client.1.smithi156.stdout:8/180: dwrite d3/d18/f1b [0,4194304] 0 2023-12-16T05:56:34.535 INFO:tasks.workunit.client.1.smithi156.stdout:1/148: readlink d3/l13 0 2023-12-16T05:56:34.535 INFO:tasks.workunit.client.1.smithi156.stdout:1/149: readlink l2 0 2023-12-16T05:56:34.537 INFO:tasks.workunit.client.0.smithi155.stdout:3/436: dread d0/f12 [8388608,4194304] 0 2023-12-16T05:56:34.537 INFO:tasks.workunit.client.1.smithi156.stdout:8/181: rmdir d3/d7/d9 39 2023-12-16T05:56:34.537 INFO:tasks.workunit.client.1.smithi156.stdout:8/182: stat d3/d6/c1e 0 2023-12-16T05:56:34.537 INFO:tasks.workunit.client.1.smithi156.stdout:8/183: fsync d3/d7/f2c 0 2023-12-16T05:56:34.537 INFO:tasks.workunit.client.1.smithi156.stdout:8/184: write d3/f29 [390988,47597] 0 2023-12-16T05:56:34.541 INFO:tasks.workunit.client.0.smithi155.stdout:3/437: mknod d0/d1a/c85 0 2023-12-16T05:56:34.544 INFO:tasks.workunit.client.0.smithi155.stdout:3/438: link d0/d1e/c25 d0/d14/d36/d47/d5f/c86 0 2023-12-16T05:56:34.545 INFO:tasks.workunit.client.1.smithi156.stdout:8/185: symlink d3/d7/d9/l38 0 2023-12-16T05:56:34.545 INFO:tasks.workunit.client.0.smithi155.stdout:3/439: rmdir d0/d14/d36/d79/d80/d73/d76 0 2023-12-16T05:56:34.546 INFO:tasks.workunit.client.0.smithi155.stdout:3/440: mkdir d0/d14/d87 0 2023-12-16T05:56:34.547 INFO:tasks.workunit.client.1.smithi156.stdout:8/186: link d3/d7/f2c d3/d18/f39 0 2023-12-16T05:56:34.548 INFO:tasks.workunit.client.0.smithi155.stdout:9/705: dwrite da/d15/d17/d24/d26/d2e/f87 [0,4194304] 0 2023-12-16T05:56:34.548 INFO:tasks.workunit.client.0.smithi155.stdout:9/706: write da/d15/d17/d36/d5b/d60/db9/fdb [193835,124901] 0 2023-12-16T05:56:34.548 INFO:tasks.workunit.client.0.smithi155.stdout:9/707: readlink da/d15/d17/d36/l7b 0 2023-12-16T05:56:34.548 INFO:tasks.workunit.client.0.smithi155.stdout:9/708: truncate da/d15/d17/d36/d5b/fa6 875013 0 2023-12-16T05:56:34.548 INFO:tasks.workunit.client.0.smithi155.stdout:3/441: creat d0/d1e/d4e/f88 x:0 0 0 2023-12-16T05:56:34.548 INFO:tasks.workunit.client.1.smithi156.stdout:8/187: creat d3/d12/d16/f3a x:0 0 0 2023-12-16T05:56:34.548 INFO:tasks.workunit.client.1.smithi156.stdout:0/247: dread d2/d7/dd/d1c/f25 [0,4194304] 0 2023-12-16T05:56:34.549 INFO:tasks.workunit.client.1.smithi156.stdout:5/423: dwrite da/dc/f2c [0,4194304] 0 2023-12-16T05:56:34.550 INFO:tasks.workunit.client.0.smithi155.stdout:9/709: mknod da/d15/d17/d36/d5b/d60/db9/de4/cf5 0 2023-12-16T05:56:34.550 INFO:tasks.workunit.client.0.smithi155.stdout:9/710: fdatasync da/d15/d17/d24/d26/d2e/d83/fdd 0 2023-12-16T05:56:34.552 INFO:tasks.workunit.client.1.smithi156.stdout:4/222: dwrite d9/d2b/f31 [0,4194304] 0 2023-12-16T05:56:34.552 INFO:tasks.workunit.client.1.smithi156.stdout:0/248: write f0 [2418490,77727] 0 2023-12-16T05:56:34.552 INFO:tasks.workunit.client.0.smithi155.stdout:3/442: creat d0/d14/d36/f89 x:0 0 0 2023-12-16T05:56:34.552 INFO:tasks.workunit.client.0.smithi155.stdout:1/650: dwrite d1/f1e [0,4194304] 0 2023-12-16T05:56:34.554 INFO:tasks.workunit.client.0.smithi155.stdout:9/711: creat da/d15/d17/d24/ff6 x:0 0 0 2023-12-16T05:56:34.554 INFO:tasks.workunit.client.0.smithi155.stdout:7/519: dwrite d0/d6a/d1a/d8c/d34/d4b/f51 [0,4194304] 0 2023-12-16T05:56:34.557 INFO:tasks.workunit.client.0.smithi155.stdout:1/651: mknod d1/d25/ccd 0 2023-12-16T05:56:34.558 INFO:tasks.workunit.client.1.smithi156.stdout:1/150: dwrite d3/d17/d1c/f28 [0,4194304] 0 2023-12-16T05:56:34.563 INFO:tasks.workunit.client.0.smithi155.stdout:3/443: dread d0/f55 [0,4194304] 0 2023-12-16T05:56:34.565 INFO:tasks.workunit.client.0.smithi155.stdout:9/712: dread da/d15/d17/d36/d5b/f61 [0,4194304] 0 2023-12-16T05:56:34.569 INFO:tasks.workunit.client.1.smithi156.stdout:4/223: symlink d9/d2b/d35/l45 0 2023-12-16T05:56:34.569 INFO:tasks.workunit.client.0.smithi155.stdout:7/520: mkdir d0/d1/db4 0 2023-12-16T05:56:34.570 INFO:tasks.workunit.client.1.smithi156.stdout:5/424: rename da/dc/d4b/d6c/d7c/d62 to da/dc/d4b/d6c/d81 0 2023-12-16T05:56:34.570 INFO:tasks.workunit.client.0.smithi155.stdout:1/652: rmdir d1/d7/d4b/d72/d79/daa 39 2023-12-16T05:56:34.570 INFO:tasks.workunit.client.0.smithi155.stdout:1/653: chown d1/f2a 112226029 1 2023-12-16T05:56:34.571 INFO:tasks.workunit.client.1.smithi156.stdout:1/151: dread d3/f15 [0,4194304] 0 2023-12-16T05:56:34.572 INFO:tasks.workunit.client.0.smithi155.stdout:3/444: mknod d0/d14/d36/d47/d5f/c8a 0 2023-12-16T05:56:34.572 INFO:tasks.workunit.client.0.smithi155.stdout:3/445: write d0/d14/d36/d79/d80/d73/f84 [819651,118095] 0 2023-12-16T05:56:34.572 INFO:tasks.workunit.client.0.smithi155.stdout:3/446: chown d0/d1a 235208 1 2023-12-16T05:56:34.573 INFO:tasks.workunit.client.1.smithi156.stdout:5/425: symlink da/dc/d2d/d34/l82 0 2023-12-16T05:56:34.574 INFO:tasks.workunit.client.0.smithi155.stdout:9/713: creat da/d15/d17/d36/dc1/ff7 x:0 0 0 2023-12-16T05:56:34.576 INFO:tasks.workunit.client.0.smithi155.stdout:9/714: write da/d15/d17/d24/d26/d2e/f8e [995299,71491] 0 2023-12-16T05:56:34.576 INFO:tasks.workunit.client.0.smithi155.stdout:9/715: write da/d15/d17/d36/dc1/ff7 [773243,76607] 0 2023-12-16T05:56:34.576 INFO:tasks.workunit.client.0.smithi155.stdout:9/716: write da/d15/d17/d36/d5b/d98/fc7 [260379,23549] 0 2023-12-16T05:56:34.577 INFO:tasks.workunit.client.1.smithi156.stdout:0/249: rename d2/d7/dd/f1f to d2/d7/dd/d29/d38/d3f/d44/f45 0 2023-12-16T05:56:34.577 INFO:tasks.workunit.client.1.smithi156.stdout:0/250: write d2/d7/dd/d29/d2e/f3a [654896,5778] 0 2023-12-16T05:56:34.577 INFO:tasks.workunit.client.1.smithi156.stdout:1/152: symlink d3/d17/l30 0 2023-12-16T05:56:34.577 INFO:tasks.workunit.client.1.smithi156.stdout:1/153: readlink d3/d1b/d27/l2c 0 2023-12-16T05:56:34.579 INFO:tasks.workunit.client.1.smithi156.stdout:5/426: truncate da/d46/f4f 126697 0 2023-12-16T05:56:34.580 INFO:tasks.workunit.client.1.smithi156.stdout:0/251: creat d2/d7/dd/d29/d2e/d40/f46 x:0 0 0 2023-12-16T05:56:34.582 INFO:tasks.workunit.client.1.smithi156.stdout:1/154: creat d3/d17/d1c/f31 x:0 0 0 2023-12-16T05:56:34.582 INFO:tasks.workunit.client.1.smithi156.stdout:4/224: dread d9/f24 [0,4194304] 0 2023-12-16T05:56:34.584 INFO:tasks.workunit.client.1.smithi156.stdout:5/427: creat da/dc/d4b/d6c/d81/f83 x:0 0 0 2023-12-16T05:56:34.587 INFO:tasks.workunit.client.0.smithi155.stdout:7/521: mknod d0/d6a/d1a/cb5 0 2023-12-16T05:56:34.588 INFO:tasks.workunit.client.1.smithi156.stdout:4/225: unlink d9/d2b/d35/l39 0 2023-12-16T05:56:34.590 INFO:tasks.workunit.client.0.smithi155.stdout:7/522: write d0/d6a/d1a/d8c/d42/f93 [359835,96093] 0 2023-12-16T05:56:34.590 INFO:tasks.workunit.client.1.smithi156.stdout:5/428: mknod da/c84 0 2023-12-16T05:56:34.590 INFO:tasks.workunit.client.1.smithi156.stdout:5/429: stat l9 0 2023-12-16T05:56:34.591 INFO:tasks.workunit.client.1.smithi156.stdout:4/226: mknod d9/d43/c46 0 2023-12-16T05:56:34.593 INFO:tasks.workunit.client.1.smithi156.stdout:5/430: mkdir da/dc/d4b/d6c/d7c/d85 0 2023-12-16T05:56:34.595 INFO:tasks.workunit.client.1.smithi156.stdout:4/227: rename d9/c2a to d9/c47 0 2023-12-16T05:56:34.602 INFO:tasks.workunit.client.1.smithi156.stdout:5/431: mknod da/dc/d4b/d6c/d77/c86 0 2023-12-16T05:56:34.602 INFO:tasks.workunit.client.1.smithi156.stdout:5/432: truncate da/dc/d2d/d4d/d54/d67/f6d 893683 0 2023-12-16T05:56:34.607 INFO:tasks.workunit.client.1.smithi156.stdout:4/228: dread d9/f15 [0,4194304] 0 2023-12-16T05:56:34.624 INFO:tasks.workunit.client.0.smithi155.stdout:9/717: dwrite da/d15/f5e [0,4194304] 0 2023-12-16T05:56:34.624 INFO:tasks.workunit.client.0.smithi155.stdout:1/654: dwrite d1/d7/d16/fa7 [0,4194304] 0 2023-12-16T05:56:34.625 INFO:tasks.workunit.client.0.smithi155.stdout:7/523: dwrite d0/d6a/d1a/d8c/d34/d4b/f7f [0,4194304] 0 2023-12-16T05:56:34.625 INFO:tasks.workunit.client.1.smithi156.stdout:1/155: dwrite d3/f5 [0,4194304] 0 2023-12-16T05:56:34.626 INFO:tasks.workunit.client.0.smithi155.stdout:9/718: creat da/d15/d17/d36/dc1/ff8 x:0 0 0 2023-12-16T05:56:34.628 INFO:tasks.workunit.client.0.smithi155.stdout:7/524: rename d0/d6a/d1a/f72 to d0/d6a/d1a/d8c/d34/d4b/fb6 0 2023-12-16T05:56:34.629 INFO:tasks.workunit.client.0.smithi155.stdout:7/525: dread - d0/d6a/d1a/d2b/d2c/d5d/f62 zero size 2023-12-16T05:56:34.629 INFO:tasks.workunit.client.0.smithi155.stdout:7/526: write d0/d6a/d1a/d22/f23 [4953937,36631] 0 2023-12-16T05:56:34.631 INFO:tasks.workunit.client.0.smithi155.stdout:9/719: getdents da/d15/d17/d36/d5b/d60/db9 0 2023-12-16T05:56:34.632 INFO:tasks.workunit.client.1.smithi156.stdout:0/252: rename d2/d7/dd/d29/d2e/d40 to d2/d47 0 2023-12-16T05:56:34.634 INFO:tasks.workunit.client.0.smithi155.stdout:7/527: write d0/d6a/d1a/d22/f91 [988389,88201] 0 2023-12-16T05:56:34.634 INFO:tasks.workunit.client.0.smithi155.stdout:7/528: truncate d0/d6a/d1a/d8c/d34/fb2 135422 0 2023-12-16T05:56:34.634 INFO:tasks.workunit.client.0.smithi155.stdout:9/720: symlink da/d15/d17/d24/d62/lf9 0 2023-12-16T05:56:34.635 INFO:tasks.workunit.client.0.smithi155.stdout:9/721: symlink da/d15/d17/d36/d5b/d98/lfa 0 2023-12-16T05:56:34.637 INFO:tasks.workunit.client.0.smithi155.stdout:1/655: dread d1/d7/d4b/d8e/dc7/d28/d74/fbb [0,4194304] 0 2023-12-16T05:56:34.638 INFO:tasks.workunit.client.0.smithi155.stdout:2/469: sync 2023-12-16T05:56:34.638 INFO:tasks.workunit.client.0.smithi155.stdout:2/470: chown d0/d5/d6/d5f/f99 56 1 2023-12-16T05:56:34.638 INFO:tasks.workunit.client.0.smithi155.stdout:4/510: sync 2023-12-16T05:56:34.639 INFO:tasks.workunit.client.0.smithi155.stdout:0/547: sync 2023-12-16T05:56:34.640 INFO:tasks.workunit.client.0.smithi155.stdout:6/732: sync 2023-12-16T05:56:34.640 INFO:tasks.workunit.client.0.smithi155.stdout:8/496: sync 2023-12-16T05:56:34.642 INFO:tasks.workunit.client.0.smithi155.stdout:5/600: sync 2023-12-16T05:56:34.645 INFO:tasks.workunit.client.0.smithi155.stdout:7/529: dread d0/d6a/d1a/d22/f87 [0,4194304] 0 2023-12-16T05:56:34.646 INFO:tasks.workunit.client.0.smithi155.stdout:1/656: truncate d1/d25/d43/d5d/f7c 707080 0 2023-12-16T05:56:34.647 INFO:tasks.workunit.client.0.smithi155.stdout:2/471: dread d0/d7/d1f/f48 [0,4194304] 0 2023-12-16T05:56:34.649 INFO:tasks.workunit.client.0.smithi155.stdout:4/511: mkdir d0/d10/d46/d16/d30/d52/da8 0 2023-12-16T05:56:34.649 INFO:tasks.workunit.client.0.smithi155.stdout:4/512: dread - d0/d10/d46/d16/d30/f8d zero size 2023-12-16T05:56:34.650 INFO:tasks.workunit.client.1.smithi156.stdout:1/156: dwrite d3/d17/f1f [0,4194304] 0 2023-12-16T05:56:34.650 INFO:tasks.workunit.client.0.smithi155.stdout:0/548: link d7/d2d/f9e d7/df/d73/d8d/fb6 0 2023-12-16T05:56:34.650 INFO:tasks.workunit.client.0.smithi155.stdout:0/549: getdents d7/d13/d46/d81 0 2023-12-16T05:56:34.651 INFO:tasks.workunit.client.1.smithi156.stdout:7/384: sync 2023-12-16T05:56:34.654 INFO:tasks.workunit.client.0.smithi155.stdout:8/497: rename d4/d62/d66/d78/d88/f25 to d4/d62/fa2 0 2023-12-16T05:56:34.655 INFO:tasks.workunit.client.0.smithi155.stdout:7/530: mknod d0/d6a/d85/cb7 0 2023-12-16T05:56:34.655 INFO:tasks.workunit.client.0.smithi155.stdout:7/531: write d0/d6a/d1a/d8c/f75 [4536565,117049] 0 2023-12-16T05:56:34.655 INFO:tasks.workunit.client.0.smithi155.stdout:7/532: write d0/d1/f83 [849812,79310] 0 2023-12-16T05:56:34.655 INFO:tasks.workunit.client.0.smithi155.stdout:2/472: creat d0/d5/f9f x:0 0 0 2023-12-16T05:56:34.655 INFO:tasks.workunit.client.0.smithi155.stdout:2/473: dread - d0/d5/d6/f83 zero size 2023-12-16T05:56:34.659 INFO:tasks.workunit.client.0.smithi155.stdout:9/722: dwrite da/d15/d17/d36/fa1 [0,4194304] 0 2023-12-16T05:56:34.662 INFO:tasks.workunit.client.0.smithi155.stdout:5/601: rename d0/d2/d4f/f96 to d0/d2/d2a/d19/d88/fc3 0 2023-12-16T05:56:34.662 INFO:tasks.workunit.client.0.smithi155.stdout:5/602: chown d0/d2/d2a/d30/d53/d7b/d99/d47/c54 9038 1 2023-12-16T05:56:34.663 INFO:tasks.workunit.client.0.smithi155.stdout:8/498: mkdir d4/d62/d66/d78/d88/d1b/d1c/d19/da3 0 2023-12-16T05:56:34.663 INFO:tasks.workunit.client.0.smithi155.stdout:8/499: chown d4/d62/d66/d78/d88/d1b/d1c/d46 334 1 2023-12-16T05:56:34.665 INFO:tasks.workunit.client.0.smithi155.stdout:0/550: mkdir d7/db7 0 2023-12-16T05:56:34.668 INFO:tasks.workunit.client.0.smithi155.stdout:6/733: dread d0/d3/fb1 [0,4194304] 0 2023-12-16T05:56:34.668 INFO:tasks.workunit.client.0.smithi155.stdout:6/734: fsync d0/df/d5e/d46/f49 0 2023-12-16T05:56:34.668 INFO:tasks.workunit.client.0.smithi155.stdout:5/603: creat d0/d2/d2a/d30/d53/d7b/d99/d47/dbb/fc4 x:0 0 0 2023-12-16T05:56:34.670 INFO:tasks.workunit.client.0.smithi155.stdout:8/500: creat d4/d62/d66/d78/d88/d1b/d1c/d19/d64/fa4 x:0 0 0 2023-12-16T05:56:34.670 INFO:tasks.workunit.client.0.smithi155.stdout:7/533: dread d0/d6a/d1a/d8c/d34/d4b/f51 [0,4194304] 0 2023-12-16T05:56:34.670 INFO:tasks.workunit.client.0.smithi155.stdout:7/534: chown d0/d6a/c70 357015115 1 2023-12-16T05:56:34.671 INFO:tasks.workunit.client.0.smithi155.stdout:1/657: rename d1/d7/d4b/d8e/dc7/d28/l42 to d1/d7/d4b/d72/d79/daa/lce 0 2023-12-16T05:56:34.672 INFO:tasks.workunit.client.0.smithi155.stdout:2/474: dread d0/f22 [0,4194304] 0 2023-12-16T05:56:34.673 INFO:tasks.workunit.client.0.smithi155.stdout:6/735: creat d0/d3/d7a/db0/dc3/dce/ddd/d1b/dea/def/ff4 x:0 0 0 2023-12-16T05:56:34.674 INFO:tasks.workunit.client.0.smithi155.stdout:2/475: mknod d0/d7/dd/d49/d4b/d8c/ca0 0 2023-12-16T05:56:34.676 INFO:tasks.workunit.client.0.smithi155.stdout:2/476: creat d0/d7/dd/d49/d4b/d7f/fa1 x:0 0 0 2023-12-16T05:56:34.677 INFO:tasks.workunit.client.0.smithi155.stdout:2/477: symlink d0/d5/d8a/la2 0 2023-12-16T05:56:34.678 INFO:tasks.workunit.client.0.smithi155.stdout:1/658: write d1/d7/d4b/d8e/dc7/f65 [2456074,38796] 0 2023-12-16T05:56:34.681 INFO:tasks.workunit.client.0.smithi155.stdout:1/659: mknod d1/d7/d4b/d8e/dc7/d28/d8f/dad/ccf 0 2023-12-16T05:56:34.682 INFO:tasks.workunit.client.1.smithi156.stdout:0/253: rename d2/d7/dd/f19 to d2/f48 0 2023-12-16T05:56:34.685 INFO:tasks.workunit.client.1.smithi156.stdout:7/385: dwrite d1e/d1f/f76 [0,4194304] 0 2023-12-16T05:56:34.685 INFO:tasks.workunit.client.1.smithi156.stdout:7/386: write d1e/d1f/d22/d2c/f45 [4898044,31792] 0 2023-12-16T05:56:34.687 INFO:tasks.workunit.client.0.smithi155.stdout:9/723: dread da/d15/d17/d24/d62/fc4 [0,4194304] 0 2023-12-16T05:56:34.688 INFO:tasks.workunit.client.0.smithi155.stdout:9/724: write da/d15/d17/d36/d5b/d98/fc7 [81130,30966] 0 2023-12-16T05:56:34.690 INFO:tasks.workunit.client.0.smithi155.stdout:4/513: dread d0/d10/f3b [0,4194304] 0 2023-12-16T05:56:34.690 INFO:tasks.workunit.client.0.smithi155.stdout:0/551: dread d7/d47/d53/f9c [0,4194304] 0 2023-12-16T05:56:34.690 INFO:tasks.workunit.client.0.smithi155.stdout:0/552: chown d7/df/f37 46 1 2023-12-16T05:56:34.690 INFO:tasks.workunit.client.0.smithi155.stdout:4/514: write d0/da/f73 [216133,119095] 0 2023-12-16T05:56:34.690 INFO:tasks.workunit.client.1.smithi156.stdout:7/387: dread d1e/d1f/d22/d2c/d33/f50 [0,4194304] 0 2023-12-16T05:56:34.690 INFO:tasks.workunit.client.0.smithi155.stdout:9/725: creat da/d15/d17/d24/d26/d2e/d32/ffb x:0 0 0 2023-12-16T05:56:34.693 INFO:tasks.workunit.client.0.smithi155.stdout:4/515: creat d0/d10/d46/d16/d1a/d70/d92/fa9 x:0 0 0 2023-12-16T05:56:34.694 INFO:tasks.workunit.client.0.smithi155.stdout:9/726: truncate da/f14 780880 0 2023-12-16T05:56:34.696 INFO:tasks.workunit.client.0.smithi155.stdout:9/727: write da/d15/f31 [2667557,103520] 0 2023-12-16T05:56:34.697 INFO:tasks.workunit.client.1.smithi156.stdout:7/388: read d1e/d1f/d22/f25 [2601284,48106] 0 2023-12-16T05:56:34.697 INFO:tasks.workunit.client.1.smithi156.stdout:7/389: write d1e/d1f/d22/d2c/f4d [553770,87644] 0 2023-12-16T05:56:34.697 INFO:tasks.workunit.client.1.smithi156.stdout:7/390: dread - d1e/d55/d71/d61/f5d zero size 2023-12-16T05:56:34.697 INFO:tasks.workunit.client.1.smithi156.stdout:7/391: truncate d1e/d1f/f76 5045733 0 2023-12-16T05:56:34.698 INFO:tasks.workunit.client.0.smithi155.stdout:5/604: dread d0/d2/f22 [4194304,4194304] 0 2023-12-16T05:56:34.698 INFO:tasks.workunit.client.0.smithi155.stdout:0/553: dread d7/d47/d53/f9c [0,4194304] 0 2023-12-16T05:56:34.698 INFO:tasks.workunit.client.0.smithi155.stdout:0/554: chown d7/df/d73/fb1 24 1 2023-12-16T05:56:34.698 INFO:tasks.workunit.client.0.smithi155.stdout:8/501: dread d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/f63 [0,4194304] 0 2023-12-16T05:56:34.700 INFO:tasks.workunit.client.0.smithi155.stdout:4/516: creat d0/d10/d46/d16/d30/faa x:0 0 0 2023-12-16T05:56:34.700 INFO:tasks.workunit.client.0.smithi155.stdout:4/517: write d0/d10/f26 [2843749,93915] 0 2023-12-16T05:56:34.702 INFO:tasks.workunit.client.0.smithi155.stdout:4/518: dread d0/da/f5a [0,4194304] 0 2023-12-16T05:56:34.702 INFO:tasks.workunit.client.0.smithi155.stdout:4/519: write d0/d10/f9b [997372,45480] 0 2023-12-16T05:56:34.702 INFO:tasks.workunit.client.0.smithi155.stdout:4/520: stat d0/d10/d46/l41 0 2023-12-16T05:56:34.702 INFO:tasks.workunit.client.0.smithi155.stdout:9/728: mknod da/d15/d17/d24/d62/d91/cfc 0 2023-12-16T05:56:34.702 INFO:tasks.workunit.client.1.smithi156.stdout:7/392: write d1e/d1f/d22/d2c/d33/f35 [735239,78955] 0 2023-12-16T05:56:34.702 INFO:tasks.workunit.client.1.smithi156.stdout:7/393: fsync d1e/d39/f62 0 2023-12-16T05:56:34.703 INFO:tasks.workunit.client.0.smithi155.stdout:5/605: creat d0/d60/d79/d8e/fc5 x:0 0 0 2023-12-16T05:56:34.703 INFO:tasks.workunit.client.0.smithi155.stdout:5/606: readlink d0/d2/d2a/d30/d53/d7b/d99/d47/l7c 0 2023-12-16T05:56:34.704 INFO:tasks.workunit.client.0.smithi155.stdout:5/607: readlink d0/d2/d2a/d19/d71/l72 0 2023-12-16T05:56:34.704 INFO:tasks.workunit.client.0.smithi155.stdout:5/608: write d0/d2/d2a/f7f [1921029,43004] 0 2023-12-16T05:56:34.704 INFO:tasks.workunit.client.0.smithi155.stdout:5/609: read d0/d2/d2a/fbd [14757,110054] 0 2023-12-16T05:56:34.704 INFO:tasks.workunit.client.0.smithi155.stdout:0/555: truncate d7/d13/d45/d4b/f5f 1936730 0 2023-12-16T05:56:34.707 INFO:tasks.workunit.client.0.smithi155.stdout:4/521: rmdir d0/da/d36/d5f/d75 39 2023-12-16T05:56:34.708 INFO:tasks.workunit.client.0.smithi155.stdout:8/502: creat d4/d62/d66/d78/d88/d1b/d1c/d46/fa5 x:0 0 0 2023-12-16T05:56:34.708 INFO:tasks.workunit.client.0.smithi155.stdout:9/729: mkdir da/d15/d17/d24/d62/d91/dc0/de9/dfd 0 2023-12-16T05:56:34.710 INFO:tasks.workunit.client.1.smithi156.stdout:4/229: getdents d9/d43 0 2023-12-16T05:56:34.710 INFO:tasks.workunit.client.1.smithi156.stdout:4/230: write d9/d2b/f3c [968316,106642] 0 2023-12-16T05:56:34.710 INFO:tasks.workunit.client.1.smithi156.stdout:1/157: unlink d3/d17/d1c/f2f 0 2023-12-16T05:56:34.710 INFO:tasks.workunit.client.1.smithi156.stdout:7/394: dread d1e/d55/d71/d61/f36 [0,4194304] 0 2023-12-16T05:56:34.711 INFO:tasks.workunit.client.0.smithi155.stdout:5/610: creat d0/d2/d2a/d19/d71/fc6 x:0 0 0 2023-12-16T05:56:34.711 INFO:tasks.workunit.client.0.smithi155.stdout:7/535: dwrite d0/d1/d5/f8 [0,4194304] 0 2023-12-16T05:56:34.712 INFO:tasks.workunit.client.0.smithi155.stdout:6/736: dwrite d0/df/d5e/d46/d6d/de3/fed [4194304,4194304] 0 2023-12-16T05:56:34.714 INFO:tasks.workunit.client.0.smithi155.stdout:5/611: write d0/d2/d4f/f9b [9684808,14547] 0 2023-12-16T05:56:34.715 INFO:tasks.workunit.client.0.smithi155.stdout:0/556: rmdir d7/df 39 2023-12-16T05:56:34.716 INFO:tasks.workunit.client.0.smithi155.stdout:2/478: dwrite d0/d7/f5e [0,4194304] 0 2023-12-16T05:56:34.716 INFO:tasks.workunit.client.0.smithi155.stdout:2/479: write d0/d34/d3c/f43 [625601,9577] 0 2023-12-16T05:56:34.716 INFO:tasks.workunit.client.0.smithi155.stdout:2/480: readlink d0/d5/d8a/la2 0 2023-12-16T05:56:34.716 INFO:tasks.workunit.client.0.smithi155.stdout:7/536: read d0/d6a/d1a/f54 [181965,107326] 0 2023-12-16T05:56:34.717 INFO:tasks.workunit.client.1.smithi156.stdout:0/254: dwrite d2/d7/dd/d1c/f36 [0,4194304] 0 2023-12-16T05:56:34.718 INFO:tasks.workunit.client.0.smithi155.stdout:8/503: symlink d4/d62/d66/d78/la6 0 2023-12-16T05:56:34.721 INFO:tasks.workunit.client.1.smithi156.stdout:4/231: dread d9/f38 [0,4194304] 0 2023-12-16T05:56:34.723 INFO:tasks.workunit.client.1.smithi156.stdout:5/433: rmdir da 39 2023-12-16T05:56:34.723 INFO:tasks.workunit.client.1.smithi156.stdout:5/434: readlink da/dc/d2d/d4d/d54/l7d 0 2023-12-16T05:56:34.724 INFO:tasks.workunit.client.0.smithi155.stdout:9/730: unlink da/d15/d17/d24/d26/d2e/d32/ffb 0 2023-12-16T05:56:34.724 INFO:tasks.workunit.client.0.smithi155.stdout:9/731: write da/d15/d17/d36/dc1/ff7 [1502634,72350] 0 2023-12-16T05:56:34.724 INFO:tasks.workunit.client.0.smithi155.stdout:9/732: write da/d15/d17/d36/d54/f7f [570469,98236] 0 2023-12-16T05:56:34.725 INFO:tasks.workunit.client.0.smithi155.stdout:9/733: read da/d15/d17/d24/d26/fd5 [434886,61860] 0 2023-12-16T05:56:34.725 INFO:tasks.workunit.client.0.smithi155.stdout:9/734: chown da/d15/d17/d36/d5b/c79 11072577 1 2023-12-16T05:56:34.725 INFO:tasks.workunit.client.0.smithi155.stdout:6/737: creat d0/d3/d2c/d8b/d85/da4/ff5 x:0 0 0 2023-12-16T05:56:34.726 INFO:tasks.workunit.client.0.smithi155.stdout:6/738: stat d0/d3/d7a/dd6 0 2023-12-16T05:56:34.726 INFO:tasks.workunit.client.0.smithi155.stdout:9/735: read da/d15/d17/d24/d62/f68 [302612,121848] 0 2023-12-16T05:56:34.727 INFO:tasks.workunit.client.0.smithi155.stdout:5/612: symlink d0/dae/lc7 0 2023-12-16T05:56:34.727 INFO:tasks.workunit.client.0.smithi155.stdout:5/613: write d0/d2/d2a/d19/d48/f58 [157292,90914] 0 2023-12-16T05:56:34.729 INFO:tasks.workunit.client.0.smithi155.stdout:1/660: write d1/d25/d43/f77 [413999,146] 0 2023-12-16T05:56:34.730 INFO:tasks.workunit.client.0.smithi155.stdout:4/522: dwrite d0/da/d36/d5f/d75/d89/d9a/f9c [0,4194304] 0 2023-12-16T05:56:34.730 INFO:tasks.workunit.client.0.smithi155.stdout:1/661: dread d1/d7/d16/d30/f7f [0,4194304] 0 2023-12-16T05:56:34.733 INFO:tasks.workunit.client.1.smithi156.stdout:1/158: mkdir d3/d1b/d32 0 2023-12-16T05:56:34.734 INFO:tasks.workunit.client.0.smithi155.stdout:2/481: mknod d0/d7/d57/d9b/ca3 0 2023-12-16T05:56:34.734 INFO:tasks.workunit.client.0.smithi155.stdout:7/537: rmdir d0/d6a/d1a/d8c/d42/d98/db1 39 2023-12-16T05:56:34.734 INFO:tasks.workunit.client.0.smithi155.stdout:7/538: write d0/d1/fe [1872457,79881] 0 2023-12-16T05:56:34.734 INFO:tasks.workunit.client.1.smithi156.stdout:7/395: rename d1e/d55/d71/d61/c41 to d1e/d1f/d74/c7f 0 2023-12-16T05:56:34.734 INFO:tasks.workunit.client.1.smithi156.stdout:7/396: write d1e/d39/f7d [661247,67240] 0 2023-12-16T05:56:34.737 INFO:tasks.workunit.client.1.smithi156.stdout:0/255: symlink d2/d47/l49 0 2023-12-16T05:56:34.737 INFO:tasks.workunit.client.1.smithi156.stdout:0/256: write d2/d47/f46 [573146,66993] 0 2023-12-16T05:56:34.738 INFO:tasks.workunit.client.0.smithi155.stdout:6/739: rmdir d0/df/d5e/d46 39 2023-12-16T05:56:34.738 INFO:tasks.workunit.client.1.smithi156.stdout:4/232: mkdir d9/d2c/d48 0 2023-12-16T05:56:34.739 INFO:tasks.workunit.client.0.smithi155.stdout:9/736: mknod da/d15/d17/d24/d62/dea/cfe 0 2023-12-16T05:56:34.739 INFO:tasks.workunit.client.0.smithi155.stdout:9/737: read da/d15/d17/d36/d5b/d98/fc7 [267067,49448] 0 2023-12-16T05:56:34.739 INFO:tasks.workunit.client.0.smithi155.stdout:9/738: readlink da/d15/d17/d36/d5b/l5d 0 2023-12-16T05:56:34.739 INFO:tasks.workunit.client.0.smithi155.stdout:9/739: readlink da/d15/d17/d24/d26/d2e/d32/l72 0 2023-12-16T05:56:34.741 INFO:tasks.workunit.client.0.smithi155.stdout:8/504: dread d4/d62/d66/d78/d88/d12/f6b [0,4194304] 0 2023-12-16T05:56:34.742 INFO:tasks.workunit.client.1.smithi156.stdout:5/435: unlink da/dc/d4b/d6c/d7c/l61 0 2023-12-16T05:56:34.744 INFO:tasks.workunit.client.0.smithi155.stdout:4/523: rmdir d0/da/d36/d5f/d75/d89 39 2023-12-16T05:56:34.746 INFO:tasks.workunit.client.0.smithi155.stdout:1/662: mknod d1/d7/d4b/d72/d7e/cd0 0 2023-12-16T05:56:34.746 INFO:tasks.workunit.client.0.smithi155.stdout:1/663: write d1/d7/d4b/d8e/dc7/d28/f9f [873522,113031] 0 2023-12-16T05:56:34.746 INFO:tasks.workunit.client.0.smithi155.stdout:1/664: truncate d1/d7/d16/d30/f6e 1279390 0 2023-12-16T05:56:34.746 INFO:tasks.workunit.client.0.smithi155.stdout:1/665: chown d1/d25/d43 1534 1 2023-12-16T05:56:34.747 INFO:tasks.workunit.client.1.smithi156.stdout:7/397: symlink d1e/d1f/d22/l80 0 2023-12-16T05:56:34.748 INFO:tasks.workunit.client.0.smithi155.stdout:7/539: mkdir d0/d6a/d1a/d2b/d65/db8 0 2023-12-16T05:56:34.748 INFO:tasks.workunit.client.0.smithi155.stdout:7/540: chown d0/d6a/d1a/d2b/d2c 521873819 1 2023-12-16T05:56:34.750 INFO:tasks.workunit.client.1.smithi156.stdout:4/233: creat d9/d43/f49 x:0 0 0 2023-12-16T05:56:34.750 INFO:tasks.workunit.client.1.smithi156.stdout:0/257: mkdir d2/d23/d4a 0 2023-12-16T05:56:34.753 INFO:tasks.workunit.client.1.smithi156.stdout:5/436: creat da/dc/d4b/d6c/d7c/f87 x:0 0 0 2023-12-16T05:56:34.753 INFO:tasks.workunit.client.0.smithi155.stdout:8/505: symlink d4/d62/d66/d78/d88/d1b/d5f/la7 0 2023-12-16T05:56:34.753 INFO:tasks.workunit.client.0.smithi155.stdout:4/524: mkdir d0/d10/d46/d16/d30/d52/d88/dab 0 2023-12-16T05:56:34.755 INFO:tasks.workunit.client.1.smithi156.stdout:7/398: link d1e/d1f/d22/d2c/d33/l69 d1e/d1f/d22/d2c/l81 0 2023-12-16T05:56:34.757 INFO:tasks.workunit.client.1.smithi156.stdout:0/258: chown d2/d7/f10 1218200 1 2023-12-16T05:56:34.757 INFO:tasks.workunit.client.0.smithi155.stdout:1/666: dread d1/d69/f8a [4194304,4194304] 0 2023-12-16T05:56:34.758 INFO:tasks.workunit.client.1.smithi156.stdout:5/437: link da/dc/d2d/f7e da/dc/d2d/d4d/f88 0 2023-12-16T05:56:34.758 INFO:tasks.workunit.client.1.smithi156.stdout:5/438: dread - da/dc/d2d/f58 zero size 2023-12-16T05:56:34.760 INFO:tasks.workunit.client.1.smithi156.stdout:7/399: symlink d1e/d1f/d22/d2c/d57/l82 0 2023-12-16T05:56:34.761 INFO:tasks.workunit.client.1.smithi156.stdout:0/259: mkdir d2/d7/dd/d29/d4b 0 2023-12-16T05:56:34.761 INFO:tasks.workunit.client.1.smithi156.stdout:0/260: chown d2 0 1 2023-12-16T05:56:34.763 INFO:tasks.workunit.client.1.smithi156.stdout:5/439: mknod da/dc/d4b/d6c/d77/c89 0 2023-12-16T05:56:34.763 INFO:tasks.workunit.client.1.smithi156.stdout:5/440: write da/d46/f70 [787177,127060] 0 2023-12-16T05:56:34.765 INFO:tasks.workunit.client.1.smithi156.stdout:7/400: mknod d1e/d55/d71/d61/c83 0 2023-12-16T05:56:34.765 INFO:tasks.workunit.client.0.smithi155.stdout:4/525: truncate d0/d10/f2c 1284265 0 2023-12-16T05:56:34.765 INFO:tasks.workunit.client.0.smithi155.stdout:4/526: dread - d0/da/fa7 zero size 2023-12-16T05:56:34.765 INFO:tasks.workunit.client.0.smithi155.stdout:7/541: unlink d0/d6a/d1a/d2b/c49 0 2023-12-16T05:56:34.765 INFO:tasks.workunit.client.0.smithi155.stdout:7/542: mkdir d0/d6a/d1a/d2b/db9 0 2023-12-16T05:56:34.766 INFO:tasks.workunit.client.1.smithi156.stdout:5/441: dread da/dc/f1d [0,4194304] 0 2023-12-16T05:56:34.768 INFO:tasks.workunit.client.1.smithi156.stdout:7/401: creat d1e/d1f/d22/d2c/d33/f84 x:0 0 0 2023-12-16T05:56:34.768 INFO:tasks.workunit.client.1.smithi156.stdout:1/159: rmdir d3/d17 39 2023-12-16T05:56:34.769 INFO:tasks.workunit.client.1.smithi156.stdout:5/442: dread da/f50 [0,4194304] 0 2023-12-16T05:56:34.770 INFO:tasks.workunit.client.0.smithi155.stdout:7/543: getdents d0/d1b/d78 0 2023-12-16T05:56:34.770 INFO:tasks.workunit.client.0.smithi155.stdout:6/740: dwrite d0/d3/d7a/d77/f83 [4194304,4194304] 0 2023-12-16T05:56:34.770 INFO:tasks.workunit.client.1.smithi156.stdout:7/402: mkdir d1e/d1f/d85 0 2023-12-16T05:56:34.771 INFO:tasks.workunit.client.0.smithi155.stdout:8/506: dread d4/d62/d66/d78/d88/d1b/d2a/d51/f6e [0,4194304] 0 2023-12-16T05:56:34.773 INFO:tasks.workunit.client.1.smithi156.stdout:1/160: truncate d3/f14 573208 0 2023-12-16T05:56:34.774 INFO:tasks.workunit.client.1.smithi156.stdout:5/443: creat da/dc/d2d/f8a x:0 0 0 2023-12-16T05:56:34.774 INFO:tasks.workunit.client.0.smithi155.stdout:6/741: creat d0/d3/d7a/d77/ff6 x:0 0 0 2023-12-16T05:56:34.775 INFO:tasks.workunit.client.1.smithi156.stdout:7/403: getdents d1e 0 2023-12-16T05:56:34.776 INFO:tasks.workunit.client.1.smithi156.stdout:0/261: dread d2/d7/dd/d1c/f25 [0,4194304] 0 2023-12-16T05:56:34.777 INFO:tasks.workunit.client.1.smithi156.stdout:1/161: link d3/fc d3/d17/f33 0 2023-12-16T05:56:34.778 INFO:tasks.workunit.client.0.smithi155.stdout:6/742: creat d0/d3/d7a/db0/dc3/dce/ddd/d1b/dea/ff7 x:0 0 0 2023-12-16T05:56:34.778 INFO:tasks.workunit.client.1.smithi156.stdout:5/444: getdents da/dc/d4b 0 2023-12-16T05:56:34.778 INFO:tasks.workunit.client.1.smithi156.stdout:5/445: chown da/dc/d4b/d6c/d81 4 1 2023-12-16T05:56:34.780 INFO:tasks.workunit.client.0.smithi155.stdout:8/507: symlink d4/d62/d66/d78/d88/la8 0 2023-12-16T05:56:34.780 INFO:tasks.workunit.client.0.smithi155.stdout:6/743: creat d0/df/d5e/d7e/dd8/ff8 x:0 0 0 2023-12-16T05:56:34.780 INFO:tasks.workunit.client.0.smithi155.stdout:6/744: write d0/df/d5e/d46/d6d/f74 [987868,34504] 0 2023-12-16T05:56:34.781 INFO:tasks.workunit.client.0.smithi155.stdout:7/544: write d0/d1/d5/f8 [2361700,102418] 0 2023-12-16T05:56:34.781 INFO:tasks.workunit.client.0.smithi155.stdout:7/545: chown d0/d6a/d1a/d8c/d34/d4b/fb6 13 1 2023-12-16T05:56:34.781 INFO:tasks.workunit.client.1.smithi156.stdout:5/446: mknod da/dc/d2d/c8b 0 2023-12-16T05:56:34.781 INFO:tasks.workunit.client.1.smithi156.stdout:5/447: stat da/d46/f70 0 2023-12-16T05:56:34.782 INFO:tasks.workunit.client.0.smithi155.stdout:8/508: truncate d4/d62/d66/d78/d88/d1b/d2a/f39 7332328 0 2023-12-16T05:56:34.784 INFO:tasks.workunit.client.0.smithi155.stdout:7/546: mkdir d0/d6a/d1a/d8c/d34/d4b/d64/d6f/dba 0 2023-12-16T05:56:34.785 INFO:tasks.workunit.client.1.smithi156.stdout:0/262: link d2/c39 d2/d7/dd/c4c 0 2023-12-16T05:56:34.786 INFO:tasks.workunit.client.0.smithi155.stdout:5/614: dwrite d0/f32 [0,4194304] 0 2023-12-16T05:56:34.786 INFO:tasks.workunit.client.1.smithi156.stdout:5/448: rmdir da/dc/d4b/d6c/d81 39 2023-12-16T05:56:34.786 INFO:tasks.workunit.client.0.smithi155.stdout:7/547: rename d0/d6a/c70 to d0/d6a/d1a/d8c/d34/d4b/cbb 0 2023-12-16T05:56:34.787 INFO:tasks.workunit.client.1.smithi156.stdout:9/255: sync 2023-12-16T05:56:34.787 INFO:tasks.workunit.client.1.smithi156.stdout:2/259: sync 2023-12-16T05:56:34.789 INFO:tasks.workunit.client.0.smithi155.stdout:7/548: mknod d0/d6a/d1a/d2b/d2c/d5d/cbc 0 2023-12-16T05:56:34.789 INFO:tasks.workunit.client.0.smithi155.stdout:7/549: fdatasync d0/d6a/d1a/d22/f91 0 2023-12-16T05:56:34.796 INFO:tasks.workunit.client.1.smithi156.stdout:5/449: unlink da/dc/d4b/d6c/d81/l7f 0 2023-12-16T05:56:34.797 INFO:tasks.workunit.client.0.smithi155.stdout:4/527: dwrite d0/d10/f9b [0,4194304] 0 2023-12-16T05:56:34.798 INFO:tasks.workunit.client.0.smithi155.stdout:8/509: dread d4/d62/d66/d78/d88/d1b/f7c [0,4194304] 0 2023-12-16T05:56:34.798 INFO:tasks.workunit.client.1.smithi156.stdout:0/263: chown d2/d7/dd/c1e 64799151 1 2023-12-16T05:56:34.800 INFO:tasks.workunit.client.0.smithi155.stdout:4/528: mkdir d0/da/d36/d5f/d75/d3d/d85/dac 0 2023-12-16T05:56:34.802 INFO:tasks.workunit.client.1.smithi156.stdout:4/234: dwrite d9/f37 [0,4194304] 0 2023-12-16T05:56:34.802 INFO:tasks.workunit.client.0.smithi155.stdout:8/510: creat d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/fa9 x:0 0 0 2023-12-16T05:56:34.803 INFO:tasks.workunit.client.0.smithi155.stdout:1/667: dwrite d1/d7/d16/f21 [4194304,4194304] 0 2023-12-16T05:56:34.804 INFO:tasks.workunit.client.0.smithi155.stdout:4/529: creat d0/d10/d46/d16/d1a/d70/d92/fad x:0 0 0 2023-12-16T05:56:34.807 INFO:tasks.workunit.client.1.smithi156.stdout:1/162: dwrite d3/d17/d19/f26 [0,4194304] 0 2023-12-16T05:56:34.808 INFO:tasks.workunit.client.1.smithi156.stdout:1/163: truncate d3/d1b/d27/f29 987464 0 2023-12-16T05:56:34.809 INFO:tasks.workunit.client.0.smithi155.stdout:8/511: symlink d4/d62/d66/d78/d88/d1b/d2a/laa 0 2023-12-16T05:56:34.815 INFO:tasks.workunit.client.0.smithi155.stdout:1/668: symlink d1/d7/d4b/d72/d79/ld1 0 2023-12-16T05:56:34.817 INFO:tasks.workunit.client.0.smithi155.stdout:8/512: write d4/d62/d66/d78/d88/d1b/d1c/f45 [684942,105855] 0 2023-12-16T05:56:34.818 INFO:tasks.workunit.client.1.smithi156.stdout:7/404: fsync d1e/d1f/d22/d2c/d33/f84 0 2023-12-16T05:56:34.820 INFO:tasks.workunit.client.1.smithi156.stdout:4/235: symlink d9/d2b/l4a 0 2023-12-16T05:56:34.820 INFO:tasks.workunit.client.1.smithi156.stdout:4/236: fsync d9/d2c/f2f 0 2023-12-16T05:56:34.823 INFO:tasks.workunit.client.0.smithi155.stdout:6/745: dwrite d0/d3/d2c/fd9 [0,4194304] 0 2023-12-16T05:56:34.825 INFO:tasks.workunit.client.1.smithi156.stdout:1/164: creat d3/d1b/d27/f34 x:0 0 0 2023-12-16T05:56:34.827 INFO:tasks.workunit.client.1.smithi156.stdout:7/405: rename f4 to d1e/d1f/d22/d2c/d57/f86 0 2023-12-16T05:56:34.827 INFO:tasks.workunit.client.1.smithi156.stdout:7/406: chown d1e/d55/d71/d61/f36 704790833 1 2023-12-16T05:56:34.828 INFO:tasks.workunit.client.0.smithi155.stdout:0/557: truncate d7/d13/d45/f49 729316 0 2023-12-16T05:56:34.828 INFO:tasks.workunit.client.0.smithi155.stdout:1/669: rename d1/d7/d4b/d8e/dc7/d28/f9f to d1/d7/d4b/d5c/fd2 0 2023-12-16T05:56:34.828 INFO:tasks.workunit.client.0.smithi155.stdout:1/670: write d1/d25/d43/d5d/d5e/fbd [778985,128903] 0 2023-12-16T05:56:34.828 INFO:tasks.workunit.client.0.smithi155.stdout:0/558: link d7/df/d6f/c8e d7/db7/cb8 0 2023-12-16T05:56:34.830 INFO:tasks.workunit.client.0.smithi155.stdout:1/671: creat d1/d7/d4b/d8e/fd3 x:0 0 0 2023-12-16T05:56:34.831 INFO:tasks.workunit.client.1.smithi156.stdout:2/260: dwrite d9/dd/d17/d33/f10 [0,4194304] 0 2023-12-16T05:56:34.831 INFO:tasks.workunit.client.1.smithi156.stdout:2/261: read - d9/dd/d17/d33/f40 zero size 2023-12-16T05:56:34.831 INFO:tasks.workunit.client.1.smithi156.stdout:2/262: stat d9/dd/d17/d33/f40 0 2023-12-16T05:56:34.831 INFO:tasks.workunit.client.1.smithi156.stdout:2/263: readlink d9/dd/d17/d33/l32 0 2023-12-16T05:56:34.831 INFO:tasks.workunit.client.1.smithi156.stdout:2/264: stat d9/dd/d17/d33/d38/d39/f3e 0 2023-12-16T05:56:34.832 INFO:tasks.workunit.client.1.smithi156.stdout:7/407: write d1e/d1f/d22/f23 [2773071,103063] 0 2023-12-16T05:56:34.832 INFO:tasks.workunit.client.1.smithi156.stdout:7/408: fdatasync d1e/d1f/d22/f25 0 2023-12-16T05:56:34.832 INFO:tasks.workunit.client.0.smithi155.stdout:0/559: getdents d7/df/d41 0 2023-12-16T05:56:34.833 INFO:tasks.workunit.client.1.smithi156.stdout:4/237: rmdir d9/d2c 39 2023-12-16T05:56:34.833 INFO:tasks.workunit.client.1.smithi156.stdout:1/165: truncate d3/f5 191805 0 2023-12-16T05:56:34.834 INFO:tasks.workunit.client.1.smithi156.stdout:2/265: link d9/dd/f2f d9/dd/d17/d33/d38/d39/f4c 0 2023-12-16T05:56:34.835 INFO:tasks.workunit.client.1.smithi156.stdout:7/409: link d1e/d1f/d22/d2c/f4d d1e/d1f/d74/f87 0 2023-12-16T05:56:34.835 INFO:tasks.workunit.client.0.smithi155.stdout:0/560: creat d7/df/d73/db3/fb9 x:0 0 0 2023-12-16T05:56:34.837 INFO:tasks.workunit.client.1.smithi156.stdout:4/238: link d9/f22 d9/d43/f4b 0 2023-12-16T05:56:34.837 INFO:tasks.workunit.client.1.smithi156.stdout:4/239: write d9/f27 [481187,14279] 0 2023-12-16T05:56:34.837 INFO:tasks.workunit.client.0.smithi155.stdout:0/561: unlink d7/df/d73/d8d/fb6 0 2023-12-16T05:56:34.838 INFO:tasks.workunit.client.1.smithi156.stdout:2/266: readlink d9/d12/l28 0 2023-12-16T05:56:34.838 INFO:tasks.workunit.client.0.smithi155.stdout:4/530: dwrite d0/d10/f9b [0,4194304] 0 2023-12-16T05:56:34.839 INFO:tasks.workunit.client.0.smithi155.stdout:4/531: dread - d0/d10/d46/d16/f8e zero size 2023-12-16T05:56:34.839 INFO:tasks.workunit.client.0.smithi155.stdout:4/532: fsync d0/d10/d46/d16/d1a/f5c 0 2023-12-16T05:56:34.839 INFO:tasks.workunit.client.0.smithi155.stdout:4/533: fsync d0/da/d36/f7f 0 2023-12-16T05:56:34.839 INFO:tasks.workunit.client.1.smithi156.stdout:4/240: symlink d9/l4c 0 2023-12-16T05:56:34.839 INFO:tasks.workunit.client.1.smithi156.stdout:4/241: chown d9/f16 1091 1 2023-12-16T05:56:34.839 INFO:tasks.workunit.client.1.smithi156.stdout:4/242: chown d9/d2b/f31 23 1 2023-12-16T05:56:34.840 INFO:tasks.workunit.client.0.smithi155.stdout:4/534: write d0/d10/d46/d16/d1a/f35 [4609196,24527] 0 2023-12-16T05:56:34.840 INFO:tasks.workunit.client.1.smithi156.stdout:2/267: creat d9/dd/d17/d33/d47/f4d x:0 0 0 2023-12-16T05:56:34.842 INFO:tasks.workunit.client.0.smithi155.stdout:4/535: rename d0/f4 to d0/da/d36/d5f/fae 0 2023-12-16T05:56:34.843 INFO:tasks.workunit.client.1.smithi156.stdout:2/268: mknod d9/dd/c4e 0 2023-12-16T05:56:34.843 INFO:tasks.workunit.client.1.smithi156.stdout:2/269: rename d9/dd to d9/dd/d4f 22 2023-12-16T05:56:34.845 INFO:tasks.workunit.client.1.smithi156.stdout:2/270: symlink d9/dd/d17/d33/d38/d39/l50 0 2023-12-16T05:56:34.845 INFO:tasks.workunit.client.1.smithi156.stdout:2/271: truncate d9/d12/f36 371122 0 2023-12-16T05:56:34.846 INFO:tasks.workunit.client.1.smithi156.stdout:2/272: creat d9/dd/d17/f51 x:0 0 0 2023-12-16T05:56:34.856 INFO:tasks.workunit.client.1.smithi156.stdout:4/243: dread d9/f28 [0,4194304] 0 2023-12-16T05:56:34.857 INFO:tasks.workunit.client.1.smithi156.stdout:4/244: creat d9/f4d x:0 0 0 2023-12-16T05:56:34.858 INFO:tasks.workunit.client.1.smithi156.stdout:4/245: fdatasync d9/d2b/f33 0 2023-12-16T05:56:34.858 INFO:tasks.workunit.client.0.smithi155.stdout:4/536: dread d0/da/d36/d5f/d75/f23 [0,4194304] 0 2023-12-16T05:56:34.858 INFO:tasks.workunit.client.0.smithi155.stdout:4/537: chown d0/d10/d46/d16/d1a/d70/c8b 1 1 2023-12-16T05:56:34.858 INFO:tasks.workunit.client.1.smithi156.stdout:5/450: dwrite da/dc/f13 [0,4194304] 0 2023-12-16T05:56:34.859 INFO:tasks.workunit.client.1.smithi156.stdout:4/246: symlink d9/d43/l4e 0 2023-12-16T05:56:34.859 INFO:tasks.workunit.client.1.smithi156.stdout:4/247: dread - d9/d43/f44 zero size 2023-12-16T05:56:34.860 INFO:tasks.workunit.client.1.smithi156.stdout:4/248: creat d9/f4f x:0 0 0 2023-12-16T05:56:34.861 INFO:tasks.workunit.client.1.smithi156.stdout:4/249: read d9/f1e [3380704,82336] 0 2023-12-16T05:56:34.863 INFO:tasks.workunit.client.1.smithi156.stdout:4/250: rename d9/cb to d9/d2c/d48/c50 0 2023-12-16T05:56:34.865 INFO:tasks.workunit.client.0.smithi155.stdout:7/550: dwrite d0/f35 [4194304,4194304] 0 2023-12-16T05:56:34.865 INFO:tasks.workunit.client.0.smithi155.stdout:7/551: write d0/d6a/d1a/d2b/d2c/d5d/f62 [476979,104359] 0 2023-12-16T05:56:34.868 INFO:tasks.workunit.client.0.smithi155.stdout:7/552: creat d0/d1/d5/fbd x:0 0 0 2023-12-16T05:56:34.870 INFO:tasks.workunit.client.1.smithi156.stdout:3/211: sync 2023-12-16T05:56:34.871 INFO:tasks.workunit.client.1.smithi156.stdout:3/212: link dc/d10/c41 dc/d10/d1d/c4d 0 2023-12-16T05:56:34.872 INFO:tasks.workunit.client.1.smithi156.stdout:0/264: dwrite d2/d7/dd/d1c/f36 [0,4194304] 0 2023-12-16T05:56:34.872 INFO:tasks.workunit.client.1.smithi156.stdout:3/213: mkdir dc/d10/d3d/d4e 0 2023-12-16T05:56:34.874 INFO:tasks.workunit.client.0.smithi155.stdout:1/672: dwrite d1/d7/d4b/d8e/dc7/d28/d74/fa3 [0,4194304] 0 2023-12-16T05:56:34.875 INFO:tasks.workunit.client.1.smithi156.stdout:0/265: symlink d2/d7/dd/d29/d38/d3f/d44/l4d 0 2023-12-16T05:56:34.877 INFO:tasks.workunit.client.1.smithi156.stdout:8/188: sync 2023-12-16T05:56:34.878 INFO:tasks.workunit.client.1.smithi156.stdout:6/257: sync 2023-12-16T05:56:34.878 INFO:tasks.workunit.client.1.smithi156.stdout:4/251: dread d9/d2c/f32 [0,4194304] 0 2023-12-16T05:56:34.878 INFO:tasks.workunit.client.1.smithi156.stdout:0/266: write d2/d7/dd/f30 [1600874,88057] 0 2023-12-16T05:56:34.880 INFO:tasks.workunit.client.1.smithi156.stdout:6/258: dread d9/d13/d2f/f34 [0,4194304] 0 2023-12-16T05:56:34.880 INFO:tasks.workunit.client.1.smithi156.stdout:6/259: write d9/f1d [3924421,96088] 0 2023-12-16T05:56:34.881 INFO:tasks.workunit.client.1.smithi156.stdout:8/189: rmdir d3/d7/d9 39 2023-12-16T05:56:34.882 INFO:tasks.workunit.client.1.smithi156.stdout:0/267: mknod d2/d7/dd/d29/d38/d3f/c4e 0 2023-12-16T05:56:34.882 INFO:tasks.workunit.client.1.smithi156.stdout:6/260: mkdir d9/d13/d2f/d51 0 2023-12-16T05:56:34.884 INFO:tasks.workunit.client.0.smithi155.stdout:7/553: dread d0/d6a/d1a/d8c/d42/d98/f50 [0,4194304] 0 2023-12-16T05:56:34.884 INFO:tasks.workunit.client.0.smithi155.stdout:7/554: chown d0/d6a/d1a/f54 133 1 2023-12-16T05:56:34.884 INFO:tasks.workunit.client.0.smithi155.stdout:7/555: read - d0/d6a/d1a/da0/fa5 zero size 2023-12-16T05:56:34.884 INFO:tasks.workunit.client.1.smithi156.stdout:3/214: dread dc/d10/f18 [0,4194304] 0 2023-12-16T05:56:34.884 INFO:tasks.workunit.client.1.smithi156.stdout:8/190: mkdir d3/d7/d9/d3b 0 2023-12-16T05:56:34.885 INFO:tasks.workunit.client.1.smithi156.stdout:8/191: readlink d3/l26 0 2023-12-16T05:56:34.885 INFO:tasks.workunit.client.1.smithi156.stdout:0/268: link d2/d7/dd/d1c/f25 d2/d7/dd/d29/f4f 0 2023-12-16T05:56:34.886 INFO:tasks.workunit.client.0.smithi155.stdout:1/673: write d1/d7/d4b/d8e/dc7/fa5 [16887,103529] 0 2023-12-16T05:56:34.886 INFO:tasks.workunit.client.1.smithi156.stdout:3/215: dread dc/df/f2d [0,4194304] 0 2023-12-16T05:56:34.886 INFO:tasks.workunit.client.1.smithi156.stdout:3/216: read - dc/d10/d1d/f32 zero size 2023-12-16T05:56:34.886 INFO:tasks.workunit.client.1.smithi156.stdout:7/410: dwrite d1e/f24 [4194304,4194304] 0 2023-12-16T05:56:34.887 INFO:tasks.workunit.client.1.smithi156.stdout:6/261: creat d9/d1c/f52 x:0 0 0 2023-12-16T05:56:34.888 INFO:tasks.workunit.client.0.smithi155.stdout:0/562: dwrite d7/d13/d45/f4f [0,4194304] 0 2023-12-16T05:56:34.888 INFO:tasks.workunit.client.0.smithi155.stdout:0/563: write d7/df/f7f [1880493,70227] 0 2023-12-16T05:56:34.889 INFO:tasks.workunit.client.0.smithi155.stdout:4/538: dwrite d0/d10/f9b [4194304,4194304] 0 2023-12-16T05:56:34.889 INFO:tasks.workunit.client.0.smithi155.stdout:4/539: write d0/d10/d46/d16/f8e [1030853,95330] 0 2023-12-16T05:56:34.891 INFO:tasks.workunit.client.0.smithi155.stdout:1/674: mkdir d1/d7/d4b/d8e/dc7/d28/d8f/db2/dd4 0 2023-12-16T05:56:34.891 INFO:tasks.workunit.client.0.smithi155.stdout:1/675: chown d1/d25 1 1 2023-12-16T05:56:34.894 INFO:tasks.workunit.client.1.smithi156.stdout:5/451: dwrite da/f36 [4194304,4194304] 0 2023-12-16T05:56:34.895 INFO:tasks.workunit.client.1.smithi156.stdout:8/192: unlink f2 0 2023-12-16T05:56:34.896 INFO:tasks.workunit.client.1.smithi156.stdout:3/217: dread dc/d10/d3d/f29 [0,4194304] 0 2023-12-16T05:56:34.896 INFO:tasks.workunit.client.1.smithi156.stdout:2/273: dwrite d9/f44 [0,4194304] 0 2023-12-16T05:56:34.902 INFO:tasks.workunit.client.0.smithi155.stdout:4/540: dread d0/d10/f34 [0,4194304] 0 2023-12-16T05:56:34.903 INFO:tasks.workunit.client.0.smithi155.stdout:4/541: write d0/fb [4299958,47624] 0 2023-12-16T05:56:34.905 INFO:tasks.workunit.client.1.smithi156.stdout:8/193: mkdir d3/d7/d9/d3c 0 2023-12-16T05:56:34.907 INFO:tasks.workunit.client.1.smithi156.stdout:3/218: symlink dc/d10/l4f 0 2023-12-16T05:56:34.907 INFO:tasks.workunit.client.0.smithi155.stdout:4/542: truncate d0/da/d36/d5f/d75/d50/f6a 4327899 0 2023-12-16T05:56:34.908 INFO:tasks.workunit.client.0.smithi155.stdout:4/543: mkdir d0/d10/d46/d16/d1a/d70/d92/daf 0 2023-12-16T05:56:34.909 INFO:tasks.workunit.client.0.smithi155.stdout:4/544: mknod d0/da/d36/d5f/d75/d3d/cb0 0 2023-12-16T05:56:34.909 INFO:tasks.workunit.client.0.smithi155.stdout:4/545: dread - d0/d10/d46/d16/d30/f7e zero size 2023-12-16T05:56:34.911 INFO:tasks.workunit.client.1.smithi156.stdout:0/269: mknod d2/d7/dd/d2d/c50 0 2023-12-16T05:56:34.911 INFO:tasks.workunit.client.1.smithi156.stdout:0/270: chown d2/d7/dd/d1c/f25 15 1 2023-12-16T05:56:34.913 INFO:tasks.workunit.client.1.smithi156.stdout:8/194: link d3/d12/f28 d3/d12/f3d 0 2023-12-16T05:56:34.915 INFO:tasks.workunit.client.1.smithi156.stdout:3/219: creat dc/d10/f50 x:0 0 0 2023-12-16T05:56:34.915 INFO:tasks.workunit.client.0.smithi155.stdout:4/546: truncate d0/d10/f2c 354824 0 2023-12-16T05:56:34.917 INFO:tasks.workunit.client.1.smithi156.stdout:3/220: creat dc/d10/d1d/d4b/f51 x:0 0 0 2023-12-16T05:56:34.920 INFO:tasks.workunit.client.0.smithi155.stdout:4/547: rename d0/d10/d46/d16/d30/d52/da8 to d0/da/d36/d5f/d75/d3d/d49/db1 0 2023-12-16T05:56:34.920 INFO:tasks.workunit.client.1.smithi156.stdout:8/195: read d3/f29 [380862,54419] 0 2023-12-16T05:56:34.921 INFO:tasks.workunit.client.1.smithi156.stdout:3/221: write f8 [326929,11343] 0 2023-12-16T05:56:34.923 INFO:tasks.workunit.client.0.smithi155.stdout:4/548: getdents d0/d10/d46 0 2023-12-16T05:56:34.924 INFO:tasks.workunit.client.1.smithi156.stdout:7/411: dwrite d1e/d1f/d22/d2c/d33/f35 [0,4194304] 0 2023-12-16T05:56:34.924 INFO:tasks.workunit.client.0.smithi155.stdout:4/549: unlink d0/d10/d46/d16/d30/l93 0 2023-12-16T05:56:34.924 INFO:tasks.workunit.client.0.smithi155.stdout:4/550: truncate d0/da/d36/d5f/d75/d3d/f4d 1266660 0 2023-12-16T05:56:34.925 INFO:tasks.workunit.client.1.smithi156.stdout:7/412: mknod d1e/d1f/d22/d75/c88 0 2023-12-16T05:56:34.925 INFO:tasks.workunit.client.0.smithi155.stdout:4/551: link d0/da/d36/d5f/d75/d3d/l99 d0/da/lb2 0 2023-12-16T05:56:34.927 INFO:tasks.workunit.client.0.smithi155.stdout:4/552: mknod d0/da/d36/d5f/d75/d3d/d49/cb3 0 2023-12-16T05:56:34.927 INFO:tasks.workunit.client.0.smithi155.stdout:4/553: stat d0/d10/d46 0 2023-12-16T05:56:34.927 INFO:tasks.workunit.client.0.smithi155.stdout:4/554: chown d0/d10/d46/d16/d1a/f72 5006 1 2023-12-16T05:56:34.927 INFO:tasks.workunit.client.0.smithi155.stdout:4/555: chown d0/d10/f8c 67 1 2023-12-16T05:56:34.928 INFO:tasks.workunit.client.1.smithi156.stdout:8/196: dread d3/d7/d9/f2a [0,4194304] 0 2023-12-16T05:56:34.928 INFO:tasks.workunit.client.0.smithi155.stdout:4/556: creat d0/da/d36/d5f/d7b/fb4 x:0 0 0 2023-12-16T05:56:34.928 INFO:tasks.workunit.client.0.smithi155.stdout:4/557: chown d0/d10/d46/d16/d30/d52/d88/f94 5183 1 2023-12-16T05:56:34.929 INFO:tasks.workunit.client.1.smithi156.stdout:8/197: unlink d3/d7/c34 0 2023-12-16T05:56:34.930 INFO:tasks.workunit.client.1.smithi156.stdout:8/198: creat d3/d12/d16/f3e x:0 0 0 2023-12-16T05:56:34.946 INFO:tasks.workunit.client.1.smithi156.stdout:6/262: dwrite d9/d13/f14 [0,4194304] 0 2023-12-16T05:56:34.955 INFO:tasks.workunit.client.1.smithi156.stdout:2/274: dwrite d9/f20 [0,4194304] 0 2023-12-16T05:56:34.955 INFO:tasks.workunit.client.1.smithi156.stdout:5/452: dwrite da/dc/d2d/f4c [0,4194304] 0 2023-12-16T05:56:34.955 INFO:tasks.workunit.client.1.smithi156.stdout:7/413: dwrite d1e/d1f/f3a [0,4194304] 0 2023-12-16T05:56:34.955 INFO:tasks.workunit.client.1.smithi156.stdout:7/414: rename d1e/d55/d71 to d1e/d55/d71/d89 22 2023-12-16T05:56:34.955 INFO:tasks.workunit.client.1.smithi156.stdout:8/199: dwrite d3/d12/d16/f3e [0,4194304] 0 2023-12-16T05:56:34.956 INFO:tasks.workunit.client.1.smithi156.stdout:4/252: dwrite d9/f27 [0,4194304] 0 2023-12-16T05:56:34.956 INFO:tasks.workunit.client.1.smithi156.stdout:2/275: rmdir d9/dd/d49 0 2023-12-16T05:56:34.957 INFO:tasks.workunit.client.0.smithi155.stdout:1/676: dwrite d1/d7/d4b/d72/d79/f9d [0,4194304] 0 2023-12-16T05:56:34.959 INFO:tasks.workunit.client.1.smithi156.stdout:8/200: dread d3/d18/f22 [0,4194304] 0 2023-12-16T05:56:34.959 INFO:tasks.workunit.client.1.smithi156.stdout:8/201: truncate d3/d7/d9/f33 47763 0 2023-12-16T05:56:34.961 INFO:tasks.workunit.client.1.smithi156.stdout:0/271: dwrite d2/d7/dd/d29/d38/f3e [0,4194304] 0 2023-12-16T05:56:34.961 INFO:tasks.workunit.client.1.smithi156.stdout:6/263: dwrite f6 [0,4194304] 0 2023-12-16T05:56:34.962 INFO:tasks.workunit.client.1.smithi156.stdout:6/264: write f5 [4895472,8877] 0 2023-12-16T05:56:34.963 INFO:tasks.workunit.client.1.smithi156.stdout:5/453: rename da/dc/d4b/d6c/d7c/f66 to da/dc/d2d/d4d/d54/d67/f8c 0 2023-12-16T05:56:34.965 INFO:tasks.workunit.client.1.smithi156.stdout:7/415: symlink d1e/d1f/d22/d2c/l8a 0 2023-12-16T05:56:34.965 INFO:tasks.workunit.client.1.smithi156.stdout:7/416: fdatasync d1e/d55/d71/d61/f5d 0 2023-12-16T05:56:34.967 INFO:tasks.workunit.client.1.smithi156.stdout:3/222: truncate dc/d10/f11 4197149 0 2023-12-16T05:56:34.970 INFO:tasks.workunit.client.1.smithi156.stdout:4/253: symlink d9/d2c/l51 0 2023-12-16T05:56:34.971 INFO:tasks.workunit.client.1.smithi156.stdout:2/276: creat d9/dd/d3f/f52 x:0 0 0 2023-12-16T05:56:34.977 INFO:tasks.workunit.client.1.smithi156.stdout:6/265: rename d9/d1c/f23 to d9/f53 0 2023-12-16T05:56:34.977 INFO:tasks.workunit.client.1.smithi156.stdout:6/266: dread - d9/f41 zero size 2023-12-16T05:56:34.977 INFO:tasks.workunit.client.1.smithi156.stdout:6/267: fsync d9/d13/f48 0 2023-12-16T05:56:34.977 INFO:tasks.workunit.client.1.smithi156.stdout:6/268: readlink d9/le 0 2023-12-16T05:56:34.978 INFO:tasks.workunit.client.1.smithi156.stdout:5/454: getdents da/dc/d4b/d6c/d77 0 2023-12-16T05:56:34.978 INFO:tasks.workunit.client.1.smithi156.stdout:5/455: write da/dc/d2d/d4d/d54/d67/f8c [685700,24264] 0 2023-12-16T05:56:34.980 INFO:tasks.workunit.client.1.smithi156.stdout:7/417: getdents d1e/d1f/d22/d2c/d57/d59 0 2023-12-16T05:56:34.981 INFO:tasks.workunit.client.1.smithi156.stdout:3/223: mkdir dc/d10/d1d/d4b/d52 0 2023-12-16T05:56:34.981 INFO:tasks.workunit.client.1.smithi156.stdout:4/254: mknod d9/c52 0 2023-12-16T05:56:34.981 INFO:tasks.workunit.client.1.smithi156.stdout:4/255: fsync d9/d2c/f2f 0 2023-12-16T05:56:34.982 INFO:tasks.workunit.client.1.smithi156.stdout:2/277: getdents d9/dd/d17/d33/d47 0 2023-12-16T05:56:34.982 INFO:tasks.workunit.client.1.smithi156.stdout:2/278: fdatasync d9/f22 0 2023-12-16T05:56:34.984 INFO:tasks.workunit.client.1.smithi156.stdout:6/269: rename d9/f41 to d9/d13/d3e/f54 0 2023-12-16T05:56:34.985 INFO:tasks.workunit.client.1.smithi156.stdout:2/279: getdents d9/dd 0 2023-12-16T05:56:34.985 INFO:tasks.workunit.client.1.smithi156.stdout:2/280: write d9/dd/d17/d33/d47/f4d [258305,75378] 0 2023-12-16T05:56:34.998 INFO:tasks.workunit.client.1.smithi156.stdout:5/456: dwrite da/dc/f3d [0,4194304] 0 2023-12-16T05:56:35.013 INFO:tasks.workunit.client.1.smithi156.stdout:4/256: dwrite f0 [0,4194304] 0 2023-12-16T05:56:35.014 INFO:tasks.workunit.client.1.smithi156.stdout:2/281: dwrite d9/f22 [4194304,4194304] 0 2023-12-16T05:56:35.014 INFO:tasks.workunit.client.1.smithi156.stdout:2/282: chown d9/dd/d17/c26 10843580 1 2023-12-16T05:56:35.014 INFO:tasks.workunit.client.1.smithi156.stdout:4/257: creat d9/d2b/d35/f53 x:0 0 0 2023-12-16T05:56:35.014 INFO:tasks.workunit.client.1.smithi156.stdout:4/258: chown d9/f18 1592414990 1 2023-12-16T05:56:35.019 INFO:tasks.workunit.client.0.smithi155.stdout:3/447: sync 2023-12-16T05:56:35.019 INFO:tasks.workunit.client.0.smithi155.stdout:3/448: chown d0/d14/c3f 3 1 2023-12-16T05:56:35.019 INFO:tasks.workunit.client.0.smithi155.stdout:3/449: chown d0/d14/d36 4 1 2023-12-16T05:56:35.019 INFO:tasks.workunit.client.1.smithi156.stdout:4/259: dread d9/f28 [0,4194304] 0 2023-12-16T05:56:35.020 INFO:tasks.workunit.client.1.smithi156.stdout:4/260: rmdir d9/d2c 39 2023-12-16T05:56:35.020 INFO:tasks.workunit.client.0.smithi155.stdout:3/450: creat d0/d14/d45/f8b x:0 0 0 2023-12-16T05:56:35.021 INFO:tasks.workunit.client.1.smithi156.stdout:4/261: creat d9/d43/f54 x:0 0 0 2023-12-16T05:56:35.021 INFO:tasks.workunit.client.0.smithi155.stdout:3/451: unlink d0/d14/f18 0 2023-12-16T05:56:35.022 INFO:tasks.workunit.client.0.smithi155.stdout:3/452: symlink d0/d14/d36/d79/d80/l8c 0 2023-12-16T05:56:35.033 INFO:tasks.workunit.client.1.smithi156.stdout:4/262: dread d9/f37 [0,4194304] 0 2023-12-16T05:56:35.034 INFO:tasks.workunit.client.1.smithi156.stdout:4/263: mknod d9/d2c/d48/c55 0 2023-12-16T05:56:35.050 INFO:tasks.workunit.client.1.smithi156.stdout:0/272: dwrite d2/d7/dd/f30 [0,4194304] 0 2023-12-16T05:56:35.051 INFO:tasks.workunit.client.1.smithi156.stdout:3/224: write dc/d10/f18 [471928,77097] 0 2023-12-16T05:56:35.054 INFO:tasks.workunit.client.1.smithi156.stdout:6/270: unlink d9/d13/d3e/f54 0 2023-12-16T05:56:35.056 INFO:tasks.workunit.client.1.smithi156.stdout:3/225: rename dc/d10/l12 to dc/d10/l53 0 2023-12-16T05:56:35.056 INFO:tasks.workunit.client.1.smithi156.stdout:5/457: dwrite da/dc/d2d/f41 [0,4194304] 0 2023-12-16T05:56:35.056 INFO:tasks.workunit.client.1.smithi156.stdout:4/264: dwrite d9/d2c/f3e [0,4194304] 0 2023-12-16T05:56:35.058 INFO:tasks.workunit.client.1.smithi156.stdout:6/271: creat d9/d13/d2f/d36/f55 x:0 0 0 2023-12-16T05:56:35.058 INFO:tasks.workunit.client.1.smithi156.stdout:2/283: dwrite d9/d12/d3d/f48 [0,4194304] 0 2023-12-16T05:56:35.061 INFO:tasks.workunit.client.1.smithi156.stdout:3/226: unlink dc/d10/d1d/f33 0 2023-12-16T05:56:35.062 INFO:tasks.workunit.client.1.smithi156.stdout:5/458: creat da/dc/d4b/d6c/d7c/d85/f8d x:0 0 0 2023-12-16T05:56:35.063 INFO:tasks.workunit.client.0.smithi155.stdout:3/453: dwrite d0/d1a/f78 [0,4194304] 0 2023-12-16T05:56:35.063 INFO:tasks.workunit.client.0.smithi155.stdout:3/454: chown d0/d14/d36/d47/d5f/f60 9788 1 2023-12-16T05:56:35.063 INFO:tasks.workunit.client.0.smithi155.stdout:3/455: dread - d0/d14/d45/f75 zero size 2023-12-16T05:56:35.063 INFO:tasks.workunit.client.0.smithi155.stdout:3/456: fdatasync d0/d14/d36/d79/d80/d73/f84 0 2023-12-16T05:56:35.063 INFO:tasks.workunit.client.0.smithi155.stdout:3/457: getdents d0/d14/d36/d47/d61 0 2023-12-16T05:56:35.065 INFO:tasks.workunit.client.0.smithi155.stdout:3/458: symlink d0/d14/d87/l8d 0 2023-12-16T05:56:35.065 INFO:tasks.workunit.client.0.smithi155.stdout:3/459: write d0/d1e/f32 [1879110,12080] 0 2023-12-16T05:56:35.065 INFO:tasks.workunit.client.1.smithi156.stdout:6/272: unlink d9/f3c 0 2023-12-16T05:56:35.066 INFO:tasks.workunit.client.0.smithi155.stdout:3/460: creat d0/d14/d36/d47/d5f/f8e x:0 0 0 2023-12-16T05:56:35.066 INFO:tasks.workunit.client.0.smithi155.stdout:3/461: write d0/d14/d45/f75 [286395,101270] 0 2023-12-16T05:56:35.067 INFO:tasks.workunit.client.1.smithi156.stdout:7/418: dwrite d1e/d1f/d22/d2c/d33/f50 [0,4194304] 0 2023-12-16T05:56:35.067 INFO:tasks.workunit.client.1.smithi156.stdout:4/265: getdents d9/d43 0 2023-12-16T05:56:35.068 INFO:tasks.workunit.client.0.smithi155.stdout:3/462: rename d0/d1e/d4e/c52 to d0/d14/d36/d79/d80/c8f 0 2023-12-16T05:56:35.069 INFO:tasks.workunit.client.0.smithi155.stdout:3/463: symlink d0/d14/d36/d7c/l90 0 2023-12-16T05:56:35.070 INFO:tasks.workunit.client.1.smithi156.stdout:2/284: rename d9/dd/l25 to d9/dd/l53 0 2023-12-16T05:56:35.070 INFO:tasks.workunit.client.1.smithi156.stdout:2/285: fsync d9/dd/f2f 0 2023-12-16T05:56:35.070 INFO:tasks.workunit.client.1.smithi156.stdout:2/286: chown d9/dd/f19 21 1 2023-12-16T05:56:35.072 INFO:tasks.workunit.client.1.smithi156.stdout:3/227: truncate dc/d10/d3d/f29 4060915 0 2023-12-16T05:56:35.074 INFO:tasks.workunit.client.0.smithi155.stdout:3/464: mkdir d0/d1a/d91 0 2023-12-16T05:56:35.074 INFO:tasks.workunit.client.1.smithi156.stdout:5/459: symlink da/dc/d2d/d4d/d54/d67/l8e 0 2023-12-16T05:56:35.076 INFO:tasks.workunit.client.1.smithi156.stdout:6/273: creat d9/d13/d2f/d51/f56 x:0 0 0 2023-12-16T05:56:35.077 INFO:tasks.workunit.client.0.smithi155.stdout:3/465: rename d0/l5 to d0/d14/d36/d47/l92 0 2023-12-16T05:56:35.077 INFO:tasks.workunit.client.1.smithi156.stdout:0/273: dwrite d2/f48 [0,4194304] 0 2023-12-16T05:56:35.077 INFO:tasks.workunit.client.1.smithi156.stdout:0/274: chown d2/d7/dd/d2d 3423 1 2023-12-16T05:56:35.078 INFO:tasks.workunit.client.1.smithi156.stdout:0/275: fdatasync d2/d23/f32 0 2023-12-16T05:56:35.080 INFO:tasks.workunit.client.1.smithi156.stdout:7/419: rename cf to d1e/d1f/d72/c8b 0 2023-12-16T05:56:35.082 INFO:tasks.workunit.client.1.smithi156.stdout:5/460: getdents da/dc/d2d 0 2023-12-16T05:56:35.085 INFO:tasks.workunit.client.1.smithi156.stdout:0/276: stat d2/d7/f3c 0 2023-12-16T05:56:35.086 INFO:tasks.workunit.client.1.smithi156.stdout:0/277: truncate d2/f48 5391895 0 2023-12-16T05:56:35.089 INFO:tasks.workunit.client.1.smithi156.stdout:3/228: rename dc/d10/f31 to dc/d10/d1d/d4b/d52/f54 0 2023-12-16T05:56:35.090 INFO:tasks.workunit.client.1.smithi156.stdout:5/461: mkdir da/dc/d4b/d6c/d77/d8f 0 2023-12-16T05:56:35.090 INFO:tasks.workunit.client.1.smithi156.stdout:5/462: stat da/l38 0 2023-12-16T05:56:35.090 INFO:tasks.workunit.client.1.smithi156.stdout:5/463: readlink da/dc/l5c 0 2023-12-16T05:56:35.097 INFO:tasks.workunit.client.1.smithi156.stdout:4/266: dwrite d9/f28 [0,4194304] 0 2023-12-16T05:56:35.097 INFO:tasks.workunit.client.1.smithi156.stdout:4/267: chown f0 0 1 2023-12-16T05:56:35.102 INFO:tasks.workunit.client.1.smithi156.stdout:5/464: mkdir da/dc/d2d/d4d/d54/d90 0 2023-12-16T05:56:35.102 INFO:tasks.workunit.client.1.smithi156.stdout:2/287: dwrite f8 [0,4194304] 0 2023-12-16T05:56:35.104 INFO:tasks.workunit.client.1.smithi156.stdout:6/274: dwrite d9/d1c/f49 [0,4194304] 0 2023-12-16T05:56:35.104 INFO:tasks.workunit.client.1.smithi156.stdout:5/465: write da/dc/d4b/f64 [476523,65116] 0 2023-12-16T05:56:35.105 INFO:tasks.workunit.client.1.smithi156.stdout:2/288: creat d9/f54 x:0 0 0 2023-12-16T05:56:35.105 INFO:tasks.workunit.client.1.smithi156.stdout:2/289: fsync f2 0 2023-12-16T05:56:35.106 INFO:tasks.workunit.client.1.smithi156.stdout:2/290: write d9/dd/d17/d33/d47/f4d [561683,73841] 0 2023-12-16T05:56:35.106 INFO:tasks.workunit.client.1.smithi156.stdout:7/420: dwrite d1e/d1f/d22/f79 [0,4194304] 0 2023-12-16T05:56:35.109 INFO:tasks.workunit.client.1.smithi156.stdout:2/291: rename d9/c29 to d9/dd/d17/d33/d38/d39/c55 0 2023-12-16T05:56:35.110 INFO:tasks.workunit.client.1.smithi156.stdout:7/421: truncate d1e/d1f/f53 368993 0 2023-12-16T05:56:35.110 INFO:tasks.workunit.client.1.smithi156.stdout:2/292: rmdir d9/dd 39 2023-12-16T05:56:35.111 INFO:tasks.workunit.client.0.smithi155.stdout:3/466: dwrite d0/d1a/d33/f72 [0,4194304] 0 2023-12-16T05:56:35.113 INFO:tasks.workunit.client.1.smithi156.stdout:7/422: rename d1e/d1f/d74/f87 to d1e/f8c 0 2023-12-16T05:56:35.115 INFO:tasks.workunit.client.1.smithi156.stdout:2/293: mkdir d9/d56 0 2023-12-16T05:56:35.115 INFO:tasks.workunit.client.1.smithi156.stdout:2/294: stat d9/d12/f36 0 2023-12-16T05:56:35.115 INFO:tasks.workunit.client.0.smithi155.stdout:3/467: read d0/d14/f6a [278239,35227] 0 2023-12-16T05:56:35.115 INFO:tasks.workunit.client.1.smithi156.stdout:0/278: dwrite d2/d23/f32 [0,4194304] 0 2023-12-16T05:56:35.117 INFO:tasks.workunit.client.1.smithi156.stdout:0/279: write d2/d7/dd/d29/f4f [2845889,9934] 0 2023-12-16T05:56:35.117 INFO:tasks.workunit.client.1.smithi156.stdout:2/295: symlink d9/dd/d17/d33/d47/l57 0 2023-12-16T05:56:35.118 INFO:tasks.workunit.client.1.smithi156.stdout:2/296: write d9/dd/d17/f51 [292362,44354] 0 2023-12-16T05:56:35.118 INFO:tasks.workunit.client.1.smithi156.stdout:7/423: write d1e/d55/d71/d61/f38 [401617,106131] 0 2023-12-16T05:56:35.121 INFO:tasks.workunit.client.1.smithi156.stdout:2/297: rename d9/dd/d17/f2b to d9/d12/f58 0 2023-12-16T05:56:35.123 INFO:tasks.workunit.client.1.smithi156.stdout:6/275: dwrite d9/d1c/f47 [0,4194304] 0 2023-12-16T05:56:35.123 INFO:tasks.workunit.client.1.smithi156.stdout:6/276: write d9/d1c/f2c [510800,53401] 0 2023-12-16T05:56:35.123 INFO:tasks.workunit.client.1.smithi156.stdout:6/277: stat d9/d13/d2f/f3f 0 2023-12-16T05:56:35.123 INFO:tasks.workunit.client.1.smithi156.stdout:0/280: dread d2/f28 [0,4194304] 0 2023-12-16T05:56:35.123 INFO:tasks.workunit.client.1.smithi156.stdout:0/281: write d2/d7/f3c [724890,11131] 0 2023-12-16T05:56:35.123 INFO:tasks.workunit.client.1.smithi156.stdout:7/424: rename d1e/d39/f62 to d1e/d55/d71/f8d 0 2023-12-16T05:56:35.125 INFO:tasks.workunit.client.1.smithi156.stdout:6/278: creat d9/d13/d3e/f57 x:0 0 0 2023-12-16T05:56:35.126 INFO:tasks.workunit.client.1.smithi156.stdout:0/282: getdents d2/d7 0 2023-12-16T05:56:35.128 INFO:tasks.workunit.client.1.smithi156.stdout:6/279: symlink d9/d13/l58 0 2023-12-16T05:56:35.129 INFO:tasks.workunit.client.1.smithi156.stdout:0/283: mkdir d2/d7/dd/d29/d38/d51 0 2023-12-16T05:56:35.130 INFO:tasks.workunit.client.1.smithi156.stdout:0/284: chown d2/d7/f3c 15349 1 2023-12-16T05:56:35.131 INFO:tasks.workunit.client.1.smithi156.stdout:2/298: rename d9/d12/l31 to d9/l59 0 2023-12-16T05:56:35.134 INFO:tasks.workunit.client.1.smithi156.stdout:7/425: rename d1e/d39/l52 to d1e/d1f/d22/d75/d77/l8e 0 2023-12-16T05:56:35.134 INFO:tasks.workunit.client.1.smithi156.stdout:5/466: dwrite da/dc/d4b/d6c/f7a [0,4194304] 0 2023-12-16T05:56:35.136 INFO:tasks.workunit.client.0.smithi155.stdout:3/468: dwrite d0/d1a/d33/d57/f6c [0,4194304] 0 2023-12-16T05:56:35.136 INFO:tasks.workunit.client.0.smithi155.stdout:0/564: sync 2023-12-16T05:56:35.136 INFO:tasks.workunit.client.0.smithi155.stdout:2/482: sync 2023-12-16T05:56:35.136 INFO:tasks.workunit.client.0.smithi155.stdout:8/513: sync 2023-12-16T05:56:35.136 INFO:tasks.workunit.client.0.smithi155.stdout:5/615: sync 2023-12-16T05:56:35.136 INFO:tasks.workunit.client.0.smithi155.stdout:9/740: sync 2023-12-16T05:56:35.136 INFO:tasks.workunit.client.0.smithi155.stdout:9/741: dread - da/d15/d17/d24/d26/d2e/d83/fdd zero size 2023-12-16T05:56:35.137 INFO:tasks.workunit.client.0.smithi155.stdout:9/742: write da/d15/d17/d24/f8a [714871,126319] 0 2023-12-16T05:56:35.137 INFO:tasks.workunit.client.1.smithi156.stdout:7/426: write f9 [2487464,74500] 0 2023-12-16T05:56:35.137 INFO:tasks.workunit.client.1.smithi156.stdout:7/427: readlink d1e/d1f/d22/d2c/d33/l60 0 2023-12-16T05:56:35.137 INFO:tasks.workunit.client.1.smithi156.stdout:7/428: write d1e/d1f/f53 [702059,99325] 0 2023-12-16T05:56:35.137 INFO:tasks.workunit.client.1.smithi156.stdout:2/299: truncate d9/dd/f19 24316 0 2023-12-16T05:56:35.138 INFO:tasks.workunit.client.1.smithi156.stdout:0/285: dread d2/d7/dd/f30 [0,4194304] 0 2023-12-16T05:56:35.139 INFO:tasks.workunit.client.0.smithi155.stdout:3/469: symlink d0/d14/d36/d79/d80/d73/l93 0 2023-12-16T05:56:35.139 INFO:tasks.workunit.client.0.smithi155.stdout:3/470: write d0/d14/d45/f8b [958586,50707] 0 2023-12-16T05:56:35.139 INFO:tasks.workunit.client.0.smithi155.stdout:0/565: dread d7/d2d/f3f [0,4194304] 0 2023-12-16T05:56:35.139 INFO:tasks.workunit.client.0.smithi155.stdout:0/566: stat d7/df/d6f/l6e 0 2023-12-16T05:56:35.140 INFO:tasks.workunit.client.0.smithi155.stdout:5/616: rmdir d0/d2/d2a 39 2023-12-16T05:56:35.140 INFO:tasks.workunit.client.0.smithi155.stdout:9/743: symlink da/d15/d17/d36/d5b/lff 0 2023-12-16T05:56:35.141 INFO:tasks.workunit.client.1.smithi156.stdout:5/467: mknod da/dc/d4b/d6c/d77/d8f/c91 0 2023-12-16T05:56:35.142 INFO:tasks.workunit.client.0.smithi155.stdout:3/471: dread d0/d14/d36/d79/d80/d73/f84 [0,4194304] 0 2023-12-16T05:56:35.142 INFO:tasks.workunit.client.0.smithi155.stdout:3/472: chown d0/d14/d36/d7c/c7e 0 1 2023-12-16T05:56:35.142 INFO:tasks.workunit.client.0.smithi155.stdout:3/473: truncate d0/d14/f6a 697886 0 2023-12-16T05:56:35.142 INFO:tasks.workunit.client.0.smithi155.stdout:3/474: write d0/f7f [667124,1298] 0 2023-12-16T05:56:35.142 INFO:tasks.workunit.client.0.smithi155.stdout:5/617: mkdir d0/d2/d2a/d19/d59/d66/dc8 0 2023-12-16T05:56:35.142 INFO:tasks.workunit.client.0.smithi155.stdout:3/475: readlink d0/d1a/l24 0 2023-12-16T05:56:35.142 INFO:tasks.workunit.client.0.smithi155.stdout:9/744: dread da/d15/f2f [0,4194304] 0 2023-12-16T05:56:35.142 INFO:tasks.workunit.client.0.smithi155.stdout:5/618: mkdir d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/dc9 0 2023-12-16T05:56:35.143 INFO:tasks.workunit.client.0.smithi155.stdout:6/746: sync 2023-12-16T05:56:35.143 INFO:tasks.workunit.client.0.smithi155.stdout:4/558: sync 2023-12-16T05:56:35.143 INFO:tasks.workunit.client.0.smithi155.stdout:7/556: sync 2023-12-16T05:56:35.143 INFO:tasks.workunit.client.0.smithi155.stdout:4/559: truncate d0/d10/d46/d16/d30/f7e 467820 0 2023-12-16T05:56:35.143 INFO:tasks.workunit.client.0.smithi155.stdout:1/677: sync 2023-12-16T05:56:35.146 INFO:tasks.workunit.client.0.smithi155.stdout:9/745: rename da/d15/d17/d24/d26/d2e/f40 to da/d15/d17/d24/d62/d91/f100 0 2023-12-16T05:56:35.146 INFO:tasks.workunit.client.0.smithi155.stdout:3/476: write d0/d1a/d33/d57/f6c [4596184,123534] 0 2023-12-16T05:56:35.147 INFO:tasks.workunit.client.0.smithi155.stdout:4/560: link d0/da/d36/d5f/d7b/fb4 d0/da/d36/d5f/d75/d89/d9a/fb5 0 2023-12-16T05:56:35.148 INFO:tasks.workunit.client.1.smithi156.stdout:2/300: mkdir d9/d5a 0 2023-12-16T05:56:35.149 INFO:tasks.workunit.client.1.smithi156.stdout:7/429: mknod d1e/d1f/d85/c8f 0 2023-12-16T05:56:35.150 INFO:tasks.workunit.client.0.smithi155.stdout:9/746: dread da/d15/d17/d24/d62/fc4 [0,4194304] 0 2023-12-16T05:56:35.151 INFO:tasks.workunit.client.0.smithi155.stdout:1/678: getdents d1 0 2023-12-16T05:56:35.153 INFO:tasks.workunit.client.0.smithi155.stdout:6/747: rename d0/d3/d2c/f30 to d0/d3/d2c/db8/ff9 0 2023-12-16T05:56:35.154 INFO:tasks.workunit.client.1.smithi156.stdout:5/468: dread da/dc/f2e [0,4194304] 0 2023-12-16T05:56:35.154 INFO:tasks.workunit.client.0.smithi155.stdout:1/679: creat d1/d7/d4b/d8e/dc7/fd5 x:0 0 0 2023-12-16T05:56:35.155 INFO:tasks.workunit.client.0.smithi155.stdout:6/748: creat d0/d3/d7a/db0/dc3/dce/ddd/d1b/dea/ffa x:0 0 0 2023-12-16T05:56:35.156 INFO:tasks.workunit.client.0.smithi155.stdout:5/619: dread d0/d2/d2a/d30/d53/d7b/f80 [0,4194304] 0 2023-12-16T05:56:35.156 INFO:tasks.workunit.client.0.smithi155.stdout:5/620: chown d0/d2/d2a/d19/c39 49 1 2023-12-16T05:56:35.156 INFO:tasks.workunit.client.0.smithi155.stdout:1/680: truncate d1/d7/d16/d30/f76 1020381 0 2023-12-16T05:56:35.158 INFO:tasks.workunit.client.0.smithi155.stdout:6/749: mkdir d0/d3/d7a/db0/dc3/dce/ddd/dd4/dfb 0 2023-12-16T05:56:35.159 INFO:tasks.workunit.client.0.smithi155.stdout:1/681: write d1/d7/d16/d30/f73 [727988,92471] 0 2023-12-16T05:56:35.159 INFO:tasks.workunit.client.1.smithi156.stdout:7/430: symlink d1e/d1f/d22/l90 0 2023-12-16T05:56:35.160 INFO:tasks.workunit.client.1.smithi156.stdout:2/301: unlink d9/d12/f23 0 2023-12-16T05:56:35.161 INFO:tasks.workunit.client.0.smithi155.stdout:7/557: dread d0/d1/d5/f1d [0,4194304] 0 2023-12-16T05:56:35.161 INFO:tasks.workunit.client.0.smithi155.stdout:5/621: creat d0/d2/d2a/d30/d53/d7b/d99/fca x:0 0 0 2023-12-16T05:56:35.161 INFO:tasks.workunit.client.0.smithi155.stdout:3/477: dread d0/d14/d36/d79/d80/d73/f84 [0,4194304] 0 2023-12-16T05:56:35.161 INFO:tasks.workunit.client.0.smithi155.stdout:3/478: write d0/d14/d36/d79/d80/f7a [704990,76070] 0 2023-12-16T05:56:35.162 INFO:tasks.workunit.client.0.smithi155.stdout:2/483: dwrite d0/d34/f40 [4194304,4194304] 0 2023-12-16T05:56:35.165 INFO:tasks.workunit.client.0.smithi155.stdout:7/558: mkdir d0/d1b/dbe 0 2023-12-16T05:56:35.165 INFO:tasks.workunit.client.0.smithi155.stdout:7/559: chown d0/d6a/d1a/d2b/d2c/l45 127 1 2023-12-16T05:56:35.165 INFO:tasks.workunit.client.1.smithi156.stdout:7/431: creat d1e/d55/d71/d61/f91 x:0 0 0 2023-12-16T05:56:35.166 INFO:tasks.workunit.client.0.smithi155.stdout:3/479: mkdir d0/d14/d87/d94 0 2023-12-16T05:56:35.167 INFO:tasks.workunit.client.0.smithi155.stdout:5/622: write d0/d2/fa6 [3405632,128115] 0 2023-12-16T05:56:35.170 INFO:tasks.workunit.client.0.smithi155.stdout:7/560: truncate d0/d6a/d1a/d8c/d42/f93 1732943 0 2023-12-16T05:56:35.172 INFO:tasks.workunit.client.0.smithi155.stdout:1/682: dread d1/d7/d4b/d8e/dc7/d28/d74/fbf [0,4194304] 0 2023-12-16T05:56:35.174 INFO:tasks.workunit.client.0.smithi155.stdout:7/561: dread d0/d6a/d1a/d8c/f7c [0,4194304] 0 2023-12-16T05:56:35.174 INFO:tasks.workunit.client.0.smithi155.stdout:5/623: write d0/d2/f1d [3445008,67216] 0 2023-12-16T05:56:35.174 INFO:tasks.workunit.client.0.smithi155.stdout:5/624: fdatasync d0/d2/d2a/d30/d53/d7b/f86 0 2023-12-16T05:56:35.175 INFO:tasks.workunit.client.1.smithi156.stdout:0/286: dwrite d2/d47/f46 [0,4194304] 0 2023-12-16T05:56:35.175 INFO:tasks.workunit.client.1.smithi156.stdout:0/287: chown d2/d7/dd/c20 2419 1 2023-12-16T05:56:35.177 INFO:tasks.workunit.client.0.smithi155.stdout:1/683: creat d1/d7/d4b/d8e/dc7/d28/d8f/db2/fd6 x:0 0 0 2023-12-16T05:56:35.177 INFO:tasks.workunit.client.1.smithi156.stdout:7/432: dread d1e/d1f/f3a [0,4194304] 0 2023-12-16T05:56:35.178 INFO:tasks.workunit.client.0.smithi155.stdout:7/562: creat d0/d6a/d1a/d8c/d42/d98/fbf x:0 0 0 2023-12-16T05:56:35.178 INFO:tasks.workunit.client.0.smithi155.stdout:7/563: truncate d0/d1/f44 779667 0 2023-12-16T05:56:35.179 INFO:tasks.workunit.client.1.smithi156.stdout:0/288: mkdir d2/d7/dd/d29/d38/d51/d52 0 2023-12-16T05:56:35.179 INFO:tasks.workunit.client.0.smithi155.stdout:5/625: creat d0/d2/d2a/d30/d53/d7b/db3/fcb x:0 0 0 2023-12-16T05:56:35.180 INFO:tasks.workunit.client.1.smithi156.stdout:7/433: creat d1e/d1f/d22/d2c/d57/f92 x:0 0 0 2023-12-16T05:56:35.180 INFO:tasks.workunit.client.0.smithi155.stdout:1/684: unlink d1/d7/d4b/d8e/dc7/l57 0 2023-12-16T05:56:35.180 INFO:tasks.workunit.client.0.smithi155.stdout:7/564: getdents d0/d6a/d85 0 2023-12-16T05:56:35.181 INFO:tasks.workunit.client.1.smithi156.stdout:0/289: creat d2/d7/dd/d29/d2e/f53 x:0 0 0 2023-12-16T05:56:35.181 INFO:tasks.workunit.client.1.smithi156.stdout:0/290: chown d2/d7/dd 129122 1 2023-12-16T05:56:35.181 INFO:tasks.workunit.client.1.smithi156.stdout:0/291: write d2/d7/dd/f41 [293502,113565] 0 2023-12-16T05:56:35.181 INFO:tasks.workunit.client.1.smithi156.stdout:7/434: stat d1e/d55/d71/d61/c6a 0 2023-12-16T05:56:35.182 INFO:tasks.workunit.client.0.smithi155.stdout:5/626: creat d0/d2/d2a/d30/d53/d7b/fcc x:0 0 0 2023-12-16T05:56:35.183 INFO:tasks.workunit.client.0.smithi155.stdout:1/685: creat d1/d7/d4b/d8e/dc7/d28/d8f/dad/fd7 x:0 0 0 2023-12-16T05:56:35.183 INFO:tasks.workunit.client.1.smithi156.stdout:7/435: mkdir d1e/d39/d93 0 2023-12-16T05:56:35.184 INFO:tasks.workunit.client.0.smithi155.stdout:3/480: dread d0/d1a/f1d [0,4194304] 0 2023-12-16T05:56:35.184 INFO:tasks.workunit.client.1.smithi156.stdout:7/436: mkdir d1e/d55/d71/d94 0 2023-12-16T05:56:35.184 INFO:tasks.workunit.client.1.smithi156.stdout:7/437: chown d1e/d55/d71/d61/f91 132 1 2023-12-16T05:56:35.184 INFO:tasks.workunit.client.1.smithi156.stdout:7/438: chown d1e/d1f/d22/d2c/d57/d59/c5c 697031639 1 2023-12-16T05:56:35.184 INFO:tasks.workunit.client.1.smithi156.stdout:7/439: fsync d1e/d1f/d22/d2c/f5e 0 2023-12-16T05:56:35.185 INFO:tasks.workunit.client.1.smithi156.stdout:0/292: dread f0 [4194304,4194304] 0 2023-12-16T05:56:35.186 INFO:tasks.workunit.client.0.smithi155.stdout:6/750: dwrite d0/d3/d7a/db0/dc3/dce/ddd/f97 [0,4194304] 0 2023-12-16T05:56:35.187 INFO:tasks.workunit.client.0.smithi155.stdout:5/627: mknod d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/ccd 0 2023-12-16T05:56:35.187 INFO:tasks.workunit.client.0.smithi155.stdout:5/628: chown d0/c4e 5 1 2023-12-16T05:56:35.187 INFO:tasks.workunit.client.0.smithi155.stdout:1/686: creat d1/d7/d4b/d8e/fd8 x:0 0 0 2023-12-16T05:56:35.187 INFO:tasks.workunit.client.0.smithi155.stdout:1/687: write d1/d25/d43/d5d/d5e/fa1 [396850,75086] 0 2023-12-16T05:56:35.187 INFO:tasks.workunit.client.0.smithi155.stdout:1/688: chown d1/d7/d4b/d72/d79/f9d 6 1 2023-12-16T05:56:35.191 INFO:tasks.workunit.client.1.smithi156.stdout:0/293: dread d2/d7/dd/d29/d2e/f3a [0,4194304] 0 2023-12-16T05:56:35.192 INFO:tasks.workunit.client.0.smithi155.stdout:2/484: dwrite d0/d5/d6/f7c [8388608,4194304] 0 2023-12-16T05:56:35.192 INFO:tasks.workunit.client.0.smithi155.stdout:2/485: write d0/d7/d69/f93 [119859,17850] 0 2023-12-16T05:56:35.193 INFO:tasks.workunit.client.1.smithi156.stdout:0/294: creat d2/d23/d4a/f54 x:0 0 0 2023-12-16T05:56:35.194 INFO:tasks.workunit.client.0.smithi155.stdout:5/629: mkdir d0/d2/d2a/d30/d53/d7b/d99/d47/d61/db6/dce 0 2023-12-16T05:56:35.194 INFO:tasks.workunit.client.0.smithi155.stdout:5/630: readlink d0/d2/d2a/d30/d53/d7b/d99/d47/la9 0 2023-12-16T05:56:35.195 INFO:tasks.workunit.client.0.smithi155.stdout:1/689: creat d1/d69/fd9 x:0 0 0 2023-12-16T05:56:35.195 INFO:tasks.workunit.client.1.smithi156.stdout:0/295: mkdir d2/d23/d55 0 2023-12-16T05:56:35.196 INFO:tasks.workunit.client.0.smithi155.stdout:6/751: dread d0/d3/d7a/db0/dc3/dce/ddd/f63 [0,4194304] 0 2023-12-16T05:56:35.196 INFO:tasks.workunit.client.0.smithi155.stdout:6/752: chown d0/d3/d7a/db0/dc3/dce/ddd/fde 1 1 2023-12-16T05:56:35.196 INFO:tasks.workunit.client.1.smithi156.stdout:2/302: truncate d9/dd/d17/f51 263194 0 2023-12-16T05:56:35.196 INFO:tasks.workunit.client.1.smithi156.stdout:2/303: write d9/fa [1260588,72402] 0 2023-12-16T05:56:35.198 INFO:tasks.workunit.client.1.smithi156.stdout:0/296: link d2/d7/dd/d1c/l37 d2/d7/dd/l56 0 2023-12-16T05:56:35.199 INFO:tasks.workunit.client.1.smithi156.stdout:7/440: getdents d1e/d1f/d85 0 2023-12-16T05:56:35.199 INFO:tasks.workunit.client.1.smithi156.stdout:7/441: chown d1e/d1f/d22/c31 511 1 2023-12-16T05:56:35.199 INFO:tasks.workunit.client.0.smithi155.stdout:2/486: truncate d0/f4 613785 0 2023-12-16T05:56:35.200 INFO:tasks.workunit.client.0.smithi155.stdout:5/631: mknod d0/d60/d79/d8e/ccf 0 2023-12-16T05:56:35.200 INFO:tasks.workunit.client.0.smithi155.stdout:5/632: fsync d0/d2/d2a/d30/d53/d7b/d99/d47/dbb/fc4 0 2023-12-16T05:56:35.200 INFO:tasks.workunit.client.0.smithi155.stdout:5/633: stat d0/d2/d2a/d30/d53/d7b/d99/f5c 0 2023-12-16T05:56:35.200 INFO:tasks.workunit.client.1.smithi156.stdout:0/297: rmdir d2/d7/dd/d29/d38/d51 39 2023-12-16T05:56:35.200 INFO:tasks.workunit.client.1.smithi156.stdout:0/298: write d2/d7/dd/f41 [440584,47898] 0 2023-12-16T05:56:35.201 INFO:tasks.workunit.client.0.smithi155.stdout:6/753: rename d0/df/d5e/d46/d6d/f74 to d0/df/d5e/d5b/dd7/ffc 0 2023-12-16T05:56:35.202 INFO:tasks.workunit.client.0.smithi155.stdout:2/487: creat d0/d7/d69/d77/fa4 x:0 0 0 2023-12-16T05:56:35.202 INFO:tasks.workunit.client.1.smithi156.stdout:2/304: link d9/dd/d17/d33/d38/d39/c46 d9/d12/c5b 0 2023-12-16T05:56:35.202 INFO:tasks.workunit.client.0.smithi155.stdout:5/634: stat d0/d2/ca7 0 2023-12-16T05:56:35.203 INFO:tasks.workunit.client.0.smithi155.stdout:3/481: dwrite d0/d14/f6a [0,4194304] 0 2023-12-16T05:56:35.203 INFO:tasks.workunit.client.0.smithi155.stdout:3/482: chown d0/f12 0 1 2023-12-16T05:56:35.204 INFO:tasks.workunit.client.1.smithi156.stdout:5/469: dwrite da/f36 [4194304,4194304] 0 2023-12-16T05:56:35.204 INFO:tasks.workunit.client.1.smithi156.stdout:7/442: symlink d1e/d39/d93/l95 0 2023-12-16T05:56:35.205 INFO:tasks.workunit.client.0.smithi155.stdout:3/483: read d0/f31 [158515,36543] 0 2023-12-16T05:56:35.205 INFO:tasks.workunit.client.0.smithi155.stdout:4/561: dwrite d0/d10/f12 [0,4194304] 0 2023-12-16T05:56:35.205 INFO:tasks.workunit.client.0.smithi155.stdout:3/484: write d0/d14/d45/f54 [5022526,105363] 0 2023-12-16T05:56:35.205 INFO:tasks.workunit.client.0.smithi155.stdout:3/485: fdatasync d0/d14/f28 0 2023-12-16T05:56:35.205 INFO:tasks.workunit.client.0.smithi155.stdout:6/754: rename d0/d3/d7a/f4e to d0/df/d43/ffd 0 2023-12-16T05:56:35.205 INFO:tasks.workunit.client.1.smithi156.stdout:0/299: rename d2/d7/f10 to d2/d7/dd/d29/d2e/f57 0 2023-12-16T05:56:35.206 INFO:tasks.workunit.client.0.smithi155.stdout:2/488: mknod d0/d7/d1f/d74/ca5 0 2023-12-16T05:56:35.206 INFO:tasks.workunit.client.1.smithi156.stdout:2/305: creat d9/f5c x:0 0 0 2023-12-16T05:56:35.206 INFO:tasks.workunit.client.1.smithi156.stdout:2/306: fdatasync d9/f27 0 2023-12-16T05:56:35.207 INFO:tasks.workunit.client.0.smithi155.stdout:5/635: mknod d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/cd0 0 2023-12-16T05:56:35.209 INFO:tasks.workunit.client.1.smithi156.stdout:5/470: creat da/dc/d4b/d6c/f92 x:0 0 0 2023-12-16T05:56:35.209 INFO:tasks.workunit.client.1.smithi156.stdout:5/471: read - da/dc/d2d/f43 zero size 2023-12-16T05:56:35.209 INFO:tasks.workunit.client.1.smithi156.stdout:5/472: truncate da/dc/d2d/f58 374734 0 2023-12-16T05:56:35.209 INFO:tasks.workunit.client.0.smithi155.stdout:3/486: dread d0/f55 [0,4194304] 0 2023-12-16T05:56:35.209 INFO:tasks.workunit.client.0.smithi155.stdout:1/690: dread d1/d7/d16/d30/f76 [0,4194304] 0 2023-12-16T05:56:35.210 INFO:tasks.workunit.client.1.smithi156.stdout:7/443: mknod d1e/d1f/d22/d2c/c96 0 2023-12-16T05:56:35.210 INFO:tasks.workunit.client.1.smithi156.stdout:7/444: rename d1e/d1f/d22/d75 to d1e/d1f/d22/d75/d97 22 2023-12-16T05:56:35.211 INFO:tasks.workunit.client.0.smithi155.stdout:4/562: symlink d0/da/d36/d5f/d75/d3d/d49/lb6 0 2023-12-16T05:56:35.211 INFO:tasks.workunit.client.1.smithi156.stdout:0/300: rmdir d2/d7/dd/d29/d38/d3f 39 2023-12-16T05:56:35.213 INFO:tasks.workunit.client.1.smithi156.stdout:2/307: creat d9/dd/f5d x:0 0 0 2023-12-16T05:56:35.213 INFO:tasks.workunit.client.1.smithi156.stdout:2/308: chown d9/dd/d17/d33/l41 102 1 2023-12-16T05:56:35.213 INFO:tasks.workunit.client.1.smithi156.stdout:2/309: fsync d9/f20 0 2023-12-16T05:56:35.214 INFO:tasks.workunit.client.0.smithi155.stdout:2/489: creat d0/d7/dd/d14/fa6 x:0 0 0 2023-12-16T05:56:35.214 INFO:tasks.workunit.client.0.smithi155.stdout:2/490: truncate d0/d34/f72 1433219 0 2023-12-16T05:56:35.215 INFO:tasks.workunit.client.1.smithi156.stdout:5/473: link da/dc/f31 da/dc/d4b/f93 0 2023-12-16T05:56:35.217 INFO:tasks.workunit.client.0.smithi155.stdout:5/636: unlink d0/d2/d2a/d30/f75 0 2023-12-16T05:56:35.218 INFO:tasks.workunit.client.0.smithi155.stdout:3/487: mkdir d0/d14/d36/d83/d95 0 2023-12-16T05:56:35.219 INFO:tasks.workunit.client.0.smithi155.stdout:4/563: mkdir d0/d10/d46/d16/d1a/d70/d92/daf/db7 0 2023-12-16T05:56:35.220 INFO:tasks.workunit.client.0.smithi155.stdout:2/491: getdents d0/d7/d57/d9b 0 2023-12-16T05:56:35.220 INFO:tasks.workunit.client.0.smithi155.stdout:2/492: dread - d0/d34/f5a zero size 2023-12-16T05:56:35.221 INFO:tasks.workunit.client.1.smithi156.stdout:7/445: link d1e/l7b d1e/d1f/d22/d2c/d57/l98 0 2023-12-16T05:56:35.222 INFO:tasks.workunit.client.0.smithi155.stdout:5/637: creat d0/d2/fd1 x:0 0 0 2023-12-16T05:56:35.222 INFO:tasks.workunit.client.0.smithi155.stdout:7/565: dread d0/d6a/d1a/d8c/d42/f93 [0,4194304] 0 2023-12-16T05:56:35.222 INFO:tasks.workunit.client.0.smithi155.stdout:7/566: stat d0/d6a/d1a/d8c/f75 0 2023-12-16T05:56:35.222 INFO:tasks.workunit.client.0.smithi155.stdout:7/567: chown d0/d1/fe 945 1 2023-12-16T05:56:35.223 INFO:tasks.workunit.client.1.smithi156.stdout:0/301: creat d2/d7/dd/d29/d38/d3f/f58 x:0 0 0 2023-12-16T05:56:35.223 INFO:tasks.workunit.client.1.smithi156.stdout:0/302: chown d2/d47/f46 769555440 1 2023-12-16T05:56:35.223 INFO:tasks.workunit.client.1.smithi156.stdout:7/446: write d1e/d1f/d22/d2c/d33/f50 [273877,117255] 0 2023-12-16T05:56:35.223 INFO:tasks.workunit.client.1.smithi156.stdout:7/447: chown d1e/d1f/d22/d2c/f4d 433135 1 2023-12-16T05:56:35.224 INFO:tasks.workunit.client.1.smithi156.stdout:2/310: truncate d9/dd/d17/f3a 3100628 0 2023-12-16T05:56:35.224 INFO:tasks.workunit.client.0.smithi155.stdout:3/488: stat d0/d14/d36/d47/l92 0 2023-12-16T05:56:35.226 INFO:tasks.workunit.client.1.smithi156.stdout:5/474: creat da/dc/d2d/f94 x:0 0 0 2023-12-16T05:56:35.226 INFO:tasks.workunit.client.0.smithi155.stdout:1/691: dwrite d1/d69/f8a [0,4194304] 0 2023-12-16T05:56:35.226 INFO:tasks.workunit.client.0.smithi155.stdout:1/692: chown d1/d7/d16/d30/f76 96745 1 2023-12-16T05:56:35.227 INFO:tasks.workunit.client.0.smithi155.stdout:5/638: symlink d0/d2/d2a/d30/d53/d7b/d99/d47/d61/ld2 0 2023-12-16T05:56:35.227 INFO:tasks.workunit.client.0.smithi155.stdout:5/639: readlink d0/d2/d2a/d30/d53/d7b/d99/d47/l7c 0 2023-12-16T05:56:35.227 INFO:tasks.workunit.client.1.smithi156.stdout:7/448: creat d1e/d1f/d22/d2c/d33/f99 x:0 0 0 2023-12-16T05:56:35.228 INFO:tasks.workunit.client.0.smithi155.stdout:7/568: creat d0/d6a/d1a/d38/fc0 x:0 0 0 2023-12-16T05:56:35.228 INFO:tasks.workunit.client.1.smithi156.stdout:2/311: truncate f5 3812131 0 2023-12-16T05:56:35.228 INFO:tasks.workunit.client.1.smithi156.stdout:2/312: readlink l6 0 2023-12-16T05:56:35.229 INFO:tasks.workunit.client.1.smithi156.stdout:7/449: dread d1e/d39/f3f [0,4194304] 0 2023-12-16T05:56:35.229 INFO:tasks.workunit.client.1.smithi156.stdout:7/450: chown d1e/d1f/d22 654498 1 2023-12-16T05:56:35.231 INFO:tasks.workunit.client.1.smithi156.stdout:0/303: dread d2/f3d [0,4194304] 0 2023-12-16T05:56:35.231 INFO:tasks.workunit.client.1.smithi156.stdout:0/304: readlink d2/l34 0 2023-12-16T05:56:35.231 INFO:tasks.workunit.client.0.smithi155.stdout:1/693: creat d1/d7/d4b/d5c/fda x:0 0 0 2023-12-16T05:56:35.233 INFO:tasks.workunit.client.0.smithi155.stdout:5/640: mkdir d0/d60/d79/d97/d9c/dd3 0 2023-12-16T05:56:35.233 INFO:tasks.workunit.client.1.smithi156.stdout:5/475: truncate da/dc/f2c 4134245 0 2023-12-16T05:56:35.234 INFO:tasks.workunit.client.1.smithi156.stdout:5/476: chown da/l32 70232 1 2023-12-16T05:56:35.235 INFO:tasks.workunit.client.1.smithi156.stdout:7/451: symlink d1e/d1f/d22/l9a 0 2023-12-16T05:56:35.236 INFO:tasks.workunit.client.1.smithi156.stdout:0/305: mknod d2/d7/dd/d1c/c59 0 2023-12-16T05:56:35.239 INFO:tasks.workunit.client.1.smithi156.stdout:5/477: rename da/l32 to da/dc/d2d/d4d/l95 0 2023-12-16T05:56:35.242 INFO:tasks.workunit.client.0.smithi155.stdout:6/755: rename d0/df/d5e/d5b/dd7/ffc to d0/df/d5e/d99/ffe 0 2023-12-16T05:56:35.242 INFO:tasks.workunit.client.0.smithi155.stdout:6/756: stat d0/c34 0 2023-12-16T05:56:35.243 INFO:tasks.workunit.client.0.smithi155.stdout:6/757: read d0/d3/d2c/d3e/faf [4095364,64100] 0 2023-12-16T05:56:35.243 INFO:tasks.workunit.client.0.smithi155.stdout:6/758: dread - d0/d3/d7a/db0/dc3/dce/ddd/ff0 zero size 2023-12-16T05:56:35.244 INFO:tasks.workunit.client.0.smithi155.stdout:1/694: symlink d1/d7/d4b/d8e/ldb 0 2023-12-16T05:56:35.246 INFO:tasks.workunit.client.1.smithi156.stdout:0/306: creat d2/d23/d4a/f5a x:0 0 0 2023-12-16T05:56:35.247 INFO:tasks.workunit.client.0.smithi155.stdout:5/641: mknod d0/d2/d2a/d30/d53/d7b/d99/d47/dbb/cd4 0 2023-12-16T05:56:35.247 INFO:tasks.workunit.client.0.smithi155.stdout:5/642: fdatasync d0/d2/d4f/fa4 0 2023-12-16T05:56:35.247 INFO:tasks.workunit.client.1.smithi156.stdout:0/307: getdents d2/d7/dd/d29 0 2023-12-16T05:56:35.249 INFO:tasks.workunit.client.0.smithi155.stdout:6/759: dread d0/d3/d7a/db0/dc3/dce/ddd/f7b [0,4194304] 0 2023-12-16T05:56:35.250 INFO:tasks.workunit.client.0.smithi155.stdout:2/493: rename d0/d7/d1f/d74/d85/f90 to d0/d7/d57/fa7 0 2023-12-16T05:56:35.251 INFO:tasks.workunit.client.0.smithi155.stdout:1/695: rmdir d1/d7/d4b/d8e/dc7/d28/d74 39 2023-12-16T05:56:35.251 INFO:tasks.workunit.client.0.smithi155.stdout:1/696: fsync d1/d7/d4b/d72/fa6 0 2023-12-16T05:56:35.251 INFO:tasks.workunit.client.1.smithi156.stdout:0/308: link d2/f48 d2/d7/dd/f5b 0 2023-12-16T05:56:35.252 INFO:tasks.workunit.client.1.smithi156.stdout:2/313: dread d9/dd/d17/f51 [0,4194304] 0 2023-12-16T05:56:35.253 INFO:tasks.workunit.client.0.smithi155.stdout:5/643: rmdir d0/d2/d2a/d19/d71 39 2023-12-16T05:56:35.253 INFO:tasks.workunit.client.0.smithi155.stdout:5/644: dread - d0/d2/d2a/d30/d53/fbe zero size 2023-12-16T05:56:35.255 INFO:tasks.workunit.client.0.smithi155.stdout:4/564: dwrite d0/da/d36/d5f/d75/d3d/d43/f4e [4194304,4194304] 0 2023-12-16T05:56:35.257 INFO:tasks.workunit.client.0.smithi155.stdout:3/489: rename d0/d14/c16 to d0/d14/d36/d79/d80/c96 0 2023-12-16T05:56:35.257 INFO:tasks.workunit.client.0.smithi155.stdout:7/569: dwrite d0/d6a/d1a/d8c/d34/fb2 [0,4194304] 0 2023-12-16T05:56:35.258 INFO:tasks.workunit.client.0.smithi155.stdout:3/490: read d0/d14/f50 [953912,74424] 0 2023-12-16T05:56:35.259 INFO:tasks.workunit.client.0.smithi155.stdout:1/697: creat d1/d7/d4b/d8e/fdc x:0 0 0 2023-12-16T05:56:35.259 INFO:tasks.workunit.client.0.smithi155.stdout:1/698: chown d1/d7/d4b/d8e/fd3 114880 1 2023-12-16T05:56:35.262 INFO:tasks.workunit.client.0.smithi155.stdout:2/494: write d0/d7/f5e [2525330,29900] 0 2023-12-16T05:56:35.262 INFO:tasks.workunit.client.0.smithi155.stdout:4/565: write d0/d10/d46/f40 [2227245,59167] 0 2023-12-16T05:56:35.263 INFO:tasks.workunit.client.1.smithi156.stdout:1/166: sync 2023-12-16T05:56:35.263 INFO:tasks.workunit.client.1.smithi156.stdout:9/256: sync 2023-12-16T05:56:35.265 INFO:tasks.workunit.client.1.smithi156.stdout:1/167: symlink d3/l35 0 2023-12-16T05:56:35.265 INFO:tasks.workunit.client.1.smithi156.stdout:2/314: dread d9/dd/f2f [0,4194304] 0 2023-12-16T05:56:35.266 INFO:tasks.workunit.client.0.smithi155.stdout:7/570: unlink d0/d6a/d1a/d8c/d42/f93 0 2023-12-16T05:56:35.266 INFO:tasks.workunit.client.0.smithi155.stdout:5/645: dread d0/d2/f1a [0,4194304] 0 2023-12-16T05:56:35.266 INFO:tasks.workunit.client.0.smithi155.stdout:5/646: fdatasync d0/d60/d79/d8e/f98 0 2023-12-16T05:56:35.266 INFO:tasks.workunit.client.0.smithi155.stdout:3/491: mkdir d0/d14/d36/d83/d97 0 2023-12-16T05:56:35.267 INFO:tasks.workunit.client.1.smithi156.stdout:2/315: truncate d9/f44 1370758 0 2023-12-16T05:56:35.268 INFO:tasks.workunit.client.1.smithi156.stdout:2/316: creat d9/d12/f5e x:0 0 0 2023-12-16T05:56:35.269 INFO:tasks.workunit.client.1.smithi156.stdout:2/317: chown l6 142905870 1 2023-12-16T05:56:35.269 INFO:tasks.workunit.client.1.smithi156.stdout:2/318: readlink l3 0 2023-12-16T05:56:35.269 INFO:tasks.workunit.client.0.smithi155.stdout:1/699: creat d1/d7/d4b/d72/fdd x:0 0 0 2023-12-16T05:56:35.271 INFO:tasks.workunit.client.1.smithi156.stdout:7/452: dwrite d1e/f8c [0,4194304] 0 2023-12-16T05:56:35.272 INFO:tasks.workunit.client.1.smithi156.stdout:2/319: unlink d9/dd/c37 0 2023-12-16T05:56:35.272 INFO:tasks.workunit.client.1.smithi156.stdout:2/320: stat d9/dd/f5d 0 2023-12-16T05:56:35.272 INFO:tasks.workunit.client.0.smithi155.stdout:2/495: symlink d0/d7/d1f/la8 0 2023-12-16T05:56:35.273 INFO:tasks.workunit.client.0.smithi155.stdout:2/496: truncate d0/f1a 771721 0 2023-12-16T05:56:35.275 INFO:tasks.workunit.client.0.smithi155.stdout:4/566: creat d0/d10/d46/d16/d1a/d70/d92/daf/fb8 x:0 0 0 2023-12-16T05:56:35.275 INFO:tasks.workunit.client.0.smithi155.stdout:4/567: write d0/d10/d46/d16/d30/faa [644578,59392] 0 2023-12-16T05:56:35.278 INFO:tasks.workunit.client.0.smithi155.stdout:5/647: rmdir d0/d2/d2a/d19/d59/d66/dc8 0 2023-12-16T05:56:35.281 INFO:tasks.workunit.client.0.smithi155.stdout:2/497: rename d0/d5/d6/f1c to d0/d34/d3c/fa9 0 2023-12-16T05:56:35.283 INFO:tasks.workunit.client.1.smithi156.stdout:5/478: dwrite da/f49 [0,4194304] 0 2023-12-16T05:56:35.283 INFO:tasks.workunit.client.1.smithi156.stdout:5/479: stat da/dc/f31 0 2023-12-16T05:56:35.293 INFO:tasks.workunit.client.0.smithi155.stdout:7/571: dwrite d0/d6a/d1a/d22/f25 [0,4194304] 0 2023-12-16T05:56:35.293 INFO:tasks.workunit.client.0.smithi155.stdout:7/572: write d0/d6a/d1a/d38/f41 [9199862,84429] 0 2023-12-16T05:56:35.295 INFO:tasks.workunit.client.1.smithi156.stdout:5/480: dread da/dc/d4b/d6c/f7a [0,4194304] 0 2023-12-16T05:56:35.296 INFO:tasks.workunit.client.0.smithi155.stdout:7/573: dread d0/d1/f44 [0,4194304] 0 2023-12-16T05:56:35.296 INFO:tasks.workunit.client.1.smithi156.stdout:5/481: link da/dc/d4b/d6c/d7c/c72 da/dc/d4b/d6c/d7c/c96 0 2023-12-16T05:56:35.297 INFO:tasks.workunit.client.0.smithi155.stdout:7/574: truncate d0/d1/d5/f1d 1329324 0 2023-12-16T05:56:35.297 INFO:tasks.workunit.client.0.smithi155.stdout:7/575: write d0/d6a/d1a/d8c/f7c [1941308,51565] 0 2023-12-16T05:56:35.299 INFO:tasks.workunit.client.1.smithi156.stdout:5/482: rename da/dc/d2d/d34/l5b to da/dc/d4b/d6c/d77/d8f/l97 0 2023-12-16T05:56:35.303 INFO:tasks.workunit.client.0.smithi155.stdout:6/760: dwrite d0/fc [0,4194304] 0 2023-12-16T05:56:35.303 INFO:tasks.workunit.client.0.smithi155.stdout:6/761: chown d0/d3/d7a/d77/ff6 6773 1 2023-12-16T05:56:35.306 INFO:tasks.workunit.client.0.smithi155.stdout:6/762: mknod d0/df/d5e/d7e/cff 0 2023-12-16T05:56:35.306 INFO:tasks.workunit.client.0.smithi155.stdout:6/763: creat d0/df/d5e/d7e/dd8/f100 x:0 0 0 2023-12-16T05:56:35.307 INFO:tasks.workunit.client.1.smithi156.stdout:0/309: dwrite d2/d7/dd/d29/d2e/f57 [0,4194304] 0 2023-12-16T05:56:35.308 INFO:tasks.workunit.client.1.smithi156.stdout:0/310: chown d2/f48 36274 1 2023-12-16T05:56:35.309 INFO:tasks.workunit.client.0.smithi155.stdout:6/764: rename d0/df/f35 to d0/d3/d7a/d77/f101 0 2023-12-16T05:56:35.310 INFO:tasks.workunit.client.1.smithi156.stdout:0/311: mkdir d2/d7/dd/d5c 0 2023-12-16T05:56:35.312 INFO:tasks.workunit.client.1.smithi156.stdout:0/312: symlink d2/d7/dd/d5c/l5d 0 2023-12-16T05:56:35.312 INFO:tasks.workunit.client.0.smithi155.stdout:6/765: read d0/d3/d7a/f9c [721895,103948] 0 2023-12-16T05:56:35.326 INFO:tasks.workunit.client.1.smithi156.stdout:9/257: dwrite d6/f1e [0,4194304] 0 2023-12-16T05:56:35.326 INFO:tasks.workunit.client.1.smithi156.stdout:9/258: write d6/d2e/f35 [1060124,62036] 0 2023-12-16T05:56:35.329 INFO:tasks.workunit.client.1.smithi156.stdout:1/168: dwrite d3/d17/d19/f26 [0,4194304] 0 2023-12-16T05:56:35.329 INFO:tasks.workunit.client.1.smithi156.stdout:4/268: sync 2023-12-16T05:56:35.330 INFO:tasks.workunit.client.1.smithi156.stdout:8/202: sync 2023-12-16T05:56:35.330 INFO:tasks.workunit.client.1.smithi156.stdout:3/229: sync 2023-12-16T05:56:35.330 INFO:tasks.workunit.client.1.smithi156.stdout:8/203: write d3/d7/f2c [872917,33355] 0 2023-12-16T05:56:35.331 INFO:tasks.workunit.client.1.smithi156.stdout:9/259: read d6/d19/f2a [2651619,93153] 0 2023-12-16T05:56:35.331 INFO:tasks.workunit.client.1.smithi156.stdout:1/169: mknod d3/d17/d2d/c36 0 2023-12-16T05:56:35.332 INFO:tasks.workunit.client.1.smithi156.stdout:8/204: getdents d3/d18 0 2023-12-16T05:56:35.332 INFO:tasks.workunit.client.1.smithi156.stdout:8/205: readlink d3/l21 0 2023-12-16T05:56:35.333 INFO:tasks.workunit.client.1.smithi156.stdout:9/260: mknod d6/d19/d30/c58 0 2023-12-16T05:56:35.335 INFO:tasks.workunit.client.1.smithi156.stdout:1/170: rmdir d3/d1b/d32 0 2023-12-16T05:56:35.336 INFO:tasks.workunit.client.1.smithi156.stdout:3/230: write dc/f14 [1200799,91215] 0 2023-12-16T05:56:35.336 INFO:tasks.workunit.client.1.smithi156.stdout:8/206: symlink d3/l3f 0 2023-12-16T05:56:35.336 INFO:tasks.workunit.client.1.smithi156.stdout:3/231: truncate dc/d10/d1d/f32 132898 0 2023-12-16T05:56:35.336 INFO:tasks.workunit.client.1.smithi156.stdout:3/232: fdatasync f8 0 2023-12-16T05:56:35.337 INFO:tasks.workunit.client.1.smithi156.stdout:3/233: creat dc/df/f55 x:0 0 0 2023-12-16T05:56:35.338 INFO:tasks.workunit.client.1.smithi156.stdout:3/234: mkdir dc/d56 0 2023-12-16T05:56:35.338 INFO:tasks.workunit.client.1.smithi156.stdout:3/235: dread - dc/df/f55 zero size 2023-12-16T05:56:35.340 INFO:tasks.workunit.client.1.smithi156.stdout:8/207: write d3/d18/f1b [1727727,87238] 0 2023-12-16T05:56:35.341 INFO:tasks.workunit.client.1.smithi156.stdout:3/236: unlink dc/f4c 0 2023-12-16T05:56:35.341 INFO:tasks.workunit.client.1.smithi156.stdout:3/237: chown dc/df/d34/c47 236 1 2023-12-16T05:56:35.343 INFO:tasks.workunit.client.1.smithi156.stdout:8/208: creat d3/d7/d9/f40 x:0 0 0 2023-12-16T05:56:35.343 INFO:tasks.workunit.client.1.smithi156.stdout:7/453: dwrite d1e/d55/d71/f4b [0,4194304] 0 2023-12-16T05:56:35.343 INFO:tasks.workunit.client.1.smithi156.stdout:7/454: stat d1e/d39/d93/l95 0 2023-12-16T05:56:35.344 INFO:tasks.workunit.client.1.smithi156.stdout:7/455: chown d1e/d1f/d22/d75/d77/c7a 1026820 1 2023-12-16T05:56:35.344 INFO:tasks.workunit.client.1.smithi156.stdout:7/456: chown d1e/d55/d71/d94 4246459 1 2023-12-16T05:56:35.344 INFO:tasks.workunit.client.1.smithi156.stdout:2/321: dwrite d9/d12/f58 [0,4194304] 0 2023-12-16T05:56:35.344 INFO:tasks.workunit.client.1.smithi156.stdout:2/322: chown d9/dd/d17/d33/d47/l57 526 1 2023-12-16T05:56:35.344 INFO:tasks.workunit.client.1.smithi156.stdout:3/238: stat dc/d10/d1d/c4d 0 2023-12-16T05:56:35.344 INFO:tasks.workunit.client.1.smithi156.stdout:0/313: dwrite d2/d7/dd/f33 [0,4194304] 0 2023-12-16T05:56:35.345 INFO:tasks.workunit.client.1.smithi156.stdout:1/171: dread d3/f18 [0,4194304] 0 2023-12-16T05:56:35.345 INFO:tasks.workunit.client.1.smithi156.stdout:6/280: sync 2023-12-16T05:56:35.346 INFO:tasks.workunit.client.0.smithi155.stdout:6/766: dwrite d0/d3/d7a/db0/dc3/ff1 [0,4194304] 0 2023-12-16T05:56:35.346 INFO:tasks.workunit.client.0.smithi155.stdout:5/648: dwrite d0/d2/d2a/d19/d71/fb1 [0,4194304] 0 2023-12-16T05:56:35.346 INFO:tasks.workunit.client.0.smithi155.stdout:5/649: stat d0/c41 0 2023-12-16T05:56:35.346 INFO:tasks.workunit.client.0.smithi155.stdout:5/650: write d0/d2/d2a/d30/d53/d7b/d99/f6c [1367694,50039] 0 2023-12-16T05:56:35.346 INFO:tasks.workunit.client.0.smithi155.stdout:7/576: dwrite d0/d1/d5/fd [0,4194304] 0 2023-12-16T05:56:35.346 INFO:tasks.workunit.client.0.smithi155.stdout:4/568: dwrite d0/d10/d46/f40 [0,4194304] 0 2023-12-16T05:56:35.347 INFO:tasks.workunit.client.0.smithi155.stdout:2/498: dwrite d0/d7/d57/fa7 [0,4194304] 0 2023-12-16T05:56:35.347 INFO:tasks.workunit.client.0.smithi155.stdout:6/767: symlink d0/df/d5e/d46/d6d/de3/l102 0 2023-12-16T05:56:35.348 INFO:tasks.workunit.client.1.smithi156.stdout:2/323: read d9/d12/f58 [1402057,40526] 0 2023-12-16T05:56:35.350 INFO:tasks.workunit.client.0.smithi155.stdout:4/569: symlink d0/d10/d46/d16/d30/d52/lb9 0 2023-12-16T05:56:35.350 INFO:tasks.workunit.client.1.smithi156.stdout:7/457: rmdir d1e/d1f/d22/d2c/d57/d59 39 2023-12-16T05:56:35.352 INFO:tasks.workunit.client.0.smithi155.stdout:2/499: getdents d0/d5/d8a 0 2023-12-16T05:56:35.352 INFO:tasks.workunit.client.0.smithi155.stdout:2/500: chown d0/d7/d69/d77/fa4 116412 1 2023-12-16T05:56:35.352 INFO:tasks.workunit.client.0.smithi155.stdout:2/501: readlink d0/d5/d6/l6b 0 2023-12-16T05:56:35.354 INFO:tasks.workunit.client.1.smithi156.stdout:0/314: dread d2/d7/dd/f30 [0,4194304] 0 2023-12-16T05:56:35.355 INFO:tasks.workunit.client.0.smithi155.stdout:2/502: truncate d0/d7/d1f/f4a 1389437 0 2023-12-16T05:56:35.355 INFO:tasks.workunit.client.0.smithi155.stdout:2/503: chown d0/d7/d1f/d74/c64 7 1 2023-12-16T05:56:35.356 INFO:tasks.workunit.client.1.smithi156.stdout:4/269: dwrite f5 [0,4194304] 0 2023-12-16T05:56:35.357 INFO:tasks.workunit.client.0.smithi155.stdout:4/570: dread d0/d10/f2c [0,4194304] 0 2023-12-16T05:56:35.359 INFO:tasks.workunit.client.0.smithi155.stdout:4/571: creat d0/da/d36/d5f/d75/d50/fba x:0 0 0 2023-12-16T05:56:35.360 INFO:tasks.workunit.client.0.smithi155.stdout:2/504: dread d0/d34/d3c/fa9 [0,4194304] 0 2023-12-16T05:56:35.361 INFO:tasks.workunit.client.1.smithi156.stdout:3/239: rename dc/f25 to dc/d10/d3d/f57 0 2023-12-16T05:56:35.361 INFO:tasks.workunit.client.1.smithi156.stdout:6/281: creat d9/d13/d3e/f59 x:0 0 0 2023-12-16T05:56:35.361 INFO:tasks.workunit.client.1.smithi156.stdout:6/282: chown d9/d1c/f49 429427790 1 2023-12-16T05:56:35.362 INFO:tasks.workunit.client.0.smithi155.stdout:5/651: dread d0/d2/d2a/d19/d21/fa2 [0,4194304] 0 2023-12-16T05:56:35.364 INFO:tasks.workunit.client.0.smithi155.stdout:5/652: mkdir d0/d2/d2a/d30/d53/db5/db9/dd5 0 2023-12-16T05:56:35.365 INFO:tasks.workunit.client.1.smithi156.stdout:0/315: mkdir d2/d7/dd/d2d/d5e 0 2023-12-16T05:56:35.365 INFO:tasks.workunit.client.1.smithi156.stdout:0/316: fdatasync d2/d23/f32 0 2023-12-16T05:56:35.365 INFO:tasks.workunit.client.1.smithi156.stdout:1/172: dwrite d3/d1b/f25 [0,4194304] 0 2023-12-16T05:56:35.366 INFO:tasks.workunit.client.1.smithi156.stdout:1/173: read d3/f15 [4502138,57614] 0 2023-12-16T05:56:35.366 INFO:tasks.workunit.client.1.smithi156.stdout:4/270: dread d9/d2c/f3e [0,4194304] 0 2023-12-16T05:56:35.367 INFO:tasks.workunit.client.1.smithi156.stdout:1/174: write f1 [2393045,19869] 0 2023-12-16T05:56:35.367 INFO:tasks.workunit.client.1.smithi156.stdout:3/240: symlink dc/d10/d1d/d4b/d52/l58 0 2023-12-16T05:56:35.371 INFO:tasks.workunit.client.0.smithi155.stdout:7/577: rmdir d0/d6a/d1a/d8c/d42 39 2023-12-16T05:56:35.374 INFO:tasks.workunit.client.1.smithi156.stdout:0/317: symlink d2/d7/dd/d29/d38/d3f/d44/l5f 0 2023-12-16T05:56:35.377 INFO:tasks.workunit.client.1.smithi156.stdout:4/271: mkdir d9/d2b/d56 0 2023-12-16T05:56:35.377 INFO:tasks.workunit.client.1.smithi156.stdout:4/272: fsync d9/f4f 0 2023-12-16T05:56:35.382 INFO:tasks.workunit.client.0.smithi155.stdout:6/768: dwrite d0/d3/d7a/d77/fa5 [0,4194304] 0 2023-12-16T05:56:35.382 INFO:tasks.workunit.client.0.smithi155.stdout:6/769: dread - d0/df/d5e/fd5 zero size 2023-12-16T05:56:35.384 INFO:tasks.workunit.client.1.smithi156.stdout:3/241: symlink dc/d10/d3d/l59 0 2023-12-16T05:56:35.385 INFO:tasks.workunit.client.1.smithi156.stdout:3/242: stat dc/df/d34/f3f 0 2023-12-16T05:56:35.385 INFO:tasks.workunit.client.0.smithi155.stdout:6/770: rename d0/df/d43 to d0/df/d5e/d7e/db6/dc6/d103 0 2023-12-16T05:56:35.386 INFO:tasks.workunit.client.0.smithi155.stdout:6/771: chown d0/d3/d2c/d3e/cdc 0 1 2023-12-16T05:56:35.386 INFO:tasks.workunit.client.0.smithi155.stdout:6/772: chown d0/d3/d2c/db8/ff9 37552 1 2023-12-16T05:56:35.386 INFO:tasks.workunit.client.0.smithi155.stdout:6/773: stat d0/cc0 0 2023-12-16T05:56:35.386 INFO:tasks.workunit.client.0.smithi155.stdout:6/774: readlink d0/d3/l40 0 2023-12-16T05:56:35.386 INFO:tasks.workunit.client.0.smithi155.stdout:6/775: read - d0/d3/d7a/db0/fb7 zero size 2023-12-16T05:56:35.388 INFO:tasks.workunit.client.1.smithi156.stdout:0/318: creat d2/d23/d55/f60 x:0 0 0 2023-12-16T05:56:35.389 INFO:tasks.workunit.client.0.smithi155.stdout:6/776: write d0/d3/d7a/db0/dc3/dce/ddd/d1b/f6a [3730819,119002] 0 2023-12-16T05:56:35.390 INFO:tasks.workunit.client.1.smithi156.stdout:2/324: dwrite d9/f5c [0,4194304] 0 2023-12-16T05:56:35.390 INFO:tasks.workunit.client.1.smithi156.stdout:4/273: link d9/c10 d9/c57 0 2023-12-16T05:56:35.397 INFO:tasks.workunit.client.1.smithi156.stdout:8/209: truncate d3/d18/f1b 3971503 0 2023-12-16T05:56:35.397 INFO:tasks.workunit.client.1.smithi156.stdout:0/319: mknod d2/d7/dd/d29/d38/d51/c61 0 2023-12-16T05:56:35.398 INFO:tasks.workunit.client.1.smithi156.stdout:1/175: dwrite d3/d1b/d27/f29 [0,4194304] 0 2023-12-16T05:56:35.398 INFO:tasks.workunit.client.1.smithi156.stdout:7/458: dwrite d1e/d1f/d22/d2c/d33/f99 [0,4194304] 0 2023-12-16T05:56:35.399 INFO:tasks.workunit.client.1.smithi156.stdout:2/325: rmdir d9/dd/d17/d33/d38/d39 39 2023-12-16T05:56:35.401 INFO:tasks.workunit.client.0.smithi155.stdout:5/653: dwrite d0/d2/d2a/f2e [0,4194304] 0 2023-12-16T05:56:35.401 INFO:tasks.workunit.client.0.smithi155.stdout:5/654: stat d0/d2/d2a/l25 0 2023-12-16T05:56:35.401 INFO:tasks.workunit.client.0.smithi155.stdout:5/655: read d0/d2/d2a/d30/f70 [372841,53457] 0 2023-12-16T05:56:35.401 INFO:tasks.workunit.client.1.smithi156.stdout:4/274: mkdir d9/d43/d58 0 2023-12-16T05:56:35.402 INFO:tasks.workunit.client.1.smithi156.stdout:4/275: chown d9/d2b/d35/f53 2883758 1 2023-12-16T05:56:35.403 INFO:tasks.workunit.client.1.smithi156.stdout:8/210: rename d3/d12/d16/f3a to d3/d18/f41 0 2023-12-16T05:56:35.403 INFO:tasks.workunit.client.1.smithi156.stdout:8/211: write d3/d18/f41 [1023158,56287] 0 2023-12-16T05:56:35.405 INFO:tasks.workunit.client.1.smithi156.stdout:1/176: getdents d3/d17/d1c 0 2023-12-16T05:56:35.411 INFO:tasks.workunit.client.0.smithi155.stdout:5/656: write d0/d2/d2a/f7f [79183,16943] 0 2023-12-16T05:56:35.411 INFO:tasks.workunit.client.0.smithi155.stdout:4/572: dwrite d0/d10/d46/d16/d1a/f5c [4194304,4194304] 0 2023-12-16T05:56:35.413 INFO:tasks.workunit.client.0.smithi155.stdout:5/657: getdents d0/d2/d2a/d30 0 2023-12-16T05:56:35.415 INFO:tasks.workunit.client.1.smithi156.stdout:7/459: creat d1e/d55/d71/f9b x:0 0 0 2023-12-16T05:56:35.415 INFO:tasks.workunit.client.1.smithi156.stdout:3/243: dwrite dc/f14 [4194304,4194304] 0 2023-12-16T05:56:35.415 INFO:tasks.workunit.client.1.smithi156.stdout:3/244: chown dc/d10/d1d/l26 1128276327 1 2023-12-16T05:56:35.415 INFO:tasks.workunit.client.1.smithi156.stdout:2/326: mkdir d9/d56/d5f 0 2023-12-16T05:56:35.415 INFO:tasks.workunit.client.1.smithi156.stdout:6/283: rmdir d9/d13/d3e 39 2023-12-16T05:56:35.415 INFO:tasks.workunit.client.1.smithi156.stdout:6/284: write d9/d13/d3e/f59 [603113,116448] 0 2023-12-16T05:56:35.416 INFO:tasks.workunit.client.0.smithi155.stdout:2/505: dwrite d0/d7/d1f/d74/f46 [0,4194304] 0 2023-12-16T05:56:35.417 INFO:tasks.workunit.client.1.smithi156.stdout:4/276: unlink f8 0 2023-12-16T05:56:35.419 INFO:tasks.workunit.client.1.smithi156.stdout:6/285: write d9/d13/f17 [769640,99390] 0 2023-12-16T05:56:35.419 INFO:tasks.workunit.client.1.smithi156.stdout:0/320: rename d2/d23/f3b to d2/d7/dd/d29/f62 0 2023-12-16T05:56:35.419 INFO:tasks.workunit.client.1.smithi156.stdout:0/321: chown d2/d7/dd/d29/d2e/f53 123 1 2023-12-16T05:56:35.420 INFO:tasks.workunit.client.0.smithi155.stdout:6/777: dread d0/d3/d2c/fd9 [0,4194304] 0 2023-12-16T05:56:35.420 INFO:tasks.workunit.client.0.smithi155.stdout:4/573: rename d0/d10/d46/d16/d1a/d70/d9f to d0/da/d36/d5f/d75/d3d/d49/dbb 0 2023-12-16T05:56:35.421 INFO:tasks.workunit.client.1.smithi156.stdout:1/177: creat d3/d1b/f37 x:0 0 0 2023-12-16T05:56:35.421 INFO:tasks.workunit.client.1.smithi156.stdout:7/460: dread d1e/d1f/d22/f23 [0,4194304] 0 2023-12-16T05:56:35.421 INFO:tasks.workunit.client.1.smithi156.stdout:0/322: read d2/d7/dd/d29/f4f [3817610,115212] 0 2023-12-16T05:56:35.421 INFO:tasks.workunit.client.1.smithi156.stdout:7/461: read d1e/d55/d71/d61/f36 [891375,124220] 0 2023-12-16T05:56:35.423 INFO:tasks.workunit.client.1.smithi156.stdout:2/327: stat d9/l3b 0 2023-12-16T05:56:35.423 INFO:tasks.workunit.client.1.smithi156.stdout:2/328: fdatasync d9/f1f 0 2023-12-16T05:56:35.424 INFO:tasks.workunit.client.1.smithi156.stdout:6/286: creat d9/d13/d2f/d36/f5a x:0 0 0 2023-12-16T05:56:35.425 INFO:tasks.workunit.client.1.smithi156.stdout:6/287: rename d9/d13 to d9/d13/d3e/d5b 22 2023-12-16T05:56:35.426 INFO:tasks.workunit.client.1.smithi156.stdout:7/462: symlink d1e/d1f/d22/l9c 0 2023-12-16T05:56:35.426 INFO:tasks.workunit.client.1.smithi156.stdout:7/463: read d1e/f27 [20796,11229] 0 2023-12-16T05:56:35.429 INFO:tasks.workunit.client.1.smithi156.stdout:6/288: unlink d9/d1c/c31 0 2023-12-16T05:56:35.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:35 smithi156 ceph-mon[121001]: Updating smithi156:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:56:35.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:35 smithi156 ceph-mon[121001]: Updating smithi155:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:56:35.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:35 smithi156 ceph-mon[121001]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-12-16T05:56:35.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:35 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:35.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:35 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:35.435 INFO:tasks.workunit.client.1.smithi156.stdout:8/212: dwrite d3/d7/d9/f33 [0,4194304] 0 2023-12-16T05:56:35.435 INFO:tasks.workunit.client.1.smithi156.stdout:2/329: dread f5 [0,4194304] 0 2023-12-16T05:56:35.435 INFO:tasks.workunit.client.1.smithi156.stdout:2/330: fdatasync d9/dd/d17/d33/d38/f3c 0 2023-12-16T05:56:35.435 INFO:tasks.workunit.client.0.smithi155.stdout:6/778: link d0/cac d0/d3/d2c/c104 0 2023-12-16T05:56:35.435 INFO:tasks.workunit.client.0.smithi155.stdout:7/578: dwrite d0/d6a/d1a/d8c/d42/d98/f50 [0,4194304] 0 2023-12-16T05:56:35.435 INFO:tasks.workunit.client.0.smithi155.stdout:6/779: mkdir d0/df/d5e/d5b/d105 0 2023-12-16T05:56:35.436 INFO:tasks.workunit.client.0.smithi155.stdout:6/780: read d0/df/f90 [543611,100167] 0 2023-12-16T05:56:35.439 INFO:tasks.workunit.client.0.smithi155.stdout:5/658: dwrite d0/d2/d2a/f45 [0,4194304] 0 2023-12-16T05:56:35.439 INFO:tasks.workunit.client.0.smithi155.stdout:5/659: stat d0/d2/ca7 0 2023-12-16T05:56:35.440 INFO:tasks.workunit.client.1.smithi156.stdout:0/323: dread d2/d7/dd/f5b [0,4194304] 0 2023-12-16T05:56:35.440 INFO:tasks.workunit.client.1.smithi156.stdout:0/324: write d2/d7/dd/d29/d38/d3f/f58 [669722,41277] 0 2023-12-16T05:56:35.440 INFO:tasks.workunit.client.1.smithi156.stdout:0/325: write d2/d23/f27 [1004066,10273] 0 2023-12-16T05:56:35.441 INFO:tasks.workunit.client.1.smithi156.stdout:4/277: dread d9/d2c/f32 [0,4194304] 0 2023-12-16T05:56:35.441 INFO:tasks.workunit.client.0.smithi155.stdout:7/579: symlink d0/d6a/d1a/d2b/db9/lc1 0 2023-12-16T05:56:35.444 INFO:tasks.workunit.client.1.smithi156.stdout:8/213: symlink d3/d7/d9/d3c/l42 0 2023-12-16T05:56:35.444 INFO:tasks.workunit.client.1.smithi156.stdout:8/214: chown d3/d7 0 1 2023-12-16T05:56:35.444 INFO:tasks.workunit.client.1.smithi156.stdout:8/215: chown d3/d18 24 1 2023-12-16T05:56:35.445 INFO:tasks.workunit.client.1.smithi156.stdout:0/326: symlink d2/d7/dd/d29/l63 0 2023-12-16T05:56:35.445 INFO:tasks.workunit.client.1.smithi156.stdout:0/327: rename d2/d7/dd/d29/d38/d3f to d2/d7/dd/d29/d38/d3f/d64 22 2023-12-16T05:56:35.445 INFO:tasks.workunit.client.1.smithi156.stdout:0/328: chown c1 184159 1 2023-12-16T05:56:35.445 INFO:tasks.workunit.client.1.smithi156.stdout:0/329: fsync d2/d7/dd/d1c/f25 0 2023-12-16T05:56:35.445 INFO:tasks.workunit.client.1.smithi156.stdout:0/330: truncate d2/d7/dd/d29/f4f 4349475 0 2023-12-16T05:56:35.446 INFO:tasks.workunit.client.0.smithi155.stdout:2/506: read d0/d7/d1f/f4a [817418,98938] 0 2023-12-16T05:56:35.446 INFO:tasks.workunit.client.0.smithi155.stdout:6/781: creat d0/d3/d7a/f106 x:0 0 0 2023-12-16T05:56:35.446 INFO:tasks.workunit.client.1.smithi156.stdout:8/216: link d3/l26 d3/d18/l43 0 2023-12-16T05:56:35.446 INFO:tasks.workunit.client.1.smithi156.stdout:8/217: chown d3/d7/f31 9345826 1 2023-12-16T05:56:35.447 INFO:tasks.workunit.client.1.smithi156.stdout:0/331: mkdir d2/d7/dd/d29/d38/d51/d65 0 2023-12-16T05:56:35.448 INFO:tasks.workunit.client.0.smithi155.stdout:5/660: symlink d0/d2/d2a/d19/d71/ld6 0 2023-12-16T05:56:35.448 INFO:tasks.workunit.client.0.smithi155.stdout:5/661: chown d0/d2/d2a/d19/d21/f36 16410 1 2023-12-16T05:56:35.448 INFO:tasks.workunit.client.0.smithi155.stdout:6/782: write d0/d3/d2c/f6c [540544,76404] 0 2023-12-16T05:56:35.449 INFO:tasks.workunit.client.0.smithi155.stdout:6/783: chown d0/d3/d7a/db0/fb7 16 1 2023-12-16T05:56:35.451 INFO:tasks.workunit.client.0.smithi155.stdout:7/580: mknod d0/cc2 0 2023-12-16T05:56:35.451 INFO:tasks.workunit.client.1.smithi156.stdout:0/332: unlink d2/f48 0 2023-12-16T05:56:35.451 INFO:tasks.workunit.client.1.smithi156.stdout:0/333: fdatasync d2/d7/dd/d29/d2e/f57 0 2023-12-16T05:56:35.451 INFO:tasks.workunit.client.1.smithi156.stdout:8/218: write d3/d18/f19 [2396055,33206] 0 2023-12-16T05:56:35.453 INFO:tasks.workunit.client.0.smithi155.stdout:2/507: unlink d0/d34/d3c/fa9 0 2023-12-16T05:56:35.453 INFO:tasks.workunit.client.0.smithi155.stdout:2/508: dread - d0/d7/dd/d14/fa6 zero size 2023-12-16T05:56:35.455 INFO:tasks.workunit.client.1.smithi156.stdout:8/219: rename d3/d6/l1c to d3/l44 0 2023-12-16T05:56:35.455 INFO:tasks.workunit.client.1.smithi156.stdout:8/220: chown d3/d18/l43 76474389 1 2023-12-16T05:56:35.455 INFO:tasks.workunit.client.0.smithi155.stdout:6/784: rmdir d0/df/d5e/d46 39 2023-12-16T05:56:35.456 INFO:tasks.workunit.client.1.smithi156.stdout:8/221: read d3/d7/f2c [156592,5429] 0 2023-12-16T05:56:35.457 INFO:tasks.workunit.client.0.smithi155.stdout:6/785: unlink d0/df/d5e/d46/d6d/de3/l102 0 2023-12-16T05:56:35.458 INFO:tasks.workunit.client.0.smithi155.stdout:6/786: stat d0/df/d5e/d7e/db6/dc6/d103/ca7 0 2023-12-16T05:56:35.458 INFO:tasks.workunit.client.0.smithi155.stdout:6/787: write d0/d3/d7a/db0/dc3/dce/ddd/ff0 [858681,111234] 0 2023-12-16T05:56:35.459 INFO:tasks.workunit.client.1.smithi156.stdout:1/178: write d3/fc [1657991,95466] 0 2023-12-16T05:56:35.459 INFO:tasks.workunit.client.1.smithi156.stdout:1/179: chown d3/d17/d1c/d22 57 1 2023-12-16T05:56:35.459 INFO:tasks.workunit.client.1.smithi156.stdout:3/245: dwrite dc/d10/d1d/f3a [0,4194304] 0 2023-12-16T05:56:35.459 INFO:tasks.workunit.client.1.smithi156.stdout:1/180: dread - d3/d17/d19/f2e zero size 2023-12-16T05:56:35.460 INFO:tasks.workunit.client.1.smithi156.stdout:1/181: readlink l2 0 2023-12-16T05:56:35.460 INFO:tasks.workunit.client.0.smithi155.stdout:2/509: dread d0/d7/d1f/d74/d85/d88/f89 [0,4194304] 0 2023-12-16T05:56:35.461 INFO:tasks.workunit.client.0.smithi155.stdout:6/788: rmdir d0/d3/d7a/d77 39 2023-12-16T05:56:35.461 INFO:tasks.workunit.client.1.smithi156.stdout:8/222: link d3/d12/l13 d3/d12/l45 0 2023-12-16T05:56:35.461 INFO:tasks.workunit.client.1.smithi156.stdout:8/223: dread - d3/d7/d9/f40 zero size 2023-12-16T05:56:35.461 INFO:tasks.workunit.client.1.smithi156.stdout:4/278: dread d9/f19 [4194304,4194304] 0 2023-12-16T05:56:35.462 INFO:tasks.workunit.client.1.smithi156.stdout:7/464: dwrite d1e/d55/f7e [0,4194304] 0 2023-12-16T05:56:35.462 INFO:tasks.workunit.client.1.smithi156.stdout:7/465: chown c16 0 1 2023-12-16T05:56:35.462 INFO:tasks.workunit.client.1.smithi156.stdout:7/466: read d1e/d1f/d22/d2c/f4d [4087500,3012] 0 2023-12-16T05:56:35.464 INFO:tasks.workunit.client.0.smithi155.stdout:2/510: getdents d0/d34 0 2023-12-16T05:56:35.464 INFO:tasks.workunit.client.0.smithi155.stdout:2/511: write d0/d7/d57/fa7 [4461500,43455] 0 2023-12-16T05:56:35.466 INFO:tasks.workunit.client.0.smithi155.stdout:7/581: dread d0/d6a/d1a/d8c/d34/d4b/f7f [0,4194304] 0 2023-12-16T05:56:35.469 INFO:tasks.workunit.client.1.smithi156.stdout:6/289: dwrite d9/d1c/f39 [4194304,4194304] 0 2023-12-16T05:56:35.470 INFO:tasks.workunit.client.0.smithi155.stdout:8/514: sync 2023-12-16T05:56:35.470 INFO:tasks.workunit.client.0.smithi155.stdout:9/747: sync 2023-12-16T05:56:35.471 INFO:tasks.workunit.client.0.smithi155.stdout:0/567: sync 2023-12-16T05:56:35.471 INFO:tasks.workunit.client.0.smithi155.stdout:0/568: write d7/df/d73/d8d/f6b [323782,26778] 0 2023-12-16T05:56:35.472 INFO:tasks.workunit.client.1.smithi156.stdout:7/467: read d1e/d1f/f76 [3283833,10734] 0 2023-12-16T05:56:35.472 INFO:tasks.workunit.client.1.smithi156.stdout:7/468: write d1e/d1f/d22/d2c/d57/f92 [708906,128545] 0 2023-12-16T05:56:35.472 INFO:tasks.workunit.client.1.smithi156.stdout:7/469: write d1e/d1f/d22/d2c/f6c [501590,127890] 0 2023-12-16T05:56:35.472 INFO:tasks.workunit.client.1.smithi156.stdout:7/470: truncate f7 5270282 0 2023-12-16T05:56:35.472 INFO:tasks.workunit.client.1.smithi156.stdout:7/471: chown d1e/d39/f3f 433526 1 2023-12-16T05:56:35.473 INFO:tasks.workunit.client.0.smithi155.stdout:5/662: dwrite d0/d2/d2a/d30/d53/fbe [0,4194304] 0 2023-12-16T05:56:35.474 INFO:tasks.workunit.client.0.smithi155.stdout:8/515: getdents d4/d62/d66/d78/d88/d1b/d1c/d97/d29 0 2023-12-16T05:56:35.474 INFO:tasks.workunit.client.0.smithi155.stdout:8/516: write d4/d62/d66/d78/d88/d1b/d1c/d46/f89 [999670,129339] 0 2023-12-16T05:56:35.474 INFO:tasks.workunit.client.1.smithi156.stdout:3/246: rename dc/d10/l1e to dc/d10/d3d/l5a 0 2023-12-16T05:56:35.476 INFO:tasks.workunit.client.0.smithi155.stdout:2/512: dread d0/d7/dd/f26 [0,4194304] 0 2023-12-16T05:56:35.476 INFO:tasks.workunit.client.0.smithi155.stdout:2/513: fdatasync d0/d7/d1f/d74/f54 0 2023-12-16T05:56:35.476 INFO:tasks.workunit.client.1.smithi156.stdout:1/182: symlink d3/d17/l38 0 2023-12-16T05:56:35.477 INFO:tasks.workunit.client.0.smithi155.stdout:0/569: mkdir d7/df/d73/dba 0 2023-12-16T05:56:35.478 INFO:tasks.workunit.client.1.smithi156.stdout:8/224: mkdir d3/d7/d27/d46 0 2023-12-16T05:56:35.479 INFO:tasks.workunit.client.0.smithi155.stdout:7/582: dread d0/d1/d5/f9 [0,4194304] 0 2023-12-16T05:56:35.480 INFO:tasks.workunit.client.0.smithi155.stdout:7/583: read d0/f15 [4953678,54947] 0 2023-12-16T05:56:35.481 INFO:tasks.workunit.client.1.smithi156.stdout:3/247: write dc/d10/f18 [3492041,75693] 0 2023-12-16T05:56:35.481 INFO:tasks.workunit.client.1.smithi156.stdout:8/225: dread d3/d18/f39 [0,4194304] 0 2023-12-16T05:56:35.481 INFO:tasks.workunit.client.1.smithi156.stdout:3/248: fdatasync dc/d10/d3d/f38 0 2023-12-16T05:56:35.482 INFO:tasks.workunit.client.1.smithi156.stdout:8/226: read - d3/d7/f31 zero size 2023-12-16T05:56:35.482 INFO:tasks.workunit.client.0.smithi155.stdout:8/517: rename d4/d62/d66/d78/d88/d1b/d2a/d5e to d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab 0 2023-12-16T05:56:35.482 INFO:tasks.workunit.client.1.smithi156.stdout:4/279: creat d9/f59 x:0 0 0 2023-12-16T05:56:35.482 INFO:tasks.workunit.client.1.smithi156.stdout:4/280: fsync d9/f1b 0 2023-12-16T05:56:35.483 INFO:tasks.workunit.client.0.smithi155.stdout:2/514: creat d0/d7/dd/d62/faa x:0 0 0 2023-12-16T05:56:35.484 INFO:tasks.workunit.client.0.smithi155.stdout:0/570: symlink d7/d13/d46/d81/lbb 0 2023-12-16T05:56:35.484 INFO:tasks.workunit.client.0.smithi155.stdout:0/571: truncate d7/df/d73/db3/fb9 65882 0 2023-12-16T05:56:35.485 INFO:tasks.workunit.client.1.smithi156.stdout:7/472: dread d1e/f32 [0,4194304] 0 2023-12-16T05:56:35.485 INFO:tasks.workunit.client.1.smithi156.stdout:0/334: dwrite d2/d47/f46 [0,4194304] 0 2023-12-16T05:56:35.485 INFO:tasks.workunit.client.0.smithi155.stdout:7/584: creat d0/d6a/d85/fc3 x:0 0 0 2023-12-16T05:56:35.486 INFO:tasks.workunit.client.0.smithi155.stdout:8/518: creat d4/fac x:0 0 0 2023-12-16T05:56:35.488 INFO:tasks.workunit.client.1.smithi156.stdout:6/290: mkdir d9/d13/d2f/d36/d5c 0 2023-12-16T05:56:35.490 INFO:tasks.workunit.client.1.smithi156.stdout:1/183: mknod d3/d17/d1c/d22/c39 0 2023-12-16T05:56:35.490 INFO:tasks.workunit.client.1.smithi156.stdout:1/184: chown d3/d17/l30 19 1 2023-12-16T05:56:35.492 INFO:tasks.workunit.client.1.smithi156.stdout:1/185: dread d3/f14 [0,4194304] 0 2023-12-16T05:56:35.492 INFO:tasks.workunit.client.1.smithi156.stdout:1/186: readlink d3/d17/l38 0 2023-12-16T05:56:35.492 INFO:tasks.workunit.client.1.smithi156.stdout:1/187: write d3/d1b/d27/f34 [471948,55781] 0 2023-12-16T05:56:35.492 INFO:tasks.workunit.client.0.smithi155.stdout:8/519: symlink d4/d62/d66/d78/lad 0 2023-12-16T05:56:35.493 INFO:tasks.workunit.client.0.smithi155.stdout:6/789: dwrite d0/d3/d7a/db0/dc3/dce/ddd/dd4/fe4 [0,4194304] 0 2023-12-16T05:56:35.493 INFO:tasks.workunit.client.0.smithi155.stdout:8/520: fsync d4/d62/d66/d78/d88/d1b/d1c/d19/f73 0 2023-12-16T05:56:35.494 INFO:tasks.workunit.client.0.smithi155.stdout:2/515: creat d0/d7/fab x:0 0 0 2023-12-16T05:56:35.494 INFO:tasks.workunit.client.1.smithi156.stdout:7/473: dread d1e/f8c [0,4194304] 0 2023-12-16T05:56:35.494 INFO:tasks.workunit.client.0.smithi155.stdout:2/516: read - d0/d7/dd/d62/faa zero size 2023-12-16T05:56:35.495 INFO:tasks.workunit.client.0.smithi155.stdout:8/521: symlink d4/d62/d95/lae 0 2023-12-16T05:56:35.497 INFO:tasks.workunit.client.1.smithi156.stdout:8/227: chown d3/d6/f36 3669716 1 2023-12-16T05:56:35.497 INFO:tasks.workunit.client.0.smithi155.stdout:6/790: creat d0/df/d5e/d46/d6d/f107 x:0 0 0 2023-12-16T05:56:35.497 INFO:tasks.workunit.client.0.smithi155.stdout:6/791: truncate d0/d3/d7a/db0/dc3/dce/ddd/f51 1214832 0 2023-12-16T05:56:35.497 INFO:tasks.workunit.client.0.smithi155.stdout:8/522: creat d4/d62/d66/d78/d88/d1b/d1c/d97/d29/faf x:0 0 0 2023-12-16T05:56:35.498 INFO:tasks.workunit.client.1.smithi156.stdout:3/249: rename dc/d10/d3d/l59 to dc/d10/d1d/d4b/d52/l5b 0 2023-12-16T05:56:35.500 INFO:tasks.workunit.client.1.smithi156.stdout:4/281: mknod d9/d2c/c5a 0 2023-12-16T05:56:35.500 INFO:tasks.workunit.client.1.smithi156.stdout:4/282: chown d9/d43/l4e 830 1 2023-12-16T05:56:35.500 INFO:tasks.workunit.client.0.smithi155.stdout:8/523: write d4/d62/d66/d78/d88/d1b/d1c/f45 [3875939,62363] 0 2023-12-16T05:56:35.501 INFO:tasks.workunit.client.0.smithi155.stdout:8/524: write d4/d62/d66/d78/d88/d12/f94 [470820,96421] 0 2023-12-16T05:56:35.502 INFO:tasks.workunit.client.0.smithi155.stdout:8/525: write d4/d62/d66/d78/d88/d1b/d1c/f5c [3706857,95251] 0 2023-12-16T05:56:35.502 INFO:tasks.workunit.client.0.smithi155.stdout:8/526: symlink d4/d62/d66/d78/d88/d1b/d1c/d97/d29/lb0 0 2023-12-16T05:56:35.504 INFO:tasks.workunit.client.1.smithi156.stdout:6/291: symlink d9/d13/d2f/l5d 0 2023-12-16T05:56:35.504 INFO:tasks.workunit.client.1.smithi156.stdout:7/474: link d1e/d1f/l68 d1e/d55/d71/l9d 0 2023-12-16T05:56:35.504 INFO:tasks.workunit.client.1.smithi156.stdout:7/475: fdatasync d1e/d39/f7d 0 2023-12-16T05:56:35.505 INFO:tasks.workunit.client.1.smithi156.stdout:9/261: sync 2023-12-16T05:56:35.506 INFO:tasks.workunit.client.1.smithi156.stdout:3/250: symlink dc/d10/d1d/d4b/l5c 0 2023-12-16T05:56:35.509 INFO:tasks.workunit.client.1.smithi156.stdout:8/228: rename d3/d12/l45 to d3/d7/d27/l47 0 2023-12-16T05:56:35.509 INFO:tasks.workunit.client.1.smithi156.stdout:8/229: truncate d3/f29 554905 0 2023-12-16T05:56:35.509 INFO:tasks.workunit.client.1.smithi156.stdout:8/230: truncate d3/d12/f3d 521024 0 2023-12-16T05:56:35.512 INFO:tasks.workunit.client.1.smithi156.stdout:5/483: sync 2023-12-16T05:56:35.513 INFO:tasks.workunit.client.1.smithi156.stdout:4/283: link d9/c25 d9/d2b/d56/c5b 0 2023-12-16T05:56:35.515 INFO:tasks.workunit.client.1.smithi156.stdout:0/335: mkdir d2/d7/dd/d66 0 2023-12-16T05:56:35.515 INFO:tasks.workunit.client.1.smithi156.stdout:0/336: chown d2/d7/dd/d1c/c21 6559 1 2023-12-16T05:56:35.515 INFO:tasks.workunit.client.1.smithi156.stdout:7/476: creat d1e/d55/f9e x:0 0 0 2023-12-16T05:56:35.516 INFO:tasks.workunit.client.1.smithi156.stdout:6/292: symlink d9/d1c/l5e 0 2023-12-16T05:56:35.518 INFO:tasks.workunit.client.0.smithi155.stdout:7/585: dwrite d0/d1/f61 [0,4194304] 0 2023-12-16T05:56:35.520 INFO:tasks.workunit.client.0.smithi155.stdout:7/586: creat d0/d1b/dbe/fc4 x:0 0 0 2023-12-16T05:56:35.520 INFO:tasks.workunit.client.0.smithi155.stdout:7/587: chown d0/d1/d5/f8 15344246 1 2023-12-16T05:56:35.520 INFO:tasks.workunit.client.0.smithi155.stdout:7/588: chown d0/d1b/f2f 3932 1 2023-12-16T05:56:35.524 INFO:tasks.workunit.client.1.smithi156.stdout:1/188: dread d3/d17/f33 [0,4194304] 0 2023-12-16T05:56:35.524 INFO:tasks.workunit.client.1.smithi156.stdout:9/262: symlink d6/d19/d25/l59 0 2023-12-16T05:56:35.524 INFO:tasks.workunit.client.0.smithi155.stdout:9/748: dwrite da/d15/d17/d36/d5b/fa2 [0,4194304] 0 2023-12-16T05:56:35.526 INFO:tasks.workunit.client.1.smithi156.stdout:8/231: rename d3/d7/f2c to d3/f48 0 2023-12-16T05:56:35.527 INFO:tasks.workunit.client.0.smithi155.stdout:0/572: dwrite d7/df/f7b [0,4194304] 0 2023-12-16T05:56:35.529 INFO:tasks.workunit.client.1.smithi156.stdout:0/337: write f0 [3672385,90645] 0 2023-12-16T05:56:35.529 INFO:tasks.workunit.client.1.smithi156.stdout:7/477: link d1e/d55/d71/f8d d1e/d1f/d22/d75/f9f 0 2023-12-16T05:56:35.533 INFO:tasks.workunit.client.0.smithi155.stdout:7/589: dread d0/d6a/d1a/d8c/f75 [0,4194304] 0 2023-12-16T05:56:35.535 INFO:tasks.workunit.client.1.smithi156.stdout:9/263: creat d6/d19/d25/f5a x:0 0 0 2023-12-16T05:56:35.535 INFO:tasks.workunit.client.1.smithi156.stdout:1/189: unlink d3/d17/d1c/f28 0 2023-12-16T05:56:35.535 INFO:tasks.workunit.client.0.smithi155.stdout:2/517: fsync d0/d7/fab 0 2023-12-16T05:56:35.536 INFO:tasks.workunit.client.0.smithi155.stdout:2/518: rmdir d0/d7/d57 39 2023-12-16T05:56:35.537 INFO:tasks.workunit.client.0.smithi155.stdout:9/749: dread da/d15/d17/d36/dc1/fef [0,4194304] 0 2023-12-16T05:56:35.537 INFO:tasks.workunit.client.0.smithi155.stdout:9/750: fdatasync da/d15/d17/d36/d5b/d60/d9e/fc5 0 2023-12-16T05:56:35.538 INFO:tasks.workunit.client.0.smithi155.stdout:6/792: dwrite d0/d3/d7a/db0/dc3/dce/ddd/d1b/dea/ff7 [0,4194304] 0 2023-12-16T05:56:35.539 INFO:tasks.workunit.client.0.smithi155.stdout:9/751: creat da/d15/d17/d36/d5b/d60/db9/f101 x:0 0 0 2023-12-16T05:56:35.539 INFO:tasks.workunit.client.1.smithi156.stdout:4/284: rename d9/f59 to d9/d43/d58/f5c 0 2023-12-16T05:56:35.540 INFO:tasks.workunit.client.1.smithi156.stdout:8/232: unlink d3/f8 0 2023-12-16T05:56:35.540 INFO:tasks.workunit.client.1.smithi156.stdout:9/264: mkdir d6/d19/d30/d5b 0 2023-12-16T05:56:35.540 INFO:tasks.workunit.client.1.smithi156.stdout:9/265: stat d6/f51 0 2023-12-16T05:56:35.541 INFO:tasks.workunit.client.0.smithi155.stdout:2/519: write d0/d7/d1f/d74/f46 [3309596,114144] 0 2023-12-16T05:56:35.541 INFO:tasks.workunit.client.1.smithi156.stdout:8/233: mknod d3/d12/d16/c49 0 2023-12-16T05:56:35.542 INFO:tasks.workunit.client.0.smithi155.stdout:6/793: creat d0/df/d5e/d5b/dd7/f108 x:0 0 0 2023-12-16T05:56:35.542 INFO:tasks.workunit.client.0.smithi155.stdout:6/794: readlink d0/df/le2 0 2023-12-16T05:56:35.542 INFO:tasks.workunit.client.0.smithi155.stdout:6/795: read - d0/df/d5e/d99/fd2 zero size 2023-12-16T05:56:35.542 INFO:tasks.workunit.client.0.smithi155.stdout:6/796: fdatasync d0/d3/d7a/d77/f101 0 2023-12-16T05:56:35.542 INFO:tasks.workunit.client.1.smithi156.stdout:1/190: mkdir d3/d3a 0 2023-12-16T05:56:35.543 INFO:tasks.workunit.client.1.smithi156.stdout:8/234: truncate d3/d7/d27/f32 356364 0 2023-12-16T05:56:35.544 INFO:tasks.workunit.client.0.smithi155.stdout:9/752: mknod da/d15/d17/d24/c102 0 2023-12-16T05:56:35.545 INFO:tasks.workunit.client.1.smithi156.stdout:9/266: unlink d6/l33 0 2023-12-16T05:56:35.546 INFO:tasks.workunit.client.1.smithi156.stdout:8/235: fsync d3/d6/f5 0 2023-12-16T05:56:35.548 INFO:tasks.workunit.client.0.smithi155.stdout:7/590: dread d0/d6a/d1a/d22/f23 [0,4194304] 0 2023-12-16T05:56:35.548 INFO:tasks.workunit.client.0.smithi155.stdout:8/527: dwrite d4/f41 [0,4194304] 0 2023-12-16T05:56:35.548 INFO:tasks.workunit.client.0.smithi155.stdout:7/591: write d0/d6a/d1a/fa9 [949043,96796] 0 2023-12-16T05:56:35.548 INFO:tasks.workunit.client.0.smithi155.stdout:8/528: readlink d4/d62/d66/d78/d88/la8 0 2023-12-16T05:56:35.548 INFO:tasks.workunit.client.1.smithi156.stdout:1/191: rename d3/c12 to d3/d17/d1c/d22/c3b 0 2023-12-16T05:56:35.548 INFO:tasks.workunit.client.0.smithi155.stdout:6/797: symlink d0/df/d5e/d46/l109 0 2023-12-16T05:56:35.549 INFO:tasks.workunit.client.1.smithi156.stdout:5/484: dwrite da/f49 [0,4194304] 0 2023-12-16T05:56:35.550 INFO:tasks.workunit.client.1.smithi156.stdout:5/485: readlink da/dc/l30 0 2023-12-16T05:56:35.550 INFO:tasks.workunit.client.1.smithi156.stdout:5/486: chown da/dc/d2d/d4d/d54/d67/l7b 6 1 2023-12-16T05:56:35.550 INFO:tasks.workunit.client.1.smithi156.stdout:7/478: dwrite d1e/d1f/d22/d2c/d57/f86 [0,4194304] 0 2023-12-16T05:56:35.550 INFO:tasks.workunit.client.1.smithi156.stdout:7/479: chown d1e/d39/f3f 7161437 1 2023-12-16T05:56:35.551 INFO:tasks.workunit.client.1.smithi156.stdout:9/267: rename c2 to d6/c5c 0 2023-12-16T05:56:35.551 INFO:tasks.workunit.client.1.smithi156.stdout:3/251: dwrite dc/d10/d1d/f49 [0,4194304] 0 2023-12-16T05:56:35.551 INFO:tasks.workunit.client.1.smithi156.stdout:3/252: stat dc/df/l17 0 2023-12-16T05:56:35.551 INFO:tasks.workunit.client.1.smithi156.stdout:3/253: chown l6 0 1 2023-12-16T05:56:35.551 INFO:tasks.workunit.client.0.smithi155.stdout:6/798: symlink d0/df/d5e/d7e/db6/dc6/d103/l10a 0 2023-12-16T05:56:35.552 INFO:tasks.workunit.client.0.smithi155.stdout:8/529: creat d4/d62/d66/d78/d88/d12/fb1 x:0 0 0 2023-12-16T05:56:35.552 INFO:tasks.workunit.client.0.smithi155.stdout:6/799: write d0/df/d5e/d7e/db6/dc6/d103/de5/ff3 [1450264,97286] 0 2023-12-16T05:56:35.553 INFO:tasks.workunit.client.0.smithi155.stdout:6/800: mknod d0/df/d5e/d5b/c10b 0 2023-12-16T05:56:35.554 INFO:tasks.workunit.client.0.smithi155.stdout:6/801: truncate d0/df/d5e/d7e/db6/dc6/fcc 330434 0 2023-12-16T05:56:35.555 INFO:tasks.workunit.client.0.smithi155.stdout:6/802: symlink d0/d3/d7a/db0/dc3/dce/l10c 0 2023-12-16T05:56:35.555 INFO:tasks.workunit.client.0.smithi155.stdout:6/803: stat d0/d3/d7a/db0/dc3/dce/ddd/dd4/dfb 0 2023-12-16T05:56:35.559 INFO:tasks.workunit.client.1.smithi156.stdout:7/480: creat d1e/d1f/d22/d2c/fa0 x:0 0 0 2023-12-16T05:56:35.559 INFO:tasks.workunit.client.1.smithi156.stdout:5/487: creat da/f98 x:0 0 0 2023-12-16T05:56:35.560 INFO:tasks.workunit.client.0.smithi155.stdout:0/573: dwrite d7/df/f7b [0,4194304] 0 2023-12-16T05:56:35.560 INFO:tasks.workunit.client.0.smithi155.stdout:0/574: write d7/d2d/f3c [992472,95306] 0 2023-12-16T05:56:35.561 INFO:tasks.workunit.client.1.smithi156.stdout:4/285: dread d9/f19 [4194304,4194304] 0 2023-12-16T05:56:35.562 INFO:tasks.workunit.client.0.smithi155.stdout:0/575: getdents d7/d47/d53 0 2023-12-16T05:56:35.563 INFO:tasks.workunit.client.1.smithi156.stdout:0/338: dwrite d2/f24 [0,4194304] 0 2023-12-16T05:56:35.563 INFO:tasks.workunit.client.1.smithi156.stdout:0/339: chown d2/d7/dd/c20 5 1 2023-12-16T05:56:35.563 INFO:tasks.workunit.client.1.smithi156.stdout:9/268: symlink d6/d19/d25/d3a/l5d 0 2023-12-16T05:56:35.564 INFO:tasks.workunit.client.1.smithi156.stdout:8/236: rename d3/d12/c20 to d3/d7/d9/d3b/c4a 0 2023-12-16T05:56:35.564 INFO:tasks.workunit.client.0.smithi155.stdout:0/576: creat d7/d2d/fbc x:0 0 0 2023-12-16T05:56:35.569 INFO:tasks.workunit.client.1.smithi156.stdout:3/254: creat dc/d10/d1d/f5d x:0 0 0 2023-12-16T05:56:35.569 INFO:tasks.workunit.client.1.smithi156.stdout:7/481: truncate d1e/f32 9114621 0 2023-12-16T05:56:35.570 INFO:tasks.workunit.client.1.smithi156.stdout:5/488: symlink da/dc/d4b/d6c/d7c/d85/l99 0 2023-12-16T05:56:35.570 INFO:tasks.workunit.client.1.smithi156.stdout:0/340: write d2/d7/dd/d29/d38/d3f/f58 [468201,80029] 0 2023-12-16T05:56:35.570 INFO:tasks.workunit.client.1.smithi156.stdout:4/286: mknod d9/d2c/d48/c5d 0 2023-12-16T05:56:35.570 INFO:tasks.workunit.client.1.smithi156.stdout:4/287: dread - d9/f23 zero size 2023-12-16T05:56:35.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:35 smithi155 ceph-mon[112451]: Updating smithi156:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:56:35.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:35 smithi155 ceph-mon[112451]: Updating smithi155:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:56:35.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:35 smithi155 ceph-mon[112451]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-12-16T05:56:35.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:35 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:35.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:35 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:35.577 INFO:tasks.workunit.client.1.smithi156.stdout:9/269: fdatasync d6/f15 0 2023-12-16T05:56:35.577 INFO:tasks.workunit.client.1.smithi156.stdout:8/237: rename d3/l3f to d3/d12/l4b 0 2023-12-16T05:56:35.577 INFO:tasks.workunit.client.1.smithi156.stdout:8/238: chown d3/d7/d9/ca 4049 1 2023-12-16T05:56:35.580 INFO:tasks.workunit.client.1.smithi156.stdout:7/482: getdents d1e/d1f/d22 0 2023-12-16T05:56:35.580 INFO:tasks.workunit.client.1.smithi156.stdout:5/489: mkdir da/d9a 0 2023-12-16T05:56:35.583 INFO:tasks.workunit.client.1.smithi156.stdout:0/341: symlink d2/l67 0 2023-12-16T05:56:35.585 INFO:tasks.workunit.client.1.smithi156.stdout:4/288: symlink d9/d2b/d35/l5e 0 2023-12-16T05:56:35.585 INFO:tasks.workunit.client.1.smithi156.stdout:1/192: dwrite d3/f14 [0,4194304] 0 2023-12-16T05:56:35.585 INFO:tasks.workunit.client.1.smithi156.stdout:5/490: mkdir da/dc/d2d/d9b 0 2023-12-16T05:56:35.585 INFO:tasks.workunit.client.1.smithi156.stdout:0/342: truncate d2/d7/dd/d29/d38/d3f/d44/f45 1153755 0 2023-12-16T05:56:35.587 INFO:tasks.workunit.client.0.smithi155.stdout:9/753: dwrite da/d15/d17/d36/d5b/d60/d9e/fb5 [0,4194304] 0 2023-12-16T05:56:35.588 INFO:tasks.workunit.client.1.smithi156.stdout:5/491: rename da/l38 to da/d46/l9c 0 2023-12-16T05:56:35.588 INFO:tasks.workunit.client.1.smithi156.stdout:5/492: truncate da/dc/d2d/d4d/d54/f5d 233685 0 2023-12-16T05:56:35.589 INFO:tasks.workunit.client.0.smithi155.stdout:9/754: write da/f10 [1794518,120182] 0 2023-12-16T05:56:35.590 INFO:tasks.workunit.client.0.smithi155.stdout:2/520: dwrite d0/d7/dd/d49/d4b/d7f/fa1 [0,4194304] 0 2023-12-16T05:56:35.594 INFO:tasks.workunit.client.0.smithi155.stdout:8/530: fdatasync d4/d62/d66/d78/d88/d1b/d1c/f5c 0 2023-12-16T05:56:35.595 INFO:tasks.workunit.client.0.smithi155.stdout:9/755: mknod da/d15/d17/d24/d62/c103 0 2023-12-16T05:56:35.596 INFO:tasks.workunit.client.1.smithi156.stdout:0/343: creat d2/d7/dd/d29/d38/f68 x:0 0 0 2023-12-16T05:56:35.596 INFO:tasks.workunit.client.1.smithi156.stdout:0/344: truncate d2/f22 6232245 0 2023-12-16T05:56:35.598 INFO:tasks.workunit.client.0.smithi155.stdout:8/531: creat d4/d62/d66/d78/d88/d1b/d1c/d19/d64/fb2 x:0 0 0 2023-12-16T05:56:35.598 INFO:tasks.workunit.client.0.smithi155.stdout:8/532: fdatasync d4/d62/d66/d78/d88/d1b/f7c 0 2023-12-16T05:56:35.599 INFO:tasks.workunit.client.0.smithi155.stdout:9/756: rmdir da/d15/d17/d24/d62/da8 0 2023-12-16T05:56:35.601 INFO:tasks.workunit.client.1.smithi156.stdout:4/289: dread d9/d2b/f31 [0,4194304] 0 2023-12-16T05:56:35.604 INFO:tasks.workunit.client.1.smithi156.stdout:0/345: mkdir d2/d7/dd/d29/d38/d51/d69 0 2023-12-16T05:56:35.606 INFO:tasks.workunit.client.1.smithi156.stdout:4/290: mknod d9/d2c/c5f 0 2023-12-16T05:56:35.608 INFO:tasks.workunit.client.1.smithi156.stdout:0/346: mknod d2/d23/c6a 0 2023-12-16T05:56:35.608 INFO:tasks.workunit.client.0.smithi155.stdout:8/533: write d4/ff [819356,89926] 0 2023-12-16T05:56:35.608 INFO:tasks.workunit.client.0.smithi155.stdout:7/592: dwrite d0/d6a/d1a/d38/f9f [0,4194304] 0 2023-12-16T05:56:35.608 INFO:tasks.workunit.client.0.smithi155.stdout:8/534: dread - d4/d62/d66/d78/d88/d12/fb1 zero size 2023-12-16T05:56:35.612 INFO:tasks.workunit.client.0.smithi155.stdout:8/535: getdents d4/d62/d66/d78/d88/d1b/d1c/d46 0 2023-12-16T05:56:35.622 INFO:tasks.workunit.client.1.smithi156.stdout:3/255: dwrite dc/f19 [0,4194304] 0 2023-12-16T05:56:35.622 INFO:tasks.workunit.client.0.smithi155.stdout:6/804: dwrite d0/d3/f1e [0,4194304] 0 2023-12-16T05:56:35.623 INFO:tasks.workunit.client.0.smithi155.stdout:6/805: getdents d0/df/d5e/d5b/dd7 0 2023-12-16T05:56:35.638 INFO:tasks.workunit.client.1.smithi156.stdout:8/239: dwrite d3/d12/d16/f2d [4194304,4194304] 0 2023-12-16T05:56:35.638 INFO:tasks.workunit.client.1.smithi156.stdout:8/240: stat d3/d18/f41 0 2023-12-16T05:56:35.640 INFO:tasks.workunit.client.0.smithi155.stdout:6/806: write d0/df/d5e/f61 [2360888,16072] 0 2023-12-16T05:56:35.641 INFO:tasks.workunit.client.1.smithi156.stdout:3/256: rmdir dc/d10 39 2023-12-16T05:56:35.641 INFO:tasks.workunit.client.1.smithi156.stdout:3/257: chown dc/d10/f24 103780 1 2023-12-16T05:56:35.643 INFO:tasks.workunit.client.1.smithi156.stdout:8/241: mknod d3/d18/c4c 0 2023-12-16T05:56:35.643 INFO:tasks.workunit.client.1.smithi156.stdout:8/242: fsync d3/f48 0 2023-12-16T05:56:35.644 INFO:tasks.workunit.client.1.smithi156.stdout:8/243: write d3/d6/f5 [620444,55250] 0 2023-12-16T05:56:35.644 INFO:tasks.workunit.client.1.smithi156.stdout:8/244: stat d3/d12/d16/c49 0 2023-12-16T05:56:35.644 INFO:tasks.workunit.client.1.smithi156.stdout:3/258: link dc/d10/d3d/l44 dc/d10/d1d/d4b/d52/l5e 0 2023-12-16T05:56:35.644 INFO:tasks.workunit.client.1.smithi156.stdout:3/259: chown dc/df/d34 95258197 1 2023-12-16T05:56:35.645 INFO:tasks.workunit.client.1.smithi156.stdout:3/260: symlink dc/d10/l5f 0 2023-12-16T05:56:35.646 INFO:tasks.workunit.client.0.smithi155.stdout:6/807: dread d0/d3/d7a/db0/dc3/dce/ddd/ff0 [0,4194304] 0 2023-12-16T05:56:35.653 INFO:tasks.workunit.client.1.smithi156.stdout:8/245: read d3/d12/f25 [3409744,68542] 0 2023-12-16T05:56:35.653 INFO:tasks.workunit.client.1.smithi156.stdout:8/246: read - d3/d7/f31 zero size 2023-12-16T05:56:35.654 INFO:tasks.workunit.client.0.smithi155.stdout:0/577: dwrite d7/d13/d45/f49 [0,4194304] 0 2023-12-16T05:56:35.654 INFO:tasks.workunit.client.0.smithi155.stdout:0/578: chown d7/df/d41/d23 5334 1 2023-12-16T05:56:35.654 INFO:tasks.workunit.client.1.smithi156.stdout:8/247: write d3/d12/f28 [491823,73805] 0 2023-12-16T05:56:35.654 INFO:tasks.workunit.client.1.smithi156.stdout:5/493: dwrite da/dc/d2d/d4d/f88 [0,4194304] 0 2023-12-16T05:56:35.654 INFO:tasks.workunit.client.1.smithi156.stdout:9/270: dwrite d6/d19/d30/f54 [0,4194304] 0 2023-12-16T05:56:35.655 INFO:tasks.workunit.client.0.smithi155.stdout:0/579: symlink d7/df/d6f/lbd 0 2023-12-16T05:56:35.655 INFO:tasks.workunit.client.1.smithi156.stdout:8/248: rename d3/l21 to d3/l4d 0 2023-12-16T05:56:35.656 INFO:tasks.workunit.client.0.smithi155.stdout:0/580: creat d7/df/d6f/fbe x:0 0 0 2023-12-16T05:56:35.657 INFO:tasks.workunit.client.1.smithi156.stdout:5/494: symlink da/dc/d4b/l9d 0 2023-12-16T05:56:35.659 INFO:tasks.workunit.client.1.smithi156.stdout:9/271: fsync d6/fe 0 2023-12-16T05:56:35.659 INFO:tasks.workunit.client.1.smithi156.stdout:9/272: chown d6/d19/f20 29 1 2023-12-16T05:56:35.660 INFO:tasks.workunit.client.1.smithi156.stdout:9/273: mkdir d6/d19/d25/d3a/d5e 0 2023-12-16T05:56:35.661 INFO:tasks.workunit.client.1.smithi156.stdout:9/274: symlink d6/d19/d25/d3a/d5e/l5f 0 2023-12-16T05:56:35.677 INFO:tasks.workunit.client.0.smithi155.stdout:2/521: dwrite d0/d34/d3c/f43 [0,4194304] 0 2023-12-16T05:56:35.677 INFO:tasks.workunit.client.0.smithi155.stdout:2/522: readlink d0/d7/d57/l5c 0 2023-12-16T05:56:35.678 INFO:tasks.workunit.client.1.smithi156.stdout:7/483: dwrite d1e/d1f/d22/d2c/f6c [0,4194304] 0 2023-12-16T05:56:35.678 INFO:tasks.workunit.client.1.smithi156.stdout:7/484: chown d1e/d39/f3f 0 1 2023-12-16T05:56:35.681 INFO:tasks.workunit.client.1.smithi156.stdout:7/485: symlink d1e/d1f/d22/d2c/d33/la1 0 2023-12-16T05:56:35.682 INFO:tasks.workunit.client.0.smithi155.stdout:9/757: dwrite da/fc6 [0,4194304] 0 2023-12-16T05:56:35.682 INFO:tasks.workunit.client.1.smithi156.stdout:7/486: mknod d1e/ca2 0 2023-12-16T05:56:35.682 INFO:tasks.workunit.client.1.smithi156.stdout:7/487: stat d1e/d55/d71/d61/f91 0 2023-12-16T05:56:35.682 INFO:tasks.workunit.client.1.smithi156.stdout:7/488: chown d1e/f27 896925520 1 2023-12-16T05:56:35.683 INFO:tasks.workunit.client.0.smithi155.stdout:9/758: write da/d15/d17/d24/d62/fc4 [764767,12501] 0 2023-12-16T05:56:35.683 INFO:tasks.workunit.client.0.smithi155.stdout:2/523: creat d0/d7/d69/d77/fac x:0 0 0 2023-12-16T05:56:35.683 INFO:tasks.workunit.client.0.smithi155.stdout:2/524: chown d0/d7/d1f 38247330 1 2023-12-16T05:56:35.684 INFO:tasks.workunit.client.1.smithi156.stdout:7/489: creat d1e/d55/d71/d61/fa3 x:0 0 0 2023-12-16T05:56:35.684 INFO:tasks.workunit.client.0.smithi155.stdout:9/759: write da/d15/d17/d36/d5b/d60/db9/fdb [17573,23764] 0 2023-12-16T05:56:35.685 INFO:tasks.workunit.client.0.smithi155.stdout:9/760: read da/d15/d17/d24/d26/d2e/d83/d8f/fb2 [238183,47743] 0 2023-12-16T05:56:35.685 INFO:tasks.workunit.client.1.smithi156.stdout:7/490: rename d1e/d1f/d85 to d1e/d1f/d72/da4 0 2023-12-16T05:56:35.685 INFO:tasks.workunit.client.1.smithi156.stdout:7/491: dread - d1e/d1f/d22/d2c/f5e zero size 2023-12-16T05:56:35.686 INFO:tasks.workunit.client.0.smithi155.stdout:9/761: creat da/d15/d17/d24/d26/d2e/d32/f104 x:0 0 0 2023-12-16T05:56:35.698 INFO:tasks.workunit.client.1.smithi156.stdout:1/193: dwrite d3/d17/f33 [0,4194304] 0 2023-12-16T05:56:35.699 INFO:tasks.workunit.client.0.smithi155.stdout:2/525: write d0/f30 [198077,124171] 0 2023-12-16T05:56:35.699 INFO:tasks.workunit.client.0.smithi155.stdout:6/808: dwrite d0/df/d5e/d99/f9b [0,4194304] 0 2023-12-16T05:56:35.700 INFO:tasks.workunit.client.0.smithi155.stdout:2/526: mkdir d0/d7/d57/dad 0 2023-12-16T05:56:35.700 INFO:tasks.workunit.client.0.smithi155.stdout:2/527: write d0/d7/dd/d14/fa6 [784042,25669] 0 2023-12-16T05:56:35.700 INFO:tasks.workunit.client.0.smithi155.stdout:6/809: dread d0/d3/f12 [0,4194304] 0 2023-12-16T05:56:35.700 INFO:tasks.workunit.client.0.smithi155.stdout:6/810: dread - d0/df/d5e/d5b/dd7/f108 zero size 2023-12-16T05:56:35.701 INFO:tasks.workunit.client.0.smithi155.stdout:6/811: write d0/df/d5e/d7e/db6/ff2 [981187,72440] 0 2023-12-16T05:56:35.702 INFO:tasks.workunit.client.0.smithi155.stdout:2/528: mkdir d0/d7/d69/dae 0 2023-12-16T05:56:35.702 INFO:tasks.workunit.client.1.smithi156.stdout:4/291: dwrite d9/f15 [0,4194304] 0 2023-12-16T05:56:35.703 INFO:tasks.workunit.client.1.smithi156.stdout:4/292: chown d9/f15 12722 1 2023-12-16T05:56:35.703 INFO:tasks.workunit.client.1.smithi156.stdout:0/347: dwrite d2/d23/d4a/f54 [0,4194304] 0 2023-12-16T05:56:35.703 INFO:tasks.workunit.client.1.smithi156.stdout:0/348: dread - d2/d7/dd/d29/f62 zero size 2023-12-16T05:56:35.703 INFO:tasks.workunit.client.0.smithi155.stdout:7/593: dwrite d0/f15 [4194304,4194304] 0 2023-12-16T05:56:35.703 INFO:tasks.workunit.client.0.smithi155.stdout:6/812: creat d0/d3/d7a/db0/dc3/dce/ddd/f10d x:0 0 0 2023-12-16T05:56:35.704 INFO:tasks.workunit.client.0.smithi155.stdout:8/536: dwrite d4/d62/d66/d78/d88/d1b/d1c/f8d [0,4194304] 0 2023-12-16T05:56:35.704 INFO:tasks.workunit.client.0.smithi155.stdout:8/537: chown d4/d62/d66/d78/d88/d1b/d1c/d46 49627745 1 2023-12-16T05:56:35.704 INFO:tasks.workunit.client.0.smithi155.stdout:8/538: truncate d4/ff 1057482 0 2023-12-16T05:56:35.708 INFO:tasks.workunit.client.0.smithi155.stdout:2/529: mkdir d0/d7/d57/daf 0 2023-12-16T05:56:35.708 INFO:tasks.workunit.client.0.smithi155.stdout:8/539: dread d4/d62/d66/d78/d88/d1b/d1c/d97/f8c [0,4194304] 0 2023-12-16T05:56:35.709 INFO:tasks.workunit.client.0.smithi155.stdout:8/540: stat d4/d62/d66/d78/d88/d1b/d1c/d1a/f2c 0 2023-12-16T05:56:35.709 INFO:tasks.workunit.client.1.smithi156.stdout:4/293: link d9/f42 d9/d43/d58/f60 0 2023-12-16T05:56:35.712 INFO:tasks.workunit.client.0.smithi155.stdout:6/813: write d0/df/d5e/d7e/db6/dc6/d103/fdb [3803259,73911] 0 2023-12-16T05:56:35.714 INFO:tasks.workunit.client.1.smithi156.stdout:8/249: dwrite d3/d18/f1b [0,4194304] 0 2023-12-16T05:56:35.714 INFO:tasks.workunit.client.1.smithi156.stdout:8/250: truncate d3/d12/f28 1154709 0 2023-12-16T05:56:35.716 INFO:tasks.workunit.client.1.smithi156.stdout:0/349: creat d2/d7/dd/d29/f6b x:0 0 0 2023-12-16T05:56:35.718 INFO:tasks.workunit.client.1.smithi156.stdout:4/294: getdents d9 0 2023-12-16T05:56:35.720 INFO:tasks.workunit.client.1.smithi156.stdout:9/275: getdents d6/d19/d25/d3a 0 2023-12-16T05:56:35.721 INFO:tasks.workunit.client.1.smithi156.stdout:5/495: dwrite da/dc/d2d/d4d/d54/d67/f8c [0,4194304] 0 2023-12-16T05:56:35.723 INFO:tasks.workunit.client.0.smithi155.stdout:9/762: dwrite da/d15/d17/d36/d5b/d98/fd7 [0,4194304] 0 2023-12-16T05:56:35.723 INFO:tasks.workunit.client.1.smithi156.stdout:4/295: creat d9/d2c/f61 x:0 0 0 2023-12-16T05:56:35.724 INFO:tasks.workunit.client.1.smithi156.stdout:9/276: link d6/f46 d6/d19/d25/d3a/f60 0 2023-12-16T05:56:35.724 INFO:tasks.workunit.client.1.smithi156.stdout:9/277: chown d6/d19/d30/f44 239286 1 2023-12-16T05:56:35.727 INFO:tasks.workunit.client.0.smithi155.stdout:0/581: dwrite d7/df/d73/d8d/f6b [0,4194304] 0 2023-12-16T05:56:35.728 INFO:tasks.workunit.client.0.smithi155.stdout:0/582: read d7/d47/fa9 [3633030,73940] 0 2023-12-16T05:56:35.729 INFO:tasks.workunit.client.1.smithi156.stdout:0/350: dread d2/d7/dd/d29/f4f [0,4194304] 0 2023-12-16T05:56:35.729 INFO:tasks.workunit.client.1.smithi156.stdout:0/351: truncate d2/d7/dd/d29/d38/f68 861107 0 2023-12-16T05:56:35.732 INFO:tasks.workunit.client.1.smithi156.stdout:5/496: creat da/dc/d4b/d6c/f9e x:0 0 0 2023-12-16T05:56:35.733 INFO:tasks.workunit.client.1.smithi156.stdout:7/492: dwrite d1e/d1f/f3a [0,4194304] 0 2023-12-16T05:56:35.735 INFO:tasks.workunit.client.1.smithi156.stdout:0/352: getdents d2/d7/dd/d29/d38/d3f/d44 0 2023-12-16T05:56:35.735 INFO:tasks.workunit.client.1.smithi156.stdout:9/278: write d6/d19/f2a [1645426,129430] 0 2023-12-16T05:56:35.735 INFO:tasks.workunit.client.1.smithi156.stdout:1/194: dwrite d3/d17/d1c/f2b [0,4194304] 0 2023-12-16T05:56:35.736 INFO:tasks.workunit.client.1.smithi156.stdout:1/195: readlink d3/l10 0 2023-12-16T05:56:35.736 INFO:tasks.workunit.client.1.smithi156.stdout:8/251: dwrite d3/f48 [0,4194304] 0 2023-12-16T05:56:35.737 INFO:tasks.workunit.client.1.smithi156.stdout:5/497: creat da/dc/f9f x:0 0 0 2023-12-16T05:56:35.739 INFO:tasks.workunit.client.1.smithi156.stdout:7/493: creat d1e/d55/d71/d61/fa5 x:0 0 0 2023-12-16T05:56:35.740 INFO:tasks.workunit.client.1.smithi156.stdout:0/353: link d2/c6 d2/d7/dd/d5c/c6c 0 2023-12-16T05:56:35.743 INFO:tasks.workunit.client.1.smithi156.stdout:9/279: mknod d6/d2e/c61 0 2023-12-16T05:56:35.743 INFO:tasks.workunit.client.1.smithi156.stdout:9/280: chown d6/d19/d25/d3a/l5d 0 1 2023-12-16T05:56:35.747 INFO:tasks.workunit.client.1.smithi156.stdout:1/196: mkdir d3/d3a/d3c 0 2023-12-16T05:56:35.747 INFO:tasks.workunit.client.1.smithi156.stdout:1/197: chown d3/f14 1749911550 1 2023-12-16T05:56:35.747 INFO:tasks.workunit.client.1.smithi156.stdout:6/293: sync 2023-12-16T05:56:35.747 INFO:tasks.workunit.client.1.smithi156.stdout:6/294: fsync d9/d13/d3e/f57 0 2023-12-16T05:56:35.747 INFO:tasks.workunit.client.1.smithi156.stdout:6/295: truncate d9/d13/d3e/f57 182968 0 2023-12-16T05:56:35.747 INFO:tasks.workunit.client.1.smithi156.stdout:6/296: fsync d9/f53 0 2023-12-16T05:56:35.747 INFO:tasks.workunit.client.1.smithi156.stdout:6/297: fdatasync d9/d13/d2f/d36/f5a 0 2023-12-16T05:56:35.748 INFO:tasks.workunit.client.1.smithi156.stdout:2/331: sync 2023-12-16T05:56:35.749 INFO:tasks.workunit.client.1.smithi156.stdout:6/298: write f6 [3988041,40566] 0 2023-12-16T05:56:35.749 INFO:tasks.workunit.client.1.smithi156.stdout:8/252: creat d3/d7/d27/d46/f4e x:0 0 0 2023-12-16T05:56:35.755 INFO:tasks.workunit.client.0.smithi155.stdout:9/763: dwrite da/d15/fb1 [0,4194304] 0 2023-12-16T05:56:35.755 INFO:tasks.workunit.client.0.smithi155.stdout:9/764: write da/d15/d17/d24/d62/d91/dc0/fd9 [572874,90755] 0 2023-12-16T05:56:35.756 INFO:tasks.workunit.client.1.smithi156.stdout:9/281: rename d6/d19/d30/l36 to d6/d19/d30/l62 0 2023-12-16T05:56:35.756 INFO:tasks.workunit.client.1.smithi156.stdout:5/498: dread da/dc/f31 [0,4194304] 0 2023-12-16T05:56:35.756 INFO:tasks.workunit.client.1.smithi156.stdout:5/499: write da/dc/d2d/f7e [4231008,98535] 0 2023-12-16T05:56:35.756 INFO:tasks.workunit.client.1.smithi156.stdout:5/500: readlink da/dc/d4b/l59 0 2023-12-16T05:56:35.756 INFO:tasks.workunit.client.1.smithi156.stdout:5/501: fsync da/f42 0 2023-12-16T05:56:35.757 INFO:tasks.workunit.client.1.smithi156.stdout:6/299: mkdir d9/d13/d3e/d5f 0 2023-12-16T05:56:35.758 INFO:tasks.workunit.client.1.smithi156.stdout:5/502: mknod da/dc/d4b/d6c/d7c/d85/ca0 0 2023-12-16T05:56:35.759 INFO:tasks.workunit.client.1.smithi156.stdout:1/198: symlink d3/l3d 0 2023-12-16T05:56:35.760 INFO:tasks.workunit.client.1.smithi156.stdout:2/332: mkdir d9/dd/d17/d33/d38/d39/d60 0 2023-12-16T05:56:35.760 INFO:tasks.workunit.client.1.smithi156.stdout:2/333: write d9/f44 [2120858,124482] 0 2023-12-16T05:56:35.763 INFO:tasks.workunit.client.1.smithi156.stdout:6/300: rmdir d9/d13/d2f/d36/d5c 0 2023-12-16T05:56:35.763 INFO:tasks.workunit.client.1.smithi156.stdout:6/301: read - d9/d13/d2f/d36/f5a zero size 2023-12-16T05:56:35.763 INFO:tasks.workunit.client.1.smithi156.stdout:4/296: dwrite d9/f22 [0,4194304] 0 2023-12-16T05:56:35.764 INFO:tasks.workunit.client.0.smithi155.stdout:8/541: dwrite d4/d62/d66/d78/d88/d1b/d1c/f5c [0,4194304] 0 2023-12-16T05:56:35.764 INFO:tasks.workunit.client.1.smithi156.stdout:0/354: dwrite d2/f22 [4194304,4194304] 0 2023-12-16T05:56:35.765 INFO:tasks.workunit.client.1.smithi156.stdout:5/503: creat da/dc/d2d/d4d/d54/fa1 x:0 0 0 2023-12-16T05:56:35.766 INFO:tasks.workunit.client.1.smithi156.stdout:8/253: dwrite d3/d7/d9/f33 [0,4194304] 0 2023-12-16T05:56:35.767 INFO:tasks.workunit.client.0.smithi155.stdout:2/530: symlink d0/d7/d69/dae/lb0 0 2023-12-16T05:56:35.767 INFO:tasks.workunit.client.0.smithi155.stdout:2/531: chown d0/d7/d1f/f97 67451376 1 2023-12-16T05:56:35.768 INFO:tasks.workunit.client.1.smithi156.stdout:5/504: read da/f49 [1692737,90800] 0 2023-12-16T05:56:35.768 INFO:tasks.workunit.client.1.smithi156.stdout:5/505: fdatasync da/d46/f4f 0 2023-12-16T05:56:35.768 INFO:tasks.workunit.client.1.smithi156.stdout:5/506: chown da/dc/d4b/d6c/d81/f63 151547970 1 2023-12-16T05:56:35.769 INFO:tasks.workunit.client.1.smithi156.stdout:6/302: mknod d9/d13/d3e/d5f/c60 0 2023-12-16T05:56:35.769 INFO:tasks.workunit.client.0.smithi155.stdout:6/814: creat d0/df/d5e/d7e/db6/dc6/d103/de5/f10e x:0 0 0 2023-12-16T05:56:35.773 INFO:tasks.workunit.client.1.smithi156.stdout:4/297: creat d9/d43/f62 x:0 0 0 2023-12-16T05:56:35.773 INFO:tasks.workunit.client.1.smithi156.stdout:4/298: fdatasync d9/d2c/f32 0 2023-12-16T05:56:35.773 INFO:tasks.workunit.client.1.smithi156.stdout:4/299: truncate d9/f23 900761 0 2023-12-16T05:56:35.773 INFO:tasks.workunit.client.1.smithi156.stdout:4/300: chown d9/f16 4330335 1 2023-12-16T05:56:35.779 INFO:tasks.workunit.client.1.smithi156.stdout:0/355: mkdir d2/d6d 0 2023-12-16T05:56:35.779 INFO:tasks.workunit.client.1.smithi156.stdout:4/301: write d9/d2b/f3c [934218,25755] 0 2023-12-16T05:56:35.779 INFO:tasks.workunit.client.1.smithi156.stdout:0/356: write f0 [3664779,70897] 0 2023-12-16T05:56:35.779 INFO:tasks.workunit.client.1.smithi156.stdout:8/254: link d3/d12/d16/c49 d3/d7/d27/d46/c4f 0 2023-12-16T05:56:35.779 INFO:tasks.workunit.client.1.smithi156.stdout:8/255: readlink d3/d7/d9/l38 0 2023-12-16T05:56:35.779 INFO:tasks.workunit.client.1.smithi156.stdout:8/256: fdatasync d3/d18/f22 0 2023-12-16T05:56:35.779 INFO:tasks.workunit.client.1.smithi156.stdout:4/302: write d9/f1e [1231614,118706] 0 2023-12-16T05:56:35.780 INFO:tasks.workunit.client.1.smithi156.stdout:0/357: mknod d2/d7/dd/d2d/d5e/c6e 0 2023-12-16T05:56:35.780 INFO:tasks.workunit.client.1.smithi156.stdout:0/358: readlink d2/d47/l49 0 2023-12-16T05:56:35.780 INFO:tasks.workunit.client.1.smithi156.stdout:0/359: fdatasync d2/d23/d4a/f5a 0 2023-12-16T05:56:35.781 INFO:tasks.workunit.client.1.smithi156.stdout:0/360: dread d2/f28 [0,4194304] 0 2023-12-16T05:56:35.781 INFO:tasks.workunit.client.0.smithi155.stdout:0/583: creat d7/df/d73/fbf x:0 0 0 2023-12-16T05:56:35.781 INFO:tasks.workunit.client.0.smithi155.stdout:0/584: write d7/df/d73/fb1 [142431,3052] 0 2023-12-16T05:56:35.783 INFO:tasks.workunit.client.1.smithi156.stdout:4/303: symlink d9/d2b/d56/l63 0 2023-12-16T05:56:35.784 INFO:tasks.workunit.client.0.smithi155.stdout:9/765: getdents da 0 2023-12-16T05:56:35.784 INFO:tasks.workunit.client.0.smithi155.stdout:9/766: chown da/d15/d17/d24/d26/d2e/d83/lbf 1174734374 1 2023-12-16T05:56:35.786 INFO:tasks.workunit.client.0.smithi155.stdout:8/542: rmdir d4/d62/d66/d78/d88 39 2023-12-16T05:56:35.786 INFO:tasks.workunit.client.0.smithi155.stdout:8/543: stat d4/d62/d66/d78/d88/d1b/d1c/d19/f73 0 2023-12-16T05:56:35.786 INFO:tasks.workunit.client.1.smithi156.stdout:8/257: rename d3/d6/c2b to d3/d7/d9/d3b/c50 0 2023-12-16T05:56:35.787 INFO:tasks.workunit.client.0.smithi155.stdout:2/532: creat d0/d7/d57/d63/fb1 x:0 0 0 2023-12-16T05:56:35.789 INFO:tasks.workunit.client.1.smithi156.stdout:1/199: dwrite d3/d17/f1f [4194304,4194304] 0 2023-12-16T05:56:35.789 INFO:tasks.workunit.client.1.smithi156.stdout:4/304: symlink d9/l64 0 2023-12-16T05:56:35.790 INFO:tasks.workunit.client.1.smithi156.stdout:8/258: stat d3/d12/l4b 0 2023-12-16T05:56:35.793 INFO:tasks.workunit.client.0.smithi155.stdout:0/585: getdents d7/df 0 2023-12-16T05:56:35.793 INFO:tasks.workunit.client.0.smithi155.stdout:8/544: rmdir d4/d62/d66/d78/d88/d1b/d1c/d97/d29 39 2023-12-16T05:56:35.793 INFO:tasks.workunit.client.0.smithi155.stdout:8/545: stat d4/d62/d66/d78/d88/d12/fb1 0 2023-12-16T05:56:35.793 INFO:tasks.workunit.client.0.smithi155.stdout:8/546: chown d4/ff 1177 1 2023-12-16T05:56:35.793 INFO:tasks.workunit.client.0.smithi155.stdout:8/547: dread - d4/d62/d66/d78/d88/d12/fb1 zero size 2023-12-16T05:56:35.793 INFO:tasks.workunit.client.0.smithi155.stdout:8/548: chown d4/d62/d66/c99 14186395 1 2023-12-16T05:56:35.794 INFO:tasks.workunit.client.1.smithi156.stdout:9/282: dwrite d6/d19/d25/f5a [0,4194304] 0 2023-12-16T05:56:35.794 INFO:tasks.workunit.client.1.smithi156.stdout:1/200: creat d3/d1b/d27/f3e x:0 0 0 2023-12-16T05:56:35.797 INFO:tasks.workunit.client.1.smithi156.stdout:4/305: creat d9/d2b/f65 x:0 0 0 2023-12-16T05:56:35.797 INFO:tasks.workunit.client.0.smithi155.stdout:2/533: creat d0/d7/d1f/d74/d85/fb2 x:0 0 0 2023-12-16T05:56:35.797 INFO:tasks.workunit.client.0.smithi155.stdout:2/534: stat d0/d34/f5a 0 2023-12-16T05:56:35.798 INFO:tasks.workunit.client.0.smithi155.stdout:0/586: dread d7/d13/d45/d4b/f8c [0,4194304] 0 2023-12-16T05:56:35.799 INFO:tasks.workunit.client.0.smithi155.stdout:2/535: creat d0/d7/dd/d49/fb3 x:0 0 0 2023-12-16T05:56:35.800 INFO:tasks.workunit.client.1.smithi156.stdout:9/283: symlink d6/d19/d25/l63 0 2023-12-16T05:56:35.803 INFO:tasks.workunit.client.1.smithi156.stdout:4/306: symlink d9/d2c/d48/l66 0 2023-12-16T05:56:35.803 INFO:tasks.workunit.client.1.smithi156.stdout:2/334: dwrite d9/d12/f58 [4194304,4194304] 0 2023-12-16T05:56:35.804 INFO:tasks.workunit.client.1.smithi156.stdout:2/335: chown d9/f2d 516271 1 2023-12-16T05:56:35.804 INFO:tasks.workunit.client.1.smithi156.stdout:1/201: mkdir d3/d3f 0 2023-12-16T05:56:35.806 INFO:tasks.workunit.client.0.smithi155.stdout:0/587: creat d7/df/d73/db3/fc0 x:0 0 0 2023-12-16T05:56:35.806 INFO:tasks.workunit.client.1.smithi156.stdout:4/307: creat d9/d2c/d48/f67 x:0 0 0 2023-12-16T05:56:35.809 INFO:tasks.workunit.client.1.smithi156.stdout:5/507: dwrite da/dc/d2d/f58 [0,4194304] 0 2023-12-16T05:56:35.809 INFO:tasks.workunit.client.1.smithi156.stdout:5/508: write da/f42 [3005727,101839] 0 2023-12-16T05:56:35.810 INFO:tasks.workunit.client.1.smithi156.stdout:5/509: truncate da/dc/d2d/f8a 661740 0 2023-12-16T05:56:35.810 INFO:tasks.workunit.client.1.smithi156.stdout:2/336: creat d9/dd/d17/f61 x:0 0 0 2023-12-16T05:56:35.810 INFO:tasks.workunit.client.1.smithi156.stdout:2/337: chown d9/f44 51159 1 2023-12-16T05:56:35.815 INFO:tasks.workunit.client.0.smithi155.stdout:6/815: dwrite d0/d3/f12 [0,4194304] 0 2023-12-16T05:56:35.815 INFO:tasks.workunit.client.0.smithi155.stdout:6/816: readlink d0/df/d5e/d7e/db6/dc6/d103/l62 0 2023-12-16T05:56:35.815 INFO:tasks.workunit.client.1.smithi156.stdout:1/202: creat d3/d1b/f40 x:0 0 0 2023-12-16T05:56:35.815 INFO:tasks.workunit.client.1.smithi156.stdout:1/203: getdents d3/d3a/d3c 0 2023-12-16T05:56:35.817 INFO:tasks.workunit.client.1.smithi156.stdout:9/284: dread d6/d19/d30/f39 [0,4194304] 0 2023-12-16T05:56:35.817 INFO:tasks.workunit.client.1.smithi156.stdout:9/285: truncate d6/d19/d25/f4c 410003 0 2023-12-16T05:56:35.817 INFO:tasks.workunit.client.1.smithi156.stdout:9/286: fsync d6/f15 0 2023-12-16T05:56:35.818 INFO:tasks.workunit.client.1.smithi156.stdout:0/361: dwrite d2/d23/d4a/f5a [0,4194304] 0 2023-12-16T05:56:35.820 INFO:tasks.workunit.client.0.smithi155.stdout:1/700: sync 2023-12-16T05:56:35.820 INFO:tasks.workunit.client.0.smithi155.stdout:3/492: sync 2023-12-16T05:56:35.820 INFO:tasks.workunit.client.0.smithi155.stdout:4/574: sync 2023-12-16T05:56:35.820 INFO:tasks.workunit.client.0.smithi155.stdout:4/575: write d0/d10/d46/d16/d1a/d70/d92/fa9 [976941,61452] 0 2023-12-16T05:56:35.821 INFO:tasks.workunit.client.0.smithi155.stdout:4/576: chown d0/d10/d46/d16/d30/d52/d88/ca4 751032 1 2023-12-16T05:56:35.821 INFO:tasks.workunit.client.0.smithi155.stdout:4/577: write d0/d10/f26 [571040,13395] 0 2023-12-16T05:56:35.822 INFO:tasks.workunit.client.1.smithi156.stdout:6/303: dwrite d9/d13/f1b [0,4194304] 0 2023-12-16T05:56:35.822 INFO:tasks.workunit.client.1.smithi156.stdout:2/338: symlink d9/dd/d3f/l62 0 2023-12-16T05:56:35.822 INFO:tasks.workunit.client.1.smithi156.stdout:9/287: symlink d6/d19/d30/d5b/l64 0 2023-12-16T05:56:35.822 INFO:tasks.workunit.client.1.smithi156.stdout:9/288: chown d6/d19/d25/f38 5 1 2023-12-16T05:56:35.822 INFO:tasks.workunit.client.0.smithi155.stdout:6/817: getdents d0/df/d5e/d5b 0 2023-12-16T05:56:35.822 INFO:tasks.workunit.client.0.smithi155.stdout:6/818: chown d0/df/d5e/d46/f65 9153169 1 2023-12-16T05:56:35.822 INFO:tasks.workunit.client.0.smithi155.stdout:1/701: rmdir d1/d7/d4b/d8e/dc7/d28/d8f/db2/dd4 0 2023-12-16T05:56:35.824 INFO:tasks.workunit.client.0.smithi155.stdout:9/767: dwrite da/d15/d17/d24/d26/f2a [4194304,4194304] 0 2023-12-16T05:56:35.824 INFO:tasks.workunit.client.0.smithi155.stdout:9/768: fdatasync da/d15/d17/d24/d26/d2e/d32/db7/fe6 0 2023-12-16T05:56:35.825 INFO:tasks.workunit.client.0.smithi155.stdout:3/493: creat d0/d14/d36/d47/f98 x:0 0 0 2023-12-16T05:56:35.826 INFO:tasks.workunit.client.1.smithi156.stdout:6/304: getdents d9/d13/d2f 0 2023-12-16T05:56:35.827 INFO:tasks.workunit.client.1.smithi156.stdout:2/339: creat d9/d12/f63 x:0 0 0 2023-12-16T05:56:35.828 INFO:tasks.workunit.client.0.smithi155.stdout:6/819: mknod d0/df/d5e/d7e/db6/dc6/d103/de5/c10f 0 2023-12-16T05:56:35.828 INFO:tasks.workunit.client.0.smithi155.stdout:4/578: mkdir d0/d10/d46/d16/d1a/d70/d92/daf/db7/dbc 0 2023-12-16T05:56:35.830 INFO:tasks.workunit.client.0.smithi155.stdout:1/702: truncate d1/f2a 1306289 0 2023-12-16T05:56:35.830 INFO:tasks.workunit.client.1.smithi156.stdout:9/289: unlink d6/fe 0 2023-12-16T05:56:35.830 INFO:tasks.workunit.client.1.smithi156.stdout:0/362: dread d2/f28 [0,4194304] 0 2023-12-16T05:56:35.832 INFO:tasks.workunit.client.1.smithi156.stdout:9/290: write d6/f1e [3689535,104605] 0 2023-12-16T05:56:35.832 INFO:tasks.workunit.client.1.smithi156.stdout:2/340: creat d9/d5a/f64 x:0 0 0 2023-12-16T05:56:35.832 INFO:tasks.workunit.client.1.smithi156.stdout:9/291: readlink d6/d19/d30/l62 0 2023-12-16T05:56:35.832 INFO:tasks.workunit.client.1.smithi156.stdout:2/341: write d9/dd/d17/f61 [244991,41681] 0 2023-12-16T05:56:35.832 INFO:tasks.workunit.client.1.smithi156.stdout:8/259: dwrite d3/f29 [0,4194304] 0 2023-12-16T05:56:35.833 INFO:tasks.workunit.client.1.smithi156.stdout:8/260: fdatasync d3/f48 0 2023-12-16T05:56:35.834 INFO:tasks.workunit.client.1.smithi156.stdout:0/363: truncate d2/f24 3646736 0 2023-12-16T05:56:35.835 INFO:tasks.workunit.client.0.smithi155.stdout:8/549: dwrite d4/d62/d66/d78/d88/d1b/d1c/d97/d29/f9c [0,4194304] 0 2023-12-16T05:56:35.835 INFO:tasks.workunit.client.0.smithi155.stdout:6/820: mknod d0/d3/d2c/d8b/d85/da4/c110 0 2023-12-16T05:56:35.835 INFO:tasks.workunit.client.0.smithi155.stdout:6/821: getdents d0/df/d5e/d7e/deb 0 2023-12-16T05:56:35.835 INFO:tasks.workunit.client.0.smithi155.stdout:6/822: write d0/d3/d7a/db0/dc3/dce/ddd/d1b/f78 [398563,42144] 0 2023-12-16T05:56:35.835 INFO:tasks.workunit.client.0.smithi155.stdout:6/823: dread - d0/d3/d2c/d8b/d85/da4/ff5 zero size 2023-12-16T05:56:35.835 INFO:tasks.workunit.client.0.smithi155.stdout:6/824: chown d0/df/d5e/d7e/db6/dc6/d103/l62 2671 1 2023-12-16T05:56:35.837 INFO:tasks.workunit.client.0.smithi155.stdout:4/579: mknod d0/da/d36/d5f/d75/d3d/d49/cbd 0 2023-12-16T05:56:35.838 INFO:tasks.workunit.client.1.smithi156.stdout:9/292: write d6/d19/d30/f54 [3825271,52534] 0 2023-12-16T05:56:35.839 INFO:tasks.workunit.client.0.smithi155.stdout:2/536: rmdir d0/d7 39 2023-12-16T05:56:35.839 INFO:tasks.workunit.client.0.smithi155.stdout:2/537: readlink d0/d7/dd/d49/d4b/l7b 0 2023-12-16T05:56:35.840 INFO:tasks.workunit.client.0.smithi155.stdout:6/825: dread d0/d3/d2c/d8b/d85/f8d [0,4194304] 0 2023-12-16T05:56:35.840 INFO:tasks.workunit.client.0.smithi155.stdout:6/826: rename d0/d3/d7a to d0/d3/d7a/dd6/d111 22 2023-12-16T05:56:35.840 INFO:tasks.workunit.client.0.smithi155.stdout:6/827: truncate d0/d3/d7a/f9c 916994 0 2023-12-16T05:56:35.840 INFO:tasks.workunit.client.0.smithi155.stdout:6/828: dread - d0/df/d5e/d46/d6d/f107 zero size 2023-12-16T05:56:35.841 INFO:tasks.workunit.client.1.smithi156.stdout:1/204: dread f0 [4194304,4194304] 0 2023-12-16T05:56:35.841 INFO:tasks.workunit.client.0.smithi155.stdout:1/703: getdents d1/d25 0 2023-12-16T05:56:35.843 INFO:tasks.workunit.client.0.smithi155.stdout:8/550: rmdir d4/d62/d66/d78/d88/d1b/d1c/d19 39 2023-12-16T05:56:35.843 INFO:tasks.workunit.client.0.smithi155.stdout:8/551: write d4/d62/d66/d78/d88/d1b/d1c/d1a/f3a [363771,110852] 0 2023-12-16T05:56:35.843 INFO:tasks.workunit.client.1.smithi156.stdout:8/261: creat d3/d7/d9/f51 x:0 0 0 2023-12-16T05:56:35.845 INFO:tasks.workunit.client.0.smithi155.stdout:4/580: link d0/d10/d46/d16/d1a/d70/d92/fa9 d0/d10/d46/d16/d30/fbe 0 2023-12-16T05:56:35.845 INFO:tasks.workunit.client.0.smithi155.stdout:2/538: mknod d0/d7/d69/cb4 0 2023-12-16T05:56:35.846 INFO:tasks.workunit.client.1.smithi156.stdout:4/308: dwrite d9/d2c/f3e [0,4194304] 0 2023-12-16T05:56:35.846 INFO:tasks.workunit.client.1.smithi156.stdout:4/309: chown d9/c52 324 1 2023-12-16T05:56:35.846 INFO:tasks.workunit.client.1.smithi156.stdout:4/310: dread - d9/d2b/d35/f3f zero size 2023-12-16T05:56:35.846 INFO:tasks.workunit.client.1.smithi156.stdout:4/311: stat d9/f4d 0 2023-12-16T05:56:35.847 INFO:tasks.workunit.client.1.smithi156.stdout:9/293: mkdir d6/d19/d25/d3a/d57/d65 0 2023-12-16T05:56:35.848 INFO:tasks.workunit.client.0.smithi155.stdout:3/494: write d0/d14/f5e [2752168,121690] 0 2023-12-16T05:56:35.852 INFO:tasks.workunit.client.1.smithi156.stdout:4/312: creat d9/d43/d58/f68 x:0 0 0 2023-12-16T05:56:35.854 INFO:tasks.workunit.client.0.smithi155.stdout:6/829: symlink d0/df/d5e/d5b/dd7/l112 0 2023-12-16T05:56:35.854 INFO:tasks.workunit.client.0.smithi155.stdout:6/830: write d0/df/f27 [602231,11265] 0 2023-12-16T05:56:35.854 INFO:tasks.workunit.client.0.smithi155.stdout:2/539: creat d0/d7/dd/d49/d4b/d8c/fb5 x:0 0 0 2023-12-16T05:56:35.854 INFO:tasks.workunit.client.0.smithi155.stdout:2/540: chown d0/d7/f73 3759538 1 2023-12-16T05:56:35.854 INFO:tasks.workunit.client.0.smithi155.stdout:1/704: mkdir d1/d7/d4b/d8e/dc7/d28/d8f/db2/dde 0 2023-12-16T05:56:35.855 INFO:tasks.workunit.client.0.smithi155.stdout:2/541: rmdir d0/d7/d1f/d74 39 2023-12-16T05:56:35.855 INFO:tasks.workunit.client.0.smithi155.stdout:2/542: chown d0/c8f 467874 1 2023-12-16T05:56:35.855 INFO:tasks.workunit.client.0.smithi155.stdout:2/543: chown d0/d5/d6/l9a 21 1 2023-12-16T05:56:35.857 INFO:tasks.workunit.client.1.smithi156.stdout:5/510: dwrite da/dc/d4b/d6c/d81/f63 [0,4194304] 0 2023-12-16T05:56:35.857 INFO:tasks.workunit.client.0.smithi155.stdout:0/588: dwrite d7/df/f7f [0,4194304] 0 2023-12-16T05:56:35.858 INFO:tasks.workunit.client.0.smithi155.stdout:3/495: creat d0/d14/d36/d47/d61/f99 x:0 0 0 2023-12-16T05:56:35.858 INFO:tasks.workunit.client.0.smithi155.stdout:1/705: getdents d1/d7/d4b/d72/d7e 0 2023-12-16T05:56:35.858 INFO:tasks.workunit.client.0.smithi155.stdout:1/706: truncate d1/d7/d4b/d5c/fda 913033 0 2023-12-16T05:56:35.860 INFO:tasks.workunit.client.0.smithi155.stdout:2/544: mkdir d0/d7/dd/d14/db6 0 2023-12-16T05:56:35.860 INFO:tasks.workunit.client.0.smithi155.stdout:2/545: write d0/d7/d57/d63/fb1 [313772,104209] 0 2023-12-16T05:56:35.860 INFO:tasks.workunit.client.0.smithi155.stdout:2/546: write d0/d7/d1f/d74/d85/d88/f89 [389043,18013] 0 2023-12-16T05:56:35.860 INFO:tasks.workunit.client.1.smithi156.stdout:5/511: symlink da/dc/d2d/d4d/d54/d90/la2 0 2023-12-16T05:56:35.861 INFO:tasks.workunit.client.0.smithi155.stdout:9/769: dread da/d15/d17/d24/d62/f97 [0,4194304] 0 2023-12-16T05:56:35.862 INFO:tasks.workunit.client.1.smithi156.stdout:5/512: truncate da/dc/d4b/d6c/f7a 1058977 0 2023-12-16T05:56:35.862 INFO:tasks.workunit.client.1.smithi156.stdout:5/513: readlink da/l35 0 2023-12-16T05:56:35.862 INFO:tasks.workunit.client.1.smithi156.stdout:6/305: dwrite d9/d13/f1b [0,4194304] 0 2023-12-16T05:56:35.867 INFO:tasks.workunit.client.1.smithi156.stdout:1/205: dread d3/f15 [0,4194304] 0 2023-12-16T05:56:35.867 INFO:tasks.workunit.client.1.smithi156.stdout:1/206: write d3/d17/d19/f2e [644215,32554] 0 2023-12-16T05:56:35.869 INFO:tasks.workunit.client.1.smithi156.stdout:6/306: mkdir d9/d1c/d61 0 2023-12-16T05:56:35.869 INFO:tasks.workunit.client.1.smithi156.stdout:6/307: write d9/ff [1904243,40404] 0 2023-12-16T05:56:35.870 INFO:tasks.workunit.client.1.smithi156.stdout:1/207: read d3/d1b/f25 [148806,18233] 0 2023-12-16T05:56:35.874 INFO:tasks.workunit.client.1.smithi156.stdout:6/308: mknod d9/d13/c62 0 2023-12-16T05:56:35.875 INFO:tasks.workunit.client.1.smithi156.stdout:1/208: symlink d3/d17/d2d/l41 0 2023-12-16T05:56:35.877 INFO:tasks.workunit.client.1.smithi156.stdout:1/209: mknod d3/d17/c42 0 2023-12-16T05:56:35.878 INFO:tasks.workunit.client.0.smithi155.stdout:1/707: dread d1/d69/f8a [0,4194304] 0 2023-12-16T05:56:35.879 INFO:tasks.workunit.client.1.smithi156.stdout:1/210: mknod d3/d17/d19/c43 0 2023-12-16T05:56:35.881 INFO:tasks.workunit.client.1.smithi156.stdout:1/211: rmdir d3/d3a/d3c 0 2023-12-16T05:56:35.882 INFO:tasks.workunit.client.1.smithi156.stdout:1/212: rmdir d3/d3f 0 2023-12-16T05:56:35.884 INFO:tasks.workunit.client.0.smithi155.stdout:8/552: dwrite d4/d62/d66/d78/f82 [0,4194304] 0 2023-12-16T05:56:35.885 INFO:tasks.workunit.client.1.smithi156.stdout:9/294: dwrite d6/fd [0,4194304] 0 2023-12-16T05:56:35.891 INFO:tasks.workunit.client.1.smithi156.stdout:0/364: dwrite d2/d7/dd/d29/f4f [0,4194304] 0 2023-12-16T05:56:35.892 INFO:tasks.workunit.client.1.smithi156.stdout:0/365: write d2/d7/f18 [185217,97975] 0 2023-12-16T05:56:35.893 INFO:tasks.workunit.client.1.smithi156.stdout:9/295: rename d6/d2e/f45 to d6/d2e/f66 0 2023-12-16T05:56:35.896 INFO:tasks.workunit.client.1.smithi156.stdout:9/296: creat d6/d19/d25/d3a/d5e/f67 x:0 0 0 2023-12-16T05:56:35.896 INFO:tasks.workunit.client.1.smithi156.stdout:9/297: rmdir d6/d19/d25/d3a 39 2023-12-16T05:56:35.897 INFO:tasks.workunit.client.0.smithi155.stdout:0/589: rmdir d7 39 2023-12-16T05:56:35.900 INFO:tasks.workunit.client.0.smithi155.stdout:3/496: rmdir d0/d14/d36/d83/d97 0 2023-12-16T05:56:35.901 INFO:tasks.workunit.client.1.smithi156.stdout:0/366: write d2/d7/dd/d29/d38/f3e [2048341,23017] 0 2023-12-16T05:56:35.902 INFO:tasks.workunit.client.0.smithi155.stdout:9/770: mknod da/d15/c105 0 2023-12-16T05:56:35.903 INFO:tasks.workunit.client.1.smithi156.stdout:4/313: dwrite d9/f42 [0,4194304] 0 2023-12-16T05:56:35.903 INFO:tasks.workunit.client.1.smithi156.stdout:4/314: fsync d9/f1e 0 2023-12-16T05:56:35.904 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.898+0000 7fd013ebe700 1 -- 172.21.15.155:0/611935501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd00c0fb520 msgr2=0x7fd00c0fd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:35.904 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.898+0000 7fd013ebe700 1 --2- 172.21.15.155:0/611935501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd00c0fb520 0x7fd00c0fd940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcffc004940 tx=0x7fcffc009e30 comp rx=0 tx=0).stop 2023-12-16T05:56:35.904 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.901+0000 7fd013ebe700 1 -- 172.21.15.155:0/611935501 shutdown_connections 2023-12-16T05:56:35.904 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.901+0000 7fd013ebe700 1 --2- 172.21.15.155:0/611935501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd00c0fde80 0x7fd00c100300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:35.904 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.901+0000 7fd013ebe700 1 --2- 172.21.15.155:0/611935501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd00c0fb520 0x7fd00c0fd940 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:35.904 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.901+0000 7fd013ebe700 1 -- 172.21.15.155:0/611935501 >> 172.21.15.155:0/611935501 conn(0x7fd00c0f7190 msgr2=0x7fd00c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:56:35.905 INFO:tasks.workunit.client.0.smithi155.stdout:1/708: rename d1/d7/d4b/d8e/dc7/d28/d74/f7a to d1/d7/d4b/d8e/dc7/d28/fdf 0 2023-12-16T05:56:35.905 INFO:tasks.workunit.client.0.smithi155.stdout:1/709: fsync d1/d7/d16/d30/f6e 0 2023-12-16T05:56:35.905 INFO:tasks.workunit.client.1.smithi156.stdout:4/315: dread d9/f23 [0,4194304] 0 2023-12-16T05:56:35.905 INFO:tasks.workunit.client.1.smithi156.stdout:4/316: dread - d9/d43/d58/f68 zero size 2023-12-16T05:56:35.905 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.902+0000 7fd013ebe700 1 -- 172.21.15.155:0/611935501 shutdown_connections 2023-12-16T05:56:35.905 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.902+0000 7fd013ebe700 1 -- 172.21.15.155:0/611935501 wait complete. 2023-12-16T05:56:35.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.903+0000 7fd013ebe700 1 Processor -- start 2023-12-16T05:56:35.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.903+0000 7fd013ebe700 1 -- start start 2023-12-16T05:56:35.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.903+0000 7fd013ebe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd00c0fb520 0x7fd00c113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:35.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.903+0000 7fd013ebe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd00c0fde80 0x7fd00c114000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:35.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.903+0000 7fd013ebe700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c114600 con 0x7fd00c0fde80 2023-12-16T05:56:35.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.903+0000 7fd013ebe700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c114ea0 con 0x7fd00c0fb520 2023-12-16T05:56:35.907 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.903+0000 7fd011459700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd00c0fde80 0x7fd00c114000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:35.907 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.903+0000 7fd011459700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd00c0fde80 0x7fd00c114000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:43692/0 (socket says 172.21.15.155:43692) 2023-12-16T05:56:35.907 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.903+0000 7fd011459700 1 -- 172.21.15.155:0/276742174 learned_addr learned my addr 172.21.15.155:0/276742174 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:56:35.907 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.904+0000 7fd011459700 1 -- 172.21.15.155:0/276742174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd00c0fb520 msgr2=0x7fd00c113ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:35.907 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.904+0000 7fd011459700 1 --2- 172.21.15.155:0/276742174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd00c0fb520 0x7fd00c113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:35.908 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.904+0000 7fd011459700 1 -- 172.21.15.155:0/276742174 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc005040 con 0x7fd00c0fde80 2023-12-16T05:56:35.908 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.904+0000 7fd011459700 1 --2- 172.21.15.155:0/276742174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd00c0fde80 0x7fd00c114000 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd00800eb40 tx=0x7fd00800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:56:35.908 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.905+0000 7fd0027fc700 1 -- 172.21.15.155:0/276742174 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd008007cc0 con 0x7fd00c0fde80 2023-12-16T05:56:35.908 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.905+0000 7fd013ebe700 1 -- 172.21.15.155:0/276742174 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00c1150a0 con 0x7fd00c0fde80 2023-12-16T05:56:35.908 INFO:tasks.workunit.client.0.smithi155.stdout:0/590: symlink d7/df/d73/d8d/d4d/lc1 0 2023-12-16T05:56:35.908 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.905+0000 7fd013ebe700 1 -- 172.21.15.155:0/276742174 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00c1155e0 con 0x7fd00c0fde80 2023-12-16T05:56:35.909 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.905+0000 7fd0027fc700 1 -- 172.21.15.155:0/276742174 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd00800f040 con 0x7fd00c0fde80 2023-12-16T05:56:35.909 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.905+0000 7fd0027fc700 1 -- 172.21.15.155:0/276742174 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd008009570 con 0x7fd00c0fde80 2023-12-16T05:56:35.911 INFO:tasks.workunit.client.1.smithi156.stdout:9/298: dread d6/d19/f2a [0,4194304] 0 2023-12-16T05:56:35.911 INFO:tasks.workunit.client.0.smithi155.stdout:9/771: symlink da/d15/d17/d36/d5b/d98/dc2/l106 0 2023-12-16T05:56:35.912 INFO:tasks.workunit.client.0.smithi155.stdout:3/497: unlink d0/c29 0 2023-12-16T05:56:35.912 INFO:tasks.workunit.client.1.smithi156.stdout:9/299: creat d6/d19/d25/d3a/d5e/f68 x:0 0 0 2023-12-16T05:56:35.912 INFO:tasks.workunit.client.1.smithi156.stdout:9/300: readlink d6/d19/l40 0 2023-12-16T05:56:35.912 INFO:tasks.workunit.client.1.smithi156.stdout:9/301: dread - d6/d19/d25/d3a/d5e/f67 zero size 2023-12-16T05:56:35.913 INFO:tasks.workunit.client.1.smithi156.stdout:9/302: symlink d6/d19/d25/d3a/d57/l69 0 2023-12-16T05:56:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.907+0000 7fd013ebe700 1 -- 172.21.15.155:0/276742174 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00c04bb80 con 0x7fd00c0fde80 2023-12-16T05:56:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.908+0000 7fd0027fc700 1 -- 172.21.15.155:0/276742174 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 24) v1 ==== 88727+0+0 (secure 0 0 0) 0x7fd0080096d0 con 0x7fd00c0fde80 2023-12-16T05:56:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.909+0000 7fd0027fc700 1 --2- 172.21.15.155:0/276742174 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7fcff806af00 0x7fcff806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.909+0000 7fd0027fc700 1 -- 172.21.15.155:0/276742174 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fd0080897c0 con 0x7fd00c0fde80 2023-12-16T05:56:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.909+0000 7fd011c5a700 1 --2- 172.21.15.155:0/276742174 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7fcff806af00 0x7fcff806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.910+0000 7fd011c5a700 1 --2- 172.21.15.155:0/276742174 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7fcff806af00 0x7fcff806d3b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00b0d0 tx=0x7fcffc009e30 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:56:35.914 INFO:tasks.workunit.client.0.smithi155.stdout:6/831: dwrite d0/d3/d7a/d77/f98 [0,4194304] 0 2023-12-16T05:56:35.914 INFO:tasks.workunit.client.0.smithi155.stdout:1/710: rename d1/d7/d4b/d72 to d1/d7/d4b/d8e/dc7/d28/d85/de0 0 2023-12-16T05:56:35.915 INFO:tasks.workunit.client.0.smithi155.stdout:1/711: dread - d1/d69/fc1 zero size 2023-12-16T05:56:35.915 INFO:tasks.workunit.client.1.smithi156.stdout:9/303: rename d6/c5c to d6/d19/d25/d3a/d57/d65/c6a 0 2023-12-16T05:56:35.916 INFO:tasks.workunit.client.0.smithi155.stdout:0/591: creat d7/df/d73/d8d/d4d/fc2 x:0 0 0 2023-12-16T05:56:35.916 INFO:tasks.workunit.client.1.smithi156.stdout:9/304: unlink d6/d19/d25/f5a 0 2023-12-16T05:56:35.916 INFO:tasks.workunit.client.1.smithi156.stdout:9/305: stat d6/d19/d25/d3a 0 2023-12-16T05:56:35.917 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:35.914+0000 7fd0027fc700 1 -- 172.21.15.155:0/276742174 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fd008057650 con 0x7fd00c0fde80 2023-12-16T05:56:35.917 INFO:tasks.workunit.client.1.smithi156.stdout:4/317: dread f0 [0,4194304] 0 2023-12-16T05:56:35.918 INFO:tasks.workunit.client.1.smithi156.stdout:9/306: mknod d6/d19/d25/d3a/d57/d65/c6b 0 2023-12-16T05:56:35.918 INFO:tasks.workunit.client.1.smithi156.stdout:9/307: chown d6/d19/d25/l59 254085 1 2023-12-16T05:56:35.919 INFO:tasks.workunit.client.0.smithi155.stdout:3/498: mkdir d0/d14/d36/d47/d5f/d9a 0 2023-12-16T05:56:35.920 INFO:tasks.workunit.client.1.smithi156.stdout:9/308: creat d6/d19/d25/d3a/f6c x:0 0 0 2023-12-16T05:56:35.920 INFO:tasks.workunit.client.1.smithi156.stdout:5/514: dwrite da/f68 [0,4194304] 0 2023-12-16T05:56:35.920 INFO:tasks.workunit.client.1.smithi156.stdout:9/309: fsync d6/d19/f37 0 2023-12-16T05:56:35.920 INFO:tasks.workunit.client.1.smithi156.stdout:5/515: chown da/f3a 108450636 1 2023-12-16T05:56:35.920 INFO:tasks.workunit.client.1.smithi156.stdout:6/309: dwrite f8 [0,4194304] 0 2023-12-16T05:56:35.920 INFO:tasks.workunit.client.1.smithi156.stdout:6/310: readlink d9/l42 0 2023-12-16T05:56:35.921 INFO:tasks.workunit.client.0.smithi155.stdout:1/712: dread d1/d7/d4b/d8e/dc7/d28/d74/fbf [0,4194304] 0 2023-12-16T05:56:35.921 INFO:tasks.workunit.client.0.smithi155.stdout:1/713: chown d1/d7/d16/d30/f62 2 1 2023-12-16T05:56:35.921 INFO:tasks.workunit.client.0.smithi155.stdout:2/547: dwrite d0/d7/dd/f26 [0,4194304] 0 2023-12-16T05:56:35.921 INFO:tasks.workunit.client.0.smithi155.stdout:2/548: truncate d0/d5/d6/f83 720278 0 2023-12-16T05:56:35.922 INFO:tasks.workunit.client.1.smithi156.stdout:9/310: rename d6/d19/d25/l49 to d6/d19/d30/l6d 0 2023-12-16T05:56:35.923 INFO:tasks.workunit.client.1.smithi156.stdout:4/318: dread d9/d2c/f2e [0,4194304] 0 2023-12-16T05:56:35.923 INFO:tasks.workunit.client.0.smithi155.stdout:6/832: write d0/df/d5e/d7e/db6/dc6/d103/f70 [9444,31503] 0 2023-12-16T05:56:35.924 INFO:tasks.workunit.client.1.smithi156.stdout:1/213: dwrite d3/f15 [4194304,4194304] 0 2023-12-16T05:56:35.924 INFO:tasks.workunit.client.1.smithi156.stdout:1/214: truncate d3/d1b/d27/f3e 216185 0 2023-12-16T05:56:35.924 INFO:tasks.workunit.client.1.smithi156.stdout:1/215: readlink d3/d17/l30 0 2023-12-16T05:56:35.924 INFO:tasks.workunit.client.1.smithi156.stdout:1/216: readlink d3/l13 0 2023-12-16T05:56:35.924 INFO:tasks.workunit.client.1.smithi156.stdout:1/217: fdatasync d3/d17/d19/f26 0 2023-12-16T05:56:35.925 INFO:tasks.workunit.client.1.smithi156.stdout:5/516: creat da/dc/d4b/d6c/d81/fa3 x:0 0 0 2023-12-16T05:56:35.925 INFO:tasks.workunit.client.1.smithi156.stdout:5/517: truncate da/dc/d4b/d6c/f7a 1495729 0 2023-12-16T05:56:35.925 INFO:tasks.workunit.client.1.smithi156.stdout:5/518: chown da/dc/d4b/d6c/d81/f63 1516091 1 2023-12-16T05:56:35.926 INFO:tasks.workunit.client.1.smithi156.stdout:6/311: creat d9/d13/d2f/d36/f63 x:0 0 0 2023-12-16T05:56:35.926 INFO:tasks.workunit.client.1.smithi156.stdout:6/312: getdents d9/d13/d2f 0 2023-12-16T05:56:35.927 INFO:tasks.workunit.client.0.smithi155.stdout:8/553: rename d4/d62/d66/d78/d88/d1b/d1c/d1a/f3f to d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/fb3 0 2023-12-16T05:56:35.927 INFO:tasks.workunit.client.0.smithi155.stdout:8/554: write d4/d62/d66/d78/d88/d1b/d1c/d19/d64/fa4 [227790,86539] 0 2023-12-16T05:56:35.929 INFO:tasks.workunit.client.0.smithi155.stdout:0/592: symlink d7/d13/d46/d81/lc3 0 2023-12-16T05:56:35.929 INFO:tasks.workunit.client.0.smithi155.stdout:0/593: write d7/df/d65/f55 [930504,14721] 0 2023-12-16T05:56:35.929 INFO:tasks.workunit.client.0.smithi155.stdout:3/499: write d0/d1e/f32 [2840250,77640] 0 2023-12-16T05:56:35.931 INFO:tasks.workunit.client.0.smithi155.stdout:2/549: creat d0/d7/d57/d9b/fb7 x:0 0 0 2023-12-16T05:56:35.931 INFO:tasks.workunit.client.1.smithi156.stdout:4/319: rename d9/d2b/d56/l63 to d9/d43/d58/l69 0 2023-12-16T05:56:35.931 INFO:tasks.workunit.client.1.smithi156.stdout:4/320: fdatasync d9/f42 0 2023-12-16T05:56:35.934 INFO:tasks.workunit.client.0.smithi155.stdout:6/833: link d0/df/d5e/d5b/f76 d0/dbd/f113 0 2023-12-16T05:56:35.937 INFO:tasks.workunit.client.0.smithi155.stdout:9/772: rename da/d15/d17/d36/d54/lad to da/d15/d17/d24/d26/l107 0 2023-12-16T05:56:35.938 INFO:tasks.workunit.client.0.smithi155.stdout:8/555: creat d4/d62/d66/d78/d88/d1b/d1c/d19/fb4 x:0 0 0 2023-12-16T05:56:35.941 INFO:tasks.workunit.client.0.smithi155.stdout:0/594: rename d7/df/d73/fb1 to d7/df/d73/d8d/fc4 0 2023-12-16T05:56:35.941 INFO:tasks.workunit.client.0.smithi155.stdout:0/595: stat d7/d2d/f3f 0 2023-12-16T05:56:35.941 INFO:tasks.workunit.client.0.smithi155.stdout:0/596: truncate d7/df/d41/f77 858137 0 2023-12-16T05:56:35.941 INFO:tasks.workunit.client.0.smithi155.stdout:0/597: dread - d7/d13/d45/f6c zero size 2023-12-16T05:56:35.942 INFO:tasks.workunit.client.0.smithi155.stdout:1/714: dwrite d1/d7/d4b/d8e/dc7/d28/d85/de0/d7e/fae [0,4194304] 0 2023-12-16T05:56:35.944 INFO:tasks.workunit.client.1.smithi156.stdout:4/321: dread d9/f1e [0,4194304] 0 2023-12-16T05:56:35.944 INFO:tasks.workunit.client.0.smithi155.stdout:8/556: symlink d4/d62/d66/d78/d80/lb5 0 2023-12-16T05:56:35.945 INFO:tasks.workunit.client.0.smithi155.stdout:6/834: rename d0/d3/d2c/d8b/lda to d0/d3/d2c/d8b/d85/da4/l114 0 2023-12-16T05:56:35.946 INFO:tasks.workunit.client.0.smithi155.stdout:0/598: creat d7/d13/d45/fc5 x:0 0 0 2023-12-16T05:56:35.947 INFO:tasks.workunit.client.1.smithi156.stdout:5/519: dread da/dc/f3d [0,4194304] 0 2023-12-16T05:56:35.950 INFO:tasks.workunit.client.1.smithi156.stdout:1/218: symlink d3/d17/d2d/l44 0 2023-12-16T05:56:35.952 INFO:tasks.workunit.client.0.smithi155.stdout:6/835: creat d0/dbd/f115 x:0 0 0 2023-12-16T05:56:35.952 INFO:tasks.workunit.client.0.smithi155.stdout:6/836: chown d0/l8e 10354027 1 2023-12-16T05:56:35.958 INFO:tasks.workunit.client.1.smithi156.stdout:4/322: mknod d9/d43/c6a 0 2023-12-16T05:56:35.958 INFO:tasks.workunit.client.1.smithi156.stdout:4/323: fdatasync d9/f28 0 2023-12-16T05:56:35.958 INFO:tasks.workunit.client.1.smithi156.stdout:4/324: chown d9/f19 1308 1 2023-12-16T05:56:35.963 INFO:tasks.workunit.client.0.smithi155.stdout:3/500: dwrite d0/d14/d36/d47/f98 [0,4194304] 0 2023-12-16T05:56:35.966 INFO:tasks.workunit.client.1.smithi156.stdout:5/520: creat da/dc/d4b/d6c/d7c/d85/fa4 x:0 0 0 2023-12-16T05:56:35.968 INFO:tasks.workunit.client.1.smithi156.stdout:4/325: unlink d9/l29 0 2023-12-16T05:56:35.968 INFO:tasks.workunit.client.0.smithi155.stdout:3/501: dread d0/f2e [0,4194304] 0 2023-12-16T05:56:35.968 INFO:tasks.workunit.client.0.smithi155.stdout:3/502: write d0/f12 [12982975,57536] 0 2023-12-16T05:56:35.969 INFO:tasks.workunit.client.1.smithi156.stdout:5/521: creat da/dc/d2d/d9b/fa5 x:0 0 0 2023-12-16T05:56:35.970 INFO:tasks.workunit.client.0.smithi155.stdout:3/503: mkdir d0/d14/d36/d47/d5f/d9a/d9b 0 2023-12-16T05:56:35.970 INFO:tasks.workunit.client.0.smithi155.stdout:3/504: chown d0/d14/d36/d79/d80/d73/c74 1067851 1 2023-12-16T05:56:35.970 INFO:tasks.workunit.client.1.smithi156.stdout:4/326: creat d9/d2c/f6b x:0 0 0 2023-12-16T05:56:35.970 INFO:tasks.workunit.client.1.smithi156.stdout:9/311: getdents d6/d19/d25/d3a 0 2023-12-16T05:56:35.974 INFO:tasks.workunit.client.0.smithi155.stdout:0/599: getdents d7/df/d73/d8d/d4d 0 2023-12-16T05:56:35.974 INFO:tasks.workunit.client.0.smithi155.stdout:0/600: getdents d7/db0 0 2023-12-16T05:56:35.974 INFO:tasks.workunit.client.0.smithi155.stdout:0/601: truncate d7/d13/d45/f6c 760706 0 2023-12-16T05:56:35.974 INFO:tasks.workunit.client.0.smithi155.stdout:3/505: getdents d0/d14/d45 0 2023-12-16T05:56:35.974 INFO:tasks.workunit.client.0.smithi155.stdout:3/506: fsync d0/d14/d36/d47/d5f/f7d 0 2023-12-16T05:56:35.975 INFO:tasks.workunit.client.0.smithi155.stdout:3/507: creat d0/d14/d87/f9c x:0 0 0 2023-12-16T05:56:35.976 INFO:tasks.workunit.client.0.smithi155.stdout:9/773: dwrite da/d15/d17/d36/d5b/f71 [0,4194304] 0 2023-12-16T05:56:35.976 INFO:tasks.workunit.client.0.smithi155.stdout:9/774: stat da/d15/d17/d36/d54/f7f 0 2023-12-16T05:56:35.976 INFO:tasks.workunit.client.1.smithi156.stdout:4/327: write d9/f37 [3230000,117837] 0 2023-12-16T05:56:35.977 INFO:tasks.workunit.client.0.smithi155.stdout:5/663: sync 2023-12-16T05:56:35.977 INFO:tasks.workunit.client.0.smithi155.stdout:5/664: chown d0/d2/d2a/d30/d53 1709723 1 2023-12-16T05:56:35.977 INFO:tasks.workunit.client.0.smithi155.stdout:3/508: mkdir d0/d14/d9d 0 2023-12-16T05:56:35.978 INFO:tasks.workunit.client.1.smithi156.stdout:1/219: dwrite d3/d1b/d27/f29 [0,4194304] 0 2023-12-16T05:56:35.981 INFO:tasks.workunit.client.1.smithi156.stdout:4/328: rename d9/l4c to d9/d2b/d56/l6c 0 2023-12-16T05:56:35.982 INFO:tasks.workunit.client.0.smithi155.stdout:6/837: dwrite d0/df/d5e/d5b/f76 [0,4194304] 0 2023-12-16T05:56:35.982 INFO:tasks.workunit.client.0.smithi155.stdout:2/550: dwrite d0/d7/f5e [0,4194304] 0 2023-12-16T05:56:35.982 INFO:tasks.workunit.client.0.smithi155.stdout:8/557: dwrite d4/f41 [0,4194304] 0 2023-12-16T05:56:35.983 INFO:tasks.workunit.client.0.smithi155.stdout:9/775: symlink da/d15/d17/d24/d26/l108 0 2023-12-16T05:56:35.984 INFO:tasks.workunit.client.1.smithi156.stdout:1/220: rename d3/d1b/d27/l2c to d3/d17/d19/l45 0 2023-12-16T05:56:35.984 INFO:tasks.workunit.client.1.smithi156.stdout:9/312: dwrite d6/f51 [0,4194304] 0 2023-12-16T05:56:35.984 INFO:tasks.workunit.client.1.smithi156.stdout:9/313: fdatasync d6/d2e/f52 0 2023-12-16T05:56:35.984 INFO:tasks.workunit.client.1.smithi156.stdout:9/314: fdatasync d6/d19/d25/d3a/f60 0 2023-12-16T05:56:35.986 INFO:tasks.workunit.client.0.smithi155.stdout:5/665: mkdir d0/d2/d2a/d19/dd7 0 2023-12-16T05:56:35.986 INFO:tasks.workunit.client.0.smithi155.stdout:5/666: write d0/d2/d2a/d30/d53/d7b/d99/fca [110904,8353] 0 2023-12-16T05:56:35.986 INFO:tasks.workunit.client.1.smithi156.stdout:4/329: unlink d9/c13 0 2023-12-16T05:56:35.988 INFO:tasks.workunit.client.0.smithi155.stdout:3/509: link d0/d14/d51/f4a d0/d1a/d33/f9e 0 2023-12-16T05:56:35.989 INFO:tasks.workunit.client.1.smithi156.stdout:1/221: write d3/f14 [897963,16690] 0 2023-12-16T05:56:35.991 INFO:tasks.workunit.client.1.smithi156.stdout:4/330: rename d9/d43/f44 to d9/d2b/d56/f6d 0 2023-12-16T05:56:35.991 INFO:tasks.workunit.client.1.smithi156.stdout:4/331: fsync d9/f4f 0 2023-12-16T05:56:35.992 INFO:tasks.workunit.client.1.smithi156.stdout:4/332: readlink d9/d43/d58/l69 0 2023-12-16T05:56:35.992 INFO:tasks.workunit.client.0.smithi155.stdout:0/602: dwrite d7/d13/d45/d4b/f8c [0,4194304] 0 2023-12-16T05:56:35.992 INFO:tasks.workunit.client.0.smithi155.stdout:0/603: truncate d7/d13/d45/fa0 1027147 0 2023-12-16T05:56:35.992 INFO:tasks.workunit.client.0.smithi155.stdout:6/838: symlink d0/df/d5e/d46/d6d/l116 0 2023-12-16T05:56:35.993 INFO:tasks.workunit.client.1.smithi156.stdout:1/222: creat d3/d1b/f46 x:0 0 0 2023-12-16T05:56:35.995 INFO:tasks.workunit.client.1.smithi156.stdout:4/333: rename d9/l17 to d9/d43/d58/l6e 0 2023-12-16T05:56:35.995 INFO:tasks.workunit.client.1.smithi156.stdout:1/223: write f0 [209128,88460] 0 2023-12-16T05:56:35.997 INFO:tasks.workunit.client.1.smithi156.stdout:4/334: link d9/c10 d9/d2b/d35/c6f 0 2023-12-16T05:56:35.997 INFO:tasks.workunit.client.1.smithi156.stdout:3/261: sync 2023-12-16T05:56:35.997 INFO:tasks.workunit.client.1.smithi156.stdout:3/262: readlink dc/d10/d1d/l3b 0 2023-12-16T05:56:35.997 INFO:tasks.workunit.client.1.smithi156.stdout:9/315: dwrite d6/f14 [0,4194304] 0 2023-12-16T05:56:35.998 INFO:tasks.workunit.client.0.smithi155.stdout:2/551: mkdir d0/d7/d69/db8 0 2023-12-16T05:56:35.998 INFO:tasks.workunit.client.0.smithi155.stdout:2/552: fsync d0/d34/f40 0 2023-12-16T05:56:35.998 INFO:tasks.workunit.client.1.smithi156.stdout:1/224: truncate d3/d1b/d27/f34 446030 0 2023-12-16T05:56:35.998 INFO:tasks.workunit.client.1.smithi156.stdout:1/225: read - d3/d1b/f37 zero size 2023-12-16T05:56:35.999 INFO:tasks.workunit.client.0.smithi155.stdout:8/558: mknod d4/d62/d66/d78/d88/d1b/d1c/d19/cb6 0 2023-12-16T05:56:35.999 INFO:tasks.workunit.client.1.smithi156.stdout:4/335: link d9/f37 d9/f70 0 2023-12-16T05:56:35.999 INFO:tasks.workunit.client.1.smithi156.stdout:4/336: chown d9/d43/d58/f68 153 1 2023-12-16T05:56:35.999 INFO:tasks.workunit.client.1.smithi156.stdout:4/337: dread - d9/d2b/d35/f3f zero size 2023-12-16T05:56:36.000 INFO:tasks.workunit.client.1.smithi156.stdout:3/263: rename dc/l21 to dc/d10/d1d/d4b/l60 0 2023-12-16T05:56:36.001 INFO:tasks.workunit.client.1.smithi156.stdout:1/226: symlink d3/d17/d1c/l47 0 2023-12-16T05:56:36.002 INFO:tasks.workunit.client.1.smithi156.stdout:4/338: creat d9/d2b/d35/f71 x:0 0 0 2023-12-16T05:56:36.002 INFO:tasks.workunit.client.1.smithi156.stdout:1/227: write d3/d1b/f25 [1893166,79425] 0 2023-12-16T05:56:36.003 INFO:tasks.workunit.client.1.smithi156.stdout:9/316: dread d6/d2e/f35 [0,4194304] 0 2023-12-16T05:56:36.003 INFO:tasks.workunit.client.1.smithi156.stdout:3/264: symlink dc/df/l61 0 2023-12-16T05:56:36.005 INFO:tasks.workunit.client.1.smithi156.stdout:4/339: link d9/d2b/d35/l5e d9/d2c/d48/l72 0 2023-12-16T05:56:36.006 INFO:tasks.workunit.client.1.smithi156.stdout:9/317: getdents d6/d19/d25 0 2023-12-16T05:56:36.006 INFO:tasks.workunit.client.1.smithi156.stdout:9/318: readlink d6/d19/d25/l2b 0 2023-12-16T05:56:36.008 INFO:tasks.workunit.client.0.smithi155.stdout:9/776: creat da/d15/d17/d24/d26/d2e/d32/f109 x:0 0 0 2023-12-16T05:56:36.008 INFO:tasks.workunit.client.0.smithi155.stdout:9/777: write da/d15/d17/d24/d26/d2e/d32/fe2 [37798,24648] 0 2023-12-16T05:56:36.008 INFO:tasks.workunit.client.0.smithi155.stdout:9/778: stat da/d15/d17/d36/d5b 0 2023-12-16T05:56:36.009 INFO:tasks.workunit.client.0.smithi155.stdout:5/667: mkdir d0/d2/d2a/d19/d88/dd8 0 2023-12-16T05:56:36.011 INFO:tasks.workunit.client.1.smithi156.stdout:4/340: write d9/d43/d58/f60 [2560035,121341] 0 2023-12-16T05:56:36.015 INFO:tasks.workunit.client.0.smithi155.stdout:0/604: creat d7/df/d73/db3/fc6 x:0 0 0 2023-12-16T05:56:36.015 INFO:tasks.workunit.client.1.smithi156.stdout:4/341: rename d9/f4f to d9/f73 0 2023-12-16T05:56:36.015 INFO:tasks.workunit.client.1.smithi156.stdout:4/342: truncate f6 3709677 0 2023-12-16T05:56:36.016 INFO:tasks.workunit.client.0.smithi155.stdout:6/839: mknod d0/d3/d7a/dd6/c117 0 2023-12-16T05:56:36.017 INFO:tasks.workunit.client.0.smithi155.stdout:2/553: dwrite d0/d7/d69/f91 [0,4194304] 0 2023-12-16T05:56:36.018 INFO:tasks.workunit.client.0.smithi155.stdout:8/559: mkdir d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/db7 0 2023-12-16T05:56:36.020 INFO:tasks.workunit.client.1.smithi156.stdout:9/319: dwrite d6/d19/d25/d3a/f6c [0,4194304] 0 2023-12-16T05:56:36.020 INFO:tasks.workunit.client.0.smithi155.stdout:9/779: mknod da/d15/d17/d24/d26/d2e/d83/d8f/d9c/c10a 0 2023-12-16T05:56:36.022 INFO:tasks.workunit.client.0.smithi155.stdout:5/668: mkdir d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/dd9 0 2023-12-16T05:56:36.024 INFO:tasks.workunit.client.0.smithi155.stdout:3/510: link d0/d1a/d33/f72 d0/d1e/f9f 0 2023-12-16T05:56:36.024 INFO:tasks.workunit.client.0.smithi155.stdout:3/511: stat d0/d14/d51/f4a 0 2023-12-16T05:56:36.026 INFO:tasks.workunit.client.0.smithi155.stdout:0/605: truncate d7/df/d6f/f82 561703 0 2023-12-16T05:56:36.027 INFO:tasks.workunit.client.0.smithi155.stdout:6/840: creat d0/d3/d2c/d8b/d85/da4/f118 x:0 0 0 2023-12-16T05:56:36.028 INFO:tasks.workunit.client.0.smithi155.stdout:6/841: chown d0/d3/d2c/l3d 62226 1 2023-12-16T05:56:36.031 INFO:tasks.workunit.client.0.smithi155.stdout:8/560: mknod d4/d62/cb8 0 2023-12-16T05:56:36.031 INFO:tasks.workunit.client.0.smithi155.stdout:8/561: readlink d4/d62/d66/d78/d88/d1b/d5f/la7 0 2023-12-16T05:56:36.031 INFO:tasks.workunit.client.0.smithi155.stdout:8/562: fsync d4/d62/d66/d78/d88/d1b/d1c/d97/fa1 0 2023-12-16T05:56:36.031 INFO:tasks.workunit.client.0.smithi155.stdout:8/563: dread - d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/fa9 zero size 2023-12-16T05:56:36.031 INFO:tasks.workunit.client.0.smithi155.stdout:8/564: chown d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/l56 1451 1 2023-12-16T05:56:36.031 INFO:tasks.workunit.client.1.smithi156.stdout:4/343: dwrite f4 [0,4194304] 0 2023-12-16T05:56:36.032 INFO:tasks.workunit.client.0.smithi155.stdout:4/581: sync 2023-12-16T05:56:36.032 INFO:tasks.workunit.client.0.smithi155.stdout:7/594: sync 2023-12-16T05:56:36.032 INFO:tasks.workunit.client.0.smithi155.stdout:5/669: creat d0/d2/d2a/fda x:0 0 0 2023-12-16T05:56:36.033 INFO:tasks.workunit.client.0.smithi155.stdout:3/512: creat d0/d14/d45/fa0 x:0 0 0 2023-12-16T05:56:36.035 INFO:tasks.workunit.client.0.smithi155.stdout:0/606: symlink d7/d47/d5d/d6a/lc7 0 2023-12-16T05:56:36.036 INFO:tasks.workunit.client.1.smithi156.stdout:4/344: read d9/d43/d58/f60 [2249598,36311] 0 2023-12-16T05:56:36.037 INFO:tasks.workunit.client.0.smithi155.stdout:6/842: rename d0/d3/d2c/d3e/faf to d0/df/d5e/d7e/f119 0 2023-12-16T05:56:36.038 INFO:tasks.workunit.client.0.smithi155.stdout:8/565: mknod d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/db7/cb9 0 2023-12-16T05:56:36.039 INFO:tasks.workunit.client.0.smithi155.stdout:4/582: rmdir d0/d10/d46/d16/d30/d52/d88/d9e 39 2023-12-16T05:56:36.043 INFO:tasks.workunit.client.0.smithi155.stdout:7/595: creat d0/d6a/d1a/d8c/d34/d4b/d64/d6f/dba/fc5 x:0 0 0 2023-12-16T05:56:36.043 INFO:tasks.workunit.client.0.smithi155.stdout:7/596: fdatasync d0/d6a/d1a/d8c/d34/f73 0 2023-12-16T05:56:36.044 INFO:tasks.workunit.client.0.smithi155.stdout:7/597: truncate d0/d6a/d1a/d8c/d34/d4b/d64/d6e/f9b 884173 0 2023-12-16T05:56:36.046 INFO:tasks.workunit.client.0.smithi155.stdout:6/843: creat d0/d3/d7a/db0/dc3/dce/ddd/d1b/f11a x:0 0 0 2023-12-16T05:56:36.048 INFO:tasks.workunit.client.0.smithi155.stdout:0/607: read d7/d13/f1b [3630661,60900] 0 2023-12-16T05:56:36.048 INFO:tasks.workunit.client.0.smithi155.stdout:0/608: chown d7/df/d41/c22 30693 1 2023-12-16T05:56:36.057 INFO:tasks.workunit.client.0.smithi155.stdout:6/844: write d0/d3/d7a/db0/dc3/dce/ddd/dd4/fe4 [159061,54751] 0 2023-12-16T05:56:36.058 INFO:tasks.workunit.client.0.smithi155.stdout:8/566: creat d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/fba x:0 0 0 2023-12-16T05:56:36.061 INFO:tasks.workunit.client.0.smithi155.stdout:4/583: getdents d0/d10/d46/d16/d30/d52 0 2023-12-16T05:56:36.061 INFO:tasks.workunit.client.0.smithi155.stdout:4/584: fsync d0/da/d36/d5f/f66 0 2023-12-16T05:56:36.063 INFO:tasks.workunit.client.0.smithi155.stdout:0/609: creat d7/df/d73/d8d/fc8 x:0 0 0 2023-12-16T05:56:36.064 INFO:tasks.workunit.client.0.smithi155.stdout:6/845: unlink d0/d3/d7a/db0/dc3/dce/ddd/d1b/f6a 0 2023-12-16T05:56:36.065 INFO:tasks.workunit.client.0.smithi155.stdout:8/567: creat d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/fbb x:0 0 0 2023-12-16T05:56:36.066 INFO:tasks.workunit.client.0.smithi155.stdout:4/585: truncate d0/d10/d46/d16/f8e 839114 0 2023-12-16T05:56:36.066 INFO:tasks.workunit.client.0.smithi155.stdout:4/586: fsync d0/da/d36/d5f/d7b/fb4 0 2023-12-16T05:56:36.066 INFO:tasks.workunit.client.0.smithi155.stdout:0/610: link d7/df/d41/c27 d7/df/d65/cc9 0 2023-12-16T05:56:36.067 INFO:tasks.workunit.client.0.smithi155.stdout:6/846: creat d0/d3/d2c/d8b/f11b x:0 0 0 2023-12-16T05:56:36.067 INFO:tasks.workunit.client.0.smithi155.stdout:6/847: chown d0/d3/d7a/db0/dc3/dce 295553 1 2023-12-16T05:56:36.068 INFO:tasks.workunit.client.0.smithi155.stdout:8/568: link d4/d62/d66/d78/d88/d1b/d1c/d19/cb6 d4/d62/d66/d78/d88/d1b/d2a/d51/cbc 0 2023-12-16T05:56:36.069 INFO:tasks.workunit.client.0.smithi155.stdout:0/611: creat d7/df/d73/dba/fca x:0 0 0 2023-12-16T05:56:36.070 INFO:tasks.workunit.client.0.smithi155.stdout:8/569: creat d4/d62/d66/fbd x:0 0 0 2023-12-16T05:56:36.070 INFO:tasks.workunit.client.0.smithi155.stdout:0/612: mknod d7/d13/ccb 0 2023-12-16T05:56:36.072 INFO:tasks.workunit.client.1.smithi156.stdout:4/345: dwrite d9/f27 [4194304,4194304] 0 2023-12-16T05:56:36.072 INFO:tasks.workunit.client.0.smithi155.stdout:0/613: symlink d7/db0/lcc 0 2023-12-16T05:56:36.076 INFO:tasks.workunit.client.0.smithi155.stdout:7/598: dwrite d0/d1/f21 [0,4194304] 0 2023-12-16T05:56:36.076 INFO:tasks.workunit.client.0.smithi155.stdout:6/848: dread d0/df/d5e/f48 [0,4194304] 0 2023-12-16T05:56:36.076 INFO:tasks.workunit.client.0.smithi155.stdout:6/849: fsync d0/d3/d2c/d8b/f72 0 2023-12-16T05:56:36.077 INFO:tasks.workunit.client.0.smithi155.stdout:5/670: dwrite d0/f32 [0,4194304] 0 2023-12-16T05:56:36.077 INFO:tasks.workunit.client.0.smithi155.stdout:3/513: dwrite d0/d14/d36/d47/f98 [4194304,4194304] 0 2023-12-16T05:56:36.077 INFO:tasks.workunit.client.0.smithi155.stdout:5/671: read - d0/d2/d2a/d30/d53/d7b/fcc zero size 2023-12-16T05:56:36.077 INFO:tasks.workunit.client.0.smithi155.stdout:5/672: stat d0/d2/d2a/d19/d71 0 2023-12-16T05:56:36.078 INFO:tasks.workunit.client.0.smithi155.stdout:0/614: link d7/df/d65/f39 d7/df/d41/d23/d36/dad/fcd 0 2023-12-16T05:56:36.078 INFO:tasks.workunit.client.0.smithi155.stdout:0/615: chown d7/d13/d45/d4b/f90 288519344 1 2023-12-16T05:56:36.078 INFO:tasks.workunit.client.0.smithi155.stdout:0/616: chown d7/df/d73/d8d/f6b 22 1 2023-12-16T05:56:36.078 INFO:tasks.workunit.client.0.smithi155.stdout:0/617: chown d7/da4/lab 16925547 1 2023-12-16T05:56:36.078 INFO:tasks.workunit.client.0.smithi155.stdout:7/599: symlink d0/d6a/d1a/d8c/d34/d4b/d64/lc6 0 2023-12-16T05:56:36.079 INFO:tasks.workunit.client.0.smithi155.stdout:6/850: link d0/d3/d7a/db0/dc3/dce/ddd/f97 d0/df/d5e/d7e/dd8/f11c 0 2023-12-16T05:56:36.087 INFO:tasks.workunit.client.0.smithi155.stdout:0/618: unlink d7/da4/lab 0 2023-12-16T05:56:36.090 INFO:tasks.workunit.client.1.smithi156.stdout:7/494: sync 2023-12-16T05:56:36.092 INFO:tasks.workunit.client.1.smithi156.stdout:7/495: rename d1e/d1f/d22/d2c to d1e/d1f/da6 0 2023-12-16T05:56:36.093 INFO:tasks.workunit.client.1.smithi156.stdout:7/496: mknod d1e/d1f/da6/ca7 0 2023-12-16T05:56:36.093 INFO:tasks.workunit.client.1.smithi156.stdout:7/497: readlink d1e/d1f/da6/l81 0 2023-12-16T05:56:36.095 INFO:tasks.workunit.client.1.smithi156.stdout:7/498: link f9 d1e/d39/fa8 0 2023-12-16T05:56:36.097 INFO:tasks.workunit.client.1.smithi156.stdout:7/499: creat d1e/d1f/d22/d75/fa9 x:0 0 0 2023-12-16T05:56:36.111 INFO:tasks.workunit.client.1.smithi156.stdout:7/500: dwrite d1e/d1f/d22/f79 [0,4194304] 0 2023-12-16T05:56:36.151 INFO:tasks.workunit.client.0.smithi155.stdout:8/570: dwrite d4/d62/d66/d78/d88/d1b/d1c/d97/f8c [0,4194304] 0 2023-12-16T05:56:36.151 INFO:tasks.workunit.client.0.smithi155.stdout:5/673: rmdir d0/d2 39 2023-12-16T05:56:36.154 INFO:tasks.workunit.client.0.smithi155.stdout:5/674: write d0/d2/d2a/f63 [4025394,121128] 0 2023-12-16T05:56:36.155 INFO:tasks.workunit.client.0.smithi155.stdout:6/851: dwrite d0/df/d5e/d7e/db6/dc6/d103/fdf [0,4194304] 0 2023-12-16T05:56:36.155 INFO:tasks.workunit.client.0.smithi155.stdout:6/852: getdents d0/d3/d2c/d8b/d85/da4/de9 0 2023-12-16T05:56:36.155 INFO:tasks.workunit.client.0.smithi155.stdout:5/675: rmdir d0/d60/d79/d97/d9c 39 2023-12-16T05:56:36.155 INFO:tasks.workunit.client.0.smithi155.stdout:0/619: dwrite d7/d13/d45/f49 [4194304,4194304] 0 2023-12-16T05:56:36.157 INFO:tasks.workunit.client.0.smithi155.stdout:6/853: creat d0/d3/d2c/d8b/f11d x:0 0 0 2023-12-16T05:56:36.159 INFO:tasks.workunit.client.0.smithi155.stdout:5/676: dread d0/d2/d2a/d19/d48/f58 [0,4194304] 0 2023-12-16T05:56:36.163 INFO:tasks.workunit.client.0.smithi155.stdout:0/620: mkdir d7/df/d73/db3/dce 0 2023-12-16T05:56:36.165 INFO:tasks.workunit.client.0.smithi155.stdout:5/677: symlink d0/d2/d2a/d30/d53/d7b/d99/d47/ldb 0 2023-12-16T05:56:36.165 INFO:tasks.workunit.client.0.smithi155.stdout:5/678: fsync d0/d2/d2a/d19/d21/d56/fac 0 2023-12-16T05:56:36.167 INFO:tasks.workunit.client.0.smithi155.stdout:8/571: dwrite d4/d62/d66/d78/d88/d12/f94 [0,4194304] 0 2023-12-16T05:56:36.167 INFO:tasks.workunit.client.0.smithi155.stdout:0/621: creat d7/d47/fcf x:0 0 0 2023-12-16T05:56:36.169 INFO:tasks.workunit.client.0.smithi155.stdout:8/572: write d4/f41 [3339434,35585] 0 2023-12-16T05:56:36.169 INFO:tasks.workunit.client.0.smithi155.stdout:8/573: dread - d4/d62/d66/d78/d88/f7f zero size 2023-12-16T05:56:36.169 INFO:tasks.workunit.client.0.smithi155.stdout:5/679: link d0/d2/d2a/d30/d53/d7b/d99/d47/d61/ld2 d0/d60/d79/d97/ldc 0 2023-12-16T05:56:36.171 INFO:tasks.workunit.client.0.smithi155.stdout:6/854: dwrite d0/d3/d2c/f6c [0,4194304] 0 2023-12-16T05:56:36.173 INFO:tasks.workunit.client.0.smithi155.stdout:0/622: creat d7/d47/fd0 x:0 0 0 2023-12-16T05:56:36.174 INFO:tasks.workunit.client.0.smithi155.stdout:0/623: write d7/d47/d53/f7d [364207,107308] 0 2023-12-16T05:56:36.176 INFO:tasks.workunit.client.0.smithi155.stdout:8/574: symlink d4/d62/d66/d78/d88/d1b/d5f/lbe 0 2023-12-16T05:56:36.179 INFO:tasks.workunit.client.0.smithi155.stdout:5/680: link d0/d2/f1d d0/d2/d2a/d30/d53/fdd 0 2023-12-16T05:56:36.183 INFO:tasks.workunit.client.0.smithi155.stdout:6/855: creat d0/df/d5e/d5b/dd7/f11e x:0 0 0 2023-12-16T05:56:36.184 INFO:tasks.workunit.client.0.smithi155.stdout:0/624: rename d7/df/f7f to d7/df/fd1 0 2023-12-16T05:56:36.185 INFO:tasks.workunit.client.0.smithi155.stdout:0/625: write d7/df/d41/f97 [870535,98972] 0 2023-12-16T05:56:36.185 INFO:tasks.workunit.client.0.smithi155.stdout:0/626: dread d7/f83 [0,4194304] 0 2023-12-16T05:56:36.186 INFO:tasks.workunit.client.0.smithi155.stdout:0/627: write d7/d13/d45/d4b/f8c [4198941,55362] 0 2023-12-16T05:56:36.186 INFO:tasks.workunit.client.0.smithi155.stdout:8/575: creat d4/d62/fbf x:0 0 0 2023-12-16T05:56:36.186 INFO:tasks.workunit.client.0.smithi155.stdout:8/576: write d4/d62/d66/d78/d88/d1b/d1c/d97/d29/faf [264477,91227] 0 2023-12-16T05:56:36.186 INFO:tasks.workunit.client.0.smithi155.stdout:8/577: chown d4/d62/d66/d78/d88/f7f 0 1 2023-12-16T05:56:36.186 INFO:tasks.workunit.client.0.smithi155.stdout:8/578: write d4/d62/d66/d78/d88/d1b/d1c/d19/d64/fa4 [825579,120219] 0 2023-12-16T05:56:36.188 INFO:tasks.workunit.client.0.smithi155.stdout:6/856: symlink d0/d3/d7a/db0/dc3/dce/ddd/d1b/dea/l11f 0 2023-12-16T05:56:36.188 INFO:tasks.workunit.client.0.smithi155.stdout:6/857: dread - d0/dbd/f115 zero size 2023-12-16T05:56:36.189 INFO:tasks.workunit.client.0.smithi155.stdout:0/628: symlink d7/df/d73/d8d/ld2 0 2023-12-16T05:56:36.191 INFO:tasks.workunit.client.0.smithi155.stdout:8/579: symlink d4/d62/d66/d78/d88/d1b/d2a/d51/lc0 0 2023-12-16T05:56:36.192 INFO:tasks.workunit.client.0.smithi155.stdout:6/858: symlink d0/d3/d7a/db0/dc3/dce/l120 0 2023-12-16T05:56:36.192 INFO:tasks.workunit.client.0.smithi155.stdout:6/859: chown d0/d3/d2c/d8b/d85/da4 766208930 1 2023-12-16T05:56:36.192 INFO:tasks.workunit.client.0.smithi155.stdout:6/860: write d0/df/f90 [1736006,103234] 0 2023-12-16T05:56:36.196 INFO:tasks.workunit.client.0.smithi155.stdout:5/681: dread d0/d2/d2a/d19/f20 [0,4194304] 0 2023-12-16T05:56:36.201 INFO:tasks.workunit.client.0.smithi155.stdout:5/682: read d0/d2/d2a/d30/d53/d7b/d99/d47/d61/f85 [23174,53681] 0 2023-12-16T05:56:36.201 INFO:tasks.workunit.client.0.smithi155.stdout:5/683: truncate d0/d2/d4f/fa4 660985 0 2023-12-16T05:56:36.204 INFO:tasks.workunit.client.0.smithi155.stdout:5/684: creat d0/d60/d79/fde x:0 0 0 2023-12-16T05:56:36.204 INFO:tasks.workunit.client.0.smithi155.stdout:5/685: write d0/d2/d2a/d30/d53/fbe [4602397,5916] 0 2023-12-16T05:56:36.207 INFO:tasks.workunit.client.0.smithi155.stdout:5/686: creat d0/d60/d79/d8e/fdf x:0 0 0 2023-12-16T05:56:36.207 INFO:tasks.workunit.client.0.smithi155.stdout:5/687: fdatasync d0/d2/f1d 0 2023-12-16T05:56:36.208 INFO:tasks.workunit.client.0.smithi155.stdout:0/629: dwrite d7/d47/d53/f93 [0,4194304] 0 2023-12-16T05:56:36.208 INFO:tasks.workunit.client.0.smithi155.stdout:5/688: mknod d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/dd9/ce0 0 2023-12-16T05:56:36.211 INFO:tasks.workunit.client.1.smithi156.stdout:2/342: sync 2023-12-16T05:56:36.211 INFO:tasks.workunit.client.1.smithi156.stdout:8/262: sync 2023-12-16T05:56:36.211 INFO:tasks.workunit.client.1.smithi156.stdout:6/313: sync 2023-12-16T05:56:36.211 INFO:tasks.workunit.client.1.smithi156.stdout:0/367: sync 2023-12-16T05:56:36.213 INFO:tasks.workunit.client.1.smithi156.stdout:6/314: write d9/d1c/f47 [3841299,63922] 0 2023-12-16T05:56:36.213 INFO:tasks.workunit.client.1.smithi156.stdout:6/315: write d9/f15 [5006263,45535] 0 2023-12-16T05:56:36.213 INFO:tasks.workunit.client.1.smithi156.stdout:2/343: unlink d9/f54 0 2023-12-16T05:56:36.213 INFO:tasks.workunit.client.1.smithi156.stdout:2/344: read d9/dd/f2f [1729428,451] 0 2023-12-16T05:56:36.214 INFO:tasks.workunit.client.1.smithi156.stdout:0/368: creat d2/d7/dd/d29/d38/d51/d65/f6f x:0 0 0 2023-12-16T05:56:36.215 INFO:tasks.workunit.client.0.smithi155.stdout:6/861: dwrite d0/d3/d7a/db0/dc3/ff1 [0,4194304] 0 2023-12-16T05:56:36.216 INFO:tasks.workunit.client.1.smithi156.stdout:6/316: rename d9/d1c/c22 to d9/d13/d2f/d51/c64 0 2023-12-16T05:56:36.219 INFO:tasks.workunit.client.1.smithi156.stdout:2/345: mkdir d9/d12/d3d/d65 0 2023-12-16T05:56:36.219 INFO:tasks.workunit.client.1.smithi156.stdout:2/346: write d9/dd/d17/d33/f40 [750467,43073] 0 2023-12-16T05:56:36.219 INFO:tasks.workunit.client.1.smithi156.stdout:2/347: rename d9/dd to d9/dd/d17/d33/d38/d39/d60/d66 22 2023-12-16T05:56:36.219 INFO:tasks.workunit.client.1.smithi156.stdout:6/317: link d9/d1c/f39 d9/d13/d2f/d36/f65 0 2023-12-16T05:56:36.219 INFO:tasks.workunit.client.1.smithi156.stdout:6/318: stat d9/d13/c21 0 2023-12-16T05:56:36.220 INFO:tasks.workunit.client.1.smithi156.stdout:2/348: creat d9/dd/d3f/f67 x:0 0 0 2023-12-16T05:56:36.220 INFO:tasks.workunit.client.0.smithi155.stdout:0/630: dread d7/df/f58 [0,4194304] 0 2023-12-16T05:56:36.220 INFO:tasks.workunit.client.0.smithi155.stdout:6/862: rename d0/d3/d2c/f60 to d0/d3/d7a/db0/dc3/dce/ddd/dd4/f121 0 2023-12-16T05:56:36.221 INFO:tasks.workunit.client.1.smithi156.stdout:6/319: symlink d9/d13/d3e/l66 0 2023-12-16T05:56:36.222 INFO:tasks.workunit.client.1.smithi156.stdout:2/349: mkdir d9/d68 0 2023-12-16T05:56:36.222 INFO:tasks.workunit.client.1.smithi156.stdout:2/350: write d9/dd/d17/f51 [1171494,60958] 0 2023-12-16T05:56:36.223 INFO:tasks.workunit.client.0.smithi155.stdout:6/863: creat d0/d3/d7a/db0/dc3/dce/ddd/d1b/dea/f122 x:0 0 0 2023-12-16T05:56:36.225 INFO:tasks.workunit.client.0.smithi155.stdout:8/580: rmdir d4/d62/d66/d78 39 2023-12-16T05:56:36.225 INFO:tasks.workunit.client.0.smithi155.stdout:8/581: read - d4/d62/d66/fbd zero size 2023-12-16T05:56:36.225 INFO:tasks.workunit.client.0.smithi155.stdout:8/582: stat d4/d62/d66/d78/d88/d12/c43 0 2023-12-16T05:56:36.227 INFO:tasks.workunit.client.1.smithi156.stdout:6/320: creat d9/f67 x:0 0 0 2023-12-16T05:56:36.235 INFO:tasks.workunit.client.1.smithi156.stdout:0/369: write d2/ff [115513,97881] 0 2023-12-16T05:56:36.236 INFO:tasks.workunit.client.0.smithi155.stdout:5/689: dwrite d0/d2/d2a/d30/d53/d7b/d99/fca [0,4194304] 0 2023-12-16T05:56:36.236 INFO:tasks.workunit.client.0.smithi155.stdout:8/583: dread d4/d62/d66/d78/d88/d1b/d1c/d46/f89 [0,4194304] 0 2023-12-16T05:56:36.236 INFO:tasks.workunit.client.0.smithi155.stdout:8/584: write d4/d62/d66/d78/d88/d1b/d2a/d51/f6e [4721247,24932] 0 2023-12-16T05:56:36.241 INFO:tasks.workunit.client.0.smithi155.stdout:5/690: mkdir d0/d2/d2a/d30/d53/d7b/d99/d47/d61/de1 0 2023-12-16T05:56:36.241 INFO:tasks.workunit.client.0.smithi155.stdout:5/691: fdatasync d0/d2/d2a/d30/d53/d7b/d99/d47/f6b 0 2023-12-16T05:56:36.245 INFO:tasks.workunit.client.0.smithi155.stdout:0/631: dwrite d7/df/d73/d8d/d4d/faf [0,4194304] 0 2023-12-16T05:56:36.245 INFO:tasks.workunit.client.1.smithi156.stdout:6/321: rmdir d9/d13 39 2023-12-16T05:56:36.245 INFO:tasks.workunit.client.1.smithi156.stdout:6/322: truncate d9/d13/d2f/d36/f5a 800624 0 2023-12-16T05:56:36.249 INFO:tasks.workunit.client.0.smithi155.stdout:0/632: creat d7/d2d/fd3 x:0 0 0 2023-12-16T05:56:36.249 INFO:tasks.workunit.client.0.smithi155.stdout:0/633: write d7/df/d65/f39 [4407543,97538] 0 2023-12-16T05:56:36.249 INFO:tasks.workunit.client.1.smithi156.stdout:6/323: getdents d9/d13/d2f/d51 0 2023-12-16T05:56:36.250 INFO:tasks.workunit.client.1.smithi156.stdout:8/263: dwrite d3/f17 [4194304,4194304] 0 2023-12-16T05:56:36.250 INFO:tasks.workunit.client.1.smithi156.stdout:8/264: chown d3/d6/f5 7 1 2023-12-16T05:56:36.250 INFO:tasks.workunit.client.1.smithi156.stdout:6/324: rmdir d9/d13/d2f/d36 39 2023-12-16T05:56:36.251 INFO:tasks.workunit.client.0.smithi155.stdout:0/634: symlink d7/df/ld4 0 2023-12-16T05:56:36.251 INFO:tasks.workunit.client.0.smithi155.stdout:0/635: dread - d7/df/d6f/fbe zero size 2023-12-16T05:56:36.251 INFO:tasks.workunit.client.0.smithi155.stdout:0/636: stat d7/df/d41/c22 0 2023-12-16T05:56:36.251 INFO:tasks.workunit.client.0.smithi155.stdout:0/637: fsync d7/df/f37 0 2023-12-16T05:56:36.251 INFO:tasks.workunit.client.0.smithi155.stdout:0/638: write d7/d13/d45/d4b/f67 [102692,34680] 0 2023-12-16T05:56:36.251 INFO:tasks.workunit.client.0.smithi155.stdout:0/639: chown d7/df/d6f/f82 653 1 2023-12-16T05:56:36.251 INFO:tasks.workunit.client.0.smithi155.stdout:0/640: truncate d7/d2d/f3f 496648 0 2023-12-16T05:56:36.253 INFO:tasks.workunit.client.1.smithi156.stdout:2/351: dwrite d9/f1f [0,4194304] 0 2023-12-16T05:56:36.253 INFO:tasks.workunit.client.1.smithi156.stdout:2/352: write d9/dd/d3f/f67 [720082,36708] 0 2023-12-16T05:56:36.253 INFO:tasks.workunit.client.1.smithi156.stdout:2/353: chown d9/d12/l4a 9 1 2023-12-16T05:56:36.254 INFO:tasks.workunit.client.1.smithi156.stdout:6/325: unlink d9/d13/d2f/l5d 0 2023-12-16T05:56:36.254 INFO:tasks.workunit.client.1.smithi156.stdout:6/326: truncate d9/d13/d3e/f57 879093 0 2023-12-16T05:56:36.254 INFO:tasks.workunit.client.1.smithi156.stdout:6/327: chown d9/d1c 24638276 1 2023-12-16T05:56:36.257 INFO:tasks.workunit.client.1.smithi156.stdout:2/354: unlink d9/dd/d17/c26 0 2023-12-16T05:56:36.260 INFO:tasks.workunit.client.0.smithi155.stdout:0/641: write d7/df/f37 [674889,29666] 0 2023-12-16T05:56:36.260 INFO:tasks.workunit.client.0.smithi155.stdout:0/642: fsync d7/d47/fa9 0 2023-12-16T05:56:36.260 INFO:tasks.workunit.client.0.smithi155.stdout:0/643: dread - d7/df/d73/db3/fc0 zero size 2023-12-16T05:56:36.260 INFO:tasks.workunit.client.0.smithi155.stdout:0/644: getdents d7/d47/d5d/d84 0 2023-12-16T05:56:36.260 INFO:tasks.workunit.client.0.smithi155.stdout:0/645: fdatasync d7/fb 0 2023-12-16T05:56:36.260 INFO:tasks.workunit.client.0.smithi155.stdout:0/646: truncate d7/df/d6f/fa5 721155 0 2023-12-16T05:56:36.262 INFO:tasks.workunit.client.0.smithi155.stdout:0/647: symlink d7/df/d41/d23/d36/ld5 0 2023-12-16T05:56:36.263 INFO:tasks.workunit.client.1.smithi156.stdout:6/328: dread d9/d13/d2f/f3f [0,4194304] 0 2023-12-16T05:56:36.263 INFO:tasks.workunit.client.0.smithi155.stdout:6/864: dwrite d0/df/d5e/d46/f47 [8388608,4194304] 0 2023-12-16T05:56:36.264 INFO:tasks.workunit.client.0.smithi155.stdout:6/865: write d0/d3/d7a/db0/dc3/dce/ddd/f10d [908315,121129] 0 2023-12-16T05:56:36.264 INFO:tasks.workunit.client.0.smithi155.stdout:8/585: dwrite d4/d62/d66/d78/d88/d1b/d1c/d97/f59 [0,4194304] 0 2023-12-16T05:56:36.264 INFO:tasks.workunit.client.1.smithi156.stdout:0/370: dwrite d2/d7/f18 [0,4194304] 0 2023-12-16T05:56:36.268 INFO:tasks.workunit.client.0.smithi155.stdout:0/648: mkdir d7/d13/d46/d81/dd6 0 2023-12-16T05:56:36.270 INFO:tasks.workunit.client.0.smithi155.stdout:5/692: dwrite d0/d2/d2a/d19/d88/fc3 [4194304,4194304] 0 2023-12-16T05:56:36.270 INFO:tasks.workunit.client.0.smithi155.stdout:5/693: chown d0/d2/d2a/c8d 60 1 2023-12-16T05:56:36.271 INFO:tasks.workunit.client.1.smithi156.stdout:8/265: dread d3/f29 [0,4194304] 0 2023-12-16T05:56:36.271 INFO:tasks.workunit.client.1.smithi156.stdout:0/371: write d2/d7/dd/d1c/f25 [3538303,122964] 0 2023-12-16T05:56:36.271 INFO:tasks.workunit.client.1.smithi156.stdout:6/329: dread d9/d1c/f2b [0,4194304] 0 2023-12-16T05:56:36.273 INFO:tasks.workunit.client.1.smithi156.stdout:8/266: dread d3/ff [0,4194304] 0 2023-12-16T05:56:36.274 INFO:tasks.workunit.client.0.smithi155.stdout:8/586: creat d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/fc1 x:0 0 0 2023-12-16T05:56:36.274 INFO:tasks.workunit.client.0.smithi155.stdout:8/587: fdatasync d4/d62/d66/d78/d88/d1b/d1c/d19/f38 0 2023-12-16T05:56:36.274 INFO:tasks.workunit.client.0.smithi155.stdout:8/588: fdatasync d4/d62/d66/d78/d88/d1b/d1c/d1a/f3a 0 2023-12-16T05:56:36.274 INFO:tasks.workunit.client.0.smithi155.stdout:8/589: chown d4/d62/d95 26751334 1 2023-12-16T05:56:36.274 INFO:tasks.workunit.client.0.smithi155.stdout:8/590: read d4/f41 [2711602,100084] 0 2023-12-16T05:56:36.275 INFO:tasks.workunit.client.1.smithi156.stdout:6/330: link f5 d9/d13/d2f/f68 0 2023-12-16T05:56:36.275 INFO:tasks.workunit.client.1.smithi156.stdout:6/331: chown d9/d1c/l33 30 1 2023-12-16T05:56:36.278 INFO:tasks.workunit.client.0.smithi155.stdout:6/866: dread d0/d3/d7a/db0/dc3/dce/ddd/f1d [0,4194304] 0 2023-12-16T05:56:36.279 INFO:tasks.workunit.client.0.smithi155.stdout:0/649: creat d7/d47/d5d/d6a/fd7 x:0 0 0 2023-12-16T05:56:36.279 INFO:tasks.workunit.client.0.smithi155.stdout:0/650: write d7/d13/d45/fa0 [1582009,51347] 0 2023-12-16T05:56:36.279 INFO:tasks.workunit.client.0.smithi155.stdout:0/651: readlink d7/l3a 0 2023-12-16T05:56:36.279 INFO:tasks.workunit.client.0.smithi155.stdout:0/652: write d7/f83 [902248,556] 0 2023-12-16T05:56:36.280 INFO:tasks.workunit.client.0.smithi155.stdout:5/694: mkdir d0/d2/d2a/d19/de2 0 2023-12-16T05:56:36.284 INFO:tasks.workunit.client.0.smithi155.stdout:6/867: symlink d0/d3/d7a/db0/dc3/dce/l123 0 2023-12-16T05:56:36.285 INFO:tasks.workunit.client.1.smithi156.stdout:2/355: dwrite f2 [0,4194304] 0 2023-12-16T05:56:36.285 INFO:tasks.workunit.client.1.smithi156.stdout:2/356: fsync d9/dd/d17/d33/d38/f3c 0 2023-12-16T05:56:36.285 INFO:tasks.workunit.client.0.smithi155.stdout:8/591: symlink d4/d62/d66/d78/d88/d1b/d1c/d97/d29/lc2 0 2023-12-16T05:56:36.285 INFO:tasks.workunit.client.1.smithi156.stdout:0/372: dread d2/d7/dd/d29/d38/f3e [0,4194304] 0 2023-12-16T05:56:36.286 INFO:tasks.workunit.client.1.smithi156.stdout:0/373: read d2/d23/f27 [234226,87636] 0 2023-12-16T05:56:36.290 INFO:tasks.workunit.client.1.smithi156.stdout:0/374: creat d2/d23/f70 x:0 0 0 2023-12-16T05:56:36.290 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.287+0000 7fd013ebe700 1 -- 172.21.15.155:0/276742174 --> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd00c0feb80 con 0x7fcff806af00 2023-12-16T05:56:36.291 INFO:tasks.workunit.client.0.smithi155.stdout:5/695: creat d0/fe3 x:0 0 0 2023-12-16T05:56:36.291 INFO:tasks.workunit.client.0.smithi155.stdout:5/696: chown d0/d2/d2a/d19/d59/d66/l90 494195 1 2023-12-16T05:56:36.292 INFO:tasks.workunit.client.1.smithi156.stdout:8/267: dread d3/d12/d16/f2d [4194304,4194304] 0 2023-12-16T05:56:36.296 INFO:tasks.workunit.client.1.smithi156.stdout:5/522: sync 2023-12-16T05:56:36.296 INFO:tasks.workunit.client.1.smithi156.stdout:8/268: getdents d3/d7/d27 0 2023-12-16T05:56:36.297 INFO:tasks.workunit.client.1.smithi156.stdout:6/332: dwrite d9/d13/d2f/f34 [0,4194304] 0 2023-12-16T05:56:36.298 INFO:tasks.workunit.client.1.smithi156.stdout:5/523: mkdir da/dc/d2d/d4d/d54/da6 0 2023-12-16T05:56:36.298 INFO:tasks.workunit.client.1.smithi156.stdout:5/524: write da/dc/d4b/d6c/d81/fa3 [439474,36839] 0 2023-12-16T05:56:36.299 INFO:tasks.workunit.client.1.smithi156.stdout:8/269: mkdir d3/d7/d9/d52 0 2023-12-16T05:56:36.300 INFO:tasks.workunit.client.0.smithi155.stdout:8/592: mknod d4/d62/d66/d78/d88/d1b/d2a/cc3 0 2023-12-16T05:56:36.301 INFO:tasks.workunit.client.1.smithi156.stdout:5/525: write da/dc/f2e [3629256,115442] 0 2023-12-16T05:56:36.301 INFO:tasks.workunit.client.1.smithi156.stdout:5/526: chown da/dc/d2d/l39 189789418 1 2023-12-16T05:56:36.301 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.298+0000 7fd0027fc700 1 -- 172.21.15.155:0/276742174 <== mgr.24363 v2:172.21.15.156:6828/1939402353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fd00c0feb80 con 0x7fcff806af00 2023-12-16T05:56:36.302 INFO:tasks.workunit.client.0.smithi155.stdout:6/868: symlink d0/d3/d7a/db0/dc3/dce/l124 0 2023-12-16T05:56:36.302 INFO:tasks.workunit.client.1.smithi156.stdout:8/270: dread d3/d7/d9/f2a [0,4194304] 0 2023-12-16T05:56:36.303 INFO:tasks.workunit.client.1.smithi156.stdout:5/527: link da/dc/d4b/l9d da/dc/d2d/d4d/d54/d67/la7 0 2023-12-16T05:56:36.305 INFO:tasks.workunit.client.1.smithi156.stdout:5/528: read da/dc/f17 [3315617,34435] 0 2023-12-16T05:56:36.305 INFO:tasks.workunit.client.1.smithi156.stdout:5/529: chown da/dc/d4b/d6c/d7c/d85 79370 1 2023-12-16T05:56:36.305 INFO:tasks.workunit.client.1.smithi156.stdout:5/530: write da/dc/d4b/d6c/f9e [504037,34843] 0 2023-12-16T05:56:36.305 INFO:tasks.workunit.client.1.smithi156.stdout:8/271: rmdir d3/d12 39 2023-12-16T05:56:36.307 INFO:tasks.workunit.client.1.smithi156.stdout:8/272: mknod d3/d12/d16/c53 0 2023-12-16T05:56:36.307 INFO:tasks.workunit.client.1.smithi156.stdout:8/273: write d3/ff [436800,120000] 0 2023-12-16T05:56:36.307 INFO:tasks.workunit.client.1.smithi156.stdout:8/274: dread - d3/d7/d9/f40 zero size 2023-12-16T05:56:36.308 INFO:tasks.workunit.client.1.smithi156.stdout:4/346: sync 2023-12-16T05:56:36.308 INFO:tasks.workunit.client.1.smithi156.stdout:7/501: sync 2023-12-16T05:56:36.308 INFO:tasks.workunit.client.1.smithi156.stdout:1/228: sync 2023-12-16T05:56:36.309 INFO:tasks.workunit.client.1.smithi156.stdout:3/265: sync 2023-12-16T05:56:36.309 INFO:tasks.workunit.client.1.smithi156.stdout:9/320: sync 2023-12-16T05:56:36.311 INFO:tasks.workunit.client.0.smithi155.stdout:0/653: dwrite d7/d2d/f9e [0,4194304] 0 2023-12-16T05:56:36.311 INFO:tasks.workunit.client.0.smithi155.stdout:0/654: chown d7/d13 24 1 2023-12-16T05:56:36.311 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.308+0000 7fd013ebe700 1 -- 172.21.15.155:0/276742174 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7fcff806af00 msgr2=0x7fcff806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:36.311 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.308+0000 7fd013ebe700 1 --2- 172.21.15.155:0/276742174 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7fcff806af00 0x7fcff806d3b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00b0d0 tx=0x7fcffc009e30 comp rx=0 tx=0).stop 2023-12-16T05:56:36.312 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.308+0000 7fd013ebe700 1 -- 172.21.15.155:0/276742174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd00c0fde80 msgr2=0x7fd00c114000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:36.312 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.308+0000 7fd013ebe700 1 --2- 172.21.15.155:0/276742174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd00c0fde80 0x7fd00c114000 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd00800eb40 tx=0x7fd00800b040 comp rx=0 tx=0).stop 2023-12-16T05:56:36.312 INFO:tasks.workunit.client.1.smithi156.stdout:4/347: mknod d9/d2b/c74 0 2023-12-16T05:56:36.312 INFO:tasks.workunit.client.1.smithi156.stdout:4/348: fsync d9/d2c/f32 0 2023-12-16T05:56:36.312 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.309+0000 7fd013ebe700 1 -- 172.21.15.155:0/276742174 shutdown_connections 2023-12-16T05:56:36.312 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.309+0000 7fd013ebe700 1 --2- 172.21.15.155:0/276742174 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7fcff806af00 0x7fcff806d3b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:36.313 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.309+0000 7fd013ebe700 1 --2- 172.21.15.155:0/276742174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd00c0fb520 0x7fd00c113ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:36.313 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.309+0000 7fd013ebe700 1 --2- 172.21.15.155:0/276742174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd00c0fde80 0x7fd00c114000 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:36.313 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.309+0000 7fd013ebe700 1 -- 172.21.15.155:0/276742174 >> 172.21.15.155:0/276742174 conn(0x7fd00c0f7190 msgr2=0x7fd00c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:56:36.313 INFO:tasks.workunit.client.1.smithi156.stdout:1/229: rename d3/d17/d19/f26 to d3/d17/f48 0 2023-12-16T05:56:36.313 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.310+0000 7fd013ebe700 1 -- 172.21.15.155:0/276742174 shutdown_connections 2023-12-16T05:56:36.313 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.310+0000 7fd013ebe700 1 -- 172.21.15.155:0/276742174 wait complete. 2023-12-16T05:56:36.314 INFO:tasks.workunit.client.1.smithi156.stdout:3/266: mkdir dc/df/d34/d62 0 2023-12-16T05:56:36.315 INFO:tasks.workunit.client.1.smithi156.stdout:4/349: read d9/f42 [363679,21092] 0 2023-12-16T05:56:36.316 INFO:tasks.workunit.client.1.smithi156.stdout:4/350: read d9/d2b/f3c [514837,69125] 0 2023-12-16T05:56:36.316 INFO:tasks.workunit.client.1.smithi156.stdout:9/321: creat d6/d2e/f6e x:0 0 0 2023-12-16T05:56:36.316 INFO:tasks.workunit.client.0.smithi155.stdout:6/869: creat d0/d3/d2c/d8b/f125 x:0 0 0 2023-12-16T05:56:36.317 INFO:tasks.workunit.client.1.smithi156.stdout:4/351: creat d9/d2b/f75 x:0 0 0 2023-12-16T05:56:36.319 INFO:tasks.workunit.client.1.smithi156.stdout:9/322: getdents d6 0 2023-12-16T05:56:36.321 INFO:tasks.workunit.client.1.smithi156.stdout:4/352: creat d9/d43/d58/f76 x:0 0 0 2023-12-16T05:56:36.321 INFO:tasks.workunit.client.0.smithi155.stdout:5/697: dwrite d0/d2/d2a/d19/d21/f6a [4194304,4194304] 0 2023-12-16T05:56:36.321 INFO:tasks.workunit.client.0.smithi155.stdout:5/698: fsync d0/d2/d2a/d19/d21/f23 0 2023-12-16T05:56:36.322 INFO:tasks.workunit.client.1.smithi156.stdout:4/353: write d9/f18 [1369079,71788] 0 2023-12-16T05:56:36.323 INFO:tasks.workunit.client.1.smithi156.stdout:5/531: fdatasync da/dc/f2e 0 2023-12-16T05:56:36.324 INFO:tasks.workunit.client.0.smithi155.stdout:6/870: symlink d0/dbd/l126 0 2023-12-16T05:56:36.324 INFO:tasks.workunit.client.0.smithi155.stdout:6/871: fsync d0/df/d5e/d5b/dd7/f11e 0 2023-12-16T05:56:36.324 INFO:tasks.workunit.client.0.smithi155.stdout:6/872: fsync d0/df/d5e/d5b/dd7/f108 0 2023-12-16T05:56:36.325 INFO:tasks.workunit.client.1.smithi156.stdout:4/354: unlink d9/d43/f54 0 2023-12-16T05:56:36.326 INFO:tasks.workunit.client.1.smithi156.stdout:5/532: truncate da/dc/d4b/d6c/d81/f63 3142927 0 2023-12-16T05:56:36.327 INFO:tasks.workunit.client.0.smithi155.stdout:0/655: write d7/df/d73/d8d/d4d/faf [2353115,4797] 0 2023-12-16T05:56:36.330 INFO:tasks.workunit.client.1.smithi156.stdout:5/533: rename da/f36 to da/dc/d4b/d6c/fa8 0 2023-12-16T05:56:36.330 INFO:tasks.workunit.client.0.smithi155.stdout:8/593: dwrite d4/d62/d66/d78/d88/d12/f21 [0,4194304] 0 2023-12-16T05:56:36.330 INFO:tasks.workunit.client.0.smithi155.stdout:8/594: write d4/d62/d66/d78/d88/d1b/d1c/d19/f73 [642999,44937] 0 2023-12-16T05:56:36.330 INFO:tasks.workunit.client.0.smithi155.stdout:0/656: write d7/d2d/f3f [266449,45822] 0 2023-12-16T05:56:36.330 INFO:tasks.workunit.client.0.smithi155.stdout:0/657: chown d7/d47/d53/ca1 0 1 2023-12-16T05:56:36.334 INFO:tasks.workunit.client.0.smithi155.stdout:5/699: symlink d0/d2/d2a/d19/dd7/le4 0 2023-12-16T05:56:36.336 INFO:teuthology.orchestra.run.smithi155.stdout:true 2023-12-16T05:56:36.339 INFO:tasks.workunit.client.0.smithi155.stdout:8/595: getdents d4/d62/d66/d78/d88/d1b/d1c/d97/d29 0 2023-12-16T05:56:36.344 INFO:tasks.workunit.client.0.smithi155.stdout:8/596: link d4/d62/d66/d78/d88/d1b/d1c/d19/cb6 d4/d62/d66/d78/d88/d9e/cc4 0 2023-12-16T05:56:36.349 INFO:tasks.workunit.client.0.smithi155.stdout:8/597: mknod d4/d62/d66/d78/d88/d1b/d1c/d19/cc5 0 2023-12-16T05:56:36.351 INFO:tasks.workunit.client.1.smithi156.stdout:6/333: dread f8 [0,4194304] 0 2023-12-16T05:56:36.351 INFO:tasks.workunit.client.1.smithi156.stdout:0/375: dwrite d2/d7/dd/f5b [0,4194304] 0 2023-12-16T05:56:36.353 INFO:tasks.workunit.client.1.smithi156.stdout:6/334: mkdir d9/d13/d2f/d51/d69 0 2023-12-16T05:56:36.355 INFO:tasks.workunit.client.1.smithi156.stdout:6/335: getdents d9/d13/d2f/d36 0 2023-12-16T05:56:36.355 INFO:tasks.workunit.client.1.smithi156.stdout:6/336: truncate d9/f35 1347445 0 2023-12-16T05:56:36.360 INFO:tasks.workunit.client.1.smithi156.stdout:3/267: dwrite dc/d10/d3d/f39 [0,4194304] 0 2023-12-16T05:56:36.361 INFO:tasks.workunit.client.1.smithi156.stdout:0/376: read d2/d23/f27 [517961,37323] 0 2023-12-16T05:56:36.367 INFO:tasks.workunit.client.1.smithi156.stdout:8/275: dwrite d3/ff [0,4194304] 0 2023-12-16T05:56:36.370 INFO:tasks.workunit.client.1.smithi156.stdout:1/230: dwrite d3/d17/d19/f2a [0,4194304] 0 2023-12-16T05:56:36.371 INFO:tasks.workunit.client.1.smithi156.stdout:0/377: getdents d2/d7/dd/d29 0 2023-12-16T05:56:36.376 INFO:tasks.workunit.client.1.smithi156.stdout:1/231: creat d3/d1b/d27/f49 x:0 0 0 2023-12-16T05:56:36.377 INFO:tasks.workunit.client.0.smithi155.stdout:6/873: dwrite d0/df/d5e/d7e/db6/dc6/fd0 [0,4194304] 0 2023-12-16T05:56:36.378 INFO:tasks.workunit.client.0.smithi155.stdout:1/715: sync 2023-12-16T05:56:36.378 INFO:tasks.workunit.client.0.smithi155.stdout:1/716: chown d1/d7/d4b/d5c/f82 386355 1 2023-12-16T05:56:36.378 INFO:tasks.workunit.client.0.smithi155.stdout:1/717: readlink d1/d7/d4b/d8e/ldb 0 2023-12-16T05:56:36.378 INFO:tasks.workunit.client.1.smithi156.stdout:5/534: dwrite da/dc/ff [0,4194304] 0 2023-12-16T05:56:36.380 INFO:tasks.workunit.client.0.smithi155.stdout:6/874: symlink d0/d3/d7a/dd6/l127 0 2023-12-16T05:56:36.380 INFO:tasks.workunit.client.0.smithi155.stdout:6/875: fdatasync d0/d3/d7a/f9c 0 2023-12-16T05:56:36.380 INFO:tasks.workunit.client.0.smithi155.stdout:6/876: dread - d0/d3/d2c/d8b/d85/da4/f118 zero size 2023-12-16T05:56:36.381 INFO:tasks.workunit.client.1.smithi156.stdout:3/268: write f8 [2216522,128565] 0 2023-12-16T05:56:36.382 INFO:tasks.workunit.client.0.smithi155.stdout:1/718: creat d1/d7/d4b/d8e/dc7/d28/d85/fe1 x:0 0 0 2023-12-16T05:56:36.382 INFO:tasks.workunit.client.0.smithi155.stdout:1/719: truncate d1/d69/fd9 459791 0 2023-12-16T05:56:36.383 INFO:tasks.workunit.client.1.smithi156.stdout:3/269: link fb dc/df/d34/f63 0 2023-12-16T05:56:36.384 INFO:tasks.workunit.client.1.smithi156.stdout:8/276: dread d3/d12/d16/f2d [0,4194304] 0 2023-12-16T05:56:36.389 INFO:tasks.workunit.client.0.smithi155.stdout:8/598: dwrite d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/fa9 [0,4194304] 0 2023-12-16T05:56:36.389 INFO:tasks.workunit.client.0.smithi155.stdout:6/877: truncate d0/d3/d7a/d77/f101 1051974 0 2023-12-16T05:56:36.389 INFO:tasks.workunit.client.1.smithi156.stdout:8/277: rmdir d3 39 2023-12-16T05:56:36.389 INFO:tasks.workunit.client.1.smithi156.stdout:4/355: dwrite d9/d2b/f31 [0,4194304] 0 2023-12-16T05:56:36.389 INFO:tasks.workunit.client.1.smithi156.stdout:9/323: dwrite d6/d2e/f50 [0,4194304] 0 2023-12-16T05:56:36.390 INFO:tasks.workunit.client.1.smithi156.stdout:6/337: dwrite d9/d13/d2f/d36/f5a [0,4194304] 0 2023-12-16T05:56:36.390 INFO:tasks.workunit.client.1.smithi156.stdout:4/356: mkdir d9/d2b/d56/d77 0 2023-12-16T05:56:36.390 INFO:tasks.workunit.client.1.smithi156.stdout:4/357: fdatasync d9/f1b 0 2023-12-16T05:56:36.390 INFO:tasks.workunit.client.1.smithi156.stdout:6/338: write d9/d1c/f2b [1207082,65529] 0 2023-12-16T05:56:36.391 INFO:tasks.workunit.client.1.smithi156.stdout:6/339: read d9/d13/d3e/f57 [662687,20102] 0 2023-12-16T05:56:36.393 INFO:tasks.workunit.client.0.smithi155.stdout:8/599: mknod d4/d62/d66/d78/d88/d1b/d1c/d19/cc6 0 2023-12-16T05:56:36.393 INFO:tasks.workunit.client.0.smithi155.stdout:0/658: dwrite d7/d2d/f3c [0,4194304] 0 2023-12-16T05:56:36.394 INFO:tasks.workunit.client.0.smithi155.stdout:8/600: rmdir d4/d62/d66/d78/d88/d12 39 2023-12-16T05:56:36.394 INFO:tasks.workunit.client.1.smithi156.stdout:7/502: dwrite d1e/d1f/da6/d33/f84 [0,4194304] 0 2023-12-16T05:56:36.395 INFO:tasks.workunit.client.0.smithi155.stdout:6/878: mknod d0/c128 0 2023-12-16T05:56:36.396 INFO:tasks.workunit.client.1.smithi156.stdout:9/324: creat d6/d19/d25/f6f x:0 0 0 2023-12-16T05:56:36.397 INFO:tasks.workunit.client.0.smithi155.stdout:0/659: mkdir d7/df/d41/dd8 0 2023-12-16T05:56:36.397 INFO:tasks.workunit.client.0.smithi155.stdout:8/601: write d4/d62/d66/d78/d88/d1b/d1c/d1a/f2d [1942883,113191] 0 2023-12-16T05:56:36.397 INFO:tasks.workunit.client.0.smithi155.stdout:0/660: write d7/df/d6f/fbe [314123,102397] 0 2023-12-16T05:56:36.399 INFO:tasks.workunit.client.0.smithi155.stdout:6/879: creat d0/d3/d2c/d8b/d85/f129 x:0 0 0 2023-12-16T05:56:36.401 INFO:tasks.workunit.client.1.smithi156.stdout:6/340: link d9/d13/f1b d9/d1c/f6a 0 2023-12-16T05:56:36.402 INFO:tasks.workunit.client.0.smithi155.stdout:0/661: symlink d7/d47/d53/ld9 0 2023-12-16T05:56:36.402 INFO:tasks.workunit.client.0.smithi155.stdout:0/662: chown d7/df/ld4 0 1 2023-12-16T05:56:36.403 INFO:tasks.workunit.client.0.smithi155.stdout:0/663: readlink d7/l3a 0 2023-12-16T05:56:36.403 INFO:tasks.workunit.client.0.smithi155.stdout:0/664: readlink d7/l18 0 2023-12-16T05:56:36.405 INFO:tasks.workunit.client.0.smithi155.stdout:0/665: mknod d7/d47/d5d/cda 0 2023-12-16T05:56:36.407 INFO:tasks.workunit.client.0.smithi155.stdout:6/880: rename d0/dbd/fe6 to d0/d3/d7a/db0/dc3/dce/ddd/d1b/f12a 0 2023-12-16T05:56:36.410 INFO:tasks.workunit.client.0.smithi155.stdout:5/700: dwrite d0/d2/d2a/f7f [0,4194304] 0 2023-12-16T05:56:36.412 INFO:tasks.workunit.client.1.smithi156.stdout:7/503: rename d1e/d1f/da6/d33 to d1e/d55/d71/d61/daa 0 2023-12-16T05:56:36.415 INFO:tasks.workunit.client.1.smithi156.stdout:7/504: symlink d1e/lab 0 2023-12-16T05:56:36.415 INFO:tasks.workunit.client.1.smithi156.stdout:0/378: dwrite d2/d23/d4a/f54 [0,4194304] 0 2023-12-16T05:56:36.416 INFO:tasks.workunit.client.0.smithi155.stdout:5/701: link d0/d2/d2a/d30/d53/fba d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/dd9/fe5 0 2023-12-16T05:56:36.418 INFO:tasks.workunit.client.0.smithi155.stdout:5/702: creat d0/d60/d79/d97/d9c/fe6 x:0 0 0 2023-12-16T05:56:36.418 INFO:tasks.workunit.client.0.smithi155.stdout:5/703: truncate d0/d2/d2a/d19/d21/d56/fac 783488 0 2023-12-16T05:56:36.425 INFO:tasks.workunit.client.1.smithi156.stdout:5/535: dwrite da/dc/d4b/d6c/d81/f83 [0,4194304] 0 2023-12-16T05:56:36.425 INFO:tasks.workunit.client.1.smithi156.stdout:3/270: dread dc/d10/f11 [0,4194304] 0 2023-12-16T05:56:36.428 INFO:tasks.workunit.client.1.smithi156.stdout:5/536: getdents da/dc/d4b/d6c/d77 0 2023-12-16T05:56:36.429 INFO:tasks.workunit.client.1.smithi156.stdout:3/271: mknod dc/d10/d1d/d4b/d52/c64 0 2023-12-16T05:56:36.429 INFO:tasks.workunit.client.1.smithi156.stdout:7/505: write d1e/d55/d71/f4b [1982450,67878] 0 2023-12-16T05:56:36.429 INFO:tasks.workunit.client.1.smithi156.stdout:7/506: fdatasync d1e/d1f/f78 0 2023-12-16T05:56:36.430 INFO:tasks.workunit.client.1.smithi156.stdout:5/537: creat da/dc/d4b/d6c/d81/fa9 x:0 0 0 2023-12-16T05:56:36.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:36 smithi156 ceph-mon[121001]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2023-12-16T05:56:36.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:36 smithi156 ceph-mon[121001]: Updating smithi156:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T05:56:36.432 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:36 smithi156 ceph-mon[121001]: Updating smithi155:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T05:56:36.432 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:36 smithi156 ceph-mon[121001]: pgmap v14: 65 pgs: 65 active+clean; 1.9 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 140 MiB/s rd, 267 MiB/s wr, 562 op/s 2023-12-16T05:56:36.432 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:36 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:36.432 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:36 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:36.432 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:36 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:36.432 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:36 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:36.432 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:36 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:36.432 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:36 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:36.432 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:36 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:36.433 INFO:tasks.workunit.client.1.smithi156.stdout:3/272: symlink dc/d56/l65 0 2023-12-16T05:56:36.433 INFO:tasks.workunit.client.1.smithi156.stdout:8/278: dwrite d3/d12/d16/f2d [4194304,4194304] 0 2023-12-16T05:56:36.434 INFO:tasks.workunit.client.1.smithi156.stdout:1/232: dwrite d3/f5 [0,4194304] 0 2023-12-16T05:56:36.436 INFO:tasks.workunit.client.1.smithi156.stdout:5/538: unlink da/dc/d2d/d4d/d54/d90/la2 0 2023-12-16T05:56:36.437 INFO:tasks.workunit.client.1.smithi156.stdout:9/325: dwrite d6/d19/d30/f3f [0,4194304] 0 2023-12-16T05:56:36.440 INFO:tasks.workunit.client.1.smithi156.stdout:3/273: mkdir dc/df/d66 0 2023-12-16T05:56:36.440 INFO:tasks.workunit.client.1.smithi156.stdout:3/274: write dc/d10/d1d/d4b/d52/f54 [9706,63746] 0 2023-12-16T05:56:36.442 INFO:tasks.workunit.client.1.smithi156.stdout:8/279: mkdir d3/d12/d16/d54 0 2023-12-16T05:56:36.442 INFO:tasks.workunit.client.1.smithi156.stdout:8/280: readlink d3/d12/l4b 0 2023-12-16T05:56:36.442 INFO:tasks.workunit.client.1.smithi156.stdout:8/281: write d3/d12/f3d [1236667,58660] 0 2023-12-16T05:56:36.444 INFO:tasks.workunit.client.0.smithi155.stdout:1/720: dwrite d1/d25/d43/fcb [0,4194304] 0 2023-12-16T05:56:36.448 INFO:tasks.workunit.client.1.smithi156.stdout:4/358: dwrite d9/d43/f49 [0,4194304] 0 2023-12-16T05:56:36.449 INFO:tasks.workunit.client.1.smithi156.stdout:1/233: truncate d3/f14 2846635 0 2023-12-16T05:56:36.450 INFO:tasks.workunit.client.1.smithi156.stdout:3/275: mkdir dc/d56/d67 0 2023-12-16T05:56:36.451 INFO:tasks.workunit.client.1.smithi156.stdout:8/282: rmdir d3/d7/d9/d3b 39 2023-12-16T05:56:36.454 INFO:tasks.workunit.client.1.smithi156.stdout:6/341: dwrite d9/ff [0,4194304] 0 2023-12-16T05:56:36.455 INFO:tasks.workunit.client.1.smithi156.stdout:0/379: dwrite d2/d23/f32 [0,4194304] 0 2023-12-16T05:56:36.455 INFO:tasks.workunit.client.1.smithi156.stdout:4/359: mknod d9/d43/d58/c78 0 2023-12-16T05:56:36.455 INFO:tasks.workunit.client.0.smithi155.stdout:8/602: dwrite d4/d62/d66/d78/d88/d1b/d1c/d97/fa1 [0,4194304] 0 2023-12-16T05:56:36.455 INFO:tasks.workunit.client.1.smithi156.stdout:0/380: read d2/d7/dd/d29/d38/f68 [318817,29003] 0 2023-12-16T05:56:36.456 INFO:tasks.workunit.client.1.smithi156.stdout:8/283: truncate d3/d7/d27/f32 156477 0 2023-12-16T05:56:36.456 INFO:tasks.workunit.client.0.smithi155.stdout:8/603: read d4/d62/d66/d78/d88/d1b/d1c/d97/d29/f9c [212077,48211] 0 2023-12-16T05:56:36.457 INFO:tasks.workunit.client.0.smithi155.stdout:8/604: mknod d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/cc7 0 2023-12-16T05:56:36.457 INFO:tasks.workunit.client.0.smithi155.stdout:8/605: fsync d4/ff 0 2023-12-16T05:56:36.458 INFO:tasks.workunit.client.1.smithi156.stdout:7/507: dwrite d1e/d55/d71/d61/fa5 [0,4194304] 0 2023-12-16T05:56:36.459 INFO:tasks.workunit.client.1.smithi156.stdout:3/276: write dc/d10/d1d/f3a [741628,39088] 0 2023-12-16T05:56:36.460 INFO:tasks.workunit.client.1.smithi156.stdout:6/342: mkdir d9/d13/d2f/d51/d6b 0 2023-12-16T05:56:36.460 INFO:tasks.workunit.client.1.smithi156.stdout:6/343: read - d9/d1c/f46 zero size 2023-12-16T05:56:36.460 INFO:tasks.workunit.client.0.smithi155.stdout:5/704: dwrite d0/d2/d2a/fe [4194304,4194304] 0 2023-12-16T05:56:36.461 INFO:tasks.workunit.client.1.smithi156.stdout:5/539: dwrite da/dc/d2d/f7e [4194304,4194304] 0 2023-12-16T05:56:36.461 INFO:tasks.workunit.client.1.smithi156.stdout:3/277: write fb [292824,77428] 0 2023-12-16T05:56:36.461 INFO:tasks.workunit.client.1.smithi156.stdout:3/278: getdents dc/df/d34/d62 0 2023-12-16T05:56:36.461 INFO:tasks.workunit.client.1.smithi156.stdout:0/381: rmdir d2/d7/dd/d29 39 2023-12-16T05:56:36.464 INFO:tasks.workunit.client.1.smithi156.stdout:8/284: creat d3/d7/d9/d3c/f55 x:0 0 0 2023-12-16T05:56:36.466 INFO:tasks.workunit.client.0.smithi155.stdout:0/666: dwrite d7/df/d41/f97 [0,4194304] 0 2023-12-16T05:56:36.468 INFO:tasks.workunit.client.0.smithi155.stdout:0/667: dread d7/d13/fa7 [0,4194304] 0 2023-12-16T05:56:36.468 INFO:tasks.workunit.client.0.smithi155.stdout:0/668: chown d7/d2d/c5b 13 1 2023-12-16T05:56:36.468 INFO:tasks.workunit.client.0.smithi155.stdout:0/669: readlink d7/df/d73/lb2 0 2023-12-16T05:56:36.468 INFO:tasks.workunit.client.1.smithi156.stdout:7/508: mkdir d1e/d55/d71/d61/dac 0 2023-12-16T05:56:36.469 INFO:tasks.workunit.client.1.smithi156.stdout:4/360: dread d9/d2b/f40 [0,4194304] 0 2023-12-16T05:56:36.472 INFO:tasks.workunit.client.1.smithi156.stdout:6/344: rename d9/ff to d9/d13/d3e/f6c 0 2023-12-16T05:56:36.472 INFO:tasks.workunit.client.0.smithi155.stdout:0/670: truncate d7/df/f37 1541312 0 2023-12-16T05:56:36.472 INFO:tasks.workunit.client.0.smithi155.stdout:8/606: dread d4/d62/fa2 [4194304,4194304] 0 2023-12-16T05:56:36.473 INFO:tasks.workunit.client.1.smithi156.stdout:5/540: creat da/dc/d2d/d4d/d54/faa x:0 0 0 2023-12-16T05:56:36.473 INFO:tasks.workunit.client.1.smithi156.stdout:5/541: write da/dc/d2d/d34/f69 [4939706,2896] 0 2023-12-16T05:56:36.473 INFO:tasks.workunit.client.1.smithi156.stdout:5/542: truncate da/d46/f4f 1030607 0 2023-12-16T05:56:36.475 INFO:tasks.workunit.client.1.smithi156.stdout:3/279: creat dc/df/d34/f68 x:0 0 0 2023-12-16T05:56:36.475 INFO:tasks.workunit.client.1.smithi156.stdout:5/543: write f0 [4484764,64718] 0 2023-12-16T05:56:36.475 INFO:tasks.workunit.client.0.smithi155.stdout:8/607: creat d4/d62/d66/d78/d88/d1b/d5f/fc8 x:0 0 0 2023-12-16T05:56:36.476 INFO:tasks.workunit.client.0.smithi155.stdout:0/671: rmdir d7/df/d73 39 2023-12-16T05:56:36.476 INFO:tasks.workunit.client.1.smithi156.stdout:8/285: mknod d3/d12/d16/d54/c56 0 2023-12-16T05:56:36.476 INFO:tasks.workunit.client.0.smithi155.stdout:7/600: sync 2023-12-16T05:56:36.477 INFO:tasks.workunit.client.0.smithi155.stdout:2/554: sync 2023-12-16T05:56:36.477 INFO:tasks.workunit.client.0.smithi155.stdout:7/601: chown d0/d1/f21 15970 1 2023-12-16T05:56:36.477 INFO:tasks.workunit.client.0.smithi155.stdout:2/555: fsync d0/d7/dd/d49/d4b/d7f/fa1 0 2023-12-16T05:56:36.477 INFO:tasks.workunit.client.1.smithi156.stdout:2/357: sync 2023-12-16T05:56:36.477 INFO:tasks.workunit.client.0.smithi155.stdout:4/587: sync 2023-12-16T05:56:36.477 INFO:tasks.workunit.client.0.smithi155.stdout:3/514: sync 2023-12-16T05:56:36.478 INFO:tasks.workunit.client.0.smithi155.stdout:9/780: sync 2023-12-16T05:56:36.479 INFO:tasks.workunit.client.1.smithi156.stdout:7/509: creat d1e/d1f/d22/d75/d77/fad x:0 0 0 2023-12-16T05:56:36.481 INFO:tasks.workunit.client.1.smithi156.stdout:4/361: creat d9/d43/f79 x:0 0 0 2023-12-16T05:56:36.481 INFO:tasks.workunit.client.1.smithi156.stdout:4/362: fsync d9/f1e 0 2023-12-16T05:56:36.482 INFO:tasks.workunit.client.0.smithi155.stdout:8/608: link d4/l36 d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/lc9 0 2023-12-16T05:56:36.482 INFO:tasks.workunit.client.0.smithi155.stdout:0/672: link d7/df/d6f/f82 d7/da4/fdb 0 2023-12-16T05:56:36.484 INFO:tasks.workunit.client.1.smithi156.stdout:6/345: creat d9/f6d x:0 0 0 2023-12-16T05:56:36.484 INFO:tasks.workunit.client.1.smithi156.stdout:6/346: dread - d9/d13/f4d zero size 2023-12-16T05:56:36.484 INFO:tasks.workunit.client.0.smithi155.stdout:7/602: truncate d0/d1/d5/fd 3192633 0 2023-12-16T05:56:36.484 INFO:tasks.workunit.client.0.smithi155.stdout:7/603: stat d0/d6a/d1a/d22/c59 0 2023-12-16T05:56:36.484 INFO:tasks.workunit.client.1.smithi156.stdout:6/347: read d9/d1c/f2b [174984,115508] 0 2023-12-16T05:56:36.484 INFO:tasks.workunit.client.1.smithi156.stdout:6/348: chown d9/d13/d3e/d5f/c60 9299 1 2023-12-16T05:56:36.485 INFO:tasks.workunit.client.0.smithi155.stdout:2/556: creat d0/d7/d1f/fb9 x:0 0 0 2023-12-16T05:56:36.487 INFO:tasks.workunit.client.0.smithi155.stdout:2/557: write d0/d7/dd/d14/f2d [1634729,23499] 0 2023-12-16T05:56:36.488 INFO:tasks.workunit.client.0.smithi155.stdout:4/588: symlink d0/d10/d46/d16/d1a/d70/d92/daf/db7/lbf 0 2023-12-16T05:56:36.489 INFO:tasks.workunit.client.0.smithi155.stdout:9/781: truncate da/d15/d17/d24/d62/f97 2989473 0 2023-12-16T05:56:36.491 INFO:tasks.workunit.client.1.smithi156.stdout:3/280: mkdir dc/d56/d69 0 2023-12-16T05:56:36.492 INFO:tasks.workunit.client.0.smithi155.stdout:8/609: unlink d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/lc9 0 2023-12-16T05:56:36.492 INFO:tasks.workunit.client.0.smithi155.stdout:0/673: creat d7/d47/d53/fdc x:0 0 0 2023-12-16T05:56:36.492 INFO:tasks.workunit.client.0.smithi155.stdout:0/674: write d7/d47/d53/f9c [769503,61275] 0 2023-12-16T05:56:36.494 INFO:tasks.workunit.client.1.smithi156.stdout:5/544: creat da/dc/d2d/d4d/d54/d90/fab x:0 0 0 2023-12-16T05:56:36.494 INFO:tasks.workunit.client.1.smithi156.stdout:5/545: fdatasync da/dc/d2d/d4d/d54/f5d 0 2023-12-16T05:56:36.494 INFO:tasks.workunit.client.1.smithi156.stdout:5/546: truncate da/f50 735050 0 2023-12-16T05:56:36.494 INFO:tasks.workunit.client.1.smithi156.stdout:5/547: readlink da/dc/d2d/d34/l82 0 2023-12-16T05:56:36.494 INFO:tasks.workunit.client.0.smithi155.stdout:2/558: rmdir d0/d7/d57/d95 39 2023-12-16T05:56:36.495 INFO:tasks.workunit.client.1.smithi156.stdout:8/286: creat d3/d18/f57 x:0 0 0 2023-12-16T05:56:36.496 INFO:tasks.workunit.client.1.smithi156.stdout:3/281: write dc/d10/d1d/f49 [1056787,81268] 0 2023-12-16T05:56:36.497 INFO:tasks.workunit.client.1.smithi156.stdout:4/363: mkdir d9/d2c/d7a 0 2023-12-16T05:56:36.497 INFO:tasks.workunit.client.0.smithi155.stdout:4/589: symlink d0/da/d36/d5f/d75/d89/d9a/lc0 0 2023-12-16T05:56:36.497 INFO:tasks.workunit.client.1.smithi156.stdout:0/382: dwrite d2/d23/d55/f60 [0,4194304] 0 2023-12-16T05:56:36.498 INFO:tasks.workunit.client.1.smithi156.stdout:6/349: mkdir d9/d13/d3e/d5f/d6e 0 2023-12-16T05:56:36.498 INFO:tasks.workunit.client.0.smithi155.stdout:5/705: dwrite d0/d2/d2a/f7f [0,4194304] 0 2023-12-16T05:56:36.498 INFO:tasks.workunit.client.0.smithi155.stdout:9/782: mkdir da/d10b 0 2023-12-16T05:56:36.498 INFO:tasks.workunit.client.0.smithi155.stdout:9/783: chown da/d15/d17/d24/ff6 0 1 2023-12-16T05:56:36.500 INFO:tasks.workunit.client.1.smithi156.stdout:5/548: creat da/d9a/fac x:0 0 0 2023-12-16T05:56:36.502 INFO:tasks.workunit.client.0.smithi155.stdout:8/610: creat d4/d62/d66/d78/d88/d1b/d1c/d19/fca x:0 0 0 2023-12-16T05:56:36.502 INFO:tasks.workunit.client.0.smithi155.stdout:3/515: dwrite d0/d14/f50 [0,4194304] 0 2023-12-16T05:56:36.502 INFO:tasks.workunit.client.0.smithi155.stdout:0/675: creat d7/df/d73/db3/dce/fdd x:0 0 0 2023-12-16T05:56:36.502 INFO:tasks.workunit.client.0.smithi155.stdout:0/676: truncate d7/d2d/fd3 1032686 0 2023-12-16T05:56:36.503 INFO:tasks.workunit.client.1.smithi156.stdout:8/287: rename d3/ff to d3/d12/f58 0 2023-12-16T05:56:36.504 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.498+0000 7f9fa4e70700 1 -- 172.21.15.155:0/3190573362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa0070510 msgr2=0x7f9fa0070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:36.504 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.498+0000 7f9fa4e70700 1 --2- 172.21.15.155:0/3190573362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa0070510 0x7f9fa0070980 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9f94004940 tx=0x7f9f94009e30 comp rx=0 tx=0).stop 2023-12-16T05:56:36.504 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.498+0000 7f9fa4e70700 1 -- 172.21.15.155:0/3190573362 shutdown_connections 2023-12-16T05:56:36.504 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.498+0000 7f9fa4e70700 1 --2- 172.21.15.155:0/3190573362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa0070510 0x7f9fa0070980 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:36.505 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.498+0000 7f9fa4e70700 1 --2- 172.21.15.155:0/3190573362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fa0071b60 0x7f9fa006ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:36.505 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.498+0000 7f9fa4e70700 1 -- 172.21.15.155:0/3190573362 >> 172.21.15.155:0/3190573362 conn(0x7f9fa00f82d0 msgr2=0x7f9fa00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:56:36.505 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.498+0000 7f9fa4e70700 1 -- 172.21.15.155:0/3190573362 shutdown_connections 2023-12-16T05:56:36.505 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.498+0000 7f9fa4e70700 1 -- 172.21.15.155:0/3190573362 wait complete. 2023-12-16T05:56:36.505 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.499+0000 7f9fa4e70700 1 Processor -- start 2023-12-16T05:56:36.505 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.499+0000 7f9fa4e70700 1 -- start start 2023-12-16T05:56:36.505 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.499+0000 7f9fa4e70700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa0070510 0x7f9fa01074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:36.505 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.499+0000 7f9fa4e70700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fa0071b60 0x7f9fa01079e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:36.505 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.499+0000 7f9fa4e70700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa01080c0 con 0x7f9fa0070510 2023-12-16T05:56:36.505 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.499+0000 7f9fa4e70700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa0108450 con 0x7f9fa0071b60 2023-12-16T05:56:36.505 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.499+0000 7f9f9dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fa0071b60 0x7f9fa01079e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:36.505 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.499+0000 7f9f9dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fa0071b60 0x7f9fa01079e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.155:45408/0 (socket says 172.21.15.155:45408) 2023-12-16T05:56:36.505 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.499+0000 7f9f9dd9b700 1 -- 172.21.15.155:0/1914831997 learned_addr learned my addr 172.21.15.155:0/1914831997 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:56:36.506 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.499+0000 7f9f9e59c700 1 --2- 172.21.15.155:0/1914831997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa0070510 0x7f9fa01074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:36.506 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.500+0000 7f9f9e59c700 1 -- 172.21.15.155:0/1914831997 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fa0071b60 msgr2=0x7f9fa01079e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:36.506 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.500+0000 7f9f9e59c700 1 --2- 172.21.15.155:0/1914831997 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fa0071b60 0x7f9fa01079e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:36.506 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.500+0000 7f9f9e59c700 1 -- 172.21.15.155:0/1914831997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f94005040 con 0x7f9fa0070510 2023-12-16T05:56:36.506 INFO:tasks.workunit.client.0.smithi155.stdout:4/590: creat d0/d10/d46/d16/fc1 x:0 0 0 2023-12-16T05:56:36.507 INFO:tasks.workunit.client.0.smithi155.stdout:4/591: chown d0/d10/d46/d16/d30/faa 176 1 2023-12-16T05:56:36.507 INFO:tasks.workunit.client.1.smithi156.stdout:3/282: mkdir dc/d6a 0 2023-12-16T05:56:36.507 INFO:tasks.workunit.client.1.smithi156.stdout:4/364: symlink d9/d43/l7b 0 2023-12-16T05:56:36.507 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.502+0000 7f9f9e59c700 1 --2- 172.21.15.155:0/1914831997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa0070510 0x7f9fa01074a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800ba80 tx=0x7f9f98009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:56:36.507 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.502+0000 7f9f8effd700 1 -- 172.21.15.155:0/1914831997 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f9800c9a0 con 0x7f9fa0070510 2023-12-16T05:56:36.507 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.502+0000 7f9f8effd700 1 -- 172.21.15.155:0/1914831997 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9f980098c0 con 0x7f9fa0070510 2023-12-16T05:56:36.507 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.502+0000 7f9f8effd700 1 -- 172.21.15.155:0/1914831997 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f98013600 con 0x7f9fa0070510 2023-12-16T05:56:36.507 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.502+0000 7f9fa4e70700 1 -- 172.21.15.155:0/1914831997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa0108730 con 0x7f9fa0070510 2023-12-16T05:56:36.508 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.503+0000 7f9fa4e70700 1 -- 172.21.15.155:0/1914831997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa0108c70 con 0x7f9fa0070510 2023-12-16T05:56:36.509 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.505+0000 7f9f8effd700 1 -- 172.21.15.155:0/1914831997 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 24) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f9f98006d50 con 0x7f9fa0070510 2023-12-16T05:56:36.509 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.506+0000 7f9f8effd700 1 --2- 172.21.15.155:0/1914831997 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f9f8806ae40 0x7f9f8806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:36.509 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.506+0000 7f9f8effd700 1 -- 172.21.15.155:0/1914831997 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f9f98089540 con 0x7f9fa0070510 2023-12-16T05:56:36.509 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.506+0000 7f9f9dd9b700 1 --2- 172.21.15.155:0/1914831997 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f9f8806ae40 0x7f9f8806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:36.509 INFO:tasks.workunit.client.0.smithi155.stdout:5/706: creat d0/d2/d2a/d30/d53/d7b/d99/d47/fe7 x:0 0 0 2023-12-16T05:56:36.510 INFO:tasks.workunit.client.0.smithi155.stdout:5/707: chown d0/d2/d2a/d19/d71/ld6 210000500 1 2023-12-16T05:56:36.510 INFO:tasks.workunit.client.0.smithi155.stdout:5/708: chown d0/l24 7453 1 2023-12-16T05:56:36.510 INFO:tasks.workunit.client.0.smithi155.stdout:5/709: chown d0/dae 213609019 1 2023-12-16T05:56:36.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.507+0000 7f9f9dd9b700 1 --2- 172.21.15.155:0/1914831997 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f9f8806ae40 0x7f9f8806d2f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9f9400b3b0 tx=0x7f9f94009e30 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:56:36.510 INFO:tasks.workunit.client.0.smithi155.stdout:5/710: dread d0/d2/d2a/d19/d21/d56/fac [0,4194304] 0 2023-12-16T05:56:36.511 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.507+0000 7f9fa4e70700 1 -- 172.21.15.155:0/1914831997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa0069c50 con 0x7f9fa0070510 2023-12-16T05:56:36.511 INFO:tasks.workunit.client.0.smithi155.stdout:9/784: mkdir da/d15/d17/d36/d10c 0 2023-12-16T05:56:36.512 INFO:tasks.workunit.client.1.smithi156.stdout:0/383: link d2/d7/dd/f5b d2/d7/dd/d1c/f71 0 2023-12-16T05:56:36.512 INFO:tasks.workunit.client.1.smithi156.stdout:2/358: dwrite d9/d12/f63 [0,4194304] 0 2023-12-16T05:56:36.512 INFO:tasks.workunit.client.1.smithi156.stdout:2/359: chown d9/dd/l42 7990042 1 2023-12-16T05:56:36.512 INFO:tasks.workunit.client.1.smithi156.stdout:5/549: symlink da/dc/d2d/d9b/lad 0 2023-12-16T05:56:36.512 INFO:tasks.workunit.client.1.smithi156.stdout:5/550: readlink da/dc/d4b/d6c/d77/d8f/l97 0 2023-12-16T05:56:36.512 INFO:tasks.workunit.client.1.smithi156.stdout:5/551: truncate da/dc/d4b/d6c/f7a 2107727 0 2023-12-16T05:56:36.512 INFO:tasks.workunit.client.1.smithi156.stdout:5/552: stat da/dc/d2d/d4d/d54/da6 0 2023-12-16T05:56:36.512 INFO:tasks.workunit.client.1.smithi156.stdout:7/510: getdents d1e/d1f/d22/d75/d77 0 2023-12-16T05:56:36.513 INFO:tasks.workunit.client.1.smithi156.stdout:8/288: creat d3/d7/d27/f59 x:0 0 0 2023-12-16T05:56:36.513 INFO:tasks.workunit.client.0.smithi155.stdout:8/611: symlink d4/lcb 0 2023-12-16T05:56:36.513 INFO:tasks.workunit.client.0.smithi155.stdout:8/612: chown d4/d62/d66/d78/d88/d1b/d1c/d1a/l4d 6894320 1 2023-12-16T05:56:36.514 INFO:tasks.workunit.client.1.smithi156.stdout:3/283: symlink dc/d10/l6b 0 2023-12-16T05:56:36.514 INFO:tasks.workunit.client.1.smithi156.stdout:3/284: chown dc/d10/d3d/l30 355108997 1 2023-12-16T05:56:36.514 INFO:tasks.workunit.client.1.smithi156.stdout:3/285: rename dc/d10/d1d to dc/d10/d1d/d6c 22 2023-12-16T05:56:36.514 INFO:tasks.workunit.client.1.smithi156.stdout:3/286: fsync dc/d10/d3d/f38 0 2023-12-16T05:56:36.515 INFO:tasks.workunit.client.1.smithi156.stdout:4/365: truncate d9/f15 3275586 0 2023-12-16T05:56:36.515 INFO:tasks.workunit.client.1.smithi156.stdout:3/287: write dc/f23 [2641996,120780] 0 2023-12-16T05:56:36.517 INFO:tasks.workunit.client.1.smithi156.stdout:0/384: symlink d2/d23/d55/l72 0 2023-12-16T05:56:36.518 INFO:tasks.workunit.client.0.smithi155.stdout:0/677: creat d7/da4/fde x:0 0 0 2023-12-16T05:56:36.521 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.518+0000 7f9f8effd700 1 -- 172.21.15.155:0/1914831997 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f9f9804dce0 con 0x7f9fa0070510 2023-12-16T05:56:36.521 INFO:tasks.workunit.client.0.smithi155.stdout:2/559: getdents d0/d7/d57/d95 0 2023-12-16T05:56:36.522 INFO:tasks.workunit.client.0.smithi155.stdout:4/592: unlink d0/d10/f9b 0 2023-12-16T05:56:36.522 INFO:tasks.workunit.client.1.smithi156.stdout:2/360: truncate f2 1231766 0 2023-12-16T05:56:36.523 INFO:tasks.workunit.client.1.smithi156.stdout:5/553: mknod da/d9a/cae 0 2023-12-16T05:56:36.524 INFO:tasks.workunit.client.0.smithi155.stdout:5/711: creat d0/d60/d79/d8e/fe8 x:0 0 0 2023-12-16T05:56:36.524 INFO:tasks.workunit.client.0.smithi155.stdout:5/712: chown d0/d2/d2a/d19/d71/l72 561197645 1 2023-12-16T05:56:36.524 INFO:tasks.workunit.client.0.smithi155.stdout:5/713: fsync d0/d2/d2a/d19/d88/fc3 0 2023-12-16T05:56:36.524 INFO:tasks.workunit.client.0.smithi155.stdout:5/714: readlink d0/dae/lc7 0 2023-12-16T05:56:36.524 INFO:tasks.workunit.client.0.smithi155.stdout:5/715: chown d0/d60/l89 2756 1 2023-12-16T05:56:36.524 INFO:tasks.workunit.client.0.smithi155.stdout:5/716: chown d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/cd0 225 1 2023-12-16T05:56:36.525 INFO:tasks.workunit.client.1.smithi156.stdout:7/511: link d1e/d1f/d22/d75/c88 d1e/d1f/d22/d75/d77/cae 0 2023-12-16T05:56:36.525 INFO:tasks.workunit.client.0.smithi155.stdout:9/785: mknod da/d15/d17/d36/d5b/d60/d9e/de3/c10d 0 2023-12-16T05:56:36.526 INFO:tasks.workunit.client.0.smithi155.stdout:0/678: symlink d7/d47/d5d/ldf 0 2023-12-16T05:56:36.526 INFO:tasks.workunit.client.0.smithi155.stdout:2/560: read d0/f22 [4146237,129999] 0 2023-12-16T05:56:36.526 INFO:tasks.workunit.client.0.smithi155.stdout:5/717: mknod d0/d2/d2a/d30/d53/d7b/ce9 0 2023-12-16T05:56:36.526 INFO:tasks.workunit.client.0.smithi155.stdout:5/718: chown d0/d2/f6e 1557 1 2023-12-16T05:56:36.526 INFO:tasks.workunit.client.0.smithi155.stdout:5/719: readlink d0/d2/l76 0 2023-12-16T05:56:36.527 INFO:tasks.workunit.client.1.smithi156.stdout:8/289: creat d3/f5a x:0 0 0 2023-12-16T05:56:36.527 INFO:tasks.workunit.client.0.smithi155.stdout:0/679: creat d7/df/d73/dba/fe0 x:0 0 0 2023-12-16T05:56:36.527 INFO:tasks.workunit.client.0.smithi155.stdout:0/680: readlink d7/df/d73/d8d/d4d/l96 0 2023-12-16T05:56:36.527 INFO:tasks.workunit.client.0.smithi155.stdout:0/681: chown d7/f29 5203 1 2023-12-16T05:56:36.528 INFO:tasks.workunit.client.1.smithi156.stdout:0/385: creat d2/d7/dd/d29/d38/d51/d69/f73 x:0 0 0 2023-12-16T05:56:36.529 INFO:tasks.workunit.client.0.smithi155.stdout:2/561: write d0/d7/d69/f87 [3199061,127759] 0 2023-12-16T05:56:36.530 INFO:tasks.workunit.client.1.smithi156.stdout:2/361: link d9/l59 d9/dd/d17/d33/d47/l69 0 2023-12-16T05:56:36.532 INFO:tasks.workunit.client.0.smithi155.stdout:2/562: mkdir d0/d7/d57/daf/dba 0 2023-12-16T05:56:36.533 INFO:tasks.workunit.client.1.smithi156.stdout:5/554: rename da/l25 to da/dc/d2d/d9b/laf 0 2023-12-16T05:56:36.533 INFO:tasks.workunit.client.1.smithi156.stdout:5/555: write da/dc/d4b/d6c/d81/f80 [910391,80518] 0 2023-12-16T05:56:36.534 INFO:tasks.workunit.client.1.smithi156.stdout:5/556: fsync da/dc/f1d 0 2023-12-16T05:56:36.534 INFO:tasks.workunit.client.1.smithi156.stdout:5/557: chown da/dc/d2d/f8a 325554 1 2023-12-16T05:56:36.535 INFO:tasks.workunit.client.0.smithi155.stdout:2/563: creat d0/d5/fbb x:0 0 0 2023-12-16T05:56:36.535 INFO:tasks.workunit.client.1.smithi156.stdout:7/512: mkdir d1e/daf 0 2023-12-16T05:56:36.536 INFO:tasks.workunit.client.0.smithi155.stdout:2/564: mkdir d0/d7/dd/d62/d66/dbc 0 2023-12-16T05:56:36.536 INFO:tasks.workunit.client.0.smithi155.stdout:5/720: write d0/d2/d2a/f45 [3479034,3672] 0 2023-12-16T05:56:36.537 INFO:tasks.workunit.client.0.smithi155.stdout:5/721: read d0/d2/d2a/d30/d53/fbe [2299016,4797] 0 2023-12-16T05:56:36.538 INFO:tasks.workunit.client.1.smithi156.stdout:8/290: link d3/d12/d16/f3e d3/f5b 0 2023-12-16T05:56:36.540 INFO:tasks.workunit.client.1.smithi156.stdout:2/362: dread d9/f27 [0,4194304] 0 2023-12-16T05:56:36.540 INFO:tasks.workunit.client.1.smithi156.stdout:2/363: truncate d9/d5a/f64 666473 0 2023-12-16T05:56:36.540 INFO:tasks.workunit.client.0.smithi155.stdout:2/565: link d0/d7/dd/l3f d0/d7/dd/d49/d4b/d8c/lbd 0 2023-12-16T05:56:36.541 INFO:tasks.workunit.client.0.smithi155.stdout:0/682: write d7/df/d41/f77 [502986,31089] 0 2023-12-16T05:56:36.541 INFO:tasks.workunit.client.0.smithi155.stdout:5/722: symlink d0/d2/d2a/lea 0 2023-12-16T05:56:36.541 INFO:tasks.workunit.client.0.smithi155.stdout:5/723: fdatasync d0/d2/d2a/d30/d53/d7b/d99/d47/f6b 0 2023-12-16T05:56:36.542 INFO:tasks.workunit.client.1.smithi156.stdout:0/386: mknod d2/d7/dd/d29/c74 0 2023-12-16T05:56:36.542 INFO:tasks.workunit.client.1.smithi156.stdout:2/364: write f8 [2622982,101991] 0 2023-12-16T05:56:36.542 INFO:tasks.workunit.client.0.smithi155.stdout:9/786: dread da/d15/d17/d36/d5b/fa2 [0,4194304] 0 2023-12-16T05:56:36.544 INFO:tasks.workunit.client.1.smithi156.stdout:5/558: mkdir da/dc/d2d/db0 0 2023-12-16T05:56:36.544 INFO:tasks.workunit.client.1.smithi156.stdout:0/387: dread d2/d23/f27 [0,4194304] 0 2023-12-16T05:56:36.545 INFO:tasks.workunit.client.1.smithi156.stdout:7/513: creat d1e/d55/d71/d61/dac/fb0 x:0 0 0 2023-12-16T05:56:36.546 INFO:tasks.workunit.client.0.smithi155.stdout:5/724: creat d0/d2/d2a/d19/d59/feb x:0 0 0 2023-12-16T05:56:36.546 INFO:tasks.workunit.client.0.smithi155.stdout:8/613: dwrite d4/d62/d66/d78/d88/d1b/d1c/f45 [0,4194304] 0 2023-12-16T05:56:36.546 INFO:tasks.workunit.client.0.smithi155.stdout:8/614: rename d4/d62/d66/d78/d88/d1b to d4/d62/d66/d78/d88/d1b/d5f/dcc 22 2023-12-16T05:56:36.546 INFO:tasks.workunit.client.0.smithi155.stdout:8/615: chown d4/d62/d66/d78/d88/d1b/d1c/l96 503157133 1 2023-12-16T05:56:36.546 INFO:tasks.workunit.client.0.smithi155.stdout:8/616: write d4/d62/d66/d78/d88/f7f [510268,5544] 0 2023-12-16T05:56:36.546 INFO:tasks.workunit.client.0.smithi155.stdout:8/617: fdatasync d4/d62/d66/d78/d88/d1b/d1c/d1a/f3a 0 2023-12-16T05:56:36.546 INFO:tasks.workunit.client.0.smithi155.stdout:4/593: dwrite d0/da/d36/d5f/d7b/fb4 [0,4194304] 0 2023-12-16T05:56:36.546 INFO:tasks.workunit.client.0.smithi155.stdout:4/594: getdents d0/d10/d46/d16/d30/d52/d88/dab 0 2023-12-16T05:56:36.548 INFO:tasks.workunit.client.1.smithi156.stdout:8/291: rename d3/d12/d16/f3e to d3/f5c 0 2023-12-16T05:56:36.548 INFO:tasks.workunit.client.0.smithi155.stdout:9/787: truncate da/d15/d17/d24/f64 5496867 0 2023-12-16T05:56:36.550 INFO:tasks.workunit.client.0.smithi155.stdout:8/618: getdents d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab 0 2023-12-16T05:56:36.550 INFO:tasks.workunit.client.0.smithi155.stdout:8/619: chown d4/d62/d66/d78/d88/d1b/d1c/d19/d64 9 1 2023-12-16T05:56:36.551 INFO:tasks.workunit.client.0.smithi155.stdout:8/620: readlink d4/d62/d95/lae 0 2023-12-16T05:56:36.552 INFO:tasks.workunit.client.1.smithi156.stdout:2/365: mkdir d9/dd/d17/d33/d38/d39/d60/d6a 0 2023-12-16T05:56:36.552 INFO:tasks.workunit.client.1.smithi156.stdout:5/559: truncate da/dc/f19 199752 0 2023-12-16T05:56:36.555 INFO:tasks.workunit.client.1.smithi156.stdout:0/388: creat d2/d7/dd/d1c/f75 x:0 0 0 2023-12-16T05:56:36.555 INFO:tasks.workunit.client.1.smithi156.stdout:0/389: fsync d2/d7/dd/d29/d38/d3f/f58 0 2023-12-16T05:56:36.557 INFO:tasks.workunit.client.1.smithi156.stdout:8/292: mknod d3/c5d 0 2023-12-16T05:56:36.557 INFO:tasks.workunit.client.1.smithi156.stdout:8/293: write d3/f5a [850411,64934] 0 2023-12-16T05:56:36.558 INFO:tasks.workunit.client.1.smithi156.stdout:2/366: mknod d9/d5a/c6b 0 2023-12-16T05:56:36.558 INFO:tasks.workunit.client.0.smithi155.stdout:4/595: creat d0/da/d36/d5f/d75/d3d/fc2 x:0 0 0 2023-12-16T05:56:36.559 INFO:tasks.workunit.client.0.smithi155.stdout:5/725: dread d0/d2/d2a/d19/d21/fa2 [0,4194304] 0 2023-12-16T05:56:36.559 INFO:tasks.workunit.client.0.smithi155.stdout:5/726: chown d0/d2/d2a/d30/d53/d7b/d99/d47/dbb/cd4 215731644 1 2023-12-16T05:56:36.560 INFO:tasks.workunit.client.0.smithi155.stdout:9/788: unlink da/d15/d17/d36/l5c 0 2023-12-16T05:56:36.561 INFO:tasks.workunit.client.1.smithi156.stdout:5/560: mknod da/dc/d4b/cb1 0 2023-12-16T05:56:36.563 INFO:tasks.workunit.client.1.smithi156.stdout:7/514: dread d1e/d55/d71/f4b [0,4194304] 0 2023-12-16T05:56:36.563 INFO:tasks.workunit.client.1.smithi156.stdout:8/294: unlink d3/d18/l23 0 2023-12-16T05:56:36.568 INFO:tasks.workunit.client.1.smithi156.stdout:5/561: rename da/dc/ff to da/dc/d4b/fb2 0 2023-12-16T05:56:36.568 INFO:tasks.workunit.client.1.smithi156.stdout:8/295: dread d3/d7/d9/f2a [0,4194304] 0 2023-12-16T05:56:36.572 INFO:tasks.workunit.client.0.smithi155.stdout:4/596: dread d0/d10/d46/d16/d1a/f72 [0,4194304] 0 2023-12-16T05:56:36.574 INFO:tasks.workunit.client.0.smithi155.stdout:2/566: dwrite d0/d7/f73 [0,4194304] 0 2023-12-16T05:56:36.574 INFO:tasks.workunit.client.0.smithi155.stdout:2/567: dread - d0/d5/fbb zero size 2023-12-16T05:56:36.575 INFO:tasks.workunit.client.1.smithi156.stdout:4/366: dwrite d9/f42 [0,4194304] 0 2023-12-16T05:56:36.575 INFO:tasks.workunit.client.1.smithi156.stdout:4/367: chown d9/d2b/d56 895 1 2023-12-16T05:56:36.575 INFO:tasks.workunit.client.1.smithi156.stdout:7/515: rmdir d1e/d1f/d22/d75/d77 39 2023-12-16T05:56:36.575 INFO:tasks.workunit.client.1.smithi156.stdout:5/562: mknod da/dc/d4b/d6c/d77/d8f/cb3 0 2023-12-16T05:56:36.578 INFO:tasks.workunit.client.1.smithi156.stdout:4/368: mknod d9/d2c/c7c 0 2023-12-16T05:56:36.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:36 smithi155 ceph-mon[112451]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2023-12-16T05:56:36.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:36 smithi155 ceph-mon[112451]: Updating smithi156:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T05:56:36.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:36 smithi155 ceph-mon[112451]: Updating smithi155:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T05:56:36.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:36 smithi155 ceph-mon[112451]: pgmap v14: 65 pgs: 65 active+clean; 1.9 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 140 MiB/s rd, 267 MiB/s wr, 562 op/s 2023-12-16T05:56:36.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:36 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:36.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:36 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:36.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:36 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:36.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:36 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:36.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:36 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:36.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:36 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:36.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:36 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:36.582 INFO:tasks.workunit.client.1.smithi156.stdout:7/516: creat d1e/d1f/d22/d75/d77/fb1 x:0 0 0 2023-12-16T05:56:36.582 INFO:tasks.workunit.client.0.smithi155.stdout:2/568: link d0/d5/f9f d0/d7/d57/d63/fbe 0 2023-12-16T05:56:36.584 INFO:tasks.workunit.client.1.smithi156.stdout:5/563: rename da/dc/d2d/d34/l82 to da/dc/d4b/lb4 0 2023-12-16T05:56:36.584 INFO:tasks.workunit.client.1.smithi156.stdout:5/564: write da/dc/d2d/d4d/d54/d90/fab [73117,31082] 0 2023-12-16T05:56:36.585 INFO:tasks.workunit.client.0.smithi155.stdout:9/789: dwrite da/d15/f31 [0,4194304] 0 2023-12-16T05:56:36.585 INFO:tasks.workunit.client.0.smithi155.stdout:2/569: rename d0/d7/d1f/d74/c64 to d0/d34/cbf 0 2023-12-16T05:56:36.585 INFO:tasks.workunit.client.1.smithi156.stdout:4/369: mkdir d9/d43/d58/d7d 0 2023-12-16T05:56:36.586 INFO:tasks.workunit.client.0.smithi155.stdout:9/790: mknod da/d15/d17/d24/d62/d91/dc0/c10e 0 2023-12-16T05:56:36.587 INFO:tasks.workunit.client.1.smithi156.stdout:8/296: dwrite d3/d18/f39 [0,4194304] 0 2023-12-16T05:56:36.587 INFO:tasks.workunit.client.0.smithi155.stdout:9/791: mkdir da/d15/d17/d36/d54/d10f 0 2023-12-16T05:56:36.588 INFO:tasks.workunit.client.1.smithi156.stdout:7/517: creat d1e/fb2 x:0 0 0 2023-12-16T05:56:36.588 INFO:tasks.workunit.client.1.smithi156.stdout:7/518: dread - d1e/d1f/da6/fa0 zero size 2023-12-16T05:56:36.592 INFO:tasks.workunit.client.1.smithi156.stdout:5/565: rename da/dc/d4b/d6c/d81/f63 to da/d46/fb5 0 2023-12-16T05:56:36.595 INFO:tasks.workunit.client.1.smithi156.stdout:4/370: mknod d9/d2c/d48/c7e 0 2023-12-16T05:56:36.599 INFO:tasks.workunit.client.1.smithi156.stdout:5/566: mknod da/dc/d2d/d4d/d54/da6/cb6 0 2023-12-16T05:56:36.599 INFO:tasks.workunit.client.1.smithi156.stdout:5/567: dread - da/dc/d4b/d6c/d7c/d85/fa4 zero size 2023-12-16T05:56:36.600 INFO:tasks.workunit.client.0.smithi155.stdout:2/570: dread d0/d7/d1f/d74/f54 [0,4194304] 0 2023-12-16T05:56:36.600 INFO:tasks.workunit.client.0.smithi155.stdout:2/571: chown d0/d7/d1f/d74/c38 58 1 2023-12-16T05:56:36.600 INFO:tasks.workunit.client.0.smithi155.stdout:2/572: truncate d0/f12 4556877 0 2023-12-16T05:56:36.600 INFO:tasks.workunit.client.0.smithi155.stdout:8/621: dwrite d4/d62/d66/d78/d88/d1b/f7c [0,4194304] 0 2023-12-16T05:56:36.601 INFO:tasks.workunit.client.0.smithi155.stdout:2/573: symlink d0/d7/d57/d95/lc0 0 2023-12-16T05:56:36.601 INFO:tasks.workunit.client.0.smithi155.stdout:2/574: readlink d0/d7/d1f/d74/l56 0 2023-12-16T05:56:36.601 INFO:tasks.workunit.client.0.smithi155.stdout:2/575: chown d0/d5/d6/d5f/f8e 30130244 1 2023-12-16T05:56:36.601 INFO:tasks.workunit.client.0.smithi155.stdout:2/576: dread - d0/d5/d6/d5f/f99 zero size 2023-12-16T05:56:36.602 INFO:tasks.workunit.client.1.smithi156.stdout:5/568: write da/dc/d4b/fb2 [3883077,78479] 0 2023-12-16T05:56:36.602 INFO:tasks.workunit.client.1.smithi156.stdout:5/569: truncate da/dc/d2d/d4d/d54/d90/fab 680091 0 2023-12-16T05:56:36.602 INFO:tasks.workunit.client.1.smithi156.stdout:4/371: unlink d9/d2b/d35/l45 0 2023-12-16T05:56:36.603 INFO:tasks.workunit.client.1.smithi156.stdout:7/519: dread d1e/d1f/da6/f6c [0,4194304] 0 2023-12-16T05:56:36.605 INFO:tasks.workunit.client.0.smithi155.stdout:2/577: write d0/d5/d6/f7c [6861913,119305] 0 2023-12-16T05:56:36.605 INFO:tasks.workunit.client.0.smithi155.stdout:2/578: write d0/d34/f5a [805666,64809] 0 2023-12-16T05:56:36.605 INFO:tasks.workunit.client.1.smithi156.stdout:5/570: creat da/dc/d4b/d6c/d77/fb7 x:0 0 0 2023-12-16T05:56:36.606 INFO:tasks.workunit.client.1.smithi156.stdout:7/520: unlink d1e/d55/d71/d61/c40 0 2023-12-16T05:56:36.608 INFO:tasks.workunit.client.1.smithi156.stdout:5/571: mknod da/dc/d2d/db0/cb8 0 2023-12-16T05:56:36.608 INFO:tasks.workunit.client.1.smithi156.stdout:5/572: chown da/f1e 4893 1 2023-12-16T05:56:36.608 INFO:tasks.workunit.client.1.smithi156.stdout:5/573: dread - da/f3a zero size 2023-12-16T05:56:36.608 INFO:tasks.workunit.client.1.smithi156.stdout:5/574: write da/dc/d2d/f8a [846760,106571] 0 2023-12-16T05:56:36.609 INFO:tasks.workunit.client.0.smithi155.stdout:2/579: mkdir d0/d7/dc1 0 2023-12-16T05:56:36.609 INFO:tasks.workunit.client.0.smithi155.stdout:2/580: fsync d0/f4 0 2023-12-16T05:56:36.609 INFO:tasks.workunit.client.1.smithi156.stdout:2/367: dwrite d9/dd/d17/d33/f40 [0,4194304] 0 2023-12-16T05:56:36.610 INFO:tasks.workunit.client.1.smithi156.stdout:7/521: rename d1e/d55/d71/d61/f38 to d1e/d55/fb3 0 2023-12-16T05:56:36.610 INFO:tasks.workunit.client.0.smithi155.stdout:2/581: rename d0/d7/dd/c2f to d0/d5/cc2 0 2023-12-16T05:56:36.612 INFO:tasks.workunit.client.0.smithi155.stdout:2/582: creat d0/d7/d1f/d74/d85/fc3 x:0 0 0 2023-12-16T05:56:36.613 INFO:tasks.workunit.client.1.smithi156.stdout:5/575: unlink da/dc/f31 0 2023-12-16T05:56:36.613 INFO:tasks.workunit.client.1.smithi156.stdout:5/576: write da/dc/d4b/d6c/d7c/d85/fa4 [945560,16061] 0 2023-12-16T05:56:36.613 INFO:tasks.workunit.client.1.smithi156.stdout:5/577: truncate da/dc/d4b/fb2 5102578 0 2023-12-16T05:56:36.614 INFO:tasks.workunit.client.0.smithi155.stdout:4/597: dwrite d0/da/d36/d5f/d7b/fb4 [0,4194304] 0 2023-12-16T05:56:36.614 INFO:tasks.workunit.client.0.smithi155.stdout:5/727: dwrite d0/d2/fd1 [0,4194304] 0 2023-12-16T05:56:36.614 INFO:tasks.workunit.client.1.smithi156.stdout:8/297: dwrite d3/d12/d16/f2d [8388608,4194304] 0 2023-12-16T05:56:36.615 INFO:tasks.workunit.client.0.smithi155.stdout:9/792: dwrite da/d15/d17/d36/d54/f7f [0,4194304] 0 2023-12-16T05:56:36.615 INFO:tasks.workunit.client.0.smithi155.stdout:9/793: write da/d15/d17/d24/d26/d2e/d83/d8f/d9c/fa4 [409088,32396] 0 2023-12-16T05:56:36.617 INFO:tasks.workunit.client.0.smithi155.stdout:4/598: symlink d0/d10/d46/d16/d30/d52/d88/dab/lc3 0 2023-12-16T05:56:36.617 INFO:tasks.workunit.client.0.smithi155.stdout:4/599: write d0/d10/d46/d16/d30/f7e [624136,125131] 0 2023-12-16T05:56:36.617 INFO:tasks.workunit.client.0.smithi155.stdout:2/583: write d0/f22 [538700,117778] 0 2023-12-16T05:56:36.617 INFO:tasks.workunit.client.0.smithi155.stdout:2/584: chown d0/d7/d1f/d74/l56 24 1 2023-12-16T05:56:36.617 INFO:tasks.workunit.client.0.smithi155.stdout:2/585: stat d0/d7/d57/c8d 0 2023-12-16T05:56:36.617 INFO:tasks.workunit.client.1.smithi156.stdout:2/368: link d9/f44 d9/d68/f6c 0 2023-12-16T05:56:36.619 INFO:tasks.workunit.client.1.smithi156.stdout:7/522: unlink d1e/d1f/da6/fa0 0 2023-12-16T05:56:36.620 INFO:tasks.workunit.client.0.smithi155.stdout:5/728: mkdir d0/d2/d4f/dec 0 2023-12-16T05:56:36.633 INFO:tasks.workunit.client.1.smithi156.stdout:2/369: creat d9/dd/d17/d33/d47/f6d x:0 0 0 2023-12-16T05:56:36.633 INFO:tasks.workunit.client.1.smithi156.stdout:2/370: readlink d9/d12/l4a 0 2023-12-16T05:56:36.633 INFO:tasks.workunit.client.1.smithi156.stdout:2/371: chown d9/d12/f63 86486985 1 2023-12-16T05:56:36.634 INFO:tasks.workunit.client.1.smithi156.stdout:7/523: rmdir d1e/d1f/d74 39 2023-12-16T05:56:36.635 INFO:tasks.workunit.client.0.smithi155.stdout:9/794: creat da/d15/d17/d24/d62/d91/f110 x:0 0 0 2023-12-16T05:56:36.635 INFO:tasks.workunit.client.1.smithi156.stdout:2/372: chown d9/dd/d17/d33/d38/d39/c55 916322 1 2023-12-16T05:56:36.635 INFO:tasks.workunit.client.0.smithi155.stdout:8/622: truncate d4/d62/d66/d78/d88/d1b/f7c 502936 0 2023-12-16T05:56:36.636 INFO:tasks.workunit.client.1.smithi156.stdout:7/524: mkdir d1e/d55/d71/d61/daa/db4 0 2023-12-16T05:56:36.637 INFO:tasks.workunit.client.1.smithi156.stdout:7/525: write f7 [133530,68761] 0 2023-12-16T05:56:36.638 INFO:tasks.workunit.client.1.smithi156.stdout:2/373: rmdir d9/d12/d3d/d65 0 2023-12-16T05:56:36.638 INFO:tasks.workunit.client.0.smithi155.stdout:4/600: creat d0/d10/d46/d16/d30/d52/d88/d9e/fc4 x:0 0 0 2023-12-16T05:56:36.639 INFO:tasks.workunit.client.0.smithi155.stdout:5/729: truncate d0/f32 199542 0 2023-12-16T05:56:36.640 INFO:tasks.workunit.client.1.smithi156.stdout:7/526: mknod d1e/d1f/da6/d57/d59/cb5 0 2023-12-16T05:56:36.641 INFO:tasks.workunit.client.1.smithi156.stdout:2/374: creat d9/dd/d17/d33/d47/f6e x:0 0 0 2023-12-16T05:56:36.642 INFO:tasks.workunit.client.0.smithi155.stdout:9/795: mknod da/d15/d17/d36/d54/d76/c111 0 2023-12-16T05:56:36.642 INFO:tasks.workunit.client.1.smithi156.stdout:7/527: getdents d1e/d1f/d22/d75/d77 0 2023-12-16T05:56:36.643 INFO:tasks.workunit.client.0.smithi155.stdout:8/623: creat d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/fcd x:0 0 0 2023-12-16T05:56:36.643 INFO:tasks.workunit.client.0.smithi155.stdout:8/624: read d4/d62/d66/d78/d88/d1b/d1c/d1a/f3a [120118,26522] 0 2023-12-16T05:56:36.644 INFO:tasks.workunit.client.0.smithi155.stdout:2/586: dwrite d0/d7/d57/fa7 [0,4194304] 0 2023-12-16T05:56:36.645 INFO:tasks.workunit.client.1.smithi156.stdout:2/375: getdents d9/dd 0 2023-12-16T05:56:36.645 INFO:tasks.workunit.client.1.smithi156.stdout:2/376: stat d9/d12/f36 0 2023-12-16T05:56:36.646 INFO:tasks.workunit.client.1.smithi156.stdout:5/578: dwrite da/dc/d2d/f8a [0,4194304] 0 2023-12-16T05:56:36.646 INFO:tasks.workunit.client.0.smithi155.stdout:8/625: dread d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/f60 [0,4194304] 0 2023-12-16T05:56:36.647 INFO:tasks.workunit.client.0.smithi155.stdout:8/626: write d4/d62/d66/d78/d88/d1b/d1c/d97/d29/f9c [2452535,4695] 0 2023-12-16T05:56:36.647 INFO:tasks.workunit.client.0.smithi155.stdout:5/730: rmdir d0/d60 39 2023-12-16T05:56:36.649 INFO:tasks.workunit.client.1.smithi156.stdout:7/528: dread d1e/d1f/da6/f45 [0,4194304] 0 2023-12-16T05:56:36.649 INFO:tasks.workunit.client.1.smithi156.stdout:7/529: stat d1e/d39 0 2023-12-16T05:56:36.649 INFO:tasks.workunit.client.1.smithi156.stdout:7/530: truncate d1e/d1f/d22/f25 4998689 0 2023-12-16T05:56:36.649 INFO:tasks.workunit.client.1.smithi156.stdout:7/531: chown d1e/d55/d71/c51 48422 1 2023-12-16T05:56:36.650 INFO:tasks.workunit.client.0.smithi155.stdout:2/587: mkdir d0/d7/d57/daf/dc4 0 2023-12-16T05:56:36.650 INFO:tasks.workunit.client.1.smithi156.stdout:7/532: mkdir d1e/d55/db6 0 2023-12-16T05:56:36.654 INFO:tasks.workunit.client.0.smithi155.stdout:8/627: link d4/d62/d66/d78/d88/d1b/d1c/d1a/f3a d4/d62/d66/d78/d88/d1b/d1c/d97/fce 0 2023-12-16T05:56:36.654 INFO:tasks.workunit.client.0.smithi155.stdout:8/628: truncate d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/fb3 1599776 0 2023-12-16T05:56:36.655 INFO:tasks.workunit.client.1.smithi156.stdout:7/533: mknod d1e/daf/cb7 0 2023-12-16T05:56:36.656 INFO:tasks.workunit.client.0.smithi155.stdout:5/731: creat d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/dc9/fed x:0 0 0 2023-12-16T05:56:36.657 INFO:tasks.workunit.client.0.smithi155.stdout:9/796: truncate da/d15/f31 3565888 0 2023-12-16T05:56:36.657 INFO:tasks.workunit.client.1.smithi156.stdout:7/534: link d1e/d55/d71/l9d d1e/d1f/d22/lb8 0 2023-12-16T05:56:36.657 INFO:tasks.workunit.client.1.smithi156.stdout:7/535: fsync d1e/d55/d71/d61/fa3 0 2023-12-16T05:56:36.657 INFO:tasks.workunit.client.1.smithi156.stdout:7/536: stat d1e/d55/d71/f49 0 2023-12-16T05:56:36.658 INFO:tasks.workunit.client.0.smithi155.stdout:2/588: truncate d0/f2 3669946 0 2023-12-16T05:56:36.658 INFO:tasks.workunit.client.1.smithi156.stdout:7/537: mknod d1e/d1f/d22/d75/cb9 0 2023-12-16T05:56:36.659 INFO:tasks.workunit.client.1.smithi156.stdout:7/538: mkdir d1e/d55/dba 0 2023-12-16T05:56:36.662 INFO:tasks.workunit.client.1.smithi156.stdout:5/579: dwrite da/dc/d2d/f43 [0,4194304] 0 2023-12-16T05:56:36.662 INFO:tasks.workunit.client.1.smithi156.stdout:2/377: rmdir d9/d12 39 2023-12-16T05:56:36.663 INFO:tasks.workunit.client.1.smithi156.stdout:7/539: write d1e/d55/d71/d61/daa/f99 [1570400,128850] 0 2023-12-16T05:56:36.664 INFO:tasks.workunit.client.0.smithi155.stdout:8/629: mknod d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/db7/ccf 0 2023-12-16T05:56:36.664 INFO:tasks.workunit.client.0.smithi155.stdout:8/630: stat d4/d62/d66/d78/d88/d1b/d1c/d1a/f3a 0 2023-12-16T05:56:36.665 INFO:tasks.workunit.client.0.smithi155.stdout:9/797: truncate da/d15/d17/d36/d5b/f6d 427359 0 2023-12-16T05:56:36.665 INFO:tasks.workunit.client.0.smithi155.stdout:1/721: sync 2023-12-16T05:56:36.667 INFO:tasks.workunit.client.1.smithi156.stdout:2/378: creat d9/d5a/f6f x:0 0 0 2023-12-16T05:56:36.669 INFO:tasks.workunit.client.0.smithi155.stdout:2/589: symlink d0/d7/d57/d95/lc5 0 2023-12-16T05:56:36.669 INFO:tasks.workunit.client.0.smithi155.stdout:6/881: sync 2023-12-16T05:56:36.669 INFO:tasks.workunit.client.0.smithi155.stdout:8/631: mkdir d4/d62/d66/d78/d88/d1b/d1c/d19/dd0 0 2023-12-16T05:56:36.670 INFO:tasks.workunit.client.1.smithi156.stdout:9/326: sync 2023-12-16T05:56:36.670 INFO:tasks.workunit.client.1.smithi156.stdout:9/327: dread - d6/d19/f29 zero size 2023-12-16T05:56:36.671 INFO:tasks.workunit.client.0.smithi155.stdout:4/601: rmdir d0/d10/d46/d16 39 2023-12-16T05:56:36.672 INFO:tasks.workunit.client.1.smithi156.stdout:7/540: mkdir d1e/d1f/da6/d57/dbb 0 2023-12-16T05:56:36.673 INFO:tasks.workunit.client.0.smithi155.stdout:5/732: dwrite d0/d2/d2a/d19/d21/f6a [4194304,4194304] 0 2023-12-16T05:56:36.677 INFO:tasks.workunit.client.0.smithi155.stdout:6/882: rename d0/df/d5e/d7e/db6/dc6 to d0/df/d5e/d7e/dd8/d12b 0 2023-12-16T05:56:36.681 INFO:tasks.workunit.client.0.smithi155.stdout:6/883: truncate d0/df/d5e/d7e/dd8/d12b/d103/de5/ff3 2370496 0 2023-12-16T05:56:36.681 INFO:tasks.workunit.client.0.smithi155.stdout:5/733: truncate d0/d2/f1a 2467841 0 2023-12-16T05:56:36.682 INFO:tasks.workunit.client.1.smithi156.stdout:9/328: creat d6/d19/d25/d3a/d57/f70 x:0 0 0 2023-12-16T05:56:36.683 INFO:tasks.workunit.client.1.smithi156.stdout:7/541: mknod d1e/d55/db6/cbc 0 2023-12-16T05:56:36.683 INFO:tasks.workunit.client.0.smithi155.stdout:6/884: rmdir d0/d3/d2c/d8b/d85 39 2023-12-16T05:56:36.683 INFO:tasks.workunit.client.0.smithi155.stdout:6/885: write d0/d3/d2c/d8b/f11d [947153,19147] 0 2023-12-16T05:56:36.686 INFO:tasks.workunit.client.0.smithi155.stdout:6/886: creat d0/df/d5e/d7e/dd8/d12b/d103/f12c x:0 0 0 2023-12-16T05:56:36.686 INFO:tasks.workunit.client.0.smithi155.stdout:6/887: readlink d0/d3/d2c/db8/lbb 0 2023-12-16T05:56:36.689 INFO:tasks.workunit.client.1.smithi156.stdout:7/542: rename d1e/d55/d71/f9b to d1e/d55/dba/fbd 0 2023-12-16T05:56:36.695 INFO:tasks.workunit.client.1.smithi156.stdout:7/543: rename d1e/d55/d71/d61/c83 to d1e/d1f/da6/d57/d59/cbe 0 2023-12-16T05:56:36.695 INFO:tasks.workunit.client.1.smithi156.stdout:7/544: write d1e/fb2 [876033,76916] 0 2023-12-16T05:56:36.696 INFO:tasks.workunit.client.1.smithi156.stdout:9/329: symlink d6/d19/l71 0 2023-12-16T05:56:36.697 INFO:tasks.workunit.client.1.smithi156.stdout:9/330: mkdir d6/d19/d25/d72 0 2023-12-16T05:56:36.698 INFO:tasks.workunit.client.1.smithi156.stdout:9/331: link d6/d19/c4b d6/d19/c73 0 2023-12-16T05:56:36.702 INFO:tasks.workunit.client.0.smithi155.stdout:2/590: dwrite d0/d7/f5e [0,4194304] 0 2023-12-16T05:56:36.703 INFO:tasks.workunit.client.0.smithi155.stdout:9/798: dwrite da/d15/d17/d36/d5b/d98/fe8 [0,4194304] 0 2023-12-16T05:56:36.703 INFO:tasks.workunit.client.0.smithi155.stdout:9/799: fdatasync da/f80 0 2023-12-16T05:56:36.703 INFO:tasks.workunit.client.0.smithi155.stdout:9/800: chown da/d15/d17/d36/d5b/d60/d9e/fb5 2158258 1 2023-12-16T05:56:36.704 INFO:tasks.workunit.client.1.smithi156.stdout:5/580: dwrite da/dc/d4b/d6c/f7a [0,4194304] 0 2023-12-16T05:56:36.704 INFO:tasks.workunit.client.1.smithi156.stdout:5/581: write da/dc/f9f [372083,47691] 0 2023-12-16T05:56:36.705 INFO:tasks.workunit.client.1.smithi156.stdout:5/582: mkdir da/dc/d2d/d4d/db9 0 2023-12-16T05:56:36.707 INFO:tasks.workunit.client.1.smithi156.stdout:5/583: unlink da/dc/l1b 0 2023-12-16T05:56:36.711 INFO:tasks.workunit.client.0.smithi155.stdout:4/602: dread d0/d10/d46/d16/d1a/f2b [0,4194304] 0 2023-12-16T05:56:36.712 INFO:tasks.workunit.client.1.smithi156.stdout:7/545: dread d1e/d55/d71/d61/daa/f35 [0,4194304] 0 2023-12-16T05:56:36.712 INFO:tasks.workunit.client.1.smithi156.stdout:7/546: chown d1e/d55/d71/d61 1857861 1 2023-12-16T05:56:36.712 INFO:tasks.workunit.client.1.smithi156.stdout:2/379: dwrite d9/dd/f5d [0,4194304] 0 2023-12-16T05:56:36.713 INFO:tasks.workunit.client.0.smithi155.stdout:9/801: rename da/d15/d17/d36/d5b/d60/db9/de4/cf5 to da/d15/d17/d24/d26/c112 0 2023-12-16T05:56:36.713 INFO:tasks.workunit.client.1.smithi156.stdout:7/547: read d1e/d1f/d22/f79 [1730671,96550] 0 2023-12-16T05:56:36.714 INFO:tasks.workunit.client.0.smithi155.stdout:8/632: dwrite d4/d62/d66/d78/d88/d1b/d1c/d19/d64/f6c [0,4194304] 0 2023-12-16T05:56:36.718 INFO:tasks.workunit.client.1.smithi156.stdout:2/380: link d9/d12/f58 d9/dd/d17/d33/d38/f70 0 2023-12-16T05:56:36.718 INFO:tasks.workunit.client.1.smithi156.stdout:7/548: mkdir d1e/dbf 0 2023-12-16T05:56:36.718 INFO:tasks.workunit.client.1.smithi156.stdout:7/549: write d1e/d1f/d22/f23 [4668414,86206] 0 2023-12-16T05:56:36.719 INFO:tasks.workunit.client.0.smithi155.stdout:4/603: creat d0/d10/d46/d16/d30/fc5 x:0 0 0 2023-12-16T05:56:36.719 INFO:tasks.workunit.client.0.smithi155.stdout:4/604: stat d0/f1d 0 2023-12-16T05:56:36.720 INFO:tasks.workunit.client.0.smithi155.stdout:1/722: dwrite d1/d7/d16/d30/f6e [0,4194304] 0 2023-12-16T05:56:36.720 INFO:tasks.workunit.client.0.smithi155.stdout:9/802: rename da/d15/d17/d36/d54/fbd to da/d15/d17/d36/d5b/d98/dc2/f113 0 2023-12-16T05:56:36.725 INFO:tasks.workunit.client.0.smithi155.stdout:1/723: unlink d1/d7/c6f 0 2023-12-16T05:56:36.725 INFO:tasks.workunit.client.0.smithi155.stdout:1/724: chown d1/d7/d4b/d8e/dc7/d28/fdf 622759 1 2023-12-16T05:56:36.725 INFO:tasks.workunit.client.1.smithi156.stdout:5/584: dwrite da/dc/d2d/d4d/d54/d90/fab [0,4194304] 0 2023-12-16T05:56:36.727 INFO:tasks.workunit.client.0.smithi155.stdout:1/725: rename d1/d25/ccd to d1/d25/d43/d5d/ce2 0 2023-12-16T05:56:36.727 INFO:tasks.workunit.client.0.smithi155.stdout:1/726: fsync d1/d7/d16/d30/f76 0 2023-12-16T05:56:36.729 INFO:tasks.workunit.client.0.smithi155.stdout:1/727: rmdir d1/d92 39 2023-12-16T05:56:36.730 INFO:tasks.workunit.client.0.smithi155.stdout:9/803: write da/d15/d17/f41 [2612470,30736] 0 2023-12-16T05:56:36.731 INFO:tasks.workunit.client.0.smithi155.stdout:1/728: mkdir d1/d7/d4b/de3 0 2023-12-16T05:56:36.731 INFO:tasks.workunit.client.0.smithi155.stdout:1/729: fsync d1/d7/f75 0 2023-12-16T05:56:36.731 INFO:tasks.workunit.client.0.smithi155.stdout:1/730: read - d1/d7/d4b/d8e/dc7/d28/d8f/f96 zero size 2023-12-16T05:56:36.732 INFO:tasks.workunit.client.0.smithi155.stdout:8/633: dread d4/f41 [0,4194304] 0 2023-12-16T05:56:36.732 INFO:tasks.workunit.client.0.smithi155.stdout:9/804: creat da/d15/d17/d24/d26/d2e/d83/d8f/df2/f114 x:0 0 0 2023-12-16T05:56:36.732 INFO:tasks.workunit.client.0.smithi155.stdout:9/805: chown da/f5a 4085979 1 2023-12-16T05:56:36.732 INFO:tasks.workunit.client.0.smithi155.stdout:2/591: dwrite d0/d7/dd/f6e [0,4194304] 0 2023-12-16T05:56:36.733 INFO:tasks.workunit.client.0.smithi155.stdout:2/592: dread - d0/d7/d1f/f97 zero size 2023-12-16T05:56:36.733 INFO:tasks.workunit.client.0.smithi155.stdout:9/806: getdents da/d15/d17/d24/d62/d91 0 2023-12-16T05:56:36.735 INFO:tasks.workunit.client.0.smithi155.stdout:8/634: write d4/d62/d66/d78/f82 [2935246,7607] 0 2023-12-16T05:56:36.735 INFO:tasks.workunit.client.0.smithi155.stdout:8/635: fsync d4/d62/d66/d78/d88/d1b/d1c/d19/fca 0 2023-12-16T05:56:36.735 INFO:tasks.workunit.client.0.smithi155.stdout:1/731: mkdir d1/d7/d16/de4 0 2023-12-16T05:56:36.736 INFO:tasks.workunit.client.1.smithi156.stdout:9/332: dwrite d6/ff [0,4194304] 0 2023-12-16T05:56:36.736 INFO:tasks.workunit.client.1.smithi156.stdout:9/333: chown d6/d19/d30/d5b 4 1 2023-12-16T05:56:36.737 INFO:tasks.workunit.client.0.smithi155.stdout:2/593: unlink d0/d7/d69/f1b 0 2023-12-16T05:56:36.737 INFO:tasks.workunit.client.1.smithi156.stdout:9/334: read d6/d19/f1a [2939440,43052] 0 2023-12-16T05:56:36.737 INFO:tasks.workunit.client.0.smithi155.stdout:8/636: creat d4/d62/d66/d78/d88/d1b/d1c/d1a/fd1 x:0 0 0 2023-12-16T05:56:36.738 INFO:tasks.workunit.client.0.smithi155.stdout:2/594: getdents d0/d5/d6 0 2023-12-16T05:56:36.739 INFO:tasks.workunit.client.0.smithi155.stdout:8/637: creat d4/fd2 x:0 0 0 2023-12-16T05:56:36.740 INFO:tasks.workunit.client.0.smithi155.stdout:1/732: mkdir d1/d7/d16/de5 0 2023-12-16T05:56:36.742 INFO:tasks.workunit.client.0.smithi155.stdout:8/638: getdents d4/d62/d66/d78/d88/d1b/d2a/d51 0 2023-12-16T05:56:36.742 INFO:tasks.workunit.client.0.smithi155.stdout:8/639: write d4/d62/d66/d78/d88/d1b/f7c [1322817,53293] 0 2023-12-16T05:56:36.742 INFO:tasks.workunit.client.0.smithi155.stdout:8/640: stat d4/d62/d66/d78/d88/d1b/d1c/d19/dd0 0 2023-12-16T05:56:36.742 INFO:tasks.workunit.client.0.smithi155.stdout:8/641: write d4/ff [1682923,128487] 0 2023-12-16T05:56:36.742 INFO:tasks.workunit.client.0.smithi155.stdout:1/733: stat d1/d7/c13 0 2023-12-16T05:56:36.744 INFO:tasks.workunit.client.0.smithi155.stdout:8/642: mkdir d4/dd3 0 2023-12-16T05:56:36.745 INFO:tasks.workunit.client.0.smithi155.stdout:8/643: symlink d4/d62/d66/d78/d88/d1b/d1c/d46/ld4 0 2023-12-16T05:56:36.745 INFO:tasks.workunit.client.0.smithi155.stdout:8/644: mknod d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/db7/cd5 0 2023-12-16T05:56:36.746 INFO:tasks.workunit.client.0.smithi155.stdout:8/645: truncate d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/f63 842776 0 2023-12-16T05:56:36.754 INFO:tasks.workunit.client.0.smithi155.stdout:1/734: dread d1/d7/d4b/d5c/f88 [0,4194304] 0 2023-12-16T05:56:36.755 INFO:tasks.workunit.client.0.smithi155.stdout:1/735: fdatasync d1/d7/d4b/d8e/dc7/d28/d8f/dad/fb1 0 2023-12-16T05:56:36.755 INFO:tasks.workunit.client.0.smithi155.stdout:1/736: mknod d1/d69/ce6 0 2023-12-16T05:56:36.757 INFO:tasks.workunit.client.1.smithi156.stdout:7/550: read d1e/d55/d71/d61/daa/f99 [325653,63217] 0 2023-12-16T05:56:36.757 INFO:tasks.workunit.client.0.smithi155.stdout:1/737: unlink d1/d7/d4b/d5c/l9a 0 2023-12-16T05:56:36.757 INFO:tasks.workunit.client.0.smithi155.stdout:1/738: write d1/d7/d4b/d5c/fd2 [1665647,9077] 0 2023-12-16T05:56:36.758 INFO:tasks.workunit.client.0.smithi155.stdout:4/605: dread d0/d10/f2c [0,4194304] 0 2023-12-16T05:56:36.760 INFO:tasks.workunit.client.0.smithi155.stdout:9/807: dwrite da/d15/d17/d24/d26/d2e/d83/d8f/d9c/fa4 [0,4194304] 0 2023-12-16T05:56:36.760 INFO:tasks.workunit.client.0.smithi155.stdout:9/808: stat da/d15/d17/d24/d26/f29 0 2023-12-16T05:56:36.760 INFO:tasks.workunit.client.0.smithi155.stdout:1/739: symlink d1/d7/d4b/d8e/dc7/d28/d8f/le7 0 2023-12-16T05:56:36.766 INFO:tasks.workunit.client.0.smithi155.stdout:9/809: unlink da/d15/d17/d24/d26/f44 0 2023-12-16T05:56:36.771 INFO:tasks.workunit.client.0.smithi155.stdout:8/646: dread d4/d62/d66/d78/d88/d1b/d1c/d97/f59 [0,4194304] 0 2023-12-16T05:56:36.772 INFO:tasks.workunit.client.0.smithi155.stdout:8/647: dread - d4/d62/fbf zero size 2023-12-16T05:56:36.772 INFO:tasks.workunit.client.0.smithi155.stdout:8/648: dread - d4/d62/d66/d78/d88/d1b/d1c/d1a/fd1 zero size 2023-12-16T05:56:36.773 INFO:tasks.workunit.client.0.smithi155.stdout:8/649: symlink d4/d62/d66/d78/ld6 0 2023-12-16T05:56:36.776 INFO:tasks.workunit.client.0.smithi155.stdout:8/650: dread d4/d62/d66/d78/d88/d1b/d1c/d46/f8f [0,4194304] 0 2023-12-16T05:56:36.779 INFO:tasks.workunit.client.0.smithi155.stdout:9/810: dread da/f80 [0,4194304] 0 2023-12-16T05:56:36.780 INFO:tasks.workunit.client.0.smithi155.stdout:9/811: write da/d15/d17/fd8 [201310,107452] 0 2023-12-16T05:56:36.782 INFO:tasks.workunit.client.0.smithi155.stdout:9/812: unlink da/d15/d17/d24/d26/d2e/l81 0 2023-12-16T05:56:36.782 INFO:tasks.workunit.client.0.smithi155.stdout:9/813: chown da/d15/d17/d24/d26/d2e/d32/fe2 3324 1 2023-12-16T05:56:36.782 INFO:tasks.workunit.client.0.smithi155.stdout:9/814: write da/d15/d17/d24/d26/d2e/d83/d8f/df2/f114 [363370,124814] 0 2023-12-16T05:56:36.782 INFO:tasks.workunit.client.0.smithi155.stdout:9/815: write da/d15/d17/d36/d5b/d98/dc2/f113 [408572,92740] 0 2023-12-16T05:56:36.783 INFO:tasks.workunit.client.0.smithi155.stdout:8/651: write d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/fa9 [3990479,102222] 0 2023-12-16T05:56:36.783 INFO:tasks.workunit.client.0.smithi155.stdout:8/652: dread - d4/d62/d66/d78/d88/d1b/d5f/fc8 zero size 2023-12-16T05:56:36.783 INFO:tasks.workunit.client.0.smithi155.stdout:8/653: write d4/d62/d66/d78/d88/d1b/f20 [5366268,98766] 0 2023-12-16T05:56:36.783 INFO:tasks.workunit.client.0.smithi155.stdout:8/654: readlink d4/d62/d66/d78/d88/d1b/d1c/l96 0 2023-12-16T05:56:36.783 INFO:tasks.workunit.client.0.smithi155.stdout:9/816: mknod da/c115 0 2023-12-16T05:56:36.785 INFO:tasks.workunit.client.0.smithi155.stdout:8/655: link d4/d62/d66/d78/d88/d12/f6b d4/d62/d66/d78/d88/d1b/d1c/d97/fd7 0 2023-12-16T05:56:36.785 INFO:tasks.workunit.client.0.smithi155.stdout:8/656: chown d4/d62/d66/d78/d88/d1b/d1c/d19/da3 24696 1 2023-12-16T05:56:36.785 INFO:tasks.workunit.client.0.smithi155.stdout:8/657: write d4/d62/d66/d78/d88/d1b/d1c/d46/f8f [283573,48614] 0 2023-12-16T05:56:36.785 INFO:tasks.workunit.client.0.smithi155.stdout:8/658: fdatasync d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/fb3 0 2023-12-16T05:56:36.786 INFO:tasks.workunit.client.0.smithi155.stdout:9/817: symlink da/d10b/l116 0 2023-12-16T05:56:36.786 INFO:tasks.workunit.client.0.smithi155.stdout:9/818: write da/d15/d17/d36/d5b/fa6 [884274,24756] 0 2023-12-16T05:56:36.786 INFO:tasks.workunit.client.0.smithi155.stdout:9/819: write da/f80 [4636189,124217] 0 2023-12-16T05:56:36.790 INFO:tasks.workunit.client.0.smithi155.stdout:9/820: dread da/d15/d17/d24/d26/fd5 [0,4194304] 0 2023-12-16T05:56:36.791 INFO:tasks.workunit.client.0.smithi155.stdout:9/821: getdents da/d15/d17/d24/d26/d2e/d83/d8f 0 2023-12-16T05:56:36.797 INFO:tasks.workunit.client.0.smithi155.stdout:4/606: dwrite d0/da/d36/d5f/d75/f23 [0,4194304] 0 2023-12-16T05:56:36.797 INFO:tasks.workunit.client.0.smithi155.stdout:4/607: write d0/d10/d46/d16/d30/d52/d88/f94 [729944,57640] 0 2023-12-16T05:56:36.797 INFO:tasks.workunit.client.0.smithi155.stdout:4/608: rmdir d0/d10/d46/d16/d30/d52/d88/dab 39 2023-12-16T05:56:36.798 INFO:tasks.workunit.client.0.smithi155.stdout:4/609: truncate d0/da/d36/d5f/d75/d89/f8a 1092519 0 2023-12-16T05:56:36.799 INFO:tasks.workunit.client.0.smithi155.stdout:1/740: dwrite d1/d25/d43/d5d/d5e/fbd [0,4194304] 0 2023-12-16T05:56:36.799 INFO:tasks.workunit.client.0.smithi155.stdout:1/741: readlink d1/d7/d4b/d8e/dc7/d28/d85/de0/d79/daa/lce 0 2023-12-16T05:56:36.799 INFO:tasks.workunit.client.0.smithi155.stdout:4/610: link d0/da/l31 d0/d10/d46/lc6 0 2023-12-16T05:56:36.799 INFO:tasks.workunit.client.1.smithi156.stdout:2/381: dwrite d9/d68/f6c [0,4194304] 0 2023-12-16T05:56:36.799 INFO:tasks.workunit.client.1.smithi156.stdout:9/335: dwrite d6/d19/d25/d3a/f60 [0,4194304] 0 2023-12-16T05:56:36.800 INFO:tasks.workunit.client.1.smithi156.stdout:9/336: fsync d6/f51 0 2023-12-16T05:56:36.800 INFO:tasks.workunit.client.1.smithi156.stdout:7/551: dwrite f9 [0,4194304] 0 2023-12-16T05:56:36.800 INFO:tasks.workunit.client.0.smithi155.stdout:2/595: dwrite d0/d7/dd/d49/fb3 [0,4194304] 0 2023-12-16T05:56:36.800 INFO:tasks.workunit.client.0.smithi155.stdout:2/596: chown d0/d7/dd/d14/fa6 458028 1 2023-12-16T05:56:36.803 INFO:tasks.workunit.client.1.smithi156.stdout:9/337: mknod d6/d19/d25/c74 0 2023-12-16T05:56:36.803 INFO:tasks.workunit.client.1.smithi156.stdout:9/338: chown d6/d19 2235551 1 2023-12-16T05:56:36.803 INFO:tasks.workunit.client.0.smithi155.stdout:1/742: creat d1/d7/d4b/fe8 x:0 0 0 2023-12-16T05:56:36.804 INFO:tasks.workunit.client.0.smithi155.stdout:4/611: creat d0/da/d36/d5f/d75/d3d/d85/fc7 x:0 0 0 2023-12-16T05:56:36.807 INFO:tasks.workunit.client.1.smithi156.stdout:9/339: write d6/f13 [1512531,88980] 0 2023-12-16T05:56:36.807 INFO:tasks.workunit.client.1.smithi156.stdout:9/340: truncate d6/d19/f1f 917398 0 2023-12-16T05:56:36.810 INFO:tasks.workunit.client.1.smithi156.stdout:9/341: creat d6/d19/d30/d48/f75 x:0 0 0 2023-12-16T05:56:36.811 INFO:tasks.workunit.client.0.smithi155.stdout:8/659: dread d4/d62/d66/d78/f82 [0,4194304] 0 2023-12-16T05:56:36.812 INFO:tasks.workunit.client.1.smithi156.stdout:9/342: link d6/d19/d25/d3a/l5d d6/d2e/l76 0 2023-12-16T05:56:36.813 INFO:tasks.workunit.client.1.smithi156.stdout:7/552: dread d1e/d1f/f3a [0,4194304] 0 2023-12-16T05:56:36.814 INFO:tasks.workunit.client.1.smithi156.stdout:7/553: mknod d1e/d1f/d74/cc0 0 2023-12-16T05:56:36.815 INFO:tasks.workunit.client.1.smithi156.stdout:7/554: rmdir d1e/d1f/d22/d75/d77 39 2023-12-16T05:56:36.816 INFO:tasks.workunit.client.1.smithi156.stdout:2/382: dwrite d9/dd/d17/d33/d47/f6e [0,4194304] 0 2023-12-16T05:56:36.817 INFO:tasks.workunit.client.0.smithi155.stdout:8/660: dread d4/d62/d66/d78/d88/d1b/f7c [0,4194304] 0 2023-12-16T05:56:36.819 INFO:tasks.workunit.client.1.smithi156.stdout:2/383: mknod d9/d68/c71 0 2023-12-16T05:56:36.820 INFO:tasks.workunit.client.1.smithi156.stdout:2/384: fsync d9/dd/d17/f51 0 2023-12-16T05:56:36.820 INFO:tasks.workunit.client.0.smithi155.stdout:4/612: dread d0/da/d36/d5f/d75/d3d/d49/f61 [0,4194304] 0 2023-12-16T05:56:36.821 INFO:tasks.workunit.client.1.smithi156.stdout:2/385: creat d9/d12/f72 x:0 0 0 2023-12-16T05:56:36.821 INFO:tasks.workunit.client.0.smithi155.stdout:2/597: dwrite d0/d5/d6/f2e [0,4194304] 0 2023-12-16T05:56:36.824 INFO:tasks.workunit.client.1.smithi156.stdout:7/555: dread d1e/d1f/da6/f4d [0,4194304] 0 2023-12-16T05:56:36.826 INFO:tasks.workunit.client.0.smithi155.stdout:8/661: link d4/d62/d66/d78/d88/d1b/d1c/d46/fa5 d4/d62/d66/d78/d88/d1b/d1c/d1a/fd8 0 2023-12-16T05:56:36.827 INFO:tasks.workunit.client.1.smithi156.stdout:7/556: link d1e/d1f/da6/d57/l98 d1e/d55/dba/lc1 0 2023-12-16T05:56:36.828 INFO:tasks.workunit.client.1.smithi156.stdout:7/557: write d1e/d55/d71/d61/dac/fb0 [577316,9989] 0 2023-12-16T05:56:36.828 INFO:tasks.workunit.client.1.smithi156.stdout:7/558: getdents d1e/d1f/d72/da4 0 2023-12-16T05:56:36.828 INFO:tasks.workunit.client.1.smithi156.stdout:7/559: write d1e/d1f/da6/d57/f92 [1711330,56750] 0 2023-12-16T05:56:36.828 INFO:tasks.workunit.client.0.smithi155.stdout:4/613: creat d0/da/d36/d5f/d75/d3d/d49/dbb/fc8 x:0 0 0 2023-12-16T05:56:36.829 INFO:tasks.workunit.client.1.smithi156.stdout:7/560: creat d1e/d55/d71/d61/daa/db4/fc2 x:0 0 0 2023-12-16T05:56:36.829 INFO:tasks.workunit.client.1.smithi156.stdout:7/561: write d1e/d55/d71/d61/fa3 [181333,115850] 0 2023-12-16T05:56:36.830 INFO:tasks.workunit.client.0.smithi155.stdout:2/598: link d0/d7/dd/d49/d4b/d80/l76 d0/d7/d1f/d74/d85/lc6 0 2023-12-16T05:56:36.832 INFO:tasks.workunit.client.0.smithi155.stdout:1/743: rename d1/d7/d16/c3c to d1/d7/d16/de5/ce9 0 2023-12-16T05:56:36.832 INFO:tasks.workunit.client.0.smithi155.stdout:1/744: write d1/d7/d4b/d8e/fd3 [464906,104114] 0 2023-12-16T05:56:36.833 INFO:tasks.workunit.client.1.smithi156.stdout:7/562: getdents d1e/d55/dba 0 2023-12-16T05:56:36.833 INFO:tasks.workunit.client.1.smithi156.stdout:7/563: fdatasync d1e/d1f/f3a 0 2023-12-16T05:56:36.834 INFO:tasks.workunit.client.1.smithi156.stdout:7/564: creat d1e/d55/d71/fc3 x:0 0 0 2023-12-16T05:56:36.834 INFO:tasks.workunit.client.1.smithi156.stdout:7/565: getdents d1e/d55/d71/d94 0 2023-12-16T05:56:36.835 INFO:tasks.workunit.client.1.smithi156.stdout:7/566: mknod d1e/dbf/cc4 0 2023-12-16T05:56:36.835 INFO:tasks.workunit.client.1.smithi156.stdout:7/567: fsync d1e/d55/fb3 0 2023-12-16T05:56:36.835 INFO:tasks.workunit.client.1.smithi156.stdout:9/343: dwrite d6/d19/d25/d3a/f43 [0,4194304] 0 2023-12-16T05:56:36.836 INFO:tasks.workunit.client.0.smithi155.stdout:4/614: creat d0/da/d36/d5f/d75/d89/fc9 x:0 0 0 2023-12-16T05:56:36.837 INFO:tasks.workunit.client.1.smithi156.stdout:9/344: creat d6/d19/d25/f77 x:0 0 0 2023-12-16T05:56:36.840 INFO:tasks.workunit.client.0.smithi155.stdout:2/599: dread d0/d7/d1f/d74/f46 [0,4194304] 0 2023-12-16T05:56:36.840 INFO:tasks.workunit.client.0.smithi155.stdout:2/600: read - d0/d7/dd/d49/d4b/d80/f9c zero size 2023-12-16T05:56:36.840 INFO:tasks.workunit.client.0.smithi155.stdout:2/601: fsync d0/d7/d1f/d74/d3a/f84 0 2023-12-16T05:56:36.841 INFO:tasks.workunit.client.0.smithi155.stdout:8/662: rename d4/d62/d66/d78/d88/d1b/d1c/l67 to d4/d62/d66/d78/d88/d1b/d1c/d19/d64/ld9 0 2023-12-16T05:56:36.843 INFO:tasks.workunit.client.0.smithi155.stdout:4/615: rmdir d0/d10/d46/d16/d7d 39 2023-12-16T05:56:36.843 INFO:tasks.workunit.client.0.smithi155.stdout:4/616: fdatasync d0/da/d36/d5f/fae 0 2023-12-16T05:56:36.843 INFO:tasks.workunit.client.0.smithi155.stdout:4/617: chown d0/d10/d46/d16/d30/d52/d88/c78 43 1 2023-12-16T05:56:36.845 INFO:tasks.workunit.client.0.smithi155.stdout:2/602: symlink d0/d7/d1f/d74/d85/d88/lc7 0 2023-12-16T05:56:36.846 INFO:tasks.workunit.client.0.smithi155.stdout:2/603: write d0/d7/d57/d9b/fb7 [176959,126198] 0 2023-12-16T05:56:36.846 INFO:tasks.workunit.client.1.smithi156.stdout:7/568: dread d1e/d1f/d22/f79 [0,4194304] 0 2023-12-16T05:56:36.847 INFO:tasks.workunit.client.0.smithi155.stdout:4/618: symlink d0/d10/d46/d16/d1a/d70/lca 0 2023-12-16T05:56:36.849 INFO:tasks.workunit.client.0.smithi155.stdout:2/604: write d0/d5/d6/d5f/f99 [738998,8499] 0 2023-12-16T05:56:36.852 INFO:tasks.workunit.client.0.smithi155.stdout:4/619: getdents d0/d10/d46/d16/d30 0 2023-12-16T05:56:36.852 INFO:tasks.workunit.client.0.smithi155.stdout:4/620: chown d0/d10/d46/d16/d30/d52/d88/c96 463 1 2023-12-16T05:56:36.852 INFO:tasks.workunit.client.0.smithi155.stdout:4/621: fsync d0/da/d36/d5f/f66 0 2023-12-16T05:56:36.853 INFO:tasks.workunit.client.0.smithi155.stdout:4/622: write d0/da/d36/d5f/d75/d50/f6a [4443848,19859] 0 2023-12-16T05:56:36.853 INFO:tasks.workunit.client.0.smithi155.stdout:2/605: write d0/d7/dd/d14/f19 [39978,18885] 0 2023-12-16T05:56:36.853 INFO:tasks.workunit.client.0.smithi155.stdout:2/606: fsync d0/f2 0 2023-12-16T05:56:36.853 INFO:tasks.workunit.client.0.smithi155.stdout:2/607: readlink d0/d7/d57/l5c 0 2023-12-16T05:56:36.854 INFO:tasks.workunit.client.0.smithi155.stdout:2/608: write d0/d5/f9f [559868,128784] 0 2023-12-16T05:56:36.854 INFO:tasks.workunit.client.0.smithi155.stdout:1/745: dread d1/d7/f34 [0,4194304] 0 2023-12-16T05:56:36.855 INFO:tasks.workunit.client.0.smithi155.stdout:2/609: creat d0/d34/d3c/fc8 x:0 0 0 2023-12-16T05:56:36.857 INFO:tasks.workunit.client.0.smithi155.stdout:1/746: truncate d1/d25/d43/f60 191177 0 2023-12-16T05:56:36.858 INFO:tasks.workunit.client.0.smithi155.stdout:1/747: write d1/d7/d16/f3a [1559273,30108] 0 2023-12-16T05:56:36.858 INFO:tasks.workunit.client.0.smithi155.stdout:1/748: stat d1/f1e 0 2023-12-16T05:56:36.859 INFO:tasks.workunit.client.0.smithi155.stdout:2/610: symlink d0/d7/dd/d62/d66/lc9 0 2023-12-16T05:56:36.860 INFO:tasks.workunit.client.0.smithi155.stdout:4/623: dread d0/d10/f5b [0,4194304] 0 2023-12-16T05:56:36.860 INFO:tasks.workunit.client.0.smithi155.stdout:4/624: chown d0/d10/d46/d16/d7d 26 1 2023-12-16T05:56:36.860 INFO:tasks.workunit.client.0.smithi155.stdout:2/611: symlink d0/d7/d69/db8/lca 0 2023-12-16T05:56:36.862 INFO:tasks.workunit.client.0.smithi155.stdout:4/625: mkdir d0/da/d36/d5f/d7b/dcb 0 2023-12-16T05:56:36.863 INFO:tasks.workunit.client.1.smithi156.stdout:9/345: dwrite d6/d19/f1b [0,4194304] 0 2023-12-16T05:56:36.864 INFO:tasks.workunit.client.0.smithi155.stdout:9/822: truncate da/d15/d17/d36/d5b/fa6 673923 0 2023-12-16T05:56:36.872 INFO:tasks.workunit.client.0.smithi155.stdout:1/749: dread d1/d7/d16/d30/f73 [0,4194304] 0 2023-12-16T05:56:36.875 INFO:tasks.workunit.client.1.smithi156.stdout:9/346: write d6/d19/d30/f54 [3565328,28845] 0 2023-12-16T05:56:36.876 INFO:tasks.workunit.client.1.smithi156.stdout:9/347: stat d6/d19/d25/f4c 0 2023-12-16T05:56:36.876 INFO:tasks.workunit.client.1.smithi156.stdout:9/348: chown d6/d2e/l3e 1868616454 1 2023-12-16T05:56:36.876 INFO:tasks.workunit.client.1.smithi156.stdout:9/349: read d6/f14 [2577762,14722] 0 2023-12-16T05:56:36.886 INFO:tasks.workunit.client.0.smithi155.stdout:1/750: dread d1/d7/f75 [0,4194304] 0 2023-12-16T05:56:36.895 INFO:tasks.workunit.client.0.smithi155.stdout:2/612: dwrite d0/d7/d1f/fb9 [0,4194304] 0 2023-12-16T05:56:36.899 INFO:tasks.workunit.client.0.smithi155.stdout:9/823: dwrite da/d15/d17/d24/d62/d91/dc0/fd9 [0,4194304] 0 2023-12-16T05:56:36.899 INFO:tasks.workunit.client.0.smithi155.stdout:9/824: chown da/d15/d17/d24/l82 360215003 1 2023-12-16T05:56:36.899 INFO:tasks.workunit.client.0.smithi155.stdout:4/626: dwrite d0/d10/d46/d16/d1a/f35 [0,4194304] 0 2023-12-16T05:56:36.899 INFO:tasks.workunit.client.1.smithi156.stdout:9/350: dwrite d6/d19/d25/f4c [0,4194304] 0 2023-12-16T05:56:36.901 INFO:tasks.workunit.client.0.smithi155.stdout:9/825: mkdir da/d15/d17/d24/d62/dea/d117 0 2023-12-16T05:56:36.901 INFO:tasks.workunit.client.0.smithi155.stdout:4/627: creat d0/d10/d46/d16/fcc x:0 0 0 2023-12-16T05:56:36.902 INFO:tasks.workunit.client.1.smithi156.stdout:9/351: symlink d6/d19/d25/d3a/d57/d65/l78 0 2023-12-16T05:56:36.902 INFO:tasks.workunit.client.1.smithi156.stdout:9/352: readlink d6/l11 0 2023-12-16T05:56:36.903 INFO:tasks.workunit.client.0.smithi155.stdout:9/826: unlink da/d15/d17/d36/d5b/fa6 0 2023-12-16T05:56:36.903 INFO:tasks.workunit.client.0.smithi155.stdout:9/827: chown da/d15/d17/d24/d26/d2e/d83/c8b 0 1 2023-12-16T05:56:36.903 INFO:tasks.workunit.client.0.smithi155.stdout:9/828: fsync da/d15/d17/d36/d5b/fb6 0 2023-12-16T05:56:36.903 INFO:tasks.workunit.client.0.smithi155.stdout:9/829: stat l2 0 2023-12-16T05:56:36.903 INFO:tasks.workunit.client.0.smithi155.stdout:9/830: fdatasync da/d15/f31 0 2023-12-16T05:56:36.904 INFO:tasks.workunit.client.0.smithi155.stdout:4/628: rmdir d0/d10/d46/d16/d30 39 2023-12-16T05:56:36.905 INFO:tasks.workunit.client.0.smithi155.stdout:9/831: creat da/d15/d17/d24/d62/dea/d117/f118 x:0 0 0 2023-12-16T05:56:36.906 INFO:tasks.workunit.client.0.smithi155.stdout:1/751: dwrite d1/d7/d4b/d8e/dc7/d28/d85/fc9 [0,4194304] 0 2023-12-16T05:56:36.906 INFO:tasks.workunit.client.0.smithi155.stdout:4/629: getdents d0/d10/d46/d16/d30/d52/d88/dab 0 2023-12-16T05:56:36.908 INFO:tasks.workunit.client.0.smithi155.stdout:2/613: dread d0/f3d [4194304,4194304] 0 2023-12-16T05:56:36.908 INFO:tasks.workunit.client.0.smithi155.stdout:9/832: rename da/d15/d17/d36/d5b/d98/la9 to da/d15/d17/d36/dc1/l119 0 2023-12-16T05:56:36.909 INFO:tasks.workunit.client.0.smithi155.stdout:9/833: chown da/d15/d17/d24/d26/d2e/d32/f104 0 1 2023-12-16T05:56:36.909 INFO:tasks.workunit.client.0.smithi155.stdout:1/752: read d1/d7/d4b/d8e/fd3 [33099,117115] 0 2023-12-16T05:56:36.912 INFO:tasks.workunit.client.0.smithi155.stdout:2/614: unlink d0/d7/dd/d14/c92 0 2023-12-16T05:56:36.914 INFO:tasks.workunit.client.0.smithi155.stdout:4/630: rename d0/d10/d46/d16/d7d to d0/d10/d46/d16/d30/dcd 0 2023-12-16T05:56:36.915 INFO:tasks.workunit.client.0.smithi155.stdout:9/834: unlink da/d15/d17/d24/ff6 0 2023-12-16T05:56:36.916 INFO:tasks.workunit.client.0.smithi155.stdout:1/753: truncate d1/d7/d4b/d8e/dc7/f65 2802232 0 2023-12-16T05:56:36.916 INFO:tasks.workunit.client.0.smithi155.stdout:1/754: write d1/d7/d4b/d5c/fd2 [2049288,80608] 0 2023-12-16T05:56:36.918 INFO:tasks.workunit.client.0.smithi155.stdout:4/631: rename d0/da/d36/d5f to d0/d10/d46/d16/d30/dce 0 2023-12-16T05:56:36.920 INFO:tasks.workunit.client.0.smithi155.stdout:9/835: unlink da/d15/d17/d36/d5b/d60/d9e/fb5 0 2023-12-16T05:56:36.920 INFO:tasks.workunit.client.0.smithi155.stdout:9/836: chown da/d15/d17/d24/d26/d2e/d32/c9b 0 1 2023-12-16T05:56:36.921 INFO:tasks.workunit.client.0.smithi155.stdout:2/615: rename d0/d7/l61 to d0/d7/d57/d63/lcb 0 2023-12-16T05:56:36.922 INFO:tasks.workunit.client.1.smithi156.stdout:9/353: dwrite d6/d19/f1a [0,4194304] 0 2023-12-16T05:56:36.923 INFO:tasks.workunit.client.1.smithi156.stdout:9/354: write d6/f13 [1697211,81878] 0 2023-12-16T05:56:36.923 INFO:tasks.workunit.client.0.smithi155.stdout:9/837: unlink da/d10b/l116 0 2023-12-16T05:56:36.924 INFO:tasks.workunit.client.0.smithi155.stdout:1/755: rename d1/d7/d4b/d8e/dc7/d28/d85/de0/d79/f9d to d1/d7/d4b/d8e/dc7/fea 0 2023-12-16T05:56:36.927 INFO:tasks.workunit.client.0.smithi155.stdout:9/838: creat da/d15/d17/d36/dc1/f11a x:0 0 0 2023-12-16T05:56:36.929 INFO:tasks.workunit.client.0.smithi155.stdout:1/756: symlink d1/d7/d4b/d8e/dc7/d28/d8f/leb 0 2023-12-16T05:56:36.930 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.885+0000 7f9fa4e70700 1 -- 172.21.15.155:0/1914831997 --> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fa0067d80 con 0x7f9f8806ae40 2023-12-16T05:56:36.930 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.887+0000 7f9f8effd700 1 -- 172.21.15.155:0/1914831997 <== mgr.24363 v2:172.21.15.156:6828/1939402353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f9fa0067d80 con 0x7f9f8806ae40 2023-12-16T05:56:36.930 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.889+0000 7f9fa4e70700 1 -- 172.21.15.155:0/1914831997 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f9f8806ae40 msgr2=0x7f9f8806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:36.930 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.889+0000 7f9fa4e70700 1 --2- 172.21.15.155:0/1914831997 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f9f8806ae40 0x7f9f8806d2f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9f9400b3b0 tx=0x7f9f94009e30 comp rx=0 tx=0).stop 2023-12-16T05:56:36.930 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.889+0000 7f9fa4e70700 1 -- 172.21.15.155:0/1914831997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa0070510 msgr2=0x7f9fa01074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:36.930 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.889+0000 7f9fa4e70700 1 --2- 172.21.15.155:0/1914831997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa0070510 0x7f9fa01074a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800ba80 tx=0x7f9f98009780 comp rx=0 tx=0).stop 2023-12-16T05:56:36.930 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.889+0000 7f9fa4e70700 1 -- 172.21.15.155:0/1914831997 shutdown_connections 2023-12-16T05:56:36.930 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.889+0000 7f9fa4e70700 1 --2- 172.21.15.155:0/1914831997 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f9f8806ae40 0x7f9f8806d2f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:36.930 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.889+0000 7f9fa4e70700 1 --2- 172.21.15.155:0/1914831997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa0070510 0x7f9fa01074a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:36.930 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.889+0000 7f9fa4e70700 1 --2- 172.21.15.155:0/1914831997 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fa0071b60 0x7f9fa01079e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:36.931 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.889+0000 7f9fa4e70700 1 -- 172.21.15.155:0/1914831997 >> 172.21.15.155:0/1914831997 conn(0x7f9fa00f82d0 msgr2=0x7f9fa00fa630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:56:36.931 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.889+0000 7f9fa4e70700 1 -- 172.21.15.155:0/1914831997 shutdown_connections 2023-12-16T05:56:36.931 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:36.889+0000 7f9fa4e70700 1 -- 172.21.15.155:0/1914831997 wait complete. 2023-12-16T05:56:36.936 INFO:tasks.workunit.client.1.smithi156.stdout:9/355: dwrite d6/f14 [0,4194304] 0 2023-12-16T05:56:36.937 INFO:tasks.workunit.client.1.smithi156.stdout:9/356: creat d6/d19/d25/d3a/d5e/f79 x:0 0 0 2023-12-16T05:56:36.937 INFO:tasks.workunit.client.1.smithi156.stdout:9/357: stat d6/l3d 0 2023-12-16T05:56:36.938 INFO:tasks.workunit.client.0.smithi155.stdout:4/632: rename d0/d10/d46/d16/d30/dce/d75/d3d/d49/cbd to d0/ccf 0 2023-12-16T05:56:36.941 INFO:tasks.workunit.client.0.smithi155.stdout:1/757: mkdir d1/d7/d4b/d5c/dec 0 2023-12-16T05:56:36.944 INFO:tasks.workunit.client.0.smithi155.stdout:9/839: rename da/d15/d17/d24/d62/dea/cfe to da/dec/c11b 0 2023-12-16T05:56:36.944 INFO:tasks.workunit.client.0.smithi155.stdout:9/840: chown da/d15/d17/d24/d26/d2e/l3b 805 1 2023-12-16T05:56:36.944 INFO:tasks.workunit.client.0.smithi155.stdout:9/841: fdatasync da/d15/f66 0 2023-12-16T05:56:36.946 INFO:tasks.workunit.client.0.smithi155.stdout:2/616: dwrite d0/d5/d6/f2e [0,4194304] 0 2023-12-16T05:56:36.947 INFO:tasks.workunit.client.0.smithi155.stdout:2/617: write d0/d7/d1f/d74/d85/d88/f89 [62539,108315] 0 2023-12-16T05:56:36.947 INFO:tasks.workunit.client.0.smithi155.stdout:4/633: unlink d0/d10/d46/d16/c1e 0 2023-12-16T05:56:36.947 INFO:tasks.workunit.client.0.smithi155.stdout:2/618: write d0/d34/d3c/fc8 [167851,77884] 0 2023-12-16T05:56:36.947 INFO:tasks.workunit.client.0.smithi155.stdout:2/619: write d0/d7/d1f/d74/d85/fc3 [522572,96874] 0 2023-12-16T05:56:36.948 INFO:tasks.workunit.client.0.smithi155.stdout:1/758: symlink d1/led 0 2023-12-16T05:56:36.949 INFO:tasks.workunit.client.0.smithi155.stdout:9/842: write da/d15/f31 [3427339,12415] 0 2023-12-16T05:56:36.954 INFO:tasks.workunit.client.1.smithi156.stdout:9/358: dwrite d6/d2e/f52 [0,4194304] 0 2023-12-16T05:56:36.954 INFO:tasks.workunit.client.1.smithi156.stdout:9/359: write d6/d19/d25/d3a/d5e/f67 [402506,89635] 0 2023-12-16T05:56:36.955 INFO:tasks.workunit.client.1.smithi156.stdout:1/234: sync 2023-12-16T05:56:36.955 INFO:tasks.workunit.client.1.smithi156.stdout:1/235: chown d3/d1b/l1d 84656964 1 2023-12-16T05:56:36.955 INFO:tasks.workunit.client.1.smithi156.stdout:1/236: readlink d3/l10 0 2023-12-16T05:56:36.955 INFO:tasks.workunit.client.1.smithi156.stdout:1/237: stat d3/d17/c42 0 2023-12-16T05:56:36.956 INFO:tasks.workunit.client.0.smithi155.stdout:4/634: link d0/d10/f2c d0/d10/d46/d16/d30/dce/d7b/dcb/fd0 0 2023-12-16T05:56:36.956 INFO:tasks.workunit.client.0.smithi155.stdout:2/620: rename d0/d7/d1f/f4a to d0/d7/dc1/fcc 0 2023-12-16T05:56:36.957 INFO:tasks.workunit.client.1.smithi156.stdout:1/238: write d3/fb [1763779,114018] 0 2023-12-16T05:56:36.957 INFO:tasks.workunit.client.1.smithi156.stdout:9/360: link d6/d2e/f66 d6/d2e/f7a 0 2023-12-16T05:56:36.957 INFO:tasks.workunit.client.1.smithi156.stdout:9/361: fsync d6/d19/d25/f6f 0 2023-12-16T05:56:36.958 INFO:tasks.workunit.client.0.smithi155.stdout:1/759: rmdir d1/d7/d4b/d8e/dc7/d28/d8f/db2/dde 0 2023-12-16T05:56:36.958 INFO:tasks.workunit.client.0.smithi155.stdout:1/760: chown d1/d7/d4b/d8e/dc7/d28/l83 70727 1 2023-12-16T05:56:36.958 INFO:tasks.workunit.client.1.smithi156.stdout:9/362: truncate d6/d19/d25/f4c 1174057 0 2023-12-16T05:56:36.960 INFO:tasks.workunit.client.1.smithi156.stdout:9/363: truncate d6/f46 1430596 0 2023-12-16T05:56:36.960 INFO:tasks.workunit.client.1.smithi156.stdout:9/364: truncate d6/d19/d25/d3a/d5e/f68 637185 0 2023-12-16T05:56:36.962 INFO:tasks.workunit.client.0.smithi155.stdout:4/635: mkdir d0/d10/d46/d16/d1a/dd1 0 2023-12-16T05:56:36.962 INFO:tasks.workunit.client.0.smithi155.stdout:4/636: chown d0/f28 62 1 2023-12-16T05:56:36.962 INFO:tasks.workunit.client.0.smithi155.stdout:4/637: write d0/d10/d46/d16/d30/dce/f6d [4595131,45315] 0 2023-12-16T05:56:36.965 INFO:tasks.workunit.client.0.smithi155.stdout:2/621: mkdir d0/d7/dd/d49/d4b/d8c/dcd 0 2023-12-16T05:56:36.966 INFO:tasks.workunit.client.1.smithi156.stdout:9/365: dread d6/ff [4194304,4194304] 0 2023-12-16T05:56:36.967 INFO:tasks.workunit.client.1.smithi156.stdout:9/366: write d6/d19/d25/d3a/f4e [602932,14367] 0 2023-12-16T05:56:36.967 INFO:tasks.workunit.client.1.smithi156.stdout:9/367: fsync d6/d19/f20 0 2023-12-16T05:56:36.967 INFO:tasks.workunit.client.1.smithi156.stdout:9/368: stat d6/d19/f2a 0 2023-12-16T05:56:36.967 INFO:tasks.workunit.client.1.smithi156.stdout:9/369: chown d6/d19/d30/f44 1009885750 1 2023-12-16T05:56:36.967 INFO:tasks.workunit.client.1.smithi156.stdout:9/370: fdatasync d6/d19/d25/d3a/f4a 0 2023-12-16T05:56:36.972 INFO:tasks.workunit.client.0.smithi155.stdout:9/843: symlink da/d15/d17/d24/d26/d2e/l11c 0 2023-12-16T05:56:36.973 INFO:tasks.workunit.client.0.smithi155.stdout:1/761: dwrite d1/d7/d4b/d8e/dc7/d28/d74/faf [0,4194304] 0 2023-12-16T05:56:36.978 INFO:tasks.workunit.client.0.smithi155.stdout:4/638: getdents d0/d10/d46/d16/d30/d52/d88/d9e 0 2023-12-16T05:56:36.982 INFO:tasks.workunit.client.0.smithi155.stdout:2/622: rename d0/d5/d6/f2e to d0/d5/fce 0 2023-12-16T05:56:36.983 INFO:tasks.workunit.client.0.smithi155.stdout:2/623: chown d0/d7/dd/f26 897658 1 2023-12-16T05:56:36.984 INFO:tasks.workunit.client.0.smithi155.stdout:9/844: mkdir da/d15/d17/d11d 0 2023-12-16T05:56:36.984 INFO:tasks.workunit.client.0.smithi155.stdout:9/845: fsync da/d15/d17/d24/d26/d2e/d32/f53 0 2023-12-16T05:56:36.984 INFO:tasks.workunit.client.0.smithi155.stdout:9/846: chown da/d15/d17/d36/d5b/d60/d9e/fd4 49817565 1 2023-12-16T05:56:36.985 INFO:tasks.workunit.client.0.smithi155.stdout:4/639: mknod d0/d10/cd2 0 2023-12-16T05:56:36.987 INFO:tasks.workunit.client.0.smithi155.stdout:4/640: symlink d0/d10/d46/d16/d1a/d70/ld3 0 2023-12-16T05:56:36.987 INFO:tasks.workunit.client.0.smithi155.stdout:2/624: dread d0/f2 [0,4194304] 0 2023-12-16T05:56:36.989 INFO:tasks.workunit.client.0.smithi155.stdout:2/625: rmdir d0/d7/d57/daf/dba 0 2023-12-16T05:56:36.991 INFO:tasks.workunit.client.0.smithi155.stdout:2/626: mknod d0/d7/d1f/d74/d3a/ccf 0 2023-12-16T05:56:36.991 INFO:tasks.workunit.client.0.smithi155.stdout:2/627: chown d0/d7/dd/d49/d4b/c50 49419 1 2023-12-16T05:56:36.993 INFO:tasks.workunit.client.0.smithi155.stdout:2/628: creat d0/d5/d6/fd0 x:0 0 0 2023-12-16T05:56:36.993 INFO:tasks.workunit.client.0.smithi155.stdout:2/629: chown d0/d34/f72 161 1 2023-12-16T05:56:36.995 INFO:tasks.workunit.client.0.smithi155.stdout:9/847: dread da/d15/d17/d24/d26/f2a [0,4194304] 0 2023-12-16T05:56:36.996 INFO:tasks.workunit.client.0.smithi155.stdout:4/641: dread d0/d10/d46/d16/d1a/f2b [0,4194304] 0 2023-12-16T05:56:36.997 INFO:tasks.workunit.client.0.smithi155.stdout:2/630: write d0/f2 [325474,115077] 0 2023-12-16T05:56:36.997 INFO:tasks.workunit.client.0.smithi155.stdout:9/848: symlink da/d15/d17/d36/d5b/d98/l11e 0 2023-12-16T05:56:37.000 INFO:tasks.workunit.client.1.smithi156.stdout:9/371: dwrite d6/d19/d25/d3a/f43 [0,4194304] 0 2023-12-16T05:56:37.001 INFO:tasks.workunit.client.0.smithi155.stdout:2/631: getdents d0/d7/d1f/d74/d85 0 2023-12-16T05:56:37.001 INFO:tasks.workunit.client.1.smithi156.stdout:9/372: getdents d6/d19/d25/d3a/d5e 0 2023-12-16T05:56:37.002 INFO:tasks.workunit.client.1.smithi156.stdout:1/239: dwrite d3/fb [0,4194304] 0 2023-12-16T05:56:37.002 INFO:tasks.workunit.client.1.smithi156.stdout:1/240: truncate d3/d17/d19/f20 399680 0 2023-12-16T05:56:37.003 INFO:tasks.workunit.client.1.smithi156.stdout:9/373: creat d6/d19/d25/d3a/d5e/f7b x:0 0 0 2023-12-16T05:56:37.004 INFO:tasks.workunit.client.1.smithi156.stdout:1/241: write d3/d17/d1c/f2b [1885743,118889] 0 2023-12-16T05:56:37.004 INFO:tasks.workunit.client.1.smithi156.stdout:1/242: write d3/d1b/f37 [285932,96255] 0 2023-12-16T05:56:37.004 INFO:tasks.workunit.client.1.smithi156.stdout:9/374: read d6/d19/f2a [3585148,25224] 0 2023-12-16T05:56:37.006 INFO:tasks.workunit.client.1.smithi156.stdout:9/375: rename d6/d19/d30/f39 to d6/d19/d30/f7c 0 2023-12-16T05:56:37.006 INFO:tasks.workunit.client.0.smithi155.stdout:4/642: dread d0/fb [0,4194304] 0 2023-12-16T05:56:37.007 INFO:tasks.workunit.client.1.smithi156.stdout:9/376: symlink d6/d19/d25/l7d 0 2023-12-16T05:56:37.007 INFO:tasks.workunit.client.1.smithi156.stdout:9/377: chown d6/d19/d30/f54 4832117 1 2023-12-16T05:56:37.007 INFO:tasks.workunit.client.1.smithi156.stdout:9/378: dread - d6/d19/d25/d3a/d57/f70 zero size 2023-12-16T05:56:37.007 INFO:tasks.workunit.client.1.smithi156.stdout:9/379: chown d6/d19/d25/f3c 457016 1 2023-12-16T05:56:37.019 INFO:tasks.workunit.client.1.smithi156.stdout:1/243: dread d3/f5 [0,4194304] 0 2023-12-16T05:56:37.020 INFO:tasks.workunit.client.1.smithi156.stdout:1/244: mknod d3/d17/d1c/d22/c4a 0 2023-12-16T05:56:37.020 INFO:tasks.workunit.client.1.smithi156.stdout:1/245: chown d3/d17/d2d 5 1 2023-12-16T05:56:37.021 INFO:tasks.workunit.client.1.smithi156.stdout:1/246: creat d3/d17/d1c/f4b x:0 0 0 2023-12-16T05:56:37.021 INFO:tasks.workunit.client.1.smithi156.stdout:1/247: read d3/d17/d19/f2e [94866,77808] 0 2023-12-16T05:56:37.023 INFO:tasks.workunit.client.1.smithi156.stdout:9/380: dwrite d6/d19/d25/f6f [0,4194304] 0 2023-12-16T05:56:37.023 INFO:tasks.workunit.client.1.smithi156.stdout:9/381: truncate d6/d19/d25/f31 463628 0 2023-12-16T05:56:37.023 INFO:tasks.workunit.client.0.smithi155.stdout:2/632: dread d0/d7/d1f/d74/f46 [0,4194304] 0 2023-12-16T05:56:37.023 INFO:tasks.workunit.client.0.smithi155.stdout:9/849: dwrite da/ff [0,4194304] 0 2023-12-16T05:56:37.023 INFO:tasks.workunit.client.0.smithi155.stdout:9/850: chown da/d15/d17/d24/d26/d2e/c56 3 1 2023-12-16T05:56:37.024 INFO:tasks.workunit.client.0.smithi155.stdout:9/851: getdents da/d15/d17/d36/d5b/d60 0 2023-12-16T05:56:37.024 INFO:tasks.workunit.client.0.smithi155.stdout:9/852: dread - da/d15/d17/d24/d26/d2e/d32/db7/fe6 zero size 2023-12-16T05:56:37.025 INFO:tasks.workunit.client.1.smithi156.stdout:9/382: unlink d6/l3d 0 2023-12-16T05:56:37.025 INFO:tasks.workunit.client.1.smithi156.stdout:9/383: write d6/d19/d25/d3a/f43 [4793875,33686] 0 2023-12-16T05:56:37.026 INFO:tasks.workunit.client.1.smithi156.stdout:6/350: sync 2023-12-16T05:56:37.026 INFO:tasks.workunit.client.1.smithi156.stdout:3/288: sync 2023-12-16T05:56:37.026 INFO:tasks.workunit.client.1.smithi156.stdout:0/390: sync 2023-12-16T05:56:37.026 INFO:tasks.workunit.client.1.smithi156.stdout:1/248: write d3/fc [251419,107389] 0 2023-12-16T05:56:37.027 INFO:tasks.workunit.client.0.smithi155.stdout:9/853: creat da/d15/d17/d36/f11f x:0 0 0 2023-12-16T05:56:37.027 INFO:tasks.workunit.client.0.smithi155.stdout:9/854: stat da/d15/d17/d24/ce0 0 2023-12-16T05:56:37.028 INFO:tasks.workunit.client.1.smithi156.stdout:9/384: creat d6/d19/d25/d72/f7e x:0 0 0 2023-12-16T05:56:37.028 INFO:tasks.workunit.client.1.smithi156.stdout:6/351: write d9/f11 [194922,36269] 0 2023-12-16T05:56:37.028 INFO:tasks.workunit.client.1.smithi156.stdout:6/352: dread - d9/d1c/f3a zero size 2023-12-16T05:56:37.028 INFO:tasks.workunit.client.1.smithi156.stdout:1/249: write d3/fb [1426511,53798] 0 2023-12-16T05:56:37.029 INFO:tasks.workunit.client.1.smithi156.stdout:0/391: mkdir d2/d7/dd/d29/d4b/d76 0 2023-12-16T05:56:37.030 INFO:tasks.workunit.client.0.smithi155.stdout:9/855: write da/d15/fb1 [2128349,22257] 0 2023-12-16T05:56:37.031 INFO:tasks.workunit.client.1.smithi156.stdout:3/289: write dc/d10/d1d/f3a [688103,27560] 0 2023-12-16T05:56:37.031 INFO:tasks.workunit.client.1.smithi156.stdout:9/385: symlink d6/d19/d25/l7f 0 2023-12-16T05:56:37.031 INFO:tasks.workunit.client.0.smithi155.stdout:9/856: link da/d15/d17/d24/d26/c112 da/d15/d17/d36/d54/d10f/c120 0 2023-12-16T05:56:37.032 INFO:tasks.workunit.client.1.smithi156.stdout:6/353: creat d9/d1c/f6f x:0 0 0 2023-12-16T05:56:37.034 INFO:tasks.workunit.client.1.smithi156.stdout:1/250: rename d3/f14 to d3/d17/d19/f4c 0 2023-12-16T05:56:37.036 INFO:tasks.workunit.client.1.smithi156.stdout:0/392: unlink d2/d23/d55/f60 0 2023-12-16T05:56:37.036 INFO:tasks.workunit.client.1.smithi156.stdout:0/393: dread - d2/f43 zero size 2023-12-16T05:56:37.037 INFO:tasks.workunit.client.1.smithi156.stdout:9/386: mkdir d6/d19/d25/d3a/d80 0 2023-12-16T05:56:37.037 INFO:tasks.workunit.client.1.smithi156.stdout:9/387: dread - d6/d19/d25/d3a/f4a zero size 2023-12-16T05:56:37.037 INFO:tasks.workunit.client.1.smithi156.stdout:9/388: chown d6/d19/l40 3730548 1 2023-12-16T05:56:37.037 INFO:tasks.workunit.client.1.smithi156.stdout:9/389: chown d6/d19/d25/f34 84439 1 2023-12-16T05:56:37.037 INFO:tasks.workunit.client.1.smithi156.stdout:9/390: fsync d6/d19/d25/f3c 0 2023-12-16T05:56:37.038 INFO:tasks.workunit.client.1.smithi156.stdout:6/354: rmdir d9/d13 39 2023-12-16T05:56:37.038 INFO:tasks.workunit.client.1.smithi156.stdout:6/355: stat d9/d13/d2f 0 2023-12-16T05:56:37.038 INFO:tasks.workunit.client.0.smithi155.stdout:9/857: dread da/d15/d17/d36/d5b/d98/fe8 [0,4194304] 0 2023-12-16T05:56:37.040 INFO:tasks.workunit.client.1.smithi156.stdout:0/394: unlink d2/d7/dd/d29/d38/d3f/c4e 0 2023-12-16T05:56:37.040 INFO:tasks.workunit.client.1.smithi156.stdout:9/391: creat d6/d19/d25/d3a/d5e/f81 x:0 0 0 2023-12-16T05:56:37.041 INFO:tasks.workunit.client.0.smithi155.stdout:2/633: dwrite d0/d5/d6/f82 [0,4194304] 0 2023-12-16T05:56:37.042 INFO:tasks.workunit.client.0.smithi155.stdout:9/858: dread da/f14 [0,4194304] 0 2023-12-16T05:56:37.042 INFO:tasks.workunit.client.0.smithi155.stdout:2/634: symlink d0/d7/d57/d9b/ld1 0 2023-12-16T05:56:37.042 INFO:tasks.workunit.client.0.smithi155.stdout:2/635: chown d0/d7/dc1/fcc 269252 1 2023-12-16T05:56:37.043 INFO:tasks.workunit.client.1.smithi156.stdout:6/356: link d9/f3b d9/f70 0 2023-12-16T05:56:37.043 INFO:tasks.workunit.client.0.smithi155.stdout:9/859: creat da/d15/d17/d36/d5b/d60/f121 x:0 0 0 2023-12-16T05:56:37.043 INFO:tasks.workunit.client.0.smithi155.stdout:9/860: fdatasync da/d15/d17/d24/d26/d2e/d83/d8f/fb2 0 2023-12-16T05:56:37.043 INFO:tasks.workunit.client.0.smithi155.stdout:9/861: readlink da/d15/d17/d36/d5b/d60/d9e/ld6 0 2023-12-16T05:56:37.044 INFO:tasks.workunit.client.0.smithi155.stdout:9/862: dread - da/d15/d17/d36/d5b/d60/f121 zero size 2023-12-16T05:56:37.044 INFO:tasks.workunit.client.0.smithi155.stdout:2/636: truncate d0/d5/d6/f83 1321756 0 2023-12-16T05:56:37.044 INFO:tasks.workunit.client.0.smithi155.stdout:9/863: symlink da/d15/d17/d24/d26/d2e/d83/d8f/df2/l122 0 2023-12-16T05:56:37.046 INFO:tasks.workunit.client.0.smithi155.stdout:9/864: mkdir da/d15/d17/d36/d5b/d60/d9e/de3/d123 0 2023-12-16T05:56:37.046 INFO:tasks.workunit.client.1.smithi156.stdout:1/251: unlink d3/d17/d19/f4c 0 2023-12-16T05:56:37.048 INFO:tasks.workunit.client.0.smithi155.stdout:3/516: sync 2023-12-16T05:56:37.048 INFO:tasks.workunit.client.0.smithi155.stdout:7/604: sync 2023-12-16T05:56:37.049 INFO:tasks.workunit.client.0.smithi155.stdout:3/517: write d0/d1e/f20 [8628875,66734] 0 2023-12-16T05:56:37.050 INFO:tasks.workunit.client.0.smithi155.stdout:3/518: chown d0/d14/d36/d47/d5f/f7d 296214 1 2023-12-16T05:56:37.050 INFO:tasks.workunit.client.0.smithi155.stdout:3/519: chown d0/d14/d36/d7c/c7e 52312 1 2023-12-16T05:56:37.051 INFO:tasks.workunit.client.0.smithi155.stdout:7/605: symlink d0/d6a/d31/lc7 0 2023-12-16T05:56:37.051 INFO:tasks.workunit.client.0.smithi155.stdout:7/606: truncate d0/d6a/fac 116014 0 2023-12-16T05:56:37.053 INFO:tasks.workunit.client.0.smithi155.stdout:2/637: write d0/d7/dc1/fcc [1410717,21153] 0 2023-12-16T05:56:37.053 INFO:tasks.workunit.client.0.smithi155.stdout:2/638: write d0/d7/d57/d9b/fb7 [854363,101595] 0 2023-12-16T05:56:37.053 INFO:tasks.workunit.client.0.smithi155.stdout:2/639: dread - d0/d7/d1f/d74/d3a/f84 zero size 2023-12-16T05:56:37.054 INFO:tasks.workunit.client.1.smithi156.stdout:9/392: rename d6/d19/d25/d3a/f6c to d6/d19/d30/d5b/f82 0 2023-12-16T05:56:37.054 INFO:tasks.workunit.client.1.smithi156.stdout:9/393: dread - d6/d19/d25/d3a/d57/f70 zero size 2023-12-16T05:56:37.056 INFO:tasks.workunit.client.1.smithi156.stdout:0/395: rmdir d2 39 2023-12-16T05:56:37.057 INFO:tasks.workunit.client.0.smithi155.stdout:7/607: mkdir d0/d6a/d1a/d22/dc8 0 2023-12-16T05:56:37.057 INFO:tasks.workunit.client.0.smithi155.stdout:9/865: dread da/d15/d17/d24/d26/d2e/d32/f3c [0,4194304] 0 2023-12-16T05:56:37.058 INFO:tasks.workunit.client.0.smithi155.stdout:2/640: mkdir d0/d7/dd/d49/d4b/d8c/dcd/dd2 0 2023-12-16T05:56:37.058 INFO:tasks.workunit.client.0.smithi155.stdout:2/641: readlink d0/d7/dd/d14/l20 0 2023-12-16T05:56:37.059 INFO:tasks.workunit.client.0.smithi155.stdout:2/642: mknod d0/d7/dd/cd3 0 2023-12-16T05:56:37.060 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.056+0000 7f66b46d2700 1 -- 172.21.15.155:0/2873656600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66ac0fb290 msgr2=0x7f66ac0fb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:37.060 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.056+0000 7f66b46d2700 1 --2- 172.21.15.155:0/2873656600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66ac0fb290 0x7f66ac0fb6a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f66a8004a50 tx=0x7f66a800af40 comp rx=0 tx=0).stop 2023-12-16T05:56:37.061 INFO:tasks.workunit.client.0.smithi155.stdout:9/866: read da/d15/d17/d36/fa1 [3602271,416] 0 2023-12-16T05:56:37.061 INFO:tasks.workunit.client.0.smithi155.stdout:9/867: chown da/d15/d17/d24/d26/d2e/l3b 0 1 2023-12-16T05:56:37.061 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.057+0000 7f66b46d2700 1 -- 172.21.15.155:0/2873656600 shutdown_connections 2023-12-16T05:56:37.061 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.057+0000 7f66b46d2700 1 --2- 172.21.15.155:0/2873656600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66ac0fc4a0 0x7f66ac0fc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:37.062 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.057+0000 7f66b46d2700 1 --2- 172.21.15.155:0/2873656600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66ac0fb290 0x7f66ac0fb6a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:37.062 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.057+0000 7f66b46d2700 1 -- 172.21.15.155:0/2873656600 >> 172.21.15.155:0/2873656600 conn(0x7f66ac0f6950 msgr2=0x7f66ac0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:56:37.062 INFO:tasks.workunit.client.0.smithi155.stdout:2/643: rmdir d0/d7/d69/d77 39 2023-12-16T05:56:37.064 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.057+0000 7f66b46d2700 1 -- 172.21.15.155:0/2873656600 shutdown_connections 2023-12-16T05:56:37.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.057+0000 7f66b46d2700 1 -- 172.21.15.155:0/2873656600 wait complete. 2023-12-16T05:56:37.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.058+0000 7f66b46d2700 1 Processor -- start 2023-12-16T05:56:37.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.058+0000 7f66b46d2700 1 -- start start 2023-12-16T05:56:37.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.058+0000 7f66b46d2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66ac0fb290 0x7f66ac10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:37.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.058+0000 7f66b46d2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66ac0fc4a0 0x7f66ac10db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:37.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.058+0000 7f66b46d2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac10e1c0 con 0x7f66ac0fb290 2023-12-16T05:56:37.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.058+0000 7f66b46d2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac10ea00 con 0x7f66ac0fc4a0 2023-12-16T05:56:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.058+0000 7f66b246e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66ac0fb290 0x7f66ac10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.058+0000 7f66b246e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66ac0fb290 0x7f66ac10d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53084/0 (socket says 172.21.15.155:53084) 2023-12-16T05:56:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.058+0000 7f66b246e700 1 -- 172.21.15.155:0/3408597272 learned_addr learned my addr 172.21.15.155:0/3408597272 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:56:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.058+0000 7f66b246e700 1 -- 172.21.15.155:0/3408597272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66ac0fc4a0 msgr2=0x7f66ac10db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.058+0000 7f66b246e700 1 --2- 172.21.15.155:0/3408597272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66ac0fc4a0 0x7f66ac10db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.058+0000 7f66b246e700 1 -- 172.21.15.155:0/3408597272 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a8005040 con 0x7f66ac0fb290 2023-12-16T05:56:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.059+0000 7f66b246e700 1 --2- 172.21.15.155:0/3408597272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66ac0fb290 0x7f66ac10d5f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f66a800c8a0 tx=0x7f66a800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:56:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.059+0000 7f66a2ffd700 1 -- 172.21.15.155:0/3408597272 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66a800f030 con 0x7f66ac0fb290 2023-12-16T05:56:37.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.059+0000 7f66b46d2700 1 -- 172.21.15.155:0/3408597272 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ac10ec80 con 0x7f66ac0fb290 2023-12-16T05:56:37.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.059+0000 7f66a2ffd700 1 -- 172.21.15.155:0/3408597272 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f66a800a450 con 0x7f66ac0fb290 2023-12-16T05:56:37.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.059+0000 7f66a2ffd700 1 -- 172.21.15.155:0/3408597272 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66a801d6c0 con 0x7f66ac0fb290 2023-12-16T05:56:37.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.059+0000 7f66b46d2700 1 -- 172.21.15.155:0/3408597272 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ac10f1c0 con 0x7f66ac0fb290 2023-12-16T05:56:37.067 INFO:tasks.workunit.client.0.smithi155.stdout:9/868: unlink c7 0 2023-12-16T05:56:37.068 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.060+0000 7f66b46d2700 1 -- 172.21.15.155:0/3408597272 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ac105470 con 0x7f66ac0fb290 2023-12-16T05:56:37.068 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.062+0000 7f66a2ffd700 1 -- 172.21.15.155:0/3408597272 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 24) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f66a8008050 con 0x7f66ac0fb290 2023-12-16T05:56:37.068 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.062+0000 7f66a2ffd700 1 --2- 172.21.15.155:0/3408597272 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f669806ae40 0x7f669806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:37.068 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.062+0000 7f66a2ffd700 1 -- 172.21.15.155:0/3408597272 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f66a808aba0 con 0x7f66ac0fb290 2023-12-16T05:56:37.069 INFO:tasks.workunit.client.0.smithi155.stdout:2/644: truncate d0/d5/d6/f75 790588 0 2023-12-16T05:56:37.069 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.063+0000 7f66b1c6d700 1 --2- 172.21.15.155:0/3408597272 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f669806ae40 0x7f669806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:37.070 INFO:tasks.workunit.client.0.smithi155.stdout:7/608: dread d0/d1/f4a [0,4194304] 0 2023-12-16T05:56:37.070 INFO:tasks.workunit.client.0.smithi155.stdout:9/869: creat da/d15/d17/d36/d54/d10f/f124 x:0 0 0 2023-12-16T05:56:37.070 INFO:tasks.workunit.client.0.smithi155.stdout:2/645: mknod d0/d7/dd/d49/d4b/d8c/dcd/dd2/cd4 0 2023-12-16T05:56:37.071 INFO:tasks.workunit.client.1.smithi156.stdout:6/357: rename d9/d1c/f24 to d9/d13/d2f/d51/d69/f71 0 2023-12-16T05:56:37.071 INFO:tasks.workunit.client.1.smithi156.stdout:6/358: read d9/d13/d2f/f3f [349103,93715] 0 2023-12-16T05:56:37.071 INFO:tasks.workunit.client.1.smithi156.stdout:9/394: symlink d6/d19/d25/d3a/d57/d65/l83 0 2023-12-16T05:56:37.071 INFO:tasks.workunit.client.1.smithi156.stdout:0/396: symlink d2/d7/dd/d29/d38/d51/d52/l77 0 2023-12-16T05:56:37.071 INFO:tasks.workunit.client.1.smithi156.stdout:0/397: dread - d2/d7/dd/d29/d2e/f53 zero size 2023-12-16T05:56:37.071 INFO:tasks.workunit.client.1.smithi156.stdout:0/398: write d2/d7/dd/d29/d38/d3f/f58 [1222044,123193] 0 2023-12-16T05:56:37.071 INFO:tasks.workunit.client.1.smithi156.stdout:0/399: chown d2/d7/dd/f5b 11837914 1 2023-12-16T05:56:37.071 INFO:tasks.workunit.client.1.smithi156.stdout:1/252: truncate d3/fb 3049823 0 2023-12-16T05:56:37.071 INFO:tasks.workunit.client.1.smithi156.stdout:0/400: write d2/d7/dd/d1c/f71 [2201453,70802] 0 2023-12-16T05:56:37.072 INFO:tasks.workunit.client.0.smithi155.stdout:7/609: mkdir d0/d6a/d1a/d8c/d34/d4b/d64/d6f/dba/dc9 0 2023-12-16T05:56:37.072 INFO:tasks.workunit.client.0.smithi155.stdout:7/610: readlink d0/l76 0 2023-12-16T05:56:37.072 INFO:tasks.workunit.client.0.smithi155.stdout:9/870: mknod da/dec/c125 0 2023-12-16T05:56:37.072 INFO:tasks.workunit.client.0.smithi155.stdout:9/871: read - da/d15/d17/d36/d5b/d60/db9/f101 zero size 2023-12-16T05:56:37.073 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.070+0000 7f66a2ffd700 1 -- 172.21.15.155:0/3408597272 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f66a80589a0 con 0x7f66ac0fb290 2023-12-16T05:56:37.073 INFO:tasks.workunit.client.1.smithi156.stdout:6/359: rename d9/f1d to d9/d1c/f72 0 2023-12-16T05:56:37.073 INFO:tasks.workunit.client.1.smithi156.stdout:6/360: write d9/d13/d2f/d51/f56 [922098,90644] 0 2023-12-16T05:56:37.073 INFO:tasks.workunit.client.0.smithi155.stdout:2/646: creat d0/d7/d69/fd5 x:0 0 0 2023-12-16T05:56:37.074 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.071+0000 7f66b1c6d700 1 --2- 172.21.15.155:0/3408597272 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f669806ae40 0x7f669806d2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f669c006fd0 tx=0x7f669c006db0 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:56:37.075 INFO:tasks.workunit.client.0.smithi155.stdout:7/611: symlink d0/d1/lca 0 2023-12-16T05:56:37.075 INFO:tasks.workunit.client.0.smithi155.stdout:3/520: dwrite d0/d1e/f59 [0,4194304] 0 2023-12-16T05:56:37.075 INFO:tasks.workunit.client.0.smithi155.stdout:3/521: dread - d0/d14/d87/f9c zero size 2023-12-16T05:56:37.075 INFO:tasks.workunit.client.0.smithi155.stdout:9/872: creat da/d15/d17/d36/d5b/d98/dc2/f126 x:0 0 0 2023-12-16T05:56:37.075 INFO:tasks.workunit.client.0.smithi155.stdout:9/873: chown da/d15/d17/d24/d26/l108 5 1 2023-12-16T05:56:37.076 INFO:tasks.workunit.client.1.smithi156.stdout:0/401: rename d2/d7/dd/d1c/f75 to d2/d7/dd/d29/d4b/d76/f78 0 2023-12-16T05:56:37.076 INFO:tasks.workunit.client.1.smithi156.stdout:0/402: readlink d2/l34 0 2023-12-16T05:56:37.076 INFO:tasks.workunit.client.0.smithi155.stdout:7/612: creat d0/d6a/d1a/d8c/d34/d6c/fcb x:0 0 0 2023-12-16T05:56:37.078 INFO:tasks.workunit.client.0.smithi155.stdout:2/647: dread d0/d5/d6/d5f/f99 [0,4194304] 0 2023-12-16T05:56:37.079 INFO:tasks.workunit.client.0.smithi155.stdout:7/613: rmdir d0/d1/db4 0 2023-12-16T05:56:37.079 INFO:tasks.workunit.client.0.smithi155.stdout:7/614: chown d0/d6a/d1a/fa9 17685 1 2023-12-16T05:56:37.080 INFO:tasks.workunit.client.0.smithi155.stdout:2/648: creat d0/d7/d57/d9b/fd6 x:0 0 0 2023-12-16T05:56:37.080 INFO:tasks.workunit.client.0.smithi155.stdout:2/649: truncate d0/d7/d69/f4e 4239209 0 2023-12-16T05:56:37.082 INFO:tasks.workunit.client.0.smithi155.stdout:2/650: write d0/d7/dd/f6e [175786,69111] 0 2023-12-16T05:56:37.082 INFO:tasks.workunit.client.0.smithi155.stdout:2/651: chown d0/d7/d57/d9b 0 1 2023-12-16T05:56:37.082 INFO:tasks.workunit.client.1.smithi156.stdout:6/361: dread d9/d1c/f2c [0,4194304] 0 2023-12-16T05:56:37.085 INFO:tasks.workunit.client.0.smithi155.stdout:7/615: rename d0/d6a/d1a/f54 to d0/d1b/d78/fcc 0 2023-12-16T05:56:37.091 INFO:tasks.workunit.client.0.smithi155.stdout:2/652: symlink d0/d7/dd/d14/ld7 0 2023-12-16T05:56:37.092 INFO:tasks.workunit.client.0.smithi155.stdout:2/653: read d0/d7/f73 [1347230,18872] 0 2023-12-16T05:56:37.092 INFO:tasks.workunit.client.0.smithi155.stdout:2/654: chown d0/d7/dd/d49/d4b/d80/l76 1 1 2023-12-16T05:56:37.093 INFO:tasks.workunit.client.1.smithi156.stdout:9/395: dwrite d6/f46 [0,4194304] 0 2023-12-16T05:56:37.094 INFO:tasks.workunit.client.1.smithi156.stdout:9/396: fdatasync d6/d19/f24 0 2023-12-16T05:56:37.096 INFO:tasks.workunit.client.1.smithi156.stdout:9/397: rmdir d6/d19/d30/d48 39 2023-12-16T05:56:37.096 INFO:tasks.workunit.client.0.smithi155.stdout:2/655: truncate d0/d7/d1f/fb9 3297324 0 2023-12-16T05:56:37.096 INFO:tasks.workunit.client.0.smithi155.stdout:3/522: dread d0/d1a/d33/d57/f6c [0,4194304] 0 2023-12-16T05:56:37.097 INFO:tasks.workunit.client.0.smithi155.stdout:3/523: chown d0/d1a/d33/c77 1442063 1 2023-12-16T05:56:37.101 INFO:tasks.workunit.client.0.smithi155.stdout:2/656: symlink d0/d7/dd/d49/d4b/d8c/dcd/dd2/ld8 0 2023-12-16T05:56:37.101 INFO:tasks.workunit.client.0.smithi155.stdout:9/874: dwrite da/d15/d17/d36/d54/f7f [4194304,4194304] 0 2023-12-16T05:56:37.102 INFO:tasks.workunit.client.0.smithi155.stdout:2/657: mknod d0/d7/d1f/d74/d85/cd9 0 2023-12-16T05:56:37.103 INFO:tasks.workunit.client.0.smithi155.stdout:3/524: write d0/f11 [314134,111006] 0 2023-12-16T05:56:37.103 INFO:tasks.workunit.client.0.smithi155.stdout:3/525: stat d0/c19 0 2023-12-16T05:56:37.104 INFO:tasks.workunit.client.0.smithi155.stdout:9/875: mknod da/d15/d17/d36/d5b/d60/db9/de4/c127 0 2023-12-16T05:56:37.105 INFO:tasks.workunit.client.0.smithi155.stdout:2/658: creat d0/d7/dd/d49/d4b/d7f/fda x:0 0 0 2023-12-16T05:56:37.106 INFO:tasks.workunit.client.0.smithi155.stdout:9/876: rmdir da/d15/d17/d36/d54/d76 39 2023-12-16T05:56:37.107 INFO:tasks.workunit.client.0.smithi155.stdout:9/877: chown da/dec/c125 15 1 2023-12-16T05:56:37.107 INFO:tasks.workunit.client.0.smithi155.stdout:9/878: stat da/d15/d17/d24/d62/dea/d117 0 2023-12-16T05:56:37.112 INFO:tasks.workunit.client.0.smithi155.stdout:2/659: write d0/f30 [471644,112997] 0 2023-12-16T05:56:37.112 INFO:tasks.workunit.client.0.smithi155.stdout:7/616: dwrite d0/d1b/fab [0,4194304] 0 2023-12-16T05:56:37.113 INFO:tasks.workunit.client.0.smithi155.stdout:7/617: dread - d0/d6a/d1a/d8c/d34/d6c/fcb zero size 2023-12-16T05:56:37.113 INFO:tasks.workunit.client.0.smithi155.stdout:7/618: write d0/d6a/d1a/d8c/d34/d4b/d64/fa4 [761332,85301] 0 2023-12-16T05:56:37.113 INFO:tasks.workunit.client.1.smithi156.stdout:9/398: dwrite d6/d19/d30/f7c [0,4194304] 0 2023-12-16T05:56:37.115 INFO:tasks.workunit.client.0.smithi155.stdout:9/879: dread da/d15/d17/d24/d62/f97 [0,4194304] 0 2023-12-16T05:56:37.115 INFO:tasks.workunit.client.1.smithi156.stdout:9/399: rename d6/d19/d25/d3a/d5e/f81 to d6/d19/d25/d72/f84 0 2023-12-16T05:56:37.115 INFO:tasks.workunit.client.1.smithi156.stdout:1/253: dwrite d3/fb [0,4194304] 0 2023-12-16T05:56:37.116 INFO:tasks.workunit.client.1.smithi156.stdout:0/403: dwrite d2/d7/dd/d29/f62 [0,4194304] 0 2023-12-16T05:56:37.116 INFO:tasks.workunit.client.1.smithi156.stdout:0/404: read d2/d23/f27 [891464,123228] 0 2023-12-16T05:56:37.117 INFO:tasks.workunit.client.1.smithi156.stdout:1/254: mkdir d3/d17/d4d 0 2023-12-16T05:56:37.119 INFO:tasks.workunit.client.1.smithi156.stdout:9/400: link d6/d19/d30/d48/l53 d6/d19/l85 0 2023-12-16T05:56:37.120 INFO:tasks.workunit.client.0.smithi155.stdout:7/619: mknod d0/d6a/d1a/d8c/d42/ccd 0 2023-12-16T05:56:37.123 INFO:tasks.workunit.client.1.smithi156.stdout:0/405: mknod d2/d7/dd/d29/d38/d51/c79 0 2023-12-16T05:56:37.124 INFO:tasks.workunit.client.1.smithi156.stdout:9/401: creat d6/d2e/f86 x:0 0 0 2023-12-16T05:56:37.125 INFO:tasks.workunit.client.0.smithi155.stdout:3/526: dwrite d0/d1e/f68 [0,4194304] 0 2023-12-16T05:56:37.126 INFO:tasks.workunit.client.1.smithi156.stdout:0/406: read d2/d7/dd/d1c/f25 [2701378,18794] 0 2023-12-16T05:56:37.128 INFO:tasks.workunit.client.1.smithi156.stdout:9/402: rename d6/d19/d25/d3a/d57 to d6/d19/d30/d48/d87 0 2023-12-16T05:56:37.129 INFO:tasks.workunit.client.0.smithi155.stdout:3/527: rename d0/d14/d36/d79/d80 to d0/d14/d87/d94/da1 0 2023-12-16T05:56:37.129 INFO:tasks.workunit.client.0.smithi155.stdout:3/528: stat d0/d1a/l24 0 2023-12-16T05:56:37.131 INFO:tasks.workunit.client.0.smithi155.stdout:2/660: rename d0/d7/dd/d49/d4b/d7f to d0/d7/dd/d49/d4b/ddb 0 2023-12-16T05:56:37.131 INFO:tasks.workunit.client.0.smithi155.stdout:2/661: fdatasync d0/f2 0 2023-12-16T05:56:37.131 INFO:tasks.workunit.client.1.smithi156.stdout:9/403: mkdir d6/d19/d25/d3a/d88 0 2023-12-16T05:56:37.134 INFO:tasks.workunit.client.1.smithi156.stdout:9/404: creat d6/d2e/f89 x:0 0 0 2023-12-16T05:56:37.134 INFO:tasks.workunit.client.1.smithi156.stdout:9/405: getdents d6/d19/d25/d3a/d80 0 2023-12-16T05:56:37.138 INFO:tasks.workunit.client.1.smithi156.stdout:1/255: dread d3/f6 [0,4194304] 0 2023-12-16T05:56:37.141 INFO:tasks.workunit.client.1.smithi156.stdout:1/256: creat d3/d17/d2d/f4e x:0 0 0 2023-12-16T05:56:37.142 INFO:tasks.workunit.client.0.smithi155.stdout:9/880: dwrite da/d15/d17/d24/d62/d91/f110 [0,4194304] 0 2023-12-16T05:56:37.145 INFO:tasks.workunit.client.1.smithi156.stdout:1/257: write d3/fb [974380,17308] 0 2023-12-16T05:56:37.145 INFO:tasks.workunit.client.0.smithi155.stdout:9/881: mkdir da/d15/d128 0 2023-12-16T05:56:37.147 INFO:tasks.workunit.client.1.smithi156.stdout:0/407: dwrite d2/d7/dd/d1c/f25 [4194304,4194304] 0 2023-12-16T05:56:37.149 INFO:tasks.workunit.client.0.smithi155.stdout:9/882: dread da/d15/f2f [0,4194304] 0 2023-12-16T05:56:37.149 INFO:tasks.workunit.client.1.smithi156.stdout:0/408: getdents d2/d7/dd/d1c 0 2023-12-16T05:56:37.149 INFO:tasks.workunit.client.1.smithi156.stdout:0/409: dread - d2/d23/f70 zero size 2023-12-16T05:56:37.150 INFO:tasks.workunit.client.1.smithi156.stdout:0/410: mknod d2/d7/dd/d2d/c7a 0 2023-12-16T05:56:37.154 INFO:tasks.workunit.client.1.smithi156.stdout:0/411: mknod d2/d7/dd/d2d/c7b 0 2023-12-16T05:56:37.154 INFO:tasks.workunit.client.1.smithi156.stdout:0/412: symlink d2/d7/dd/d66/l7c 0 2023-12-16T05:56:37.154 INFO:tasks.workunit.client.1.smithi156.stdout:0/413: write d2/d7/dd/d29/d38/d51/d65/f6f [19078,97654] 0 2023-12-16T05:56:37.155 INFO:tasks.workunit.client.0.smithi155.stdout:3/529: dwrite d0/d14/d36/f89 [0,4194304] 0 2023-12-16T05:56:37.156 INFO:tasks.workunit.client.0.smithi155.stdout:7/620: dwrite d0/d6a/d31/f8a [0,4194304] 0 2023-12-16T05:56:37.156 INFO:tasks.workunit.client.0.smithi155.stdout:7/621: chown d0/d6a/d1a/d38/fc0 7487 1 2023-12-16T05:56:37.158 INFO:tasks.workunit.client.1.smithi156.stdout:1/258: dread d3/d17/d19/f2a [0,4194304] 0 2023-12-16T05:56:37.158 INFO:tasks.workunit.client.1.smithi156.stdout:0/414: write f0 [3245785,74594] 0 2023-12-16T05:56:37.158 INFO:tasks.workunit.client.1.smithi156.stdout:0/415: readlink d2/l1d 0 2023-12-16T05:56:37.159 INFO:tasks.workunit.client.1.smithi156.stdout:1/259: mkdir d3/d1b/d27/d4f 0 2023-12-16T05:56:37.159 INFO:tasks.workunit.client.1.smithi156.stdout:9/406: dwrite d6/d2e/f50 [0,4194304] 0 2023-12-16T05:56:37.159 INFO:tasks.workunit.client.1.smithi156.stdout:9/407: fsync d6/d19/d30/d48/f75 0 2023-12-16T05:56:37.160 INFO:tasks.workunit.client.0.smithi155.stdout:3/530: write d0/d1e/f23 [1442239,56227] 0 2023-12-16T05:56:37.160 INFO:tasks.workunit.client.1.smithi156.stdout:0/416: unlink d2/d23/d4a/f5a 0 2023-12-16T05:56:37.161 INFO:tasks.workunit.client.0.smithi155.stdout:7/622: creat d0/fce x:0 0 0 2023-12-16T05:56:37.161 INFO:tasks.workunit.client.0.smithi155.stdout:7/623: read - d0/d6a/d85/fc3 zero size 2023-12-16T05:56:37.162 INFO:tasks.workunit.client.1.smithi156.stdout:1/260: unlink d3/d17/d2d/l44 0 2023-12-16T05:56:37.162 INFO:tasks.workunit.client.1.smithi156.stdout:1/261: read d3/d1b/d27/f3e [8778,10686] 0 2023-12-16T05:56:37.162 INFO:tasks.workunit.client.1.smithi156.stdout:9/408: getdents d6/d19/d30/d48 0 2023-12-16T05:56:37.162 INFO:tasks.workunit.client.1.smithi156.stdout:1/262: mknod d3/d17/d19/c50 0 2023-12-16T05:56:37.162 INFO:tasks.workunit.client.1.smithi156.stdout:1/263: dread - d3/d17/d1c/f31 zero size 2023-12-16T05:56:37.162 INFO:tasks.workunit.client.1.smithi156.stdout:9/409: mkdir d6/d2e/d8a 0 2023-12-16T05:56:37.163 INFO:tasks.workunit.client.0.smithi155.stdout:7/624: creat d0/d6a/d31/fcf x:0 0 0 2023-12-16T05:56:37.163 INFO:tasks.workunit.client.0.smithi155.stdout:3/531: symlink d0/d1e/la2 0 2023-12-16T05:56:37.163 INFO:tasks.workunit.client.0.smithi155.stdout:3/532: chown d0/d14/d36/d47/c71 2811754 1 2023-12-16T05:56:37.163 INFO:tasks.workunit.client.1.smithi156.stdout:1/264: link d3/d17/d19/f2a d3/d17/d1c/d22/f51 0 2023-12-16T05:56:37.164 INFO:tasks.workunit.client.0.smithi155.stdout:7/625: dread d0/d6a/d31/f46 [0,4194304] 0 2023-12-16T05:56:37.164 INFO:tasks.workunit.client.1.smithi156.stdout:9/410: mkdir d6/d19/d25/d3a/d88/d8b 0 2023-12-16T05:56:37.166 INFO:tasks.workunit.client.0.smithi155.stdout:3/533: rename d0/d14/d36/d47/d61 to d0/d1a/da3 0 2023-12-16T05:56:37.166 INFO:tasks.workunit.client.1.smithi156.stdout:1/265: unlink d3/d1b/d27/f49 0 2023-12-16T05:56:37.166 INFO:tasks.workunit.client.0.smithi155.stdout:7/626: getdents d0/d6a/d1a/d8c/d34 0 2023-12-16T05:56:37.167 INFO:tasks.workunit.client.0.smithi155.stdout:3/534: dread d0/d14/d36/d47/d5f/f7d [0,4194304] 0 2023-12-16T05:56:37.167 INFO:tasks.workunit.client.1.smithi156.stdout:9/411: chown d6/d19/d25/d3a/d5e/l5f 1040 1 2023-12-16T05:56:37.168 INFO:tasks.workunit.client.0.smithi155.stdout:9/883: write da/d15/d17/d36/d5b/f6d [1214147,100963] 0 2023-12-16T05:56:37.168 INFO:tasks.workunit.client.1.smithi156.stdout:9/412: read d6/d2e/f52 [793371,89009] 0 2023-12-16T05:56:37.169 INFO:tasks.workunit.client.1.smithi156.stdout:1/266: creat d3/d17/f52 x:0 0 0 2023-12-16T05:56:37.169 INFO:tasks.workunit.client.1.smithi156.stdout:1/267: stat d3/d1b/f46 0 2023-12-16T05:56:37.169 INFO:tasks.workunit.client.1.smithi156.stdout:1/268: fdatasync d3/d1b/d27/f34 0 2023-12-16T05:56:37.169 INFO:tasks.workunit.client.1.smithi156.stdout:1/269: chown d3/d17/d2d/c36 6 1 2023-12-16T05:56:37.170 INFO:tasks.workunit.client.0.smithi155.stdout:7/627: creat d0/d6a/d1a/d8c/d34/d4b/d60/fd0 x:0 0 0 2023-12-16T05:56:37.170 INFO:tasks.workunit.client.0.smithi155.stdout:7/628: readlink d0/d6a/d1a/l1f 0 2023-12-16T05:56:37.170 INFO:tasks.workunit.client.0.smithi155.stdout:7/629: chown d0/d6a/d1a/d22/f23 32294 1 2023-12-16T05:56:37.170 INFO:tasks.workunit.client.1.smithi156.stdout:1/270: creat d3/d17/d2d/f53 x:0 0 0 2023-12-16T05:56:37.171 INFO:tasks.workunit.client.1.smithi156.stdout:1/271: readlink d3/d17/l30 0 2023-12-16T05:56:37.172 INFO:tasks.workunit.client.0.smithi155.stdout:7/630: rename d0/d6a/d1a/d2b/d2c/d5d/caf to d0/d6a/d1a/d8c/d42/d98/cd1 0 2023-12-16T05:56:37.173 INFO:tasks.workunit.client.1.smithi156.stdout:1/272: link d3/d17/d19/c50 d3/d17/c54 0 2023-12-16T05:56:37.175 INFO:tasks.workunit.client.1.smithi156.stdout:1/273: symlink d3/d17/d19/l55 0 2023-12-16T05:56:37.177 INFO:tasks.workunit.client.1.smithi156.stdout:1/274: link d3/f18 d3/d17/d4d/f56 0 2023-12-16T05:56:37.177 INFO:tasks.workunit.client.1.smithi156.stdout:0/417: truncate d2/d7/dd/d1c/f71 5317560 0 2023-12-16T05:56:37.179 INFO:tasks.workunit.client.1.smithi156.stdout:1/275: mkdir d3/d17/d1c/d22/d57 0 2023-12-16T05:56:37.179 INFO:tasks.workunit.client.1.smithi156.stdout:1/276: stat d3/fb 0 2023-12-16T05:56:37.181 INFO:tasks.workunit.client.1.smithi156.stdout:4/372: sync 2023-12-16T05:56:37.181 INFO:tasks.workunit.client.1.smithi156.stdout:8/298: sync 2023-12-16T05:56:37.181 INFO:tasks.workunit.client.1.smithi156.stdout:4/373: chown d9/d2b/f31 0 1 2023-12-16T05:56:37.181 INFO:tasks.workunit.client.1.smithi156.stdout:4/374: chown d9/d2b/l4a 68113687 1 2023-12-16T05:56:37.181 INFO:tasks.workunit.client.1.smithi156.stdout:0/418: write d2/d23/f32 [662414,88670] 0 2023-12-16T05:56:37.181 INFO:tasks.workunit.client.1.smithi156.stdout:0/419: read - d2/d7/dd/d29/d4b/d76/f78 zero size 2023-12-16T05:56:37.182 INFO:tasks.workunit.client.1.smithi156.stdout:1/277: rename d3/f16 to d3/d17/d19/f58 0 2023-12-16T05:56:37.183 INFO:tasks.workunit.client.0.smithi155.stdout:3/535: dread d0/d1e/f23 [0,4194304] 0 2023-12-16T05:56:37.184 INFO:tasks.workunit.client.1.smithi156.stdout:8/299: rename d3/f17 to d3/f5e 0 2023-12-16T05:56:37.184 INFO:tasks.workunit.client.1.smithi156.stdout:8/300: chown d3/d7/f31 1290813 1 2023-12-16T05:56:37.186 INFO:tasks.workunit.client.1.smithi156.stdout:1/278: unlink d3/l3d 0 2023-12-16T05:56:37.186 INFO:tasks.workunit.client.1.smithi156.stdout:1/279: dread - d3/d17/d1c/f4b zero size 2023-12-16T05:56:37.186 INFO:tasks.workunit.client.1.smithi156.stdout:1/280: dread - d3/d1b/f40 zero size 2023-12-16T05:56:37.186 INFO:tasks.workunit.client.1.smithi156.stdout:1/281: fdatasync d3/d1b/d27/f34 0 2023-12-16T05:56:37.187 INFO:tasks.workunit.client.1.smithi156.stdout:1/282: write d3/d1b/d27/f34 [979316,25665] 0 2023-12-16T05:56:37.187 INFO:tasks.workunit.client.0.smithi155.stdout:3/536: write d0/d14/d36/d47/f98 [7841156,3737] 0 2023-12-16T05:56:37.188 INFO:tasks.workunit.client.1.smithi156.stdout:8/301: truncate d3/d12/f25 2911802 0 2023-12-16T05:56:37.188 INFO:tasks.workunit.client.1.smithi156.stdout:8/302: write d3/d7/d27/d46/f4e [361416,43846] 0 2023-12-16T05:56:37.188 INFO:tasks.workunit.client.1.smithi156.stdout:8/303: chown d3/d7/d27/d46 50 1 2023-12-16T05:56:37.190 INFO:tasks.workunit.client.1.smithi156.stdout:1/283: mknod d3/d17/d1c/c59 0 2023-12-16T05:56:37.190 INFO:tasks.workunit.client.1.smithi156.stdout:1/284: truncate d3/d17/f52 864179 0 2023-12-16T05:56:37.192 INFO:tasks.workunit.client.0.smithi155.stdout:7/631: dwrite d0/d6a/d1a/d38/f9d [0,4194304] 0 2023-12-16T05:56:37.195 INFO:tasks.workunit.client.1.smithi156.stdout:0/420: write d2/d7/dd/d29/f4f [3346914,67209] 0 2023-12-16T05:56:37.195 INFO:tasks.workunit.client.1.smithi156.stdout:1/285: read d3/d17/d1c/f2b [3756762,96815] 0 2023-12-16T05:56:37.196 INFO:tasks.workunit.client.0.smithi155.stdout:7/632: link d0/d6a/d1a/d8c/f75 d0/fd2 0 2023-12-16T05:56:37.196 INFO:tasks.workunit.client.0.smithi155.stdout:7/633: stat d0/d1/f61 0 2023-12-16T05:56:37.196 INFO:tasks.workunit.client.0.smithi155.stdout:7/634: fsync d0/d1/f24 0 2023-12-16T05:56:37.198 INFO:tasks.workunit.client.1.smithi156.stdout:1/286: creat d3/f5a x:0 0 0 2023-12-16T05:56:37.198 INFO:tasks.workunit.client.0.smithi155.stdout:7/635: creat d0/d6a/d1a/d2b/fd3 x:0 0 0 2023-12-16T05:56:37.199 INFO:tasks.workunit.client.0.smithi155.stdout:7/636: dread d0/d1b/d78/fcc [0,4194304] 0 2023-12-16T05:56:37.215 INFO:tasks.workunit.client.1.smithi156.stdout:9/413: dwrite d6/d2e/f86 [0,4194304] 0 2023-12-16T05:56:37.215 INFO:tasks.workunit.client.1.smithi156.stdout:4/375: dwrite d9/f24 [0,4194304] 0 2023-12-16T05:56:37.216 INFO:tasks.workunit.client.0.smithi155.stdout:9/884: dwrite da/d15/d17/d36/d54/f7f [4194304,4194304] 0 2023-12-16T05:56:37.216 INFO:tasks.workunit.client.1.smithi156.stdout:8/304: dwrite d3/d6/f36 [0,4194304] 0 2023-12-16T05:56:37.216 INFO:tasks.workunit.client.1.smithi156.stdout:1/287: dwrite d3/d17/d2d/f4e [0,4194304] 0 2023-12-16T05:56:37.217 INFO:tasks.workunit.client.1.smithi156.stdout:9/414: rmdir d6/d19/d30/d48 39 2023-12-16T05:56:37.217 INFO:tasks.workunit.client.1.smithi156.stdout:4/376: mknod d9/d2c/d48/c7f 0 2023-12-16T05:56:37.219 INFO:tasks.workunit.client.1.smithi156.stdout:8/305: symlink d3/d7/d27/l5f 0 2023-12-16T05:56:37.222 INFO:tasks.workunit.client.1.smithi156.stdout:9/415: write d6/d19/d25/d3a/f60 [21076,7685] 0 2023-12-16T05:56:37.223 INFO:tasks.workunit.client.1.smithi156.stdout:4/377: rename d9/d2b/d35/l5e to d9/d2c/l80 0 2023-12-16T05:56:37.224 INFO:tasks.workunit.client.1.smithi156.stdout:4/378: write f5 [1838145,36587] 0 2023-12-16T05:56:37.227 INFO:tasks.workunit.client.1.smithi156.stdout:9/416: getdents d6 0 2023-12-16T05:56:37.227 INFO:tasks.workunit.client.1.smithi156.stdout:9/417: truncate d6/d2e/f66 591573 0 2023-12-16T05:56:37.227 INFO:tasks.workunit.client.0.smithi155.stdout:9/885: dread da/d15/d17/d24/d62/f68 [0,4194304] 0 2023-12-16T05:56:37.228 INFO:tasks.workunit.client.0.smithi155.stdout:9/886: creat da/d15/d17/d36/d5b/f129 x:0 0 0 2023-12-16T05:56:37.229 INFO:tasks.workunit.client.1.smithi156.stdout:4/379: truncate d9/f22 867630 0 2023-12-16T05:56:37.229 INFO:tasks.workunit.client.1.smithi156.stdout:4/380: chown d9/f15 52009 1 2023-12-16T05:56:37.230 INFO:tasks.workunit.client.0.smithi155.stdout:9/887: rename da/d15/d17/d24/f64 to da/d15/d17/d36/d5b/d60/db9/f12a 0 2023-12-16T05:56:37.230 INFO:tasks.workunit.client.1.smithi156.stdout:9/418: creat d6/f8c x:0 0 0 2023-12-16T05:56:37.231 INFO:tasks.workunit.client.1.smithi156.stdout:4/381: creat d9/d2c/d7a/f81 x:0 0 0 2023-12-16T05:56:37.232 INFO:tasks.workunit.client.1.smithi156.stdout:9/419: readlink d6/d19/d25/d3a/d5e/l5f 0 2023-12-16T05:56:37.234 INFO:tasks.workunit.client.1.smithi156.stdout:4/382: mkdir d9/d43/d58/d7d/d82 0 2023-12-16T05:56:37.235 INFO:tasks.workunit.client.1.smithi156.stdout:0/421: dwrite d2/d7/dd/d29/d2e/f53 [0,4194304] 0 2023-12-16T05:56:37.236 INFO:tasks.workunit.client.0.smithi155.stdout:7/637: dwrite d0/d1b/dbe/fc4 [0,4194304] 0 2023-12-16T05:56:37.236 INFO:tasks.workunit.client.0.smithi155.stdout:7/638: fdatasync d0/d1b/d78/fcc 0 2023-12-16T05:56:37.236 INFO:tasks.workunit.client.1.smithi156.stdout:9/420: mkdir d6/d19/d30/d48/d87/d8d 0 2023-12-16T05:56:37.238 INFO:tasks.workunit.client.0.smithi155.stdout:7/639: rmdir d0/d6a/d1a/d8c/d34/d4b/d64/d6f 39 2023-12-16T05:56:37.239 INFO:tasks.workunit.client.0.smithi155.stdout:0/683: sync 2023-12-16T05:56:37.239 INFO:tasks.workunit.client.0.smithi155.stdout:0/684: stat d7/d13/d46 0 2023-12-16T05:56:37.240 INFO:tasks.workunit.client.1.smithi156.stdout:4/383: creat d9/d2b/d56/d77/f83 x:0 0 0 2023-12-16T05:56:37.240 INFO:tasks.workunit.client.1.smithi156.stdout:4/384: dread - d9/d43/d58/f5c zero size 2023-12-16T05:56:37.240 INFO:tasks.workunit.client.0.smithi155.stdout:0/685: truncate d7/df/d41/d23/d36/f54 2828048 0 2023-12-16T05:56:37.241 INFO:tasks.workunit.client.0.smithi155.stdout:0/686: mkdir d7/df/d41/d23/de1 0 2023-12-16T05:56:37.242 INFO:tasks.workunit.client.1.smithi156.stdout:8/306: dwrite d3/d6/f5 [0,4194304] 0 2023-12-16T05:56:37.245 INFO:tasks.workunit.client.1.smithi156.stdout:0/422: symlink d2/d7/dd/d2d/d5e/l7d 0 2023-12-16T05:56:37.247 INFO:tasks.workunit.client.1.smithi156.stdout:9/421: mknod d6/d19/d30/d5b/c8e 0 2023-12-16T05:56:37.248 INFO:tasks.workunit.client.1.smithi156.stdout:4/385: creat d9/d2c/d48/f84 x:0 0 0 2023-12-16T05:56:37.250 INFO:tasks.workunit.client.1.smithi156.stdout:8/307: creat d3/d12/d16/d54/f60 x:0 0 0 2023-12-16T05:56:37.250 INFO:tasks.workunit.client.0.smithi155.stdout:9/888: dwrite da/d15/d17/d24/d26/f29 [0,4194304] 0 2023-12-16T05:56:37.251 INFO:tasks.workunit.client.1.smithi156.stdout:0/423: mkdir d2/d7/dd/d29/d38/d51/d65/d7e 0 2023-12-16T05:56:37.251 INFO:tasks.workunit.client.1.smithi156.stdout:0/424: truncate d2/f43 658139 0 2023-12-16T05:56:37.252 INFO:tasks.workunit.client.1.smithi156.stdout:9/422: chown d6/d2e/f66 1401024 1 2023-12-16T05:56:37.254 INFO:tasks.workunit.client.0.smithi155.stdout:9/889: write da/fc6 [717006,31853] 0 2023-12-16T05:56:37.255 INFO:tasks.workunit.client.1.smithi156.stdout:4/386: creat d9/d2b/d56/f85 x:0 0 0 2023-12-16T05:56:37.255 INFO:tasks.workunit.client.1.smithi156.stdout:4/387: write f0 [5232204,108110] 0 2023-12-16T05:56:37.257 INFO:tasks.workunit.client.1.smithi156.stdout:8/308: symlink d3/d12/l61 0 2023-12-16T05:56:37.259 INFO:tasks.workunit.client.1.smithi156.stdout:3/290: sync 2023-12-16T05:56:37.261 INFO:tasks.workunit.client.1.smithi156.stdout:6/362: sync 2023-12-16T05:56:37.262 INFO:tasks.workunit.client.1.smithi156.stdout:2/386: sync 2023-12-16T05:56:37.262 INFO:tasks.workunit.client.1.smithi156.stdout:5/585: sync 2023-12-16T05:56:37.262 INFO:tasks.workunit.client.1.smithi156.stdout:5/586: getdents da/dc/d2d/d4d/db9 0 2023-12-16T05:56:37.263 INFO:tasks.workunit.client.1.smithi156.stdout:7/569: sync 2023-12-16T05:56:37.264 INFO:tasks.workunit.client.0.smithi155.stdout:0/687: dwrite d7/df/d73/d8d/d4d/faf [4194304,4194304] 0 2023-12-16T05:56:37.264 INFO:tasks.workunit.client.0.smithi155.stdout:0/688: write d7/df/d73/fac [500002,27863] 0 2023-12-16T05:56:37.266 INFO:tasks.workunit.client.1.smithi156.stdout:2/387: dread d9/dd/d3f/f67 [0,4194304] 0 2023-12-16T05:56:37.267 INFO:tasks.workunit.client.0.smithi155.stdout:0/689: creat d7/df/d73/fe2 x:0 0 0 2023-12-16T05:56:37.267 INFO:tasks.workunit.client.1.smithi156.stdout:6/363: link d9/d13/d2f/f3f d9/d13/f73 0 2023-12-16T05:56:37.268 INFO:tasks.workunit.client.1.smithi156.stdout:6/364: dread - d9/d1c/f52 zero size 2023-12-16T05:56:37.268 INFO:tasks.workunit.client.1.smithi156.stdout:6/365: truncate d9/d13/d2f/f3f 3203602 0 2023-12-16T05:56:37.268 INFO:tasks.workunit.client.0.smithi155.stdout:0/690: mknod d7/df/d41/dd8/ce3 0 2023-12-16T05:56:37.269 INFO:tasks.workunit.client.1.smithi156.stdout:5/587: creat da/dc/d2d/db0/fba x:0 0 0 2023-12-16T05:56:37.270 INFO:tasks.workunit.client.0.smithi155.stdout:0/691: mknod d7/d13/d45/d3e/ce4 0 2023-12-16T05:56:37.270 INFO:tasks.workunit.client.0.smithi155.stdout:0/692: chown d7/df/d41/d23/l2c 74 1 2023-12-16T05:56:37.271 INFO:tasks.workunit.client.1.smithi156.stdout:7/570: creat d1e/fc5 x:0 0 0 2023-12-16T05:56:37.271 INFO:tasks.workunit.client.1.smithi156.stdout:7/571: stat d1e/d39/d93/l95 0 2023-12-16T05:56:37.271 INFO:tasks.workunit.client.1.smithi156.stdout:2/388: truncate d9/d68/f6c 3611492 0 2023-12-16T05:56:37.272 INFO:tasks.workunit.client.0.smithi155.stdout:0/693: mkdir d7/d13/d46/d81/de5 0 2023-12-16T05:56:37.273 INFO:tasks.workunit.client.1.smithi156.stdout:7/572: read d1e/d55/d71/d61/daa/f84 [3851240,125491] 0 2023-12-16T05:56:37.273 INFO:tasks.workunit.client.1.smithi156.stdout:6/366: rename d9/f3b to d9/d1c/d50/f74 0 2023-12-16T05:56:37.274 INFO:tasks.workunit.client.1.smithi156.stdout:5/588: rename da/l47 to da/dc/d4b/d6c/d7c/lbb 0 2023-12-16T05:56:37.275 INFO:tasks.workunit.client.1.smithi156.stdout:5/589: creat da/dc/d2d/d4d/d54/d90/fbc x:0 0 0 2023-12-16T05:56:37.275 INFO:tasks.workunit.client.1.smithi156.stdout:5/590: fdatasync da/dc/d2d/d4d/d54/fa1 0 2023-12-16T05:56:37.276 INFO:tasks.workunit.client.1.smithi156.stdout:2/389: dread d9/dd/d17/f61 [0,4194304] 0 2023-12-16T05:56:37.277 INFO:tasks.workunit.client.1.smithi156.stdout:5/591: creat da/dc/d2d/d4d/fbd x:0 0 0 2023-12-16T05:56:37.277 INFO:tasks.workunit.client.1.smithi156.stdout:0/425: dwrite d2/d7/dd/d29/d38/f68 [0,4194304] 0 2023-12-16T05:56:37.286 INFO:tasks.workunit.client.1.smithi156.stdout:0/426: dread d2/d7/dd/d29/d38/d3f/f58 [0,4194304] 0 2023-12-16T05:56:37.286 INFO:tasks.workunit.client.1.smithi156.stdout:0/427: readlink d2/d7/dd/l17 0 2023-12-16T05:56:37.286 INFO:tasks.workunit.client.1.smithi156.stdout:0/428: truncate d2/d7/dd/d29/d4b/d76/f78 931386 0 2023-12-16T05:56:37.286 INFO:tasks.workunit.client.1.smithi156.stdout:0/429: dread - d2/d7/dd/d29/d38/d51/d69/f73 zero size 2023-12-16T05:56:37.287 INFO:tasks.workunit.client.1.smithi156.stdout:2/390: dread d9/d12/d3d/f48 [0,4194304] 0 2023-12-16T05:56:37.287 INFO:tasks.workunit.client.1.smithi156.stdout:0/430: symlink d2/d7/dd/d1c/l7f 0 2023-12-16T05:56:37.300 INFO:tasks.workunit.client.1.smithi156.stdout:8/309: dwrite d3/d6/f5 [0,4194304] 0 2023-12-16T05:56:37.300 INFO:tasks.workunit.client.1.smithi156.stdout:8/310: write d3/d6/f36 [13353232,5161] 0 2023-12-16T05:56:37.300 INFO:tasks.workunit.client.0.smithi155.stdout:0/694: dwrite d7/df/d65/f39 [0,4194304] 0 2023-12-16T05:56:37.301 INFO:tasks.workunit.client.1.smithi156.stdout:8/311: mkdir d3/d7/d62 0 2023-12-16T05:56:37.301 INFO:tasks.workunit.client.1.smithi156.stdout:8/312: dread - d3/d7/f31 zero size 2023-12-16T05:56:37.303 INFO:tasks.workunit.client.1.smithi156.stdout:3/291: dwrite dc/d10/d3d/f37 [0,4194304] 0 2023-12-16T05:56:37.307 INFO:tasks.workunit.client.1.smithi156.stdout:3/292: symlink dc/d10/d3d/d4e/l6d 0 2023-12-16T05:56:37.309 INFO:tasks.workunit.client.1.smithi156.stdout:3/293: mkdir dc/d56/d67/d6e 0 2023-12-16T05:56:37.309 INFO:tasks.workunit.client.1.smithi156.stdout:3/294: write dc/df/f55 [64111,129599] 0 2023-12-16T05:56:37.309 INFO:tasks.workunit.client.1.smithi156.stdout:3/295: write dc/d10/d1d/f5d [469665,106203] 0 2023-12-16T05:56:37.311 INFO:tasks.workunit.client.0.smithi155.stdout:9/890: dwrite da/d15/d17/d36/dc1/f11a [0,4194304] 0 2023-12-16T05:56:37.312 INFO:tasks.workunit.client.1.smithi156.stdout:6/367: dwrite d9/f6d [0,4194304] 0 2023-12-16T05:56:37.312 INFO:tasks.workunit.client.1.smithi156.stdout:6/368: fdatasync f8 0 2023-12-16T05:56:37.312 INFO:tasks.workunit.client.1.smithi156.stdout:6/369: dread - d9/d1c/f32 zero size 2023-12-16T05:56:37.313 INFO:tasks.workunit.client.1.smithi156.stdout:7/573: dwrite d1e/d55/d71/d61/daa/f99 [0,4194304] 0 2023-12-16T05:56:37.313 INFO:tasks.workunit.client.1.smithi156.stdout:7/574: chown d1e/d55/d71/d61/daa/f50 53935238 1 2023-12-16T05:56:37.313 INFO:tasks.workunit.client.1.smithi156.stdout:7/575: fsync d1e/d55/d71/d61/dac/fb0 0 2023-12-16T05:56:37.313 INFO:tasks.workunit.client.1.smithi156.stdout:7/576: fsync d1e/d55/d71/f49 0 2023-12-16T05:56:37.314 INFO:tasks.workunit.client.0.smithi155.stdout:9/891: write da/d15/d17/d24/d62/d91/dc0/fd9 [3327287,3035] 0 2023-12-16T05:56:37.314 INFO:tasks.workunit.client.0.smithi155.stdout:9/892: fdatasync da/d15/d17/d36/d5b/d60/fdf 0 2023-12-16T05:56:37.314 INFO:tasks.workunit.client.0.smithi155.stdout:9/893: rmdir da/d15/d17/d36/d54 39 2023-12-16T05:56:37.315 INFO:tasks.workunit.client.1.smithi156.stdout:3/296: creat dc/d56/d67/f6f x:0 0 0 2023-12-16T05:56:37.317 INFO:tasks.workunit.client.0.smithi155.stdout:9/894: unlink da/d15/d17/d24/d26/d2e/l6c 0 2023-12-16T05:56:37.317 INFO:tasks.workunit.client.0.smithi155.stdout:9/895: chown da/d15/d17/d24/d62/d91/dc0 25 1 2023-12-16T05:56:37.322 INFO:tasks.workunit.client.1.smithi156.stdout:6/370: link d9/f6d d9/d13/d3e/d5f/f75 0 2023-12-16T05:56:37.322 INFO:tasks.workunit.client.1.smithi156.stdout:5/592: dwrite da/dc/d2d/f41 [0,4194304] 0 2023-12-16T05:56:37.324 INFO:tasks.workunit.client.1.smithi156.stdout:7/577: creat d1e/fc6 x:0 0 0 2023-12-16T05:56:37.324 INFO:tasks.workunit.client.1.smithi156.stdout:7/578: chown d1e/d1f/f78 3747463 1 2023-12-16T05:56:37.325 INFO:tasks.workunit.client.1.smithi156.stdout:0/431: dwrite d2/d7/dd/d29/d38/d51/d69/f73 [0,4194304] 0 2023-12-16T05:56:37.325 INFO:tasks.workunit.client.1.smithi156.stdout:0/432: chown d2/d7/dd/d29/d38/d51/c61 27892 1 2023-12-16T05:56:37.326 INFO:tasks.workunit.client.1.smithi156.stdout:5/593: readlink da/dc/d4b/lb4 0 2023-12-16T05:56:37.326 INFO:tasks.workunit.client.1.smithi156.stdout:3/297: mkdir dc/df/d70 0 2023-12-16T05:56:37.327 INFO:tasks.workunit.client.1.smithi156.stdout:7/579: symlink d1e/d1f/d74/lc7 0 2023-12-16T05:56:37.328 INFO:tasks.workunit.client.1.smithi156.stdout:7/580: truncate d1e/d55/d71/d61/f5d 54427 0 2023-12-16T05:56:37.329 INFO:tasks.workunit.client.1.smithi156.stdout:0/433: creat d2/d47/f80 x:0 0 0 2023-12-16T05:56:37.329 INFO:tasks.workunit.client.1.smithi156.stdout:0/434: stat d2/d7/dd/c1e 0 2023-12-16T05:56:37.331 INFO:tasks.workunit.client.1.smithi156.stdout:5/594: rmdir da/dc/d2d/d4d 39 2023-12-16T05:56:37.332 INFO:tasks.workunit.client.1.smithi156.stdout:8/313: dwrite d3/d6/f36 [0,4194304] 0 2023-12-16T05:56:37.332 INFO:tasks.workunit.client.1.smithi156.stdout:8/314: fdatasync d3/d18/f22 0 2023-12-16T05:56:37.332 INFO:tasks.workunit.client.1.smithi156.stdout:8/315: chown d3/d18/f41 14423 1 2023-12-16T05:56:37.333 INFO:tasks.workunit.client.0.smithi155.stdout:0/695: dwrite d7/df/d73/dba/fe0 [0,4194304] 0 2023-12-16T05:56:37.333 INFO:tasks.workunit.client.0.smithi155.stdout:0/696: truncate d7/d13/d45/fc5 1037560 0 2023-12-16T05:56:37.334 INFO:tasks.workunit.client.0.smithi155.stdout:0/697: mknod d7/df/d41/d23/de1/ce6 0 2023-12-16T05:56:37.335 INFO:tasks.workunit.client.1.smithi156.stdout:3/298: creat dc/df/d34/f71 x:0 0 0 2023-12-16T05:56:37.335 INFO:tasks.workunit.client.0.smithi155.stdout:0/698: truncate d7/d13/d45/fa0 262511 0 2023-12-16T05:56:37.336 INFO:tasks.workunit.client.1.smithi156.stdout:5/595: symlink da/dc/d2d/d9b/lbe 0 2023-12-16T05:56:37.337 INFO:tasks.workunit.client.1.smithi156.stdout:7/581: dread d1e/d1f/da6/d57/f92 [0,4194304] 0 2023-12-16T05:56:37.338 INFO:tasks.workunit.client.1.smithi156.stdout:3/299: creat dc/d10/d1d/d4b/d52/f72 x:0 0 0 2023-12-16T05:56:37.338 INFO:tasks.workunit.client.1.smithi156.stdout:3/300: write dc/df/f2d [526605,85033] 0 2023-12-16T05:56:37.338 INFO:tasks.workunit.client.1.smithi156.stdout:3/301: dread - dc/d10/d1d/d4b/d52/f72 zero size 2023-12-16T05:56:37.338 INFO:tasks.workunit.client.1.smithi156.stdout:5/596: dread da/f42 [0,4194304] 0 2023-12-16T05:56:37.339 INFO:tasks.workunit.client.0.smithi155.stdout:0/699: unlink d7/df/ld4 0 2023-12-16T05:56:37.339 INFO:tasks.workunit.client.1.smithi156.stdout:7/582: mknod d1e/d1f/d74/cc8 0 2023-12-16T05:56:37.339 INFO:tasks.workunit.client.1.smithi156.stdout:7/583: write d1e/d39/fa8 [9245103,89296] 0 2023-12-16T05:56:37.340 INFO:tasks.workunit.client.1.smithi156.stdout:3/302: mknod dc/d10/d1d/d4b/d52/c73 0 2023-12-16T05:56:37.340 INFO:tasks.workunit.client.0.smithi155.stdout:0/700: symlink d7/d13/d46/le7 0 2023-12-16T05:56:37.341 INFO:tasks.workunit.client.1.smithi156.stdout:3/303: dread dc/d10/d1d/f32 [0,4194304] 0 2023-12-16T05:56:37.341 INFO:tasks.workunit.client.1.smithi156.stdout:3/304: write dc/d10/d3d/f38 [4776499,43864] 0 2023-12-16T05:56:37.341 INFO:tasks.workunit.client.1.smithi156.stdout:5/597: fdatasync da/dc/d4b/f64 0 2023-12-16T05:56:37.341 INFO:tasks.workunit.client.1.smithi156.stdout:5/598: stat da/dc/d4b/d6c/d7c/d85/l99 0 2023-12-16T05:56:37.341 INFO:tasks.workunit.client.1.smithi156.stdout:5/599: chown da/dc/d4b/d6c/d77/c89 503413 1 2023-12-16T05:56:37.342 INFO:tasks.workunit.client.1.smithi156.stdout:7/584: symlink d1e/d55/dba/lc9 0 2023-12-16T05:56:37.344 INFO:tasks.workunit.client.1.smithi156.stdout:3/305: mknod dc/d56/d67/d6e/c74 0 2023-12-16T05:56:37.344 INFO:tasks.workunit.client.1.smithi156.stdout:6/371: dwrite d9/f35 [0,4194304] 0 2023-12-16T05:56:37.346 INFO:tasks.workunit.client.1.smithi156.stdout:5/600: link da/dc/d4b/d6c/d7c/c96 da/dc/d4b/d6c/d7c/d85/cbf 0 2023-12-16T05:56:37.347 INFO:tasks.workunit.client.1.smithi156.stdout:6/372: dread d9/d13/d3e/f57 [0,4194304] 0 2023-12-16T05:56:37.348 INFO:tasks.workunit.client.1.smithi156.stdout:6/373: fsync d9/d13/f3d 0 2023-12-16T05:56:37.353 INFO:tasks.workunit.client.1.smithi156.stdout:0/435: write d2/d7/dd/d29/d38/d51/d69/f73 [4536189,84816] 0 2023-12-16T05:56:37.353 INFO:tasks.workunit.client.1.smithi156.stdout:7/585: mkdir d1e/d1f/da6/d57/dca 0 2023-12-16T05:56:37.354 INFO:tasks.workunit.client.1.smithi156.stdout:2/391: truncate d9/d68/f6c 1776798 0 2023-12-16T05:56:37.355 INFO:tasks.workunit.client.0.smithi155.stdout:9/896: dwrite da/d15/d17/d24/d26/d2e/d32/f35 [0,4194304] 0 2023-12-16T05:56:37.355 INFO:tasks.workunit.client.0.smithi155.stdout:9/897: stat da/d15/d17/d24/d62/d91/f110 0 2023-12-16T05:56:37.356 INFO:tasks.workunit.client.1.smithi156.stdout:2/392: write d9/dd/d17/d33/f10 [1321651,56345] 0 2023-12-16T05:56:37.357 INFO:tasks.workunit.client.1.smithi156.stdout:6/374: symlink d9/d1c/d61/l76 0 2023-12-16T05:56:37.360 INFO:tasks.workunit.client.1.smithi156.stdout:7/586: rename d1e/d1f/da6/f5e to d1e/d55/d71/d61/daa/db4/fcb 0 2023-12-16T05:56:37.361 INFO:tasks.workunit.client.1.smithi156.stdout:8/316: dwrite d3/d18/f1b [4194304,4194304] 0 2023-12-16T05:56:37.367 INFO:tasks.workunit.client.1.smithi156.stdout:6/375: write d9/d1c/f72 [3140564,108172] 0 2023-12-16T05:56:37.367 INFO:tasks.workunit.client.1.smithi156.stdout:6/376: write d9/d1c/f52 [288839,53548] 0 2023-12-16T05:56:37.367 INFO:tasks.workunit.client.1.smithi156.stdout:6/377: stat d9/d13/c16 0 2023-12-16T05:56:37.367 INFO:tasks.workunit.client.1.smithi156.stdout:6/378: dread - d9/d13/d2f/d36/f63 zero size 2023-12-16T05:56:37.369 INFO:tasks.workunit.client.1.smithi156.stdout:7/587: rmdir d1e/d55/dba 39 2023-12-16T05:56:37.369 INFO:tasks.workunit.client.1.smithi156.stdout:7/588: fdatasync d1e/d39/fa8 0 2023-12-16T05:56:37.374 INFO:tasks.workunit.client.1.smithi156.stdout:8/317: link d3/d7/d27/f59 d3/d7/f63 0 2023-12-16T05:56:37.375 INFO:tasks.workunit.client.1.smithi156.stdout:7/589: write d1e/d39/f7d [316806,106377] 0 2023-12-16T05:56:37.375 INFO:tasks.workunit.client.1.smithi156.stdout:7/590: chown ld 23 1 2023-12-16T05:56:37.378 INFO:tasks.workunit.client.1.smithi156.stdout:3/306: dwrite dc/d10/d3d/f39 [0,4194304] 0 2023-12-16T05:56:37.378 INFO:tasks.workunit.client.1.smithi156.stdout:3/307: chown dc/d10/c22 15706174 1 2023-12-16T05:56:37.382 INFO:tasks.workunit.client.1.smithi156.stdout:6/379: unlink d9/le 0 2023-12-16T05:56:37.382 INFO:tasks.workunit.client.0.smithi155.stdout:9/898: dwrite da/d15/d17/d24/d26/d2e/d83/fdd [0,4194304] 0 2023-12-16T05:56:37.382 INFO:tasks.workunit.client.1.smithi156.stdout:2/393: dwrite d9/dd/d17/d33/d38/d39/f4c [0,4194304] 0 2023-12-16T05:56:37.383 INFO:tasks.workunit.client.1.smithi156.stdout:6/380: dread d9/d13/d3e/f59 [0,4194304] 0 2023-12-16T05:56:37.383 INFO:tasks.workunit.client.1.smithi156.stdout:5/601: dwrite da/d46/f4f [0,4194304] 0 2023-12-16T05:56:37.383 INFO:tasks.workunit.client.1.smithi156.stdout:6/381: fdatasync d9/d1c/f2b 0 2023-12-16T05:56:37.385 INFO:tasks.workunit.client.0.smithi155.stdout:9/899: rmdir da/d15/d17/d36/d5b/d60/d9e 39 2023-12-16T05:56:37.385 INFO:tasks.workunit.client.0.smithi155.stdout:9/900: chown da/d10b 0 1 2023-12-16T05:56:37.386 INFO:tasks.workunit.client.0.smithi155.stdout:9/901: symlink da/d15/d17/d24/d62/dea/l12b 0 2023-12-16T05:56:37.386 INFO:tasks.workunit.client.1.smithi156.stdout:0/436: dwrite d2/d47/f46 [0,4194304] 0 2023-12-16T05:56:37.387 INFO:tasks.workunit.client.0.smithi155.stdout:9/902: creat da/d15/d17/d36/d54/f12c x:0 0 0 2023-12-16T05:56:37.388 INFO:tasks.workunit.client.0.smithi155.stdout:9/903: rename da/d15/d17/d24/ce0 to da/d15/d17/d24/d26/d2e/d83/d8f/df2/c12d 0 2023-12-16T05:56:37.390 INFO:tasks.workunit.client.1.smithi156.stdout:7/591: rmdir d1e/d1f/d72/da4 39 2023-12-16T05:56:37.391 INFO:tasks.workunit.client.1.smithi156.stdout:7/592: dread - d1e/d1f/d22/f64 zero size 2023-12-16T05:56:37.391 INFO:tasks.workunit.client.1.smithi156.stdout:3/308: mkdir dc/df/d34/d62/d75 0 2023-12-16T05:56:37.392 INFO:tasks.workunit.client.1.smithi156.stdout:2/394: symlink d9/dd/d17/d33/d38/d39/d60/l73 0 2023-12-16T05:56:37.393 INFO:tasks.workunit.client.1.smithi156.stdout:2/395: read f2 [951352,91677] 0 2023-12-16T05:56:37.393 INFO:tasks.workunit.client.1.smithi156.stdout:2/396: fsync d9/f1f 0 2023-12-16T05:56:37.395 INFO:tasks.workunit.client.1.smithi156.stdout:5/602: mkdir da/dc/d2d/d4d/d54/d90/dc0 0 2023-12-16T05:56:37.399 INFO:tasks.workunit.client.1.smithi156.stdout:0/437: symlink d2/d7/dd/d29/d38/d51/l81 0 2023-12-16T05:56:37.399 INFO:tasks.workunit.client.1.smithi156.stdout:0/438: chown d2/d7/dd/d29/d38/d3f/d44 60664712 1 2023-12-16T05:56:37.400 INFO:tasks.workunit.client.1.smithi156.stdout:0/439: readlink d2/d7/dd/d2d/d5e/l7d 0 2023-12-16T05:56:37.400 INFO:tasks.workunit.client.1.smithi156.stdout:0/440: write d2/d7/dd/d29/d38/d51/d65/f6f [863976,118833] 0 2023-12-16T05:56:37.400 INFO:tasks.workunit.client.1.smithi156.stdout:0/441: read d2/ff [205755,76122] 0 2023-12-16T05:56:37.400 INFO:tasks.workunit.client.0.smithi155.stdout:5/734: sync 2023-12-16T05:56:37.400 INFO:tasks.workunit.client.0.smithi155.stdout:6/888: sync 2023-12-16T05:56:37.400 INFO:tasks.workunit.client.0.smithi155.stdout:6/889: write d0/df/f27 [946665,61392] 0 2023-12-16T05:56:37.400 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:37 smithi155 ceph-mon[112451]: Reconfiguring node-exporter.smithi155 (dependencies changed)... 2023-12-16T05:56:37.401 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:37 smithi155 ceph-mon[112451]: Reconfiguring daemon node-exporter.smithi155 on smithi155 2023-12-16T05:56:37.401 INFO:tasks.workunit.client.0.smithi155.stdout:5/735: unlink d0/d2/d2a/d30/d53/d7b/f86 0 2023-12-16T05:56:37.401 INFO:tasks.workunit.client.0.smithi155.stdout:5/736: fdatasync d0/d2/fa6 0 2023-12-16T05:56:37.401 INFO:tasks.workunit.client.0.smithi155.stdout:5/737: fsync d0/f32 0 2023-12-16T05:56:37.401 INFO:tasks.workunit.client.1.smithi156.stdout:7/593: rmdir d1e/d55/d71/d61/dac 39 2023-12-16T05:56:37.404 INFO:tasks.workunit.client.1.smithi156.stdout:3/309: creat dc/d10/d1d/d4b/f76 x:0 0 0 2023-12-16T05:56:37.405 INFO:tasks.workunit.client.0.smithi155.stdout:9/904: dwrite da/d15/d17/d36/d5b/f129 [0,4194304] 0 2023-12-16T05:56:37.405 INFO:tasks.workunit.client.1.smithi156.stdout:2/397: mkdir d9/dd/d17/d33/d38/d74 0 2023-12-16T05:56:37.409 INFO:tasks.workunit.client.1.smithi156.stdout:5/603: truncate da/dc/f3d 2461959 0 2023-12-16T05:56:37.409 INFO:tasks.workunit.client.1.smithi156.stdout:0/442: rename d2/d7/dd/d29/l63 to d2/d7/dd/d2d/d5e/l82 0 2023-12-16T05:56:37.409 INFO:tasks.workunit.client.0.smithi155.stdout:6/890: rmdir d0/d3 39 2023-12-16T05:56:37.410 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.407+0000 7f66b46d2700 1 -- 172.21.15.155:0/3408597272 --> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f66ac10f510 con 0x7f669806ae40 2023-12-16T05:56:37.410 INFO:tasks.workunit.client.1.smithi156.stdout:2/398: write d9/dd/d17/f51 [51701,120053] 0 2023-12-16T05:56:37.410 INFO:tasks.workunit.client.1.smithi156.stdout:7/594: creat d1e/d1f/da6/d57/dbb/fcc x:0 0 0 2023-12-16T05:56:37.410 INFO:tasks.workunit.client.0.smithi155.stdout:9/905: rmdir da/d15/d17/d36/d5b/d60/d9e 39 2023-12-16T05:56:37.410 INFO:tasks.workunit.client.0.smithi155.stdout:9/906: write da/d15/d17/d36/d54/f7f [8691053,62210] 0 2023-12-16T05:56:37.411 INFO:tasks.workunit.client.1.smithi156.stdout:3/310: mkdir dc/d56/d67/d77 0 2023-12-16T05:56:37.412 INFO:tasks.workunit.client.1.smithi156.stdout:0/443: mknod d2/d7/dd/d1c/c83 0 2023-12-16T05:56:37.412 INFO:tasks.workunit.client.1.smithi156.stdout:0/444: chown d2/d7/dd/d29/d38/d3f/d44/l5f 21899 1 2023-12-16T05:56:37.412 INFO:tasks.workunit.client.0.smithi155.stdout:6/891: rmdir d0/df/d5e/d46/d6d/de3 39 2023-12-16T05:56:37.413 INFO:tasks.workunit.client.0.smithi155.stdout:9/907: creat da/d15/d17/d36/d5b/d60/db9/de4/f12e x:0 0 0 2023-12-16T05:56:37.414 INFO:tasks.workunit.client.1.smithi156.stdout:2/399: creat d9/d68/f75 x:0 0 0 2023-12-16T05:56:37.414 INFO:tasks.workunit.client.1.smithi156.stdout:2/400: readlink l3 0 2023-12-16T05:56:37.415 INFO:tasks.workunit.client.0.smithi155.stdout:6/892: truncate d0/d3/d7a/d77/f101 635045 0 2023-12-16T05:56:37.415 INFO:tasks.workunit.client.0.smithi155.stdout:6/893: dread - d0/df/d5e/d7e/dd8/d12b/fc9 zero size 2023-12-16T05:56:37.415 INFO:tasks.workunit.client.0.smithi155.stdout:6/894: chown d0/d3/d2c/d8b/d85/f8d 108 1 2023-12-16T05:56:37.415 INFO:tasks.workunit.client.0.smithi155.stdout:6/895: truncate d0/d3/d7a/db0/dc3/dce/ddd/f10d 1333196 0 2023-12-16T05:56:37.416 INFO:tasks.workunit.client.1.smithi156.stdout:7/595: creat d1e/d55/dba/fcd x:0 0 0 2023-12-16T05:56:37.416 INFO:tasks.workunit.client.1.smithi156.stdout:7/596: fsync d1e/d55/d71/fc3 0 2023-12-16T05:56:37.416 INFO:tasks.workunit.client.1.smithi156.stdout:7/597: truncate d1e/d55/d71/d61/daa/db4/fc2 480358 0 2023-12-16T05:56:37.417 INFO:tasks.workunit.client.1.smithi156.stdout:3/311: mknod dc/c78 0 2023-12-16T05:56:37.418 INFO:tasks.workunit.client.0.smithi155.stdout:9/908: dread da/d15/d17/d36/d5b/f6d [0,4194304] 0 2023-12-16T05:56:37.418 INFO:tasks.workunit.client.1.smithi156.stdout:5/604: dread da/dc/d4b/d6c/f7a [0,4194304] 0 2023-12-16T05:56:37.418 INFO:tasks.workunit.client.1.smithi156.stdout:3/312: write dc/d10/d1d/f49 [570344,85251] 0 2023-12-16T05:56:37.419 INFO:tasks.workunit.client.1.smithi156.stdout:0/445: creat d2/d7/dd/d29/f84 x:0 0 0 2023-12-16T05:56:37.419 INFO:tasks.workunit.client.0.smithi155.stdout:5/738: dwrite d0/d2/d2a/d30/d53/d7b/fcc [0,4194304] 0 2023-12-16T05:56:37.421 INFO:tasks.workunit.client.1.smithi156.stdout:2/401: creat d9/dd/d17/d33/d38/d39/f76 x:0 0 0 2023-12-16T05:56:37.422 INFO:tasks.workunit.client.1.smithi156.stdout:7/598: mknod d1e/daf/cce 0 2023-12-16T05:56:37.423 INFO:tasks.workunit.client.0.smithi155.stdout:9/909: write da/d15/f66 [3711404,72694] 0 2023-12-16T05:56:37.423 INFO:tasks.workunit.client.0.smithi155.stdout:9/910: stat da/d15/d17/d24/d26/d2e/c51 0 2023-12-16T05:56:37.423 INFO:tasks.workunit.client.1.smithi156.stdout:7/599: write d1e/d1f/f3a [1769847,119450] 0 2023-12-16T05:56:37.424 INFO:tasks.workunit.client.0.smithi155.stdout:5/739: rename d0/d2/d2a/d30/d53/db5/db9/dd5 to d0/d2/d2a/d19/dd7/dee 0 2023-12-16T05:56:37.425 INFO:tasks.workunit.client.1.smithi156.stdout:5/605: creat da/dc/d2d/d4d/d54/d67/fc1 x:0 0 0 2023-12-16T05:56:37.425 INFO:tasks.workunit.client.1.smithi156.stdout:5/606: chown da/dc/l1f 0 1 2023-12-16T05:56:37.426 INFO:teuthology.orchestra.run.smithi155.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T05:56:37.426 INFO:teuthology.orchestra.run.smithi155.stdout:alertmanager.smithi155 smithi155 *:9093,9094 running (4m) 5s ago 5m 26.3M - 0.25.0 c8568f914cd2 59958a4f4cbd 2023-12-16T05:56:37.426 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi155 smithi155 running (5m) 5s ago 5m 7444k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 033f79f53811 2023-12-16T05:56:37.426 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi156 smithi156 running (5m) 14s ago 5m 7470k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 c72bd1a1d00a 2023-12-16T05:56:37.426 INFO:teuthology.orchestra.run.smithi155.stdout:grafana.smithi155 smithi155 *:3000 running (4m) 5s ago 5m 94.7M - 9.4.7 954c08fa6188 cb715f87b8c6 2023-12-16T05:56:37.426 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.bzsxjw smithi155 running (2m) 5s ago 2m 1638M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6bcabf94a5c3 2023-12-16T05:56:37.427 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.vicpis smithi155 running (2m) 5s ago 2m 222M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 afa64e1ef8da 2023-12-16T05:56:37.427 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.fasing smithi156 running (2m) 14s ago 2m 234M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 7d97160bda7c 2023-12-16T05:56:37.427 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.qvgmfj smithi156 running (2m) 14s ago 2m 1360M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4018b2f2e27e 2023-12-16T05:56:37.427 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi155.maowdn smithi155 *:9283 running (6m) 5s ago 6m 406M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 73b9fc45e71f 2023-12-16T05:56:37.427 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi156.pclong smithi156 *:8443,9283 running (36s) 14s ago 5m 494M - 19.0.0-191-g6d933094 a29c258b5d6f 99f9fc95fc56 2023-12-16T05:56:37.427 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi155 smithi155 running (6m) 5s ago 6m 81.8M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 0d0eecfde53b 2023-12-16T05:56:37.427 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi156 smithi156 running (5m) 14s ago 5m 55.8M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 4575acae9bdb 2023-12-16T05:56:37.427 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi155 smithi155 *:9100 running (5m) 5s ago 5m 16.8M - 1.5.0 0da6a335fe13 500b3e583f23 2023-12-16T05:56:37.427 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi156 smithi156 *:9100 running (5m) 14s ago 5m 20.0M - 1.5.0 0da6a335fe13 7e4371b6e840 2023-12-16T05:56:37.427 INFO:teuthology.orchestra.run.smithi155.stdout:osd.0 smithi155 running (4m) 5s ago 4m 312M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 91e650c277f7 2023-12-16T05:56:37.427 INFO:teuthology.orchestra.run.smithi155.stdout:osd.1 smithi155 running (4m) 5s ago 4m 352M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957303cb6598 2023-12-16T05:56:37.427 INFO:teuthology.orchestra.run.smithi155.stdout:osd.2 smithi155 running (3m) 5s ago 3m 276M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957a169c1cac 2023-12-16T05:56:37.427 INFO:teuthology.orchestra.run.smithi155.stdout:osd.3 smithi156 running (3m) 14s ago 3m 375M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c4f6c54afe99 2023-12-16T05:56:37.427 INFO:teuthology.orchestra.run.smithi155.stdout:osd.4 smithi156 running (3m) 14s ago 3m 304M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 6309b12204fd 2023-12-16T05:56:37.428 INFO:teuthology.orchestra.run.smithi155.stdout:osd.5 smithi156 running (3m) 14s ago 3m 334M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 84b2c33eb0e1 2023-12-16T05:56:37.428 INFO:teuthology.orchestra.run.smithi155.stdout:prometheus.smithi155 smithi155 *:9095 running (4m) 5s ago 5m 57.0M - 2.43.0 a07b618ecd1d 75cfe8962fd8 2023-12-16T05:56:37.428 INFO:tasks.workunit.client.0.smithi155.stdout:9/911: mknod da/d15/d17/d11d/c12f 0 2023-12-16T05:56:37.429 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.423+0000 7f66a2ffd700 1 -- 172.21.15.155:0/3408597272 <== mgr.24363 v2:172.21.15.156:6828/1939402353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f66ac10f510 con 0x7f669806ae40 2023-12-16T05:56:37.429 INFO:tasks.workunit.client.1.smithi156.stdout:0/446: mkdir d2/d7/dd/d29/d4b/d76/d85 0 2023-12-16T05:56:37.429 INFO:tasks.workunit.client.1.smithi156.stdout:2/402: mknod d9/dd/d17/c77 0 2023-12-16T05:56:37.429 INFO:tasks.workunit.client.1.smithi156.stdout:3/313: creat dc/d56/d67/f79 x:0 0 0 2023-12-16T05:56:37.429 INFO:tasks.workunit.client.1.smithi156.stdout:7/600: creat d1e/d1f/da6/fcf x:0 0 0 2023-12-16T05:56:37.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:37 smithi156 ceph-mon[121001]: Reconfiguring node-exporter.smithi155 (dependencies changed)... 2023-12-16T05:56:37.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:37 smithi156 ceph-mon[121001]: Reconfiguring daemon node-exporter.smithi155 on smithi155 2023-12-16T05:56:37.430 INFO:tasks.workunit.client.0.smithi155.stdout:5/740: mkdir d0/d2/d2a/d30/d53/d7b/d99/d47/d61/db6/def 0 2023-12-16T05:56:37.430 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.427+0000 7f66b46d2700 1 -- 172.21.15.155:0/3408597272 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f669806ae40 msgr2=0x7f669806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:37.430 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.427+0000 7f66b46d2700 1 --2- 172.21.15.155:0/3408597272 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f669806ae40 0x7f669806d2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f669c006fd0 tx=0x7f669c006db0 comp rx=0 tx=0).stop 2023-12-16T05:56:37.430 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.427+0000 7f66b46d2700 1 -- 172.21.15.155:0/3408597272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66ac0fb290 msgr2=0x7f66ac10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:37.431 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.427+0000 7f66b46d2700 1 --2- 172.21.15.155:0/3408597272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66ac0fb290 0x7f66ac10d5f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f66a800c8a0 tx=0x7f66a800af40 comp rx=0 tx=0).stop 2023-12-16T05:56:37.431 INFO:tasks.workunit.client.0.smithi155.stdout:9/912: truncate da/d15/d17/d24/d62/d91/fd0 1976105 0 2023-12-16T05:56:37.431 INFO:tasks.workunit.client.0.smithi155.stdout:6/896: dwrite d0/df/d5e/d7e/dd8/d12b/fcc [0,4194304] 0 2023-12-16T05:56:37.431 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.427+0000 7f66b46d2700 1 -- 172.21.15.155:0/3408597272 shutdown_connections 2023-12-16T05:56:37.431 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.427+0000 7f66b46d2700 1 --2- 172.21.15.155:0/3408597272 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f669806ae40 0x7f669806d2f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:37.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.427+0000 7f66b46d2700 1 --2- 172.21.15.155:0/3408597272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66ac0fb290 0x7f66ac10d5f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:37.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.427+0000 7f66b46d2700 1 --2- 172.21.15.155:0/3408597272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66ac0fc4a0 0x7f66ac10db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:37.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.427+0000 7f66b46d2700 1 -- 172.21.15.155:0/3408597272 >> 172.21.15.155:0/3408597272 conn(0x7f66ac0f6950 msgr2=0x7f66ac0f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:56:37.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.427+0000 7f66b46d2700 1 -- 172.21.15.155:0/3408597272 shutdown_connections 2023-12-16T05:56:37.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.427+0000 7f66b46d2700 1 -- 172.21.15.155:0/3408597272 wait complete. 2023-12-16T05:56:37.432 INFO:tasks.workunit.client.0.smithi155.stdout:5/741: mknod d0/d2/d2a/d30/d53/d7b/d99/d47/d61/db6/dce/cf0 0 2023-12-16T05:56:37.432 INFO:tasks.workunit.client.0.smithi155.stdout:9/913: mkdir da/d15/d17/d130 0 2023-12-16T05:56:37.432 INFO:tasks.workunit.client.0.smithi155.stdout:9/914: stat da/d15/f5e 0 2023-12-16T05:56:37.433 INFO:tasks.workunit.client.1.smithi156.stdout:0/447: creat d2/f86 x:0 0 0 2023-12-16T05:56:37.434 INFO:tasks.workunit.client.1.smithi156.stdout:3/314: creat dc/d10/f7a x:0 0 0 2023-12-16T05:56:37.434 INFO:tasks.workunit.client.1.smithi156.stdout:7/601: rmdir d1e/d55/d71/d61/dac 39 2023-12-16T05:56:37.434 INFO:tasks.workunit.client.0.smithi155.stdout:6/897: symlink d0/df/d5e/d46/d6d/de3/l12d 0 2023-12-16T05:56:37.434 INFO:tasks.workunit.client.0.smithi155.stdout:6/898: fdatasync d0/d3/d7a/db0/dc3/dce/ddd/fcb 0 2023-12-16T05:56:37.434 INFO:tasks.workunit.client.0.smithi155.stdout:6/899: fdatasync d0/d3/d2c/d8b/f125 0 2023-12-16T05:56:37.434 INFO:tasks.workunit.client.0.smithi155.stdout:5/742: rename d0/d60/d79/d97 to d0/d60/d79/df1 0 2023-12-16T05:56:37.434 INFO:tasks.workunit.client.0.smithi155.stdout:5/743: truncate d0/d2/d2a/d30/d53/d7b/d99/fca 4314130 0 2023-12-16T05:56:37.434 INFO:tasks.workunit.client.0.smithi155.stdout:5/744: chown d0/c4e 5159709 1 2023-12-16T05:56:37.435 INFO:tasks.workunit.client.0.smithi155.stdout:5/745: write d0/d2/d2a/d30/d53/d7b/d99/fca [2566462,5119] 0 2023-12-16T05:56:37.435 INFO:tasks.workunit.client.0.smithi155.stdout:5/746: dread - d0/d60/d79/d8e/fdf zero size 2023-12-16T05:56:37.435 INFO:tasks.workunit.client.0.smithi155.stdout:5/747: chown d0/d2/d2a/d30/d53/l8b 92 1 2023-12-16T05:56:37.436 INFO:tasks.workunit.client.1.smithi156.stdout:0/448: mknod d2/d7/c87 0 2023-12-16T05:56:37.436 INFO:tasks.workunit.client.0.smithi155.stdout:9/915: symlink da/d15/d17/d36/d5b/d60/db9/de4/l131 0 2023-12-16T05:56:37.436 INFO:tasks.workunit.client.0.smithi155.stdout:9/916: fsync da/d15/d17/d36/d5b/fa2 0 2023-12-16T05:56:37.437 INFO:tasks.workunit.client.1.smithi156.stdout:3/315: rename dc/df/d34/c40 to dc/d56/d69/c7b 0 2023-12-16T05:56:37.437 INFO:tasks.workunit.client.1.smithi156.stdout:3/316: write dc/d10/d1d/f5d [1347391,2270] 0 2023-12-16T05:56:37.437 INFO:tasks.workunit.client.1.smithi156.stdout:3/317: write dc/d10/f24 [530243,82246] 0 2023-12-16T05:56:37.437 INFO:tasks.workunit.client.1.smithi156.stdout:3/318: write dc/d10/d1d/f42 [241204,15429] 0 2023-12-16T05:56:37.438 INFO:tasks.workunit.client.0.smithi155.stdout:6/900: mknod d0/df/d5e/d46/c12e 0 2023-12-16T05:56:37.438 INFO:tasks.workunit.client.1.smithi156.stdout:7/602: link d1e/l56 d1e/d39/ld0 0 2023-12-16T05:56:37.439 INFO:tasks.workunit.client.1.smithi156.stdout:0/449: rename d2/d6d to d2/d7/dd/d29/d38/d51/d52/d88 0 2023-12-16T05:56:37.440 INFO:tasks.workunit.client.0.smithi155.stdout:9/917: symlink da/d15/d17/d24/d26/d2e/d83/d8f/d9c/l132 0 2023-12-16T05:56:37.441 INFO:tasks.workunit.client.1.smithi156.stdout:0/450: dread d2/d7/dd/f41 [0,4194304] 0 2023-12-16T05:56:37.442 INFO:tasks.workunit.client.0.smithi155.stdout:6/901: symlink d0/df/d5e/d7e/dd8/d12b/d103/l12f 0 2023-12-16T05:56:37.442 INFO:tasks.workunit.client.1.smithi156.stdout:7/603: creat d1e/dbf/fd1 x:0 0 0 2023-12-16T05:56:37.442 INFO:tasks.workunit.client.1.smithi156.stdout:7/604: write d1e/fb2 [1960774,1777] 0 2023-12-16T05:56:37.442 INFO:tasks.workunit.client.1.smithi156.stdout:7/605: stat d1e/d55/d71/d61 0 2023-12-16T05:56:37.443 INFO:tasks.workunit.client.1.smithi156.stdout:3/319: creat dc/f7c x:0 0 0 2023-12-16T05:56:37.445 INFO:tasks.workunit.client.1.smithi156.stdout:2/403: rename d9/dd/d17/d33/d38 to d9/dd/d17/d33/d78 0 2023-12-16T05:56:37.445 INFO:tasks.workunit.client.1.smithi156.stdout:2/404: write d9/d12/f5e [520501,8878] 0 2023-12-16T05:56:37.445 INFO:tasks.workunit.client.1.smithi156.stdout:2/405: chown d9/d12/l28 11073 1 2023-12-16T05:56:37.446 INFO:tasks.workunit.client.0.smithi155.stdout:9/918: getdents da/d15/d17/d36/d5b/d60/db9 0 2023-12-16T05:56:37.447 INFO:tasks.workunit.client.1.smithi156.stdout:0/451: creat d2/d7/dd/d29/f89 x:0 0 0 2023-12-16T05:56:37.448 INFO:tasks.workunit.client.0.smithi155.stdout:9/919: creat da/d15/d17/d36/d54/f133 x:0 0 0 2023-12-16T05:56:37.448 INFO:tasks.workunit.client.1.smithi156.stdout:0/452: read d2/d23/f32 [2833899,109920] 0 2023-12-16T05:56:37.448 INFO:tasks.workunit.client.1.smithi156.stdout:0/453: fdatasync d2/f43 0 2023-12-16T05:56:37.448 INFO:tasks.workunit.client.1.smithi156.stdout:0/454: write d2/d47/f80 [572741,69071] 0 2023-12-16T05:56:37.449 INFO:tasks.workunit.client.0.smithi155.stdout:9/920: creat da/d15/d17/d24/d26/f134 x:0 0 0 2023-12-16T05:56:37.451 INFO:tasks.workunit.client.1.smithi156.stdout:7/606: rename d1e/d1f/l68 to d1e/d1f/d22/ld2 0 2023-12-16T05:56:37.451 INFO:tasks.workunit.client.1.smithi156.stdout:7/607: chown d1e/d1f/d22/d75/fa9 192 1 2023-12-16T05:56:37.451 INFO:tasks.workunit.client.1.smithi156.stdout:7/608: fdatasync d1e/d39/f3f 0 2023-12-16T05:56:37.451 INFO:tasks.workunit.client.1.smithi156.stdout:2/406: getdents d9/d5a 0 2023-12-16T05:56:37.451 INFO:tasks.workunit.client.1.smithi156.stdout:2/407: write d9/d12/f45 [59584,19570] 0 2023-12-16T05:56:37.453 INFO:tasks.workunit.client.1.smithi156.stdout:7/609: creat d1e/d1f/da6/d57/dca/fd3 x:0 0 0 2023-12-16T05:56:37.455 INFO:tasks.workunit.client.0.smithi155.stdout:5/748: dwrite d0/d2/d2a/d19/d88/f95 [0,4194304] 0 2023-12-16T05:56:37.456 INFO:tasks.workunit.client.1.smithi156.stdout:2/408: creat d9/dd/d17/d33/d78/d39/f79 x:0 0 0 2023-12-16T05:56:37.458 INFO:tasks.workunit.client.0.smithi155.stdout:5/749: rename d0/d2/d2a/d19/d88/c8f to d0/d2/d2a/d19/d48/cf2 0 2023-12-16T05:56:37.458 INFO:tasks.workunit.client.1.smithi156.stdout:0/455: dread d2/d23/f32 [0,4194304] 0 2023-12-16T05:56:37.458 INFO:tasks.workunit.client.0.smithi155.stdout:5/750: fdatasync d0/d2/d2a/d19/d71/fc6 0 2023-12-16T05:56:37.458 INFO:tasks.workunit.client.0.smithi155.stdout:5/751: truncate d0/d2/d2a/f2e 3258739 0 2023-12-16T05:56:37.459 INFO:tasks.workunit.client.1.smithi156.stdout:7/610: creat d1e/d55/d71/d61/dac/fd4 x:0 0 0 2023-12-16T05:56:37.459 INFO:tasks.workunit.client.0.smithi155.stdout:5/752: creat d0/ff3 x:0 0 0 2023-12-16T05:56:37.461 INFO:tasks.workunit.client.1.smithi156.stdout:2/409: rename d9/dd/d17/d33/c2a to d9/dd/d17/d33/c7a 0 2023-12-16T05:56:37.463 INFO:tasks.workunit.client.1.smithi156.stdout:0/456: mknod d2/d7/dd/d2d/d5e/c8a 0 2023-12-16T05:56:37.471 INFO:tasks.workunit.client.1.smithi156.stdout:7/611: creat d1e/d1f/d22/d75/d77/fd5 x:0 0 0 2023-12-16T05:56:37.471 INFO:tasks.workunit.client.1.smithi156.stdout:7/612: dread - d1e/d1f/f78 zero size 2023-12-16T05:56:37.472 INFO:tasks.workunit.client.1.smithi156.stdout:2/410: mknod d9/dd/d17/d33/d78/c7b 0 2023-12-16T05:56:37.474 INFO:tasks.workunit.client.1.smithi156.stdout:0/457: creat d2/d23/d4a/f8b x:0 0 0 2023-12-16T05:56:37.475 INFO:tasks.workunit.client.1.smithi156.stdout:7/613: link d1e/d1f/d22/d75/d77/cae d1e/d55/d71/d61/daa/cd6 0 2023-12-16T05:56:37.475 INFO:tasks.workunit.client.1.smithi156.stdout:7/614: fdatasync d1e/d39/f3f 0 2023-12-16T05:56:37.475 INFO:tasks.workunit.client.1.smithi156.stdout:7/615: read - d1e/fc5 zero size 2023-12-16T05:56:37.476 INFO:tasks.workunit.client.0.smithi155.stdout:6/902: dwrite d0/d3/d7a/d77/fa5 [0,4194304] 0 2023-12-16T05:56:37.477 INFO:tasks.workunit.client.1.smithi156.stdout:0/458: creat d2/d7/dd/d29/d38/d51/d52/f8c x:0 0 0 2023-12-16T05:56:37.477 INFO:tasks.workunit.client.1.smithi156.stdout:0/459: fsync d2/d7/dd/d1c/f71 0 2023-12-16T05:56:37.479 INFO:tasks.workunit.client.1.smithi156.stdout:7/616: mknod d1e/d55/d71/cd7 0 2023-12-16T05:56:37.479 INFO:tasks.workunit.client.0.smithi155.stdout:5/753: dwrite d0/f1c [4194304,4194304] 0 2023-12-16T05:56:37.480 INFO:tasks.workunit.client.0.smithi155.stdout:9/921: dwrite da/d15/d17/d24/d62/d91/dc0/fd9 [4194304,4194304] 0 2023-12-16T05:56:37.482 INFO:tasks.workunit.client.0.smithi155.stdout:5/754: creat d0/d2/d2a/d19/d48/ff4 x:0 0 0 2023-12-16T05:56:37.482 INFO:tasks.workunit.client.0.smithi155.stdout:5/755: fdatasync d0/d2/f6e 0 2023-12-16T05:56:37.482 INFO:tasks.workunit.client.0.smithi155.stdout:5/756: fsync d0/d2/d2a/f7f 0 2023-12-16T05:56:37.483 INFO:tasks.workunit.client.1.smithi156.stdout:3/320: dwrite dc/df/f55 [0,4194304] 0 2023-12-16T05:56:37.485 INFO:tasks.workunit.client.0.smithi155.stdout:5/757: rename d0/d60/d79/df1/d9c/dd3 to d0/d2/d2a/d19/d48/df5 0 2023-12-16T05:56:37.487 INFO:tasks.workunit.client.0.smithi155.stdout:5/758: getdents d0/d2/d2a/d19/d21 0 2023-12-16T05:56:37.487 INFO:tasks.workunit.client.0.smithi155.stdout:5/759: truncate d0/d2/d2a/d30/d53/d7b/d99/f83 926907 0 2023-12-16T05:56:37.487 INFO:tasks.workunit.client.0.smithi155.stdout:5/760: chown d0/d2/d2a/d19/d48 2830 1 2023-12-16T05:56:37.490 INFO:tasks.workunit.client.1.smithi156.stdout:3/321: link dc/d10/d1d/d4b/d52/c64 dc/d10/d1d/c7d 0 2023-12-16T05:56:37.494 INFO:tasks.workunit.client.1.smithi156.stdout:2/411: dwrite d9/dd/d3f/f52 [0,4194304] 0 2023-12-16T05:56:37.498 INFO:tasks.workunit.client.1.smithi156.stdout:3/322: rmdir dc/d56/d67/d77 0 2023-12-16T05:56:37.501 INFO:tasks.workunit.client.1.smithi156.stdout:2/412: mknod d9/d68/c7c 0 2023-12-16T05:56:37.502 INFO:tasks.workunit.client.1.smithi156.stdout:3/323: truncate dc/d10/d3d/f29 3144587 0 2023-12-16T05:56:37.504 INFO:tasks.workunit.client.1.smithi156.stdout:2/413: symlink d9/d5a/l7d 0 2023-12-16T05:56:37.504 INFO:tasks.workunit.client.1.smithi156.stdout:3/324: creat dc/d10/f7e x:0 0 0 2023-12-16T05:56:37.506 INFO:tasks.workunit.client.1.smithi156.stdout:3/325: write dc/d10/d1d/f49 [2304055,24770] 0 2023-12-16T05:56:37.506 INFO:tasks.workunit.client.1.smithi156.stdout:3/326: fdatasync dc/f7c 0 2023-12-16T05:56:37.506 INFO:tasks.workunit.client.1.smithi156.stdout:2/414: symlink d9/dd/d17/l7e 0 2023-12-16T05:56:37.507 INFO:tasks.workunit.client.1.smithi156.stdout:3/327: creat dc/d56/d69/f7f x:0 0 0 2023-12-16T05:56:37.508 INFO:tasks.workunit.client.0.smithi155.stdout:9/922: dwrite da/d15/f31 [0,4194304] 0 2023-12-16T05:56:37.508 INFO:tasks.workunit.client.1.smithi156.stdout:7/617: dwrite d1e/d1f/da6/f4d [0,4194304] 0 2023-12-16T05:56:37.509 INFO:tasks.workunit.client.1.smithi156.stdout:0/460: dwrite d2/d7/dd/d29/d2e/f3a [0,4194304] 0 2023-12-16T05:56:37.509 INFO:tasks.workunit.client.1.smithi156.stdout:0/461: stat d2/d23/d4a 0 2023-12-16T05:56:37.509 INFO:tasks.workunit.client.1.smithi156.stdout:0/462: rename d2/d7 to d2/d7/dd/d29/d4b/d76/d85/d8d 22 2023-12-16T05:56:37.509 INFO:tasks.workunit.client.1.smithi156.stdout:0/463: chown d2/d7/dd/d2d/d5e/c8a 21 1 2023-12-16T05:56:37.509 INFO:tasks.workunit.client.1.smithi156.stdout:0/464: write d2/d7/dd/d29/f89 [356282,25014] 0 2023-12-16T05:56:37.509 INFO:tasks.workunit.client.1.smithi156.stdout:0/465: truncate d2/f43 1263138 0 2023-12-16T05:56:37.509 INFO:tasks.workunit.client.1.smithi156.stdout:2/415: truncate d9/dd/d17/f51 317928 0 2023-12-16T05:56:37.510 INFO:tasks.workunit.client.1.smithi156.stdout:3/328: creat dc/d56/d69/f80 x:0 0 0 2023-12-16T05:56:37.512 INFO:tasks.workunit.client.1.smithi156.stdout:7/618: mkdir d1e/d1f/da6/d57/d59/dd8 0 2023-12-16T05:56:37.513 INFO:tasks.workunit.client.0.smithi155.stdout:4/643: sync 2023-12-16T05:56:37.513 INFO:tasks.workunit.client.0.smithi155.stdout:8/663: sync 2023-12-16T05:56:37.514 INFO:tasks.workunit.client.0.smithi155.stdout:4/644: chown d0/d10/d46/d16/d30/dcd 780 1 2023-12-16T05:56:37.514 INFO:tasks.workunit.client.0.smithi155.stdout:1/762: sync 2023-12-16T05:56:37.514 INFO:tasks.workunit.client.0.smithi155.stdout:4/645: fsync d0/d10/f3b 0 2023-12-16T05:56:37.514 INFO:tasks.workunit.client.0.smithi155.stdout:4/646: fdatasync d0/d10/d46/d16/d1a/f5c 0 2023-12-16T05:56:37.514 INFO:tasks.workunit.client.0.smithi155.stdout:5/761: mknod d0/d2/d2a/d30/d53/d7b/d99/d47/dbb/cf6 0 2023-12-16T05:56:37.515 INFO:tasks.workunit.client.1.smithi156.stdout:0/466: creat d2/d7/dd/d29/d38/d51/d52/d88/f8e x:0 0 0 2023-12-16T05:56:37.515 INFO:tasks.workunit.client.0.smithi155.stdout:9/923: symlink da/d15/d17/d24/d26/d2e/d32/l135 0 2023-12-16T05:56:37.516 INFO:tasks.workunit.client.0.smithi155.stdout:8/664: symlink d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/lda 0 2023-12-16T05:56:37.517 INFO:tasks.workunit.client.1.smithi156.stdout:2/416: rmdir d9/dd/d3f 39 2023-12-16T05:56:37.517 INFO:tasks.workunit.client.1.smithi156.stdout:2/417: chown d9/d5a/c6b 7064504 1 2023-12-16T05:56:37.517 INFO:tasks.workunit.client.1.smithi156.stdout:2/418: read - d9/d5a/f6f zero size 2023-12-16T05:56:37.518 INFO:tasks.workunit.client.1.smithi156.stdout:3/329: creat dc/d56/d67/d6e/f81 x:0 0 0 2023-12-16T05:56:37.518 INFO:tasks.workunit.client.1.smithi156.stdout:3/330: chown dc/d10/d1d/d4b/f51 823181 1 2023-12-16T05:56:37.519 INFO:tasks.workunit.client.1.smithi156.stdout:3/331: readlink dc/df/l1a 0 2023-12-16T05:56:37.519 INFO:tasks.workunit.client.0.smithi155.stdout:1/763: link d1/d7/d4b/d8e/dbc/lc3 d1/d25/d43/d5d/d5e/lee 0 2023-12-16T05:56:37.519 INFO:tasks.workunit.client.0.smithi155.stdout:8/665: mkdir d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/ddb 0 2023-12-16T05:56:37.519 INFO:tasks.workunit.client.0.smithi155.stdout:9/924: dread da/d15/d17/d24/d62/f68 [0,4194304] 0 2023-12-16T05:56:37.520 INFO:tasks.workunit.client.1.smithi156.stdout:7/619: rename d1e/d1f/d22/d75/d77/fad to d1e/d1f/d72/fd9 0 2023-12-16T05:56:37.520 INFO:tasks.workunit.client.1.smithi156.stdout:7/620: chown d1e/l20 7 1 2023-12-16T05:56:37.522 INFO:tasks.workunit.client.1.smithi156.stdout:0/467: mkdir d2/d7/dd/d2d/d5e/d8f 0 2023-12-16T05:56:37.524 INFO:tasks.workunit.client.1.smithi156.stdout:2/419: mknod d9/dd/d17/d33/c7f 0 2023-12-16T05:56:37.525 INFO:tasks.workunit.client.1.smithi156.stdout:3/332: creat dc/d10/f82 x:0 0 0 2023-12-16T05:56:37.525 INFO:tasks.workunit.client.1.smithi156.stdout:3/333: write dc/df/d34/f71 [991024,122505] 0 2023-12-16T05:56:37.527 INFO:tasks.workunit.client.1.smithi156.stdout:7/621: creat d1e/d1f/d72/da4/fda x:0 0 0 2023-12-16T05:56:37.529 INFO:tasks.workunit.client.1.smithi156.stdout:0/468: symlink d2/d7/dd/d2d/d5e/d8f/l90 0 2023-12-16T05:56:37.532 INFO:tasks.workunit.client.1.smithi156.stdout:2/420: mkdir d9/d5a/d80 0 2023-12-16T05:56:37.532 INFO:tasks.workunit.client.0.smithi155.stdout:4/647: dwrite d0/d10/d46/d16/d30/dce/d75/d3d/d49/f61 [0,4194304] 0 2023-12-16T05:56:37.533 INFO:tasks.workunit.client.1.smithi156.stdout:7/622: mkdir d1e/d55/db6/ddb 0 2023-12-16T05:56:37.535 INFO:tasks.workunit.client.1.smithi156.stdout:0/469: truncate d2/d7/dd/d1c/f36 516185 0 2023-12-16T05:56:37.535 INFO:tasks.workunit.client.1.smithi156.stdout:0/470: chown d2/d7/dd/d66 0 1 2023-12-16T05:56:37.539 INFO:tasks.workunit.client.1.smithi156.stdout:7/623: truncate f9 3039170 0 2023-12-16T05:56:37.541 INFO:tasks.workunit.client.1.smithi156.stdout:1/288: sync 2023-12-16T05:56:37.541 INFO:tasks.workunit.client.1.smithi156.stdout:1/289: chown d3/d1b/c21 0 1 2023-12-16T05:56:37.542 INFO:tasks.workunit.client.1.smithi156.stdout:1/290: dread d3/d1b/d27/f3e [0,4194304] 0 2023-12-16T05:56:37.543 INFO:tasks.workunit.client.1.smithi156.stdout:3/334: dwrite dc/d10/f18 [0,4194304] 0 2023-12-16T05:56:37.543 INFO:tasks.workunit.client.1.smithi156.stdout:3/335: dread - dc/d10/d1d/d4b/f51 zero size 2023-12-16T05:56:37.544 INFO:tasks.workunit.client.0.smithi155.stdout:1/764: dwrite d1/d7/d4b/d8e/dc7/d28/f93 [0,4194304] 0 2023-12-16T05:56:37.544 INFO:tasks.workunit.client.1.smithi156.stdout:7/624: write d1e/d1f/d22/f25 [749608,16588] 0 2023-12-16T05:56:37.544 INFO:tasks.workunit.client.1.smithi156.stdout:0/471: rmdir d2/d7/dd/d29/d38/d51/d52/d88 39 2023-12-16T05:56:37.546 INFO:tasks.workunit.client.1.smithi156.stdout:1/291: write f1 [5283118,125939] 0 2023-12-16T05:56:37.546 INFO:tasks.workunit.client.1.smithi156.stdout:2/421: dread d9/dd/d17/d33/f40 [0,4194304] 0 2023-12-16T05:56:37.547 INFO:tasks.workunit.client.1.smithi156.stdout:3/336: creat dc/d56/f83 x:0 0 0 2023-12-16T05:56:37.547 INFO:tasks.workunit.client.1.smithi156.stdout:3/337: write dc/d10/f50 [811562,96345] 0 2023-12-16T05:56:37.547 INFO:tasks.workunit.client.1.smithi156.stdout:1/292: write d3/d17/d19/f58 [5574790,130806] 0 2023-12-16T05:56:37.548 INFO:tasks.workunit.client.1.smithi156.stdout:7/625: symlink d1e/d1f/da6/d57/d59/ldc 0 2023-12-16T05:56:37.550 INFO:tasks.workunit.client.1.smithi156.stdout:0/472: link d2/d23/f27 d2/d7/dd/d29/d38/f91 0 2023-12-16T05:56:37.551 INFO:tasks.workunit.client.1.smithi156.stdout:0/473: write d2/d7/dd/d29/d2e/f3a [1371845,57582] 0 2023-12-16T05:56:37.551 INFO:tasks.workunit.client.1.smithi156.stdout:0/474: write d2/f86 [599505,12424] 0 2023-12-16T05:56:37.556 INFO:tasks.workunit.client.1.smithi156.stdout:2/422: rename d9/d68/f6c to d9/dd/d17/d33/d78/d39/d60/d6a/f81 0 2023-12-16T05:56:37.556 INFO:tasks.workunit.client.1.smithi156.stdout:2/423: dread - d9/f34 zero size 2023-12-16T05:56:37.556 INFO:tasks.workunit.client.1.smithi156.stdout:2/424: chown d9/d12/f5e 643018 1 2023-12-16T05:56:37.557 INFO:tasks.workunit.client.1.smithi156.stdout:3/338: mknod dc/d56/c84 0 2023-12-16T05:56:37.561 INFO:tasks.workunit.client.1.smithi156.stdout:1/293: symlink d3/d17/d1c/l5b 0 2023-12-16T05:56:37.562 INFO:tasks.workunit.client.1.smithi156.stdout:7/626: creat d1e/d55/db6/ddb/fdd x:0 0 0 2023-12-16T05:56:37.565 INFO:tasks.workunit.client.1.smithi156.stdout:0/475: unlink d2/d23/f27 0 2023-12-16T05:56:37.569 INFO:tasks.workunit.client.1.smithi156.stdout:2/425: dread d9/d12/f63 [0,4194304] 0 2023-12-16T05:56:37.569 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.566+0000 7f7815766700 1 -- 172.21.15.155:0/1588529524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7810070570 msgr2=0x7f78100709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:37.569 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.566+0000 7f7815766700 1 --2- 172.21.15.155:0/1588529524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7810070570 0x7f78100709c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f77f8004940 tx=0x7f77f8009e30 comp rx=0 tx=0).stop 2023-12-16T05:56:37.569 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.566+0000 7f7815766700 1 -- 172.21.15.155:0/1588529524 shutdown_connections 2023-12-16T05:56:37.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.566+0000 7f7815766700 1 --2- 172.21.15.155:0/1588529524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7810070570 0x7f78100709c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:37.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.566+0000 7f7815766700 1 --2- 172.21.15.155:0/1588529524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7810071bc0 0x7f7810070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:37.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.566+0000 7f7815766700 1 -- 172.21.15.155:0/1588529524 >> 172.21.15.155:0/1588529524 conn(0x7f78100f82d0 msgr2=0x7f78100fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:56:37.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.566+0000 7f7815766700 1 -- 172.21.15.155:0/1588529524 shutdown_connections 2023-12-16T05:56:37.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.566+0000 7f7815766700 1 -- 172.21.15.155:0/1588529524 wait complete. 2023-12-16T05:56:37.571 INFO:tasks.workunit.client.1.smithi156.stdout:0/476: getdents d2/d7/dd/d29/d38/d51/d65 0 2023-12-16T05:56:37.571 INFO:tasks.workunit.client.1.smithi156.stdout:0/477: fsync d2/d7/dd/d29/f84 0 2023-12-16T05:56:37.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.567+0000 7f7815766700 1 Processor -- start 2023-12-16T05:56:37.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.567+0000 7f7815766700 1 -- start start 2023-12-16T05:56:37.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.567+0000 7f7815766700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7810070570 0x7f781010f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:37.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.567+0000 7f7815766700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7810071bc0 0x7f781010fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:37.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.567+0000 7f7815766700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78101103d0 con 0x7f7810070570 2023-12-16T05:56:37.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.567+0000 7f7815766700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7810110c10 con 0x7f7810071bc0 2023-12-16T05:56:37.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.568+0000 7f780effd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7810070570 0x7f781010f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:37.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.568+0000 7f780effd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7810070570 0x7f781010f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53112/0 (socket says 172.21.15.155:53112) 2023-12-16T05:56:37.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.568+0000 7f780effd700 1 -- 172.21.15.155:0/3192630064 learned_addr learned my addr 172.21.15.155:0/3192630064 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:56:37.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.568+0000 7f7807fff700 1 --2- 172.21.15.155:0/3192630064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7810071bc0 0x7f781010fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:37.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.568+0000 7f780effd700 1 -- 172.21.15.155:0/3192630064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7810071bc0 msgr2=0x7f781010fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:37.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.568+0000 7f780effd700 1 --2- 172.21.15.155:0/3192630064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7810071bc0 0x7f781010fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:37.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.568+0000 7f780effd700 1 -- 172.21.15.155:0/3192630064 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f8005040 con 0x7f7810070570 2023-12-16T05:56:37.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.568+0000 7f780effd700 1 --2- 172.21.15.155:0/3192630064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7810070570 0x7f781010f800 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f780000b790 tx=0x7f7800009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:56:37.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.568+0000 7f78077fe700 1 -- 172.21.15.155:0/3192630064 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f780000f6f0 con 0x7f7810070570 2023-12-16T05:56:37.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.568+0000 7f78077fe700 1 -- 172.21.15.155:0/3192630064 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f780000fd00 con 0x7f7810070570 2023-12-16T05:56:37.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.569+0000 7f78077fe700 1 -- 172.21.15.155:0/3192630064 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78000103a0 con 0x7f7810070570 2023-12-16T05:56:37.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.569+0000 7f7815766700 1 -- 172.21.15.155:0/3192630064 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7810110ef0 con 0x7f7810070570 2023-12-16T05:56:37.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.569+0000 7f7815766700 1 -- 172.21.15.155:0/3192630064 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7810111430 con 0x7f7810070570 2023-12-16T05:56:37.574 INFO:tasks.workunit.client.1.smithi156.stdout:3/339: dwrite dc/df/f2b [0,4194304] 0 2023-12-16T05:56:37.574 INFO:tasks.workunit.client.1.smithi156.stdout:3/340: chown dc/d10/d1d/d4b/d52/c64 1455713 1 2023-12-16T05:56:37.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.570+0000 7f78077fe700 1 -- 172.21.15.155:0/3192630064 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 24) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f780000f850 con 0x7f7810070570 2023-12-16T05:56:37.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.570+0000 7f7815766700 1 -- 172.21.15.155:0/3192630064 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781004bb80 con 0x7f7810070570 2023-12-16T05:56:37.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.571+0000 7f78077fe700 1 --2- 172.21.15.155:0/3192630064 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f77fc06ae40 0x7f77fc06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:37.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.571+0000 7f78077fe700 1 -- 172.21.15.155:0/3192630064 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f7800089400 con 0x7f7810070570 2023-12-16T05:56:37.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.572+0000 7f7807fff700 1 --2- 172.21.15.155:0/3192630064 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f77fc06ae40 0x7f77fc06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:37.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.573+0000 7f7807fff700 1 --2- 172.21.15.155:0/3192630064 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f77fc06ae40 0x7f77fc06d2f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f77f8009fd0 tx=0x7f77f8009e30 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:56:37.577 INFO:tasks.workunit.client.1.smithi156.stdout:3/341: rmdir dc/d6a 0 2023-12-16T05:56:37.579 INFO:tasks.workunit.client.1.smithi156.stdout:2/426: dread d9/dd/d3f/f52 [0,4194304] 0 2023-12-16T05:56:37.579 INFO:tasks.workunit.client.1.smithi156.stdout:3/342: mknod dc/df/d34/d62/c85 0 2023-12-16T05:56:37.579 INFO:tasks.workunit.client.1.smithi156.stdout:7/627: dwrite d1e/d1f/d22/d75/f9f [0,4194304] 0 2023-12-16T05:56:37.580 INFO:tasks.workunit.client.1.smithi156.stdout:3/343: symlink dc/d56/d69/l86 0 2023-12-16T05:56:37.581 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.578+0000 7f78077fe700 1 -- 172.21.15.155:0/3192630064 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f78000573b0 con 0x7f7810070570 2023-12-16T05:56:37.583 INFO:tasks.workunit.client.1.smithi156.stdout:0/478: dwrite d2/d7/dd/f33 [4194304,4194304] 0 2023-12-16T05:56:37.586 INFO:tasks.workunit.client.1.smithi156.stdout:3/344: fsync dc/d10/f50 0 2023-12-16T05:56:37.586 INFO:tasks.workunit.client.1.smithi156.stdout:7/628: creat d1e/d55/fde x:0 0 0 2023-12-16T05:56:37.589 INFO:tasks.workunit.client.1.smithi156.stdout:0/479: dread d2/d23/f32 [0,4194304] 0 2023-12-16T05:56:37.593 INFO:tasks.workunit.client.1.smithi156.stdout:1/294: truncate d3/d17/d19/f58 4589809 0 2023-12-16T05:56:37.594 INFO:tasks.workunit.client.1.smithi156.stdout:3/345: creat dc/d10/d3d/f87 x:0 0 0 2023-12-16T05:56:37.595 INFO:tasks.workunit.client.1.smithi156.stdout:2/427: dwrite d9/dd/f1b [0,4194304] 0 2023-12-16T05:56:37.595 INFO:tasks.workunit.client.1.smithi156.stdout:2/428: chown d9/dd/d17/d33/l32 197 1 2023-12-16T05:56:37.597 INFO:tasks.workunit.client.1.smithi156.stdout:0/480: mknod d2/d7/dd/d29/d38/d3f/c92 0 2023-12-16T05:56:37.597 INFO:tasks.workunit.client.1.smithi156.stdout:0/481: rename d2/d7 to d2/d7/dd/d2d/d93 22 2023-12-16T05:56:37.598 INFO:tasks.workunit.client.0.smithi155.stdout:8/666: mkdir d4/d62/d66/d78/d88/d12/ddc 0 2023-12-16T05:56:37.598 INFO:tasks.workunit.client.0.smithi155.stdout:8/667: truncate d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/fcd 557780 0 2023-12-16T05:56:37.600 INFO:tasks.workunit.client.0.smithi155.stdout:9/925: stat da/d15/d17/d36/d54/l88 0 2023-12-16T05:56:37.601 INFO:tasks.workunit.client.1.smithi156.stdout:7/629: dwrite d1e/d1f/da6/fcf [0,4194304] 0 2023-12-16T05:56:37.601 INFO:tasks.workunit.client.1.smithi156.stdout:1/295: creat d3/d1b/d27/f5c x:0 0 0 2023-12-16T05:56:37.602 INFO:tasks.workunit.client.0.smithi155.stdout:4/648: rename d0/d10/d46/d16/d30/dce/d75/d89/d9a/lc0 to d0/d10/d46/d16/d30/dce/d75/d3d/d49/dbb/ld4 0 2023-12-16T05:56:37.602 INFO:tasks.workunit.client.1.smithi156.stdout:3/346: mknod dc/d56/d67/d6e/c88 0 2023-12-16T05:56:37.604 INFO:tasks.workunit.client.0.smithi155.stdout:1/765: creat d1/d7/d16/de4/fef x:0 0 0 2023-12-16T05:56:37.604 INFO:tasks.workunit.client.0.smithi155.stdout:1/766: readlink d1/d7/l3d 0 2023-12-16T05:56:37.608 INFO:tasks.workunit.client.1.smithi156.stdout:2/429: symlink d9/dd/d17/l82 0 2023-12-16T05:56:37.616 INFO:tasks.workunit.client.1.smithi156.stdout:4/388: sync 2023-12-16T05:56:37.616 INFO:tasks.workunit.client.1.smithi156.stdout:4/389: fsync d9/d2b/d56/f6d 0 2023-12-16T05:56:37.616 INFO:tasks.workunit.client.1.smithi156.stdout:9/423: sync 2023-12-16T05:56:37.617 INFO:tasks.workunit.client.1.smithi156.stdout:1/296: creat d3/d3a/f5d x:0 0 0 2023-12-16T05:56:37.618 INFO:tasks.workunit.client.1.smithi156.stdout:3/347: mknod dc/df/d34/d62/c89 0 2023-12-16T05:56:37.618 INFO:tasks.workunit.client.1.smithi156.stdout:3/348: chown dc/d10/d3d/d4e/l6d 9 1 2023-12-16T05:56:37.618 INFO:tasks.workunit.client.1.smithi156.stdout:3/349: write dc/d10/f82 [900137,82158] 0 2023-12-16T05:56:37.618 INFO:tasks.workunit.client.1.smithi156.stdout:3/350: write dc/df/f2d [908294,27295] 0 2023-12-16T05:56:37.620 INFO:tasks.workunit.client.0.smithi155.stdout:4/649: creat d0/d10/d46/d16/d1a/d70/d92/daf/db7/dbc/fd5 x:0 0 0 2023-12-16T05:56:37.620 INFO:tasks.workunit.client.0.smithi155.stdout:4/650: stat d0 0 2023-12-16T05:56:37.620 INFO:tasks.workunit.client.0.smithi155.stdout:4/651: chown d0/d10/d46/d16/d1a/d70/d92/daf/db7 19775087 1 2023-12-16T05:56:37.624 INFO:tasks.workunit.client.1.smithi156.stdout:4/390: dread d9/d2b/f31 [0,4194304] 0 2023-12-16T05:56:37.624 INFO:tasks.workunit.client.1.smithi156.stdout:4/391: chown d9/d2b/d56/d77/f83 31 1 2023-12-16T05:56:37.626 INFO:tasks.workunit.client.1.smithi156.stdout:2/430: getdents d9/dd/d17/d33/d78/d39/d60/d6a 0 2023-12-16T05:56:37.626 INFO:tasks.workunit.client.1.smithi156.stdout:2/431: write d9/d68/f75 [588678,29084] 0 2023-12-16T05:56:37.626 INFO:tasks.workunit.client.1.smithi156.stdout:2/432: chown d9/d5a 95791870 1 2023-12-16T05:56:37.627 INFO:tasks.workunit.client.1.smithi156.stdout:3/351: symlink dc/d56/d67/l8a 0 2023-12-16T05:56:37.631 INFO:tasks.workunit.client.1.smithi156.stdout:2/433: mkdir d9/dd/d3f/d83 0 2023-12-16T05:56:37.631 INFO:tasks.workunit.client.1.smithi156.stdout:2/434: chown d9/f5c 3389161 1 2023-12-16T05:56:37.631 INFO:tasks.workunit.client.1.smithi156.stdout:2/435: write d9/dd/d17/d33/d78/d39/d60/d6a/f81 [2207862,77090] 0 2023-12-16T05:56:37.633 INFO:tasks.workunit.client.1.smithi156.stdout:3/352: link dc/df/c3e dc/d10/d3d/c8b 0 2023-12-16T05:56:37.633 INFO:tasks.workunit.client.1.smithi156.stdout:3/353: write dc/d10/d1d/d4b/f51 [52982,122542] 0 2023-12-16T05:56:37.633 INFO:tasks.workunit.client.1.smithi156.stdout:3/354: write dc/d10/d1d/f5d [1435370,56987] 0 2023-12-16T05:56:37.633 INFO:tasks.workunit.client.1.smithi156.stdout:3/355: write dc/d56/d69/f7f [477515,49177] 0 2023-12-16T05:56:37.634 INFO:tasks.workunit.client.1.smithi156.stdout:9/424: dread d6/d19/d25/d3a/f43 [0,4194304] 0 2023-12-16T05:56:37.634 INFO:tasks.workunit.client.1.smithi156.stdout:9/425: chown d6/d19/d30/l6d 15 1 2023-12-16T05:56:37.634 INFO:tasks.workunit.client.1.smithi156.stdout:9/426: chown d6/d2e/f52 69 1 2023-12-16T05:56:37.636 INFO:tasks.workunit.client.1.smithi156.stdout:2/436: creat d9/dd/d3f/d83/f84 x:0 0 0 2023-12-16T05:56:37.636 INFO:tasks.workunit.client.1.smithi156.stdout:5/607: sync 2023-12-16T05:56:37.636 INFO:tasks.workunit.client.1.smithi156.stdout:6/382: sync 2023-12-16T05:56:37.638 INFO:tasks.workunit.client.1.smithi156.stdout:3/356: link dc/df/d34/d62/c85 dc/d56/d67/c8c 0 2023-12-16T05:56:37.639 INFO:tasks.workunit.client.1.smithi156.stdout:8/318: sync 2023-12-16T05:56:37.639 INFO:tasks.workunit.client.1.smithi156.stdout:8/319: readlink d3/d7/d27/l5f 0 2023-12-16T05:56:37.640 INFO:tasks.workunit.client.1.smithi156.stdout:9/427: creat d6/f8f x:0 0 0 2023-12-16T05:56:37.640 INFO:tasks.workunit.client.1.smithi156.stdout:9/428: fsync d6/d19/f24 0 2023-12-16T05:56:37.643 INFO:tasks.workunit.client.1.smithi156.stdout:2/437: rename d9/dd/f5d to d9/d5a/d80/f85 0 2023-12-16T05:56:37.644 INFO:tasks.workunit.client.1.smithi156.stdout:3/357: getdents dc/d10/d1d/d4b/d52 0 2023-12-16T05:56:37.645 INFO:tasks.workunit.client.1.smithi156.stdout:8/320: creat d3/d18/f64 x:0 0 0 2023-12-16T05:56:37.645 INFO:tasks.workunit.client.1.smithi156.stdout:8/321: dread - d3/d12/d16/d54/f60 zero size 2023-12-16T05:56:37.646 INFO:tasks.workunit.client.1.smithi156.stdout:9/429: creat d6/d19/d25/d3a/d88/d8b/f90 x:0 0 0 2023-12-16T05:56:37.648 INFO:tasks.workunit.client.1.smithi156.stdout:6/383: rename d9/d1c/d61 to d9/d13/d2f/d51/d6b/d77 0 2023-12-16T05:56:37.648 INFO:tasks.workunit.client.1.smithi156.stdout:6/384: fsync d9/d1c/f3a 0 2023-12-16T05:56:37.650 INFO:tasks.workunit.client.1.smithi156.stdout:2/438: mkdir d9/dd/d17/d33/d86 0 2023-12-16T05:56:37.652 INFO:tasks.workunit.client.1.smithi156.stdout:3/358: creat dc/df/d34/d62/f8d x:0 0 0 2023-12-16T05:56:37.652 INFO:tasks.workunit.client.1.smithi156.stdout:3/359: fdatasync dc/d10/f11 0 2023-12-16T05:56:37.652 INFO:tasks.workunit.client.1.smithi156.stdout:3/360: read dc/df/d34/f71 [554575,125655] 0 2023-12-16T05:56:37.652 INFO:tasks.workunit.client.1.smithi156.stdout:3/361: fdatasync dc/d56/d67/f6f 0 2023-12-16T05:56:37.652 INFO:tasks.workunit.client.1.smithi156.stdout:3/362: chown dc/d10/d1d/c7d 6 1 2023-12-16T05:56:37.652 INFO:tasks.workunit.client.1.smithi156.stdout:3/363: read - dc/d10/d1d/d4b/d52/f72 zero size 2023-12-16T05:56:37.653 INFO:tasks.workunit.client.1.smithi156.stdout:9/430: truncate d6/d19/d25/f38 147687 0 2023-12-16T05:56:37.653 INFO:tasks.workunit.client.1.smithi156.stdout:9/431: chown d6/d2e/f66 7042 1 2023-12-16T05:56:37.655 INFO:tasks.workunit.client.1.smithi156.stdout:6/385: mkdir d9/d1c/d78 0 2023-12-16T05:56:37.657 INFO:tasks.workunit.client.1.smithi156.stdout:3/364: rename dc/d56/d69/f80 to dc/d10/d1d/f8e 0 2023-12-16T05:56:37.657 INFO:tasks.workunit.client.1.smithi156.stdout:2/439: dread d9/f5c [0,4194304] 0 2023-12-16T05:56:37.659 INFO:tasks.workunit.client.1.smithi156.stdout:6/386: creat d9/d13/d2f/d36/f79 x:0 0 0 2023-12-16T05:56:37.659 INFO:tasks.workunit.client.1.smithi156.stdout:6/387: write d9/d13/f4d [808169,3909] 0 2023-12-16T05:56:37.659 INFO:tasks.workunit.client.1.smithi156.stdout:3/365: getdents dc/d10/d3d/d4e 0 2023-12-16T05:56:37.660 INFO:tasks.workunit.client.1.smithi156.stdout:2/440: creat d9/dd/d17/d33/d47/f87 x:0 0 0 2023-12-16T05:56:37.662 INFO:tasks.workunit.client.1.smithi156.stdout:9/432: mknod d6/d19/c91 0 2023-12-16T05:56:37.666 INFO:tasks.workunit.client.1.smithi156.stdout:2/441: mknod d9/d12/c88 0 2023-12-16T05:56:37.666 INFO:tasks.workunit.client.1.smithi156.stdout:2/442: chown d9/dd/d3f 182 1 2023-12-16T05:56:37.667 INFO:tasks.workunit.client.1.smithi156.stdout:2/443: symlink d9/dd/l89 0 2023-12-16T05:56:37.689 INFO:tasks.workunit.client.1.smithi156.stdout:6/388: read d9/d13/f14 [4798340,92686] 0 2023-12-16T05:56:37.691 INFO:tasks.workunit.client.1.smithi156.stdout:6/389: rename d9/d13/d2f/d51/c64 to d9/d13/d2f/d51/d6b/c7a 0 2023-12-16T05:56:37.691 INFO:tasks.workunit.client.1.smithi156.stdout:6/390: readlink d9/d13/d2f/d36/l4c 0 2023-12-16T05:56:37.692 INFO:tasks.workunit.client.1.smithi156.stdout:6/391: creat d9/d13/d2f/d51/d69/f7b x:0 0 0 2023-12-16T05:56:37.694 INFO:tasks.workunit.client.1.smithi156.stdout:6/392: rename d9/l42 to d9/d13/d2f/d51/d6b/l7c 0 2023-12-16T05:56:37.695 INFO:tasks.workunit.client.1.smithi156.stdout:6/393: creat d9/d13/d2f/d51/d69/f7d x:0 0 0 2023-12-16T05:56:37.695 INFO:tasks.workunit.client.1.smithi156.stdout:6/394: write d9/d13/d3e/f6c [5227904,25267] 0 2023-12-16T05:56:37.695 INFO:tasks.workunit.client.1.smithi156.stdout:6/395: dread - d9/d13/d2f/d51/d69/f71 zero size 2023-12-16T05:56:37.697 INFO:tasks.workunit.client.1.smithi156.stdout:6/396: mkdir d9/d13/d2f/d51/d6b/d77/d7e 0 2023-12-16T05:56:37.697 INFO:tasks.workunit.client.1.smithi156.stdout:6/397: chown d9/d13/f3d 801533 1 2023-12-16T05:56:37.697 INFO:tasks.workunit.client.1.smithi156.stdout:6/398: stat c4 0 2023-12-16T05:56:37.701 INFO:tasks.workunit.client.1.smithi156.stdout:2/444: dread d9/d68/f75 [0,4194304] 0 2023-12-16T05:56:37.702 INFO:tasks.workunit.client.0.smithi155.stdout:8/668: dwrite d4/d62/d66/d78/d88/d1b/d1c/d97/fa1 [0,4194304] 0 2023-12-16T05:56:37.702 INFO:tasks.workunit.client.1.smithi156.stdout:2/445: fsync d9/dd/d17/d33/d78/d39/f3e 0 2023-12-16T05:56:37.704 INFO:tasks.workunit.client.1.smithi156.stdout:2/446: creat d9/dd/f8a x:0 0 0 2023-12-16T05:56:37.705 INFO:tasks.workunit.client.1.smithi156.stdout:7/630: dwrite d1e/d1f/da6/d57/f92 [0,4194304] 0 2023-12-16T05:56:37.706 INFO:tasks.workunit.client.1.smithi156.stdout:2/447: link d9/dd/d17/d33/d78/f70 d9/d5a/d80/f8b 0 2023-12-16T05:56:37.706 INFO:tasks.workunit.client.1.smithi156.stdout:2/448: fdatasync d9/dd/d17/f3a 0 2023-12-16T05:56:37.707 INFO:tasks.workunit.client.0.smithi155.stdout:8/669: unlink d4/d62/d66/d78/d88/d1b/d1c/d1a/f2c 0 2023-12-16T05:56:37.709 INFO:tasks.workunit.client.0.smithi155.stdout:8/670: creat d4/d62/d66/d78/d88/d1b/d1c/d19/da3/fdd x:0 0 0 2023-12-16T05:56:37.710 INFO:tasks.workunit.client.1.smithi156.stdout:7/631: symlink d1e/d1f/da6/ldf 0 2023-12-16T05:56:37.711 INFO:tasks.workunit.client.0.smithi155.stdout:8/671: dread d4/d62/d66/d78/d88/d1b/f7c [0,4194304] 0 2023-12-16T05:56:37.711 INFO:tasks.workunit.client.0.smithi155.stdout:8/672: chown d4/d62/d66/d78/d88/d12/ddc 42377619 1 2023-12-16T05:56:37.711 INFO:tasks.workunit.client.0.smithi155.stdout:8/673: truncate d4/f41 5210562 0 2023-12-16T05:56:37.712 INFO:tasks.workunit.client.0.smithi155.stdout:8/674: creat d4/d62/d66/d78/d88/fde x:0 0 0 2023-12-16T05:56:37.712 INFO:tasks.workunit.client.1.smithi156.stdout:7/632: creat d1e/d55/db6/ddb/fe0 x:0 0 0 2023-12-16T05:56:37.713 INFO:tasks.workunit.client.1.smithi156.stdout:7/633: readlink d1e/d1f/d22/lb8 0 2023-12-16T05:56:37.713 INFO:tasks.workunit.client.0.smithi155.stdout:8/675: rename d4/d62/d66/d78/d88/d1b/d1c/d97/d29/f9c to d4/d62/d66/fdf 0 2023-12-16T05:56:37.714 INFO:tasks.workunit.client.1.smithi156.stdout:2/449: mkdir d9/dd/d17/d33/d78/d39/d8c 0 2023-12-16T05:56:37.714 INFO:tasks.workunit.client.1.smithi156.stdout:2/450: readlink d9/dd/d17/l82 0 2023-12-16T05:56:37.715 INFO:tasks.workunit.client.1.smithi156.stdout:7/634: truncate f7 888196 0 2023-12-16T05:56:37.716 INFO:tasks.workunit.client.1.smithi156.stdout:2/451: mknod d9/d68/c8d 0 2023-12-16T05:56:37.716 INFO:tasks.workunit.client.1.smithi156.stdout:2/452: write d9/f1f [4768812,60358] 0 2023-12-16T05:56:37.717 INFO:tasks.workunit.client.1.smithi156.stdout:7/635: write d1e/f32 [1337870,29592] 0 2023-12-16T05:56:37.718 INFO:tasks.workunit.client.1.smithi156.stdout:2/453: symlink d9/d56/l8e 0 2023-12-16T05:56:37.719 INFO:tasks.workunit.client.1.smithi156.stdout:2/454: mkdir d9/dd/d17/d8f 0 2023-12-16T05:56:37.721 INFO:tasks.workunit.client.1.smithi156.stdout:2/455: link d9/dd/f1b d9/d68/f90 0 2023-12-16T05:56:37.721 INFO:tasks.workunit.client.1.smithi156.stdout:2/456: fsync d9/f34 0 2023-12-16T05:56:37.722 INFO:tasks.workunit.client.1.smithi156.stdout:2/457: unlink d9/d12/f72 0 2023-12-16T05:56:37.723 INFO:tasks.workunit.client.0.smithi155.stdout:8/676: dread d4/d62/d66/d78/d88/d1b/d1c/d97/f59 [0,4194304] 0 2023-12-16T05:56:37.723 INFO:tasks.workunit.client.1.smithi156.stdout:2/458: mkdir d9/dd/d17/d33/d78/d39/d60/d6a/d91 0 2023-12-16T05:56:37.724 INFO:tasks.workunit.client.0.smithi155.stdout:8/677: creat d4/d62/d66/d78/d88/d1b/d1c/d19/dd0/fe0 x:0 0 0 2023-12-16T05:56:37.725 INFO:tasks.workunit.client.1.smithi156.stdout:6/399: write d9/d1c/f72 [1569477,122136] 0 2023-12-16T05:56:37.725 INFO:tasks.workunit.client.1.smithi156.stdout:7/636: dread d1e/d1f/da6/f4d [0,4194304] 0 2023-12-16T05:56:37.725 INFO:tasks.workunit.client.1.smithi156.stdout:6/400: fsync d9/d13/f17 0 2023-12-16T05:56:37.725 INFO:tasks.workunit.client.1.smithi156.stdout:6/401: getdents d9/d1c/d78 0 2023-12-16T05:56:37.725 INFO:tasks.workunit.client.1.smithi156.stdout:6/402: chown d9/d13/d2f/d51/d69/f7d 127 1 2023-12-16T05:56:37.725 INFO:tasks.workunit.client.1.smithi156.stdout:6/403: dread - d9/d1c/f46 zero size 2023-12-16T05:56:37.725 INFO:tasks.workunit.client.1.smithi156.stdout:6/404: chown d9/d13/d3e/f6c 25179 1 2023-12-16T05:56:37.725 INFO:tasks.workunit.client.1.smithi156.stdout:2/459: symlink d9/dd/d17/d33/d78/d74/l92 0 2023-12-16T05:56:37.726 INFO:tasks.workunit.client.0.smithi155.stdout:8/678: write d4/d62/d66/d78/d88/d1b/d2a/d51/f6e [4217479,14945] 0 2023-12-16T05:56:37.726 INFO:tasks.workunit.client.0.smithi155.stdout:8/679: creat d4/fe1 x:0 0 0 2023-12-16T05:56:37.727 INFO:tasks.workunit.client.1.smithi156.stdout:7/637: symlink d1e/d1f/da6/d57/d59/dd8/le1 0 2023-12-16T05:56:37.727 INFO:tasks.workunit.client.0.smithi155.stdout:8/680: mkdir d4/d62/d66/d78/d88/d1b/d2a/de2 0 2023-12-16T05:56:37.728 INFO:tasks.workunit.client.1.smithi156.stdout:6/405: creat d9/d13/d3e/d5f/f7f x:0 0 0 2023-12-16T05:56:37.729 INFO:tasks.workunit.client.1.smithi156.stdout:6/406: chown d9/d13/f14 1107766 1 2023-12-16T05:56:37.731 INFO:tasks.workunit.client.1.smithi156.stdout:2/460: symlink d9/dd/d17/d33/d86/l93 0 2023-12-16T05:56:37.734 INFO:tasks.workunit.client.1.smithi156.stdout:0/482: dwrite d2/d7/dd/d29/d38/d51/d52/f8c [0,4194304] 0 2023-12-16T05:56:37.734 INFO:tasks.workunit.client.1.smithi156.stdout:1/297: dwrite d3/d17/f33 [4194304,4194304] 0 2023-12-16T05:56:37.734 INFO:tasks.workunit.client.1.smithi156.stdout:1/298: stat d3/f6 0 2023-12-16T05:56:37.738 INFO:tasks.workunit.client.0.smithi155.stdout:4/652: dwrite d0/d10/d46/d16/d30/dce/d75/d3d/d85/fc7 [0,4194304] 0 2023-12-16T05:56:37.738 INFO:tasks.workunit.client.0.smithi155.stdout:4/653: write d0/d10/d46/d16/d1a/f69 [219629,44229] 0 2023-12-16T05:56:37.738 INFO:tasks.workunit.client.0.smithi155.stdout:4/654: write d0/d10/d46/d16/d1a/d70/d92/daf/fb8 [298185,72810] 0 2023-12-16T05:56:37.738 INFO:tasks.workunit.client.0.smithi155.stdout:9/926: dwrite da/d15/d17/d24/d62/fc4 [0,4194304] 0 2023-12-16T05:56:37.739 INFO:tasks.workunit.client.1.smithi156.stdout:9/433: dwrite d6/fd [4194304,4194304] 0 2023-12-16T05:56:37.741 INFO:tasks.workunit.client.1.smithi156.stdout:2/461: dread f2 [0,4194304] 0 2023-12-16T05:56:37.741 INFO:tasks.workunit.client.1.smithi156.stdout:8/322: dwrite d3/d12/f58 [0,4194304] 0 2023-12-16T05:56:37.741 INFO:tasks.workunit.client.1.smithi156.stdout:5/608: dwrite da/dc/d2d/f43 [0,4194304] 0 2023-12-16T05:56:37.741 INFO:tasks.workunit.client.1.smithi156.stdout:5/609: fsync da/dc/d2d/d4d/fbd 0 2023-12-16T05:56:37.742 INFO:tasks.workunit.client.1.smithi156.stdout:1/299: creat d3/d17/f5e x:0 0 0 2023-12-16T05:56:37.744 INFO:tasks.workunit.client.1.smithi156.stdout:9/434: getdents d6/d19/d25/d3a/d88/d8b 0 2023-12-16T05:56:37.747 INFO:tasks.workunit.client.0.smithi155.stdout:1/767: dwrite d1/d7/d4b/d5c/f82 [0,4194304] 0 2023-12-16T05:56:37.750 INFO:tasks.workunit.client.1.smithi156.stdout:2/462: symlink d9/d5a/l94 0 2023-12-16T05:56:37.756 INFO:tasks.workunit.client.1.smithi156.stdout:5/610: rmdir da/dc/d2d/d4d/d54/d90/dc0 0 2023-12-16T05:56:37.757 INFO:tasks.workunit.client.1.smithi156.stdout:5/611: write da/d46/fb5 [3515261,13065] 0 2023-12-16T05:56:37.757 INFO:tasks.workunit.client.1.smithi156.stdout:8/323: creat d3/d18/f65 x:0 0 0 2023-12-16T05:56:37.757 INFO:tasks.workunit.client.1.smithi156.stdout:8/324: chown d3/d18/f22 59 1 2023-12-16T05:56:37.757 INFO:tasks.workunit.client.1.smithi156.stdout:7/638: dwrite d1e/f24 [4194304,4194304] 0 2023-12-16T05:56:37.761 INFO:tasks.workunit.client.1.smithi156.stdout:6/407: dwrite d9/f70 [4194304,4194304] 0 2023-12-16T05:56:37.762 INFO:tasks.workunit.client.1.smithi156.stdout:5/612: rmdir da/dc/d4b 39 2023-12-16T05:56:37.764 INFO:tasks.workunit.client.1.smithi156.stdout:8/325: mkdir d3/d7/d66 0 2023-12-16T05:56:37.764 INFO:tasks.workunit.client.1.smithi156.stdout:8/326: fsync d3/d7/f31 0 2023-12-16T05:56:37.764 INFO:tasks.workunit.client.0.smithi155.stdout:9/927: dwrite da/d15/d17/d24/d62/f97 [0,4194304] 0 2023-12-16T05:56:37.771 INFO:tasks.workunit.client.1.smithi156.stdout:6/408: rename d9/d13/d3e/c43 to d9/d13/c80 0 2023-12-16T05:56:37.772 INFO:tasks.workunit.client.1.smithi156.stdout:7/639: dread d1e/d55/f7e [0,4194304] 0 2023-12-16T05:56:37.773 INFO:tasks.workunit.client.1.smithi156.stdout:0/483: dwrite d2/d7/f18 [4194304,4194304] 0 2023-12-16T05:56:37.773 INFO:tasks.workunit.client.1.smithi156.stdout:0/484: chown d2/d7/dd/d29/d38/d51/l81 1471976395 1 2023-12-16T05:56:37.774 INFO:tasks.workunit.client.0.smithi155.stdout:8/681: rename d4/d62/d66/d78/d88/d1b/d1c/f5c to d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/fe3 0 2023-12-16T05:56:37.774 INFO:tasks.workunit.client.0.smithi155.stdout:4/655: symlink d0/d10/d46/d16/d30/dce/d75/d3d/d49/db1/ld6 0 2023-12-16T05:56:37.774 INFO:tasks.workunit.client.1.smithi156.stdout:6/409: mknod d9/d13/d2f/d51/d6b/c81 0 2023-12-16T05:56:37.775 INFO:tasks.workunit.client.1.smithi156.stdout:7/640: mknod d1e/daf/ce2 0 2023-12-16T05:56:37.779 INFO:tasks.workunit.client.1.smithi156.stdout:6/410: unlink d9/d13/d2f/d51/d6b/c81 0 2023-12-16T05:56:37.779 INFO:tasks.workunit.client.1.smithi156.stdout:7/641: symlink d1e/d55/d71/d61/le3 0 2023-12-16T05:56:37.780 INFO:tasks.workunit.client.1.smithi156.stdout:0/485: write d2/f22 [2331352,26416] 0 2023-12-16T05:56:37.780 INFO:tasks.workunit.client.1.smithi156.stdout:6/411: getdents d9/d13/d2f/d51/d69 0 2023-12-16T05:56:37.781 INFO:tasks.workunit.client.0.smithi155.stdout:9/928: unlink da/d15/d17/d36/d5b/f129 0 2023-12-16T05:56:37.782 INFO:tasks.workunit.client.1.smithi156.stdout:7/642: dread d1e/d55/d71/d61/fa3 [0,4194304] 0 2023-12-16T05:56:37.783 INFO:tasks.workunit.client.1.smithi156.stdout:1/300: dwrite d3/d1b/d27/f5c [0,4194304] 0 2023-12-16T05:56:37.783 INFO:tasks.workunit.client.0.smithi155.stdout:4/656: mknod d0/d10/d46/d16/d1a/d70/d92/cd7 0 2023-12-16T05:56:37.784 INFO:tasks.workunit.client.1.smithi156.stdout:0/486: getdents d2/d7/dd/d29/d4b/d76 0 2023-12-16T05:56:37.785 INFO:tasks.workunit.client.1.smithi156.stdout:7/643: symlink d1e/d55/d71/d94/le4 0 2023-12-16T05:56:37.785 INFO:tasks.workunit.client.1.smithi156.stdout:7/644: chown d1e/d39/d93/l95 7493 1 2023-12-16T05:56:37.788 INFO:tasks.workunit.client.1.smithi156.stdout:6/412: dread d9/d1c/f39 [0,4194304] 0 2023-12-16T05:56:37.789 INFO:tasks.workunit.client.1.smithi156.stdout:1/301: chown d3/cd 99850784 1 2023-12-16T05:56:37.790 INFO:tasks.workunit.client.1.smithi156.stdout:9/435: dwrite d6/d2e/f86 [0,4194304] 0 2023-12-16T05:56:37.790 INFO:tasks.workunit.client.1.smithi156.stdout:9/436: getdents d6/d19/d30/d48/d87/d8d 0 2023-12-16T05:56:37.791 INFO:tasks.workunit.client.1.smithi156.stdout:7/645: creat d1e/d55/d71/d61/fe5 x:0 0 0 2023-12-16T05:56:37.791 INFO:tasks.workunit.client.1.smithi156.stdout:7/646: stat d1e/d1f/da6/d57/l82 0 2023-12-16T05:56:37.791 INFO:tasks.workunit.client.1.smithi156.stdout:7/647: fdatasync d1e/d1f/f3a 0 2023-12-16T05:56:37.791 INFO:tasks.workunit.client.1.smithi156.stdout:7/648: stat d1e 0 2023-12-16T05:56:37.791 INFO:tasks.workunit.client.1.smithi156.stdout:7/649: truncate d1e/d55/d71/d61/f5d 473985 0 2023-12-16T05:56:37.791 INFO:tasks.workunit.client.1.smithi156.stdout:7/650: write d1e/d55/d71/d61/daa/db4/fc2 [956953,69612] 0 2023-12-16T05:56:37.792 INFO:tasks.workunit.client.1.smithi156.stdout:6/413: unlink d9/cd 0 2023-12-16T05:56:37.792 INFO:tasks.workunit.client.1.smithi156.stdout:2/463: dwrite d9/d5a/d80/f85 [4194304,4194304] 0 2023-12-16T05:56:37.792 INFO:tasks.workunit.client.1.smithi156.stdout:2/464: dread - d9/d5a/f6f zero size 2023-12-16T05:56:37.793 INFO:tasks.workunit.client.0.smithi155.stdout:1/768: dwrite d1/d25/d43/fcb [0,4194304] 0 2023-12-16T05:56:37.793 INFO:tasks.workunit.client.0.smithi155.stdout:4/657: dread d0/d10/d46/d16/d30/dce/fae [0,4194304] 0 2023-12-16T05:56:37.794 INFO:tasks.workunit.client.1.smithi156.stdout:8/327: dwrite d3/d12/f28 [0,4194304] 0 2023-12-16T05:56:37.794 INFO:tasks.workunit.client.1.smithi156.stdout:8/328: fsync d3/d6/f5 0 2023-12-16T05:56:37.794 INFO:tasks.workunit.client.1.smithi156.stdout:1/302: mknod d3/d17/d4d/c5f 0 2023-12-16T05:56:37.794 INFO:tasks.workunit.client.1.smithi156.stdout:6/414: write d9/d1c/f47 [653335,125703] 0 2023-12-16T05:56:37.794 INFO:tasks.workunit.client.1.smithi156.stdout:2/465: write d9/f20 [2128438,85117] 0 2023-12-16T05:56:37.794 INFO:tasks.workunit.client.1.smithi156.stdout:2/466: truncate d9/dd/d17/d33/d78/d39/f3e 509656 0 2023-12-16T05:56:37.796 INFO:tasks.workunit.client.0.smithi155.stdout:8/682: rmdir d4/d62/d66/d78/d88/d1b/d1c/d19/da3 39 2023-12-16T05:56:37.797 INFO:tasks.workunit.client.1.smithi156.stdout:0/487: link d2/d7/dd/d29/d38/f3e d2/d7/dd/d2d/d5e/f94 0 2023-12-16T05:56:37.798 INFO:tasks.workunit.client.1.smithi156.stdout:0/488: write d2/d7/f3c [713597,9321] 0 2023-12-16T05:56:37.799 INFO:tasks.workunit.client.1.smithi156.stdout:9/437: dread d6/d19/d25/f6f [0,4194304] 0 2023-12-16T05:56:37.799 INFO:tasks.workunit.client.1.smithi156.stdout:7/651: creat d1e/d55/dba/fe6 x:0 0 0 2023-12-16T05:56:37.801 INFO:tasks.workunit.client.1.smithi156.stdout:0/489: write d2/d7/dd/f33 [5119432,95428] 0 2023-12-16T05:56:37.801 INFO:tasks.workunit.client.0.smithi155.stdout:1/769: unlink c0 0 2023-12-16T05:56:37.801 INFO:tasks.workunit.client.1.smithi156.stdout:2/467: dread d9/dd/f2f [0,4194304] 0 2023-12-16T05:56:37.802 INFO:tasks.workunit.client.1.smithi156.stdout:7/652: write d1e/d1f/da6/f6c [3815626,52985] 0 2023-12-16T05:56:37.802 INFO:tasks.workunit.client.0.smithi155.stdout:4/658: mkdir d0/d10/d46/d16/d30/dce/d75/d3d/d49/dbb/dd8 0 2023-12-16T05:56:37.803 INFO:tasks.workunit.client.1.smithi156.stdout:2/468: write d9/dd/d17/d33/d78/f3c [2344802,117025] 0 2023-12-16T05:56:37.803 INFO:tasks.workunit.client.0.smithi155.stdout:8/683: mknod d4/ce4 0 2023-12-16T05:56:37.805 INFO:tasks.workunit.client.0.smithi155.stdout:1/770: rename d1/d25/d43/d5d/d5e/c84 to d1/d7/d4b/d8e/dc7/d28/cf0 0 2023-12-16T05:56:37.805 INFO:tasks.workunit.client.1.smithi156.stdout:8/329: rmdir d3/d7/d9/d52 0 2023-12-16T05:56:37.806 INFO:tasks.workunit.client.0.smithi155.stdout:4/659: rmdir d0/d10/d46/d16/d30/dce/d75/d3d/d85/d97 0 2023-12-16T05:56:37.807 INFO:tasks.workunit.client.1.smithi156.stdout:1/303: link d3/d17/d4d/f56 d3/d17/f60 0 2023-12-16T05:56:37.807 INFO:tasks.workunit.client.1.smithi156.stdout:1/304: chown d3/d1b/d27/f34 4191496 1 2023-12-16T05:56:37.807 INFO:tasks.workunit.client.0.smithi155.stdout:4/660: dread d0/d10/d46/d16/d30/dce/d75/f45 [0,4194304] 0 2023-12-16T05:56:37.808 INFO:tasks.workunit.client.0.smithi155.stdout:1/771: rmdir d1/d7/d16/de4 39 2023-12-16T05:56:37.809 INFO:tasks.workunit.client.0.smithi155.stdout:1/772: symlink d1/d25/d43/lf1 0 2023-12-16T05:56:37.810 INFO:tasks.workunit.client.0.smithi155.stdout:1/773: chown d1/d7/d16/c44 2801 1 2023-12-16T05:56:37.811 INFO:tasks.workunit.client.0.smithi155.stdout:1/774: creat d1/d7/d4b/d8e/dc7/d28/d8f/ff2 x:0 0 0 2023-12-16T05:56:37.812 INFO:tasks.workunit.client.0.smithi155.stdout:1/775: rmdir d1/d7/d4b/d8e/dc7/d28/d74 39 2023-12-16T05:56:37.812 INFO:tasks.workunit.client.0.smithi155.stdout:4/661: dread d0/d10/d46/d16/d1a/d70/d92/fa9 [0,4194304] 0 2023-12-16T05:56:37.812 INFO:tasks.workunit.client.0.smithi155.stdout:4/662: chown d0/d10/d46/d16/d30/dce/d75/d89/fc9 446547073 1 2023-12-16T05:56:37.814 INFO:tasks.workunit.client.0.smithi155.stdout:1/776: read d1/d7/d4b/d5c/f88 [2250475,36580] 0 2023-12-16T05:56:37.814 INFO:tasks.workunit.client.0.smithi155.stdout:1/777: dread - d1/d7/d4b/d8e/dc7/d28/d8f/ff2 zero size 2023-12-16T05:56:37.814 INFO:tasks.workunit.client.0.smithi155.stdout:1/778: fdatasync d1/d7/d16/d30/f76 0 2023-12-16T05:56:37.814 INFO:tasks.workunit.client.0.smithi155.stdout:4/663: write d0/f1d [1240030,2738] 0 2023-12-16T05:56:37.817 INFO:tasks.workunit.client.0.smithi155.stdout:1/779: mkdir d1/d7/d4b/d8e/dc7/d28/d8f/dad/df3 0 2023-12-16T05:56:37.817 INFO:tasks.workunit.client.0.smithi155.stdout:8/684: dread d4/d62/d66/fdf [0,4194304] 0 2023-12-16T05:56:37.818 INFO:tasks.workunit.client.1.smithi156.stdout:7/653: creat d1e/d1f/fe7 x:0 0 0 2023-12-16T05:56:37.819 INFO:tasks.workunit.client.0.smithi155.stdout:4/664: truncate d0/d10/d46/d16/d30/dce/d75/d3d/f4d 938444 0 2023-12-16T05:56:37.819 INFO:tasks.workunit.client.0.smithi155.stdout:4/665: read d0/d10/f2c [314188,45757] 0 2023-12-16T05:56:37.821 INFO:tasks.workunit.client.1.smithi156.stdout:2/469: link d9/fa d9/dd/d17/d33/d78/f95 0 2023-12-16T05:56:37.821 INFO:tasks.workunit.client.0.smithi155.stdout:1/780: mkdir d1/d7/d4b/d8e/dc7/df4 0 2023-12-16T05:56:37.823 INFO:tasks.workunit.client.0.smithi155.stdout:8/685: symlink d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/db7/le5 0 2023-12-16T05:56:37.823 INFO:tasks.workunit.client.0.smithi155.stdout:8/686: write d4/d62/d66/d78/d88/fde [377119,83163] 0 2023-12-16T05:56:37.824 INFO:tasks.workunit.client.1.smithi156.stdout:1/305: rmdir d3/d17/d19 39 2023-12-16T05:56:37.825 INFO:tasks.workunit.client.0.smithi155.stdout:4/666: unlink d0/d10/d46/d16/d30/dce/fae 0 2023-12-16T05:56:37.826 INFO:tasks.workunit.client.0.smithi155.stdout:1/781: creat d1/d7/d4b/d8e/dc7/d28/d8f/dad/ff5 x:0 0 0 2023-12-16T05:56:37.826 INFO:tasks.workunit.client.0.smithi155.stdout:1/782: dread - d1/d7/d4b/d8e/dc7/d28/fdf zero size 2023-12-16T05:56:37.827 INFO:tasks.workunit.client.1.smithi156.stdout:7/654: creat d1e/d55/d71/fe8 x:0 0 0 2023-12-16T05:56:37.827 INFO:tasks.workunit.client.1.smithi156.stdout:1/306: mkdir d3/d17/d1c/d22/d57/d61 0 2023-12-16T05:56:37.828 INFO:tasks.workunit.client.0.smithi155.stdout:8/687: mknod d4/ce6 0 2023-12-16T05:56:37.828 INFO:tasks.workunit.client.1.smithi156.stdout:8/330: rmdir d3 39 2023-12-16T05:56:37.830 INFO:tasks.workunit.client.1.smithi156.stdout:1/307: link d3/d17/d2d/f53 d3/d1b/d27/d4f/f62 0 2023-12-16T05:56:37.831 INFO:tasks.workunit.client.1.smithi156.stdout:0/490: dwrite d2/d7/dd/d29/f4f [4194304,4194304] 0 2023-12-16T05:56:37.831 INFO:tasks.workunit.client.1.smithi156.stdout:0/491: truncate d2/ff 991248 0 2023-12-16T05:56:37.831 INFO:tasks.workunit.client.1.smithi156.stdout:9/438: dwrite d6/f1e [0,4194304] 0 2023-12-16T05:56:37.831 INFO:tasks.workunit.client.1.smithi156.stdout:9/439: readlink d6/d19/d30/d48/d87/d65/l78 0 2023-12-16T05:56:37.831 INFO:tasks.workunit.client.0.smithi155.stdout:4/667: creat d0/d10/d46/d16/d1a/d70/d92/daf/db7/fd9 x:0 0 0 2023-12-16T05:56:37.831 INFO:tasks.workunit.client.0.smithi155.stdout:4/668: write d0/d10/d46/d16/d30/dce/d75/d3d/d43/f62 [1130536,92909] 0 2023-12-16T05:56:37.831 INFO:tasks.workunit.client.1.smithi156.stdout:8/331: rmdir d3/d12/d16/d54 39 2023-12-16T05:56:37.833 INFO:tasks.workunit.client.0.smithi155.stdout:8/688: mknod d4/d62/d66/d78/d88/d12/ddc/ce7 0 2023-12-16T05:56:37.833 INFO:tasks.workunit.client.1.smithi156.stdout:1/308: truncate d3/d17/d4d/f56 1769860 0 2023-12-16T05:56:37.835 INFO:tasks.workunit.client.1.smithi156.stdout:0/492: creat d2/d7/dd/d29/d38/d51/d52/d88/f95 x:0 0 0 2023-12-16T05:56:37.836 INFO:tasks.workunit.client.0.smithi155.stdout:4/669: mknod d0/d10/d46/d16/d30/d52/d88/d9e/cda 0 2023-12-16T05:56:37.837 INFO:tasks.workunit.client.1.smithi156.stdout:9/440: creat d6/d19/d30/d48/f92 x:0 0 0 2023-12-16T05:56:37.837 INFO:tasks.workunit.client.1.smithi156.stdout:9/441: chown d6/d19/f37 63104783 1 2023-12-16T05:56:37.838 INFO:tasks.workunit.client.1.smithi156.stdout:2/470: dwrite d9/dd/d17/d33/d78/d39/f76 [0,4194304] 0 2023-12-16T05:56:37.839 INFO:tasks.workunit.client.1.smithi156.stdout:1/309: mknod d3/d17/d19/c63 0 2023-12-16T05:56:37.841 INFO:tasks.workunit.client.0.smithi155.stdout:1/783: dread d1/d7/d4b/d8e/dc7/f94 [0,4194304] 0 2023-12-16T05:56:37.842 INFO:tasks.workunit.client.1.smithi156.stdout:9/442: mknod d6/d19/d25/d3a/d88/d8b/c93 0 2023-12-16T05:56:37.845 INFO:tasks.workunit.client.1.smithi156.stdout:8/332: dread d3/d12/f25 [0,4194304] 0 2023-12-16T05:56:37.845 INFO:tasks.workunit.client.0.smithi155.stdout:8/689: link d4/d62/d66/d78/d88/d1b/d1c/d19/da3/fdd d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/fe8 0 2023-12-16T05:56:37.846 INFO:tasks.workunit.client.0.smithi155.stdout:4/670: mkdir d0/d10/d46/d16/d30/dce/d75/ddb 0 2023-12-16T05:56:37.847 INFO:tasks.workunit.client.1.smithi156.stdout:8/333: mknod d3/d7/c67 0 2023-12-16T05:56:37.850 INFO:tasks.workunit.client.1.smithi156.stdout:8/334: symlink d3/d7/d62/l68 0 2023-12-16T05:56:37.853 INFO:tasks.workunit.client.0.smithi155.stdout:1/784: dread d1/d25/d43/d5d/d5e/fbd [0,4194304] 0 2023-12-16T05:56:37.853 INFO:tasks.workunit.client.0.smithi155.stdout:1/785: write d1/d25/d43/f77 [1538598,44472] 0 2023-12-16T05:56:37.853 INFO:tasks.workunit.client.0.smithi155.stdout:4/671: write d0/d10/d46/d16/d1a/f2b [1161471,85742] 0 2023-12-16T05:56:37.854 INFO:tasks.workunit.client.0.smithi155.stdout:2/662: sync 2023-12-16T05:56:37.854 INFO:tasks.workunit.client.0.smithi155.stdout:7/640: sync 2023-12-16T05:56:37.856 INFO:tasks.workunit.client.0.smithi155.stdout:3/537: sync 2023-12-16T05:56:37.856 INFO:tasks.workunit.client.0.smithi155.stdout:0/701: sync 2023-12-16T05:56:37.857 INFO:tasks.workunit.client.0.smithi155.stdout:2/663: truncate d0/d7/d69/f91 3787237 0 2023-12-16T05:56:37.859 INFO:tasks.workunit.client.0.smithi155.stdout:0/702: rename d7/d13/d46/d81 to d7/df/d73/d8d/d4d/de8 0 2023-12-16T05:56:37.860 INFO:tasks.workunit.client.0.smithi155.stdout:1/786: symlink d1/d7/d16/lf6 0 2023-12-16T05:56:37.867 INFO:tasks.workunit.client.1.smithi156.stdout:1/310: dread d3/fc [4194304,4194304] 0 2023-12-16T05:56:37.873 INFO:tasks.workunit.client.0.smithi155.stdout:0/703: write d7/df/d6f/f7a [456447,1478] 0 2023-12-16T05:56:37.886 INFO:tasks.workunit.client.1.smithi156.stdout:7/655: dwrite d1e/d1f/da6/f6c [4194304,4194304] 0 2023-12-16T05:56:37.886 INFO:tasks.workunit.client.1.smithi156.stdout:0/493: dwrite d2/d7/dd/d29/f6b [0,4194304] 0 2023-12-16T05:56:37.891 INFO:tasks.workunit.client.0.smithi155.stdout:7/641: dwrite d0/d6a/d1a/d2b/d2c/d5d/f62 [0,4194304] 0 2023-12-16T05:56:37.891 INFO:tasks.workunit.client.0.smithi155.stdout:7/642: write d0/d1/f67 [443024,16297] 0 2023-12-16T05:56:37.894 INFO:tasks.workunit.client.0.smithi155.stdout:7/643: mknod d0/d6a/d1a/d2b/cd4 0 2023-12-16T05:56:37.894 INFO:tasks.workunit.client.0.smithi155.stdout:7/644: chown d0/l14 15550 1 2023-12-16T05:56:37.894 INFO:tasks.workunit.client.0.smithi155.stdout:7/645: mkdir d0/d1b/d78/dd5 0 2023-12-16T05:56:37.894 INFO:tasks.workunit.client.0.smithi155.stdout:7/646: chown d0/d6a/d1a/d8c/d42 12059 1 2023-12-16T05:56:37.895 INFO:tasks.workunit.client.0.smithi155.stdout:7/647: mkdir d0/d6a/d1a/d8c/d34/d4b/d64/dd6 0 2023-12-16T05:56:37.896 INFO:tasks.workunit.client.0.smithi155.stdout:7/648: creat d0/d6a/d1a/d8c/d34/d4b/d64/fd7 x:0 0 0 2023-12-16T05:56:37.903 INFO:tasks.workunit.client.1.smithi156.stdout:0/494: dread d2/d7/dd/d29/d38/f68 [0,4194304] 0 2023-12-16T05:56:37.904 INFO:tasks.workunit.client.1.smithi156.stdout:0/495: truncate d2/d7/dd/d29/d38/d51/d69/f73 4506916 0 2023-12-16T05:56:37.904 INFO:tasks.workunit.client.1.smithi156.stdout:0/496: fdatasync d2/d7/f3c 0 2023-12-16T05:56:37.904 INFO:tasks.workunit.client.1.smithi156.stdout:0/497: chown d2/d7/dd/d5c/l5d 152078 1 2023-12-16T05:56:37.905 INFO:tasks.workunit.client.1.smithi156.stdout:0/498: creat d2/d7/dd/f96 x:0 0 0 2023-12-16T05:56:37.906 INFO:tasks.workunit.client.1.smithi156.stdout:0/499: creat d2/d23/d55/f97 x:0 0 0 2023-12-16T05:56:37.907 INFO:tasks.workunit.client.1.smithi156.stdout:9/443: dwrite d6/d19/d25/d3a/d5e/f68 [0,4194304] 0 2023-12-16T05:56:37.907 INFO:tasks.workunit.client.0.smithi155.stdout:2/664: dwrite d0/d7/d57/d9b/fb7 [0,4194304] 0 2023-12-16T05:56:37.907 INFO:tasks.workunit.client.0.smithi155.stdout:8/690: dwrite d4/d62/d66/d78/d88/d1b/d1c/d19/f38 [0,4194304] 0 2023-12-16T05:56:37.907 INFO:tasks.workunit.client.0.smithi155.stdout:7/649: dread d0/d1/f21 [0,4194304] 0 2023-12-16T05:56:37.907 INFO:tasks.workunit.client.0.smithi155.stdout:7/650: read d0/d6a/d1a/d8c/d34/d4b/d64/d6f/f81 [333894,89639] 0 2023-12-16T05:56:37.908 INFO:tasks.workunit.client.1.smithi156.stdout:0/500: unlink d2/d7/dd/l17 0 2023-12-16T05:56:37.908 INFO:tasks.workunit.client.1.smithi156.stdout:1/311: dwrite d3/d3a/f5d [0,4194304] 0 2023-12-16T05:56:37.910 INFO:tasks.workunit.client.0.smithi155.stdout:4/672: dwrite d0/d10/d46/d16/d30/fbe [0,4194304] 0 2023-12-16T05:56:37.911 INFO:tasks.workunit.client.0.smithi155.stdout:1/787: dwrite d1/d7/d4b/d8e/dc7/fea [0,4194304] 0 2023-12-16T05:56:37.913 INFO:tasks.workunit.client.0.smithi155.stdout:8/691: creat d4/d62/d66/d78/d88/d1b/d1c/d97/d29/fe9 x:0 0 0 2023-12-16T05:56:37.916 INFO:tasks.workunit.client.0.smithi155.stdout:7/651: mkdir d0/d6a/d1a/d8c/d34/d4b/d60/dd8 0 2023-12-16T05:56:37.924 INFO:tasks.workunit.client.0.smithi155.stdout:8/692: dread d4/d62/d66/d78/d88/d1b/d2a/f39 [0,4194304] 0 2023-12-16T05:56:37.924 INFO:tasks.workunit.client.0.smithi155.stdout:1/788: rmdir d1/d25/d43/d5d 39 2023-12-16T05:56:37.927 INFO:tasks.workunit.client.0.smithi155.stdout:2/665: link d0/d5/d6/f7c d0/d5/fdc 0 2023-12-16T05:56:37.927 INFO:tasks.workunit.client.0.smithi155.stdout:2/666: dread - d0/d7/fab zero size 2023-12-16T05:56:37.927 INFO:tasks.workunit.client.0.smithi155.stdout:2/667: fdatasync d0/d34/d3c/f79 0 2023-12-16T05:56:37.927 INFO:tasks.workunit.client.0.smithi155.stdout:1/789: write d1/d25/d43/d5d/d5e/fbd [1374948,87239] 0 2023-12-16T05:56:37.930 INFO:tasks.workunit.client.0.smithi155.stdout:4/673: dwrite d0/d10/d46/d16/d30/dce/d75/d89/d9a/fb5 [4194304,4194304] 0 2023-12-16T05:56:37.934 INFO:tasks.workunit.client.0.smithi155.stdout:8/693: dread d4/d62/d66/d78/d88/d1b/d1c/d97/f59 [0,4194304] 0 2023-12-16T05:56:37.936 INFO:tasks.workunit.client.0.smithi155.stdout:7/652: dwrite d0/d1b/d78/fcc [0,4194304] 0 2023-12-16T05:56:37.943 INFO:tasks.workunit.client.0.smithi155.stdout:1/790: dwrite d1/d25/d43/d5d/f7c [0,4194304] 0 2023-12-16T05:56:37.943 INFO:tasks.workunit.client.0.smithi155.stdout:1/791: write d1/d7/d16/d30/f73 [3228250,13982] 0 2023-12-16T05:56:37.950 INFO:tasks.workunit.client.0.smithi155.stdout:8/694: dwrite d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/fb3 [0,4194304] 0 2023-12-16T05:56:37.953 INFO:tasks.workunit.client.1.smithi156.stdout:9/444: mknod d6/d19/d25/c94 0 2023-12-16T05:56:37.954 INFO:tasks.workunit.client.1.smithi156.stdout:9/445: chown d6/d2e/f50 0 1 2023-12-16T05:56:37.954 INFO:tasks.workunit.client.1.smithi156.stdout:0/501: mknod d2/d7/dd/d29/d2e/c98 0 2023-12-16T05:56:37.956 INFO:tasks.workunit.client.1.smithi156.stdout:9/446: mkdir d6/d19/d30/d95 0 2023-12-16T05:56:37.956 INFO:tasks.workunit.client.1.smithi156.stdout:9/447: chown d6/d19/d30/d5b/c8e 245961627 1 2023-12-16T05:56:37.956 INFO:tasks.workunit.client.1.smithi156.stdout:9/448: read d6/d19/f20 [86864,1888] 0 2023-12-16T05:56:37.957 INFO:tasks.workunit.client.1.smithi156.stdout:0/502: creat d2/d7/dd/d29/d4b/d76/d85/f99 x:0 0 0 2023-12-16T05:56:37.957 INFO:tasks.workunit.client.1.smithi156.stdout:0/503: chown d2/d7/dd/d2d/d5e/l7d 15 1 2023-12-16T05:56:37.958 INFO:tasks.workunit.client.1.smithi156.stdout:9/449: rename d6/d19/d25/f77 to d6/d19/d25/d3a/d80/f96 0 2023-12-16T05:56:37.960 INFO:tasks.workunit.client.1.smithi156.stdout:0/504: creat d2/d7/dd/d2d/f9a x:0 0 0 2023-12-16T05:56:37.963 INFO:tasks.workunit.client.1.smithi156.stdout:0/505: mknod d2/d7/dd/d29/c9b 0 2023-12-16T05:56:37.963 INFO:tasks.workunit.client.1.smithi156.stdout:4/392: sync 2023-12-16T05:56:37.963 INFO:tasks.workunit.client.1.smithi156.stdout:3/366: sync 2023-12-16T05:56:37.964 INFO:tasks.workunit.client.1.smithi156.stdout:3/367: fdatasync dc/d10/d1d/d4b/d52/f72 0 2023-12-16T05:56:37.964 INFO:tasks.workunit.client.1.smithi156.stdout:0/506: write d2/d7/dd/f33 [2156413,8430] 0 2023-12-16T05:56:37.964 INFO:tasks.workunit.client.1.smithi156.stdout:0/507: fsync d2/d7/dd/d29/f4f 0 2023-12-16T05:56:37.964 INFO:tasks.workunit.client.1.smithi156.stdout:4/393: creat d9/d2b/d35/f86 x:0 0 0 2023-12-16T05:56:37.965 INFO:tasks.workunit.client.1.smithi156.stdout:3/368: creat dc/df/d66/f8f x:0 0 0 2023-12-16T05:56:37.965 INFO:tasks.workunit.client.1.smithi156.stdout:3/369: chown dc/d56/d67/d6e/f81 260964 1 2023-12-16T05:56:37.966 INFO:tasks.workunit.client.1.smithi156.stdout:9/450: rmdir d6/d19/d30 39 2023-12-16T05:56:37.966 INFO:tasks.workunit.client.1.smithi156.stdout:9/451: write d6/d19/f29 [252326,5184] 0 2023-12-16T05:56:37.967 INFO:tasks.workunit.client.1.smithi156.stdout:4/394: symlink d9/d2c/d7a/l87 0 2023-12-16T05:56:37.968 INFO:tasks.workunit.client.1.smithi156.stdout:3/370: mkdir dc/d10/d1d/d90 0 2023-12-16T05:56:37.968 INFO:tasks.workunit.client.1.smithi156.stdout:3/371: write dc/d10/f18 [1392147,28589] 0 2023-12-16T05:56:37.969 INFO:tasks.workunit.client.1.smithi156.stdout:0/508: symlink d2/d7/dd/d29/d38/l9c 0 2023-12-16T05:56:37.970 INFO:tasks.workunit.client.1.smithi156.stdout:9/452: link d6/d19/d30/d48/d87/l69 d6/d2e/l97 0 2023-12-16T05:56:37.970 INFO:tasks.workunit.client.1.smithi156.stdout:4/395: symlink d9/d2b/d56/d77/l88 0 2023-12-16T05:56:37.971 INFO:tasks.workunit.client.1.smithi156.stdout:3/372: creat dc/d10/d3d/f91 x:0 0 0 2023-12-16T05:56:37.971 INFO:tasks.workunit.client.1.smithi156.stdout:4/396: write d9/f27 [5990477,54675] 0 2023-12-16T05:56:37.972 INFO:tasks.workunit.client.1.smithi156.stdout:0/509: mknod d2/d7/dd/d29/d38/c9d 0 2023-12-16T05:56:37.974 INFO:tasks.workunit.client.1.smithi156.stdout:3/373: write dc/d10/d3d/f38 [3016432,37481] 0 2023-12-16T05:56:37.974 INFO:tasks.workunit.client.1.smithi156.stdout:4/397: link d9/d43/d58/f60 d9/d43/d58/f89 0 2023-12-16T05:56:37.974 INFO:tasks.workunit.client.1.smithi156.stdout:0/510: truncate d2/d7/dd/d29/f6b 3071640 0 2023-12-16T05:56:37.975 INFO:tasks.workunit.client.1.smithi156.stdout:0/511: stat d2/d7/dd/d1c/f36 0 2023-12-16T05:56:37.975 INFO:tasks.workunit.client.1.smithi156.stdout:3/374: creat dc/d56/f92 x:0 0 0 2023-12-16T05:56:37.976 INFO:tasks.workunit.client.1.smithi156.stdout:0/512: creat d2/d7/dd/d29/d38/d51/d52/d88/f9e x:0 0 0 2023-12-16T05:56:37.977 INFO:tasks.workunit.client.1.smithi156.stdout:3/375: rename dc/df/c4a to dc/d56/c93 0 2023-12-16T05:56:37.978 INFO:tasks.workunit.client.1.smithi156.stdout:0/513: symlink d2/d7/dd/d29/d38/d51/l9f 0 2023-12-16T05:56:37.979 INFO:tasks.workunit.client.1.smithi156.stdout:0/514: truncate d2/d7/dd/d29/f4f 7389016 0 2023-12-16T05:56:37.979 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.977+0000 7f7815766700 1 -- 172.21.15.155:0/3192630064 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7810111700 con 0x7f7810070570 2023-12-16T05:56:37.980 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.977+0000 7f78077fe700 1 -- 172.21.15.155:0/3192630064 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+842 (secure 0 0 0) 0x7f7800056f40 con 0x7f7810070570 2023-12-16T05:56:37.980 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T05:56:37.980 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": { 2023-12-16T05:56:37.981 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T05:56:37.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:56:37.981 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": { 2023-12-16T05:56:37.981 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 1, 2023-12-16T05:56:37.981 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 1 2023-12-16T05:56:37.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:56:37.981 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": { 2023-12-16T05:56:37.981 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T05:56:37.982 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:56:37.982 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2023-12-16T05:56:37.982 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T05:56:37.982 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:56:37.982 INFO:teuthology.orchestra.run.smithi155.stdout: "overall": { 2023-12-16T05:56:37.982 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 13, 2023-12-16T05:56:37.982 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 1 2023-12-16T05:56:37.982 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-12-16T05:56:37.982 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T05:56:37.984 INFO:tasks.workunit.client.0.smithi155.stdout:2/668: unlink d0/d7/d69/f6f 0 2023-12-16T05:56:37.984 INFO:tasks.workunit.client.0.smithi155.stdout:2/669: chown d0/d34/f40 577 1 2023-12-16T05:56:37.984 INFO:tasks.workunit.client.0.smithi155.stdout:2/670: write d0/d7/dd/f3e [4133896,22667] 0 2023-12-16T05:56:37.985 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.981+0000 7f7815766700 1 -- 172.21.15.155:0/3192630064 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f77fc06ae40 msgr2=0x7f77fc06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:37.985 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.981+0000 7f7815766700 1 --2- 172.21.15.155:0/3192630064 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f77fc06ae40 0x7f77fc06d2f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f77f8009fd0 tx=0x7f77f8009e30 comp rx=0 tx=0).stop 2023-12-16T05:56:37.985 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.981+0000 7f7815766700 1 -- 172.21.15.155:0/3192630064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7810070570 msgr2=0x7f781010f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:37.985 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.981+0000 7f7815766700 1 --2- 172.21.15.155:0/3192630064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7810070570 0x7f781010f800 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f780000b790 tx=0x7f7800009250 comp rx=0 tx=0).stop 2023-12-16T05:56:37.986 INFO:tasks.workunit.client.1.smithi156.stdout:4/398: dread d9/f24 [0,4194304] 0 2023-12-16T05:56:37.986 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.982+0000 7f7815766700 1 -- 172.21.15.155:0/3192630064 shutdown_connections 2023-12-16T05:56:37.986 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.982+0000 7f7815766700 1 --2- 172.21.15.155:0/3192630064 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f77fc06ae40 0x7f77fc06d2f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:37.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.982+0000 7f7815766700 1 --2- 172.21.15.155:0/3192630064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7810070570 0x7f781010f800 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:37.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.982+0000 7f7815766700 1 --2- 172.21.15.155:0/3192630064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7810071bc0 0x7f781010fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:37.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.982+0000 7f7815766700 1 -- 172.21.15.155:0/3192630064 >> 172.21.15.155:0/3192630064 conn(0x7f78100f82d0 msgr2=0x7f7810102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:56:37.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.983+0000 7f7815766700 1 -- 172.21.15.155:0/3192630064 shutdown_connections 2023-12-16T05:56:37.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:37.983+0000 7f7815766700 1 -- 172.21.15.155:0/3192630064 wait complete. 2023-12-16T05:56:37.987 INFO:tasks.workunit.client.1.smithi156.stdout:4/399: write d9/d2b/f33 [3150389,3447] 0 2023-12-16T05:56:37.988 INFO:tasks.workunit.client.1.smithi156.stdout:4/400: truncate d9/f38 2363162 0 2023-12-16T05:56:37.989 INFO:tasks.workunit.client.1.smithi156.stdout:4/401: creat d9/d2c/d7a/f8a x:0 0 0 2023-12-16T05:56:37.990 INFO:tasks.workunit.client.1.smithi156.stdout:4/402: rename d9/d43/d58/f68 to d9/d43/d58/d7d/f8b 0 2023-12-16T05:56:37.992 INFO:tasks.workunit.client.1.smithi156.stdout:4/403: symlink d9/l8c 0 2023-12-16T05:56:37.992 INFO:tasks.workunit.client.1.smithi156.stdout:4/404: stat d9/d2b/c74 0 2023-12-16T05:56:37.996 INFO:tasks.workunit.client.1.smithi156.stdout:0/515: dwrite d2/d7/dd/d2d/f9a [0,4194304] 0 2023-12-16T05:56:37.997 INFO:tasks.workunit.client.1.smithi156.stdout:0/516: write d2/f22 [5242020,25681] 0 2023-12-16T05:56:37.998 INFO:tasks.workunit.client.1.smithi156.stdout:0/517: symlink d2/d7/dd/d29/la0 0 2023-12-16T05:56:37.999 INFO:tasks.workunit.client.1.smithi156.stdout:0/518: symlink d2/d7/dd/d29/d38/d51/d65/d7e/la1 0 2023-12-16T05:56:37.999 INFO:tasks.workunit.client.1.smithi156.stdout:0/519: readlink d2/d7/dd/d5c/l5d 0 2023-12-16T05:56:38.000 INFO:tasks.workunit.client.1.smithi156.stdout:0/520: symlink d2/d47/la2 0 2023-12-16T05:56:38.001 INFO:tasks.workunit.client.1.smithi156.stdout:0/521: creat d2/d23/d4a/fa3 x:0 0 0 2023-12-16T05:56:38.020 INFO:tasks.workunit.client.1.smithi156.stdout:9/453: dwrite d6/d19/d30/f3f [0,4194304] 0 2023-12-16T05:56:38.026 INFO:tasks.workunit.client.1.smithi156.stdout:9/454: rename d6/d19/d25/d3a/f60 to d6/f98 0 2023-12-16T05:56:38.026 INFO:tasks.workunit.client.1.smithi156.stdout:9/455: write d6/d19/f32 [1495139,61889] 0 2023-12-16T05:56:38.027 INFO:tasks.workunit.client.1.smithi156.stdout:0/522: dwrite f0 [0,4194304] 0 2023-12-16T05:56:38.030 INFO:tasks.workunit.client.1.smithi156.stdout:9/456: link d6/d19/f22 d6/d19/d30/d48/d87/f99 0 2023-12-16T05:56:38.030 INFO:tasks.workunit.client.1.smithi156.stdout:9/457: read - d6/d19/d30/d48/d87/f99 zero size 2023-12-16T05:56:38.035 INFO:tasks.workunit.client.1.smithi156.stdout:0/523: rename d2/d7/dd/d29/f62 to d2/d7/dd/d29/fa4 0 2023-12-16T05:56:38.038 INFO:tasks.workunit.client.1.smithi156.stdout:9/458: mkdir d6/d19/d30/d5b/d9a 0 2023-12-16T05:56:38.038 INFO:tasks.workunit.client.1.smithi156.stdout:9/459: chown d6/d19/f20 325 1 2023-12-16T05:56:38.038 INFO:tasks.workunit.client.1.smithi156.stdout:9/460: fdatasync d6/d19/d30/d48/f75 0 2023-12-16T05:56:38.040 INFO:tasks.workunit.client.1.smithi156.stdout:0/524: rmdir d2/d7/dd/d66 39 2023-12-16T05:56:38.041 INFO:tasks.workunit.client.1.smithi156.stdout:9/461: creat d6/d19/d30/d48/d87/f9b x:0 0 0 2023-12-16T05:56:38.043 INFO:tasks.workunit.client.1.smithi156.stdout:9/462: symlink d6/d19/d25/d72/l9c 0 2023-12-16T05:56:38.044 INFO:tasks.workunit.client.1.smithi156.stdout:9/463: symlink d6/d19/d30/d5b/d9a/l9d 0 2023-12-16T05:56:38.044 INFO:tasks.workunit.client.1.smithi156.stdout:9/464: truncate d6/d19/d25/d3a/f4a 182616 0 2023-12-16T05:56:38.044 INFO:tasks.workunit.client.1.smithi156.stdout:9/465: fdatasync d6/d19/f24 0 2023-12-16T05:56:38.044 INFO:tasks.workunit.client.1.smithi156.stdout:4/405: rmdir d9/d2c/d7a 39 2023-12-16T05:56:38.044 INFO:tasks.workunit.client.1.smithi156.stdout:4/406: stat d9/d2c/f6b 0 2023-12-16T05:56:38.046 INFO:tasks.workunit.client.1.smithi156.stdout:9/466: chown d6/d19/d25/d3a/d5e/f79 76158311 1 2023-12-16T05:56:38.047 INFO:tasks.workunit.client.1.smithi156.stdout:9/467: creat d6/d19/d25/f9e x:0 0 0 2023-12-16T05:56:38.047 INFO:tasks.workunit.client.1.smithi156.stdout:9/468: readlink d6/d19/l85 0 2023-12-16T05:56:38.048 INFO:tasks.workunit.client.1.smithi156.stdout:9/469: creat d6/d19/d30/d5b/d9a/f9f x:0 0 0 2023-12-16T05:56:38.050 INFO:tasks.workunit.client.1.smithi156.stdout:9/470: rename d6/d19/d25/d72/f7e to d6/d19/d30/d48/d87/d65/fa0 0 2023-12-16T05:56:38.053 INFO:tasks.workunit.client.1.smithi156.stdout:4/407: dread d9/f18 [0,4194304] 0 2023-12-16T05:56:38.053 INFO:tasks.workunit.client.1.smithi156.stdout:4/408: chown d9/d2c/f2e 394083 1 2023-12-16T05:56:38.054 INFO:tasks.workunit.client.1.smithi156.stdout:0/525: dread f0 [0,4194304] 0 2023-12-16T05:56:38.054 INFO:tasks.workunit.client.1.smithi156.stdout:9/471: read d6/d19/d25/f38 [72796,1855] 0 2023-12-16T05:56:38.056 INFO:tasks.workunit.client.1.smithi156.stdout:0/526: rename f0 to d2/d7/dd/d1c/fa5 0 2023-12-16T05:56:38.056 INFO:tasks.workunit.client.1.smithi156.stdout:0/527: fdatasync d2/d7/dd/d29/d38/f68 0 2023-12-16T05:56:38.056 INFO:tasks.workunit.client.1.smithi156.stdout:9/472: truncate d6/d2e/f35 648502 0 2023-12-16T05:56:38.057 INFO:tasks.workunit.client.1.smithi156.stdout:9/473: fdatasync d6/d19/d30/f54 0 2023-12-16T05:56:38.058 INFO:tasks.workunit.client.1.smithi156.stdout:0/528: creat d2/d23/d4a/fa6 x:0 0 0 2023-12-16T05:56:38.059 INFO:tasks.workunit.client.1.smithi156.stdout:9/474: symlink d6/d19/d30/d48/la1 0 2023-12-16T05:56:38.060 INFO:tasks.workunit.client.1.smithi156.stdout:0/529: mknod d2/d7/dd/d29/ca7 0 2023-12-16T05:56:38.062 INFO:tasks.workunit.client.1.smithi156.stdout:0/530: mkdir d2/d7/da8 0 2023-12-16T05:56:38.063 INFO:tasks.workunit.client.1.smithi156.stdout:0/531: readlink d2/d7/dd/d1c/l37 0 2023-12-16T05:56:38.063 INFO:tasks.workunit.client.1.smithi156.stdout:0/532: chown d2/f86 4 1 2023-12-16T05:56:38.063 INFO:tasks.workunit.client.1.smithi156.stdout:0/533: chown d2/d7/f18 88697298 1 2023-12-16T05:56:38.063 INFO:tasks.workunit.client.1.smithi156.stdout:5/613: sync 2023-12-16T05:56:38.063 INFO:tasks.workunit.client.1.smithi156.stdout:5/614: write da/f42 [230868,114026] 0 2023-12-16T05:56:38.064 INFO:tasks.workunit.client.1.smithi156.stdout:0/534: unlink d2/d7/dd/d1c/f71 0 2023-12-16T05:56:38.064 INFO:tasks.workunit.client.1.smithi156.stdout:9/475: dread d6/d19/d25/d3a/d5e/f67 [0,4194304] 0 2023-12-16T05:56:38.069 INFO:tasks.workunit.client.1.smithi156.stdout:0/535: rename d2/d7/dd/d29/d2e/c98 to d2/d7/dd/d2d/d5e/d8f/ca9 0 2023-12-16T05:56:38.070 INFO:tasks.workunit.client.1.smithi156.stdout:0/536: mknod d2/d7/dd/d66/caa 0 2023-12-16T05:56:38.070 INFO:tasks.workunit.client.1.smithi156.stdout:0/537: write d2/d7/dd/d29/f4f [7990400,64415] 0 2023-12-16T05:56:38.072 INFO:tasks.workunit.client.1.smithi156.stdout:4/409: dwrite d9/f21 [0,4194304] 0 2023-12-16T05:56:38.074 INFO:tasks.workunit.client.1.smithi156.stdout:4/410: mknod d9/d2c/c8d 0 2023-12-16T05:56:38.075 INFO:tasks.workunit.client.1.smithi156.stdout:4/411: creat d9/d43/f8e x:0 0 0 2023-12-16T05:56:38.077 INFO:tasks.workunit.client.0.smithi155.stdout:7/653: mknod d0/d6a/d1a/d2b/db9/cd9 0 2023-12-16T05:56:38.077 INFO:tasks.workunit.client.1.smithi156.stdout:5/615: fdatasync da/dc/f19 0 2023-12-16T05:56:38.079 INFO:tasks.workunit.client.1.smithi156.stdout:5/616: creat da/dc/d4b/d6c/d77/fc2 x:0 0 0 2023-12-16T05:56:38.080 INFO:tasks.workunit.client.0.smithi155.stdout:1/792: mknod d1/d7/d4b/d8e/dc7/df4/cf7 0 2023-12-16T05:56:38.084 INFO:tasks.workunit.client.1.smithi156.stdout:5/617: mkdir da/dc/d2d/d4d/d54/d90/dc3 0 2023-12-16T05:56:38.084 INFO:tasks.workunit.client.1.smithi156.stdout:5/618: dread - da/dc/d2d/d9b/fa5 zero size 2023-12-16T05:56:38.084 INFO:tasks.workunit.client.1.smithi156.stdout:5/619: readlink da/dc/d2d/d9b/lad 0 2023-12-16T05:56:38.084 INFO:tasks.workunit.client.1.smithi156.stdout:5/620: write da/dc/f9f [295194,118852] 0 2023-12-16T05:56:38.084 INFO:tasks.workunit.client.1.smithi156.stdout:5/621: dread - da/dc/d2d/db0/fba zero size 2023-12-16T05:56:38.084 INFO:tasks.workunit.client.1.smithi156.stdout:0/538: getdents d2/d7 0 2023-12-16T05:56:38.086 INFO:tasks.workunit.client.1.smithi156.stdout:5/622: creat da/d9a/fc4 x:0 0 0 2023-12-16T05:56:38.086 INFO:tasks.workunit.client.1.smithi156.stdout:5/623: stat da/dc/d2d/d4d/f88 0 2023-12-16T05:56:38.086 INFO:tasks.workunit.client.1.smithi156.stdout:4/412: dread d9/d43/d58/f60 [0,4194304] 0 2023-12-16T05:56:38.086 INFO:tasks.workunit.client.1.smithi156.stdout:0/539: read d2/d47/f80 [187864,114921] 0 2023-12-16T05:56:38.086 INFO:tasks.workunit.client.1.smithi156.stdout:0/540: chown d2/d23/d55 948 1 2023-12-16T05:56:38.087 INFO:tasks.workunit.client.0.smithi155.stdout:8/695: creat d4/dd3/fea x:0 0 0 2023-12-16T05:56:38.088 INFO:tasks.workunit.client.1.smithi156.stdout:9/476: dwrite d6/d19/d25/d72/f84 [0,4194304] 0 2023-12-16T05:56:38.088 INFO:tasks.workunit.client.1.smithi156.stdout:9/477: dread - d6/d19/d30/d48/d87/f9b zero size 2023-12-16T05:56:38.088 INFO:tasks.workunit.client.1.smithi156.stdout:0/541: read d2/d7/dd/d29/f4f [4444368,20307] 0 2023-12-16T05:56:38.088 INFO:tasks.workunit.client.1.smithi156.stdout:0/542: chown d2/d7/dd/d29/d38/d51/d65 13 1 2023-12-16T05:56:38.089 INFO:tasks.workunit.client.1.smithi156.stdout:5/624: mkdir da/dc/d4b/d6c/d81/dc5 0 2023-12-16T05:56:38.089 INFO:tasks.workunit.client.0.smithi155.stdout:7/654: dread d0/fd2 [0,4194304] 0 2023-12-16T05:56:38.089 INFO:tasks.workunit.client.0.smithi155.stdout:7/655: chown d0/d6a/d1a/d22/c59 2509 1 2023-12-16T05:56:38.090 INFO:tasks.workunit.client.1.smithi156.stdout:9/478: write d6/d19/d25/d72/f84 [749839,49752] 0 2023-12-16T05:56:38.090 INFO:tasks.workunit.client.0.smithi155.stdout:7/656: write d0/f35 [3612716,94838] 0 2023-12-16T05:56:38.092 INFO:tasks.workunit.client.1.smithi156.stdout:0/543: rmdir d2/d7/dd/d29 39 2023-12-16T05:56:38.092 INFO:tasks.workunit.client.1.smithi156.stdout:0/544: dread - d2/d7/dd/f96 zero size 2023-12-16T05:56:38.094 INFO:tasks.workunit.client.1.smithi156.stdout:5/625: symlink da/lc6 0 2023-12-16T05:56:38.096 INFO:tasks.workunit.client.0.smithi155.stdout:1/793: creat d1/d7/d4b/de3/ff8 x:0 0 0 2023-12-16T05:56:38.096 INFO:tasks.workunit.client.1.smithi156.stdout:4/413: dread d9/f70 [0,4194304] 0 2023-12-16T05:56:38.097 INFO:tasks.workunit.client.1.smithi156.stdout:0/545: symlink d2/d7/dd/d29/d4b/d76/lab 0 2023-12-16T05:56:38.098 INFO:tasks.workunit.client.0.smithi155.stdout:1/794: dread d1/d7/d4b/d8e/fd3 [0,4194304] 0 2023-12-16T05:56:38.098 INFO:tasks.workunit.client.0.smithi155.stdout:8/696: link d4/d62/d66/d78/d88/d1b/d1c/d97/d29/l40 d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/leb 0 2023-12-16T05:56:38.100 INFO:tasks.workunit.client.1.smithi156.stdout:4/414: getdents d9/d2b/d35 0 2023-12-16T05:56:38.100 INFO:tasks.workunit.client.0.smithi155.stdout:7/657: truncate d0/d6a/fac 59999 0 2023-12-16T05:56:38.100 INFO:tasks.workunit.client.1.smithi156.stdout:9/479: dread d6/d2e/f50 [0,4194304] 0 2023-12-16T05:56:38.101 INFO:tasks.workunit.client.0.smithi155.stdout:7/658: read d0/d6a/d1a/d8c/d34/d4b/d64/d6f/f81 [546960,131018] 0 2023-12-16T05:56:38.101 INFO:tasks.workunit.client.0.smithi155.stdout:7/659: fsync d0/d6a/f8d 0 2023-12-16T05:56:38.101 INFO:tasks.workunit.client.0.smithi155.stdout:7/660: readlink d0/d6a/d1a/d8c/l79 0 2023-12-16T05:56:38.102 INFO:tasks.workunit.client.1.smithi156.stdout:5/626: symlink da/dc/d4b/lc7 0 2023-12-16T05:56:38.102 INFO:tasks.workunit.client.0.smithi155.stdout:7/661: write d0/d6a/d1a/f89 [479595,855] 0 2023-12-16T05:56:38.103 INFO:tasks.workunit.client.1.smithi156.stdout:4/415: rename d9/d2b/f33 to d9/d2b/f8f 0 2023-12-16T05:56:38.104 INFO:tasks.workunit.client.1.smithi156.stdout:4/416: stat d9/d2b/l4a 0 2023-12-16T05:56:38.104 INFO:tasks.workunit.client.1.smithi156.stdout:4/417: dread - d9/d43/f62 zero size 2023-12-16T05:56:38.104 INFO:tasks.workunit.client.0.smithi155.stdout:1/795: creat d1/d7/d4b/d8e/ff9 x:0 0 0 2023-12-16T05:56:38.104 INFO:tasks.workunit.client.1.smithi156.stdout:4/418: write f4 [2644755,128197] 0 2023-12-16T05:56:38.105 INFO:tasks.workunit.client.1.smithi156.stdout:9/480: creat d6/d19/fa2 x:0 0 0 2023-12-16T05:56:38.106 INFO:tasks.workunit.client.0.smithi155.stdout:8/697: rmdir d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab 39 2023-12-16T05:56:38.107 INFO:tasks.workunit.client.1.smithi156.stdout:5/627: creat da/dc/d2d/d4d/d54/d90/dc3/fc8 x:0 0 0 2023-12-16T05:56:38.107 INFO:tasks.workunit.client.1.smithi156.stdout:5/628: chown da/dc/d2d/l39 11 1 2023-12-16T05:56:38.109 INFO:tasks.workunit.client.1.smithi156.stdout:0/546: dread d2/d7/dd/d29/d38/d51/d52/f8c [0,4194304] 0 2023-12-16T05:56:38.109 INFO:tasks.workunit.client.1.smithi156.stdout:0/547: write d2/d23/d4a/fa6 [635352,97192] 0 2023-12-16T05:56:38.109 INFO:tasks.workunit.client.1.smithi156.stdout:4/419: creat d9/d43/d58/d7d/f90 x:0 0 0 2023-12-16T05:56:38.110 INFO:tasks.workunit.client.0.smithi155.stdout:7/662: truncate d0/d1/f24 5606656 0 2023-12-16T05:56:38.111 INFO:tasks.workunit.client.1.smithi156.stdout:5/629: mkdir da/dc/d2d/d4d/db9/dc9 0 2023-12-16T05:56:38.112 INFO:tasks.workunit.client.0.smithi155.stdout:1/796: unlink d1/d7/d16/de5/ce9 0 2023-12-16T05:56:38.113 INFO:tasks.workunit.client.1.smithi156.stdout:0/548: creat d2/d7/dd/d66/fac x:0 0 0 2023-12-16T05:56:38.114 INFO:tasks.workunit.client.1.smithi156.stdout:4/420: stat d9/d2b/d56/l6c 0 2023-12-16T05:56:38.115 INFO:tasks.workunit.client.0.smithi155.stdout:8/698: creat d4/d62/d66/d78/d88/d1b/d1c/d46/fec x:0 0 0 2023-12-16T05:56:38.116 INFO:tasks.workunit.client.1.smithi156.stdout:5/630: getdents da/d9a 0 2023-12-16T05:56:38.117 INFO:tasks.workunit.client.0.smithi155.stdout:7/663: getdents d0/d6a/d1a/d2b/d2c 0 2023-12-16T05:56:38.121 INFO:tasks.workunit.client.1.smithi156.stdout:5/631: link da/dc/d4b/d6c/d7c/c72 da/dc/d2d/d4d/d54/cca 0 2023-12-16T05:56:38.121 INFO:tasks.workunit.client.1.smithi156.stdout:5/632: chown da/dc/f2c 414844983 1 2023-12-16T05:56:38.128 INFO:tasks.workunit.client.1.smithi156.stdout:0/549: dread d2/d7/dd/d29/f4f [0,4194304] 0 2023-12-16T05:56:38.129 INFO:tasks.workunit.client.1.smithi156.stdout:5/633: write da/dc/d2d/d4d/d54/d90/fab [1216116,69758] 0 2023-12-16T05:56:38.131 INFO:tasks.workunit.client.1.smithi156.stdout:0/550: unlink d2/f43 0 2023-12-16T05:56:38.135 INFO:tasks.workunit.client.1.smithi156.stdout:0/551: mkdir d2/d7/dd/d29/d38/dad 0 2023-12-16T05:56:38.135 INFO:tasks.workunit.client.1.smithi156.stdout:0/552: dread - d2/d23/f70 zero size 2023-12-16T05:56:38.150 INFO:tasks.workunit.client.1.smithi156.stdout:9/481: dwrite d6/d19/f37 [0,4194304] 0 2023-12-16T05:56:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.149+0000 7fcbd955f700 1 -- 172.21.15.155:0/2739011581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcbd41053f0 msgr2=0x7fcbd4105800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.149+0000 7fcbd955f700 1 --2- 172.21.15.155:0/2739011581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcbd41053f0 0x7fcbd4105800 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4004880 tx=0x7fcbc4009e30 comp rx=0 tx=0).stop 2023-12-16T05:56:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.149+0000 7fcbd955f700 1 -- 172.21.15.155:0/2739011581 shutdown_connections 2023-12-16T05:56:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.149+0000 7fcbd955f700 1 --2- 172.21.15.155:0/2739011581 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbd4106600 0x7fcbd4106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.149+0000 7fcbd955f700 1 --2- 172.21.15.155:0/2739011581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcbd41053f0 0x7fcbd4105800 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.149+0000 7fcbd955f700 1 -- 172.21.15.155:0/2739011581 >> 172.21.15.155:0/2739011581 conn(0x7fcbd406bdc0 msgr2=0x7fcbd406e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:56:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.149+0000 7fcbd955f700 1 -- 172.21.15.155:0/2739011581 shutdown_connections 2023-12-16T05:56:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.149+0000 7fcbd955f700 1 -- 172.21.15.155:0/2739011581 wait complete. 2023-12-16T05:56:38.153 INFO:tasks.workunit.client.1.smithi156.stdout:9/482: mkdir d6/da3 0 2023-12-16T05:56:38.153 INFO:tasks.workunit.client.0.smithi155.stdout:6/903: sync 2023-12-16T05:56:38.153 INFO:tasks.workunit.client.0.smithi155.stdout:6/904: chown d0/d3/d2c/d3e/cdc 122 1 2023-12-16T05:56:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.150+0000 7fcbd955f700 1 Processor -- start 2023-12-16T05:56:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.150+0000 7fcbd955f700 1 -- start start 2023-12-16T05:56:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.150+0000 7fcbd955f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcbd4106600 0x7fcbd4113be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.150+0000 7fcbd955f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbd4114120 0x7fcbd4115010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.150+0000 7fcbd955f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd41145e0 con 0x7fcbd4114120 2023-12-16T05:56:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.150+0000 7fcbd955f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd4114750 con 0x7fcbd4106600 2023-12-16T05:56:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.151+0000 7fcbd27fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbd4114120 0x7fcbd4115010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.151+0000 7fcbd27fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbd4114120 0x7fcbd4115010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53128/0 (socket says 172.21.15.155:53128) 2023-12-16T05:56:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.151+0000 7fcbd27fc700 1 -- 172.21.15.155:0/4060067773 learned_addr learned my addr 172.21.15.155:0/4060067773 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:56:38.155 INFO:tasks.workunit.client.0.smithi155.stdout:6/905: rename d0/df/d5e/d5b/f76 to d0/df/d5e/d5b/f130 0 2023-12-16T05:56:38.155 INFO:tasks.workunit.client.0.smithi155.stdout:7/664: dwrite d0/d6a/d31/f52 [0,4194304] 0 2023-12-16T05:56:38.155 INFO:tasks.workunit.client.0.smithi155.stdout:7/665: chown d0/d1b 198647 1 2023-12-16T05:56:38.155 INFO:tasks.workunit.client.0.smithi155.stdout:7/666: write d0/d6a/d1a/d8c/d34/d4b/d60/fd0 [823347,42476] 0 2023-12-16T05:56:38.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.151+0000 7fcbd27fc700 1 -- 172.21.15.155:0/4060067773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcbd4106600 msgr2=0x7fcbd4113be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:38.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.151+0000 7fcbd27fc700 1 --2- 172.21.15.155:0/4060067773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcbd4106600 0x7fcbd4113be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:38.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.151+0000 7fcbd27fc700 1 -- 172.21.15.155:0/4060067773 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc4005040 con 0x7fcbd4114120 2023-12-16T05:56:38.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.151+0000 7fcbd27fc700 1 --2- 172.21.15.155:0/4060067773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbd4114120 0x7fcbd4115010 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80041d0 tx=0x7fcbc800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:56:38.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.152+0000 7fcbbb7fe700 1 -- 172.21.15.155:0/4060067773 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbc8007cc0 con 0x7fcbd4114120 2023-12-16T05:56:38.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.152+0000 7fcbbb7fe700 1 -- 172.21.15.155:0/4060067773 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcbc800f040 con 0x7fcbd4114120 2023-12-16T05:56:38.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.152+0000 7fcbbb7fe700 1 -- 172.21.15.155:0/4060067773 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbc800ca50 con 0x7fcbd4114120 2023-12-16T05:56:38.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.153+0000 7fcbd955f700 1 -- 172.21.15.155:0/4060067773 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd4115610 con 0x7fcbd4114120 2023-12-16T05:56:38.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.153+0000 7fcbd955f700 1 -- 172.21.15.155:0/4060067773 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd4115ad0 con 0x7fcbd4114120 2023-12-16T05:56:38.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.154+0000 7fcbd955f700 1 -- 172.21.15.155:0/4060067773 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd404bb80 con 0x7fcbd4114120 2023-12-16T05:56:38.158 INFO:tasks.workunit.client.0.smithi155.stdout:1/797: dwrite d1/d7/d4b/f6d [0,4194304] 0 2023-12-16T05:56:38.158 INFO:tasks.workunit.client.0.smithi155.stdout:1/798: truncate d1/d7/d16/fa7 5238763 0 2023-12-16T05:56:38.158 INFO:tasks.workunit.client.0.smithi155.stdout:7/667: unlink d0/c71 0 2023-12-16T05:56:38.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.155+0000 7fcbbb7fe700 1 -- 172.21.15.155:0/4060067773 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 24) v1 ==== 88727+0+0 (secure 0 0 0) 0x7fcbc800cbb0 con 0x7fcbd4114120 2023-12-16T05:56:38.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.155+0000 7fcbbb7fe700 1 --2- 172.21.15.155:0/4060067773 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7fcbbc06af10 0x7fcbbc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:56:38.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.156+0000 7fcbd2ffd700 1 --2- 172.21.15.155:0/4060067773 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7fcbbc06af10 0x7fcbbc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:56:38.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.156+0000 7fcbd2ffd700 1 --2- 172.21.15.155:0/4060067773 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7fcbbc06af10 0x7fcbbc06d3c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4113970 tx=0x7fcbc4009e30 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:56:38.159 INFO:tasks.workunit.client.0.smithi155.stdout:5/762: sync 2023-12-16T05:56:38.160 INFO:tasks.workunit.client.0.smithi155.stdout:7/668: creat d0/d1/d5/fda x:0 0 0 2023-12-16T05:56:38.160 INFO:tasks.workunit.client.1.smithi156.stdout:4/421: dwrite d9/d43/d58/d7d/f90 [0,4194304] 0 2023-12-16T05:56:38.160 INFO:tasks.workunit.client.1.smithi156.stdout:4/422: write d9/d43/f8e [271608,3030] 0 2023-12-16T05:56:38.161 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.158+0000 7fcbbb7fe700 1 -- 172.21.15.155:0/4060067773 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fcbc8007e20 con 0x7fcbd4114120 2023-12-16T05:56:38.165 INFO:tasks.workunit.client.0.smithi155.stdout:8/699: dwrite d4/d62/d66/d78/d88/d1b/d1c/f54 [0,4194304] 0 2023-12-16T05:56:38.165 INFO:tasks.workunit.client.1.smithi156.stdout:5/634: dwrite da/dc/d2d/d4d/d54/f5d [0,4194304] 0 2023-12-16T05:56:38.165 INFO:tasks.workunit.client.1.smithi156.stdout:5/635: stat da/dc/d2d/f7e 0 2023-12-16T05:56:38.166 INFO:tasks.workunit.client.1.smithi156.stdout:4/423: rename d9/d2c/f6b to d9/d2b/d56/f91 0 2023-12-16T05:56:38.166 INFO:tasks.workunit.client.1.smithi156.stdout:5/636: truncate da/f1e 2056849 0 2023-12-16T05:56:38.166 INFO:tasks.workunit.client.1.smithi156.stdout:0/553: dwrite d2/d7/dd/d1c/fa5 [0,4194304] 0 2023-12-16T05:56:38.166 INFO:tasks.workunit.client.0.smithi155.stdout:6/906: rmdir d0/df/d5e/d7e/deb 0 2023-12-16T05:56:38.166 INFO:tasks.workunit.client.0.smithi155.stdout:6/907: fsync d0/d3/f1e 0 2023-12-16T05:56:38.166 INFO:tasks.workunit.client.0.smithi155.stdout:1/799: write d1/d7/d16/f3a [3043213,101161] 0 2023-12-16T05:56:38.167 INFO:tasks.workunit.client.0.smithi155.stdout:5/763: rmdir d0/d2/d2a/d19/d21/d56 39 2023-12-16T05:56:38.167 INFO:tasks.workunit.client.0.smithi155.stdout:5/764: truncate d0/d2/d2a/d19/d71/fb1 4412128 0 2023-12-16T05:56:38.167 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.164+0000 7fcbbb7fe700 1 -- 172.21.15.155:0/4060067773 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fcbc808d060 con 0x7fcbd4114120 2023-12-16T05:56:38.167 INFO:tasks.workunit.client.0.smithi155.stdout:1/800: rmdir d1/d7/d4b/d8e/dc7/d28/d8f/dad/df3 0 2023-12-16T05:56:38.168 INFO:tasks.workunit.client.1.smithi156.stdout:4/424: creat d9/d2c/d7a/f92 x:0 0 0 2023-12-16T05:56:38.168 INFO:tasks.workunit.client.1.smithi156.stdout:4/425: chown d9/d2c/l51 965182 1 2023-12-16T05:56:38.168 INFO:tasks.workunit.client.1.smithi156.stdout:4/426: write d9/d43/d58/f5c [370828,121202] 0 2023-12-16T05:56:38.168 INFO:tasks.workunit.client.1.smithi156.stdout:5/637: creat da/dc/d4b/d6c/d7c/fcb x:0 0 0 2023-12-16T05:56:38.168 INFO:tasks.workunit.client.1.smithi156.stdout:5/638: chown da/dc/d4b/d6c/d81/l6a 12 1 2023-12-16T05:56:38.169 INFO:tasks.workunit.client.1.smithi156.stdout:4/427: mknod d9/d2b/d35/c93 0 2023-12-16T05:56:38.169 INFO:tasks.workunit.client.1.smithi156.stdout:4/428: dread - d9/d2c/d7a/f92 zero size 2023-12-16T05:56:38.169 INFO:tasks.workunit.client.1.smithi156.stdout:4/429: readlink d9/d2c/d48/l72 0 2023-12-16T05:56:38.170 INFO:tasks.workunit.client.1.smithi156.stdout:5/639: symlink da/dc/d4b/d6c/d81/lcc 0 2023-12-16T05:56:38.170 INFO:tasks.workunit.client.0.smithi155.stdout:5/765: creat d0/d2/d2a/d19/d21/ff7 x:0 0 0 2023-12-16T05:56:38.171 INFO:tasks.workunit.client.1.smithi156.stdout:0/554: mkdir d2/d7/dd/d29/d38/dae 0 2023-12-16T05:56:38.173 INFO:tasks.workunit.client.0.smithi155.stdout:1/801: write d1/d7/d4b/d8e/dc7/f94 [96790,104235] 0 2023-12-16T05:56:38.174 INFO:tasks.workunit.client.1.smithi156.stdout:4/430: rename d9/d2b/d35/c6f to d9/d2b/c94 0 2023-12-16T05:56:38.174 INFO:tasks.workunit.client.1.smithi156.stdout:4/431: fdatasync d9/f28 0 2023-12-16T05:56:38.175 INFO:tasks.workunit.client.1.smithi156.stdout:0/555: truncate d2/d23/f32 1876572 0 2023-12-16T05:56:38.176 INFO:tasks.workunit.client.1.smithi156.stdout:0/556: rename d2/d7/dd to d2/d7/dd/d66/daf 22 2023-12-16T05:56:38.177 INFO:tasks.workunit.client.0.smithi155.stdout:6/908: dread d0/df/f26 [0,4194304] 0 2023-12-16T05:56:38.177 INFO:tasks.workunit.client.0.smithi155.stdout:6/909: stat d0/df/d5e/d7e/dd8/d12b/d103/fdf 0 2023-12-16T05:56:38.178 INFO:tasks.workunit.client.1.smithi156.stdout:4/432: mkdir d9/d43/d58/d95 0 2023-12-16T05:56:38.179 INFO:tasks.workunit.client.0.smithi155.stdout:1/802: mknod d1/d7/d4b/d8e/dc7/d28/d74/cfa 0 2023-12-16T05:56:38.179 INFO:tasks.workunit.client.0.smithi155.stdout:1/803: chown d1/d7/d16/c44 4967 1 2023-12-16T05:56:38.184 INFO:tasks.workunit.client.0.smithi155.stdout:8/700: dwrite d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/fbb [0,4194304] 0 2023-12-16T05:56:38.184 INFO:tasks.workunit.client.0.smithi155.stdout:8/701: write d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/fe8 [984794,109900] 0 2023-12-16T05:56:38.195 INFO:tasks.workunit.client.1.smithi156.stdout:0/557: dread d2/f22 [0,4194304] 0 2023-12-16T05:56:38.198 INFO:tasks.workunit.client.1.smithi156.stdout:0/558: mknod d2/d7/dd/d5c/cb0 0 2023-12-16T05:56:38.199 INFO:tasks.workunit.client.1.smithi156.stdout:0/559: creat d2/d7/dd/d1c/fb1 x:0 0 0 2023-12-16T05:56:38.202 INFO:tasks.workunit.client.1.smithi156.stdout:0/560: link d2/c3 d2/d7/dd/d29/d38/d51/cb2 0 2023-12-16T05:56:38.202 INFO:tasks.workunit.client.1.smithi156.stdout:0/561: chown d2/d7/dd/d2d/d5e/c6e 3394 1 2023-12-16T05:56:38.204 INFO:tasks.workunit.client.1.smithi156.stdout:0/562: mkdir d2/d7/dd/d1c/db3 0 2023-12-16T05:56:38.205 INFO:tasks.workunit.client.1.smithi156.stdout:0/563: mknod d2/d23/d4a/cb4 0 2023-12-16T05:56:38.205 INFO:tasks.workunit.client.1.smithi156.stdout:0/564: chown d2/d7/dd/d5c/l5d 503681965 1 2023-12-16T05:56:38.206 INFO:tasks.workunit.client.0.smithi155.stdout:7/669: mknod d0/d1b/cdb 0 2023-12-16T05:56:38.207 INFO:tasks.workunit.client.1.smithi156.stdout:0/565: unlink d2/d7/dd/f41 0 2023-12-16T05:56:38.208 INFO:tasks.workunit.client.1.smithi156.stdout:0/566: mkdir d2/d7/da8/db5 0 2023-12-16T05:56:38.208 INFO:tasks.workunit.client.1.smithi156.stdout:0/567: write d2/d7/dd/d29/d4b/d76/f78 [1521286,68662] 0 2023-12-16T05:56:38.208 INFO:tasks.workunit.client.0.smithi155.stdout:7/670: write d0/f35 [7630110,123367] 0 2023-12-16T05:56:38.209 INFO:tasks.workunit.client.1.smithi156.stdout:0/568: write d2/d7/dd/d29/f4f [1115459,27814] 0 2023-12-16T05:56:38.210 INFO:tasks.workunit.client.1.smithi156.stdout:0/569: mknod d2/d7/dd/d2d/d5e/cb6 0 2023-12-16T05:56:38.210 INFO:tasks.workunit.client.1.smithi156.stdout:0/570: write d2/d23/d4a/f54 [4708172,83069] 0 2023-12-16T05:56:38.210 INFO:tasks.workunit.client.1.smithi156.stdout:0/571: chown d2/d7/f3c 1 1 2023-12-16T05:56:38.211 INFO:tasks.workunit.client.1.smithi156.stdout:0/572: write d2/d47/f46 [4943932,73052] 0 2023-12-16T05:56:38.218 INFO:tasks.workunit.client.0.smithi155.stdout:5/766: dwrite d0/d2/d2a/d19/d59/feb [0,4194304] 0 2023-12-16T05:56:38.220 INFO:tasks.workunit.client.0.smithi155.stdout:7/671: dread d0/fd2 [0,4194304] 0 2023-12-16T05:56:38.222 INFO:tasks.workunit.client.0.smithi155.stdout:5/767: creat d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/dc9/ff8 x:0 0 0 2023-12-16T05:56:38.222 INFO:tasks.workunit.client.0.smithi155.stdout:6/910: dwrite d0/d3/d7a/d77/fa3 [0,4194304] 0 2023-12-16T05:56:38.223 INFO:tasks.workunit.client.1.smithi156.stdout:5/640: dwrite da/dc/f17 [0,4194304] 0 2023-12-16T05:56:38.224 INFO:tasks.workunit.client.0.smithi155.stdout:8/702: dwrite d4/d62/d66/d78/d88/d1b/d1c/d97/d29/faf [0,4194304] 0 2023-12-16T05:56:38.224 INFO:tasks.workunit.client.0.smithi155.stdout:7/672: creat d0/d6a/d1a/da0/fdc x:0 0 0 2023-12-16T05:56:38.224 INFO:tasks.workunit.client.0.smithi155.stdout:7/673: chown d0/d6a/d1a/d2b/d65 5 1 2023-12-16T05:56:38.224 INFO:tasks.workunit.client.0.smithi155.stdout:5/768: symlink d0/d2/d2a/d19/dd7/lf9 0 2023-12-16T05:56:38.224 INFO:tasks.workunit.client.0.smithi155.stdout:5/769: dread - d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/dd9/fe5 zero size 2023-12-16T05:56:38.224 INFO:tasks.workunit.client.0.smithi155.stdout:5/770: fdatasync d0/d2/d2a/d19/d88/fc3 0 2023-12-16T05:56:38.224 INFO:tasks.workunit.client.0.smithi155.stdout:1/804: dwrite d1/d25/d43/f60 [0,4194304] 0 2023-12-16T05:56:38.225 INFO:tasks.workunit.client.1.smithi156.stdout:5/641: mkdir da/d9a/dcd 0 2023-12-16T05:56:38.225 INFO:tasks.workunit.client.1.smithi156.stdout:4/433: dwrite d9/f24 [4194304,4194304] 0 2023-12-16T05:56:38.225 INFO:tasks.workunit.client.1.smithi156.stdout:5/642: mkdir da/d9a/dcd/dce 0 2023-12-16T05:56:38.226 INFO:tasks.workunit.client.0.smithi155.stdout:1/805: write d1/ff [512061,130981] 0 2023-12-16T05:56:38.226 INFO:tasks.workunit.client.0.smithi155.stdout:6/911: mkdir d0/d3/d7a/db0/dc3/d131 0 2023-12-16T05:56:38.226 INFO:tasks.workunit.client.0.smithi155.stdout:6/912: dread - d0/dbd/f115 zero size 2023-12-16T05:56:38.228 INFO:tasks.workunit.client.1.smithi156.stdout:5/643: creat da/dc/d2d/d34/fcf x:0 0 0 2023-12-16T05:56:38.229 INFO:tasks.workunit.client.1.smithi156.stdout:0/573: dwrite d2/d7/dd/d29/d38/d51/d52/d88/f8e [0,4194304] 0 2023-12-16T05:56:38.230 INFO:tasks.workunit.client.1.smithi156.stdout:5/644: unlink da/d46/f70 0 2023-12-16T05:56:38.231 INFO:tasks.workunit.client.0.smithi155.stdout:8/703: symlink d4/d62/d66/d78/d88/d12/led 0 2023-12-16T05:56:38.233 INFO:tasks.workunit.client.1.smithi156.stdout:0/574: mknod d2/d7/dd/d29/d38/d51/d65/cb7 0 2023-12-16T05:56:38.234 INFO:tasks.workunit.client.1.smithi156.stdout:5/645: creat da/dc/d2d/fd0 x:0 0 0 2023-12-16T05:56:38.235 INFO:tasks.workunit.client.0.smithi155.stdout:7/674: creat d0/d6a/d1a/d2b/d65/db8/fdd x:0 0 0 2023-12-16T05:56:38.236 INFO:tasks.workunit.client.0.smithi155.stdout:5/771: mknod d0/d2/d2a/d19/d88/cfa 0 2023-12-16T05:56:38.237 INFO:tasks.workunit.client.0.smithi155.stdout:5/772: write d0/d2/d2a/d19/d21/f36 [1604246,114203] 0 2023-12-16T05:56:38.237 INFO:tasks.workunit.client.0.smithi155.stdout:5/773: chown d0/d2/d2a/d19/f38 0 1 2023-12-16T05:56:38.239 INFO:tasks.workunit.client.1.smithi156.stdout:0/575: truncate d2/f24 1813099 0 2023-12-16T05:56:38.239 INFO:tasks.workunit.client.1.smithi156.stdout:0/576: write d2/d47/f46 [5398692,118832] 0 2023-12-16T05:56:38.239 INFO:tasks.workunit.client.1.smithi156.stdout:0/577: fsync d2/d7/dd/d29/d38/d51/d65/f6f 0 2023-12-16T05:56:38.240 INFO:tasks.workunit.client.0.smithi155.stdout:6/913: mkdir d0/d3/d7a/dd6/d132 0 2023-12-16T05:56:38.240 INFO:tasks.workunit.client.1.smithi156.stdout:0/578: write d2/d7/dd/f33 [2801315,44168] 0 2023-12-16T05:56:38.242 INFO:tasks.workunit.client.0.smithi155.stdout:5/774: rename d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/cd0 to d0/d2/d2a/d30/d53/d7b/d99/d47/d61/db6/dce/cfb 0 2023-12-16T05:56:38.242 INFO:tasks.workunit.client.1.smithi156.stdout:0/579: truncate d2/d7/dd/d29/d38/d51/d52/f8c 3378305 0 2023-12-16T05:56:38.242 INFO:tasks.workunit.client.1.smithi156.stdout:0/580: write d2/d7/f18 [8861961,76543] 0 2023-12-16T05:56:38.243 INFO:tasks.workunit.client.1.smithi156.stdout:0/581: write d2/d7/dd/d29/d4b/d76/d85/f99 [409212,25566] 0 2023-12-16T05:56:38.243 INFO:tasks.workunit.client.0.smithi155.stdout:5/775: truncate d0/d2/d2a/d30/d53/fbe 385352 0 2023-12-16T05:56:38.243 INFO:tasks.workunit.client.0.smithi155.stdout:5/776: chown d0/d2/d4f/fa4 65 1 2023-12-16T05:56:38.247 INFO:tasks.workunit.client.1.smithi156.stdout:0/582: mknod d2/d7/dd/d29/d4b/d76/d85/cb8 0 2023-12-16T05:56:38.250 INFO:tasks.workunit.client.1.smithi156.stdout:4/434: dwrite d9/d43/d58/d7d/f90 [0,4194304] 0 2023-12-16T05:56:38.254 INFO:tasks.workunit.client.0.smithi155.stdout:1/806: dread d1/d7/f75 [0,4194304] 0 2023-12-16T05:56:38.254 INFO:tasks.workunit.client.0.smithi155.stdout:1/807: fsync d1/f1e 0 2023-12-16T05:56:38.259 INFO:tasks.workunit.client.1.smithi156.stdout:0/583: dread d2/d7/f18 [4194304,4194304] 0 2023-12-16T05:56:38.261 INFO:tasks.workunit.client.1.smithi156.stdout:0/584: write d2/d7/dd/d29/d38/d51/d52/f8c [2248748,105847] 0 2023-12-16T05:56:38.266 INFO:tasks.workunit.client.1.smithi156.stdout:6/415: sync 2023-12-16T05:56:38.266 INFO:tasks.workunit.client.1.smithi156.stdout:2/471: sync 2023-12-16T05:56:38.267 INFO:tasks.workunit.client.1.smithi156.stdout:2/472: chown d9/f5c 4 1 2023-12-16T05:56:38.267 INFO:tasks.workunit.client.1.smithi156.stdout:2/473: chown d9/dd/d17/d33/f40 122984511 1 2023-12-16T05:56:38.267 INFO:tasks.workunit.client.1.smithi156.stdout:2/474: write d9/dd/f8a [754689,59155] 0 2023-12-16T05:56:38.267 INFO:tasks.workunit.client.0.smithi155.stdout:5/777: dwrite d0/d2/d2a/d19/f4c [4194304,4194304] 0 2023-12-16T05:56:38.268 INFO:tasks.workunit.client.0.smithi155.stdout:1/808: dread d1/d7/d4b/d8e/dc7/fa5 [0,4194304] 0 2023-12-16T05:56:38.268 INFO:tasks.workunit.client.1.smithi156.stdout:6/416: mkdir d9/d13/d2f/d51/d82 0 2023-12-16T05:56:38.269 INFO:tasks.workunit.client.1.smithi156.stdout:2/475: mkdir d9/dd/d17/d33/d86/d96 0 2023-12-16T05:56:38.270 INFO:tasks.workunit.client.0.smithi155.stdout:5/778: link d0/c51 d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/cfc 0 2023-12-16T05:56:38.270 INFO:tasks.workunit.client.0.smithi155.stdout:5/779: chown d0/d2/f1d 93 1 2023-12-16T05:56:38.271 INFO:tasks.workunit.client.1.smithi156.stdout:2/476: creat d9/d68/f97 x:0 0 0 2023-12-16T05:56:38.271 INFO:tasks.workunit.client.0.smithi155.stdout:5/780: read d0/d2/d2a/f18 [1035507,56807] 0 2023-12-16T05:56:38.272 INFO:tasks.workunit.client.1.smithi156.stdout:2/477: mknod d9/dd/d17/d33/d86/d96/c98 0 2023-12-16T05:56:38.272 INFO:tasks.workunit.client.1.smithi156.stdout:2/478: write d9/d68/f97 [149729,14652] 0 2023-12-16T05:56:38.273 INFO:tasks.workunit.client.1.smithi156.stdout:2/479: creat d9/dd/d17/d33/d78/d39/d60/d6a/d91/f99 x:0 0 0 2023-12-16T05:56:38.273 INFO:tasks.workunit.client.1.smithi156.stdout:2/480: fsync d9/dd/d17/d33/d47/f6e 0 2023-12-16T05:56:38.273 INFO:tasks.workunit.client.1.smithi156.stdout:2/481: dread - d9/dd/d17/d33/d78/d39/f79 zero size 2023-12-16T05:56:38.273 INFO:tasks.workunit.client.1.smithi156.stdout:2/482: truncate d9/dd/d3f/f67 829180 0 2023-12-16T05:56:38.275 INFO:tasks.workunit.client.0.smithi155.stdout:5/781: write d0/d2/d4f/f55 [959872,97521] 0 2023-12-16T05:56:38.276 INFO:tasks.workunit.client.1.smithi156.stdout:4/435: dwrite d9/f27 [4194304,4194304] 0 2023-12-16T05:56:38.277 INFO:tasks.workunit.client.0.smithi155.stdout:5/782: creat d0/d2/d2a/d19/d88/dd8/ffd x:0 0 0 2023-12-16T05:56:38.278 INFO:tasks.workunit.client.0.smithi155.stdout:5/783: mknod d0/d2/cfe 0 2023-12-16T05:56:38.279 INFO:tasks.workunit.client.1.smithi156.stdout:4/436: getdents d9/d43 0 2023-12-16T05:56:38.279 INFO:tasks.workunit.client.1.smithi156.stdout:4/437: chown d9/f19 171556 1 2023-12-16T05:56:38.279 INFO:tasks.workunit.client.1.smithi156.stdout:4/438: chown d9/d2b 80369817 1 2023-12-16T05:56:38.279 INFO:tasks.workunit.client.1.smithi156.stdout:4/439: stat d9/d2b/d35 0 2023-12-16T05:56:38.279 INFO:tasks.workunit.client.0.smithi155.stdout:1/809: dread d1/d7/d4b/d8e/dc7/d28/f70 [0,4194304] 0 2023-12-16T05:56:38.279 INFO:tasks.workunit.client.0.smithi155.stdout:8/704: dwrite d4/d62/d66/d78/d88/d1b/d1c/d97/fa1 [0,4194304] 0 2023-12-16T05:56:38.280 INFO:tasks.workunit.client.0.smithi155.stdout:8/705: chown d4/d62/d66/d78/d88/d1b/d1c/d97/d29/faf 12 1 2023-12-16T05:56:38.280 INFO:tasks.workunit.client.1.smithi156.stdout:2/483: rmdir d9/dd/d17/d33 39 2023-12-16T05:56:38.281 INFO:tasks.workunit.client.0.smithi155.stdout:1/810: mkdir d1/d7/d4b/dfb 0 2023-12-16T05:56:38.282 INFO:tasks.workunit.client.1.smithi156.stdout:4/440: mknod d9/d43/d58/d95/c96 0 2023-12-16T05:56:38.282 INFO:tasks.workunit.client.0.smithi155.stdout:1/811: creat d1/d7/d4b/d8e/dc7/d28/d85/de0/d7e/ffc x:0 0 0 2023-12-16T05:56:38.283 INFO:tasks.workunit.client.1.smithi156.stdout:2/484: creat d9/d56/f9a x:0 0 0 2023-12-16T05:56:38.283 INFO:tasks.workunit.client.1.smithi156.stdout:2/485: readlink d9/dd/l42 0 2023-12-16T05:56:38.283 INFO:tasks.workunit.client.1.smithi156.stdout:4/441: write d9/f1e [2499526,95084] 0 2023-12-16T05:56:38.284 INFO:tasks.workunit.client.0.smithi155.stdout:1/812: creat d1/d7/d4b/d8e/dc7/d28/d85/ffd x:0 0 0 2023-12-16T05:56:38.285 INFO:tasks.workunit.client.0.smithi155.stdout:9/929: sync 2023-12-16T05:56:38.287 INFO:tasks.workunit.client.1.smithi156.stdout:4/442: creat d9/d43/d58/d95/f97 x:0 0 0 2023-12-16T05:56:38.288 INFO:tasks.workunit.client.1.smithi156.stdout:2/486: mknod d9/d12/c9b 0 2023-12-16T05:56:38.291 INFO:tasks.workunit.client.1.smithi156.stdout:4/443: mkdir d9/d2b/d98 0 2023-12-16T05:56:38.291 INFO:tasks.workunit.client.1.smithi156.stdout:4/444: fdatasync d9/d2b/d35/f53 0 2023-12-16T05:56:38.291 INFO:tasks.workunit.client.1.smithi156.stdout:4/445: write d9/d2c/f61 [429955,56399] 0 2023-12-16T05:56:38.293 INFO:tasks.workunit.client.0.smithi155.stdout:9/930: dread da/d15/d17/f1c [0,4194304] 0 2023-12-16T05:56:38.294 INFO:tasks.workunit.client.0.smithi155.stdout:9/931: mkdir da/d15/d17/d24/d26/d2e/d32/d136 0 2023-12-16T05:56:38.295 INFO:tasks.workunit.client.1.smithi156.stdout:4/446: rename d9/d2b/d56/d77 to d9/d2b/d98/d99 0 2023-12-16T05:56:38.297 INFO:tasks.workunit.client.1.smithi156.stdout:6/417: dwrite d9/d1c/f39 [4194304,4194304] 0 2023-12-16T05:56:38.304 INFO:tasks.workunit.client.0.smithi155.stdout:5/784: dwrite d0/d2/f1d [0,4194304] 0 2023-12-16T05:56:38.305 INFO:tasks.workunit.client.0.smithi155.stdout:5/785: symlink d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/lff 0 2023-12-16T05:56:38.306 INFO:tasks.workunit.client.0.smithi155.stdout:5/786: symlink d0/d2/d2a/d30/d53/d7b/d99/l100 0 2023-12-16T05:56:38.306 INFO:tasks.workunit.client.0.smithi155.stdout:5/787: write d0/d2/d2a/f42 [1537615,38547] 0 2023-12-16T05:56:38.307 INFO:tasks.workunit.client.0.smithi155.stdout:5/788: chown d0/d2/f5 4794179 1 2023-12-16T05:56:38.308 INFO:tasks.workunit.client.0.smithi155.stdout:5/789: mkdir d0/d2/d2a/d30/d53/d7b/d99/d101 0 2023-12-16T05:56:38.309 INFO:tasks.workunit.client.0.smithi155.stdout:5/790: truncate d0/d2/d2a/d19/d21/f36 1449713 0 2023-12-16T05:56:38.312 INFO:tasks.workunit.client.1.smithi156.stdout:4/447: getdents d9/d2b 0 2023-12-16T05:56:38.313 INFO:tasks.workunit.client.1.smithi156.stdout:4/448: mkdir d9/d2b/d9a 0 2023-12-16T05:56:38.314 INFO:tasks.workunit.client.1.smithi156.stdout:4/449: chown d9/d43/l4e 1765614160 1 2023-12-16T05:56:38.314 INFO:tasks.workunit.client.1.smithi156.stdout:4/450: write d9/d43/f62 [125274,5522] 0 2023-12-16T05:56:38.314 INFO:tasks.workunit.client.0.smithi155.stdout:8/706: dwrite d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/f72 [0,4194304] 0 2023-12-16T05:56:38.315 INFO:tasks.workunit.client.0.smithi155.stdout:1/813: dwrite d1/d7/d4b/d8e/ff9 [0,4194304] 0 2023-12-16T05:56:38.315 INFO:tasks.workunit.client.1.smithi156.stdout:6/418: dwrite d9/f35 [4194304,4194304] 0 2023-12-16T05:56:38.316 INFO:tasks.workunit.client.1.smithi156.stdout:6/419: truncate d9/d13/d2f/d36/f63 706384 0 2023-12-16T05:56:38.316 INFO:tasks.workunit.client.1.smithi156.stdout:6/420: chown d9/d13/d3e/f6c 995 1 2023-12-16T05:56:38.316 INFO:tasks.workunit.client.1.smithi156.stdout:4/451: chown d9/d2b/f75 7 1 2023-12-16T05:56:38.316 INFO:tasks.workunit.client.1.smithi156.stdout:4/452: chown d9/d2c/f61 32 1 2023-12-16T05:56:38.316 INFO:tasks.workunit.client.0.smithi155.stdout:1/814: write d1/d7/d4b/d8e/dc7/fa5 [626369,5965] 0 2023-12-16T05:56:38.322 INFO:tasks.workunit.client.0.smithi155.stdout:8/707: getdents d4/d62/d66/d78/d88/d1b/d2a 0 2023-12-16T05:56:38.325 INFO:tasks.workunit.client.0.smithi155.stdout:8/708: read d4/d62/d66/d78/d88/d1b/d1c/d97/f59 [3827457,100320] 0 2023-12-16T05:56:38.325 INFO:tasks.workunit.client.0.smithi155.stdout:8/709: read - d4/fe1 zero size 2023-12-16T05:56:38.327 INFO:tasks.workunit.client.0.smithi155.stdout:8/710: symlink d4/d62/d66/d78/d80/lee 0 2023-12-16T05:56:38.327 INFO:tasks.workunit.client.0.smithi155.stdout:8/711: write d4/d62/d66/d78/d88/d1b/d1c/d97/fd7 [1845841,64892] 0 2023-12-16T05:56:38.330 INFO:tasks.workunit.client.0.smithi155.stdout:8/712: dread d4/d62/d66/d78/d88/d1b/d1c/d97/fce [0,4194304] 0 2023-12-16T05:56:38.330 INFO:tasks.workunit.client.0.smithi155.stdout:8/713: readlink d4/d62/d66/d78/d88/d1b/d2a/laa 0 2023-12-16T05:56:38.332 INFO:tasks.workunit.client.0.smithi155.stdout:8/714: unlink d4/d62/d66/d78/d88/d1b/d1c/d19/fca 0 2023-12-16T05:56:38.333 INFO:tasks.workunit.client.0.smithi155.stdout:8/715: dread d4/d62/d66/d78/d88/d1b/f7c [0,4194304] 0 2023-12-16T05:56:38.334 INFO:tasks.workunit.client.0.smithi155.stdout:8/716: mkdir d4/d62/d66/d78/def 0 2023-12-16T05:56:38.335 INFO:tasks.workunit.client.0.smithi155.stdout:8/717: truncate d4/d62/d66/d78/d88/d1b/d1c/f8d 2428744 0 2023-12-16T05:56:38.336 INFO:tasks.workunit.client.0.smithi155.stdout:8/718: symlink d4/d62/d66/d78/d88/d1b/d2a/d51/lf0 0 2023-12-16T05:56:38.337 INFO:tasks.workunit.client.1.smithi156.stdout:4/453: dwrite d9/d2c/f2f [4194304,4194304] 0 2023-12-16T05:56:38.337 INFO:tasks.workunit.client.0.smithi155.stdout:1/815: dwrite d1/d25/f9b [0,4194304] 0 2023-12-16T05:56:38.337 INFO:tasks.workunit.client.0.smithi155.stdout:1/816: truncate d1/d7/d4b/d8e/dc7/d28/d8f/f96 238117 0 2023-12-16T05:56:38.339 INFO:tasks.workunit.client.1.smithi156.stdout:6/421: dwrite d9/d13/d3e/f59 [0,4194304] 0 2023-12-16T05:56:38.339 INFO:tasks.workunit.client.1.smithi156.stdout:6/422: chown d9/d1c/c37 52563836 1 2023-12-16T05:56:38.339 INFO:tasks.workunit.client.0.smithi155.stdout:1/817: fsync d1/d7/f5a 0 2023-12-16T05:56:38.340 INFO:tasks.workunit.client.1.smithi156.stdout:6/423: write d9/d1c/f47 [3122609,88969] 0 2023-12-16T05:56:38.340 INFO:tasks.workunit.client.1.smithi156.stdout:6/424: chown d9/d13/d2f 589 1 2023-12-16T05:56:38.340 INFO:tasks.workunit.client.1.smithi156.stdout:4/454: rename d9/f4d to d9/d2c/f9b 0 2023-12-16T05:56:38.340 INFO:tasks.workunit.client.0.smithi155.stdout:8/719: dread d4/d62/d66/d78/d88/d1b/d1c/d46/f89 [0,4194304] 0 2023-12-16T05:56:38.341 INFO:tasks.workunit.client.0.smithi155.stdout:1/818: dread d1/d7/d16/fa7 [4194304,4194304] 0 2023-12-16T05:56:38.342 INFO:tasks.workunit.client.0.smithi155.stdout:8/720: rename d4/ce6 to d4/d62/d66/d78/d88/d12/ddc/cf1 0 2023-12-16T05:56:38.342 INFO:tasks.workunit.client.1.smithi156.stdout:6/425: rename d9/d13/d2f/d51/d69/f7d to d9/d13/d3e/f83 0 2023-12-16T05:56:38.343 INFO:tasks.workunit.client.0.smithi155.stdout:8/721: read d4/d62/d66/d78/d88/d1b/d5f/f90 [139695,129735] 0 2023-12-16T05:56:38.344 INFO:tasks.workunit.client.1.smithi156.stdout:4/455: rename d9/d43/f49 to d9/d43/d58/f9c 0 2023-12-16T05:56:38.344 INFO:tasks.workunit.client.0.smithi155.stdout:8/722: creat d4/d62/d66/d78/d80/ff2 x:0 0 0 2023-12-16T05:56:38.345 INFO:tasks.workunit.client.0.smithi155.stdout:8/723: fsync d4/d62/d66/d78/d88/d1b/d1c/d97/f59 0 2023-12-16T05:56:38.345 INFO:tasks.workunit.client.1.smithi156.stdout:6/426: creat d9/d1c/d50/f84 x:0 0 0 2023-12-16T05:56:38.345 INFO:tasks.workunit.client.1.smithi156.stdout:6/427: write d9/d13/d3e/d5f/f7f [797677,51754] 0 2023-12-16T05:56:38.346 INFO:tasks.workunit.client.1.smithi156.stdout:6/428: write d9/d13/d2f/d36/f79 [1013209,6349] 0 2023-12-16T05:56:38.346 INFO:tasks.workunit.client.1.smithi156.stdout:4/456: rmdir d9/d43/d58/d7d 39 2023-12-16T05:56:38.346 INFO:tasks.workunit.client.1.smithi156.stdout:4/457: truncate d9/d2c/d48/f67 1043489 0 2023-12-16T05:56:38.348 INFO:tasks.workunit.client.1.smithi156.stdout:6/429: creat d9/f85 x:0 0 0 2023-12-16T05:56:38.348 INFO:tasks.workunit.client.0.smithi155.stdout:1/819: dread d1/d7/d16/f21 [4194304,4194304] 0 2023-12-16T05:56:38.349 INFO:tasks.workunit.client.1.smithi156.stdout:6/430: mknod d9/d1c/d50/c86 0 2023-12-16T05:56:38.351 INFO:tasks.workunit.client.1.smithi156.stdout:4/458: rmdir d9/d2b/d98/d99 39 2023-12-16T05:56:38.352 INFO:tasks.workunit.client.1.smithi156.stdout:6/431: creat d9/d13/d2f/d51/d6b/d77/d7e/f87 x:0 0 0 2023-12-16T05:56:38.352 INFO:tasks.workunit.client.1.smithi156.stdout:6/432: truncate d9/d13/d2f/d36/f55 1030982 0 2023-12-16T05:56:38.353 INFO:tasks.workunit.client.1.smithi156.stdout:4/459: write d9/d2b/d35/f71 [21169,6375] 0 2023-12-16T05:56:38.353 INFO:tasks.workunit.client.0.smithi155.stdout:8/724: dread d4/d62/d66/d78/d88/d1b/d1c/f45 [0,4194304] 0 2023-12-16T05:56:38.354 INFO:tasks.workunit.client.0.smithi155.stdout:8/725: write d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/fe3 [4788243,30889] 0 2023-12-16T05:56:38.354 INFO:tasks.workunit.client.0.smithi155.stdout:8/726: write d4/d62/d66/d78/d88/d1b/d1c/d19/d64/fa4 [161269,55711] 0 2023-12-16T05:56:38.355 INFO:tasks.workunit.client.1.smithi156.stdout:6/433: unlink d9/d13/f48 0 2023-12-16T05:56:38.355 INFO:tasks.workunit.client.0.smithi155.stdout:8/727: mkdir d4/d62/d66/d78/d88/d1b/d1c/d97/df3 0 2023-12-16T05:56:38.356 INFO:tasks.workunit.client.1.smithi156.stdout:4/460: truncate f0 707316 0 2023-12-16T05:56:38.356 INFO:tasks.workunit.client.1.smithi156.stdout:4/461: write d9/d2b/d35/f3f [232178,76018] 0 2023-12-16T05:56:38.357 INFO:tasks.workunit.client.1.smithi156.stdout:4/462: read d9/d2c/f3e [2344908,109824] 0 2023-12-16T05:56:38.357 INFO:tasks.workunit.client.1.smithi156.stdout:4/463: dread - d9/d2b/d98/d99/f83 zero size 2023-12-16T05:56:38.357 INFO:tasks.workunit.client.0.smithi155.stdout:8/728: write d4/d62/d66/d78/d88/d1b/d1c/f54 [1595901,124762] 0 2023-12-16T05:56:38.360 INFO:tasks.workunit.client.0.smithi155.stdout:8/729: write d4/d62/d66/d78/d88/d1b/d1c/d1a/f3d [1494733,64260] 0 2023-12-16T05:56:38.360 INFO:tasks.workunit.client.0.smithi155.stdout:8/730: chown d4/d62/d66/d78/d88/d1b/d2a/de2 17243 1 2023-12-16T05:56:38.361 INFO:tasks.workunit.client.0.smithi155.stdout:8/731: symlink d4/d62/d66/d78/d88/d1b/d1c/d1a/lf4 0 2023-12-16T05:56:38.362 INFO:tasks.workunit.client.0.smithi155.stdout:8/732: mkdir d4/d62/d66/d78/d88/d1b/d1c/d97/df3/df5 0 2023-12-16T05:56:38.362 INFO:tasks.workunit.client.0.smithi155.stdout:8/733: write d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/fba [804749,93585] 0 2023-12-16T05:56:38.363 INFO:tasks.workunit.client.0.smithi155.stdout:8/734: symlink d4/d62/d66/d78/d88/d1b/d1c/d1a/lf6 0 2023-12-16T05:56:38.369 INFO:tasks.workunit.client.1.smithi156.stdout:4/464: dread d9/f42 [0,4194304] 0 2023-12-16T05:56:38.369 INFO:tasks.workunit.client.1.smithi156.stdout:4/465: truncate d9/d2c/d7a/f8a 879145 0 2023-12-16T05:56:38.370 INFO:tasks.workunit.client.1.smithi156.stdout:4/466: mknod d9/d2c/d48/c9d 0 2023-12-16T05:56:38.371 INFO:tasks.workunit.client.0.smithi155.stdout:1/820: dwrite d1/f2a [0,4194304] 0 2023-12-16T05:56:38.371 INFO:tasks.workunit.client.0.smithi155.stdout:1/821: chown d1/d7/d4b/d8e/dc7/d28/d8f/dad/ccf 4392 1 2023-12-16T05:56:38.372 INFO:tasks.workunit.client.0.smithi155.stdout:1/822: creat d1/d7/d16/de4/ffe x:0 0 0 2023-12-16T05:56:38.375 INFO:tasks.workunit.client.1.smithi156.stdout:6/434: dwrite d9/f35 [4194304,4194304] 0 2023-12-16T05:56:38.379 INFO:tasks.workunit.client.1.smithi156.stdout:4/467: rmdir d9/d2c/d48 39 2023-12-16T05:56:38.394 INFO:tasks.workunit.client.0.smithi155.stdout:8/735: dwrite d4/d62/d66/d78/d88/d1b/d2a/f75 [0,4194304] 0 2023-12-16T05:56:38.395 INFO:tasks.workunit.client.0.smithi155.stdout:8/736: dread - d4/fd2 zero size 2023-12-16T05:56:38.395 INFO:tasks.workunit.client.1.smithi156.stdout:4/468: dread d9/f21 [0,4194304] 0 2023-12-16T05:56:38.395 INFO:tasks.workunit.client.0.smithi155.stdout:8/737: write d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/fb3 [1102119,17009] 0 2023-12-16T05:56:38.395 INFO:tasks.workunit.client.0.smithi155.stdout:8/738: stat d4/d62/d66/c99 0 2023-12-16T05:56:38.397 INFO:tasks.workunit.client.0.smithi155.stdout:8/739: mknod d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/cf7 0 2023-12-16T05:56:38.397 INFO:tasks.workunit.client.0.smithi155.stdout:8/740: fsync d4/d62/d66/d78/d88/d1b/d5f/f90 0 2023-12-16T05:56:38.399 INFO:tasks.workunit.client.0.smithi155.stdout:1/823: dwrite d1/d7/f1f [0,4194304] 0 2023-12-16T05:56:38.401 INFO:tasks.workunit.client.1.smithi156.stdout:6/435: dwrite d9/d13/d2f/d36/f55 [0,4194304] 0 2023-12-16T05:56:38.402 INFO:tasks.workunit.client.0.smithi155.stdout:1/824: dread d1/d7/d4b/d8e/dc7/d28/d85/de0/d79/f97 [0,4194304] 0 2023-12-16T05:56:38.403 INFO:tasks.workunit.client.1.smithi156.stdout:6/436: symlink d9/d13/d2f/d51/d82/l88 0 2023-12-16T05:56:38.403 INFO:tasks.workunit.client.1.smithi156.stdout:6/437: write d9/d1c/f49 [5101266,89247] 0 2023-12-16T05:56:38.403 INFO:tasks.workunit.client.1.smithi156.stdout:6/438: dread - d9/d13/d3e/f83 zero size 2023-12-16T05:56:38.404 INFO:tasks.workunit.client.1.smithi156.stdout:6/439: stat d9/d1c/f2b 0 2023-12-16T05:56:38.404 INFO:tasks.workunit.client.1.smithi156.stdout:6/440: dread - d9/d13/d2f/d51/d69/f7b zero size 2023-12-16T05:56:38.406 INFO:tasks.workunit.client.0.smithi155.stdout:1/825: dread d1/d7/d4b/d8e/fd3 [0,4194304] 0 2023-12-16T05:56:38.407 INFO:tasks.workunit.client.0.smithi155.stdout:1/826: write d1/d7/f95 [1514263,627] 0 2023-12-16T05:56:38.407 INFO:tasks.workunit.client.0.smithi155.stdout:1/827: creat d1/d7/d4b/d8e/dc7/fff x:0 0 0 2023-12-16T05:56:38.421 INFO:tasks.workunit.client.1.smithi156.stdout:4/469: dwrite d9/d43/f79 [0,4194304] 0 2023-12-16T05:56:38.425 INFO:tasks.workunit.client.1.smithi156.stdout:1/312: sync 2023-12-16T05:56:38.425 INFO:tasks.workunit.client.1.smithi156.stdout:8/335: sync 2023-12-16T05:56:38.425 INFO:tasks.workunit.client.1.smithi156.stdout:7/656: sync 2023-12-16T05:56:38.426 INFO:tasks.workunit.client.1.smithi156.stdout:8/336: write d3/d18/f57 [711146,1506] 0 2023-12-16T05:56:38.429 INFO:tasks.workunit.client.1.smithi156.stdout:8/337: read d3/d18/f39 [2518729,35119] 0 2023-12-16T05:56:38.430 INFO:tasks.workunit.client.0.smithi155.stdout:1/828: dwrite d1/d69/fc1 [0,4194304] 0 2023-12-16T05:56:38.430 INFO:tasks.workunit.client.0.smithi155.stdout:1/829: stat d1/d7/d4b/d8e/dc7/d28/d74/fa3 0 2023-12-16T05:56:38.430 INFO:tasks.workunit.client.0.smithi155.stdout:1/830: symlink d1/d7/d4b/d8e/dc7/d28/d85/de0/d79/l100 0 2023-12-16T05:56:38.430 INFO:tasks.workunit.client.1.smithi156.stdout:1/313: write d3/d1b/d27/f29 [1594196,83948] 0 2023-12-16T05:56:38.430 INFO:tasks.workunit.client.1.smithi156.stdout:1/314: readlink d3/d17/l38 0 2023-12-16T05:56:38.430 INFO:tasks.workunit.client.1.smithi156.stdout:1/315: write d3/d1b/d27/f3e [659745,66211] 0 2023-12-16T05:56:38.431 INFO:tasks.workunit.client.1.smithi156.stdout:1/316: dread - d3/d1b/f40 zero size 2023-12-16T05:56:38.431 INFO:tasks.workunit.client.1.smithi156.stdout:8/338: symlink d3/d7/d62/l69 0 2023-12-16T05:56:38.431 INFO:tasks.workunit.client.1.smithi156.stdout:1/317: creat d3/d17/d4d/f64 x:0 0 0 2023-12-16T05:56:38.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:38 smithi156 ceph-mon[121001]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:56:38.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:38 smithi156 ceph-mon[121001]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:56:38.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:38 smithi156 ceph-mon[121001]: pgmap v15: 65 pgs: 65 active+clean; 1.9 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 124 MiB/s rd, 243 MiB/s wr, 384 op/s 2023-12-16T05:56:38.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:38 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/3192630064' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:56:38.431 INFO:tasks.workunit.client.1.smithi156.stdout:1/318: write d3/d17/d1c/f2b [1973103,11084] 0 2023-12-16T05:56:38.432 INFO:tasks.workunit.client.1.smithi156.stdout:6/441: dwrite d9/f53 [4194304,4194304] 0 2023-12-16T05:56:38.432 INFO:tasks.workunit.client.1.smithi156.stdout:6/442: truncate d9/d1c/d50/f84 390502 0 2023-12-16T05:56:38.432 INFO:tasks.workunit.client.1.smithi156.stdout:8/339: link d3/d6/f36 d3/d7/d9/d3c/f6a 0 2023-12-16T05:56:38.435 INFO:tasks.workunit.client.0.smithi155.stdout:1/831: link d1/d7/d4b/d8e/dc7/d28/d85/de0/d79/daa/cca d1/d25/dc8/c101 0 2023-12-16T05:56:38.435 INFO:tasks.workunit.client.0.smithi155.stdout:1/832: chown d1/d7/d4b/d8e/dc7/d28/d8f/dad/fd7 330368 1 2023-12-16T05:56:38.438 INFO:tasks.workunit.client.0.smithi155.stdout:1/833: mkdir d1/d25/d43/d5d/d102 0 2023-12-16T05:56:38.438 INFO:tasks.workunit.client.0.smithi155.stdout:1/834: readlink d1/d7/d4b/d8e/dc7/d28/d85/l8d 0 2023-12-16T05:56:38.440 INFO:tasks.workunit.client.1.smithi156.stdout:6/443: dread d9/d13/d3e/f6c [0,4194304] 0 2023-12-16T05:56:38.440 INFO:tasks.workunit.client.1.smithi156.stdout:6/444: chown d9/d13/c16 1615 1 2023-12-16T05:56:38.441 INFO:tasks.workunit.client.1.smithi156.stdout:8/340: mkdir d3/d7/d62/d6b 0 2023-12-16T05:56:38.441 INFO:tasks.workunit.client.0.smithi155.stdout:8/741: dread d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/fb3 [0,4194304] 0 2023-12-16T05:56:38.442 INFO:tasks.workunit.client.0.smithi155.stdout:8/742: mkdir d4/dd3/df8 0 2023-12-16T05:56:38.442 INFO:tasks.workunit.client.1.smithi156.stdout:8/341: creat d3/d12/f6c x:0 0 0 2023-12-16T05:56:38.443 INFO:tasks.workunit.client.0.smithi155.stdout:8/743: mkdir d4/d62/d66/d78/d88/d1b/d2a/d51/df9 0 2023-12-16T05:56:38.443 INFO:tasks.workunit.client.0.smithi155.stdout:8/744: readlink d4/d62/d66/d78/d80/lb5 0 2023-12-16T05:56:38.443 INFO:tasks.workunit.client.1.smithi156.stdout:8/342: mknod d3/d7/d62/c6d 0 2023-12-16T05:56:38.443 INFO:tasks.workunit.client.1.smithi156.stdout:8/343: chown d3/d12/d16/d54/f60 3906 1 2023-12-16T05:56:38.444 INFO:tasks.workunit.client.0.smithi155.stdout:8/745: getdents d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/db7 0 2023-12-16T05:56:38.444 INFO:tasks.workunit.client.0.smithi155.stdout:1/835: write d1/d7/d16/f21 [7344286,53733] 0 2023-12-16T05:56:38.444 INFO:tasks.workunit.client.1.smithi156.stdout:8/344: fsync d3/d7/d9/d3c/f6a 0 2023-12-16T05:56:38.445 INFO:tasks.workunit.client.0.smithi155.stdout:1/836: mkdir d1/d7/d4b/d8e/dc7/d28/d8f/db2/d103 0 2023-12-16T05:56:38.446 INFO:tasks.workunit.client.0.smithi155.stdout:1/837: mknod d1/d7/d16/de4/c104 0 2023-12-16T05:56:38.447 INFO:tasks.workunit.client.1.smithi156.stdout:1/319: dwrite d3/f18 [0,4194304] 0 2023-12-16T05:56:38.449 INFO:tasks.workunit.client.1.smithi156.stdout:1/320: creat d3/d1b/d27/d4f/f65 x:0 0 0 2023-12-16T05:56:38.450 INFO:tasks.workunit.client.1.smithi156.stdout:1/321: symlink d3/d17/d1c/d22/d57/d61/l66 0 2023-12-16T05:56:38.450 INFO:tasks.workunit.client.1.smithi156.stdout:1/322: stat d3/d17/d4d/f64 0 2023-12-16T05:56:38.450 INFO:tasks.workunit.client.1.smithi156.stdout:1/323: chown d3/d17/d2d/c36 12 1 2023-12-16T05:56:38.455 INFO:tasks.workunit.client.1.smithi156.stdout:1/324: truncate d3/d17/f60 2662137 0 2023-12-16T05:56:38.456 INFO:tasks.workunit.client.1.smithi156.stdout:1/325: dread - d3/d1b/d27/d4f/f65 zero size 2023-12-16T05:56:38.456 INFO:tasks.workunit.client.1.smithi156.stdout:1/326: fdatasync d3/f18 0 2023-12-16T05:56:38.457 INFO:tasks.workunit.client.1.smithi156.stdout:1/327: getdents d3/d17/d1c/d22/d57 0 2023-12-16T05:56:38.457 INFO:tasks.workunit.client.1.smithi156.stdout:1/328: read d3/d1b/d27/f34 [135492,6643] 0 2023-12-16T05:56:38.458 INFO:tasks.workunit.client.1.smithi156.stdout:1/329: write d3/d1b/d27/f34 [629978,84786] 0 2023-12-16T05:56:38.458 INFO:tasks.workunit.client.1.smithi156.stdout:1/330: chown d3/d17/c24 7 1 2023-12-16T05:56:38.464 INFO:tasks.workunit.client.1.smithi156.stdout:8/345: dwrite d3/d12/f6c [0,4194304] 0 2023-12-16T05:56:38.465 INFO:tasks.workunit.client.0.smithi155.stdout:8/746: dwrite d4/dd3/fea [0,4194304] 0 2023-12-16T05:56:38.465 INFO:tasks.workunit.client.0.smithi155.stdout:8/747: write d4/d62/d66/d78/d88/d1b/d1c/d1a/fd1 [58489,79699] 0 2023-12-16T05:56:38.465 INFO:tasks.workunit.client.0.smithi155.stdout:8/748: chown d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/f72 4629 1 2023-12-16T05:56:38.465 INFO:tasks.workunit.client.0.smithi155.stdout:8/749: chown d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/f60 24315347 1 2023-12-16T05:56:38.465 INFO:tasks.workunit.client.0.smithi155.stdout:8/750: fdatasync d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/fe3 0 2023-12-16T05:56:38.468 INFO:tasks.workunit.client.1.smithi156.stdout:8/346: rename d3/d7/d9 to d3/d7/d27/d46/d6e 0 2023-12-16T05:56:38.474 INFO:tasks.workunit.client.1.smithi156.stdout:8/347: dread d3/d6/f36 [8388608,4194304] 0 2023-12-16T05:56:38.481 INFO:tasks.workunit.client.1.smithi156.stdout:8/348: dread d3/f5b [0,4194304] 0 2023-12-16T05:56:38.481 INFO:tasks.workunit.client.1.smithi156.stdout:6/445: write d9/d13/f3d [2044423,113222] 0 2023-12-16T05:56:38.483 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:38 smithi155 ceph-mon[112451]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:56:38.483 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:38 smithi155 ceph-mon[112451]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:56:38.483 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:38 smithi155 ceph-mon[112451]: pgmap v15: 65 pgs: 65 active+clean; 1.9 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 124 MiB/s rd, 243 MiB/s wr, 384 op/s 2023-12-16T05:56:38.483 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:38 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/3192630064' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:56:38.488 INFO:tasks.workunit.client.0.smithi155.stdout:1/838: write d1/d7/d4b/d8e/dc7/d28/d74/fbf [198619,56435] 0 2023-12-16T05:56:38.490 INFO:tasks.workunit.client.1.smithi156.stdout:1/331: dwrite d3/d17/d19/f20 [0,4194304] 0 2023-12-16T05:56:38.491 INFO:tasks.workunit.client.1.smithi156.stdout:7/657: dwrite d1e/d55/f9e [0,4194304] 0 2023-12-16T05:56:38.491 INFO:tasks.workunit.client.1.smithi156.stdout:6/446: dread f8 [0,4194304] 0 2023-12-16T05:56:38.491 INFO:tasks.workunit.client.1.smithi156.stdout:6/447: fsync d9/d1c/f49 0 2023-12-16T05:56:38.491 INFO:tasks.workunit.client.1.smithi156.stdout:6/448: fsync d9/d1c/f2b 0 2023-12-16T05:56:38.492 INFO:tasks.workunit.client.0.smithi155.stdout:1/839: creat d1/d7/d4b/d8e/dc7/d28/d8f/f105 x:0 0 0 2023-12-16T05:56:38.492 INFO:tasks.workunit.client.0.smithi155.stdout:1/840: dread - d1/d7/d4b/d8e/dc7/d28/d85/ffd zero size 2023-12-16T05:56:38.492 INFO:tasks.workunit.client.1.smithi156.stdout:1/332: creat d3/d1b/d27/f67 x:0 0 0 2023-12-16T05:56:38.493 INFO:tasks.workunit.client.0.smithi155.stdout:1/841: write d1/d7/d4b/d8e/dc7/d28/d85/de0/f7d [2951400,56325] 0 2023-12-16T05:56:38.495 INFO:tasks.workunit.client.1.smithi156.stdout:8/349: dwrite d3/d12/d16/f2d [12582912,4194304] 0 2023-12-16T05:56:38.495 INFO:tasks.workunit.client.1.smithi156.stdout:8/350: read - d3/d18/f64 zero size 2023-12-16T05:56:38.495 INFO:tasks.workunit.client.1.smithi156.stdout:8/351: fdatasync d3/d6/f36 0 2023-12-16T05:56:38.496 INFO:tasks.workunit.client.0.smithi155.stdout:1/842: symlink d1/d7/d4b/d8e/dc7/d28/d85/de0/d79/l106 0 2023-12-16T05:56:38.496 INFO:tasks.workunit.client.1.smithi156.stdout:6/449: mkdir d9/d13/d2f/d51/d82/d89 0 2023-12-16T05:56:38.496 INFO:tasks.workunit.client.1.smithi156.stdout:6/450: fsync d9/d13/d2f/d36/f63 0 2023-12-16T05:56:38.497 INFO:tasks.workunit.client.1.smithi156.stdout:6/451: dread d9/f11 [0,4194304] 0 2023-12-16T05:56:38.500 INFO:tasks.workunit.client.1.smithi156.stdout:6/452: truncate d9/d13/f20 2368550 0 2023-12-16T05:56:38.500 INFO:tasks.workunit.client.1.smithi156.stdout:6/453: fdatasync d9/d13/d2f/d36/f65 0 2023-12-16T05:56:38.504 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.501+0000 7fcbd955f700 1 -- 172.21.15.155:0/4060067773 --> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbd410a1d0 con 0x7fcbbc06af10 2023-12-16T05:56:38.506 INFO:tasks.workunit.client.0.smithi155.stdout:1/843: dread d1/d7/d4b/f50 [0,4194304] 0 2023-12-16T05:56:38.507 INFO:tasks.workunit.client.1.smithi156.stdout:8/352: write d3/d18/f57 [437527,45016] 0 2023-12-16T05:56:38.507 INFO:tasks.workunit.client.1.smithi156.stdout:8/353: readlink d3/l44 0 2023-12-16T05:56:38.509 INFO:tasks.workunit.client.1.smithi156.stdout:8/354: mknod d3/d7/d27/d46/d6e/c6f 0 2023-12-16T05:56:38.509 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T05:56:38.509 INFO:teuthology.orchestra.run.smithi155.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T05:56:38.510 INFO:teuthology.orchestra.run.smithi155.stdout: "in_progress": true, 2023-12-16T05:56:38.510 INFO:teuthology.orchestra.run.smithi155.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T05:56:38.510 INFO:teuthology.orchestra.run.smithi155.stdout: "services_complete": [], 2023-12-16T05:56:38.510 INFO:teuthology.orchestra.run.smithi155.stdout: "progress": "1/2 daemons upgraded", 2023-12-16T05:56:38.510 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "", 2023-12-16T05:56:38.510 INFO:teuthology.orchestra.run.smithi155.stdout: "is_paused": false 2023-12-16T05:56:38.510 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T05:56:38.511 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.505+0000 7fcbbb7fe700 1 -- 172.21.15.155:0/4060067773 <== mgr.24363 v2:172.21.15.156:6828/1939402353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fcbd410a1d0 con 0x7fcbbc06af10 2023-12-16T05:56:38.511 INFO:tasks.workunit.client.0.smithi155.stdout:3/538: sync 2023-12-16T05:56:38.512 INFO:tasks.workunit.client.1.smithi156.stdout:7/658: dwrite d1e/f8c [4194304,4194304] 0 2023-12-16T05:56:38.512 INFO:tasks.workunit.client.1.smithi156.stdout:7/659: mkdir d1e/dbf/de9 0 2023-12-16T05:56:38.513 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.510+0000 7fcbd955f700 1 -- 172.21.15.155:0/4060067773 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7fcbbc06af10 msgr2=0x7fcbbc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:38.513 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.510+0000 7fcbd955f700 1 --2- 172.21.15.155:0/4060067773 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7fcbbc06af10 0x7fcbbc06d3c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4113970 tx=0x7fcbc4009e30 comp rx=0 tx=0).stop 2023-12-16T05:56:38.513 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.510+0000 7fcbd955f700 1 -- 172.21.15.155:0/4060067773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbd4114120 msgr2=0x7fcbd4115010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:56:38.513 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.510+0000 7fcbd955f700 1 --2- 172.21.15.155:0/4060067773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbd4114120 0x7fcbd4115010 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80041d0 tx=0x7fcbc800b040 comp rx=0 tx=0).stop 2023-12-16T05:56:38.513 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.510+0000 7fcbd955f700 1 -- 172.21.15.155:0/4060067773 shutdown_connections 2023-12-16T05:56:38.514 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.510+0000 7fcbd955f700 1 --2- 172.21.15.155:0/4060067773 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7fcbbc06af10 0x7fcbbc06d3c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:38.514 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.510+0000 7fcbd955f700 1 --2- 172.21.15.155:0/4060067773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcbd4106600 0x7fcbd4113be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:38.514 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.510+0000 7fcbd955f700 1 --2- 172.21.15.155:0/4060067773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbd4114120 0x7fcbd4115010 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:56:38.514 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.510+0000 7fcbd955f700 1 -- 172.21.15.155:0/4060067773 >> 172.21.15.155:0/4060067773 conn(0x7fcbd406bdc0 msgr2=0x7fcbd4107820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:56:38.514 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.510+0000 7fcbd955f700 1 -- 172.21.15.155:0/4060067773 shutdown_connections 2023-12-16T05:56:38.514 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:56:38.510+0000 7fcbd955f700 1 -- 172.21.15.155:0/4060067773 wait complete. 2023-12-16T05:56:38.521 INFO:tasks.workunit.client.1.smithi156.stdout:7/660: dread d1e/d1f/da6/fcf [0,4194304] 0 2023-12-16T05:56:38.524 INFO:tasks.workunit.client.1.smithi156.stdout:6/454: dwrite d9/d1c/f3a [0,4194304] 0 2023-12-16T05:56:38.524 INFO:tasks.workunit.client.1.smithi156.stdout:6/455: readlink d9/d1c/l5e 0 2023-12-16T05:56:38.526 INFO:tasks.workunit.client.1.smithi156.stdout:7/661: mkdir d1e/d55/d71/d94/dea 0 2023-12-16T05:56:38.526 INFO:tasks.workunit.client.0.smithi155.stdout:3/539: dread d0/fb [0,4194304] 0 2023-12-16T05:56:38.528 INFO:tasks.workunit.client.0.smithi155.stdout:3/540: symlink d0/d14/d36/d83/la4 0 2023-12-16T05:56:38.529 INFO:tasks.workunit.client.1.smithi156.stdout:7/662: read d1e/d55/d71/d61/daa/f84 [2405231,32164] 0 2023-12-16T05:56:38.529 INFO:tasks.workunit.client.0.smithi155.stdout:3/541: symlink d0/d14/d9d/la5 0 2023-12-16T05:56:38.532 INFO:tasks.workunit.client.0.smithi155.stdout:1/844: dwrite d1/d7/d4b/d8e/dc7/d28/d85/fe1 [0,4194304] 0 2023-12-16T05:56:38.534 INFO:tasks.workunit.client.0.smithi155.stdout:1/845: symlink d1/d7/d4b/de3/l107 0 2023-12-16T05:56:38.535 INFO:tasks.workunit.client.0.smithi155.stdout:1/846: creat d1/d7/d4b/d5c/f108 x:0 0 0 2023-12-16T05:56:38.536 INFO:tasks.workunit.client.0.smithi155.stdout:1/847: symlink d1/d92/l109 0 2023-12-16T05:56:38.539 INFO:tasks.workunit.client.1.smithi156.stdout:7/663: dread d1e/d1f/da6/f4d [0,4194304] 0 2023-12-16T05:56:38.541 INFO:tasks.workunit.client.1.smithi156.stdout:7/664: creat d1e/d55/db6/ddb/feb x:0 0 0 2023-12-16T05:56:38.542 INFO:tasks.workunit.client.1.smithi156.stdout:7/665: creat d1e/d55/dba/fec x:0 0 0 2023-12-16T05:56:38.545 INFO:tasks.workunit.client.1.smithi156.stdout:7/666: mknod d1e/ced 0 2023-12-16T05:56:38.547 INFO:tasks.workunit.client.1.smithi156.stdout:7/667: rename d1e/d1f/da6/fcf to d1e/dbf/fee 0 2023-12-16T05:56:38.547 INFO:tasks.workunit.client.1.smithi156.stdout:7/668: fsync d1e/d55/d71/d61/dac/fb0 0 2023-12-16T05:56:38.548 INFO:tasks.workunit.client.1.smithi156.stdout:6/456: dwrite d9/d13/f20 [0,4194304] 0 2023-12-16T05:56:38.548 INFO:tasks.workunit.client.1.smithi156.stdout:7/669: mknod d1e/d39/d93/cef 0 2023-12-16T05:56:38.550 INFO:tasks.workunit.client.0.smithi155.stdout:3/542: dread d0/d14/f50 [0,4194304] 0 2023-12-16T05:56:38.551 INFO:tasks.workunit.client.1.smithi156.stdout:6/457: read d9/d13/f17 [607757,403] 0 2023-12-16T05:56:38.551 INFO:tasks.workunit.client.1.smithi156.stdout:6/458: chown f5 21682 1 2023-12-16T05:56:38.551 INFO:tasks.workunit.client.1.smithi156.stdout:7/670: symlink d1e/d39/d93/lf0 0 2023-12-16T05:56:38.552 INFO:tasks.workunit.client.0.smithi155.stdout:3/543: creat d0/d14/d36/fa6 x:0 0 0 2023-12-16T05:56:38.554 INFO:tasks.workunit.client.1.smithi156.stdout:7/671: unlink d1e/d1f/d22/l3c 0 2023-12-16T05:56:38.555 INFO:tasks.workunit.client.1.smithi156.stdout:6/459: write d9/f15 [1970886,110092] 0 2023-12-16T05:56:38.557 INFO:tasks.workunit.client.1.smithi156.stdout:9/483: sync 2023-12-16T05:56:38.557 INFO:tasks.workunit.client.1.smithi156.stdout:5/646: sync 2023-12-16T05:56:38.557 INFO:tasks.workunit.client.1.smithi156.stdout:5/647: chown da/d46/l6e 17 1 2023-12-16T05:56:38.558 INFO:tasks.workunit.client.1.smithi156.stdout:3/376: sync 2023-12-16T05:56:38.558 INFO:tasks.workunit.client.1.smithi156.stdout:3/377: fsync fb 0 2023-12-16T05:56:38.559 INFO:tasks.workunit.client.1.smithi156.stdout:5/648: unlink da/dc/d2d/d4d/d54/c6f 0 2023-12-16T05:56:38.560 INFO:tasks.workunit.client.1.smithi156.stdout:9/484: creat d6/d19/d30/d48/fa4 x:0 0 0 2023-12-16T05:56:38.562 INFO:tasks.workunit.client.1.smithi156.stdout:3/378: truncate dc/df/d34/f63 1474075 0 2023-12-16T05:56:38.564 INFO:tasks.workunit.client.1.smithi156.stdout:9/485: stat d6/c4f 0 2023-12-16T05:56:38.564 INFO:tasks.workunit.client.1.smithi156.stdout:5/649: truncate da/d46/f4f 49771 0 2023-12-16T05:56:38.565 INFO:tasks.workunit.client.1.smithi156.stdout:3/379: rmdir dc/df 39 2023-12-16T05:56:38.566 INFO:tasks.workunit.client.0.smithi155.stdout:3/544: dread d0/f2e [0,4194304] 0 2023-12-16T05:56:38.566 INFO:tasks.workunit.client.0.smithi155.stdout:3/545: chown d0/d14/d36/c48 58 1 2023-12-16T05:56:38.568 INFO:tasks.workunit.client.1.smithi156.stdout:9/486: mkdir d6/d2e/d8a/da5 0 2023-12-16T05:56:38.568 INFO:tasks.workunit.client.1.smithi156.stdout:9/487: stat d6/d19/d25/c94 0 2023-12-16T05:56:38.568 INFO:tasks.workunit.client.1.smithi156.stdout:9/488: read - d6/d19/d25/d3a/d5e/f7b zero size 2023-12-16T05:56:38.568 INFO:tasks.workunit.client.1.smithi156.stdout:9/489: chown d6/d19/d25/f38 1 1 2023-12-16T05:56:38.568 INFO:tasks.workunit.client.1.smithi156.stdout:9/490: chown d6/d19/d25/d3a/d5e/f68 0 1 2023-12-16T05:56:38.568 INFO:tasks.workunit.client.1.smithi156.stdout:9/491: chown d6/d2e/l97 25342173 1 2023-12-16T05:56:38.568 INFO:tasks.workunit.client.1.smithi156.stdout:5/650: fsync da/dc/d4b/d6c/f92 0 2023-12-16T05:56:38.568 INFO:tasks.workunit.client.0.smithi155.stdout:3/546: truncate d0/d14/f50 2597249 0 2023-12-16T05:56:38.569 INFO:tasks.workunit.client.0.smithi155.stdout:3/547: mkdir d0/d14/d36/d47/da7 0 2023-12-16T05:56:38.570 INFO:tasks.workunit.client.1.smithi156.stdout:3/380: symlink dc/d56/d67/d6e/l94 0 2023-12-16T05:56:38.570 INFO:tasks.workunit.client.0.smithi155.stdout:3/548: chown d0/d1a/c66 11151196 1 2023-12-16T05:56:38.571 INFO:tasks.workunit.client.0.smithi155.stdout:1/848: dwrite d1/d7/d4b/d8e/dc7/fa5 [0,4194304] 0 2023-12-16T05:56:38.571 INFO:tasks.workunit.client.1.smithi156.stdout:9/492: chown d6/f46 31 1 2023-12-16T05:56:38.572 INFO:tasks.workunit.client.1.smithi156.stdout:7/672: rmdir d1e/d55/db6/ddb 39 2023-12-16T05:56:38.572 INFO:tasks.workunit.client.1.smithi156.stdout:7/673: write d1e/d55/d71/fe8 [965962,6356] 0 2023-12-16T05:56:38.572 INFO:tasks.workunit.client.1.smithi156.stdout:7/674: chown d1e/d55/d71/d61/l46 175747 1 2023-12-16T05:56:38.573 INFO:tasks.workunit.client.0.smithi155.stdout:1/849: mkdir d1/d7/d4b/d10a 0 2023-12-16T05:56:38.573 INFO:tasks.workunit.client.1.smithi156.stdout:7/675: write f9 [2460251,17663] 0 2023-12-16T05:56:38.574 INFO:tasks.workunit.client.1.smithi156.stdout:6/460: dwrite d9/d13/d2f/d36/f5a [0,4194304] 0 2023-12-16T05:56:38.574 INFO:tasks.workunit.client.1.smithi156.stdout:6/461: stat d9/d13/d2f/d51/d6b/d77/d7e 0 2023-12-16T05:56:38.574 INFO:tasks.workunit.client.1.smithi156.stdout:5/651: mknod da/dc/d2d/d4d/d54/d90/cd1 0 2023-12-16T05:56:38.576 INFO:tasks.workunit.client.1.smithi156.stdout:3/381: rmdir dc/d56/d69 39 2023-12-16T05:56:38.580 INFO:tasks.workunit.client.1.smithi156.stdout:7/676: mknod d1e/d55/d71/d94/cf1 0 2023-12-16T05:56:38.580 INFO:tasks.workunit.client.1.smithi156.stdout:7/677: read - d1e/d55/db6/ddb/feb zero size 2023-12-16T05:56:38.580 INFO:tasks.workunit.client.1.smithi156.stdout:7/678: chown d1e/d55/d71/d61/daa/c70 65 1 2023-12-16T05:56:38.580 INFO:tasks.workunit.client.1.smithi156.stdout:7/679: readlink d1e/d55/dba/lc1 0 2023-12-16T05:56:38.584 INFO:tasks.workunit.client.1.smithi156.stdout:6/462: symlink d9/d13/d2f/d51/d69/l8a 0 2023-12-16T05:56:38.586 INFO:tasks.workunit.client.1.smithi156.stdout:5/652: rename da/d46/l9c to da/d46/ld2 0 2023-12-16T05:56:38.587 INFO:tasks.workunit.client.0.smithi155.stdout:3/549: dwrite d0/d1e/f59 [0,4194304] 0 2023-12-16T05:56:38.588 INFO:tasks.workunit.client.0.smithi155.stdout:3/550: mkdir d0/d14/d36/d83/da8 0 2023-12-16T05:56:38.591 INFO:tasks.workunit.client.1.smithi156.stdout:9/493: unlink d6/f14 0 2023-12-16T05:56:38.593 INFO:tasks.workunit.client.1.smithi156.stdout:6/463: creat d9/d13/d2f/d51/d6b/d77/f8b x:0 0 0 2023-12-16T05:56:38.594 INFO:tasks.workunit.client.1.smithi156.stdout:5/653: mknod da/dc/d2d/db0/cd3 0 2023-12-16T05:56:38.594 INFO:tasks.workunit.client.1.smithi156.stdout:5/654: chown da/f42 17889070 1 2023-12-16T05:56:38.594 INFO:tasks.workunit.client.1.smithi156.stdout:5/655: stat f0 0 2023-12-16T05:56:38.598 INFO:tasks.workunit.client.1.smithi156.stdout:5/656: creat da/dc/d4b/d6c/d7c/d85/fd4 x:0 0 0 2023-12-16T05:56:38.603 INFO:tasks.workunit.client.1.smithi156.stdout:7/680: dwrite d1e/d1f/da6/d57/f86 [0,4194304] 0 2023-12-16T05:56:38.604 INFO:tasks.workunit.client.1.smithi156.stdout:7/681: getdents d1e/d1f/d22 0 2023-12-16T05:56:38.605 INFO:tasks.workunit.client.1.smithi156.stdout:3/382: dwrite dc/d10/f7e [0,4194304] 0 2023-12-16T05:56:38.606 INFO:tasks.workunit.client.1.smithi156.stdout:7/682: mkdir d1e/d1f/d72/da4/df2 0 2023-12-16T05:56:38.606 INFO:tasks.workunit.client.1.smithi156.stdout:7/683: fsync d1e/d1f/da6/d57/dca/fd3 0 2023-12-16T05:56:38.609 INFO:tasks.workunit.client.1.smithi156.stdout:3/383: creat dc/d10/d3d/f95 x:0 0 0 2023-12-16T05:56:38.609 INFO:tasks.workunit.client.1.smithi156.stdout:3/384: read - dc/d56/d67/f6f zero size 2023-12-16T05:56:38.609 INFO:tasks.workunit.client.1.smithi156.stdout:3/385: dread - dc/d56/f83 zero size 2023-12-16T05:56:38.610 INFO:tasks.workunit.client.1.smithi156.stdout:7/684: mknod d1e/d55/d71/d61/cf3 0 2023-12-16T05:56:38.616 INFO:tasks.workunit.client.1.smithi156.stdout:9/494: dwrite d6/d19/f37 [0,4194304] 0 2023-12-16T05:56:38.616 INFO:tasks.workunit.client.1.smithi156.stdout:9/495: chown d6/d19/d25/d3a/d88/d8b 4344208 1 2023-12-16T05:56:38.617 INFO:tasks.workunit.client.1.smithi156.stdout:3/386: dread dc/f23 [0,4194304] 0 2023-12-16T05:56:38.619 INFO:tasks.workunit.client.1.smithi156.stdout:6/464: rmdir d9/d13/d2f 39 2023-12-16T05:56:38.619 INFO:tasks.workunit.client.1.smithi156.stdout:6/465: fdatasync d9/d13/d2f/d36/f79 0 2023-12-16T05:56:38.620 INFO:tasks.workunit.client.1.smithi156.stdout:9/496: creat d6/d19/d25/fa6 x:0 0 0 2023-12-16T05:56:38.620 INFO:tasks.workunit.client.1.smithi156.stdout:9/497: write d6/d19/d25/f4c [1196344,122050] 0 2023-12-16T05:56:38.621 INFO:tasks.workunit.client.1.smithi156.stdout:3/387: mkdir dc/df/d70/d96 0 2023-12-16T05:56:38.623 INFO:tasks.workunit.client.1.smithi156.stdout:9/498: creat d6/d19/d30/d95/fa7 x:0 0 0 2023-12-16T05:56:38.623 INFO:tasks.workunit.client.1.smithi156.stdout:5/657: dwrite da/dc/d2d/d4d/fbd [0,4194304] 0 2023-12-16T05:56:38.623 INFO:tasks.workunit.client.1.smithi156.stdout:6/466: fsync d9/d13/d2f/f68 0 2023-12-16T05:56:38.623 INFO:tasks.workunit.client.1.smithi156.stdout:6/467: fsync d9/f67 0 2023-12-16T05:56:38.625 INFO:tasks.workunit.client.1.smithi156.stdout:3/388: symlink dc/df/d34/l97 0 2023-12-16T05:56:38.628 INFO:tasks.workunit.client.1.smithi156.stdout:5/658: creat da/dc/d2d/d4d/d54/fd5 x:0 0 0 2023-12-16T05:56:38.630 INFO:tasks.workunit.client.1.smithi156.stdout:6/468: creat d9/d13/d2f/d51/d6b/d77/d7e/f8c x:0 0 0 2023-12-16T05:56:38.630 INFO:tasks.workunit.client.1.smithi156.stdout:6/469: truncate d9/d13/d2f/d36/f63 1619086 0 2023-12-16T05:56:38.630 INFO:tasks.workunit.client.1.smithi156.stdout:6/470: write d9/d1c/f46 [276171,95897] 0 2023-12-16T05:56:38.630 INFO:tasks.workunit.client.1.smithi156.stdout:6/471: chown d9/f35 9 1 2023-12-16T05:56:38.630 INFO:tasks.workunit.client.1.smithi156.stdout:3/389: rmdir dc/d10/d1d/d4b/d52 39 2023-12-16T05:56:38.631 INFO:tasks.workunit.client.1.smithi156.stdout:5/659: creat da/dc/d2d/d34/fd6 x:0 0 0 2023-12-16T05:56:38.631 INFO:tasks.workunit.client.1.smithi156.stdout:5/660: chown da/dc/d2d/d4d/d54/da6 993310630 1 2023-12-16T05:56:38.633 INFO:tasks.workunit.client.1.smithi156.stdout:6/472: creat d9/f8d x:0 0 0 2023-12-16T05:56:38.633 INFO:tasks.workunit.client.1.smithi156.stdout:5/661: creat da/dc/d2d/d34/fd7 x:0 0 0 2023-12-16T05:56:38.637 INFO:tasks.workunit.client.1.smithi156.stdout:5/662: creat da/dc/d4b/d6c/d81/fd8 x:0 0 0 2023-12-16T05:56:38.638 INFO:tasks.workunit.client.1.smithi156.stdout:5/663: dread - da/dc/d2d/d4d/d54/d67/fc1 zero size 2023-12-16T05:56:38.638 INFO:tasks.workunit.client.1.smithi156.stdout:5/664: fsync da/dc/f19 0 2023-12-16T05:56:38.638 INFO:tasks.workunit.client.1.smithi156.stdout:5/665: creat da/dc/d4b/d6c/fd9 x:0 0 0 2023-12-16T05:56:38.638 INFO:tasks.workunit.client.1.smithi156.stdout:3/390: dread dc/d10/f18 [0,4194304] 0 2023-12-16T05:56:38.638 INFO:tasks.workunit.client.1.smithi156.stdout:3/391: symlink dc/d10/l98 0 2023-12-16T05:56:38.639 INFO:tasks.workunit.client.1.smithi156.stdout:5/666: rename da/dc/d4b/d6c/fa8 to da/dc/d2d/d34/fda 0 2023-12-16T05:56:38.640 INFO:tasks.workunit.client.1.smithi156.stdout:6/473: dread d9/d13/d2f/d36/f55 [0,4194304] 0 2023-12-16T05:56:38.640 INFO:tasks.workunit.client.1.smithi156.stdout:6/474: chown d9/d1c/c37 6402533 1 2023-12-16T05:56:38.641 INFO:tasks.workunit.client.1.smithi156.stdout:6/475: mkdir d9/d13/d2f/d51/d82/d89/d8e 0 2023-12-16T05:56:38.642 INFO:tasks.workunit.client.1.smithi156.stdout:6/476: creat d9/d13/d2f/d51/d82/f8f x:0 0 0 2023-12-16T05:56:38.643 INFO:tasks.workunit.client.1.smithi156.stdout:6/477: creat d9/d13/d2f/d51/f90 x:0 0 0 2023-12-16T05:56:38.644 INFO:tasks.workunit.client.1.smithi156.stdout:6/478: link d9/d1c/f6a d9/d13/d2f/d51/f91 0 2023-12-16T05:56:38.644 INFO:tasks.workunit.client.1.smithi156.stdout:6/479: stat d9/d1c/f2b 0 2023-12-16T05:56:38.645 INFO:tasks.workunit.client.1.smithi156.stdout:6/480: unlink d9/d1c/l2a 0 2023-12-16T05:56:38.649 INFO:tasks.workunit.client.1.smithi156.stdout:5/667: dread f4 [0,4194304] 0 2023-12-16T05:56:38.650 INFO:tasks.workunit.client.1.smithi156.stdout:5/668: rename da/dc/d2d/d4d/d54/d67/fc1 to da/dc/d2d/d4d/d54/d90/fdb 0 2023-12-16T05:56:38.657 INFO:tasks.workunit.client.1.smithi156.stdout:5/669: dread da/dc/d2d/d4d/d54/d90/fab [0,4194304] 0 2023-12-16T05:56:38.657 INFO:tasks.workunit.client.1.smithi156.stdout:5/670: chown da/dc/d2d/f3c 24661897 1 2023-12-16T05:56:38.662 INFO:tasks.workunit.client.1.smithi156.stdout:6/481: dwrite d9/d13/f17 [0,4194304] 0 2023-12-16T05:56:38.672 INFO:tasks.workunit.client.1.smithi156.stdout:5/671: dwrite da/dc/d2d/d4d/d54/d90/fab [0,4194304] 0 2023-12-16T05:56:38.673 INFO:tasks.workunit.client.1.smithi156.stdout:5/672: stat da/dc/d2d/d4d/d54/da6 0 2023-12-16T05:56:38.673 INFO:tasks.workunit.client.1.smithi156.stdout:5/673: dread - da/dc/d2d/fd0 zero size 2023-12-16T05:56:38.684 INFO:tasks.workunit.client.1.smithi156.stdout:7/685: dwrite d1e/d1f/d22/d75/d77/fb1 [0,4194304] 0 2023-12-16T05:56:38.690 INFO:tasks.workunit.client.1.smithi156.stdout:7/686: mkdir d1e/d1f/d72/df4 0 2023-12-16T05:56:38.691 INFO:tasks.workunit.client.1.smithi156.stdout:7/687: fsync d1e/d1f/da6/f6c 0 2023-12-16T05:56:38.692 INFO:tasks.workunit.client.1.smithi156.stdout:7/688: rename d1e/d39/d93 to d1e/d55/d71/df5 0 2023-12-16T05:56:38.692 INFO:tasks.workunit.client.1.smithi156.stdout:7/689: fdatasync d1e/d1f/d22/d75/fa9 0 2023-12-16T05:56:38.693 INFO:tasks.workunit.client.1.smithi156.stdout:7/690: mknod d1e/d55/d71/d61/cf6 0 2023-12-16T05:56:38.694 INFO:tasks.workunit.client.1.smithi156.stdout:6/482: dwrite d9/d13/d2f/d51/d6b/d77/f8b [0,4194304] 0 2023-12-16T05:56:38.694 INFO:tasks.workunit.client.1.smithi156.stdout:5/674: dwrite da/d9a/fc4 [0,4194304] 0 2023-12-16T05:56:38.695 INFO:tasks.workunit.client.1.smithi156.stdout:7/691: rename d1e/ca2 to d1e/d1f/cf7 0 2023-12-16T05:56:38.700 INFO:tasks.workunit.client.1.smithi156.stdout:5/675: symlink da/dc/d4b/d6c/ldc 0 2023-12-16T05:56:38.701 INFO:tasks.workunit.client.1.smithi156.stdout:5/676: truncate da/dc/f13 1992278 0 2023-12-16T05:56:38.701 INFO:tasks.workunit.client.1.smithi156.stdout:5/677: readlink da/dc/d2d/d9b/lbe 0 2023-12-16T05:56:38.702 INFO:tasks.workunit.client.1.smithi156.stdout:5/678: creat da/dc/d2d/d4d/db9/dc9/fdd x:0 0 0 2023-12-16T05:56:38.704 INFO:tasks.workunit.client.1.smithi156.stdout:5/679: symlink da/dc/d2d/d34/lde 0 2023-12-16T05:56:38.712 INFO:tasks.workunit.client.1.smithi156.stdout:5/680: dread da/dc/d2d/d4d/d54/d90/fab [0,4194304] 0 2023-12-16T05:56:38.712 INFO:tasks.workunit.client.1.smithi156.stdout:5/681: dread - da/dc/d4b/d6c/d7c/fcb zero size 2023-12-16T05:56:38.714 INFO:tasks.workunit.client.1.smithi156.stdout:6/483: dwrite d9/d13/d2f/d51/d6b/d77/d7e/f8c [0,4194304] 0 2023-12-16T05:56:38.719 INFO:tasks.workunit.client.1.smithi156.stdout:6/484: rmdir d9/d1c/d78 0 2023-12-16T05:56:38.719 INFO:tasks.workunit.client.1.smithi156.stdout:6/485: read d9/d13/d3e/f6c [2033652,124546] 0 2023-12-16T05:56:38.720 INFO:tasks.workunit.client.1.smithi156.stdout:6/486: chown d9/d13/d3e/f6c 175 1 2023-12-16T05:56:38.720 INFO:tasks.workunit.client.0.smithi155.stdout:0/704: sync 2023-12-16T05:56:38.720 INFO:tasks.workunit.client.0.smithi155.stdout:4/674: sync 2023-12-16T05:56:38.720 INFO:tasks.workunit.client.0.smithi155.stdout:2/671: sync 2023-12-16T05:56:38.720 INFO:tasks.workunit.client.0.smithi155.stdout:2/672: fdatasync d0/f3d 0 2023-12-16T05:56:38.720 INFO:tasks.workunit.client.0.smithi155.stdout:0/705: readlink d7/df/d41/d23/l52 0 2023-12-16T05:56:38.720 INFO:tasks.workunit.client.0.smithi155.stdout:0/706: chown d7/df/d73/d8d/d4d/de8/lbb 1072295 1 2023-12-16T05:56:38.721 INFO:tasks.workunit.client.0.smithi155.stdout:2/673: creat d0/d7/dd/d62/fdd x:0 0 0 2023-12-16T05:56:38.722 INFO:tasks.workunit.client.0.smithi155.stdout:0/707: symlink d7/df/d6f/le9 0 2023-12-16T05:56:38.722 INFO:tasks.workunit.client.0.smithi155.stdout:0/708: dread - d7/df/d73/dba/fca zero size 2023-12-16T05:56:38.722 INFO:tasks.workunit.client.0.smithi155.stdout:2/674: creat d0/d7/d1f/d74/fde x:0 0 0 2023-12-16T05:56:38.723 INFO:tasks.workunit.client.0.smithi155.stdout:0/709: mknod d7/df/d73/dba/cea 0 2023-12-16T05:56:38.725 INFO:tasks.workunit.client.0.smithi155.stdout:2/675: link d0/d34/d3c/c4c d0/d34/cdf 0 2023-12-16T05:56:38.726 INFO:tasks.workunit.client.0.smithi155.stdout:0/710: unlink d7/da4/fdb 0 2023-12-16T05:56:38.727 INFO:tasks.workunit.client.0.smithi155.stdout:2/676: symlink d0/d7/dd/d49/d4b/d8c/le0 0 2023-12-16T05:56:38.727 INFO:tasks.workunit.client.1.smithi156.stdout:6/487: dread d9/f35 [0,4194304] 0 2023-12-16T05:56:38.727 INFO:tasks.workunit.client.1.smithi156.stdout:5/682: dwrite da/f52 [0,4194304] 0 2023-12-16T05:56:38.728 INFO:tasks.workunit.client.0.smithi155.stdout:0/711: dread d7/df/d41/f77 [0,4194304] 0 2023-12-16T05:56:38.728 INFO:tasks.workunit.client.0.smithi155.stdout:2/677: creat d0/d7/d57/d95/fe1 x:0 0 0 2023-12-16T05:56:38.729 INFO:tasks.workunit.client.1.smithi156.stdout:5/683: write f4 [1283084,23757] 0 2023-12-16T05:56:38.729 INFO:tasks.workunit.client.0.smithi155.stdout:0/712: symlink d7/df/d41/d23/de1/leb 0 2023-12-16T05:56:38.730 INFO:tasks.workunit.client.1.smithi156.stdout:6/488: write d9/d13/f3d [4099921,14700] 0 2023-12-16T05:56:38.730 INFO:tasks.workunit.client.1.smithi156.stdout:5/684: symlink da/dc/d4b/d6c/d7c/d85/ldf 0 2023-12-16T05:56:38.730 INFO:tasks.workunit.client.0.smithi155.stdout:2/678: mkdir d0/d5/de2 0 2023-12-16T05:56:38.730 INFO:tasks.workunit.client.0.smithi155.stdout:2/679: fdatasync d0/d7/d1f/d74/f46 0 2023-12-16T05:56:38.732 INFO:tasks.workunit.client.0.smithi155.stdout:0/713: creat d7/d13/d45/fec x:0 0 0 2023-12-16T05:56:38.732 INFO:tasks.workunit.client.1.smithi156.stdout:6/489: creat d9/d13/d2f/d51/d82/d89/f92 x:0 0 0 2023-12-16T05:56:38.733 INFO:tasks.workunit.client.1.smithi156.stdout:6/490: dread d9/d13/d3e/f57 [0,4194304] 0 2023-12-16T05:56:38.733 INFO:tasks.workunit.client.1.smithi156.stdout:6/491: truncate d9/f85 178194 0 2023-12-16T05:56:38.733 INFO:tasks.workunit.client.0.smithi155.stdout:2/680: creat d0/d7/d1f/d74/d85/d88/fe3 x:0 0 0 2023-12-16T05:56:38.734 INFO:tasks.workunit.client.0.smithi155.stdout:2/681: truncate d0/f30 4430052 0 2023-12-16T05:56:38.734 INFO:tasks.workunit.client.0.smithi155.stdout:2/682: rmdir d0 39 2023-12-16T05:56:38.734 INFO:tasks.workunit.client.0.smithi155.stdout:2/683: read - d0/d7/dd/d62/fdd zero size 2023-12-16T05:56:38.735 INFO:tasks.workunit.client.1.smithi156.stdout:6/492: creat d9/f93 x:0 0 0 2023-12-16T05:56:38.736 INFO:tasks.workunit.client.1.smithi156.stdout:6/493: link d9/d1c/f3a d9/d13/d2f/d51/d82/f94 0 2023-12-16T05:56:38.736 INFO:tasks.workunit.client.1.smithi156.stdout:6/494: chown d9/d13/c16 3 1 2023-12-16T05:56:38.742 INFO:tasks.workunit.client.0.smithi155.stdout:4/675: dwrite d0/d10/d46/d16/d1a/f6f [0,4194304] 0 2023-12-16T05:56:38.742 INFO:tasks.workunit.client.0.smithi155.stdout:4/676: chown d0/d10/d46/d16/d30/d52/c60 9 1 2023-12-16T05:56:38.742 INFO:tasks.workunit.client.0.smithi155.stdout:4/677: chown d0/d10/d46/d16/d1a/f72 11942230 1 2023-12-16T05:56:38.742 INFO:tasks.workunit.client.1.smithi156.stdout:6/495: getdents d9/d13/d2f/d51/d82 0 2023-12-16T05:56:38.743 INFO:tasks.workunit.client.1.smithi156.stdout:6/496: mknod d9/d13/d3e/d5f/d6e/c95 0 2023-12-16T05:56:38.744 INFO:tasks.workunit.client.1.smithi156.stdout:2/487: sync 2023-12-16T05:56:38.746 INFO:tasks.workunit.client.1.smithi156.stdout:0/585: sync 2023-12-16T05:56:38.746 INFO:tasks.workunit.client.1.smithi156.stdout:8/355: sync 2023-12-16T05:56:38.746 INFO:tasks.workunit.client.1.smithi156.stdout:1/333: sync 2023-12-16T05:56:38.746 INFO:tasks.workunit.client.1.smithi156.stdout:4/470: sync 2023-12-16T05:56:38.746 INFO:tasks.workunit.client.1.smithi156.stdout:8/356: chown d3/d12 7625721 1 2023-12-16T05:56:38.747 INFO:tasks.workunit.client.1.smithi156.stdout:4/471: dread - d9/d43/d58/f76 zero size 2023-12-16T05:56:38.747 INFO:tasks.workunit.client.1.smithi156.stdout:4/472: chown d9/d2b/d35/c93 432 1 2023-12-16T05:56:38.747 INFO:tasks.workunit.client.1.smithi156.stdout:4/473: chown d9/d2b/d98/d99 8607 1 2023-12-16T05:56:38.749 INFO:tasks.workunit.client.1.smithi156.stdout:0/586: rename d2/f22 to d2/d23/d55/fb9 0 2023-12-16T05:56:38.750 INFO:tasks.workunit.client.1.smithi156.stdout:8/357: read d3/d7/d27/d46/d6e/d3c/f6a [14474590,27739] 0 2023-12-16T05:56:38.751 INFO:tasks.workunit.client.1.smithi156.stdout:1/334: creat d3/d17/d1c/d22/d57/f68 x:0 0 0 2023-12-16T05:56:38.752 INFO:tasks.workunit.client.1.smithi156.stdout:4/474: creat d9/d2c/d48/f9e x:0 0 0 2023-12-16T05:56:38.753 INFO:tasks.workunit.client.1.smithi156.stdout:0/587: mkdir d2/d7/dd/d29/d38/d51/d52/d88/dba 0 2023-12-16T05:56:38.754 INFO:tasks.workunit.client.1.smithi156.stdout:8/358: creat d3/d12/f70 x:0 0 0 2023-12-16T05:56:38.754 INFO:tasks.workunit.client.1.smithi156.stdout:8/359: fsync d3/d18/f64 0 2023-12-16T05:56:38.755 INFO:tasks.workunit.client.1.smithi156.stdout:1/335: truncate d3/d17/d19/f2a 1223630 0 2023-12-16T05:56:38.756 INFO:tasks.workunit.client.1.smithi156.stdout:8/360: creat d3/d7/d66/f71 x:0 0 0 2023-12-16T05:56:38.757 INFO:tasks.workunit.client.1.smithi156.stdout:1/336: mknod d3/d17/c69 0 2023-12-16T05:56:38.759 INFO:tasks.workunit.client.1.smithi156.stdout:4/475: rename d9/f22 to d9/d2b/f9f 0 2023-12-16T05:56:38.759 INFO:tasks.workunit.client.1.smithi156.stdout:4/476: dread - d9/d43/d58/f76 zero size 2023-12-16T05:56:38.760 INFO:tasks.workunit.client.1.smithi156.stdout:1/337: creat d3/d17/d1c/d22/f6a x:0 0 0 2023-12-16T05:56:38.760 INFO:tasks.workunit.client.1.smithi156.stdout:1/338: chown d3/f6 473725228 1 2023-12-16T05:56:38.760 INFO:tasks.workunit.client.1.smithi156.stdout:1/339: stat d3/d1b/d27 0 2023-12-16T05:56:38.760 INFO:tasks.workunit.client.1.smithi156.stdout:1/340: write d3/d17/d1c/f31 [870925,116381] 0 2023-12-16T05:56:38.762 INFO:tasks.workunit.client.0.smithi155.stdout:2/684: dwrite d0/d7/dd/f39 [0,4194304] 0 2023-12-16T05:56:38.762 INFO:tasks.workunit.client.1.smithi156.stdout:6/497: dwrite d9/d13/d2f/d51/f90 [0,4194304] 0 2023-12-16T05:56:38.762 INFO:tasks.workunit.client.1.smithi156.stdout:6/498: truncate d9/d13/d2f/d51/d82/d89/f92 249056 0 2023-12-16T05:56:38.762 INFO:tasks.workunit.client.1.smithi156.stdout:4/477: link d9/d2c/f3e d9/d2b/d98/fa0 0 2023-12-16T05:56:38.763 INFO:tasks.workunit.client.1.smithi156.stdout:5/685: dwrite da/dc/d2d/d9b/fa5 [0,4194304] 0 2023-12-16T05:56:38.763 INFO:tasks.workunit.client.0.smithi155.stdout:0/714: dwrite d7/d47/d53/fdc [0,4194304] 0 2023-12-16T05:56:38.764 INFO:tasks.workunit.client.1.smithi156.stdout:6/499: write d9/f70 [759835,49847] 0 2023-12-16T05:56:38.764 INFO:tasks.workunit.client.1.smithi156.stdout:1/341: mknod d3/d17/d4d/c6b 0 2023-12-16T05:56:38.765 INFO:tasks.workunit.client.1.smithi156.stdout:5/686: dread da/dc/d4b/d6c/d7c/d85/fa4 [0,4194304] 0 2023-12-16T05:56:38.765 INFO:tasks.workunit.client.0.smithi155.stdout:2/685: mknod d0/d7/dd/d49/d4b/d8c/dcd/ce4 0 2023-12-16T05:56:38.770 INFO:tasks.workunit.client.0.smithi155.stdout:0/715: rename d7/d13/d45/f4f to d7/d13/d45/d3e/fed 0 2023-12-16T05:56:38.772 INFO:tasks.workunit.client.1.smithi156.stdout:6/500: getdents d9/d13 0 2023-12-16T05:56:38.772 INFO:tasks.workunit.client.1.smithi156.stdout:6/501: fdatasync d9/d1c/f6f 0 2023-12-16T05:56:38.772 INFO:tasks.workunit.client.1.smithi156.stdout:6/502: chown d9/f70 656 1 2023-12-16T05:56:38.772 INFO:tasks.workunit.client.1.smithi156.stdout:8/361: dwrite d3/d7/d27/d46/d6e/f33 [0,4194304] 0 2023-12-16T05:56:38.772 INFO:tasks.workunit.client.0.smithi155.stdout:2/686: link d0/d7/d69/cb4 d0/d7/dd/d49/d4b/d8c/dcd/dd2/ce5 0 2023-12-16T05:56:38.773 INFO:tasks.workunit.client.1.smithi156.stdout:1/342: creat d3/d3a/f6c x:0 0 0 2023-12-16T05:56:38.773 INFO:tasks.workunit.client.1.smithi156.stdout:1/343: chown d3/d1b/d27/d4f/f65 958078 1 2023-12-16T05:56:38.774 INFO:tasks.workunit.client.0.smithi155.stdout:0/716: symlink d7/df/d73/da2/lee 0 2023-12-16T05:56:38.774 INFO:tasks.workunit.client.1.smithi156.stdout:1/344: write d3/d17/d19/f2e [570593,85353] 0 2023-12-16T05:56:38.774 INFO:tasks.workunit.client.1.smithi156.stdout:1/345: chown d3/d17/c54 310 1 2023-12-16T05:56:38.774 INFO:tasks.workunit.client.1.smithi156.stdout:5/687: truncate da/dc/d4b/f64 2573427 0 2023-12-16T05:56:38.776 INFO:tasks.workunit.client.0.smithi155.stdout:0/717: link d7/df/c91 d7/d47/cef 0 2023-12-16T05:56:38.777 INFO:tasks.workunit.client.1.smithi156.stdout:4/478: truncate d9/d2b/f31 2843446 0 2023-12-16T05:56:38.778 INFO:tasks.workunit.client.0.smithi155.stdout:0/718: getdents d7/d13/d46 0 2023-12-16T05:56:38.780 INFO:tasks.workunit.client.1.smithi156.stdout:6/503: rmdir d9 39 2023-12-16T05:56:38.780 INFO:tasks.workunit.client.0.smithi155.stdout:0/719: write d7/df/d65/f39 [1226417,99819] 0 2023-12-16T05:56:38.783 INFO:tasks.workunit.client.1.smithi156.stdout:1/346: rename d3/l35 to d3/d17/d1c/l6d 0 2023-12-16T05:56:38.785 INFO:tasks.workunit.client.1.smithi156.stdout:6/504: stat d9/d13/d2f/d51/d6b/l7c 0 2023-12-16T05:56:38.785 INFO:tasks.workunit.client.1.smithi156.stdout:6/505: fsync d9/d1c/d50/f84 0 2023-12-16T05:56:38.785 INFO:tasks.workunit.client.0.smithi155.stdout:0/720: creat d7/df/d73/db3/ff0 x:0 0 0 2023-12-16T05:56:38.786 INFO:tasks.workunit.client.1.smithi156.stdout:6/506: write d9/d13/d2f/d36/f55 [3508737,120499] 0 2023-12-16T05:56:38.787 INFO:tasks.workunit.client.1.smithi156.stdout:1/347: rmdir d3/d1b 39 2023-12-16T05:56:38.788 INFO:tasks.workunit.client.0.smithi155.stdout:0/721: creat d7/d2d/ff1 x:0 0 0 2023-12-16T05:56:38.789 INFO:tasks.workunit.client.1.smithi156.stdout:6/507: creat d9/d13/d2f/d36/f96 x:0 0 0 2023-12-16T05:56:38.789 INFO:tasks.workunit.client.0.smithi155.stdout:0/722: creat d7/da4/ff2 x:0 0 0 2023-12-16T05:56:38.790 INFO:tasks.workunit.client.1.smithi156.stdout:6/508: write d9/f85 [87046,120154] 0 2023-12-16T05:56:38.790 INFO:tasks.workunit.client.1.smithi156.stdout:1/348: rmdir d3/d1b 39 2023-12-16T05:56:38.792 INFO:tasks.workunit.client.0.smithi155.stdout:0/723: dread d7/d13/d45/d4b/f67 [0,4194304] 0 2023-12-16T05:56:38.792 INFO:tasks.workunit.client.0.smithi155.stdout:0/724: readlink d7/df/d41/d23/de1/leb 0 2023-12-16T05:56:38.792 INFO:tasks.workunit.client.0.smithi155.stdout:0/725: chown d7/da4 0 1 2023-12-16T05:56:38.792 INFO:tasks.workunit.client.0.smithi155.stdout:0/726: truncate d7/d47/d5d/f74 193321 0 2023-12-16T05:56:38.792 INFO:tasks.workunit.client.0.smithi155.stdout:0/727: truncate d7/df/fa8 257818 0 2023-12-16T05:56:38.793 INFO:tasks.workunit.client.0.smithi155.stdout:0/728: mkdir d7/d13/d46/df3 0 2023-12-16T05:56:38.793 INFO:tasks.workunit.client.1.smithi156.stdout:1/349: mkdir d3/d17/d1c/d22/d6e 0 2023-12-16T05:56:38.793 INFO:tasks.workunit.client.1.smithi156.stdout:1/350: fdatasync d3/fc 0 2023-12-16T05:56:38.793 INFO:tasks.workunit.client.1.smithi156.stdout:1/351: chown d3/d17/d1c/d22/d57 32597573 1 2023-12-16T05:56:38.798 INFO:tasks.workunit.client.1.smithi156.stdout:8/362: dwrite d3/d7/d27/d46/d6e/f33 [0,4194304] 0 2023-12-16T05:56:38.800 INFO:tasks.workunit.client.1.smithi156.stdout:8/363: symlink d3/d7/d27/d46/l72 0 2023-12-16T05:56:38.800 INFO:tasks.workunit.client.1.smithi156.stdout:6/509: dread d9/d13/d2f/d51/d6b/d77/f8b [0,4194304] 0 2023-12-16T05:56:38.800 INFO:tasks.workunit.client.1.smithi156.stdout:6/510: write d9/d13/d2f/d51/f56 [1967839,74822] 0 2023-12-16T05:56:38.801 INFO:tasks.workunit.client.1.smithi156.stdout:6/511: symlink d9/d13/d2f/l97 0 2023-12-16T05:56:38.804 INFO:tasks.workunit.client.1.smithi156.stdout:6/512: link d9/d1c/f46 d9/d13/d3e/f98 0 2023-12-16T05:56:38.809 INFO:tasks.workunit.client.1.smithi156.stdout:1/352: dread d3/d17/f33 [4194304,4194304] 0 2023-12-16T05:56:38.809 INFO:tasks.workunit.client.1.smithi156.stdout:1/353: write d3/d17/d4d/f64 [903243,74434] 0 2023-12-16T05:56:38.809 INFO:tasks.workunit.client.1.smithi156.stdout:1/354: stat d3/d17/l38 0 2023-12-16T05:56:38.810 INFO:tasks.workunit.client.1.smithi156.stdout:1/355: mknod d3/d17/d1c/d22/c6f 0 2023-12-16T05:56:38.812 INFO:tasks.workunit.client.1.smithi156.stdout:1/356: read f0 [3608051,112262] 0 2023-12-16T05:56:38.812 INFO:tasks.workunit.client.1.smithi156.stdout:1/357: chown d3/d1b/d27/f29 130991604 1 2023-12-16T05:56:38.813 INFO:tasks.workunit.client.1.smithi156.stdout:6/513: write d9/d13/f27 [1917221,25104] 0 2023-12-16T05:56:38.814 INFO:tasks.workunit.client.1.smithi156.stdout:1/358: creat d3/d17/d4d/f70 x:0 0 0 2023-12-16T05:56:38.814 INFO:tasks.workunit.client.1.smithi156.stdout:1/359: dread - d3/d17/d1c/f4b zero size 2023-12-16T05:56:38.815 INFO:tasks.workunit.client.1.smithi156.stdout:6/514: mkdir d9/d13/d2f/d51/d69/d99 0 2023-12-16T05:56:38.816 INFO:tasks.workunit.client.1.smithi156.stdout:1/360: mknod d3/d3a/c71 0 2023-12-16T05:56:38.817 INFO:tasks.workunit.client.1.smithi156.stdout:1/361: creat d3/d17/d1c/d22/d6e/f72 x:0 0 0 2023-12-16T05:56:38.819 INFO:tasks.workunit.client.1.smithi156.stdout:1/362: truncate d3/d17/d19/f2a 701834 0 2023-12-16T05:56:38.821 INFO:tasks.workunit.client.1.smithi156.stdout:6/515: dread f8 [0,4194304] 0 2023-12-16T05:56:38.822 INFO:tasks.workunit.client.1.smithi156.stdout:1/363: creat d3/d1b/d27/f73 x:0 0 0 2023-12-16T05:56:38.822 INFO:tasks.workunit.client.1.smithi156.stdout:1/364: write d3/d3a/f5d [4732056,35330] 0 2023-12-16T05:56:38.822 INFO:tasks.workunit.client.1.smithi156.stdout:1/365: write d3/d1b/d27/d4f/f65 [181181,15892] 0 2023-12-16T05:56:38.823 INFO:tasks.workunit.client.1.smithi156.stdout:1/366: creat d3/d17/d2d/f74 x:0 0 0 2023-12-16T05:56:38.837 INFO:tasks.workunit.client.1.smithi156.stdout:4/479: dwrite d9/d2b/f8f [0,4194304] 0 2023-12-16T05:56:38.841 INFO:tasks.workunit.client.1.smithi156.stdout:5/688: dwrite da/dc/d2d/f8a [0,4194304] 0 2023-12-16T05:56:38.850 INFO:tasks.workunit.client.1.smithi156.stdout:8/364: dwrite d3/d12/f58 [0,4194304] 0 2023-12-16T05:56:38.854 INFO:tasks.workunit.client.0.smithi155.stdout:0/729: dwrite d7/df/d41/d23/f68 [0,4194304] 0 2023-12-16T05:56:38.854 INFO:tasks.workunit.client.0.smithi155.stdout:0/730: chown d7/d2d/fbc 0 1 2023-12-16T05:56:38.854 INFO:tasks.workunit.client.1.smithi156.stdout:4/480: dwrite d9/f15 [0,4194304] 0 2023-12-16T05:56:38.857 INFO:tasks.workunit.client.0.smithi155.stdout:0/731: rename d7/df/d73/d8d/d4d/lc1 to d7/d2d/lf4 0 2023-12-16T05:56:38.859 INFO:tasks.workunit.client.0.smithi155.stdout:0/732: creat d7/df/d73/da2/ff5 x:0 0 0 2023-12-16T05:56:38.860 INFO:tasks.workunit.client.0.smithi155.stdout:0/733: write d7/d2d/f9e [1121638,58383] 0 2023-12-16T05:56:38.861 INFO:tasks.workunit.client.1.smithi156.stdout:1/367: rename d3/d17/d1c/d22/d6e to d3/d1b/d27/d4f/d75 0 2023-12-16T05:56:38.869 INFO:tasks.workunit.client.1.smithi156.stdout:5/689: creat da/dc/d4b/d6c/d81/dc5/fe0 x:0 0 0 2023-12-16T05:56:38.869 INFO:tasks.workunit.client.1.smithi156.stdout:5/690: write da/dc/f2c [4229166,120751] 0 2023-12-16T05:56:38.870 INFO:tasks.workunit.client.1.smithi156.stdout:5/691: fdatasync da/f98 0 2023-12-16T05:56:38.870 INFO:tasks.workunit.client.1.smithi156.stdout:8/365: creat d3/d12/d16/f73 x:0 0 0 2023-12-16T05:56:38.874 INFO:tasks.workunit.client.1.smithi156.stdout:4/481: mknod d9/d43/ca1 0 2023-12-16T05:56:38.874 INFO:tasks.workunit.client.1.smithi156.stdout:4/482: write d9/d2c/d7a/f81 [933570,59701] 0 2023-12-16T05:56:38.875 INFO:tasks.workunit.client.0.smithi155.stdout:0/734: dwrite d7/df/d73/db3/fc0 [0,4194304] 0 2023-12-16T05:56:38.875 INFO:tasks.workunit.client.1.smithi156.stdout:1/368: creat d3/f76 x:0 0 0 2023-12-16T05:56:38.876 INFO:tasks.workunit.client.1.smithi156.stdout:5/692: getdents da/dc/d2d/d4d/d54/d90 0 2023-12-16T05:56:38.876 INFO:tasks.workunit.client.1.smithi156.stdout:5/693: chown da/dc/d4b/d6c/d81/fa3 16 1 2023-12-16T05:56:38.876 INFO:tasks.workunit.client.1.smithi156.stdout:5/694: chown da/dc/d2d/d4d/d54/l7d 0 1 2023-12-16T05:56:38.877 INFO:tasks.workunit.client.0.smithi155.stdout:0/735: rename d7/d47/fa9 to d7/df/d41/d23/de1/ff6 0 2023-12-16T05:56:38.877 INFO:tasks.workunit.client.0.smithi155.stdout:0/736: chown d7/d47/d53/f7d 47 1 2023-12-16T05:56:38.877 INFO:tasks.workunit.client.1.smithi156.stdout:4/483: read d9/f24 [1446941,30667] 0 2023-12-16T05:56:38.878 INFO:tasks.workunit.client.0.smithi155.stdout:0/737: unlink d7/df/d41/f77 0 2023-12-16T05:56:38.878 INFO:tasks.workunit.client.0.smithi155.stdout:0/738: truncate d7/df/d73/d8d/d4d/fc2 899420 0 2023-12-16T05:56:38.878 INFO:tasks.workunit.client.1.smithi156.stdout:1/369: rmdir d3/d17/d2d 39 2023-12-16T05:56:38.879 INFO:tasks.workunit.client.1.smithi156.stdout:1/370: write d3/d17/f5e [177195,85647] 0 2023-12-16T05:56:38.879 INFO:tasks.workunit.client.0.smithi155.stdout:0/739: creat d7/d2d/ff7 x:0 0 0 2023-12-16T05:56:38.881 INFO:tasks.workunit.client.1.smithi156.stdout:1/371: truncate d3/d17/d1c/f31 80846 0 2023-12-16T05:56:38.881 INFO:tasks.workunit.client.1.smithi156.stdout:9/499: sync 2023-12-16T05:56:38.883 INFO:tasks.workunit.client.1.smithi156.stdout:1/372: mknod d3/d17/c77 0 2023-12-16T05:56:38.884 INFO:tasks.workunit.client.1.smithi156.stdout:9/500: creat d6/d19/d30/d48/d87/d65/fa8 x:0 0 0 2023-12-16T05:56:38.886 INFO:tasks.workunit.client.1.smithi156.stdout:1/373: symlink d3/d1b/d27/d4f/l78 0 2023-12-16T05:56:38.894 INFO:tasks.workunit.client.1.smithi156.stdout:1/374: getdents d3/d1b/d27/d4f 0 2023-12-16T05:56:38.897 INFO:tasks.workunit.client.1.smithi156.stdout:4/484: dwrite d9/d2c/d48/f67 [0,4194304] 0 2023-12-16T05:56:38.898 INFO:tasks.workunit.client.1.smithi156.stdout:4/485: write d9/f23 [1597992,32240] 0 2023-12-16T05:56:38.900 INFO:tasks.workunit.client.1.smithi156.stdout:4/486: symlink d9/la2 0 2023-12-16T05:56:38.901 INFO:tasks.workunit.client.1.smithi156.stdout:4/487: chown d9/d43/d58/d7d/f90 28854 1 2023-12-16T05:56:38.907 INFO:tasks.workunit.client.1.smithi156.stdout:4/488: dread f4 [0,4194304] 0 2023-12-16T05:56:38.912 INFO:tasks.workunit.client.0.smithi155.stdout:5/791: sync 2023-12-16T05:56:38.912 INFO:tasks.workunit.client.0.smithi155.stdout:9/932: sync 2023-12-16T05:56:38.912 INFO:tasks.workunit.client.0.smithi155.stdout:6/914: sync 2023-12-16T05:56:38.912 INFO:tasks.workunit.client.0.smithi155.stdout:5/792: readlink d0/d2/d2a/d30/d53/d7b/d99/lb2 0 2023-12-16T05:56:38.912 INFO:tasks.workunit.client.0.smithi155.stdout:7/675: sync 2023-12-16T05:56:38.914 INFO:tasks.workunit.client.0.smithi155.stdout:6/915: symlink d0/df/d5e/d46/d6d/l133 0 2023-12-16T05:56:38.916 INFO:tasks.workunit.client.0.smithi155.stdout:7/676: rmdir d0/d1b/d78/dd5 0 2023-12-16T05:56:38.916 INFO:tasks.workunit.client.0.smithi155.stdout:5/793: creat d0/f102 x:0 0 0 2023-12-16T05:56:38.917 INFO:tasks.workunit.client.0.smithi155.stdout:5/794: write d0/d2/d2a/d30/d53/d7b/d99/d47/fb8 [427569,62405] 0 2023-12-16T05:56:38.920 INFO:tasks.workunit.client.1.smithi156.stdout:1/375: dwrite d3/d1b/f46 [0,4194304] 0 2023-12-16T05:56:38.920 INFO:tasks.workunit.client.1.smithi156.stdout:1/376: write d3/d17/d1c/f31 [155118,69485] 0 2023-12-16T05:56:38.921 INFO:tasks.workunit.client.0.smithi155.stdout:0/740: dwrite d7/df/d73/d8d/f6b [0,4194304] 0 2023-12-16T05:56:38.921 INFO:tasks.workunit.client.0.smithi155.stdout:0/741: dread - d7/d2d/fbc zero size 2023-12-16T05:56:38.923 INFO:tasks.workunit.client.1.smithi156.stdout:4/489: dwrite d9/d2b/f31 [0,4194304] 0 2023-12-16T05:56:38.924 INFO:tasks.workunit.client.1.smithi156.stdout:1/377: rename d3/d1b/d27/f34 to d3/d1b/f79 0 2023-12-16T05:56:38.928 INFO:tasks.workunit.client.0.smithi155.stdout:9/933: dread da/d15/d17/d24/d26/d2e/d83/d8f/d9c/fa4 [0,4194304] 0 2023-12-16T05:56:38.929 INFO:tasks.workunit.client.1.smithi156.stdout:9/501: dwrite d6/f51 [0,4194304] 0 2023-12-16T05:56:38.929 INFO:tasks.workunit.client.0.smithi155.stdout:5/795: write d0/d2/d4f/f9b [10893298,5227] 0 2023-12-16T05:56:38.930 INFO:tasks.workunit.client.0.smithi155.stdout:5/796: symlink d0/d2/d2a/d30/d53/d7b/l103 0 2023-12-16T05:56:38.931 INFO:tasks.workunit.client.0.smithi155.stdout:5/797: truncate d0/d2/d2a/d19/f38 899824 0 2023-12-16T05:56:38.931 INFO:tasks.workunit.client.0.smithi155.stdout:5/798: readlink d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/lc2 0 2023-12-16T05:56:38.932 INFO:tasks.workunit.client.0.smithi155.stdout:5/799: symlink d0/dae/l104 0 2023-12-16T05:56:38.933 INFO:tasks.workunit.client.1.smithi156.stdout:4/490: link d9/d2c/f3e d9/fa3 0 2023-12-16T05:56:38.933 INFO:tasks.workunit.client.1.smithi156.stdout:1/378: creat d3/d3a/f7a x:0 0 0 2023-12-16T05:56:38.934 INFO:tasks.workunit.client.1.smithi156.stdout:1/379: creat d3/d17/d19/f7b x:0 0 0 2023-12-16T05:56:38.952 INFO:tasks.workunit.client.1.smithi156.stdout:1/380: rmdir d3/d17/d19 39 2023-12-16T05:56:38.952 INFO:tasks.workunit.client.1.smithi156.stdout:3/392: sync 2023-12-16T05:56:38.953 INFO:tasks.workunit.client.1.smithi156.stdout:1/381: creat d3/d17/d4d/f7c x:0 0 0 2023-12-16T05:56:38.953 INFO:tasks.workunit.client.1.smithi156.stdout:3/393: mkdir dc/d10/d3d/d4e/d99 0 2023-12-16T05:56:38.954 INFO:tasks.workunit.client.1.smithi156.stdout:1/382: creat d3/d1b/d27/d4f/d75/f7d x:0 0 0 2023-12-16T05:56:38.955 INFO:tasks.workunit.client.0.smithi155.stdout:7/677: dwrite d0/d6a/d31/f8a [0,4194304] 0 2023-12-16T05:56:38.955 INFO:tasks.workunit.client.0.smithi155.stdout:7/678: truncate d0/d1/d5/fbd 20429 0 2023-12-16T05:56:38.955 INFO:tasks.workunit.client.0.smithi155.stdout:6/916: dwrite d0/df/d5e/d5b/f130 [0,4194304] 0 2023-12-16T05:56:38.956 INFO:tasks.workunit.client.0.smithi155.stdout:6/917: readlink d0/d3/l52 0 2023-12-16T05:56:38.956 INFO:tasks.workunit.client.0.smithi155.stdout:0/742: dwrite d7/df/d73/db3/ff0 [0,4194304] 0 2023-12-16T05:56:38.956 INFO:tasks.workunit.client.0.smithi155.stdout:0/743: chown d7/c14 9 1 2023-12-16T05:56:38.957 INFO:tasks.workunit.client.1.smithi156.stdout:9/502: dwrite d6/f98 [4194304,4194304] 0 2023-12-16T05:56:38.957 INFO:tasks.workunit.client.1.smithi156.stdout:9/503: chown d6/d2e/d8a/da5 66 1 2023-12-16T05:56:38.957 INFO:tasks.workunit.client.1.smithi156.stdout:9/504: fdatasync d6/d19/f29 0 2023-12-16T05:56:38.960 INFO:tasks.workunit.client.0.smithi155.stdout:0/744: mkdir d7/df/d73/df8 0 2023-12-16T05:56:38.960 INFO:tasks.workunit.client.0.smithi155.stdout:0/745: write d7/d47/d53/f7d [870912,281] 0 2023-12-16T05:56:38.960 INFO:tasks.workunit.client.0.smithi155.stdout:9/934: dwrite da/d15/d17/d36/d5b/d60/d9e/fd4 [0,4194304] 0 2023-12-16T05:56:38.960 INFO:tasks.workunit.client.1.smithi156.stdout:4/491: dwrite d9/d2c/d48/f67 [0,4194304] 0 2023-12-16T05:56:38.961 INFO:tasks.workunit.client.1.smithi156.stdout:4/492: read - d9/d43/d58/d7d/f8b zero size 2023-12-16T05:56:38.961 INFO:tasks.workunit.client.1.smithi156.stdout:4/493: write d9/d2b/d98/fa0 [1407451,114588] 0 2023-12-16T05:56:38.961 INFO:tasks.workunit.client.1.smithi156.stdout:4/494: fdatasync d9/d2c/f9b 0 2023-12-16T05:56:38.967 INFO:tasks.workunit.client.0.smithi155.stdout:0/746: write d7/df/d41/d23/f68 [3249242,71865] 0 2023-12-16T05:56:38.967 INFO:tasks.workunit.client.0.smithi155.stdout:0/747: chown d7/d2d/ff1 57199977 1 2023-12-16T05:56:38.967 INFO:tasks.workunit.client.1.smithi156.stdout:4/495: link d9/d2b/c74 d9/d2b/d98/d99/ca4 0 2023-12-16T05:56:38.968 INFO:tasks.workunit.client.1.smithi156.stdout:4/496: rmdir d9/d43/d58/d95 39 2023-12-16T05:56:38.968 INFO:tasks.workunit.client.1.smithi156.stdout:4/497: chown d9/la2 57069576 1 2023-12-16T05:56:38.969 INFO:tasks.workunit.client.1.smithi156.stdout:4/498: mknod d9/d43/d58/d7d/ca5 0 2023-12-16T05:56:38.971 INFO:tasks.workunit.client.1.smithi156.stdout:4/499: symlink d9/d2b/d35/la6 0 2023-12-16T05:56:38.976 INFO:tasks.workunit.client.1.smithi156.stdout:4/500: write d9/d2b/f3c [442999,11896] 0 2023-12-16T05:56:38.980 INFO:tasks.workunit.client.1.smithi156.stdout:4/501: write d9/f19 [3468424,82639] 0 2023-12-16T05:56:38.983 INFO:tasks.workunit.client.1.smithi156.stdout:0/588: sync 2023-12-16T05:56:38.984 INFO:tasks.workunit.client.1.smithi156.stdout:2/488: sync 2023-12-16T05:56:38.984 INFO:tasks.workunit.client.1.smithi156.stdout:7/692: sync 2023-12-16T05:56:38.988 INFO:tasks.workunit.client.0.smithi155.stdout:9/935: dwrite da/d15/f1d [0,4194304] 0 2023-12-16T05:56:38.989 INFO:tasks.workunit.client.1.smithi156.stdout:2/489: creat d9/dd/d3f/f9c x:0 0 0 2023-12-16T05:56:38.995 INFO:tasks.workunit.client.1.smithi156.stdout:2/490: dread d9/f5c [0,4194304] 0 2023-12-16T05:56:38.995 INFO:tasks.workunit.client.1.smithi156.stdout:2/491: write d9/d12/f5e [1259917,32376] 0 2023-12-16T05:56:39.000 INFO:tasks.workunit.client.1.smithi156.stdout:0/589: dread d2/f24 [0,4194304] 0 2023-12-16T05:56:39.001 INFO:tasks.workunit.client.1.smithi156.stdout:0/590: chown d2/d7/dd/d29/d38/d3f/c92 3 1 2023-12-16T05:56:39.002 INFO:tasks.workunit.client.0.smithi155.stdout:0/748: rmdir d7/d47 39 2023-12-16T05:56:39.003 INFO:tasks.workunit.client.1.smithi156.stdout:0/591: link d2/d7/c87 d2/d7/dd/d29/d38/d51/cbb 0 2023-12-16T05:56:39.003 INFO:tasks.workunit.client.0.smithi155.stdout:9/936: symlink da/d15/d17/l137 0 2023-12-16T05:56:39.004 INFO:tasks.workunit.client.1.smithi156.stdout:1/383: write d3/f5 [480280,40254] 0 2023-12-16T05:56:39.004 INFO:tasks.workunit.client.1.smithi156.stdout:2/492: dread d9/dd/d17/d33/d47/f6e [0,4194304] 0 2023-12-16T05:56:39.005 INFO:tasks.workunit.client.0.smithi155.stdout:0/749: write d7/df/f7b [3380441,83496] 0 2023-12-16T05:56:39.005 INFO:tasks.workunit.client.0.smithi155.stdout:0/750: stat d7/df/d41/d23/f68 0 2023-12-16T05:56:39.006 INFO:tasks.workunit.client.0.smithi155.stdout:9/937: rename da/f13 to da/d15/f138 0 2023-12-16T05:56:39.006 INFO:tasks.workunit.client.0.smithi155.stdout:9/938: truncate da/d15/d17/d24/d26/d2e/d32/db7/fe6 230231 0 2023-12-16T05:56:39.006 INFO:tasks.workunit.client.1.smithi156.stdout:0/592: rename d2/d7/dd/d5c to d2/d7/dd/d29/d38/d51/d52/d88/dbc 0 2023-12-16T05:56:39.007 INFO:tasks.workunit.client.0.smithi155.stdout:9/939: creat da/d15/d17/d36/d54/d76/f139 x:0 0 0 2023-12-16T05:56:39.008 INFO:tasks.workunit.client.0.smithi155.stdout:6/918: dwrite d0/d3/d7a/db0/fb7 [0,4194304] 0 2023-12-16T05:56:39.009 INFO:tasks.workunit.client.0.smithi155.stdout:9/940: mknod da/d15/d17/d24/d26/d2e/d32/ded/c13a 0 2023-12-16T05:56:39.011 INFO:tasks.workunit.client.1.smithi156.stdout:2/493: mknod d9/dd/d17/d8f/c9d 0 2023-12-16T05:56:39.011 INFO:tasks.workunit.client.1.smithi156.stdout:2/494: getdents d9/dd/d17/d33/d78/d39/d8c 0 2023-12-16T05:56:39.011 INFO:tasks.workunit.client.1.smithi156.stdout:2/495: truncate d9/d12/f45 699107 0 2023-12-16T05:56:39.011 INFO:tasks.workunit.client.1.smithi156.stdout:2/496: fsync d9/dd/d3f/f52 0 2023-12-16T05:56:39.012 INFO:tasks.workunit.client.1.smithi156.stdout:0/593: unlink d2/d7/dd/d29/d38/d51/d69/f73 0 2023-12-16T05:56:39.012 INFO:tasks.workunit.client.1.smithi156.stdout:2/497: getdents d9/d12/d3d 0 2023-12-16T05:56:39.013 INFO:tasks.workunit.client.0.smithi155.stdout:6/919: creat d0/df/d5e/d7e/dd8/d12b/d103/f134 x:0 0 0 2023-12-16T05:56:39.014 INFO:tasks.workunit.client.1.smithi156.stdout:0/594: creat d2/d7/dd/d29/d38/d51/d65/d7e/fbd x:0 0 0 2023-12-16T05:56:39.015 INFO:tasks.workunit.client.0.smithi155.stdout:9/941: dread da/d15/d17/d24/d26/d2e/f63 [0,4194304] 0 2023-12-16T05:56:39.015 INFO:tasks.workunit.client.0.smithi155.stdout:9/942: truncate da/d15/d17/d36/d5b/fb6 719802 0 2023-12-16T05:56:39.016 INFO:tasks.workunit.client.1.smithi156.stdout:0/595: rename d2/d7/dd/d1c/c31 to d2/d7/dd/d2d/cbe 0 2023-12-16T05:56:39.016 INFO:tasks.workunit.client.0.smithi155.stdout:6/920: rename d0/f7c to d0/d3/d7a/db0/dc3/dce/ddd/d1b/f135 0 2023-12-16T05:56:39.016 INFO:tasks.workunit.client.0.smithi155.stdout:9/943: write da/d15/f2f [378953,50760] 0 2023-12-16T05:56:39.017 INFO:tasks.workunit.client.1.smithi156.stdout:0/596: creat d2/d7/dd/d29/d38/d51/d52/fbf x:0 0 0 2023-12-16T05:56:39.017 INFO:tasks.workunit.client.1.smithi156.stdout:0/597: chown d2/d7/dd/d29/d38/d51/d52/d88 4 1 2023-12-16T05:56:39.018 INFO:tasks.workunit.client.0.smithi155.stdout:6/921: mknod d0/dbd/c136 0 2023-12-16T05:56:39.021 INFO:tasks.workunit.client.1.smithi156.stdout:0/598: write d2/f24 [1369336,78292] 0 2023-12-16T05:56:39.021 INFO:tasks.workunit.client.1.smithi156.stdout:0/599: chown d2/d7/dd/d1c/db3 6616319 1 2023-12-16T05:56:39.021 INFO:tasks.workunit.client.1.smithi156.stdout:0/600: chown d2/d7/dd/d2d/f9a 14289467 1 2023-12-16T05:56:39.021 INFO:tasks.workunit.client.0.smithi155.stdout:6/922: mkdir d0/df/d5e/d7e/dd8/d12b/d103/d137 0 2023-12-16T05:56:39.022 INFO:tasks.workunit.client.0.smithi155.stdout:6/923: chown d0/d3/d7a/db0/dc3/dce/ddd/dd4/dfb 2520875 1 2023-12-16T05:56:39.025 INFO:tasks.workunit.client.1.smithi156.stdout:3/394: dwrite dc/d10/d1d/f49 [0,4194304] 0 2023-12-16T05:56:39.025 INFO:tasks.workunit.client.1.smithi156.stdout:9/505: dwrite d6/d2e/f50 [0,4194304] 0 2023-12-16T05:56:39.025 INFO:tasks.workunit.client.0.smithi155.stdout:6/924: creat d0/df/d5e/d5b/f138 x:0 0 0 2023-12-16T05:56:39.025 INFO:tasks.workunit.client.0.smithi155.stdout:7/679: dwrite d0/d1b/f39 [0,4194304] 0 2023-12-16T05:56:39.026 INFO:tasks.workunit.client.0.smithi155.stdout:0/751: fsync d7/d47/d53/f7d 0 2023-12-16T05:56:39.029 INFO:tasks.workunit.client.1.smithi156.stdout:9/506: dread - d6/f15 zero size 2023-12-16T05:56:39.029 INFO:tasks.workunit.client.0.smithi155.stdout:7/680: creat d0/d6a/d1a/d8c/d34/d4b/d60/fde x:0 0 0 2023-12-16T05:56:39.032 INFO:tasks.workunit.client.1.smithi156.stdout:9/507: mkdir d6/d19/d25/d3a/d5e/da9 0 2023-12-16T05:56:39.032 INFO:tasks.workunit.client.1.smithi156.stdout:9/508: write d6/d19/d30/d48/d87/d65/fa8 [423198,83012] 0 2023-12-16T05:56:39.033 INFO:tasks.workunit.client.0.smithi155.stdout:0/752: rename d7/df/d73/db3/dce/fdd to d7/d47/d5d/d6a/ff9 0 2023-12-16T05:56:39.033 INFO:tasks.workunit.client.0.smithi155.stdout:0/753: dread - d7/df/d73/d8d/d4d/f80 zero size 2023-12-16T05:56:39.033 INFO:tasks.workunit.client.0.smithi155.stdout:0/754: chown d7/df/d73/d8d/l98 30509 1 2023-12-16T05:56:39.035 INFO:tasks.workunit.client.1.smithi156.stdout:4/502: dwrite d9/d43/d58/d7d/f8b [0,4194304] 0 2023-12-16T05:56:39.036 INFO:tasks.workunit.client.1.smithi156.stdout:9/509: creat d6/d19/d25/d3a/faa x:0 0 0 2023-12-16T05:56:39.036 INFO:tasks.workunit.client.0.smithi155.stdout:7/681: rename d0/d6a/d1a/d22/c9c to d0/d6a/d1a/d2b/db9/cdf 0 2023-12-16T05:56:39.037 INFO:tasks.workunit.client.1.smithi156.stdout:1/384: dwrite d3/fb [0,4194304] 0 2023-12-16T05:56:39.038 INFO:tasks.workunit.client.0.smithi155.stdout:0/755: link d7/df/f37 d7/d13/d46/df3/ffa 0 2023-12-16T05:56:39.038 INFO:tasks.workunit.client.1.smithi156.stdout:4/503: mknod d9/d2b/d35/ca7 0 2023-12-16T05:56:39.039 INFO:tasks.workunit.client.1.smithi156.stdout:9/510: mknod d6/d2e/d8a/cab 0 2023-12-16T05:56:39.041 INFO:tasks.workunit.client.0.smithi155.stdout:6/925: dread d0/d3/d7a/d77/fa3 [0,4194304] 0 2023-12-16T05:56:39.045 INFO:tasks.workunit.client.1.smithi156.stdout:1/385: creat d3/d17/d1c/d22/d57/f7e x:0 0 0 2023-12-16T05:56:39.045 INFO:tasks.workunit.client.1.smithi156.stdout:1/386: chown d3/d1b/d27/f67 2606072 1 2023-12-16T05:56:39.045 INFO:tasks.workunit.client.1.smithi156.stdout:1/387: symlink d3/d17/d1c/d22/d57/l7f 0 2023-12-16T05:56:39.045 INFO:tasks.workunit.client.1.smithi156.stdout:5/695: sync 2023-12-16T05:56:39.045 INFO:tasks.workunit.client.1.smithi156.stdout:8/366: sync 2023-12-16T05:56:39.045 INFO:tasks.workunit.client.1.smithi156.stdout:6/516: sync 2023-12-16T05:56:39.045 INFO:tasks.workunit.client.1.smithi156.stdout:4/504: read f6 [1033306,38521] 0 2023-12-16T05:56:39.045 INFO:tasks.workunit.client.1.smithi156.stdout:1/388: creat d3/d17/d1c/d22/d57/d61/f80 x:0 0 0 2023-12-16T05:56:39.046 INFO:tasks.workunit.client.1.smithi156.stdout:8/367: rmdir d3/d7 39 2023-12-16T05:56:39.046 INFO:tasks.workunit.client.0.smithi155.stdout:0/756: getdents d7/df/d73/db3 0 2023-12-16T05:56:39.046 INFO:tasks.workunit.client.0.smithi155.stdout:6/926: write d0/d3/f38 [2809559,84352] 0 2023-12-16T05:56:39.046 INFO:tasks.workunit.client.0.smithi155.stdout:6/927: truncate d0/df/d5e/d7e/dd8/ff8 410285 0 2023-12-16T05:56:39.047 INFO:tasks.workunit.client.0.smithi155.stdout:6/928: dread - d0/d3/d7a/db0/dc3/dce/ddd/d1b/f12a zero size 2023-12-16T05:56:39.047 INFO:tasks.workunit.client.0.smithi155.stdout:9/944: dwrite da/d15/d17/d24/d26/d2e/d83/fdd [0,4194304] 0 2023-12-16T05:56:39.047 INFO:tasks.workunit.client.1.smithi156.stdout:3/395: dwrite dc/f7c [0,4194304] 0 2023-12-16T05:56:39.048 INFO:tasks.workunit.client.1.smithi156.stdout:5/696: rename l9 to da/dc/d2d/d4d/d54/d90/le1 0 2023-12-16T05:56:39.048 INFO:tasks.workunit.client.1.smithi156.stdout:5/697: truncate da/dc/d2d/fd0 876181 0 2023-12-16T05:56:39.049 INFO:tasks.workunit.client.1.smithi156.stdout:4/505: creat d9/d43/d58/fa8 x:0 0 0 2023-12-16T05:56:39.050 INFO:tasks.workunit.client.1.smithi156.stdout:8/368: mkdir d3/d12/d74 0 2023-12-16T05:56:39.050 INFO:tasks.workunit.client.1.smithi156.stdout:1/389: read d3/d17/d1c/f2b [4026392,12153] 0 2023-12-16T05:56:39.052 INFO:tasks.workunit.client.1.smithi156.stdout:3/396: creat dc/df/d34/d62/f9a x:0 0 0 2023-12-16T05:56:39.052 INFO:tasks.workunit.client.1.smithi156.stdout:3/397: fsync dc/d10/d1d/d4b/f51 0 2023-12-16T05:56:39.053 INFO:tasks.workunit.client.0.smithi155.stdout:0/757: link d7/f83 d7/df/d73/d8d/d4d/de8/dd6/ffb 0 2023-12-16T05:56:39.054 INFO:tasks.workunit.client.1.smithi156.stdout:4/506: creat d9/d43/fa9 x:0 0 0 2023-12-16T05:56:39.054 INFO:tasks.workunit.client.1.smithi156.stdout:4/507: chown d9/f42 161156 1 2023-12-16T05:56:39.055 INFO:tasks.workunit.client.1.smithi156.stdout:1/390: unlink d3/d17/d2d/l41 0 2023-12-16T05:56:39.055 INFO:tasks.workunit.client.0.smithi155.stdout:6/929: mknod d0/d3/d7a/dd6/d132/c139 0 2023-12-16T05:56:39.057 INFO:tasks.workunit.client.0.smithi155.stdout:9/945: getdents da/d15/d17/d36/d54/d10f 0 2023-12-16T05:56:39.057 INFO:tasks.workunit.client.0.smithi155.stdout:9/946: fdatasync da/d15/d17/d36/d5b/d60/db9/f12a 0 2023-12-16T05:56:39.058 INFO:tasks.workunit.client.1.smithi156.stdout:1/391: mknod d3/d1b/d27/d4f/c81 0 2023-12-16T05:56:39.058 INFO:tasks.workunit.client.1.smithi156.stdout:3/398: creat dc/df/d70/f9b x:0 0 0 2023-12-16T05:56:39.058 INFO:tasks.workunit.client.1.smithi156.stdout:1/392: chown d3/f6 915 1 2023-12-16T05:56:39.058 INFO:tasks.workunit.client.1.smithi156.stdout:1/393: write d3/d1b/d27/f3e [892834,99562] 0 2023-12-16T05:56:39.059 INFO:tasks.workunit.client.1.smithi156.stdout:3/399: rmdir dc/d10/d1d/d4b/d52 39 2023-12-16T05:56:39.059 INFO:tasks.workunit.client.0.smithi155.stdout:0/758: rename d7/d13/d45/d4b/f90 to d7/df/d73/dba/ffc 0 2023-12-16T05:56:39.060 INFO:tasks.workunit.client.1.smithi156.stdout:4/508: unlink d9/d2b/d56/c5b 0 2023-12-16T05:56:39.061 INFO:tasks.workunit.client.0.smithi155.stdout:6/930: symlink d0/df/d5e/d46/l13a 0 2023-12-16T05:56:39.061 INFO:tasks.workunit.client.1.smithi156.stdout:1/394: mkdir d3/d17/d1c/d22/d57/d82 0 2023-12-16T05:56:39.063 INFO:tasks.workunit.client.0.smithi155.stdout:9/947: creat da/d15/d17/d36/d5b/d60/d9e/de3/f13b x:0 0 0 2023-12-16T05:56:39.063 INFO:tasks.workunit.client.0.smithi155.stdout:9/948: stat da/d15/d17/l92 0 2023-12-16T05:56:39.064 INFO:tasks.workunit.client.1.smithi156.stdout:3/400: symlink dc/l9c 0 2023-12-16T05:56:39.067 INFO:tasks.workunit.client.1.smithi156.stdout:6/517: dwrite d9/f35 [0,4194304] 0 2023-12-16T05:56:39.067 INFO:tasks.workunit.client.1.smithi156.stdout:6/518: write d9/d13/d3e/f59 [4965442,22725] 0 2023-12-16T05:56:39.067 INFO:tasks.workunit.client.1.smithi156.stdout:4/509: creat d9/d43/d58/d95/faa x:0 0 0 2023-12-16T05:56:39.068 INFO:tasks.workunit.client.0.smithi155.stdout:9/949: rename da/d15/d17/d24/d26/d2e/d83/d8f/d9c/l132 to da/d15/d17/d24/d26/d2e/d83/l13c 0 2023-12-16T05:56:39.072 INFO:tasks.workunit.client.1.smithi156.stdout:6/519: mkdir d9/d13/d2f/d51/d82/d89/d8e/d9a 0 2023-12-16T05:56:39.076 INFO:tasks.workunit.client.1.smithi156.stdout:6/520: mkdir d9/d13/d2f/d51/d9b 0 2023-12-16T05:56:39.079 INFO:tasks.workunit.client.1.smithi156.stdout:6/521: read d9/d13/f18 [2461229,30785] 0 2023-12-16T05:56:39.080 INFO:tasks.workunit.client.1.smithi156.stdout:6/522: truncate d9/d13/f4d 1323162 0 2023-12-16T05:56:39.081 INFO:tasks.workunit.client.1.smithi156.stdout:6/523: creat d9/d13/d2f/d51/d69/d99/f9c x:0 0 0 2023-12-16T05:56:39.081 INFO:tasks.workunit.client.1.smithi156.stdout:6/524: getdents d9/d13/d2f/d51/d9b 0 2023-12-16T05:56:39.081 INFO:tasks.workunit.client.1.smithi156.stdout:6/525: truncate d9/d13/d3e/f57 1349076 0 2023-12-16T05:56:39.082 INFO:tasks.workunit.client.0.smithi155.stdout:1/850: sync 2023-12-16T05:56:39.083 INFO:tasks.workunit.client.0.smithi155.stdout:1/851: getdents d1/d7 0 2023-12-16T05:56:39.083 INFO:tasks.workunit.client.0.smithi155.stdout:1/852: readlink d1/d7/d4b/d8e/la9 0 2023-12-16T05:56:39.083 INFO:tasks.workunit.client.1.smithi156.stdout:6/526: truncate d9/d1c/f72 3473484 0 2023-12-16T05:56:39.084 INFO:tasks.workunit.client.0.smithi155.stdout:1/853: symlink d1/d7/d16/l10b 0 2023-12-16T05:56:39.087 INFO:tasks.workunit.client.1.smithi156.stdout:1/395: dwrite d3/d17/f52 [0,4194304] 0 2023-12-16T05:56:39.087 INFO:tasks.workunit.client.1.smithi156.stdout:6/527: dread d9/d13/d3e/f98 [0,4194304] 0 2023-12-16T05:56:39.091 INFO:tasks.workunit.client.1.smithi156.stdout:6/528: creat d9/d13/d2f/d51/d82/d89/d8e/f9d x:0 0 0 2023-12-16T05:56:39.093 INFO:tasks.workunit.client.1.smithi156.stdout:6/529: creat d9/d1c/f9e x:0 0 0 2023-12-16T05:56:39.094 INFO:tasks.workunit.client.1.smithi156.stdout:6/530: truncate d9/d13/d3e/d5f/f75 3543238 0 2023-12-16T05:56:39.096 INFO:tasks.workunit.client.0.smithi155.stdout:3/551: sync 2023-12-16T05:56:39.101 INFO:tasks.workunit.client.0.smithi155.stdout:0/759: dwrite d7/df/d6f/fa5 [0,4194304] 0 2023-12-16T05:56:39.112 INFO:tasks.workunit.client.0.smithi155.stdout:8/751: sync 2023-12-16T05:56:39.113 INFO:tasks.workunit.client.0.smithi155.stdout:8/752: creat d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/ffa x:0 0 0 2023-12-16T05:56:39.113 INFO:tasks.workunit.client.0.smithi155.stdout:8/753: readlink d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/leb 0 2023-12-16T05:56:39.114 INFO:tasks.workunit.client.0.smithi155.stdout:8/754: creat d4/d62/d66/d78/d80/ffb x:0 0 0 2023-12-16T05:56:39.115 INFO:tasks.workunit.client.0.smithi155.stdout:8/755: creat d4/d62/d66/d78/d88/d1b/d1c/d97/ffc x:0 0 0 2023-12-16T05:56:39.116 INFO:tasks.workunit.client.0.smithi155.stdout:8/756: creat d4/d62/d66/d78/d88/d12/ffd x:0 0 0 2023-12-16T05:56:39.116 INFO:tasks.workunit.client.0.smithi155.stdout:8/757: chown d4/d62/d66/d78/d88/d1b/d1c/d97/fce 19847798 1 2023-12-16T05:56:39.117 INFO:tasks.workunit.client.0.smithi155.stdout:8/758: symlink d4/d62/d66/d78/d88/d9e/lfe 0 2023-12-16T05:56:39.117 INFO:tasks.workunit.client.0.smithi155.stdout:8/759: chown d4/d62/d66/d78/d88/d1b/d1c/d19/cc5 0 1 2023-12-16T05:56:39.117 INFO:tasks.workunit.client.0.smithi155.stdout:8/760: fsync d4/d62/d66/d78/d88/d1b/d1c/d97/f8c 0 2023-12-16T05:56:39.117 INFO:tasks.workunit.client.0.smithi155.stdout:8/761: readlink d4/d62/d66/d78/d80/l9b 0 2023-12-16T05:56:39.117 INFO:tasks.workunit.client.0.smithi155.stdout:8/762: write d4/d62/d66/d78/d80/ffb [145538,112134] 0 2023-12-16T05:56:39.117 INFO:tasks.workunit.client.0.smithi155.stdout:8/763: truncate d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/fe3 5267844 0 2023-12-16T05:56:39.118 INFO:tasks.workunit.client.0.smithi155.stdout:8/764: mknod d4/d62/d66/d78/d88/d9e/cff 0 2023-12-16T05:56:39.119 INFO:tasks.workunit.client.0.smithi155.stdout:8/765: creat d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/f100 x:0 0 0 2023-12-16T05:56:39.119 INFO:tasks.workunit.client.0.smithi155.stdout:8/766: dread - d4/d62/d66/d78/d88/d1b/f61 zero size 2023-12-16T05:56:39.119 INFO:tasks.workunit.client.0.smithi155.stdout:8/767: creat d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/f101 x:0 0 0 2023-12-16T05:56:39.120 INFO:tasks.workunit.client.1.smithi156.stdout:6/531: dread d9/d13/d2f/d51/d6b/d77/d7e/f8c [0,4194304] 0 2023-12-16T05:56:39.120 INFO:tasks.workunit.client.0.smithi155.stdout:8/768: creat d4/f102 x:0 0 0 2023-12-16T05:56:39.120 INFO:tasks.workunit.client.0.smithi155.stdout:8/769: chown d4/d62/d66/d78/d88/d1b/d1c/d97 78956 1 2023-12-16T05:56:39.121 INFO:tasks.workunit.client.1.smithi156.stdout:6/532: symlink d9/d13/l9f 0 2023-12-16T05:56:39.123 INFO:tasks.workunit.client.1.smithi156.stdout:5/698: dread da/dc/d2d/d4d/fbd [0,4194304] 0 2023-12-16T05:56:39.123 INFO:tasks.workunit.client.0.smithi155.stdout:6/931: dwrite d0/df/d5e/d7e/dd8/d12b/d103/f12c [0,4194304] 0 2023-12-16T05:56:39.123 INFO:tasks.workunit.client.0.smithi155.stdout:6/932: fsync d0/df/d5e/d46/f81 0 2023-12-16T05:56:39.124 INFO:tasks.workunit.client.0.smithi155.stdout:6/933: symlink d0/d3/d7a/dd6/d132/l13b 0 2023-12-16T05:56:39.126 INFO:tasks.workunit.client.1.smithi156.stdout:5/699: write da/f48 [4145033,94413] 0 2023-12-16T05:56:39.126 INFO:tasks.workunit.client.1.smithi156.stdout:5/700: write da/dc/f3d [3051974,39711] 0 2023-12-16T05:56:39.127 INFO:tasks.workunit.client.0.smithi155.stdout:6/934: write d0/d3/d7a/db0/fb7 [3946271,10277] 0 2023-12-16T05:56:39.127 INFO:tasks.workunit.client.0.smithi155.stdout:6/935: stat d0/df/d5e/d7e 0 2023-12-16T05:56:39.127 INFO:tasks.workunit.client.1.smithi156.stdout:5/701: rmdir da/dc/d2d/d4d/d54/d90 39 2023-12-16T05:56:39.128 INFO:tasks.workunit.client.0.smithi155.stdout:8/770: rename d4/d62/d66/d78/d80 to d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d103 0 2023-12-16T05:56:39.128 INFO:tasks.workunit.client.0.smithi155.stdout:8/771: dread - d4/d62/d66/d78/d88/d1b/f61 zero size 2023-12-16T05:56:39.128 INFO:tasks.workunit.client.0.smithi155.stdout:8/772: chown d4/d62/d66/d78/d88/d1b/d1c/d19/d64/fb2 94 1 2023-12-16T05:56:39.128 INFO:tasks.workunit.client.0.smithi155.stdout:8/773: truncate d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d103/ff2 1028926 0 2023-12-16T05:56:39.129 INFO:tasks.workunit.client.1.smithi156.stdout:5/702: mkdir da/dc/de2 0 2023-12-16T05:56:39.129 INFO:tasks.workunit.client.1.smithi156.stdout:6/533: dread d9/d13/d2f/d51/f90 [0,4194304] 0 2023-12-16T05:56:39.129 INFO:tasks.workunit.client.0.smithi155.stdout:6/936: rename d0/df/d5e/d46/d6d/l116 to d0/df/d5e/d5b/l13c 0 2023-12-16T05:56:39.131 INFO:tasks.workunit.client.0.smithi155.stdout:8/774: truncate d4/d62/d66/d78/d88/d1b/d2a/f75 1924578 0 2023-12-16T05:56:39.132 INFO:tasks.workunit.client.0.smithi155.stdout:6/937: mknod d0/df/d5e/d99/c13d 0 2023-12-16T05:56:39.132 INFO:tasks.workunit.client.0.smithi155.stdout:6/938: chown d0/df/d5e/d46 174 1 2023-12-16T05:56:39.132 INFO:tasks.workunit.client.1.smithi156.stdout:6/534: write d9/d1c/f39 [2607999,106255] 0 2023-12-16T05:56:39.133 INFO:tasks.workunit.client.0.smithi155.stdout:8/775: creat d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/f104 x:0 0 0 2023-12-16T05:56:39.134 INFO:tasks.workunit.client.1.smithi156.stdout:3/401: dwrite dc/df/d34/f63 [0,4194304] 0 2023-12-16T05:56:39.134 INFO:tasks.workunit.client.0.smithi155.stdout:8/776: unlink d4/d62/d66/d78/d88/d1b/d1c/d1a/f3a 0 2023-12-16T05:56:39.135 INFO:tasks.workunit.client.0.smithi155.stdout:8/777: creat d4/d62/d66/d78/def/f105 x:0 0 0 2023-12-16T05:56:39.137 INFO:tasks.workunit.client.0.smithi155.stdout:8/778: read d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/f63 [689727,44969] 0 2023-12-16T05:56:39.137 INFO:tasks.workunit.client.1.smithi156.stdout:3/402: rmdir dc/df/d70/d96 0 2023-12-16T05:56:39.138 INFO:tasks.workunit.client.1.smithi156.stdout:3/403: read dc/d10/f24 [2451865,60952] 0 2023-12-16T05:56:39.139 INFO:tasks.workunit.client.0.smithi155.stdout:8/779: rename d4/d62/d66/d78/d88/d1b/d2a/d51/df9 to d4/d62/d66/d78/d88/d1b/d1c/d97/df3/df5/d106 0 2023-12-16T05:56:39.139 INFO:tasks.workunit.client.1.smithi156.stdout:3/404: creat dc/d10/d1d/d4b/f9d x:0 0 0 2023-12-16T05:56:39.140 INFO:tasks.workunit.client.1.smithi156.stdout:3/405: write dc/d10/f11 [1179554,46012] 0 2023-12-16T05:56:39.140 INFO:tasks.workunit.client.1.smithi156.stdout:0/601: dwrite d2/f24 [0,4194304] 0 2023-12-16T05:56:39.141 INFO:tasks.workunit.client.1.smithi156.stdout:3/406: rename dc/df/l1c to dc/df/l9e 0 2023-12-16T05:56:39.141 INFO:tasks.workunit.client.1.smithi156.stdout:3/407: chown dc/df/f2b 267842 1 2023-12-16T05:56:39.143 INFO:tasks.workunit.client.1.smithi156.stdout:0/602: mkdir d2/d7/dd/d29/d4b/dc0 0 2023-12-16T05:56:39.143 INFO:tasks.workunit.client.1.smithi156.stdout:0/603: dread - d2/d7/dd/f96 zero size 2023-12-16T05:56:39.143 INFO:tasks.workunit.client.1.smithi156.stdout:0/604: truncate d2/d7/dd/d29/f89 616255 0 2023-12-16T05:56:39.144 INFO:tasks.workunit.client.1.smithi156.stdout:0/605: creat d2/d23/d4a/fc1 x:0 0 0 2023-12-16T05:56:39.145 INFO:tasks.workunit.client.0.smithi155.stdout:6/939: dread d0/df/f26 [0,4194304] 0 2023-12-16T05:56:39.145 INFO:tasks.workunit.client.0.smithi155.stdout:0/760: dwrite d7/f2a [0,4194304] 0 2023-12-16T05:56:39.145 INFO:tasks.workunit.client.0.smithi155.stdout:6/940: write d0/d3/d7a/db0/dc3/dce/ddd/d1b/dea/ffa [675210,20090] 0 2023-12-16T05:56:39.146 INFO:tasks.workunit.client.1.smithi156.stdout:1/396: dwrite d3/d17/d1c/d22/f6a [0,4194304] 0 2023-12-16T05:56:39.146 INFO:tasks.workunit.client.0.smithi155.stdout:6/941: truncate d0/d3/f38 5151102 0 2023-12-16T05:56:39.150 INFO:tasks.workunit.client.1.smithi156.stdout:0/606: mkdir d2/d7/dd/d29/d38/d51/d52/d88/dbc/dc2 0 2023-12-16T05:56:39.153 INFO:tasks.workunit.client.0.smithi155.stdout:1/854: dwrite d1/d7/d4b/d5c/f82 [4194304,4194304] 0 2023-12-16T05:56:39.154 INFO:tasks.workunit.client.1.smithi156.stdout:1/397: rename d3/d17/d4d/f70 to d3/d17/d4d/f83 0 2023-12-16T05:56:39.155 INFO:tasks.workunit.client.1.smithi156.stdout:5/703: dwrite da/dc/d4b/fb2 [0,4194304] 0 2023-12-16T05:56:39.155 INFO:tasks.workunit.client.1.smithi156.stdout:9/511: dwrite d6/d2e/f52 [0,4194304] 0 2023-12-16T05:56:39.155 INFO:tasks.workunit.client.1.smithi156.stdout:9/512: chown d6/d19/f22 6275832 1 2023-12-16T05:56:39.157 INFO:tasks.workunit.client.1.smithi156.stdout:6/535: dwrite d9/d13/d2f/f3f [0,4194304] 0 2023-12-16T05:56:39.157 INFO:tasks.workunit.client.1.smithi156.stdout:8/369: dwrite d3/d12/d16/d54/f60 [0,4194304] 0 2023-12-16T05:56:39.157 INFO:tasks.workunit.client.1.smithi156.stdout:0/607: unlink d2/d7/dd/d29/d38/f3e 0 2023-12-16T05:56:39.158 INFO:tasks.workunit.client.0.smithi155.stdout:9/950: dwrite da/f1e [0,4194304] 0 2023-12-16T05:56:39.158 INFO:tasks.workunit.client.0.smithi155.stdout:9/951: write da/fbe [519214,54286] 0 2023-12-16T05:56:39.158 INFO:tasks.workunit.client.0.smithi155.stdout:9/952: read - da/d15/d17/d36/d5b/d60/d9e/fc5 zero size 2023-12-16T05:56:39.158 INFO:tasks.workunit.client.0.smithi155.stdout:1/855: creat d1/d25/d43/f10c x:0 0 0 2023-12-16T05:56:39.159 INFO:tasks.workunit.client.1.smithi156.stdout:1/398: truncate d3/d1b/f79 491277 0 2023-12-16T05:56:39.159 INFO:tasks.workunit.client.1.smithi156.stdout:1/399: write d3/d17/d2d/f53 [517922,84058] 0 2023-12-16T05:56:39.159 INFO:tasks.workunit.client.0.smithi155.stdout:6/942: dread d0/d3/d2c/d3e/f64 [0,4194304] 0 2023-12-16T05:56:39.159 INFO:tasks.workunit.client.1.smithi156.stdout:5/704: rmdir da/dc/d2d/d4d/d54/d90 39 2023-12-16T05:56:39.161 INFO:tasks.workunit.client.1.smithi156.stdout:9/513: rmdir d6/d19/d30/d48 39 2023-12-16T05:56:39.163 INFO:tasks.workunit.client.1.smithi156.stdout:6/536: creat d9/d13/d2f/d51/d82/fa0 x:0 0 0 2023-12-16T05:56:39.168 INFO:tasks.workunit.client.1.smithi156.stdout:6/537: write d9/d1c/f2b [4156500,6259] 0 2023-12-16T05:56:39.168 INFO:tasks.workunit.client.1.smithi156.stdout:8/370: mknod d3/d7/d62/c75 0 2023-12-16T05:56:39.169 INFO:tasks.workunit.client.1.smithi156.stdout:8/371: write d3/d18/f64 [829086,18178] 0 2023-12-16T05:56:39.172 INFO:tasks.workunit.client.0.smithi155.stdout:8/780: dwrite d4/d62/d66/d78/d88/d12/f94 [0,4194304] 0 2023-12-16T05:56:39.172 INFO:tasks.workunit.client.0.smithi155.stdout:9/953: rename da/d15/d17/d24/d62/lf9 to da/d15/d17/d36/l13d 0 2023-12-16T05:56:39.172 INFO:tasks.workunit.client.0.smithi155.stdout:9/954: chown da/l49 1003 1 2023-12-16T05:56:39.173 INFO:tasks.workunit.client.0.smithi155.stdout:9/955: dread - da/d15/d17/d36/d5b/d60/d9e/fc5 zero size 2023-12-16T05:56:39.173 INFO:tasks.workunit.client.0.smithi155.stdout:9/956: fdatasync da/d15/f66 0 2023-12-16T05:56:39.173 INFO:tasks.workunit.client.1.smithi156.stdout:0/608: getdents d2/d7/dd/d29/d2e 0 2023-12-16T05:56:39.173 INFO:tasks.workunit.client.1.smithi156.stdout:3/408: dwrite dc/d56/d67/f6f [0,4194304] 0 2023-12-16T05:56:39.173 INFO:tasks.workunit.client.1.smithi156.stdout:0/609: chown d2/d7/dd/d29/d2e/f53 21 1 2023-12-16T05:56:39.174 INFO:tasks.workunit.client.1.smithi156.stdout:0/610: fdatasync d2/d7/dd/d29/fa4 0 2023-12-16T05:56:39.174 INFO:tasks.workunit.client.1.smithi156.stdout:3/409: write dc/d56/f92 [970595,15740] 0 2023-12-16T05:56:39.174 INFO:tasks.workunit.client.0.smithi155.stdout:6/943: creat d0/d3/d2c/d8b/d85/da4/f13e x:0 0 0 2023-12-16T05:56:39.175 INFO:tasks.workunit.client.1.smithi156.stdout:1/400: link d3/d17/c24 d3/d17/d1c/d22/d57/d82/c84 0 2023-12-16T05:56:39.176 INFO:tasks.workunit.client.0.smithi155.stdout:0/761: dwrite d7/df/d73/db3/fb9 [0,4194304] 0 2023-12-16T05:56:39.179 INFO:tasks.workunit.client.1.smithi156.stdout:5/705: rename da/dc/d2d/d4d/fbd to da/fe3 0 2023-12-16T05:56:39.179 INFO:tasks.workunit.client.1.smithi156.stdout:9/514: mkdir d6/d19/d25/d3a/d88/d8b/dac 0 2023-12-16T05:56:39.180 INFO:tasks.workunit.client.0.smithi155.stdout:8/781: truncate d4/f42 2571283 0 2023-12-16T05:56:39.180 INFO:tasks.workunit.client.1.smithi156.stdout:0/611: dread d2/d7/f18 [4194304,4194304] 0 2023-12-16T05:56:39.180 INFO:tasks.workunit.client.1.smithi156.stdout:0/612: truncate d2/d7/dd/d29/d38/d51/d65/d7e/fbd 14526 0 2023-12-16T05:56:39.183 INFO:tasks.workunit.client.0.smithi155.stdout:6/944: mknod d0/d3/d7a/db0/dc3/dce/ddd/d1b/dea/c13f 0 2023-12-16T05:56:39.187 INFO:tasks.workunit.client.0.smithi155.stdout:9/957: dread da/d15/f138 [0,4194304] 0 2023-12-16T05:56:39.188 INFO:tasks.workunit.client.1.smithi156.stdout:3/410: link dc/d56/d67/l8a dc/df/d34/d62/l9f 0 2023-12-16T05:56:39.190 INFO:tasks.workunit.client.1.smithi156.stdout:1/401: creat d3/d17/d1c/d22/d57/f85 x:0 0 0 2023-12-16T05:56:39.190 INFO:tasks.workunit.client.1.smithi156.stdout:1/402: fsync d3/d17/d19/f2e 0 2023-12-16T05:56:39.192 INFO:tasks.workunit.client.0.smithi155.stdout:0/762: mknod d7/db7/cfd 0 2023-12-16T05:56:39.194 INFO:tasks.workunit.client.0.smithi155.stdout:8/782: rename d4/l36 to d4/l107 0 2023-12-16T05:56:39.195 INFO:tasks.workunit.client.0.smithi155.stdout:9/958: mkdir da/d15/d17/d24/d62/dea/d13e 0 2023-12-16T05:56:39.196 INFO:tasks.workunit.client.1.smithi156.stdout:5/706: symlink da/dc/d2d/d4d/db9/le4 0 2023-12-16T05:56:39.196 INFO:tasks.workunit.client.1.smithi156.stdout:5/707: fdatasync da/dc/d4b/f64 0 2023-12-16T05:56:39.198 INFO:tasks.workunit.client.1.smithi156.stdout:1/403: dread d3/d17/d19/f20 [0,4194304] 0 2023-12-16T05:56:39.199 INFO:tasks.workunit.client.0.smithi155.stdout:0/763: creat d7/df/d73/d8d/d4d/de8/de5/ffe x:0 0 0 2023-12-16T05:56:39.199 INFO:tasks.workunit.client.1.smithi156.stdout:0/613: mknod d2/d7/dd/d29/d38/d3f/cc3 0 2023-12-16T05:56:39.199 INFO:tasks.workunit.client.0.smithi155.stdout:6/945: dread d0/dbd/f113 [0,4194304] 0 2023-12-16T05:56:39.201 INFO:tasks.workunit.client.0.smithi155.stdout:9/959: symlink da/d15/d17/d24/d26/l13f 0 2023-12-16T05:56:39.205 INFO:tasks.workunit.client.0.smithi155.stdout:0/764: link d7/df/d6f/c8e d7/df/d73/db3/dce/cff 0 2023-12-16T05:56:39.206 INFO:tasks.workunit.client.0.smithi155.stdout:8/783: dread d4/dd3/fea [0,4194304] 0 2023-12-16T05:56:39.206 INFO:tasks.workunit.client.0.smithi155.stdout:1/856: dwrite d1/d7/d16/d30/f6e [0,4194304] 0 2023-12-16T05:56:39.210 INFO:tasks.workunit.client.1.smithi156.stdout:5/708: rmdir da/dc/d2d/d4d/db9/dc9 39 2023-12-16T05:56:39.213 INFO:tasks.workunit.client.0.smithi155.stdout:4/678: sync 2023-12-16T05:56:39.215 INFO:tasks.workunit.client.1.smithi156.stdout:0/614: unlink d2/d7/dd/d66/fac 0 2023-12-16T05:56:39.215 INFO:tasks.workunit.client.1.smithi156.stdout:0/615: fdatasync d2/d23/d4a/f8b 0 2023-12-16T05:56:39.215 INFO:tasks.workunit.client.1.smithi156.stdout:0/616: write d2/d47/f80 [1628405,110466] 0 2023-12-16T05:56:39.216 INFO:tasks.workunit.client.1.smithi156.stdout:1/404: rmdir d3/d17/d1c/d22/d57 39 2023-12-16T05:56:39.216 INFO:tasks.workunit.client.1.smithi156.stdout:1/405: dread - d3/d17/d1c/d22/d57/f7e zero size 2023-12-16T05:56:39.217 INFO:tasks.workunit.client.0.smithi155.stdout:0/765: dread d7/df/d73/db3/ff0 [0,4194304] 0 2023-12-16T05:56:39.218 INFO:tasks.workunit.client.0.smithi155.stdout:0/766: write d7/df/d73/d8d/d4d/f80 [295669,37476] 0 2023-12-16T05:56:39.219 INFO:tasks.workunit.client.1.smithi156.stdout:1/406: creat d3/d17/d2d/f86 x:0 0 0 2023-12-16T05:56:39.221 INFO:tasks.workunit.client.1.smithi156.stdout:1/407: symlink d3/d3a/l87 0 2023-12-16T05:56:39.221 INFO:tasks.workunit.client.1.smithi156.stdout:1/408: stat d3/d17/d19 0 2023-12-16T05:56:39.221 INFO:tasks.workunit.client.0.smithi155.stdout:2/687: sync 2023-12-16T05:56:39.222 INFO:tasks.workunit.client.1.smithi156.stdout:8/372: dwrite d3/d18/f64 [0,4194304] 0 2023-12-16T05:56:39.222 INFO:tasks.workunit.client.1.smithi156.stdout:8/373: chown d3/d7/d27/f32 1082 1 2023-12-16T05:56:39.223 INFO:tasks.workunit.client.1.smithi156.stdout:9/515: dwrite d6/d2e/f89 [0,4194304] 0 2023-12-16T05:56:39.223 INFO:tasks.workunit.client.1.smithi156.stdout:9/516: dread - d6/f8c zero size 2023-12-16T05:56:39.223 INFO:tasks.workunit.client.0.smithi155.stdout:4/679: dread d0/f5 [0,4194304] 0 2023-12-16T05:56:39.224 INFO:tasks.workunit.client.1.smithi156.stdout:8/374: write d3/d6/f5 [2615464,83619] 0 2023-12-16T05:56:39.224 INFO:tasks.workunit.client.1.smithi156.stdout:6/538: dwrite f5 [0,4194304] 0 2023-12-16T05:56:39.224 INFO:tasks.workunit.client.1.smithi156.stdout:5/709: dread da/f14 [0,4194304] 0 2023-12-16T05:56:39.224 INFO:tasks.workunit.client.1.smithi156.stdout:3/411: dwrite dc/df/d34/f68 [0,4194304] 0 2023-12-16T05:56:39.224 INFO:tasks.workunit.client.1.smithi156.stdout:3/412: write dc/d10/f82 [1561517,28371] 0 2023-12-16T05:56:39.228 INFO:tasks.workunit.client.1.smithi156.stdout:9/517: rename d6/d19/d30/d48/d87/d8d to d6/d2e/dad 0 2023-12-16T05:56:39.228 INFO:tasks.workunit.client.1.smithi156.stdout:9/518: chown d6/d19/f1f 61585523 1 2023-12-16T05:56:39.228 INFO:tasks.workunit.client.1.smithi156.stdout:9/519: fdatasync d6/f15 0 2023-12-16T05:56:39.229 INFO:tasks.workunit.client.1.smithi156.stdout:0/617: mkdir d2/d7/dd/d2d/d5e/dc4 0 2023-12-16T05:56:39.232 INFO:tasks.workunit.client.0.smithi155.stdout:4/680: dread d0/d10/d46/d16/f4b [0,4194304] 0 2023-12-16T05:56:39.232 INFO:tasks.workunit.client.0.smithi155.stdout:4/681: getdents d0/d10/d46/d16/d30/dce/d75/d86 0 2023-12-16T05:56:39.233 INFO:tasks.workunit.client.1.smithi156.stdout:8/375: mkdir d3/d7/d66/d76 0 2023-12-16T05:56:39.237 INFO:tasks.workunit.client.1.smithi156.stdout:6/539: rmdir d9/d13/d3e/d5f 39 2023-12-16T05:56:39.238 INFO:tasks.workunit.client.1.smithi156.stdout:5/710: creat da/dc/d4b/d6c/fe5 x:0 0 0 2023-12-16T05:56:39.238 INFO:tasks.workunit.client.1.smithi156.stdout:6/540: read d9/f70 [2331398,49327] 0 2023-12-16T05:56:39.239 INFO:tasks.workunit.client.1.smithi156.stdout:3/413: link dc/d56/d67/l8a dc/d56/d69/la0 0 2023-12-16T05:56:39.239 INFO:tasks.workunit.client.1.smithi156.stdout:3/414: write dc/d10/d1d/d4b/d52/f54 [38690,36159] 0 2023-12-16T05:56:39.244 INFO:tasks.workunit.client.1.smithi156.stdout:8/376: mkdir d3/d7/d27/d46/d6e/d3b/d77 0 2023-12-16T05:56:39.250 INFO:tasks.workunit.client.1.smithi156.stdout:5/711: rmdir da 39 2023-12-16T05:56:39.250 INFO:tasks.workunit.client.1.smithi156.stdout:5/712: dread - da/dc/d2d/d4d/d54/d90/dc3/fc8 zero size 2023-12-16T05:56:39.250 INFO:tasks.workunit.client.1.smithi156.stdout:5/713: chown da/dc/d4b/lb4 117 1 2023-12-16T05:56:39.250 INFO:tasks.workunit.client.1.smithi156.stdout:5/714: dread - da/dc/d4b/d6c/d7c/fcb zero size 2023-12-16T05:56:39.251 INFO:tasks.workunit.client.1.smithi156.stdout:6/541: link d9/d13/d2f/d51/d82/d89/d8e/f9d d9/d1c/d50/fa1 0 2023-12-16T05:56:39.252 INFO:tasks.workunit.client.1.smithi156.stdout:3/415: symlink dc/df/d34/d62/la1 0 2023-12-16T05:56:39.253 INFO:tasks.workunit.client.1.smithi156.stdout:8/377: creat d3/f78 x:0 0 0 2023-12-16T05:56:39.253 INFO:tasks.workunit.client.1.smithi156.stdout:8/378: fdatasync d3/d12/f28 0 2023-12-16T05:56:39.254 INFO:tasks.workunit.client.1.smithi156.stdout:8/379: write d3/d12/d16/f2d [10270709,75891] 0 2023-12-16T05:56:39.254 INFO:tasks.workunit.client.1.smithi156.stdout:5/715: mknod da/dc/d2d/d4d/d54/d90/dc3/ce6 0 2023-12-16T05:56:39.254 INFO:tasks.workunit.client.1.smithi156.stdout:2/498: sync 2023-12-16T05:56:39.254 INFO:tasks.workunit.client.1.smithi156.stdout:7/693: sync 2023-12-16T05:56:39.255 INFO:tasks.workunit.client.1.smithi156.stdout:6/542: symlink d9/d13/d3e/d5f/d6e/la2 0 2023-12-16T05:56:39.255 INFO:tasks.workunit.client.1.smithi156.stdout:6/543: fsync d9/d13/d2f/f68 0 2023-12-16T05:56:39.256 INFO:tasks.workunit.client.0.smithi155.stdout:9/960: creat da/d15/d17/d24/d62/dea/d13e/f140 x:0 0 0 2023-12-16T05:56:39.256 INFO:tasks.workunit.client.0.smithi155.stdout:9/961: write da/d15/d17/d36/dc1/ff7 [2146596,81447] 0 2023-12-16T05:56:39.257 INFO:tasks.workunit.client.1.smithi156.stdout:3/416: rmdir dc/d10/d3d/d4e/d99 0 2023-12-16T05:56:39.258 INFO:tasks.workunit.client.0.smithi155.stdout:8/784: read - d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/fc1 zero size 2023-12-16T05:56:39.258 INFO:tasks.workunit.client.1.smithi156.stdout:2/499: mkdir d9/dd/d17/d33/d47/d9e 0 2023-12-16T05:56:39.258 INFO:tasks.workunit.client.1.smithi156.stdout:2/500: chown d9/dd/d17/d33 762947 1 2023-12-16T05:56:39.259 INFO:tasks.workunit.client.1.smithi156.stdout:7/694: getdents d1e/d1f/d74 0 2023-12-16T05:56:39.260 INFO:tasks.workunit.client.1.smithi156.stdout:6/544: creat d9/d13/d3e/d5f/d6e/fa3 x:0 0 0 2023-12-16T05:56:39.260 INFO:tasks.workunit.client.1.smithi156.stdout:2/501: write d9/d12/f63 [772961,61025] 0 2023-12-16T05:56:39.261 INFO:tasks.workunit.client.0.smithi155.stdout:1/857: rename d1/d7/d4b/d5c/fda to d1/d7/d16/de4/f10d 0 2023-12-16T05:56:39.261 INFO:tasks.workunit.client.1.smithi156.stdout:8/380: dread d3/d18/f19 [0,4194304] 0 2023-12-16T05:56:39.261 INFO:tasks.workunit.client.1.smithi156.stdout:7/695: mknod d1e/d1f/da6/d57/d59/dd8/cf8 0 2023-12-16T05:56:39.261 INFO:tasks.workunit.client.1.smithi156.stdout:8/381: write d3/d18/f22 [1814231,48259] 0 2023-12-16T05:56:39.262 INFO:tasks.workunit.client.1.smithi156.stdout:8/382: readlink d3/l26 0 2023-12-16T05:56:39.263 INFO:tasks.workunit.client.1.smithi156.stdout:7/696: dread d1e/d1f/f53 [0,4194304] 0 2023-12-16T05:56:39.263 INFO:tasks.workunit.client.1.smithi156.stdout:7/697: truncate d1e/d55/dba/fbd 985726 0 2023-12-16T05:56:39.263 INFO:tasks.workunit.client.1.smithi156.stdout:6/545: unlink c4 0 2023-12-16T05:56:39.263 INFO:tasks.workunit.client.0.smithi155.stdout:0/767: link d7/d13/d45/f49 d7/df/d41/d23/d36/f100 0 2023-12-16T05:56:39.263 INFO:tasks.workunit.client.1.smithi156.stdout:2/502: rmdir d9/d12/d3d 39 2023-12-16T05:56:39.264 INFO:tasks.workunit.client.0.smithi155.stdout:2/688: symlink d0/d7/dd/d49/d4b/le6 0 2023-12-16T05:56:39.264 INFO:tasks.workunit.client.1.smithi156.stdout:8/383: getdents d3/d7/d27/d46 0 2023-12-16T05:56:39.265 INFO:tasks.workunit.client.1.smithi156.stdout:7/698: read d1e/d55/d71/f4b [938567,105791] 0 2023-12-16T05:56:39.266 INFO:tasks.workunit.client.1.smithi156.stdout:2/503: creat d9/d56/d5f/f9f x:0 0 0 2023-12-16T05:56:39.266 INFO:tasks.workunit.client.1.smithi156.stdout:6/546: dread d9/f85 [0,4194304] 0 2023-12-16T05:56:39.266 INFO:tasks.workunit.client.0.smithi155.stdout:4/682: mknod d0/d10/d46/d16/d1a/dd1/cdc 0 2023-12-16T05:56:39.266 INFO:tasks.workunit.client.1.smithi156.stdout:8/384: creat d3/d7/d27/d46/f79 x:0 0 0 2023-12-16T05:56:39.267 INFO:tasks.workunit.client.0.smithi155.stdout:9/962: symlink da/d15/d17/d24/d62/dea/d117/l141 0 2023-12-16T05:56:39.267 INFO:tasks.workunit.client.0.smithi155.stdout:9/963: fsync da/d15/d17/d36/dc1/ff8 0 2023-12-16T05:56:39.268 INFO:tasks.workunit.client.0.smithi155.stdout:8/785: creat d4/d62/d66/d78/d88/d12/f108 x:0 0 0 2023-12-16T05:56:39.268 INFO:tasks.workunit.client.0.smithi155.stdout:1/858: symlink d1/d7/d4b/d5c/dec/l10e 0 2023-12-16T05:56:39.270 INFO:tasks.workunit.client.0.smithi155.stdout:0/768: link d7/df/d73/d8d/lb4 d7/df/d73/l101 0 2023-12-16T05:56:39.270 INFO:tasks.workunit.client.0.smithi155.stdout:0/769: readlink d7/df/d41/d23/d36/l3d 0 2023-12-16T05:56:39.270 INFO:tasks.workunit.client.0.smithi155.stdout:0/770: truncate d7/df/d73/dba/fca 842534 0 2023-12-16T05:56:39.272 INFO:tasks.workunit.client.1.smithi156.stdout:2/504: rename d9/dd/d17/d33/d47/f87 to d9/dd/d17/fa0 0 2023-12-16T05:56:39.272 INFO:tasks.workunit.client.1.smithi156.stdout:2/505: chown d9/dd/d17/d33/d78 90288611 1 2023-12-16T05:56:39.272 INFO:tasks.workunit.client.1.smithi156.stdout:2/506: dread - d9/d56/f9a zero size 2023-12-16T05:56:39.273 INFO:tasks.workunit.client.0.smithi155.stdout:2/689: rename d0/d7/dd/d49/d4b/ddb to d0/d7/d57/d63/de7 0 2023-12-16T05:56:39.273 INFO:tasks.workunit.client.1.smithi156.stdout:8/385: mkdir d3/d7a 0 2023-12-16T05:56:39.273 INFO:tasks.workunit.client.1.smithi156.stdout:8/386: fdatasync d3/f5c 0 2023-12-16T05:56:39.275 INFO:tasks.workunit.client.0.smithi155.stdout:2/690: write d0/d7/d57/d63/de7/fda [281552,34152] 0 2023-12-16T05:56:39.281 INFO:tasks.workunit.client.0.smithi155.stdout:8/786: link d4/d62/d66/d78/ld6 d4/d62/d66/d78/l109 0 2023-12-16T05:56:39.281 INFO:tasks.workunit.client.0.smithi155.stdout:4/683: symlink d0/d10/ldd 0 2023-12-16T05:56:39.282 INFO:tasks.workunit.client.0.smithi155.stdout:1/859: truncate d1/d25/d43/f60 3366777 0 2023-12-16T05:56:39.282 INFO:tasks.workunit.client.1.smithi156.stdout:2/507: dread d9/dd/f19 [0,4194304] 0 2023-12-16T05:56:39.283 INFO:tasks.workunit.client.1.smithi156.stdout:2/508: readlink d9/dd/l53 0 2023-12-16T05:56:39.284 INFO:tasks.workunit.client.0.smithi155.stdout:0/771: mknod d7/df/d73/d8d/d4d/de8/c102 0 2023-12-16T05:56:39.284 INFO:tasks.workunit.client.0.smithi155.stdout:8/787: read d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d103/ff2 [445284,99598] 0 2023-12-16T05:56:39.285 INFO:tasks.workunit.client.1.smithi156.stdout:2/509: rename d9/dd/d17/d33/d86 to d9/dd/d3f/d83/da1 0 2023-12-16T05:56:39.285 INFO:tasks.workunit.client.1.smithi156.stdout:2/510: read d9/d12/f45 [526581,102228] 0 2023-12-16T05:56:39.285 INFO:tasks.workunit.client.1.smithi156.stdout:2/511: write d9/dd/d3f/f67 [858582,4947] 0 2023-12-16T05:56:39.286 INFO:tasks.workunit.client.0.smithi155.stdout:4/684: link d0/da/f73 d0/d10/d46/d16/d1a/d70/d92/fde 0 2023-12-16T05:56:39.286 INFO:tasks.workunit.client.0.smithi155.stdout:4/685: chown d0/d10/d46/d16/d1a/d70/d92/daf/db7/dbc 6558 1 2023-12-16T05:56:39.286 INFO:tasks.workunit.client.1.smithi156.stdout:2/512: write d9/dd/d17/d33/d78/d39/f3e [415844,66235] 0 2023-12-16T05:56:39.288 INFO:tasks.workunit.client.0.smithi155.stdout:1/860: mknod d1/d7/d4b/d8e/c10f 0 2023-12-16T05:56:39.289 INFO:tasks.workunit.client.1.smithi156.stdout:2/513: mkdir d9/dd/d17/d33/d78/d39/d8c/da2 0 2023-12-16T05:56:39.291 INFO:tasks.workunit.client.0.smithi155.stdout:0/772: link d7/df/d73/d8d/d4d/de8/lbb d7/df/d73/d8d/d4d/de8/l103 0 2023-12-16T05:56:39.291 INFO:tasks.workunit.client.0.smithi155.stdout:4/686: read d0/d10/d46/d16/d30/dce/d75/f25 [99249,116055] 0 2023-12-16T05:56:39.291 INFO:tasks.workunit.client.0.smithi155.stdout:4/687: truncate d0/d10/f12 9380025 0 2023-12-16T05:56:39.291 INFO:tasks.workunit.client.0.smithi155.stdout:8/788: mkdir d4/d62/d66/d78/d88/d1b/d1c/d19/da3/d10a 0 2023-12-16T05:56:39.297 INFO:tasks.workunit.client.1.smithi156.stdout:5/716: dwrite da/dc/d2d/d4d/d54/d90/dc3/fc8 [0,4194304] 0 2023-12-16T05:56:39.297 INFO:tasks.workunit.client.1.smithi156.stdout:5/717: write da/dc/d2d/db0/fba [758455,88135] 0 2023-12-16T05:56:39.298 INFO:tasks.workunit.client.1.smithi156.stdout:5/718: rename da/dc/d2d/d34/c60 to da/dc/d2d/d4d/d54/ce7 0 2023-12-16T05:56:39.299 INFO:tasks.workunit.client.0.smithi155.stdout:0/773: creat d7/d13/f104 x:0 0 0 2023-12-16T05:56:39.299 INFO:tasks.workunit.client.0.smithi155.stdout:0/774: fsync d7/d13/d45/fc5 0 2023-12-16T05:56:39.299 INFO:tasks.workunit.client.0.smithi155.stdout:0/775: read - d7/df/d73/d8d/fc8 zero size 2023-12-16T05:56:39.299 INFO:tasks.workunit.client.0.smithi155.stdout:0/776: chown d7/df/d73/dba 125885965 1 2023-12-16T05:56:39.299 INFO:tasks.workunit.client.0.smithi155.stdout:0/777: chown d7/df/d41/d23/l2c 10513 1 2023-12-16T05:56:39.299 INFO:tasks.workunit.client.0.smithi155.stdout:0/778: write d7/df/d73/d8d/d4d/faf [8781072,3082] 0 2023-12-16T05:56:39.299 INFO:tasks.workunit.client.0.smithi155.stdout:0/779: chown d7/d13/d45/f6c 1 1 2023-12-16T05:56:39.299 INFO:tasks.workunit.client.0.smithi155.stdout:8/789: rmdir d4/d62/d66/d78/d88/d9e 39 2023-12-16T05:56:39.299 INFO:tasks.workunit.client.0.smithi155.stdout:4/688: mkdir d0/d10/d46/d16/d1a/dd1/ddf 0 2023-12-16T05:56:39.299 INFO:tasks.workunit.client.0.smithi155.stdout:4/689: readlink d0/da/l31 0 2023-12-16T05:56:39.300 INFO:tasks.workunit.client.0.smithi155.stdout:1/861: dread d1/d7/d16/d30/f62 [0,4194304] 0 2023-12-16T05:56:39.300 INFO:tasks.workunit.client.0.smithi155.stdout:1/862: chown d1/d7/d16/de5 8425 1 2023-12-16T05:56:39.300 INFO:tasks.workunit.client.1.smithi156.stdout:2/514: write d9/dd/d17/d33/d78/d39/f76 [3849204,21569] 0 2023-12-16T05:56:39.300 INFO:tasks.workunit.client.1.smithi156.stdout:2/515: fdatasync d9/d12/f45 0 2023-12-16T05:56:39.300 INFO:tasks.workunit.client.1.smithi156.stdout:5/719: creat da/dc/d4b/d6c/d77/d8f/fe8 x:0 0 0 2023-12-16T05:56:39.303 INFO:tasks.workunit.client.0.smithi155.stdout:1/863: rename d1/ff to d1/d69/f110 0 2023-12-16T05:56:39.303 INFO:tasks.workunit.client.0.smithi155.stdout:8/790: dread d4/d62/d66/d78/d88/d1b/d1c/d19/d64/fa4 [0,4194304] 0 2023-12-16T05:56:39.304 INFO:tasks.workunit.client.1.smithi156.stdout:5/720: mknod da/dc/ce9 0 2023-12-16T05:56:39.305 INFO:tasks.workunit.client.0.smithi155.stdout:1/864: truncate d1/d25/f32 3824164 0 2023-12-16T05:56:39.306 INFO:tasks.workunit.client.0.smithi155.stdout:8/791: write d4/d62/d66/d78/d88/d1b/d1c/d97/fd7 [2782257,127616] 0 2023-12-16T05:56:39.306 INFO:tasks.workunit.client.1.smithi156.stdout:5/721: creat da/dc/d4b/d6c/d81/dc5/fea x:0 0 0 2023-12-16T05:56:39.307 INFO:tasks.workunit.client.1.smithi156.stdout:5/722: write da/dc/d2d/d34/fcf [348916,8716] 0 2023-12-16T05:56:39.307 INFO:tasks.workunit.client.1.smithi156.stdout:5/723: write da/dc/d4b/d6c/d7c/d85/f8d [383656,7940] 0 2023-12-16T05:56:39.307 INFO:tasks.workunit.client.1.smithi156.stdout:5/724: chown da/dc/d2d/d4d/d54 781 1 2023-12-16T05:56:39.307 INFO:tasks.workunit.client.1.smithi156.stdout:5/725: stat da/dc/d2d/d4d/d54/d90/fbc 0 2023-12-16T05:56:39.307 INFO:tasks.workunit.client.0.smithi155.stdout:1/865: rename d1/d7/d4b/d8e/dc7/d28/d85/de0/fa6 to d1/d25/d43/d5d/d102/f111 0 2023-12-16T05:56:39.308 INFO:tasks.workunit.client.1.smithi156.stdout:5/726: mkdir da/dc/d4b/d6c/d81/dc5/deb 0 2023-12-16T05:56:39.308 INFO:tasks.workunit.client.0.smithi155.stdout:8/792: creat d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/f10b x:0 0 0 2023-12-16T05:56:39.309 INFO:tasks.workunit.client.0.smithi155.stdout:1/866: creat d1/d7/d4b/d8e/dc7/f112 x:0 0 0 2023-12-16T05:56:39.309 INFO:tasks.workunit.client.0.smithi155.stdout:8/793: mkdir d4/d62/d10c 0 2023-12-16T05:56:39.310 INFO:tasks.workunit.client.0.smithi155.stdout:1/867: mkdir d1/d7/d4b/d8e/dc7/d28/d8f/db2/d103/d113 0 2023-12-16T05:56:39.311 INFO:tasks.workunit.client.0.smithi155.stdout:8/794: link d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/f60 d4/d62/d66/f10d 0 2023-12-16T05:56:39.313 INFO:tasks.workunit.client.0.smithi155.stdout:1/868: mknod d1/d92/c114 0 2023-12-16T05:56:39.313 INFO:tasks.workunit.client.0.smithi155.stdout:1/869: fdatasync d1/d7/f34 0 2023-12-16T05:56:39.314 INFO:tasks.workunit.client.1.smithi156.stdout:3/417: dwrite dc/f7c [4194304,4194304] 0 2023-12-16T05:56:39.315 INFO:tasks.workunit.client.1.smithi156.stdout:6/547: dwrite d9/d1c/f32 [0,4194304] 0 2023-12-16T05:56:39.315 INFO:tasks.workunit.client.1.smithi156.stdout:3/418: dread dc/d10/d1d/d4b/d52/f54 [0,4194304] 0 2023-12-16T05:56:39.316 INFO:tasks.workunit.client.0.smithi155.stdout:2/691: dwrite d0/d5/d6/f83 [0,4194304] 0 2023-12-16T05:56:39.316 INFO:tasks.workunit.client.0.smithi155.stdout:4/690: dread d0/d10/f12 [0,4194304] 0 2023-12-16T05:56:39.316 INFO:tasks.workunit.client.0.smithi155.stdout:9/964: dwrite da/d15/d17/d36/d5b/d60/fdf [0,4194304] 0 2023-12-16T05:56:39.317 INFO:tasks.workunit.client.0.smithi155.stdout:9/965: fdatasync da/d15/fb1 0 2023-12-16T05:56:39.317 INFO:tasks.workunit.client.0.smithi155.stdout:9/966: stat da/ff 0 2023-12-16T05:56:39.317 INFO:tasks.workunit.client.0.smithi155.stdout:0/780: dwrite d7/d47/d5d/d6a/f7c [0,4194304] 0 2023-12-16T05:56:39.318 INFO:tasks.workunit.client.1.smithi156.stdout:5/727: fsync da/dc/d4b/d6c/d7c/d85/f8d 0 2023-12-16T05:56:39.318 INFO:tasks.workunit.client.1.smithi156.stdout:7/699: dwrite d1e/d1f/d22/d75/d77/fb1 [0,4194304] 0 2023-12-16T05:56:39.318 INFO:tasks.workunit.client.1.smithi156.stdout:8/387: dwrite d3/d18/f57 [0,4194304] 0 2023-12-16T05:56:39.318 INFO:tasks.workunit.client.1.smithi156.stdout:7/700: write d1e/d55/d71/d61/daa/f6f [858214,53711] 0 2023-12-16T05:56:39.318 INFO:tasks.workunit.client.1.smithi156.stdout:8/388: read - d3/d18/f65 zero size 2023-12-16T05:56:39.318 INFO:tasks.workunit.client.1.smithi156.stdout:7/701: fdatasync d1e/d55/d71/f8d 0 2023-12-16T05:56:39.319 INFO:tasks.workunit.client.0.smithi155.stdout:0/781: write d7/d13/d45/d4b/f5f [1567505,39157] 0 2023-12-16T05:56:39.319 INFO:tasks.workunit.client.0.smithi155.stdout:0/782: fdatasync f2 0 2023-12-16T05:56:39.319 INFO:tasks.workunit.client.0.smithi155.stdout:0/783: readlink d7/df/d6f/le9 0 2023-12-16T05:56:39.319 INFO:tasks.workunit.client.0.smithi155.stdout:2/692: rename d0/d34/f72 to d0/d5/d6/d5f/fe8 0 2023-12-16T05:56:39.319 INFO:tasks.workunit.client.0.smithi155.stdout:2/693: chown d0/d5/de2 28746 1 2023-12-16T05:56:39.319 INFO:tasks.workunit.client.0.smithi155.stdout:2/694: write d0/d7/d1f/d74/d85/d88/f89 [1004738,125284] 0 2023-12-16T05:56:39.320 INFO:tasks.workunit.client.0.smithi155.stdout:1/870: read d1/d25/d43/d5d/d5e/fa1 [106588,128822] 0 2023-12-16T05:56:39.320 INFO:tasks.workunit.client.0.smithi155.stdout:1/871: fsync d1/d7/d4b/d8e/dc7/d28/d8f/f96 0 2023-12-16T05:56:39.325 INFO:tasks.workunit.client.1.smithi156.stdout:6/548: rename d9/d13/d2f/d51/d82/l88 to d9/d13/d2f/d51/d6b/d77/la4 0 2023-12-16T05:56:39.326 INFO:tasks.workunit.client.1.smithi156.stdout:3/419: link dc/df/d34/d62/c85 dc/d10/d1d/d90/ca2 0 2023-12-16T05:56:39.327 INFO:tasks.workunit.client.0.smithi155.stdout:9/967: dread da/d15/f5e [0,4194304] 0 2023-12-16T05:56:39.327 INFO:tasks.workunit.client.0.smithi155.stdout:9/968: stat da/d15/d17/d36/d5b/d60/lb4 0 2023-12-16T05:56:39.327 INFO:tasks.workunit.client.0.smithi155.stdout:9/969: chown da/d15/d17/d24/d62/d91/dc0/fd9 43119832 1 2023-12-16T05:56:39.328 INFO:tasks.workunit.client.0.smithi155.stdout:0/784: rmdir d7/df/d65 39 2023-12-16T05:56:39.328 INFO:tasks.workunit.client.0.smithi155.stdout:9/970: dread da/d15/d17/d24/d26/d2e/d32/fe2 [0,4194304] 0 2023-12-16T05:56:39.328 INFO:tasks.workunit.client.0.smithi155.stdout:9/971: readlink da/d15/d17/d24/d26/l108 0 2023-12-16T05:56:39.329 INFO:tasks.workunit.client.1.smithi156.stdout:5/728: mkdir da/dc/d2d/d4d/db9/dec 0 2023-12-16T05:56:39.331 INFO:tasks.workunit.client.0.smithi155.stdout:4/691: rename d0/d10/d46 to d0/da/de0 0 2023-12-16T05:56:39.332 INFO:tasks.workunit.client.0.smithi155.stdout:1/872: creat d1/d69/f115 x:0 0 0 2023-12-16T05:56:39.332 INFO:tasks.workunit.client.0.smithi155.stdout:1/873: dread - d1/d7/d4b/d8e/dc7/d28/d8f/dad/fb1 zero size 2023-12-16T05:56:39.334 INFO:tasks.workunit.client.0.smithi155.stdout:9/972: unlink da/d15/d17/d24/d26/d2e/f4a 0 2023-12-16T05:56:39.334 INFO:tasks.workunit.client.1.smithi156.stdout:7/702: creat d1e/d55/d71/ff9 x:0 0 0 2023-12-16T05:56:39.334 INFO:tasks.workunit.client.1.smithi156.stdout:7/703: fsync d1e/d55/d71/f4b 0 2023-12-16T05:56:39.335 INFO:tasks.workunit.client.1.smithi156.stdout:8/389: creat d3/d12/d74/f7b x:0 0 0 2023-12-16T05:56:39.336 INFO:tasks.workunit.client.0.smithi155.stdout:0/785: rename d7/df/d73/d8d/c76 to d7/d13/d45/d3e/c105 0 2023-12-16T05:56:39.336 INFO:tasks.workunit.client.0.smithi155.stdout:4/692: getdents d0/da/de0/d16/d30/d52/d88/d9e 0 2023-12-16T05:56:39.338 INFO:tasks.workunit.client.0.smithi155.stdout:1/874: creat d1/d7/d4b/d8e/dc7/d28/d85/de0/d7e/f116 x:0 0 0 2023-12-16T05:56:39.338 INFO:tasks.workunit.client.1.smithi156.stdout:6/549: link d9/d1c/l33 d9/d13/d2f/d51/d69/d99/la5 0 2023-12-16T05:56:39.338 INFO:tasks.workunit.client.1.smithi156.stdout:6/550: dread - d9/d13/d3e/f83 zero size 2023-12-16T05:56:39.338 INFO:tasks.workunit.client.1.smithi156.stdout:3/420: creat dc/d10/d1d/fa3 x:0 0 0 2023-12-16T05:56:39.339 INFO:tasks.workunit.client.1.smithi156.stdout:3/421: stat dc/d56/d67/d6e/c88 0 2023-12-16T05:56:39.339 INFO:tasks.workunit.client.1.smithi156.stdout:3/422: readlink dc/d10/d1d/d4b/d52/l5e 0 2023-12-16T05:56:39.339 INFO:tasks.workunit.client.0.smithi155.stdout:9/973: creat da/d15/d17/d36/d5b/d60/db9/de4/f142 x:0 0 0 2023-12-16T05:56:39.339 INFO:tasks.workunit.client.0.smithi155.stdout:9/974: chown da/d15/d17/d24/d26/c112 6 1 2023-12-16T05:56:39.340 INFO:tasks.workunit.client.0.smithi155.stdout:2/695: dwrite d0/d5/fbb [0,4194304] 0 2023-12-16T05:56:39.340 INFO:tasks.workunit.client.1.smithi156.stdout:5/729: creat da/dc/d4b/d6c/d81/dc5/fed x:0 0 0 2023-12-16T05:56:39.341 INFO:tasks.workunit.client.0.smithi155.stdout:0/786: truncate d7/f29 1054683 0 2023-12-16T05:56:39.341 INFO:tasks.workunit.client.0.smithi155.stdout:8/795: dwrite d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/fe8 [0,4194304] 0 2023-12-16T05:56:39.341 INFO:tasks.workunit.client.0.smithi155.stdout:8/796: dread - d4/fac zero size 2023-12-16T05:56:39.341 INFO:tasks.workunit.client.0.smithi155.stdout:8/797: chown d4/d62/d66/d78/d88/d1b/d1c/d1a/lf6 71193201 1 2023-12-16T05:56:39.342 INFO:tasks.workunit.client.1.smithi156.stdout:7/704: creat d1e/d1f/ffa x:0 0 0 2023-12-16T05:56:39.343 INFO:tasks.workunit.client.0.smithi155.stdout:4/693: rename d0/da/de0/d16/d30/f7e to d0/da/de0/d16/d30/dce/d75/d89/fe1 0 2023-12-16T05:56:39.343 INFO:tasks.workunit.client.0.smithi155.stdout:4/694: chown d0/da/de0/d16/d30/dce/d75/d50/f6a 29 1 2023-12-16T05:56:39.343 INFO:tasks.workunit.client.0.smithi155.stdout:4/695: readlink d0/da/de0/d16/d1a/l65 0 2023-12-16T05:56:39.344 INFO:tasks.workunit.client.1.smithi156.stdout:8/390: creat d3/d7/d62/d6b/f7c x:0 0 0 2023-12-16T05:56:39.344 INFO:tasks.workunit.client.0.smithi155.stdout:4/696: read d0/da/de0/d16/d1a/d70/d92/daf/fb8 [32212,87784] 0 2023-12-16T05:56:39.344 INFO:tasks.workunit.client.0.smithi155.stdout:4/697: truncate d0/da/de0/d16/fcc 363119 0 2023-12-16T05:56:39.344 INFO:tasks.workunit.client.0.smithi155.stdout:4/698: chown d0/da/de0/d16/d30/dce/d75/d3d/d43/c4c 5942 1 2023-12-16T05:56:39.345 INFO:tasks.workunit.client.1.smithi156.stdout:6/551: creat d9/d13/d2f/d51/d6b/d77/d7e/fa6 x:0 0 0 2023-12-16T05:56:39.345 INFO:tasks.workunit.client.0.smithi155.stdout:4/699: read d0/da/de0/d16/d30/dce/d75/d3d/d43/f62 [934111,30988] 0 2023-12-16T05:56:39.345 INFO:tasks.workunit.client.0.smithi155.stdout:1/875: creat d1/d7/d4b/d8e/dc7/df4/f117 x:0 0 0 2023-12-16T05:56:39.350 INFO:tasks.workunit.client.1.smithi156.stdout:8/391: mkdir d3/d7a/d7d 0 2023-12-16T05:56:39.350 INFO:tasks.workunit.client.1.smithi156.stdout:8/392: write d3/d18/f41 [1903314,13288] 0 2023-12-16T05:56:39.350 INFO:tasks.workunit.client.1.smithi156.stdout:6/552: write d9/d13/d2f/d51/f90 [338883,13956] 0 2023-12-16T05:56:39.352 INFO:tasks.workunit.client.0.smithi155.stdout:0/787: stat d7/df/d41/c27 0 2023-12-16T05:56:39.352 INFO:tasks.workunit.client.1.smithi156.stdout:6/553: mknod d9/d1c/d50/ca7 0 2023-12-16T05:56:39.354 INFO:tasks.workunit.client.1.smithi156.stdout:6/554: read d9/d1c/f6a [910759,91224] 0 2023-12-16T05:56:39.354 INFO:tasks.workunit.client.1.smithi156.stdout:6/555: stat d9/d13/d2f/d51/d69/d99 0 2023-12-16T05:56:39.355 INFO:tasks.workunit.client.1.smithi156.stdout:5/730: dread da/dc/f13 [0,4194304] 0 2023-12-16T05:56:39.356 INFO:tasks.workunit.client.1.smithi156.stdout:6/556: symlink d9/d1c/d50/la8 0 2023-12-16T05:56:39.356 INFO:tasks.workunit.client.1.smithi156.stdout:6/557: truncate d9/d1c/f2b 4635970 0 2023-12-16T05:56:39.356 INFO:tasks.workunit.client.1.smithi156.stdout:7/705: dwrite d1e/d55/d71/d61/fe5 [0,4194304] 0 2023-12-16T05:56:39.359 INFO:tasks.workunit.client.1.smithi156.stdout:5/731: link da/dc/d2d/c8b da/dc/d4b/d6c/d81/cee 0 2023-12-16T05:56:39.359 INFO:tasks.workunit.client.1.smithi156.stdout:6/558: rmdir d9/d13/d2f/d51/d69 39 2023-12-16T05:56:39.359 INFO:tasks.workunit.client.0.smithi155.stdout:0/788: mkdir d7/df/d41/d106 0 2023-12-16T05:56:39.361 INFO:tasks.workunit.client.0.smithi155.stdout:8/798: mkdir d4/d62/d66/d78/d88/d1b/d1c/d97/df3/d10e 0 2023-12-16T05:56:39.362 INFO:tasks.workunit.client.0.smithi155.stdout:9/975: rename da/d15/d17/d36/d5b/d60/fdf to da/d15/d17/d36/d5b/d60/db9/f143 0 2023-12-16T05:56:39.362 INFO:tasks.workunit.client.0.smithi155.stdout:1/876: rename d1/d7 to d1/d7/d4b/d8e/dc7/d28/d85/de0/d79/daa/d118 22 2023-12-16T05:56:39.363 INFO:tasks.workunit.client.1.smithi156.stdout:6/559: symlink d9/d13/d2f/d51/d82/la9 0 2023-12-16T05:56:39.364 INFO:tasks.workunit.client.0.smithi155.stdout:0/789: rmdir d7/df/d73/d8d/d4d 39 2023-12-16T05:56:39.364 INFO:tasks.workunit.client.0.smithi155.stdout:0/790: chown d7/df/d73/da2 1243262 1 2023-12-16T05:56:39.366 INFO:tasks.workunit.client.0.smithi155.stdout:9/976: creat da/d15/d17/d24/d26/d2e/d32/d136/f144 x:0 0 0 2023-12-16T05:56:39.368 INFO:tasks.workunit.client.0.smithi155.stdout:1/877: symlink d1/d7/d4b/d8e/dc7/d28/d74/dc5/l119 0 2023-12-16T05:56:39.369 INFO:tasks.workunit.client.1.smithi156.stdout:6/560: read d9/d13/d2f/d36/f65 [632979,29218] 0 2023-12-16T05:56:39.370 INFO:tasks.workunit.client.1.smithi156.stdout:7/706: dwrite d1e/d55/d71/d61/dac/fd4 [0,4194304] 0 2023-12-16T05:56:39.370 INFO:tasks.workunit.client.1.smithi156.stdout:7/707: fsync d1e/d55/f7e 0 2023-12-16T05:56:39.371 INFO:tasks.workunit.client.0.smithi155.stdout:2/696: truncate d0/d5/fbb 3603984 0 2023-12-16T05:56:39.372 INFO:tasks.workunit.client.0.smithi155.stdout:0/791: symlink d7/df/d41/d23/de1/l107 0 2023-12-16T05:56:39.372 INFO:tasks.workunit.client.1.smithi156.stdout:5/732: read da/dc/d2d/d4d/d54/f5d [3080519,119266] 0 2023-12-16T05:56:39.373 INFO:tasks.workunit.client.0.smithi155.stdout:4/700: dread d0/da/de0/d16/d30/dce/d75/f45 [0,4194304] 0 2023-12-16T05:56:39.375 INFO:tasks.workunit.client.1.smithi156.stdout:7/708: mkdir d1e/d1f/da6/d57/d59/dfb 0 2023-12-16T05:56:39.375 INFO:tasks.workunit.client.0.smithi155.stdout:1/878: truncate d1/d7/d4b/f50 2342259 0 2023-12-16T05:56:39.376 INFO:tasks.workunit.client.1.smithi156.stdout:3/423: dwrite dc/d10/d1d/d4b/f51 [0,4194304] 0 2023-12-16T05:56:39.377 INFO:tasks.workunit.client.0.smithi155.stdout:9/977: dread da/d15/d17/d24/d62/d91/f110 [0,4194304] 0 2023-12-16T05:56:39.378 INFO:tasks.workunit.client.0.smithi155.stdout:0/792: link d7/d47/d5d/f74 d7/df/d73/d8d/d4d/de8/dd6/f108 0 2023-12-16T05:56:39.378 INFO:tasks.workunit.client.0.smithi155.stdout:0/793: chown d7/df/d73/d8d/d4d/l96 21 1 2023-12-16T05:56:39.379 INFO:tasks.workunit.client.1.smithi156.stdout:6/561: dread d9/d1c/f47 [0,4194304] 0 2023-12-16T05:56:39.380 INFO:tasks.workunit.client.0.smithi155.stdout:1/879: mkdir d1/d7/d4b/d8e/dc7/d28/d8f/db2/d103/d11a 0 2023-12-16T05:56:39.382 INFO:tasks.workunit.client.1.smithi156.stdout:6/562: rmdir d9/d1c 39 2023-12-16T05:56:39.382 INFO:tasks.workunit.client.1.smithi156.stdout:6/563: truncate d9/d13/d2f/d51/f56 2968168 0 2023-12-16T05:56:39.383 INFO:tasks.workunit.client.0.smithi155.stdout:0/794: dread d7/d2d/f3f [0,4194304] 0 2023-12-16T05:56:39.383 INFO:tasks.workunit.client.0.smithi155.stdout:0/795: truncate d7/d13/f104 287376 0 2023-12-16T05:56:39.383 INFO:tasks.workunit.client.0.smithi155.stdout:0/796: chown d7/df/d65/f39 11 1 2023-12-16T05:56:39.383 INFO:tasks.workunit.client.0.smithi155.stdout:8/799: dwrite d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d103/ff2 [0,4194304] 0 2023-12-16T05:56:39.384 INFO:tasks.workunit.client.0.smithi155.stdout:1/880: rename d1/d7/d16/de5 to d1/d7/d4b/d8e/dc7/d28/d8f/d11b 0 2023-12-16T05:56:39.385 INFO:tasks.workunit.client.1.smithi156.stdout:6/564: rename d9/d1c/d50/ca7 to d9/d13/d2f/d51/caa 0 2023-12-16T05:56:39.385 INFO:tasks.workunit.client.1.smithi156.stdout:6/565: dread - d9/d1c/f6f zero size 2023-12-16T05:56:39.386 INFO:tasks.workunit.client.0.smithi155.stdout:0/797: rmdir d7/d13/d46/df3 39 2023-12-16T05:56:39.386 INFO:tasks.workunit.client.1.smithi156.stdout:6/566: creat d9/d13/d2f/d51/d6b/fab x:0 0 0 2023-12-16T05:56:39.393 INFO:tasks.workunit.client.0.smithi155.stdout:8/800: rename d4/d62/d66/d78/d88/d1b/d1c/d19/da3/fdd to d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/f10f 0 2023-12-16T05:56:39.395 INFO:tasks.workunit.client.0.smithi155.stdout:1/881: rmdir d1/d25/d43/d5d/d5e 39 2023-12-16T05:56:39.397 INFO:tasks.workunit.client.1.smithi156.stdout:7/709: dwrite d1e/d55/fde [0,4194304] 0 2023-12-16T05:56:39.397 INFO:tasks.workunit.client.1.smithi156.stdout:7/710: write d1e/d1f/da6/d57/dbb/fcc [68986,104142] 0 2023-12-16T05:56:39.397 INFO:tasks.workunit.client.1.smithi156.stdout:7/711: chown d1e/d1f/d22/d75/d77/c7a 14743 1 2023-12-16T05:56:39.397 INFO:tasks.workunit.client.1.smithi156.stdout:7/712: fdatasync d1e/d55/d71/d61/f91 0 2023-12-16T05:56:39.398 INFO:tasks.workunit.client.0.smithi155.stdout:0/798: rename d7/d13/c1f to d7/d2d/c109 0 2023-12-16T05:56:39.400 INFO:tasks.workunit.client.0.smithi155.stdout:8/801: mkdir d4/d62/d66/d78/d88/d1b/d1c/d19/dd0/d110 0 2023-12-16T05:56:39.401 INFO:tasks.workunit.client.1.smithi156.stdout:7/713: symlink d1e/d1f/d72/da4/df2/lfc 0 2023-12-16T05:56:39.401 INFO:tasks.workunit.client.0.smithi155.stdout:4/701: dwrite d0/da/de0/d16/d30/dce/d75/d50/f6a [0,4194304] 0 2023-12-16T05:56:39.402 INFO:tasks.workunit.client.1.smithi156.stdout:7/714: getdents d1e/d1f/d22/d75 0 2023-12-16T05:56:39.402 INFO:tasks.workunit.client.1.smithi156.stdout:7/715: fsync d1e/d1f/fe7 0 2023-12-16T05:56:39.402 INFO:tasks.workunit.client.1.smithi156.stdout:7/716: fdatasync d1e/d55/d71/d61/f36 0 2023-12-16T05:56:39.403 INFO:tasks.workunit.client.0.smithi155.stdout:1/882: rename d1/d7/d4b/d8e/dc7/d28/d74/dc5/l119 to d1/d7/d4b/d8e/dc7/d28/d8f/db2/d103/l11c 0 2023-12-16T05:56:39.403 INFO:tasks.workunit.client.0.smithi155.stdout:1/883: truncate d1/d7/d4b/d8e/dc7/d28/d85/de0/d79/f9c 883807 0 2023-12-16T05:56:39.404 INFO:tasks.workunit.client.1.smithi156.stdout:7/717: creat d1e/d55/d71/d94/ffd x:0 0 0 2023-12-16T05:56:39.404 INFO:tasks.workunit.client.0.smithi155.stdout:8/802: mknod d4/d62/c111 0 2023-12-16T05:56:39.404 INFO:tasks.workunit.client.0.smithi155.stdout:8/803: write d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d103/ffb [448781,61768] 0 2023-12-16T05:56:39.406 INFO:tasks.workunit.client.1.smithi156.stdout:4/510: sync 2023-12-16T05:56:39.406 INFO:tasks.workunit.client.1.smithi156.stdout:4/511: chown d9/c52 8943259 1 2023-12-16T05:56:39.406 INFO:tasks.workunit.client.0.smithi155.stdout:1/884: write d1/f35 [437406,35602] 0 2023-12-16T05:56:39.407 INFO:tasks.workunit.client.1.smithi156.stdout:4/512: creat d9/d2c/d7a/fab x:0 0 0 2023-12-16T05:56:39.407 INFO:tasks.workunit.client.0.smithi155.stdout:4/702: mkdir d0/da/de0/d16/d30/dce/d7b/de2 0 2023-12-16T05:56:39.407 INFO:tasks.workunit.client.0.smithi155.stdout:0/799: write d7/d47/d53/fdc [3795225,75555] 0 2023-12-16T05:56:39.408 INFO:tasks.workunit.client.1.smithi156.stdout:4/513: creat d9/d43/fac x:0 0 0 2023-12-16T05:56:39.409 INFO:tasks.workunit.client.0.smithi155.stdout:8/804: unlink d4/d62/d66/d78/d88/d1b/d1c/d1a/fd8 0 2023-12-16T05:56:39.412 INFO:tasks.workunit.client.0.smithi155.stdout:4/703: creat d0/da/de0/d16/d30/dce/d75/d3d/d43/fe3 x:0 0 0 2023-12-16T05:56:39.412 INFO:tasks.workunit.client.0.smithi155.stdout:4/704: fsync d0/da/f5a 0 2023-12-16T05:56:39.415 INFO:tasks.workunit.client.0.smithi155.stdout:4/705: dread d0/da/d36/f7f [0,4194304] 0 2023-12-16T05:56:39.415 INFO:tasks.workunit.client.0.smithi155.stdout:4/706: readlink d0/da/de0/d16/d30/dce/d75/d3d/d49/l53 0 2023-12-16T05:56:39.417 INFO:tasks.workunit.client.0.smithi155.stdout:0/800: rename d7/d13/d45/d4b to d7/df/d41/d23/d36/dad/d10a 0 2023-12-16T05:56:39.420 INFO:tasks.workunit.client.0.smithi155.stdout:4/707: mknod d0/da/de0/d16/d1a/d70/d92/daf/db7/dbc/ce4 0 2023-12-16T05:56:39.420 INFO:tasks.workunit.client.0.smithi155.stdout:4/708: chown d0/d10/f5b 5 1 2023-12-16T05:56:39.420 INFO:tasks.workunit.client.0.smithi155.stdout:4/709: stat d0/d10/f2c 0 2023-12-16T05:56:39.420 INFO:tasks.workunit.client.0.smithi155.stdout:4/710: chown d0/d10/c7c 110672548 1 2023-12-16T05:56:39.421 INFO:tasks.workunit.client.0.smithi155.stdout:1/885: dread d1/d7/d16/d30/f62 [0,4194304] 0 2023-12-16T05:56:39.422 INFO:tasks.workunit.client.0.smithi155.stdout:0/801: getdents d7/df/d6f 0 2023-12-16T05:56:39.422 INFO:tasks.workunit.client.0.smithi155.stdout:9/978: dwrite da/d15/d17/d36/d5b/d60/d9e/fa5 [0,4194304] 0 2023-12-16T05:56:39.423 INFO:tasks.workunit.client.1.smithi156.stdout:6/567: dwrite d9/d13/f17 [0,4194304] 0 2023-12-16T05:56:39.424 INFO:tasks.workunit.client.0.smithi155.stdout:8/805: unlink d4/d62/d66/d78/d88/d1b/d1c/d97/fa1 0 2023-12-16T05:56:39.427 INFO:tasks.workunit.client.0.smithi155.stdout:9/979: mkdir da/d15/d17/d24/d62/d91/d145 0 2023-12-16T05:56:39.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:39 smithi156 ceph-mon[121001]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:56:39.430 INFO:tasks.workunit.client.0.smithi155.stdout:2/697: dwrite d0/d5/fbb [0,4194304] 0 2023-12-16T05:56:39.430 INFO:tasks.workunit.client.0.smithi155.stdout:2/698: truncate d0/d7/dd/d49/d4b/d80/f9c 1014990 0 2023-12-16T05:56:39.430 INFO:tasks.workunit.client.1.smithi156.stdout:7/718: dwrite d1e/d1f/d22/d75/d77/fd5 [0,4194304] 0 2023-12-16T05:56:39.433 INFO:tasks.workunit.client.1.smithi156.stdout:4/514: dwrite d9/d43/d58/f89 [0,4194304] 0 2023-12-16T05:56:39.435 INFO:tasks.workunit.client.0.smithi155.stdout:8/806: symlink d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/l112 0 2023-12-16T05:56:39.435 INFO:tasks.workunit.client.1.smithi156.stdout:4/515: symlink d9/d2c/lad 0 2023-12-16T05:56:39.436 INFO:tasks.workunit.client.0.smithi155.stdout:4/711: rename d0/da/de0/d16/d30/dce/d75/d3d/d85/fc7 to d0/fe5 0 2023-12-16T05:56:39.437 INFO:tasks.workunit.client.1.smithi156.stdout:6/568: dread f6 [4194304,4194304] 0 2023-12-16T05:56:39.438 INFO:tasks.workunit.client.0.smithi155.stdout:9/980: unlink da/d15/d17/d24/d26/d2e/d83/d8f/la3 0 2023-12-16T05:56:39.438 INFO:tasks.workunit.client.0.smithi155.stdout:9/981: stat da/d15/d17/d36/d54/d10f/f124 0 2023-12-16T05:56:39.438 INFO:tasks.workunit.client.1.smithi156.stdout:4/516: rename d9/d2b/d56 to d9/d2c/d48/dae 0 2023-12-16T05:56:39.439 INFO:tasks.workunit.client.0.smithi155.stdout:8/807: mknod d4/d62/d66/d78/d88/d12/c113 0 2023-12-16T05:56:39.440 INFO:tasks.workunit.client.1.smithi156.stdout:6/569: rename d9/d13/f1b to d9/d1c/fac 0 2023-12-16T05:56:39.440 INFO:tasks.workunit.client.1.smithi156.stdout:6/570: readlink d9/d13/l9f 0 2023-12-16T05:56:39.440 INFO:tasks.workunit.client.1.smithi156.stdout:6/571: dread - d9/d13/d3e/f83 zero size 2023-12-16T05:56:39.440 INFO:tasks.workunit.client.1.smithi156.stdout:6/572: chown d9/d13/f17 76987773 1 2023-12-16T05:56:39.441 INFO:tasks.workunit.client.1.smithi156.stdout:4/517: mknod d9/d2c/caf 0 2023-12-16T05:56:39.441 INFO:tasks.workunit.client.1.smithi156.stdout:6/573: write d9/d13/d3e/f6c [4580852,67667] 0 2023-12-16T05:56:39.441 INFO:tasks.workunit.client.0.smithi155.stdout:0/802: rename d7/d13/f17 to d7/df/d73/d8d/d4d/f10b 0 2023-12-16T05:56:39.443 INFO:tasks.workunit.client.0.smithi155.stdout:4/712: creat d0/da/de0/d16/d30/dce/d75/d89/d9a/fe6 x:0 0 0 2023-12-16T05:56:39.444 INFO:tasks.workunit.client.1.smithi156.stdout:6/574: mkdir d9/d13/d2f/d51/dad 0 2023-12-16T05:56:39.444 INFO:tasks.workunit.client.0.smithi155.stdout:9/982: truncate da/d15/d17/d24/d26/d2e/fe1 619753 0 2023-12-16T05:56:39.444 INFO:tasks.workunit.client.0.smithi155.stdout:5/800: sync 2023-12-16T05:56:39.446 INFO:tasks.workunit.client.1.smithi156.stdout:6/575: creat d9/d13/d2f/d51/d6b/fae x:0 0 0 2023-12-16T05:56:39.447 INFO:tasks.workunit.client.0.smithi155.stdout:2/699: rename d0/d7/d1f/d74/d85/fb2 to d0/d34/d3c/fe9 0 2023-12-16T05:56:39.447 INFO:tasks.workunit.client.0.smithi155.stdout:2/700: chown d0/d7/dd/d14/ld7 11540864 1 2023-12-16T05:56:39.449 INFO:tasks.workunit.client.0.smithi155.stdout:0/803: rename d7/d47/d5d/d6a/lc7 to d7/d47/d5d/d6a/l10c 0 2023-12-16T05:56:39.454 INFO:tasks.workunit.client.0.smithi155.stdout:0/804: write d7/d13/d45/d3e/fed [4154483,44000] 0 2023-12-16T05:56:39.454 INFO:tasks.workunit.client.0.smithi155.stdout:0/805: dread - d7/d47/fd0 zero size 2023-12-16T05:56:39.454 INFO:tasks.workunit.client.0.smithi155.stdout:0/806: chown d7/df/d41/d23/d36/dad/d10a/c8a 197590 1 2023-12-16T05:56:39.454 INFO:tasks.workunit.client.0.smithi155.stdout:4/713: creat d0/da/de0/d16/d30/dce/d7b/fe7 x:0 0 0 2023-12-16T05:56:39.454 INFO:tasks.workunit.client.0.smithi155.stdout:2/701: mknod d0/d7/dd/d49/d4b/d8c/dcd/dd2/cea 0 2023-12-16T05:56:39.454 INFO:tasks.workunit.client.0.smithi155.stdout:2/702: chown d0/d7/dd/d14/l37 6033 1 2023-12-16T05:56:39.454 INFO:tasks.workunit.client.1.smithi156.stdout:6/576: dread d9/d1c/f39 [0,4194304] 0 2023-12-16T05:56:39.455 INFO:tasks.workunit.client.1.smithi156.stdout:6/577: link d9/d1c/d50/f84 d9/d13/d3e/d5f/d6e/faf 0 2023-12-16T05:56:39.455 INFO:tasks.workunit.client.1.smithi156.stdout:6/578: truncate d9/d1c/f2b 3405092 0 2023-12-16T05:56:39.455 INFO:tasks.workunit.client.0.smithi155.stdout:4/714: mkdir d0/da/de0/d16/de8 0 2023-12-16T05:56:39.456 INFO:tasks.workunit.client.1.smithi156.stdout:6/579: write d9/d1c/f52 [118632,86956] 0 2023-12-16T05:56:39.457 INFO:tasks.workunit.client.0.smithi155.stdout:2/703: truncate d0/d7/dc1/fcc 559706 0 2023-12-16T05:56:39.459 INFO:tasks.workunit.client.0.smithi155.stdout:4/715: creat d0/da/de0/d16/d30/dce/d75/ddb/fe9 x:0 0 0 2023-12-16T05:56:39.459 INFO:tasks.workunit.client.0.smithi155.stdout:4/716: write d0/da/de0/d16/d30/dce/d75/d3d/d49/dbb/fc8 [464179,124209] 0 2023-12-16T05:56:39.461 INFO:tasks.workunit.client.0.smithi155.stdout:2/704: link d0/d7/dd/l3f d0/d7/dd/d49/d4b/leb 0 2023-12-16T05:56:39.465 INFO:tasks.workunit.client.0.smithi155.stdout:2/705: mknod d0/d7/dd/d62/cec 0 2023-12-16T05:56:39.467 INFO:tasks.workunit.client.0.smithi155.stdout:2/706: getdents d0/d7/d1f/d74/d85 0 2023-12-16T05:56:39.469 INFO:tasks.workunit.client.1.smithi156.stdout:4/518: dwrite d9/d2b/d35/f71 [0,4194304] 0 2023-12-16T05:56:39.469 INFO:tasks.workunit.client.0.smithi155.stdout:0/807: link d7/d47/d5d/d6a/l10c d7/d13/d45/d3e/l10d 0 2023-12-16T05:56:39.470 INFO:tasks.workunit.client.0.smithi155.stdout:0/808: read d7/d13/d45/f6c [108990,22718] 0 2023-12-16T05:56:39.470 INFO:tasks.workunit.client.0.smithi155.stdout:2/707: write d0/d5/fce [216009,19809] 0 2023-12-16T05:56:39.471 INFO:tasks.workunit.client.1.smithi156.stdout:6/580: dread d9/d1c/f32 [0,4194304] 0 2023-12-16T05:56:39.471 INFO:tasks.workunit.client.1.smithi156.stdout:4/519: chown d9/d2b/f65 45430 1 2023-12-16T05:56:39.472 INFO:tasks.workunit.client.0.smithi155.stdout:2/708: symlink d0/d7/dd/d49/d4b/d8c/dcd/dd2/led 0 2023-12-16T05:56:39.472 INFO:tasks.workunit.client.0.smithi155.stdout:2/709: truncate d0/d7/d69/d77/fac 1017741 0 2023-12-16T05:56:39.474 INFO:tasks.workunit.client.0.smithi155.stdout:2/710: write d0/d5/fce [1243434,103707] 0 2023-12-16T05:56:39.475 INFO:tasks.workunit.client.0.smithi155.stdout:2/711: symlink d0/lee 0 2023-12-16T05:56:39.479 INFO:tasks.workunit.client.0.smithi155.stdout:9/983: dwrite da/d15/fb1 [0,4194304] 0 2023-12-16T05:56:39.479 INFO:tasks.workunit.client.0.smithi155.stdout:4/717: dwrite d0/da/de0/d16/d1a/d70/d92/fde [0,4194304] 0 2023-12-16T05:56:39.485 INFO:tasks.workunit.client.0.smithi155.stdout:0/809: dread d7/df/d6f/f7a [0,4194304] 0 2023-12-16T05:56:39.492 INFO:tasks.workunit.client.0.smithi155.stdout:4/718: write d0/da/de0/d16/f4b [2512553,113081] 0 2023-12-16T05:56:39.494 INFO:tasks.workunit.client.0.smithi155.stdout:4/719: rename d0/da/de0/d16/d30/fbe to d0/da/d36/fea 0 2023-12-16T05:56:39.495 INFO:tasks.workunit.client.0.smithi155.stdout:4/720: write d0/da/de0/f1c [888383,99844] 0 2023-12-16T05:56:39.497 INFO:tasks.workunit.client.0.smithi155.stdout:4/721: rename d0/da/de0/d16/d30/faa to d0/da/de0/d16/d30/dce/d75/d3d/d43/feb 0 2023-12-16T05:56:39.497 INFO:tasks.workunit.client.0.smithi155.stdout:0/810: write d7/df/d41/d23/d36/f54 [3584705,119950] 0 2023-12-16T05:56:39.498 INFO:tasks.workunit.client.0.smithi155.stdout:4/722: rename d0/d10/f8c to d0/d10/fec 0 2023-12-16T05:56:39.498 INFO:tasks.workunit.client.0.smithi155.stdout:4/723: truncate d0/da/de0/d16/d30/dce/d75/d89/fc9 609346 0 2023-12-16T05:56:39.499 INFO:tasks.workunit.client.0.smithi155.stdout:0/811: creat d7/df/d73/db3/dce/f10e x:0 0 0 2023-12-16T05:56:39.500 INFO:tasks.workunit.client.1.smithi156.stdout:6/581: dwrite d9/f85 [0,4194304] 0 2023-12-16T05:56:39.502 INFO:tasks.workunit.client.0.smithi155.stdout:0/812: rename d7/d13/fa7 to d7/df/d41/d23/d36/dad/d10a/f10f 0 2023-12-16T05:56:39.502 INFO:tasks.workunit.client.0.smithi155.stdout:0/813: fsync d7/d2d/fd3 0 2023-12-16T05:56:39.503 INFO:tasks.workunit.client.0.smithi155.stdout:2/712: dwrite d0/d7/d69/f58 [0,4194304] 0 2023-12-16T05:56:39.504 INFO:tasks.workunit.client.0.smithi155.stdout:0/814: unlink d7/fb 0 2023-12-16T05:56:39.505 INFO:tasks.workunit.client.0.smithi155.stdout:9/984: dwrite da/d15/d17/d36/d5b/d60/d9e/fd4 [4194304,4194304] 0 2023-12-16T05:56:39.505 INFO:tasks.workunit.client.0.smithi155.stdout:2/713: mkdir d0/d5/def 0 2023-12-16T05:56:39.505 INFO:tasks.workunit.client.0.smithi155.stdout:2/714: write d0/d34/d3c/fc8 [325375,98700] 0 2023-12-16T05:56:39.506 INFO:tasks.workunit.client.0.smithi155.stdout:0/815: creat d7/df/d41/d23/de1/f110 x:0 0 0 2023-12-16T05:56:39.507 INFO:tasks.workunit.client.1.smithi156.stdout:4/520: dwrite d9/d2b/f75 [0,4194304] 0 2023-12-16T05:56:39.507 INFO:tasks.workunit.client.0.smithi155.stdout:9/985: read da/d15/f66 [1949384,120821] 0 2023-12-16T05:56:39.507 INFO:tasks.workunit.client.0.smithi155.stdout:2/715: mkdir d0/d7/dd/d49/d4b/df0 0 2023-12-16T05:56:39.509 INFO:tasks.workunit.client.0.smithi155.stdout:0/816: unlink d7/df/fa8 0 2023-12-16T05:56:39.509 INFO:tasks.workunit.client.0.smithi155.stdout:9/986: creat da/d15/d17/f146 x:0 0 0 2023-12-16T05:56:39.510 INFO:tasks.workunit.client.1.smithi156.stdout:4/521: rmdir d9/d2c/d48/dae 39 2023-12-16T05:56:39.510 INFO:tasks.workunit.client.0.smithi155.stdout:0/817: unlink d7/df/d41/d23/l52 0 2023-12-16T05:56:39.512 INFO:tasks.workunit.client.0.smithi155.stdout:2/716: dread d0/d7/dc1/fcc [0,4194304] 0 2023-12-16T05:56:39.512 INFO:tasks.workunit.client.0.smithi155.stdout:9/987: mkdir da/d15/d17/d24/d26/d2e/d32/ded/d147 0 2023-12-16T05:56:39.512 INFO:tasks.workunit.client.0.smithi155.stdout:9/988: stat da/d15/d17/d36/d5b/d60/db9/f143 0 2023-12-16T05:56:39.512 INFO:tasks.workunit.client.0.smithi155.stdout:2/717: creat d0/d7/d57/d63/ff1 x:0 0 0 2023-12-16T05:56:39.515 INFO:tasks.workunit.client.0.smithi155.stdout:9/989: rename da/d15/d17/d36/l13d to da/d15/d17/d24/d26/d2e/d83/d8f/l148 0 2023-12-16T05:56:39.517 INFO:tasks.workunit.client.1.smithi156.stdout:4/522: dread d9/d43/f4b [0,4194304] 0 2023-12-16T05:56:39.517 INFO:tasks.workunit.client.1.smithi156.stdout:4/523: write d9/f23 [1885901,83960] 0 2023-12-16T05:56:39.518 INFO:tasks.workunit.client.0.smithi155.stdout:2/718: mknod d0/d7/d1f/d74/d85/cf2 0 2023-12-16T05:56:39.519 INFO:tasks.workunit.client.1.smithi156.stdout:4/524: mknod d9/d2b/d9a/cb0 0 2023-12-16T05:56:39.519 INFO:tasks.workunit.client.1.smithi156.stdout:4/525: stat d9/d43/c46 0 2023-12-16T05:56:39.519 INFO:tasks.workunit.client.1.smithi156.stdout:6/582: dwrite d9/d1c/f9e [0,4194304] 0 2023-12-16T05:56:39.520 INFO:tasks.workunit.client.0.smithi155.stdout:9/990: creat da/d15/d17/d36/d5b/d60/d9e/f149 x:0 0 0 2023-12-16T05:56:39.520 INFO:tasks.workunit.client.1.smithi156.stdout:6/583: mknod d9/d13/d2f/d51/d82/d89/d8e/cb0 0 2023-12-16T05:56:39.521 INFO:tasks.workunit.client.1.smithi156.stdout:6/584: write d9/d13/d2f/d51/d6b/d77/d7e/fa6 [291972,33385] 0 2023-12-16T05:56:39.522 INFO:tasks.workunit.client.0.smithi155.stdout:4/724: dwrite d0/da/f5a [0,4194304] 0 2023-12-16T05:56:39.522 INFO:tasks.workunit.client.0.smithi155.stdout:2/719: stat d0/d7/dd/d49/d4b/leb 0 2023-12-16T05:56:39.522 INFO:tasks.workunit.client.0.smithi155.stdout:2/720: chown d0/d7/dd/d49/d4b/d80/l76 1110222 1 2023-12-16T05:56:39.522 INFO:tasks.workunit.client.0.smithi155.stdout:2/721: stat d0/d7/d1f/d74/d3a/ccf 0 2023-12-16T05:56:39.523 INFO:tasks.workunit.client.0.smithi155.stdout:9/991: creat da/d15/d17/d36/dc1/f14a x:0 0 0 2023-12-16T05:56:39.524 INFO:tasks.workunit.client.1.smithi156.stdout:4/526: truncate d9/d2b/f75 1725850 0 2023-12-16T05:56:39.525 INFO:tasks.workunit.client.0.smithi155.stdout:4/725: rmdir d0/da 39 2023-12-16T05:56:39.528 INFO:tasks.workunit.client.0.smithi155.stdout:2/722: symlink d0/d7/dd/d49/d4b/d80/lf3 0 2023-12-16T05:56:39.528 INFO:tasks.workunit.client.0.smithi155.stdout:2/723: getdents d0/d5/de2 0 2023-12-16T05:56:39.529 INFO:tasks.workunit.client.0.smithi155.stdout:9/992: truncate da/d15/d17/d36/d5b/d98/dc2/f113 137512 0 2023-12-16T05:56:39.531 INFO:tasks.workunit.client.0.smithi155.stdout:4/726: truncate d0/da/de0/d16/d30/dce/d75/f23 2957688 0 2023-12-16T05:56:39.532 INFO:tasks.workunit.client.0.smithi155.stdout:0/818: dwrite d7/df/d73/d8d/f63 [0,4194304] 0 2023-12-16T05:56:39.534 INFO:tasks.workunit.client.1.smithi156.stdout:1/409: sync 2023-12-16T05:56:39.534 INFO:tasks.workunit.client.1.smithi156.stdout:1/410: write d3/d3a/f5d [4330572,61491] 0 2023-12-16T05:56:39.535 INFO:tasks.workunit.client.0.smithi155.stdout:2/724: creat d0/d7/dd/d14/db6/ff4 x:0 0 0 2023-12-16T05:56:39.536 INFO:tasks.workunit.client.1.smithi156.stdout:1/411: symlink d3/d17/d2d/l88 0 2023-12-16T05:56:39.536 INFO:tasks.workunit.client.1.smithi156.stdout:1/412: fdatasync f1 0 2023-12-16T05:56:39.537 INFO:tasks.workunit.client.0.smithi155.stdout:9/993: rename da/d15/d17/d36/d10c to da/d15/d17/d24/d26/d2e/d83/d8f/df2/d14b 0 2023-12-16T05:56:39.537 INFO:tasks.workunit.client.0.smithi155.stdout:9/994: dread - da/d15/d17/d36/d5b/d60/d9e/fc5 zero size 2023-12-16T05:56:39.537 INFO:tasks.workunit.client.0.smithi155.stdout:4/727: creat d0/fed x:0 0 0 2023-12-16T05:56:39.538 INFO:tasks.workunit.client.1.smithi156.stdout:4/527: dread d9/f15 [0,4194304] 0 2023-12-16T05:56:39.539 INFO:tasks.workunit.client.0.smithi155.stdout:0/819: creat d7/df/d73/db3/f111 x:0 0 0 2023-12-16T05:56:39.543 INFO:tasks.workunit.client.1.smithi156.stdout:6/585: dwrite d9/d13/d2f/d51/d6b/fab [0,4194304] 0 2023-12-16T05:56:39.544 INFO:tasks.workunit.client.1.smithi156.stdout:6/586: write d9/d1c/d50/f74 [7487976,56438] 0 2023-12-16T05:56:39.545 INFO:tasks.workunit.client.1.smithi156.stdout:6/587: creat d9/d13/d2f/d51/fb1 x:0 0 0 2023-12-16T05:56:39.546 INFO:tasks.workunit.client.1.smithi156.stdout:1/413: dread d3/d17/d1c/d22/f51 [0,4194304] 0 2023-12-16T05:56:39.547 INFO:tasks.workunit.client.1.smithi156.stdout:6/588: read d9/f70 [77671,1840] 0 2023-12-16T05:56:39.549 INFO:tasks.workunit.client.0.smithi155.stdout:2/725: dread d0/d7/d69/f58 [0,4194304] 0 2023-12-16T05:56:39.549 INFO:tasks.workunit.client.0.smithi155.stdout:2/726: fsync d0/d34/d3c/fe9 0 2023-12-16T05:56:39.550 INFO:tasks.workunit.client.1.smithi156.stdout:1/414: dread d3/d17/d19/f2e [0,4194304] 0 2023-12-16T05:56:39.550 INFO:tasks.workunit.client.1.smithi156.stdout:1/415: stat d3/d17/d2d/f86 0 2023-12-16T05:56:39.550 INFO:tasks.workunit.client.1.smithi156.stdout:1/416: stat d3/d17/d19/c63 0 2023-12-16T05:56:39.554 INFO:tasks.workunit.client.0.smithi155.stdout:9/995: unlink da/d15/d17/d36/d5b/d98/le5 0 2023-12-16T05:56:39.554 INFO:tasks.workunit.client.0.smithi155.stdout:9/996: truncate da/d15/d17/d36/f11f 212758 0 2023-12-16T05:56:39.555 INFO:tasks.workunit.client.1.smithi156.stdout:4/528: dwrite d9/d2c/d7a/f81 [0,4194304] 0 2023-12-16T05:56:39.556 INFO:tasks.workunit.client.0.smithi155.stdout:4/728: mknod d0/da/de0/d16/d1a/d70/cee 0 2023-12-16T05:56:39.556 INFO:tasks.workunit.client.0.smithi155.stdout:4/729: write d0/f20 [8587291,1854] 0 2023-12-16T05:56:39.556 INFO:tasks.workunit.client.1.smithi156.stdout:4/529: dread d9/d2c/d7a/f8a [0,4194304] 0 2023-12-16T05:56:39.559 INFO:tasks.workunit.client.1.smithi156.stdout:4/530: rename d9/d2b/f9f to d9/d2b/d98/d99/fb1 0 2023-12-16T05:56:39.559 INFO:tasks.workunit.client.1.smithi156.stdout:4/531: dread - d9/d43/d58/fa8 zero size 2023-12-16T05:56:39.560 INFO:tasks.workunit.client.0.smithi155.stdout:9/997: write da/d15/d17/d24/d26/d2e/f63 [1167880,78681] 0 2023-12-16T05:56:39.560 INFO:tasks.workunit.client.0.smithi155.stdout:4/730: write d0/da/de0/d16/f8e [745115,120486] 0 2023-12-16T05:56:39.562 INFO:tasks.workunit.client.0.smithi155.stdout:0/820: rename d7/df/d41/d106 to d7/d112 0 2023-12-16T05:56:39.562 INFO:tasks.workunit.client.1.smithi156.stdout:6/589: dread f6 [4194304,4194304] 0 2023-12-16T05:56:39.563 INFO:tasks.workunit.client.0.smithi155.stdout:4/731: mkdir d0/d10/def 0 2023-12-16T05:56:39.564 INFO:tasks.workunit.client.1.smithi156.stdout:6/590: creat d9/d13/d2f/fb2 x:0 0 0 2023-12-16T05:56:39.567 INFO:tasks.workunit.client.0.smithi155.stdout:0/821: unlink d7/df/d65/l48 0 2023-12-16T05:56:39.572 INFO:tasks.workunit.client.0.smithi155.stdout:9/998: rename da/d15/d17/d36/d5b/d60/db9/de4 to da/d15/d17/d24/d26/d2e/d83/d8f/d9c/d14c 0 2023-12-16T05:56:39.574 INFO:tasks.workunit.client.0.smithi155.stdout:9/999: mknod da/d15/d17/d36/d5b/d60/c14d 0 2023-12-16T05:56:39.576 INFO:tasks.workunit.client.1.smithi156.stdout:6/591: write d9/d1c/f49 [654343,14279] 0 2023-12-16T05:56:39.576 INFO:tasks.workunit.client.1.smithi156.stdout:4/532: dread d9/d43/d58/f60 [0,4194304] 0 2023-12-16T05:56:39.576 INFO:tasks.workunit.client.1.smithi156.stdout:4/533: fsync d9/d2b/d35/f86 0 2023-12-16T05:56:39.576 INFO:tasks.workunit.client.1.smithi156.stdout:4/534: write d9/d43/d58/d7d/f90 [5082235,75590] 0 2023-12-16T05:56:39.577 INFO:tasks.workunit.client.0.smithi155.stdout:2/727: dwrite d0/d7/d57/d63/de7/fa1 [0,4194304] 0 2023-12-16T05:56:39.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:39 smithi155 ceph-mon[112451]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:56:39.581 INFO:tasks.workunit.client.1.smithi156.stdout:1/417: dwrite d3/d1b/f46 [0,4194304] 0 2023-12-16T05:56:39.583 INFO:tasks.workunit.client.1.smithi156.stdout:6/592: dread d9/d13/d2f/d36/f55 [0,4194304] 0 2023-12-16T05:56:39.586 INFO:tasks.workunit.client.1.smithi156.stdout:6/593: unlink d9/d1c/d50/f84 0 2023-12-16T05:56:39.591 INFO:tasks.workunit.client.1.smithi156.stdout:1/418: dread d3/d17/f52 [0,4194304] 0 2023-12-16T05:56:39.591 INFO:tasks.workunit.client.0.smithi155.stdout:0/822: dwrite d7/d47/d5d/d6a/f7c [0,4194304] 0 2023-12-16T05:56:39.593 INFO:tasks.workunit.client.1.smithi156.stdout:1/419: mknod d3/c89 0 2023-12-16T05:56:39.604 INFO:tasks.workunit.client.0.smithi155.stdout:2/728: dwrite d0/d5/d6/d5f/f99 [0,4194304] 0 2023-12-16T05:56:39.604 INFO:tasks.workunit.client.0.smithi155.stdout:2/729: chown d0/d34/cdf 3450528 1 2023-12-16T05:56:39.604 INFO:tasks.workunit.client.0.smithi155.stdout:2/730: chown d0/d7/d69/d77/fa4 4 1 2023-12-16T05:56:39.606 INFO:tasks.workunit.client.1.smithi156.stdout:4/535: dwrite d9/f28 [0,4194304] 0 2023-12-16T05:56:39.606 INFO:tasks.workunit.client.1.smithi156.stdout:4/536: write d9/d2c/d48/dae/f6d [232289,99608] 0 2023-12-16T05:56:39.626 INFO:tasks.workunit.client.0.smithi155.stdout:0/823: dwrite d7/df/d73/db3/fc6 [0,4194304] 0 2023-12-16T05:56:39.630 INFO:tasks.workunit.client.0.smithi155.stdout:2/731: dwrite d0/f30 [0,4194304] 0 2023-12-16T05:56:39.630 INFO:tasks.workunit.client.0.smithi155.stdout:2/732: fsync d0/d7/dc1/fcc 0 2023-12-16T05:56:39.630 INFO:tasks.workunit.client.0.smithi155.stdout:2/733: stat d0/d34/d3c/f43 0 2023-12-16T05:56:39.630 INFO:tasks.workunit.client.0.smithi155.stdout:2/734: write d0/d7/f5e [4604404,72844] 0 2023-12-16T05:56:39.631 INFO:tasks.workunit.client.0.smithi155.stdout:2/735: read d0/f4 [1403657,653] 0 2023-12-16T05:56:39.631 INFO:tasks.workunit.client.1.smithi156.stdout:1/420: dwrite d3/d1b/d27/d4f/f65 [0,4194304] 0 2023-12-16T05:56:39.631 INFO:tasks.workunit.client.1.smithi156.stdout:1/421: fsync d3/fc 0 2023-12-16T05:56:39.632 INFO:tasks.workunit.client.0.smithi155.stdout:2/736: symlink d0/d7/d57/d63/de7/lf5 0 2023-12-16T05:56:39.633 INFO:tasks.workunit.client.1.smithi156.stdout:4/537: dwrite d9/d2b/f8f [0,4194304] 0 2023-12-16T05:56:39.634 INFO:tasks.workunit.client.1.smithi156.stdout:1/422: creat d3/d1b/d27/f8a x:0 0 0 2023-12-16T05:56:39.636 INFO:tasks.workunit.client.0.smithi155.stdout:0/824: dread d7/df/d41/d23/d36/dad/d10a/f5f [0,4194304] 0 2023-12-16T05:56:39.636 INFO:tasks.workunit.client.1.smithi156.stdout:1/423: read d3/d17/f48 [1671877,19832] 0 2023-12-16T05:56:39.638 INFO:tasks.workunit.client.1.smithi156.stdout:4/538: mknod d9/d2b/d35/cb2 0 2023-12-16T05:56:39.639 INFO:tasks.workunit.client.0.smithi155.stdout:0/825: unlink d7/df/d41/d23/d36/la6 0 2023-12-16T05:56:39.639 INFO:tasks.workunit.client.0.smithi155.stdout:0/826: fdatasync d7/d13/f104 0 2023-12-16T05:56:39.639 INFO:tasks.workunit.client.0.smithi155.stdout:0/827: readlink d7/df/d41/d23/de1/l107 0 2023-12-16T05:56:39.640 INFO:tasks.workunit.client.0.smithi155.stdout:0/828: mknod d7/df/d73/dba/c113 0 2023-12-16T05:56:39.645 INFO:tasks.workunit.client.0.smithi155.stdout:0/829: dread d7/f29 [0,4194304] 0 2023-12-16T05:56:39.645 INFO:tasks.workunit.client.1.smithi156.stdout:1/424: unlink d3/lf 0 2023-12-16T05:56:39.647 INFO:tasks.workunit.client.0.smithi155.stdout:0/830: creat d7/d13/d45/f114 x:0 0 0 2023-12-16T05:56:39.647 INFO:tasks.workunit.client.0.smithi155.stdout:0/831: chown d7/d47/d53/ca1 976 1 2023-12-16T05:56:39.648 INFO:tasks.workunit.client.0.smithi155.stdout:0/832: truncate d7/df/d41/d23/d36/dad/d10a/f67 123732 0 2023-12-16T05:56:39.650 INFO:tasks.workunit.client.1.smithi156.stdout:1/425: mkdir d3/d1b/d8b 0 2023-12-16T05:56:39.652 INFO:tasks.workunit.client.0.smithi155.stdout:0/833: rename d7/d47 to d7/df/d73/d8d/d4d/d115 0 2023-12-16T05:56:39.652 INFO:tasks.workunit.client.0.smithi155.stdout:0/834: read - d7/d2d/ff1 zero size 2023-12-16T05:56:39.652 INFO:tasks.workunit.client.0.smithi155.stdout:0/835: dread - d7/d2d/ff1 zero size 2023-12-16T05:56:39.653 INFO:tasks.workunit.client.0.smithi155.stdout:0/836: symlink d7/df/d41/d23/de1/l116 0 2023-12-16T05:56:39.653 INFO:tasks.workunit.client.1.smithi156.stdout:1/426: link d3/d1b/d27/f8a d3/d17/d4d/f8c 0 2023-12-16T05:56:39.653 INFO:tasks.workunit.client.1.smithi156.stdout:1/427: write d3/d17/d2d/f86 [84555,127411] 0 2023-12-16T05:56:39.658 INFO:tasks.workunit.client.0.smithi155.stdout:0/837: creat d7/df/d73/dba/f117 x:0 0 0 2023-12-16T05:56:39.659 INFO:tasks.workunit.client.1.smithi156.stdout:1/428: creat d3/d1b/f8d x:0 0 0 2023-12-16T05:56:39.659 INFO:tasks.workunit.client.1.smithi156.stdout:1/429: creat d3/d1b/d8b/f8e x:0 0 0 2023-12-16T05:56:39.659 INFO:tasks.workunit.client.1.smithi156.stdout:1/430: rename d3/d17/d1c/c59 to d3/d1b/d27/d4f/c8f 0 2023-12-16T05:56:39.659 INFO:tasks.workunit.client.1.smithi156.stdout:1/431: truncate d3/d17/d2d/f53 20960 0 2023-12-16T05:56:39.659 INFO:tasks.workunit.client.1.smithi156.stdout:1/432: chown d3/f6 13 1 2023-12-16T05:56:39.661 INFO:tasks.workunit.client.1.smithi156.stdout:1/433: rename d3/d17/d1c/f2b to d3/d1b/d27/d4f/f90 0 2023-12-16T05:56:39.662 INFO:tasks.workunit.client.1.smithi156.stdout:4/539: dwrite d9/d2c/d48/dae/f85 [0,4194304] 0 2023-12-16T05:56:39.663 INFO:tasks.workunit.client.0.smithi155.stdout:0/838: dread d7/df/d73/d8d/d4d/faf [0,4194304] 0 2023-12-16T05:56:39.663 INFO:tasks.workunit.client.1.smithi156.stdout:1/434: rename f0 to d3/d1b/d8b/f91 0 2023-12-16T05:56:39.664 INFO:tasks.workunit.client.1.smithi156.stdout:1/435: truncate d3/d1b/d27/d4f/f90 4899845 0 2023-12-16T05:56:39.664 INFO:tasks.workunit.client.1.smithi156.stdout:1/436: read - d3/d1b/d27/f67 zero size 2023-12-16T05:56:39.664 INFO:tasks.workunit.client.1.smithi156.stdout:1/437: dread - d3/d17/d4d/f8c zero size 2023-12-16T05:56:39.677 INFO:tasks.workunit.client.1.smithi156.stdout:4/540: rename d9/d2c/d7a/f81 to d9/d2b/d98/fb3 0 2023-12-16T05:56:39.682 INFO:tasks.workunit.client.1.smithi156.stdout:9/520: sync 2023-12-16T05:56:39.684 INFO:tasks.workunit.client.1.smithi156.stdout:9/521: mkdir d6/d19/d30/dae 0 2023-12-16T05:56:39.685 INFO:tasks.workunit.client.0.smithi155.stdout:0/839: dwrite d7/df/f9a [0,4194304] 0 2023-12-16T05:56:39.685 INFO:tasks.workunit.client.0.smithi155.stdout:0/840: chown d7/df/d41/d23/d36/dad/d10a/f8c 1335985365 1 2023-12-16T05:56:39.685 INFO:tasks.workunit.client.0.smithi155.stdout:0/841: chown d7/db0/lcc 1 1 2023-12-16T05:56:39.686 INFO:tasks.workunit.client.0.smithi155.stdout:0/842: mknod d7/df/d73/d8d/d9b/c118 0 2023-12-16T05:56:39.686 INFO:tasks.workunit.client.0.smithi155.stdout:0/843: fdatasync d7/df/d41/d23/d36/dad/d10a/f60 0 2023-12-16T05:56:39.687 INFO:tasks.workunit.client.0.smithi155.stdout:0/844: creat d7/df/d41/f119 x:0 0 0 2023-12-16T05:56:39.693 INFO:tasks.workunit.client.1.smithi156.stdout:4/541: dread d9/f70 [0,4194304] 0 2023-12-16T05:56:39.696 INFO:tasks.workunit.client.0.smithi155.stdout:0/845: dread d7/df/d41/d23/d36/dad/d10a/f60 [0,4194304] 0 2023-12-16T05:56:39.697 INFO:tasks.workunit.client.0.smithi155.stdout:0/846: rmdir d7/d13/d45/d3e 39 2023-12-16T05:56:39.697 INFO:tasks.workunit.client.0.smithi155.stdout:0/847: stat d7/df/d73/d8d/d4d/d115/d5d/d6a/ff9 0 2023-12-16T05:56:39.719 INFO:tasks.workunit.client.0.smithi155.stdout:0/848: dwrite d7/df/d73/d8d/f63 [0,4194304] 0 2023-12-16T05:56:39.719 INFO:tasks.workunit.client.1.smithi156.stdout:4/542: dwrite d9/f15 [0,4194304] 0 2023-12-16T05:56:39.720 INFO:tasks.workunit.client.0.smithi155.stdout:0/849: creat d7/df/d73/db3/f11a x:0 0 0 2023-12-16T05:56:39.724 INFO:tasks.workunit.client.1.smithi156.stdout:0/618: sync 2023-12-16T05:56:39.731 INFO:tasks.workunit.client.1.smithi156.stdout:0/619: dread d2/d7/dd/d29/d4b/d76/f78 [0,4194304] 0 2023-12-16T05:56:39.732 INFO:tasks.workunit.client.1.smithi156.stdout:0/620: read d2/f28 [3602,82474] 0 2023-12-16T05:56:39.732 INFO:tasks.workunit.client.1.smithi156.stdout:0/621: chown d2/f86 1767 1 2023-12-16T05:56:39.736 INFO:tasks.workunit.client.1.smithi156.stdout:0/622: write d2/f24 [2098936,67699] 0 2023-12-16T05:56:39.736 INFO:tasks.workunit.client.1.smithi156.stdout:0/623: fsync d2/d7/dd/f33 0 2023-12-16T05:56:39.738 INFO:tasks.workunit.client.1.smithi156.stdout:0/624: symlink d2/d23/lc5 0 2023-12-16T05:56:39.739 INFO:tasks.workunit.client.0.smithi155.stdout:0/850: dwrite d7/d2d/ff7 [0,4194304] 0 2023-12-16T05:56:39.742 INFO:tasks.workunit.client.1.smithi156.stdout:0/625: dread d2/d7/dd/d29/d38/d3f/f58 [0,4194304] 0 2023-12-16T05:56:39.754 INFO:tasks.workunit.client.0.smithi155.stdout:0/851: dwrite d7/df/d73/d8d/d4d/d115/d53/f7d [0,4194304] 0 2023-12-16T05:56:39.754 INFO:tasks.workunit.client.0.smithi155.stdout:0/852: chown d7/d2d/ff1 3 1 2023-12-16T05:56:39.754 INFO:tasks.workunit.client.0.smithi155.stdout:0/853: chown d7/df/d65/f39 29136 1 2023-12-16T05:56:39.754 INFO:tasks.workunit.client.0.smithi155.stdout:0/854: stat d7/df/d73/d8d/d4d/d115/d5d/d84/c92 0 2023-12-16T05:56:39.754 INFO:tasks.workunit.client.0.smithi155.stdout:0/855: dread - d7/df/d73/db3/f111 zero size 2023-12-16T05:56:39.756 INFO:tasks.workunit.client.0.smithi155.stdout:7/682: sync 2023-12-16T05:56:39.757 INFO:tasks.workunit.client.0.smithi155.stdout:7/683: fdatasync d0/d6a/d1a/d8c/f7c 0 2023-12-16T05:56:39.757 INFO:tasks.workunit.client.0.smithi155.stdout:7/684: dread - d0/d6a/d1a/d8c/d34/d4b/d60/fde zero size 2023-12-16T05:56:39.758 INFO:tasks.workunit.client.0.smithi155.stdout:7/685: symlink d0/d6a/d1a/d8c/d34/d4b/d64/d6f/le0 0 2023-12-16T05:56:39.760 INFO:tasks.workunit.client.0.smithi155.stdout:7/686: link d0/d6a/d1a/d8c/d34/d4b/d64/d6e/f7e d0/d6a/d1a/d8c/d34/d4b/d64/d6f/dba/dc9/fe1 0 2023-12-16T05:56:39.761 INFO:tasks.workunit.client.1.smithi156.stdout:0/626: dwrite d2/f86 [0,4194304] 0 2023-12-16T05:56:39.762 INFO:tasks.workunit.client.1.smithi156.stdout:0/627: write d2/d7/dd/d29/d38/d51/d65/d7e/fbd [800882,74423] 0 2023-12-16T05:56:39.762 INFO:tasks.workunit.client.0.smithi155.stdout:7/687: symlink d0/d6a/d31/le2 0 2023-12-16T05:56:39.765 INFO:tasks.workunit.client.1.smithi156.stdout:0/628: rename d2/d7/dd/d2d/c50 to d2/d7/dd/d29/d38/d3f/d44/cc6 0 2023-12-16T05:56:39.766 INFO:tasks.workunit.client.1.smithi156.stdout:0/629: rmdir d2/d7/da8/db5 0 2023-12-16T05:56:39.774 INFO:tasks.workunit.client.0.smithi155.stdout:7/688: write d0/d1/f4a [92782,34707] 0 2023-12-16T05:56:39.775 INFO:tasks.workunit.client.1.smithi156.stdout:0/630: getdents d2/d7/dd/d29 0 2023-12-16T05:56:39.775 INFO:tasks.workunit.client.1.smithi156.stdout:0/631: fdatasync d2/d7/dd/f33 0 2023-12-16T05:56:39.778 INFO:tasks.workunit.client.1.smithi156.stdout:0/632: truncate d2/d7/dd/d1c/f25 7012159 0 2023-12-16T05:56:39.782 INFO:tasks.workunit.client.0.smithi155.stdout:0/856: dwrite d7/d2d/fbc [0,4194304] 0 2023-12-16T05:56:39.782 INFO:tasks.workunit.client.0.smithi155.stdout:0/857: rename d7 to d7/d2d/d11b 22 2023-12-16T05:56:39.782 INFO:tasks.workunit.client.0.smithi155.stdout:0/858: fdatasync d7/df/d73/fbf 0 2023-12-16T05:56:39.782 INFO:tasks.workunit.client.0.smithi155.stdout:0/859: chown d7/db0 8879 1 2023-12-16T05:56:39.788 INFO:tasks.workunit.client.0.smithi155.stdout:0/860: rmdir d7/df/d73/d8d/d9b 39 2023-12-16T05:56:39.789 INFO:tasks.workunit.client.0.smithi155.stdout:0/861: truncate d7/df/d41/d23/d36/dad/fcd 2836210 0 2023-12-16T05:56:39.799 INFO:tasks.workunit.client.0.smithi155.stdout:6/946: sync 2023-12-16T05:56:39.799 INFO:tasks.workunit.client.0.smithi155.stdout:3/552: sync 2023-12-16T05:56:39.800 INFO:tasks.workunit.client.0.smithi155.stdout:6/947: mknod d0/df/d5e/c140 0 2023-12-16T05:56:39.800 INFO:tasks.workunit.client.0.smithi155.stdout:7/689: dwrite d0/d6a/d1a/d8c/d34/d4b/d64/fd7 [0,4194304] 0 2023-12-16T05:56:39.800 INFO:tasks.workunit.client.0.smithi155.stdout:7/690: write d0/d6a/d1a/d8c/d42/f80 [683650,41510] 0 2023-12-16T05:56:39.802 INFO:tasks.workunit.client.1.smithi156.stdout:0/633: dwrite d2/d7/dd/d29/d2e/f3a [4194304,4194304] 0 2023-12-16T05:56:39.802 INFO:tasks.workunit.client.1.smithi156.stdout:0/634: stat d2/d7/dd/d29/la0 0 2023-12-16T05:56:39.802 INFO:tasks.workunit.client.1.smithi156.stdout:0/635: write d2/d23/f70 [228037,31154] 0 2023-12-16T05:56:39.802 INFO:tasks.workunit.client.1.smithi156.stdout:0/636: stat d2/d7/dd/d29/d38/d3f/d44/l4d 0 2023-12-16T05:56:39.803 INFO:tasks.workunit.client.0.smithi155.stdout:3/553: creat d0/fa9 x:0 0 0 2023-12-16T05:56:39.803 INFO:tasks.workunit.client.0.smithi155.stdout:0/862: dread d7/f2a [0,4194304] 0 2023-12-16T05:56:39.803 INFO:tasks.workunit.client.0.smithi155.stdout:6/948: link d0/d3/d2c/d8b/f125 d0/df/d5e/d46/d6d/f141 0 2023-12-16T05:56:39.804 INFO:tasks.workunit.client.1.smithi156.stdout:0/637: creat d2/d23/d55/fc7 x:0 0 0 2023-12-16T05:56:39.805 INFO:tasks.workunit.client.0.smithi155.stdout:7/691: creat d0/fe3 x:0 0 0 2023-12-16T05:56:39.805 INFO:tasks.workunit.client.0.smithi155.stdout:7/692: fdatasync d0/d1b/d78/f96 0 2023-12-16T05:56:39.806 INFO:tasks.workunit.client.0.smithi155.stdout:3/554: symlink d0/d14/d36/d47/da7/laa 0 2023-12-16T05:56:39.807 INFO:tasks.workunit.client.0.smithi155.stdout:6/949: creat d0/d3/d7a/db0/dc3/dce/ddd/dd4/f142 x:0 0 0 2023-12-16T05:56:39.807 INFO:tasks.workunit.client.0.smithi155.stdout:6/950: fdatasync d0/d3/d7a/db0/dc3/dce/ddd/f1d 0 2023-12-16T05:56:39.808 INFO:tasks.workunit.client.0.smithi155.stdout:7/693: symlink d0/d1/le4 0 2023-12-16T05:56:39.809 INFO:tasks.workunit.client.1.smithi156.stdout:9/522: symlink d6/laf 0 2023-12-16T05:56:39.809 INFO:tasks.workunit.client.0.smithi155.stdout:0/863: write d7/d2d/f9e [625960,11609] 0 2023-12-16T05:56:39.810 INFO:tasks.workunit.client.0.smithi155.stdout:7/694: mknod d0/d6a/d1a/d22/ce5 0 2023-12-16T05:56:39.813 INFO:tasks.workunit.client.0.smithi155.stdout:0/864: rename d7/df/d41/d23/d36/dad/d10a/c8a to d7/df/d73/db3/c11c 0 2023-12-16T05:56:39.815 INFO:tasks.workunit.client.1.smithi156.stdout:2/516: sync 2023-12-16T05:56:39.815 INFO:tasks.workunit.client.0.smithi155.stdout:7/695: unlink d0/d6a/d1a/d8c/d34/fb2 0 2023-12-16T05:56:39.815 INFO:tasks.workunit.client.0.smithi155.stdout:7/696: truncate d0/d1/d5/f8 5231541 0 2023-12-16T05:56:39.816 INFO:tasks.workunit.client.1.smithi156.stdout:2/517: mknod d9/d68/ca3 0 2023-12-16T05:56:39.818 INFO:tasks.workunit.client.1.smithi156.stdout:2/518: link d9/f1f d9/dd/d17/d33/d78/fa4 0 2023-12-16T05:56:39.818 INFO:tasks.workunit.client.0.smithi155.stdout:0/865: rename d7/df/d41/d23/d36/dad/d10a/f67 to d7/d2d/f11d 0 2023-12-16T05:56:39.818 INFO:tasks.workunit.client.0.smithi155.stdout:0/866: chown d7/df/d73/d8d/l98 63119384 1 2023-12-16T05:56:39.819 INFO:tasks.workunit.client.0.smithi155.stdout:7/697: mkdir d0/d6a/d1a/da0/de6 0 2023-12-16T05:56:39.819 INFO:tasks.workunit.client.0.smithi155.stdout:7/698: dread - d0/d6a/d1a/da0/fdc zero size 2023-12-16T05:56:39.819 INFO:tasks.workunit.client.0.smithi155.stdout:7/699: chown d0/d6a/d31 507432 1 2023-12-16T05:56:39.820 INFO:tasks.workunit.client.0.smithi155.stdout:0/867: rmdir d7/db7 39 2023-12-16T05:56:39.820 INFO:tasks.workunit.client.1.smithi156.stdout:2/519: symlink d9/dd/la5 0 2023-12-16T05:56:39.820 INFO:tasks.workunit.client.1.smithi156.stdout:2/520: chown d9/f44 1950 1 2023-12-16T05:56:39.821 INFO:tasks.workunit.client.0.smithi155.stdout:7/700: rename d0/d6a/d1a/d2b/db9/cdf to d0/d6a/d1a/d8c/d34/d4b/ce7 0 2023-12-16T05:56:39.821 INFO:tasks.workunit.client.1.smithi156.stdout:2/521: write d9/dd/f1b [1989793,106857] 0 2023-12-16T05:56:39.823 INFO:tasks.workunit.client.0.smithi155.stdout:0/868: creat d7/df/d73/d8d/d4d/d115/d53/f11e x:0 0 0 2023-12-16T05:56:39.825 INFO:tasks.workunit.client.0.smithi155.stdout:0/869: getdents d7/df/d41/d23/d36 0 2023-12-16T05:56:39.832 INFO:tasks.workunit.client.0.smithi155.stdout:6/951: dwrite d0/d3/d7a/db0/dc3/dce/ddd/f15 [0,4194304] 0 2023-12-16T05:56:39.832 INFO:tasks.workunit.client.0.smithi155.stdout:6/952: write d0/d3/d7a/db0/dc3/dce/ddd/f51 [1331131,117296] 0 2023-12-16T05:56:39.834 INFO:tasks.workunit.client.0.smithi155.stdout:3/555: dwrite d0/d1a/d33/d57/f6c [0,4194304] 0 2023-12-16T05:56:39.834 INFO:tasks.workunit.client.0.smithi155.stdout:6/953: getdents d0/d3/d2c/db8 0 2023-12-16T05:56:39.836 INFO:tasks.workunit.client.0.smithi155.stdout:6/954: unlink d0/df/d5e/d46/f65 0 2023-12-16T05:56:39.836 INFO:tasks.workunit.client.0.smithi155.stdout:6/955: chown d0/d3/d7a/f73 406 1 2023-12-16T05:56:39.836 INFO:tasks.workunit.client.0.smithi155.stdout:6/956: fdatasync d0/d3/d7a/d77/f83 0 2023-12-16T05:56:39.845 INFO:tasks.workunit.client.0.smithi155.stdout:7/701: dwrite d0/d6a/d1a/d8c/d34/d4b/f51 [0,4194304] 0 2023-12-16T05:56:39.845 INFO:tasks.workunit.client.0.smithi155.stdout:3/556: dread d0/d14/f35 [0,4194304] 0 2023-12-16T05:56:39.845 INFO:tasks.workunit.client.0.smithi155.stdout:7/702: chown d0/d6a/d1a/d8c/d34/f73 66905 1 2023-12-16T05:56:39.846 INFO:tasks.workunit.client.0.smithi155.stdout:0/870: dwrite d7/df/d41/f119 [0,4194304] 0 2023-12-16T05:56:39.847 INFO:tasks.workunit.client.0.smithi155.stdout:0/871: chown d7/df/d73/db3 26653 1 2023-12-16T05:56:39.847 INFO:tasks.workunit.client.0.smithi155.stdout:3/557: unlink d0/d14/d51/c43 0 2023-12-16T05:56:39.851 INFO:tasks.workunit.client.0.smithi155.stdout:0/872: creat d7/d13/d46/f11f x:0 0 0 2023-12-16T05:56:39.852 INFO:tasks.workunit.client.1.smithi156.stdout:2/522: dwrite d9/dd/d17/f1d [0,4194304] 0 2023-12-16T05:56:39.853 INFO:tasks.workunit.client.1.smithi156.stdout:2/523: truncate d9/d68/f75 847072 0 2023-12-16T05:56:39.855 INFO:tasks.workunit.client.0.smithi155.stdout:3/558: dread d0/d14/f50 [0,4194304] 0 2023-12-16T05:56:39.856 INFO:tasks.workunit.client.0.smithi155.stdout:3/559: getdents d0/d1e 0 2023-12-16T05:56:39.857 INFO:tasks.workunit.client.0.smithi155.stdout:3/560: write d0/fa9 [59956,69590] 0 2023-12-16T05:56:39.865 INFO:tasks.workunit.client.0.smithi155.stdout:6/957: dwrite d0/df/d5e/d46/f47 [0,4194304] 0 2023-12-16T05:56:39.865 INFO:tasks.workunit.client.0.smithi155.stdout:7/703: dwrite d0/d6a/d1a/d8c/d34/f73 [0,4194304] 0 2023-12-16T05:56:39.866 INFO:tasks.workunit.client.1.smithi156.stdout:2/524: dwrite f8 [0,4194304] 0 2023-12-16T05:56:39.866 INFO:tasks.workunit.client.0.smithi155.stdout:6/958: mknod d0/df/d5e/d46/d6d/c143 0 2023-12-16T05:56:39.866 INFO:tasks.workunit.client.0.smithi155.stdout:6/959: chown d0/d3/d2c/d8b/d85/da4/f118 2337 1 2023-12-16T05:56:39.866 INFO:tasks.workunit.client.0.smithi155.stdout:6/960: fsync d0/df/d5e/f48 0 2023-12-16T05:56:39.867 INFO:tasks.workunit.client.0.smithi155.stdout:7/704: truncate d0/d6a/d31/f52 2831242 0 2023-12-16T05:56:39.867 INFO:tasks.workunit.client.0.smithi155.stdout:7/705: readlink d0/d1/l29 0 2023-12-16T05:56:39.868 INFO:tasks.workunit.client.0.smithi155.stdout:6/961: rename d0/l5d to d0/d3/d7a/dd6/l144 0 2023-12-16T05:56:39.869 INFO:tasks.workunit.client.1.smithi156.stdout:2/525: write d9/d5a/d80/f8b [1157389,45877] 0 2023-12-16T05:56:39.869 INFO:tasks.workunit.client.0.smithi155.stdout:7/706: mkdir d0/d6a/d31/de8 0 2023-12-16T05:56:39.870 INFO:tasks.workunit.client.0.smithi155.stdout:7/707: fsync d0/d6a/d1a/d8c/d42/f80 0 2023-12-16T05:56:39.870 INFO:tasks.workunit.client.0.smithi155.stdout:6/962: mknod d0/d3/d7a/db0/dc3/dce/ddd/c145 0 2023-12-16T05:56:39.871 INFO:tasks.workunit.client.0.smithi155.stdout:7/708: mknod d0/d6a/d1a/d8c/d42/d98/db1/ce9 0 2023-12-16T05:56:39.871 INFO:tasks.workunit.client.1.smithi156.stdout:2/526: rename d9/d5a to d9/dd/d17/d33/d78/d39/d8c/da2/da6 0 2023-12-16T05:56:39.872 INFO:tasks.workunit.client.0.smithi155.stdout:6/963: truncate d0/df/d5e/d46/f3f 359097 0 2023-12-16T05:56:39.872 INFO:tasks.workunit.client.0.smithi155.stdout:6/964: chown d0/df/d5e/d46/d6d/lcd 13912 1 2023-12-16T05:56:39.872 INFO:tasks.workunit.client.0.smithi155.stdout:6/965: fsync d0/df/d5e/d5b/dd7/f108 0 2023-12-16T05:56:39.873 INFO:tasks.workunit.client.1.smithi156.stdout:2/527: symlink d9/dd/d17/d33/d78/d39/d60/d6a/la7 0 2023-12-16T05:56:39.873 INFO:tasks.workunit.client.1.smithi156.stdout:2/528: dread - d9/d56/d5f/f9f zero size 2023-12-16T05:56:39.874 INFO:tasks.workunit.client.0.smithi155.stdout:6/966: mknod d0/df/d5e/d7e/c146 0 2023-12-16T05:56:39.875 INFO:tasks.workunit.client.0.smithi155.stdout:6/967: dread d0/d3/d2c/d8b/f72 [0,4194304] 0 2023-12-16T05:56:39.875 INFO:tasks.workunit.client.1.smithi156.stdout:2/529: rename d9/dd/d3f/d83/da1/l93 to d9/dd/d3f/la8 0 2023-12-16T05:56:39.884 INFO:tasks.workunit.client.1.smithi156.stdout:2/530: dread d9/dd/d17/d33/d78/d39/d8c/da2/da6/d80/f85 [0,4194304] 0 2023-12-16T05:56:39.884 INFO:tasks.workunit.client.1.smithi156.stdout:2/531: fdatasync d9/d56/f9a 0 2023-12-16T05:56:39.886 INFO:tasks.workunit.client.1.smithi156.stdout:2/532: rename l3 to d9/dd/d17/d33/d78/d39/d60/d6a/la9 0 2023-12-16T05:56:39.886 INFO:tasks.workunit.client.1.smithi156.stdout:2/533: write d9/dd/d17/d33/d78/d39/d60/d6a/f81 [659434,14140] 0 2023-12-16T05:56:39.888 INFO:tasks.workunit.client.0.smithi155.stdout:7/709: dwrite d0/d6a/d1a/f89 [0,4194304] 0 2023-12-16T05:56:39.891 INFO:tasks.workunit.client.1.smithi156.stdout:2/534: rename d9/dd/d3f to d9/d68/daa 0 2023-12-16T05:56:39.892 INFO:tasks.workunit.client.1.smithi156.stdout:2/535: write d9/dd/d17/d33/d78/f3c [366749,63103] 0 2023-12-16T05:56:39.892 INFO:tasks.workunit.client.1.smithi156.stdout:2/536: dread - d9/d68/daa/f9c zero size 2023-12-16T05:56:39.902 INFO:tasks.workunit.client.0.smithi155.stdout:7/710: dwrite d0/d6a/d1a/d8c/f7c [0,4194304] 0 2023-12-16T05:56:39.902 INFO:tasks.workunit.client.0.smithi155.stdout:7/711: fdatasync d0/d6a/d1a/d8c/d34/d4b/d64/d6f/dba/dc9/fe1 0 2023-12-16T05:56:39.902 INFO:tasks.workunit.client.0.smithi155.stdout:7/712: fdatasync d0/d1/f4a 0 2023-12-16T05:56:39.902 INFO:tasks.workunit.client.0.smithi155.stdout:7/713: write d0/d1/d5/f1d [2085197,127007] 0 2023-12-16T05:56:39.904 INFO:tasks.workunit.client.1.smithi156.stdout:2/537: dread d9/dd/d17/f3a [0,4194304] 0 2023-12-16T05:56:39.905 INFO:tasks.workunit.client.1.smithi156.stdout:2/538: mknod d9/dd/d17/d8f/cab 0 2023-12-16T05:56:39.906 INFO:tasks.workunit.client.1.smithi156.stdout:2/539: dread d9/dd/d17/f61 [0,4194304] 0 2023-12-16T05:56:39.906 INFO:tasks.workunit.client.1.smithi156.stdout:2/540: fsync d9/d56/f9a 0 2023-12-16T05:56:39.917 INFO:tasks.workunit.client.1.smithi156.stdout:5/733: sync 2023-12-16T05:56:39.917 INFO:tasks.workunit.client.1.smithi156.stdout:6/594: sync 2023-12-16T05:56:39.917 INFO:tasks.workunit.client.1.smithi156.stdout:7/719: sync 2023-12-16T05:56:39.917 INFO:tasks.workunit.client.1.smithi156.stdout:3/424: sync 2023-12-16T05:56:39.917 INFO:tasks.workunit.client.1.smithi156.stdout:5/734: stat da/d9a/dcd 0 2023-12-16T05:56:39.917 INFO:tasks.workunit.client.1.smithi156.stdout:3/425: fdatasync fb 0 2023-12-16T05:56:39.917 INFO:tasks.workunit.client.1.smithi156.stdout:3/426: chown dc/df/d34/d62/c89 372305062 1 2023-12-16T05:56:39.917 INFO:tasks.workunit.client.1.smithi156.stdout:8/393: sync 2023-12-16T05:56:39.917 INFO:tasks.workunit.client.1.smithi156.stdout:8/394: chown d3/d18/f19 7654762 1 2023-12-16T05:56:39.917 INFO:tasks.workunit.client.1.smithi156.stdout:8/395: stat d3/d7/d27/d46/f79 0 2023-12-16T05:56:39.917 INFO:tasks.workunit.client.1.smithi156.stdout:8/396: fdatasync d3/f5e 0 2023-12-16T05:56:39.918 INFO:tasks.workunit.client.1.smithi156.stdout:7/720: rmdir d1e/d1f/d22/d75 39 2023-12-16T05:56:39.918 INFO:tasks.workunit.client.1.smithi156.stdout:7/721: truncate d1e/d55/dba/fe6 282398 0 2023-12-16T05:56:39.918 INFO:tasks.workunit.client.1.smithi156.stdout:5/735: chown da/dc/d4b/d6c/l76 3805 1 2023-12-16T05:56:39.918 INFO:tasks.workunit.client.1.smithi156.stdout:3/427: rmdir dc 39 2023-12-16T05:56:39.918 INFO:tasks.workunit.client.1.smithi156.stdout:3/428: write dc/d10/d1d/f42 [46566,108240] 0 2023-12-16T05:56:39.920 INFO:tasks.workunit.client.1.smithi156.stdout:7/722: symlink d1e/dbf/de9/lfe 0 2023-12-16T05:56:39.920 INFO:tasks.workunit.client.1.smithi156.stdout:7/723: dread - d1e/d55/db6/ddb/fdd zero size 2023-12-16T05:56:39.921 INFO:tasks.workunit.client.1.smithi156.stdout:5/736: rename da/dc/d2d/d34/fd6 to da/dc/d4b/d6c/d77/fef 0 2023-12-16T05:56:39.921 INFO:tasks.workunit.client.1.smithi156.stdout:5/737: chown da/dc/l44 805 1 2023-12-16T05:56:39.924 INFO:tasks.workunit.client.1.smithi156.stdout:2/541: dwrite d9/dd/d17/d33/d78/f3c [0,4194304] 0 2023-12-16T05:56:39.924 INFO:tasks.workunit.client.1.smithi156.stdout:2/542: truncate d9/d68/daa/f67 1168521 0 2023-12-16T05:56:39.924 INFO:tasks.workunit.client.1.smithi156.stdout:7/724: rename d1e/d1f/d22/f64 to d1e/d55/fff 0 2023-12-16T05:56:39.926 INFO:tasks.workunit.client.1.smithi156.stdout:2/543: write d9/d68/f90 [107310,45599] 0 2023-12-16T05:56:39.928 INFO:tasks.workunit.client.1.smithi156.stdout:5/738: link da/dc/d2d/d4d/d54/da6/cb6 da/dc/d4b/d6c/cf0 0 2023-12-16T05:56:39.929 INFO:tasks.workunit.client.1.smithi156.stdout:5/739: rmdir da/dc/d2d/d4d/d54 39 2023-12-16T05:56:39.930 INFO:tasks.workunit.client.1.smithi156.stdout:3/429: dread dc/df/f55 [0,4194304] 0 2023-12-16T05:56:39.930 INFO:tasks.workunit.client.1.smithi156.stdout:3/430: readlink dc/d10/d1d/d4b/l5c 0 2023-12-16T05:56:39.930 INFO:tasks.workunit.client.1.smithi156.stdout:2/544: link d9/dd/d17/d33/d78/d39/c46 d9/dd/d17/cac 0 2023-12-16T05:56:39.931 INFO:tasks.workunit.client.1.smithi156.stdout:3/431: symlink dc/df/la4 0 2023-12-16T05:56:39.931 INFO:tasks.workunit.client.1.smithi156.stdout:3/432: fdatasync dc/d10/d1d/d4b/d52/f54 0 2023-12-16T05:56:39.931 INFO:tasks.workunit.client.1.smithi156.stdout:2/545: rmdir d9/dd/d17/d33 39 2023-12-16T05:56:39.932 INFO:tasks.workunit.client.1.smithi156.stdout:2/546: chown d9/dd 224949 1 2023-12-16T05:56:39.932 INFO:tasks.workunit.client.1.smithi156.stdout:8/397: dwrite d3/d7/d27/d46/f4e [0,4194304] 0 2023-12-16T05:56:39.932 INFO:tasks.workunit.client.1.smithi156.stdout:8/398: chown d3/d7/c15 200163426 1 2023-12-16T05:56:39.932 INFO:tasks.workunit.client.1.smithi156.stdout:8/399: chown d3/d12/d16/l35 15965 1 2023-12-16T05:56:39.933 INFO:tasks.workunit.client.1.smithi156.stdout:3/433: unlink dc/df/c28 0 2023-12-16T05:56:39.934 INFO:tasks.workunit.client.1.smithi156.stdout:2/547: unlink d9/l3b 0 2023-12-16T05:56:39.935 INFO:tasks.workunit.client.1.smithi156.stdout:5/740: dread da/dc/d2d/db0/fba [0,4194304] 0 2023-12-16T05:56:39.935 INFO:tasks.workunit.client.1.smithi156.stdout:5/741: fdatasync da/f50 0 2023-12-16T05:56:39.935 INFO:tasks.workunit.client.1.smithi156.stdout:2/548: write f8 [220097,95940] 0 2023-12-16T05:56:39.937 INFO:tasks.workunit.client.1.smithi156.stdout:8/400: getdents d3/d12/d16 0 2023-12-16T05:56:39.937 INFO:tasks.workunit.client.1.smithi156.stdout:8/401: stat d3/d18/f57 0 2023-12-16T05:56:39.938 INFO:tasks.workunit.client.1.smithi156.stdout:3/434: creat dc/d56/d69/fa5 x:0 0 0 2023-12-16T05:56:39.939 INFO:tasks.workunit.client.1.smithi156.stdout:2/549: mkdir d9/dd/d17/d33/d78/d39/d8c/da2/dad 0 2023-12-16T05:56:39.940 INFO:tasks.workunit.client.1.smithi156.stdout:7/725: dwrite d1e/d1f/d22/d75/d77/fd5 [4194304,4194304] 0 2023-12-16T05:56:39.940 INFO:tasks.workunit.client.1.smithi156.stdout:8/402: creat d3/d7/d66/d76/f7e x:0 0 0 2023-12-16T05:56:39.941 INFO:tasks.workunit.client.1.smithi156.stdout:3/435: symlink dc/d10/d1d/la6 0 2023-12-16T05:56:39.941 INFO:tasks.workunit.client.1.smithi156.stdout:3/436: truncate dc/df/d34/f71 1351584 0 2023-12-16T05:56:39.941 INFO:tasks.workunit.client.1.smithi156.stdout:5/742: write da/dc/d2d/f41 [1378537,63263] 0 2023-12-16T05:56:39.941 INFO:tasks.workunit.client.1.smithi156.stdout:3/437: read - dc/df/d66/f8f zero size 2023-12-16T05:56:39.941 INFO:tasks.workunit.client.1.smithi156.stdout:5/743: readlink da/dc/d4b/lc7 0 2023-12-16T05:56:39.942 INFO:tasks.workunit.client.1.smithi156.stdout:3/438: read dc/df/d34/f68 [1953761,9403] 0 2023-12-16T05:56:39.942 INFO:tasks.workunit.client.1.smithi156.stdout:2/550: mkdir d9/dd/d17/d33/dae 0 2023-12-16T05:56:39.949 INFO:tasks.workunit.client.1.smithi156.stdout:7/726: symlink d1e/d1f/da6/d57/d59/dd8/l100 0 2023-12-16T05:56:39.950 INFO:tasks.workunit.client.1.smithi156.stdout:7/727: read d1e/d1f/f76 [3096856,117574] 0 2023-12-16T05:56:39.950 INFO:tasks.workunit.client.1.smithi156.stdout:7/728: chown d1e/d55/d71/d61/f36 12288123 1 2023-12-16T05:56:39.950 INFO:tasks.workunit.client.1.smithi156.stdout:7/729: fsync d1e/d1f/da6/d57/f86 0 2023-12-16T05:56:39.951 INFO:tasks.workunit.client.1.smithi156.stdout:5/744: mknod da/cf1 0 2023-12-16T05:56:39.953 INFO:tasks.workunit.client.1.smithi156.stdout:8/403: unlink d3/d7/d27/d46/d6e/d3b/c4a 0 2023-12-16T05:56:39.955 INFO:tasks.workunit.client.1.smithi156.stdout:7/730: truncate d1e/f32 3110514 0 2023-12-16T05:56:39.956 INFO:tasks.workunit.client.1.smithi156.stdout:5/745: symlink da/dc/d2d/d4d/d54/d90/dc3/lf2 0 2023-12-16T05:56:39.957 INFO:tasks.workunit.client.1.smithi156.stdout:5/746: fsync da/dc/d2d/d4d/db9/dc9/fdd 0 2023-12-16T05:56:39.957 INFO:tasks.workunit.client.1.smithi156.stdout:3/439: dwrite dc/d10/d1d/d4b/d52/f54 [0,4194304] 0 2023-12-16T05:56:39.958 INFO:tasks.workunit.client.1.smithi156.stdout:8/404: truncate d3/d12/d16/d54/f60 76033 0 2023-12-16T05:56:39.958 INFO:tasks.workunit.client.1.smithi156.stdout:8/405: dread - d3/d12/f70 zero size 2023-12-16T05:56:39.958 INFO:tasks.workunit.client.1.smithi156.stdout:8/406: getdents d3/d12/d16 0 2023-12-16T05:56:39.958 INFO:tasks.workunit.client.1.smithi156.stdout:8/407: chown d3/d12/d16 2 1 2023-12-16T05:56:39.959 INFO:tasks.workunit.client.1.smithi156.stdout:2/551: dwrite d9/d68/f75 [0,4194304] 0 2023-12-16T05:56:39.959 INFO:tasks.workunit.client.1.smithi156.stdout:2/552: chown d9/dd/l53 44184181 1 2023-12-16T05:56:39.959 INFO:tasks.workunit.client.1.smithi156.stdout:2/553: write d9/f44 [2341317,32095] 0 2023-12-16T05:56:39.961 INFO:tasks.workunit.client.1.smithi156.stdout:7/731: creat d1e/d55/d71/d61/daa/db4/f101 x:0 0 0 2023-12-16T05:56:39.963 INFO:tasks.workunit.client.1.smithi156.stdout:5/747: mknod da/dc/d2d/d4d/d54/d90/dc3/cf3 0 2023-12-16T05:56:39.967 INFO:tasks.workunit.client.1.smithi156.stdout:5/748: write da/f68 [3248387,29115] 0 2023-12-16T05:56:39.968 INFO:tasks.workunit.client.1.smithi156.stdout:3/440: creat dc/d10/d1d/d4b/fa7 x:0 0 0 2023-12-16T05:56:39.971 INFO:tasks.workunit.client.1.smithi156.stdout:8/408: creat d3/d7/d62/f7f x:0 0 0 2023-12-16T05:56:39.971 INFO:tasks.workunit.client.1.smithi156.stdout:8/409: truncate d3/d12/d16/f73 387207 0 2023-12-16T05:56:39.976 INFO:tasks.workunit.client.1.smithi156.stdout:2/554: truncate d9/f27 1068091 0 2023-12-16T05:56:39.977 INFO:tasks.workunit.client.1.smithi156.stdout:7/732: dwrite d1e/dbf/fee [4194304,4194304] 0 2023-12-16T05:56:39.979 INFO:tasks.workunit.client.1.smithi156.stdout:5/749: creat da/dc/d2d/ff4 x:0 0 0 2023-12-16T05:56:39.979 INFO:tasks.workunit.client.1.smithi156.stdout:5/750: chown da/dc/d2d/f8a 4 1 2023-12-16T05:56:39.981 INFO:tasks.workunit.client.1.smithi156.stdout:3/441: creat dc/d10/d1d/fa8 x:0 0 0 2023-12-16T05:56:39.988 INFO:tasks.workunit.client.1.smithi156.stdout:8/410: mknod d3/d7/d27/d46/d6e/d3b/c80 0 2023-12-16T05:56:39.989 INFO:tasks.workunit.client.1.smithi156.stdout:2/555: truncate d9/d12/f58 1661690 0 2023-12-16T05:56:40.004 INFO:tasks.workunit.client.1.smithi156.stdout:2/556: write d9/f27 [794981,93853] 0 2023-12-16T05:56:40.010 INFO:tasks.workunit.client.1.smithi156.stdout:5/751: dwrite da/dc/f2c [0,4194304] 0 2023-12-16T05:56:40.011 INFO:tasks.workunit.client.1.smithi156.stdout:3/442: dwrite dc/d56/d67/f79 [0,4194304] 0 2023-12-16T05:56:40.011 INFO:tasks.workunit.client.1.smithi156.stdout:7/733: dwrite d1e/d55/fb3 [0,4194304] 0 2023-12-16T05:56:40.013 INFO:tasks.workunit.client.1.smithi156.stdout:3/443: write dc/d10/f24 [3626548,109574] 0 2023-12-16T05:56:40.016 INFO:tasks.workunit.client.1.smithi156.stdout:2/557: dwrite d9/d56/f9a [0,4194304] 0 2023-12-16T05:56:40.051 INFO:tasks.workunit.client.1.smithi156.stdout:7/734: mkdir d1e/d55/d71/d61/d102 0 2023-12-16T05:56:40.053 INFO:tasks.workunit.client.1.smithi156.stdout:3/444: creat dc/df/d34/d62/d75/fa9 x:0 0 0 2023-12-16T05:56:40.053 INFO:tasks.workunit.client.1.smithi156.stdout:3/445: stat dc/d10/d1d/d90 0 2023-12-16T05:56:40.053 INFO:tasks.workunit.client.1.smithi156.stdout:3/446: write dc/d56/d67/f6f [5066163,115302] 0 2023-12-16T05:56:40.060 INFO:tasks.workunit.client.1.smithi156.stdout:7/735: creat d1e/dbf/de9/f103 x:0 0 0 2023-12-16T05:56:40.060 INFO:tasks.workunit.client.1.smithi156.stdout:7/736: fdatasync d1e/d55/d71/d61/f91 0 2023-12-16T05:56:40.060 INFO:tasks.workunit.client.1.smithi156.stdout:3/447: rmdir dc 39 2023-12-16T05:56:40.065 INFO:tasks.workunit.client.1.smithi156.stdout:7/737: creat d1e/d1f/d72/da4/df2/f104 x:0 0 0 2023-12-16T05:56:40.065 INFO:tasks.workunit.client.1.smithi156.stdout:3/448: creat dc/df/d70/faa x:0 0 0 2023-12-16T05:56:40.065 INFO:tasks.workunit.client.1.smithi156.stdout:3/449: write dc/d10/d1d/d4b/d52/f72 [126080,83173] 0 2023-12-16T05:56:40.065 INFO:tasks.workunit.client.1.smithi156.stdout:7/738: mknod d1e/d55/d71/c105 0 2023-12-16T05:56:40.066 INFO:tasks.workunit.client.1.smithi156.stdout:7/739: dread d1e/f27 [0,4194304] 0 2023-12-16T05:56:40.066 INFO:tasks.workunit.client.1.smithi156.stdout:7/740: chown d1e/d55/dba/lc1 155279 1 2023-12-16T05:56:40.066 INFO:tasks.workunit.client.1.smithi156.stdout:7/741: truncate d1e/d55/dba/fe6 298097 0 2023-12-16T05:56:40.066 INFO:tasks.workunit.client.1.smithi156.stdout:7/742: write f7 [1125546,37128] 0 2023-12-16T05:56:40.069 INFO:tasks.workunit.client.1.smithi156.stdout:7/743: read d1e/f8c [3522234,21828] 0 2023-12-16T05:56:40.069 INFO:tasks.workunit.client.1.smithi156.stdout:7/744: truncate d1e/d55/d71/d61/f5d 568932 0 2023-12-16T05:56:40.071 INFO:tasks.workunit.client.1.smithi156.stdout:7/745: mknod d1e/d55/db6/c106 0 2023-12-16T05:56:40.072 INFO:tasks.workunit.client.1.smithi156.stdout:7/746: mkdir d1e/d1f/d72/d107 0 2023-12-16T05:56:40.073 INFO:tasks.workunit.client.1.smithi156.stdout:7/747: getdents d1e/d55/d71/d61/daa/db4 0 2023-12-16T05:56:40.075 INFO:tasks.workunit.client.1.smithi156.stdout:7/748: write d1e/d1f/da6/f4d [3619107,30959] 0 2023-12-16T05:56:40.075 INFO:tasks.workunit.client.1.smithi156.stdout:3/450: dwrite dc/df/f2e [4194304,4194304] 0 2023-12-16T05:56:40.076 INFO:tasks.workunit.client.1.smithi156.stdout:7/749: mkdir d1e/d55/d71/d94/d108 0 2023-12-16T05:56:40.079 INFO:tasks.workunit.client.1.smithi156.stdout:3/451: symlink dc/df/d34/d62/d75/lab 0 2023-12-16T05:56:40.080 INFO:tasks.workunit.client.1.smithi156.stdout:7/750: creat d1e/d55/dba/f109 x:0 0 0 2023-12-16T05:56:40.081 INFO:tasks.workunit.client.1.smithi156.stdout:3/452: mkdir dc/d10/d1d/d4b/dac 0 2023-12-16T05:56:40.081 INFO:tasks.workunit.client.1.smithi156.stdout:3/453: chown dc/d56/d67/c8c 17 1 2023-12-16T05:56:40.081 INFO:tasks.workunit.client.1.smithi156.stdout:3/454: chown dc/d10/f7e 54340717 1 2023-12-16T05:56:40.082 INFO:tasks.workunit.client.1.smithi156.stdout:7/751: mknod d1e/d1f/d72/d107/c10a 0 2023-12-16T05:56:40.084 INFO:tasks.workunit.client.1.smithi156.stdout:3/455: rename dc/d10/d1d/l3b to dc/df/lad 0 2023-12-16T05:56:40.085 INFO:tasks.workunit.client.1.smithi156.stdout:7/752: mknod d1e/c10b 0 2023-12-16T05:56:40.086 INFO:tasks.workunit.client.1.smithi156.stdout:3/456: rename dc/d10/d1d/d4b/d52/f72 to dc/d10/d1d/d4b/d52/fae 0 2023-12-16T05:56:40.086 INFO:tasks.workunit.client.0.smithi155.stdout:8/808: sync 2023-12-16T05:56:40.087 INFO:tasks.workunit.client.0.smithi155.stdout:5/801: sync 2023-12-16T05:56:40.087 INFO:tasks.workunit.client.0.smithi155.stdout:1/886: sync 2023-12-16T05:56:40.087 INFO:tasks.workunit.client.0.smithi155.stdout:5/802: write d0/d60/d79/df1/d9c/fe6 [30662,15334] 0 2023-12-16T05:56:40.087 INFO:tasks.workunit.client.0.smithi155.stdout:5/803: readlink d0/d2/d2a/d30/d53/d7b/d99/d47/l7d 0 2023-12-16T05:56:40.087 INFO:tasks.workunit.client.1.smithi156.stdout:3/457: symlink dc/df/d34/d62/laf 0 2023-12-16T05:56:40.087 INFO:tasks.workunit.client.1.smithi156.stdout:7/753: write d1e/f8c [5920094,116519] 0 2023-12-16T05:56:40.087 INFO:tasks.workunit.client.1.smithi156.stdout:7/754: stat d1e/d1f/d74/cc8 0 2023-12-16T05:56:40.088 INFO:tasks.workunit.client.0.smithi155.stdout:8/809: write d4/d62/d66/d78/d88/d12/f21 [1817192,91757] 0 2023-12-16T05:56:40.088 INFO:tasks.workunit.client.0.smithi155.stdout:8/810: readlink d4/d62/d66/l7b 0 2023-12-16T05:56:40.088 INFO:tasks.workunit.client.0.smithi155.stdout:8/811: write d4/d62/d66/fbd [529039,25832] 0 2023-12-16T05:56:40.089 INFO:tasks.workunit.client.1.smithi156.stdout:3/458: symlink dc/df/d66/lb0 0 2023-12-16T05:56:40.089 INFO:tasks.workunit.client.1.smithi156.stdout:3/459: dread - dc/d10/d1d/fa3 zero size 2023-12-16T05:56:40.089 INFO:tasks.workunit.client.0.smithi155.stdout:4/732: sync 2023-12-16T05:56:40.089 INFO:tasks.workunit.client.0.smithi155.stdout:2/737: sync 2023-12-16T05:56:40.089 INFO:tasks.workunit.client.0.smithi155.stdout:4/733: truncate d0/da/de0/d16/d30/dce/d75/d3d/d43/f95 1558446 0 2023-12-16T05:56:40.090 INFO:tasks.workunit.client.1.smithi156.stdout:7/755: creat d1e/d1f/d22/f10c x:0 0 0 2023-12-16T05:56:40.091 INFO:tasks.workunit.client.0.smithi155.stdout:5/804: rename d0/d2/d2a/d30/d53/lab to d0/d2/d2a/d19/d48/l105 0 2023-12-16T05:56:40.091 INFO:tasks.workunit.client.1.smithi156.stdout:3/460: creat dc/d10/fb1 x:0 0 0 2023-12-16T05:56:40.092 INFO:tasks.workunit.client.1.smithi156.stdout:7/756: mkdir d1e/d1f/da6/d10d 0 2023-12-16T05:56:40.092 INFO:tasks.workunit.client.1.smithi156.stdout:7/757: write d1e/d55/d71/d61/daa/db4/fcb [266787,62726] 0 2023-12-16T05:56:40.092 INFO:tasks.workunit.client.1.smithi156.stdout:7/758: read - d1e/dbf/fd1 zero size 2023-12-16T05:56:40.093 INFO:tasks.workunit.client.0.smithi155.stdout:8/812: dread d4/d62/d66/d78/d88/d1b/d1c/d19/d64/fa4 [0,4194304] 0 2023-12-16T05:56:40.093 INFO:tasks.workunit.client.1.smithi156.stdout:3/461: mkdir dc/d10/d1d/db2 0 2023-12-16T05:56:40.095 INFO:tasks.workunit.client.0.smithi155.stdout:2/738: mknod d0/d7/d1f/cf6 0 2023-12-16T05:56:40.095 INFO:tasks.workunit.client.0.smithi155.stdout:4/734: mknod d0/da/de0/d16/d30/dce/d75/d3d/d49/cf0 0 2023-12-16T05:56:40.095 INFO:tasks.workunit.client.0.smithi155.stdout:8/813: dread d4/d62/d66/d78/d88/d1b/d1c/d46/f8f [0,4194304] 0 2023-12-16T05:56:40.095 INFO:tasks.workunit.client.0.smithi155.stdout:8/814: chown d4/d62/d66/d78/d88/la8 16430702 1 2023-12-16T05:56:40.095 INFO:tasks.workunit.client.0.smithi155.stdout:4/735: write d0/da/de0/d16/d30/dce/d75/d89/d9a/fe6 [474472,69279] 0 2023-12-16T05:56:40.096 INFO:tasks.workunit.client.1.smithi156.stdout:3/462: getdents dc/d56/d69 0 2023-12-16T05:56:40.096 INFO:tasks.workunit.client.1.smithi156.stdout:3/463: truncate dc/df/d70/faa 183316 0 2023-12-16T05:56:40.096 INFO:tasks.workunit.client.0.smithi155.stdout:2/739: symlink d0/d7/dd/d62/d66/lf7 0 2023-12-16T05:56:40.097 INFO:tasks.workunit.client.0.smithi155.stdout:8/815: link d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/db7/ccf d4/d62/d66/d78/d88/d1b/d2a/d51/c114 0 2023-12-16T05:56:40.097 INFO:tasks.workunit.client.0.smithi155.stdout:8/816: write d4/d62/d66/d78/d88/d12/f108 [57477,5356] 0 2023-12-16T05:56:40.098 INFO:tasks.workunit.client.0.smithi155.stdout:8/817: mknod d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d103/c115 0 2023-12-16T05:56:40.101 INFO:tasks.workunit.client.0.smithi155.stdout:8/818: link d4/d62/d66/d78/d88/d1b/d1c/d97/ffc d4/d62/d66/d78/d88/d1b/d1c/d19/d64/f116 0 2023-12-16T05:56:40.102 INFO:tasks.workunit.client.1.smithi156.stdout:2/558: dwrite d9/dd/d17/d33/d47/f6e [0,4194304] 0 2023-12-16T05:56:40.104 INFO:tasks.workunit.client.1.smithi156.stdout:3/464: write dc/df/f55 [1776458,88142] 0 2023-12-16T05:56:40.109 INFO:tasks.workunit.client.1.smithi156.stdout:2/559: mkdir d9/dd/d17/d33/dae/daf 0 2023-12-16T05:56:40.113 INFO:tasks.workunit.client.0.smithi155.stdout:1/887: dwrite d1/d7/d4b/d5c/f82 [4194304,4194304] 0 2023-12-16T05:56:40.113 INFO:tasks.workunit.client.0.smithi155.stdout:2/740: write d0/d5/d6/f82 [1862099,98068] 0 2023-12-16T05:56:40.113 INFO:tasks.workunit.client.0.smithi155.stdout:2/741: fsync d0/f2 0 2023-12-16T05:56:40.115 INFO:tasks.workunit.client.0.smithi155.stdout:1/888: unlink d1/d7/d16/d30/f6e 0 2023-12-16T05:56:40.117 INFO:tasks.workunit.client.0.smithi155.stdout:2/742: rename d0/d7/dd/d49/d4b/le6 to d0/d7/dd/d49/d4b/lf8 0 2023-12-16T05:56:40.117 INFO:tasks.workunit.client.0.smithi155.stdout:2/743: stat d0/d7/d69/f87 0 2023-12-16T05:56:40.117 INFO:tasks.workunit.client.1.smithi156.stdout:2/560: write d9/dd/d17/d33/d78/d39/f76 [1454068,76049] 0 2023-12-16T05:56:40.117 INFO:tasks.workunit.client.1.smithi156.stdout:7/759: dwrite d1e/d1f/d22/f79 [0,4194304] 0 2023-12-16T05:56:40.117 INFO:tasks.workunit.client.1.smithi156.stdout:7/760: fsync d1e/d1f/d22/d75/fa9 0 2023-12-16T05:56:40.118 INFO:tasks.workunit.client.0.smithi155.stdout:1/889: creat d1/d7/f11d x:0 0 0 2023-12-16T05:56:40.118 INFO:tasks.workunit.client.0.smithi155.stdout:1/890: chown d1/d7/d4b/d8e/dc7/d28/d85/de0/d79/daa/cab 21635077 1 2023-12-16T05:56:40.118 INFO:tasks.workunit.client.0.smithi155.stdout:5/805: dwrite d0/d2/d4f/f55 [4194304,4194304] 0 2023-12-16T05:56:40.118 INFO:tasks.workunit.client.0.smithi155.stdout:5/806: chown d0/d2/d2a/f2e 198075584 1 2023-12-16T05:56:40.118 INFO:tasks.workunit.client.0.smithi155.stdout:5/807: truncate d0/d60/d79/df1/d9c/fe6 590081 0 2023-12-16T05:56:40.120 INFO:tasks.workunit.client.0.smithi155.stdout:1/891: mknod d1/d7/d4b/d8e/dc7/d28/d74/dc5/c11e 0 2023-12-16T05:56:40.120 INFO:tasks.workunit.client.1.smithi156.stdout:2/561: creat d9/dd/d17/d33/dae/fb0 x:0 0 0 2023-12-16T05:56:40.120 INFO:tasks.workunit.client.0.smithi155.stdout:1/892: dread - d1/d7/f9e zero size 2023-12-16T05:56:40.121 INFO:tasks.workunit.client.0.smithi155.stdout:1/893: creat d1/d92/f11f x:0 0 0 2023-12-16T05:56:40.121 INFO:tasks.workunit.client.0.smithi155.stdout:1/894: read - d1/d7/d16/de4/ffe zero size 2023-12-16T05:56:40.123 INFO:tasks.workunit.client.1.smithi156.stdout:7/761: mknod d1e/d1f/da6/c10e 0 2023-12-16T05:56:40.125 INFO:tasks.workunit.client.1.smithi156.stdout:7/762: rename d1e/d55/d71/d61/daa/c70 to d1e/d1f/da6/c10f 0 2023-12-16T05:56:40.125 INFO:tasks.workunit.client.1.smithi156.stdout:7/763: write d1e/d55/d71/f49 [5084670,129902] 0 2023-12-16T05:56:40.125 INFO:tasks.workunit.client.1.smithi156.stdout:7/764: write d1e/d39/fa8 [3544961,56900] 0 2023-12-16T05:56:40.125 INFO:tasks.workunit.client.1.smithi156.stdout:7/765: dread - d1e/d55/d71/fc3 zero size 2023-12-16T05:56:40.125 INFO:tasks.workunit.client.1.smithi156.stdout:7/766: readlink d1e/d55/d71/d61/l5b 0 2023-12-16T05:56:40.127 INFO:tasks.workunit.client.0.smithi155.stdout:8/819: getdents d4/d62/d66/d78/d88/d1b/d1c/d19/d64 0 2023-12-16T05:56:40.128 INFO:tasks.workunit.client.1.smithi156.stdout:7/767: creat d1e/d1f/da6/d57/d59/dd8/f110 x:0 0 0 2023-12-16T05:56:40.129 INFO:tasks.workunit.client.1.smithi156.stdout:7/768: readlink d1e/d55/d71/d61/l5b 0 2023-12-16T05:56:40.129 INFO:tasks.workunit.client.0.smithi155.stdout:8/820: mkdir d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/d117 0 2023-12-16T05:56:40.129 INFO:tasks.workunit.client.0.smithi155.stdout:8/821: truncate d4/d62/d66/d78/d88/d1b/d1c/d46/f89 1974780 0 2023-12-16T05:56:40.129 INFO:tasks.workunit.client.0.smithi155.stdout:8/822: creat d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/f118 x:0 0 0 2023-12-16T05:56:40.131 INFO:tasks.workunit.client.0.smithi155.stdout:8/823: unlink d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/f101 0 2023-12-16T05:56:40.133 INFO:tasks.workunit.client.1.smithi156.stdout:3/465: dwrite dc/df/f2b [0,4194304] 0 2023-12-16T05:56:40.133 INFO:tasks.workunit.client.1.smithi156.stdout:3/466: truncate dc/d10/f7e 4923307 0 2023-12-16T05:56:40.133 INFO:tasks.workunit.client.1.smithi156.stdout:2/562: dread d9/f20 [0,4194304] 0 2023-12-16T05:56:40.134 INFO:tasks.workunit.client.0.smithi155.stdout:1/895: dread d1/f2a [0,4194304] 0 2023-12-16T05:56:40.134 INFO:tasks.workunit.client.0.smithi155.stdout:8/824: unlink d4/d62/d66/d78/d88/d12/f6b 0 2023-12-16T05:56:40.134 INFO:tasks.workunit.client.0.smithi155.stdout:8/825: chown d4/d62/d66/d78/l109 174 1 2023-12-16T05:56:40.135 INFO:tasks.workunit.client.1.smithi156.stdout:3/467: dread dc/df/d70/faa [0,4194304] 0 2023-12-16T05:56:40.135 INFO:tasks.workunit.client.1.smithi156.stdout:3/468: chown dc/d10/d3d/l30 479019 1 2023-12-16T05:56:40.135 INFO:tasks.workunit.client.1.smithi156.stdout:3/469: write dc/d56/d67/f6f [5453715,43913] 0 2023-12-16T05:56:40.135 INFO:tasks.workunit.client.1.smithi156.stdout:3/470: chown dc/df/f2e 134838172 1 2023-12-16T05:56:40.135 INFO:tasks.workunit.client.1.smithi156.stdout:3/471: chown dc/df/d34/d62/f8d 71 1 2023-12-16T05:56:40.135 INFO:tasks.workunit.client.1.smithi156.stdout:3/472: fdatasync dc/d10/d1d/f3a 0 2023-12-16T05:56:40.135 INFO:tasks.workunit.client.1.smithi156.stdout:7/769: truncate d1e/d1f/da6/d57/f92 3468853 0 2023-12-16T05:56:40.135 INFO:tasks.workunit.client.1.smithi156.stdout:7/770: fdatasync d1e/d55/d71/d61/daa/f6f 0 2023-12-16T05:56:40.135 INFO:tasks.workunit.client.0.smithi155.stdout:4/736: dwrite d0/da/de0/d16/d1a/f6f [4194304,4194304] 0 2023-12-16T05:56:40.136 INFO:tasks.workunit.client.0.smithi155.stdout:1/896: rmdir d1/d25/d43 39 2023-12-16T05:56:40.136 INFO:tasks.workunit.client.1.smithi156.stdout:3/473: rename dc/df/d34/f71 to dc/d56/d67/d6e/fb3 0 2023-12-16T05:56:40.137 INFO:tasks.workunit.client.0.smithi155.stdout:8/826: creat d4/d62/d66/d78/d88/d1b/f119 x:0 0 0 2023-12-16T05:56:40.137 INFO:tasks.workunit.client.0.smithi155.stdout:8/827: fsync d4/d62/d66/d78/d88/d1b/f20 0 2023-12-16T05:56:40.137 INFO:tasks.workunit.client.0.smithi155.stdout:8/828: chown d4/d62/d95 190776 1 2023-12-16T05:56:40.137 INFO:tasks.workunit.client.1.smithi156.stdout:7/771: creat d1e/d55/d71/f111 x:0 0 0 2023-12-16T05:56:40.138 INFO:tasks.workunit.client.1.smithi156.stdout:7/772: write d1e/d1f/f53 [395410,50998] 0 2023-12-16T05:56:40.138 INFO:tasks.workunit.client.0.smithi155.stdout:4/737: symlink d0/da/de0/d16/d30/d52/lf1 0 2023-12-16T05:56:40.139 INFO:tasks.workunit.client.0.smithi155.stdout:1/897: creat d1/d7/d4b/d8e/dc7/d28/d85/f120 x:0 0 0 2023-12-16T05:56:40.139 INFO:tasks.workunit.client.1.smithi156.stdout:2/563: link f8 d9/d12/fb1 0 2023-12-16T05:56:40.140 INFO:tasks.workunit.client.0.smithi155.stdout:8/829: rename d4/d62/d66/d78/d88/d12/fb1 to d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/f11a 0 2023-12-16T05:56:40.140 INFO:tasks.workunit.client.1.smithi156.stdout:3/474: mkdir dc/d10/db4 0 2023-12-16T05:56:40.141 INFO:tasks.workunit.client.0.smithi155.stdout:2/744: dwrite d0/d7/d1f/fb9 [0,4194304] 0 2023-12-16T05:56:40.141 INFO:tasks.workunit.client.0.smithi155.stdout:2/745: truncate d0/d34/d3c/fe9 781873 0 2023-12-16T05:56:40.142 INFO:tasks.workunit.client.0.smithi155.stdout:4/738: getdents d0/da/de0/d16/d30/dce/d7b 0 2023-12-16T05:56:40.142 INFO:tasks.workunit.client.1.smithi156.stdout:7/773: creat d1e/d1f/da6/d10d/f112 x:0 0 0 2023-12-16T05:56:40.142 INFO:tasks.workunit.client.1.smithi156.stdout:7/774: readlink d1e/l7b 0 2023-12-16T05:56:40.142 INFO:tasks.workunit.client.1.smithi156.stdout:7/775: stat d1e/d1f/da6/c47 0 2023-12-16T05:56:40.142 INFO:tasks.workunit.client.1.smithi156.stdout:7/776: dread - d1e/d1f/d72/da4/fda zero size 2023-12-16T05:56:40.142 INFO:tasks.workunit.client.1.smithi156.stdout:7/777: write d1e/fc5 [803917,6898] 0 2023-12-16T05:56:40.143 INFO:tasks.workunit.client.1.smithi156.stdout:7/778: write d1e/d1f/da6/f45 [986283,98624] 0 2023-12-16T05:56:40.144 INFO:tasks.workunit.client.1.smithi156.stdout:3/475: mkdir dc/d10/d3d/db5 0 2023-12-16T05:56:40.144 INFO:tasks.workunit.client.1.smithi156.stdout:3/476: chown dc/d10/d1d/d4b/d52/fae 8141561 1 2023-12-16T05:56:40.144 INFO:tasks.workunit.client.0.smithi155.stdout:5/808: dwrite d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/dc9/ff8 [0,4194304] 0 2023-12-16T05:56:40.145 INFO:tasks.workunit.client.1.smithi156.stdout:7/779: mknod d1e/c113 0 2023-12-16T05:56:40.145 INFO:tasks.workunit.client.1.smithi156.stdout:7/780: dread - d1e/d1f/da6/d57/dca/fd3 zero size 2023-12-16T05:56:40.147 INFO:tasks.workunit.client.1.smithi156.stdout:2/564: mkdir d9/dd/d17/d33/d78/d39/d8c/db2 0 2023-12-16T05:56:40.148 INFO:tasks.workunit.client.0.smithi155.stdout:2/746: rename d0/d7/dd/d49/d4b/d8c/dcd/dd2 to d0/d5/d6/d5f/df9 0 2023-12-16T05:56:40.149 INFO:tasks.workunit.client.1.smithi156.stdout:7/781: read d1e/f32 [2841038,33319] 0 2023-12-16T05:56:40.149 INFO:tasks.workunit.client.1.smithi156.stdout:7/782: chown d1e/d55/d71/d61/daa/f3d 1920 1 2023-12-16T05:56:40.150 INFO:tasks.workunit.client.1.smithi156.stdout:2/565: write d9/d12/f18 [663330,59258] 0 2023-12-16T05:56:40.154 INFO:tasks.workunit.client.1.smithi156.stdout:2/566: creat d9/d56/d5f/fb3 x:0 0 0 2023-12-16T05:56:40.157 INFO:tasks.workunit.client.0.smithi155.stdout:8/830: truncate d4/d62/d66/d78/d88/d1b/d1c/d97/f8c 1878286 0 2023-12-16T05:56:40.161 INFO:tasks.workunit.client.0.smithi155.stdout:8/831: getdents d4/d62/d66/d78/d88/d12/ddc 0 2023-12-16T05:56:40.162 INFO:tasks.workunit.client.1.smithi156.stdout:2/567: dread d9/dd/d17/d33/d78/f70 [0,4194304] 0 2023-12-16T05:56:40.164 INFO:tasks.workunit.client.0.smithi155.stdout:1/898: rmdir d1/d7/d4b/d8e/dc7/d28/d85 39 2023-12-16T05:56:40.164 INFO:tasks.workunit.client.1.smithi156.stdout:3/477: dwrite dc/d10/f24 [4194304,4194304] 0 2023-12-16T05:56:40.165 INFO:tasks.workunit.client.0.smithi155.stdout:2/747: dread d0/d5/d6/f75 [0,4194304] 0 2023-12-16T05:56:40.167 INFO:tasks.workunit.client.0.smithi155.stdout:1/899: truncate d1/d7/d4b/d5c/f88 492177 0 2023-12-16T05:56:40.167 INFO:tasks.workunit.client.0.smithi155.stdout:5/809: dwrite d0/d2/d2a/d19/d21/d56/fac [0,4194304] 0 2023-12-16T05:56:40.168 INFO:tasks.workunit.client.0.smithi155.stdout:2/748: dread d0/d7/dd/d14/fa6 [0,4194304] 0 2023-12-16T05:56:40.168 INFO:tasks.workunit.client.0.smithi155.stdout:5/810: chown d0/d2/d2a/f42 45198204 1 2023-12-16T05:56:40.170 INFO:tasks.workunit.client.0.smithi155.stdout:1/900: rename d1/d7/d4b/d8e/dbc to d1/d7/d4b/d8e/dc7/d28/d8f/d121 0 2023-12-16T05:56:40.175 INFO:tasks.workunit.client.0.smithi155.stdout:1/901: rename d1/d7/c78 to d1/d7/d4b/d8e/dc7/d28/d85/de0/c122 0 2023-12-16T05:56:40.181 INFO:tasks.workunit.client.0.smithi155.stdout:1/902: unlink d1/d7/d4b/d8e/dc7/d28/d85/de0/d79/c98 0 2023-12-16T05:56:40.181 INFO:tasks.workunit.client.1.smithi156.stdout:1/438: sync 2023-12-16T05:56:40.182 INFO:tasks.workunit.client.0.smithi155.stdout:5/811: dread d0/d2/f22 [4194304,4194304] 0 2023-12-16T05:56:40.182 INFO:tasks.workunit.client.0.smithi155.stdout:5/812: write d0/f32 [797666,21506] 0 2023-12-16T05:56:40.182 INFO:tasks.workunit.client.0.smithi155.stdout:5/813: getdents d0/d2/d2a/d19/d48/df5 0 2023-12-16T05:56:40.183 INFO:tasks.workunit.client.0.smithi155.stdout:1/903: mkdir d1/d7/d4b/d8e/dc7/d28/d85/d123 0 2023-12-16T05:56:40.184 INFO:tasks.workunit.client.0.smithi155.stdout:1/904: creat d1/d7/d4b/f124 x:0 0 0 2023-12-16T05:56:40.184 INFO:tasks.workunit.client.0.smithi155.stdout:1/905: stat d1/d7/c53 0 2023-12-16T05:56:40.184 INFO:tasks.workunit.client.0.smithi155.stdout:5/814: write d0/d2/d2a/d30/d53/d7b/d99/d47/f73 [5252521,130700] 0 2023-12-16T05:56:40.185 INFO:tasks.workunit.client.0.smithi155.stdout:5/815: stat d0 0 2023-12-16T05:56:40.185 INFO:tasks.workunit.client.0.smithi155.stdout:1/906: mkdir d1/d7/d4b/d8e/dc7/d28/d8f/d125 0 2023-12-16T05:56:40.185 INFO:tasks.workunit.client.0.smithi155.stdout:1/907: write d1/d7/f18 [2770174,92362] 0 2023-12-16T05:56:40.186 INFO:tasks.workunit.client.0.smithi155.stdout:5/816: symlink d0/d2/d2a/d19/l106 0 2023-12-16T05:56:40.186 INFO:tasks.workunit.client.0.smithi155.stdout:1/908: write d1/d7/d4b/d8e/dc7/d28/d85/fe1 [2691550,71172] 0 2023-12-16T05:56:40.186 INFO:tasks.workunit.client.0.smithi155.stdout:1/909: truncate d1/d7/d4b/d8e/dc7/fd5 17373 0 2023-12-16T05:56:40.186 INFO:tasks.workunit.client.0.smithi155.stdout:1/910: dread - d1/d7/d4b/f124 zero size 2023-12-16T05:56:40.187 INFO:tasks.workunit.client.0.smithi155.stdout:1/911: stat d1/d69/f115 0 2023-12-16T05:56:40.187 INFO:tasks.workunit.client.0.smithi155.stdout:1/912: rmdir d1/d7/d16 39 2023-12-16T05:56:40.200 INFO:tasks.workunit.client.1.smithi156.stdout:1/439: symlink d3/d17/d1c/d22/d57/d61/l92 0 2023-12-16T05:56:40.200 INFO:tasks.workunit.client.1.smithi156.stdout:1/440: dread - d3/d3a/f7a zero size 2023-12-16T05:56:40.200 INFO:tasks.workunit.client.1.smithi156.stdout:1/441: chown d3/d17/c42 0 1 2023-12-16T05:56:40.201 INFO:tasks.workunit.client.1.smithi156.stdout:2/568: rename d9/dd/d17/d33/d78/d39/d60/d6a/d91 to d9/d68/daa/db4 0 2023-12-16T05:56:40.203 INFO:tasks.workunit.client.1.smithi156.stdout:1/442: rename d3/d17/d1c/f31 to d3/d1b/d8b/f93 0 2023-12-16T05:56:40.204 INFO:tasks.workunit.client.1.smithi156.stdout:2/569: unlink d9/dd/d17/d33/d78/d39/d60/d6a/la7 0 2023-12-16T05:56:40.204 INFO:tasks.workunit.client.1.smithi156.stdout:2/570: chown d9/dd/d17/d33/d78/d39/d8c/da2/da6/d80/f85 3655 1 2023-12-16T05:56:40.213 INFO:tasks.workunit.client.1.smithi156.stdout:3/478: dwrite dc/d56/d69/fa5 [0,4194304] 0 2023-12-16T05:56:40.213 INFO:tasks.workunit.client.1.smithi156.stdout:3/479: fdatasync dc/d10/d1d/d4b/f76 0 2023-12-16T05:56:40.214 INFO:tasks.workunit.client.0.smithi155.stdout:2/749: dwrite d0/d34/d3c/f79 [0,4194304] 0 2023-12-16T05:56:40.214 INFO:tasks.workunit.client.0.smithi155.stdout:1/913: dwrite d1/f4f [0,4194304] 0 2023-12-16T05:56:40.214 INFO:tasks.workunit.client.0.smithi155.stdout:8/832: dwrite d4/d62/d66/d78/d88/d1b/d1c/f54 [0,4194304] 0 2023-12-16T05:56:40.217 INFO:tasks.workunit.client.1.smithi156.stdout:1/443: dread d3/d17/d19/f58 [0,4194304] 0 2023-12-16T05:56:40.219 INFO:tasks.workunit.client.0.smithi155.stdout:1/914: rmdir d1/d7/d16/d30 39 2023-12-16T05:56:40.219 INFO:tasks.workunit.client.0.smithi155.stdout:1/915: write d1/d7/d16/f21 [5590405,37039] 0 2023-12-16T05:56:40.219 INFO:tasks.workunit.client.0.smithi155.stdout:8/833: chown d4/d62/d66/d78/d88/d1b/d1c/d97/l52 298 1 2023-12-16T05:56:40.221 INFO:tasks.workunit.client.0.smithi155.stdout:8/834: mkdir d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/d11b 0 2023-12-16T05:56:40.222 INFO:tasks.workunit.client.0.smithi155.stdout:8/835: truncate d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/f60 860403 0 2023-12-16T05:56:40.222 INFO:tasks.workunit.client.0.smithi155.stdout:8/836: write d4/d62/d66/d78/d88/d1b/d1c/d97/d29/fe9 [951181,44679] 0 2023-12-16T05:56:40.223 INFO:tasks.workunit.client.0.smithi155.stdout:1/916: dread d1/d25/d43/f77 [0,4194304] 0 2023-12-16T05:56:40.223 INFO:tasks.workunit.client.0.smithi155.stdout:8/837: unlink d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/fa9 0 2023-12-16T05:56:40.223 INFO:tasks.workunit.client.0.smithi155.stdout:8/838: truncate d4/fe1 725017 0 2023-12-16T05:56:40.223 INFO:tasks.workunit.client.0.smithi155.stdout:8/839: chown d4/d62/d66/d78/d88/d1b/d1c/d97/d29/l58 2344 1 2023-12-16T05:56:40.223 INFO:tasks.workunit.client.0.smithi155.stdout:8/840: chown d4/d62/d66/d78/d88/d1b/d2a/d51/l9f 265649845 1 2023-12-16T05:56:40.224 INFO:tasks.workunit.client.0.smithi155.stdout:8/841: truncate d4/fac 454044 0 2023-12-16T05:56:40.224 INFO:tasks.workunit.client.1.smithi156.stdout:2/571: rename d9/dd/d17/d33/d78/d39/d60/d6a to d9/dd/d17/d33/db5 0 2023-12-16T05:56:40.224 INFO:tasks.workunit.client.1.smithi156.stdout:3/480: dread dc/d10/d1d/d4b/f51 [0,4194304] 0 2023-12-16T05:56:40.225 INFO:tasks.workunit.client.0.smithi155.stdout:1/917: link d1/d7/d4b/d8e/dc7/d28/d8f/le7 d1/d7/d4b/d8e/dc7/d28/d8f/db2/l126 0 2023-12-16T05:56:40.225 INFO:tasks.workunit.client.1.smithi156.stdout:2/572: creat d9/dd/d17/d33/d78/d39/d60/fb6 x:0 0 0 2023-12-16T05:56:40.226 INFO:tasks.workunit.client.1.smithi156.stdout:3/481: write dc/df/f2f [2809551,91271] 0 2023-12-16T05:56:40.227 INFO:tasks.workunit.client.1.smithi156.stdout:2/573: creat d9/dd/d17/d33/d78/d39/d8c/fb7 x:0 0 0 2023-12-16T05:56:40.227 INFO:tasks.workunit.client.1.smithi156.stdout:2/574: stat d9/dd/l53 0 2023-12-16T05:56:40.227 INFO:tasks.workunit.client.1.smithi156.stdout:2/575: write d9/dd/d17/d33/d78/d39/d8c/da2/da6/f64 [890187,48937] 0 2023-12-16T05:56:40.228 INFO:tasks.workunit.client.1.smithi156.stdout:3/482: truncate dc/f7c 5970251 0 2023-12-16T05:56:40.228 INFO:tasks.workunit.client.1.smithi156.stdout:3/483: fsync dc/d10/d1d/f42 0 2023-12-16T05:56:40.229 INFO:tasks.workunit.client.1.smithi156.stdout:2/576: creat d9/dd/d17/d33/d78/d39/d8c/da2/dad/fb8 x:0 0 0 2023-12-16T05:56:40.229 INFO:tasks.workunit.client.1.smithi156.stdout:3/484: creat dc/d10/d1d/d4b/fb6 x:0 0 0 2023-12-16T05:56:40.230 INFO:tasks.workunit.client.1.smithi156.stdout:3/485: readlink dc/d56/d67/d6e/l94 0 2023-12-16T05:56:40.230 INFO:tasks.workunit.client.1.smithi156.stdout:3/486: write dc/f19 [5127719,99754] 0 2023-12-16T05:56:40.230 INFO:tasks.workunit.client.1.smithi156.stdout:2/577: creat d9/d12/fb9 x:0 0 0 2023-12-16T05:56:40.232 INFO:tasks.workunit.client.1.smithi156.stdout:1/444: dwrite d3/d17/d4d/f64 [0,4194304] 0 2023-12-16T05:56:40.232 INFO:tasks.workunit.client.1.smithi156.stdout:2/578: getdents d9/dd/d17/d33/d78/d39 0 2023-12-16T05:56:40.232 INFO:tasks.workunit.client.1.smithi156.stdout:2/579: truncate d9/dd/d17/f61 545963 0 2023-12-16T05:56:40.233 INFO:tasks.workunit.client.1.smithi156.stdout:6/595: sync 2023-12-16T05:56:40.233 INFO:tasks.workunit.client.1.smithi156.stdout:9/523: sync 2023-12-16T05:56:40.233 INFO:tasks.workunit.client.1.smithi156.stdout:6/596: truncate f8 4945261 0 2023-12-16T05:56:40.234 INFO:tasks.workunit.client.1.smithi156.stdout:9/524: write d6/d19/d30/d5b/d9a/f9f [225843,101362] 0 2023-12-16T05:56:40.234 INFO:tasks.workunit.client.1.smithi156.stdout:0/638: sync 2023-12-16T05:56:40.234 INFO:tasks.workunit.client.1.smithi156.stdout:0/639: chown d2/d23 144 1 2023-12-16T05:56:40.234 INFO:tasks.workunit.client.1.smithi156.stdout:0/640: fsync d2/d7/dd/d29/f89 0 2023-12-16T05:56:40.234 INFO:tasks.workunit.client.1.smithi156.stdout:4/543: sync 2023-12-16T05:56:40.240 INFO:tasks.workunit.client.1.smithi156.stdout:2/580: creat d9/dd/fba x:0 0 0 2023-12-16T05:56:40.242 INFO:tasks.workunit.client.1.smithi156.stdout:6/597: mknod d9/d13/d2f/d51/d82/cb3 0 2023-12-16T05:56:40.242 INFO:tasks.workunit.client.1.smithi156.stdout:9/525: mkdir d6/da3/db0 0 2023-12-16T05:56:40.245 INFO:tasks.workunit.client.1.smithi156.stdout:0/641: creat d2/d7/dd/d29/d38/d51/d65/fc8 x:0 0 0 2023-12-16T05:56:40.245 INFO:tasks.workunit.client.1.smithi156.stdout:4/544: creat d9/d43/fb4 x:0 0 0 2023-12-16T05:56:40.246 INFO:tasks.workunit.client.0.smithi155.stdout:8/842: dwrite d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/fbb [0,4194304] 0 2023-12-16T05:56:40.248 INFO:tasks.workunit.client.1.smithi156.stdout:1/445: rename d3/d17/d1c/d22/d57/d82/c84 to d3/c94 0 2023-12-16T05:56:40.249 INFO:tasks.workunit.client.1.smithi156.stdout:1/446: dread - d3/d1b/d27/d4f/d75/f72 zero size 2023-12-16T05:56:40.249 INFO:tasks.workunit.client.0.smithi155.stdout:8/843: write d4/d62/d66/d78/d88/d12/f2e [321086,82690] 0 2023-12-16T05:56:40.249 INFO:tasks.workunit.client.0.smithi155.stdout:8/844: chown d4/d62/d66/fbd 392 1 2023-12-16T05:56:40.249 INFO:tasks.workunit.client.0.smithi155.stdout:8/845: write d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/f100 [545013,34846] 0 2023-12-16T05:56:40.249 INFO:tasks.workunit.client.0.smithi155.stdout:8/846: fdatasync d4/d62/d66/d78/d88/d1b/d1c/d19/fb4 0 2023-12-16T05:56:40.249 INFO:tasks.workunit.client.0.smithi155.stdout:8/847: creat d4/d62/d66/d78/d88/d1b/d1c/d1a/f11c x:0 0 0 2023-12-16T05:56:40.250 INFO:tasks.workunit.client.0.smithi155.stdout:1/918: dwrite d1/d25/d43/f60 [0,4194304] 0 2023-12-16T05:56:40.250 INFO:tasks.workunit.client.0.smithi155.stdout:8/848: read d4/dd3/fea [828592,102025] 0 2023-12-16T05:56:40.250 INFO:tasks.workunit.client.0.smithi155.stdout:8/849: dread - d4/f102 zero size 2023-12-16T05:56:40.250 INFO:tasks.workunit.client.0.smithi155.stdout:8/850: write d4/d62/d66/d78/d88/d1b/d1c/d1a/f3d [4732870,61203] 0 2023-12-16T05:56:40.250 INFO:tasks.workunit.client.0.smithi155.stdout:8/851: truncate d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/f63 1021649 0 2023-12-16T05:56:40.251 INFO:tasks.workunit.client.0.smithi155.stdout:1/919: dread d1/d7/d16/de4/f10d [0,4194304] 0 2023-12-16T05:56:40.251 INFO:tasks.workunit.client.1.smithi156.stdout:3/487: dwrite dc/d10/d1d/fa8 [0,4194304] 0 2023-12-16T05:56:40.252 INFO:tasks.workunit.client.1.smithi156.stdout:3/488: write fb [8533006,387] 0 2023-12-16T05:56:40.252 INFO:tasks.workunit.client.1.smithi156.stdout:3/489: getdents dc/d10/db4 0 2023-12-16T05:56:40.252 INFO:tasks.workunit.client.1.smithi156.stdout:9/526: creat d6/d2e/d8a/da5/fb1 x:0 0 0 2023-12-16T05:56:40.252 INFO:tasks.workunit.client.1.smithi156.stdout:9/527: fsync d6/d19/f32 0 2023-12-16T05:56:40.252 INFO:tasks.workunit.client.1.smithi156.stdout:4/545: getdents d9/d2b/d9a 0 2023-12-16T05:56:40.252 INFO:tasks.workunit.client.1.smithi156.stdout:4/546: write d9/d2c/d7a/f8a [833922,79639] 0 2023-12-16T05:56:40.252 INFO:tasks.workunit.client.1.smithi156.stdout:1/447: symlink d3/d17/d19/l95 0 2023-12-16T05:56:40.255 INFO:tasks.workunit.client.1.smithi156.stdout:6/598: rename d9/d13/d2f/d51/d6b/l7c to d9/lb4 0 2023-12-16T05:56:40.259 INFO:tasks.workunit.client.1.smithi156.stdout:3/490: creat dc/fb7 x:0 0 0 2023-12-16T05:56:40.259 INFO:tasks.workunit.client.1.smithi156.stdout:3/491: chown dc/d10/f50 42 1 2023-12-16T05:56:40.259 INFO:tasks.workunit.client.1.smithi156.stdout:3/492: readlink dc/df/l16 0 2023-12-16T05:56:40.260 INFO:tasks.workunit.client.1.smithi156.stdout:3/493: write dc/d10/f18 [1973894,26640] 0 2023-12-16T05:56:40.260 INFO:tasks.workunit.client.1.smithi156.stdout:0/642: mkdir d2/d7/dd/d2d/d5e/d8f/dc9 0 2023-12-16T05:56:40.260 INFO:tasks.workunit.client.1.smithi156.stdout:0/643: chown d2/d47 3 1 2023-12-16T05:56:40.263 INFO:tasks.workunit.client.1.smithi156.stdout:4/547: creat d9/d2b/d35/fb5 x:0 0 0 2023-12-16T05:56:40.265 INFO:tasks.workunit.client.1.smithi156.stdout:9/528: rename d6/d19/d30/d5b/l64 to d6/da3/db0/lb2 0 2023-12-16T05:56:40.265 INFO:tasks.workunit.client.1.smithi156.stdout:9/529: readlink d6/d19/d30/l62 0 2023-12-16T05:56:40.265 INFO:tasks.workunit.client.1.smithi156.stdout:9/530: readlink d6/d19/l71 0 2023-12-16T05:56:40.266 INFO:tasks.workunit.client.1.smithi156.stdout:0/644: symlink d2/d7/dd/d29/d4b/dc0/lca 0 2023-12-16T05:56:40.269 INFO:tasks.workunit.client.1.smithi156.stdout:6/599: rename d9/d1c/f47 to d9/d13/d3e/fb5 0 2023-12-16T05:56:40.269 INFO:tasks.workunit.client.1.smithi156.stdout:6/600: chown d9/d13/d2f/d51/d9b 51 1 2023-12-16T05:56:40.270 INFO:tasks.workunit.client.1.smithi156.stdout:9/531: link d6/d19/d25/l2b d6/da3/db0/lb3 0 2023-12-16T05:56:40.272 INFO:tasks.workunit.client.1.smithi156.stdout:1/448: dwrite d3/d17/d19/f2e [0,4194304] 0 2023-12-16T05:56:40.272 INFO:tasks.workunit.client.1.smithi156.stdout:3/494: rename dc/d10/d1d/d4b/d52/f54 to dc/df/fb8 0 2023-12-16T05:56:40.273 INFO:tasks.workunit.client.1.smithi156.stdout:6/601: mknod d9/d13/d2f/d36/cb6 0 2023-12-16T05:56:40.274 INFO:tasks.workunit.client.0.smithi155.stdout:6/968: sync 2023-12-16T05:56:40.274 INFO:tasks.workunit.client.0.smithi155.stdout:0/873: sync 2023-12-16T05:56:40.274 INFO:tasks.workunit.client.0.smithi155.stdout:0/874: read - d7/df/d73/db3/f11a zero size 2023-12-16T05:56:40.274 INFO:tasks.workunit.client.0.smithi155.stdout:6/969: truncate d0/df/d5e/d7e/dd8/d12b/d103/f134 362775 0 2023-12-16T05:56:40.274 INFO:tasks.workunit.client.0.smithi155.stdout:6/970: fsync d0/df/d5e/d7e/f89 0 2023-12-16T05:56:40.275 INFO:tasks.workunit.client.0.smithi155.stdout:6/971: write d0/df/d5e/d7e/dd8/d12b/fc9 [428272,56327] 0 2023-12-16T05:56:40.275 INFO:tasks.workunit.client.0.smithi155.stdout:6/972: readlink d0/d3/d7a/db0/dc3/dce/ld3 0 2023-12-16T05:56:40.275 INFO:tasks.workunit.client.0.smithi155.stdout:6/973: write d0/df/d5e/d7e/dd8/d12b/d103/f134 [920827,67826] 0 2023-12-16T05:56:40.275 INFO:tasks.workunit.client.1.smithi156.stdout:2/581: dwrite d9/d12/f18 [0,4194304] 0 2023-12-16T05:56:40.276 INFO:tasks.workunit.client.0.smithi155.stdout:0/875: write d7/d13/d46/df3/ffa [812490,94863] 0 2023-12-16T05:56:40.276 INFO:tasks.workunit.client.0.smithi155.stdout:0/876: chown d7/df/d41/d23/d36/dad/d10a/c66 7954 1 2023-12-16T05:56:40.276 INFO:tasks.workunit.client.1.smithi156.stdout:3/495: mknod dc/df/d34/cb9 0 2023-12-16T05:56:40.276 INFO:tasks.workunit.client.1.smithi156.stdout:3/496: getdents dc/d10/d1d/db2 0 2023-12-16T05:56:40.278 INFO:tasks.workunit.client.1.smithi156.stdout:6/602: mknod d9/d13/d2f/d51/dad/cb7 0 2023-12-16T05:56:40.278 INFO:tasks.workunit.client.1.smithi156.stdout:6/603: read d9/d1c/f2c [520568,70011] 0 2023-12-16T05:56:40.278 INFO:tasks.workunit.client.1.smithi156.stdout:6/604: stat d9/d13/d2f/d51/d82/cb3 0 2023-12-16T05:56:40.278 INFO:tasks.workunit.client.1.smithi156.stdout:6/605: stat d9/f93 0 2023-12-16T05:56:40.279 INFO:tasks.workunit.client.0.smithi155.stdout:0/877: creat d7/df/d73/d8d/d4d/f120 x:0 0 0 2023-12-16T05:56:40.290 INFO:tasks.workunit.client.0.smithi155.stdout:0/878: dread d7/df/fd1 [0,4194304] 0 2023-12-16T05:56:40.299 INFO:tasks.workunit.client.0.smithi155.stdout:6/974: dwrite d0/d3/d2c/f4f [0,4194304] 0 2023-12-16T05:56:40.300 INFO:tasks.workunit.client.1.smithi156.stdout:4/548: rename d9/d2b/f40 to d9/d43/d58/fb6 0 2023-12-16T05:56:40.300 INFO:tasks.workunit.client.1.smithi156.stdout:4/549: chown d9/d2c/f2d 242140 1 2023-12-16T05:56:40.300 INFO:tasks.workunit.client.0.smithi155.stdout:6/975: symlink d0/d3/d2c/d8b/d85/l147 0 2023-12-16T05:56:40.301 INFO:tasks.workunit.client.1.smithi156.stdout:2/582: dwrite d9/dd/d17/f3a [0,4194304] 0 2023-12-16T05:56:40.301 INFO:tasks.workunit.client.0.smithi155.stdout:6/976: rmdir d0/d3/d7a/db0/dc3/d131 0 2023-12-16T05:56:40.302 INFO:tasks.workunit.client.1.smithi156.stdout:4/550: symlink d9/d43/d58/lb7 0 2023-12-16T05:56:40.303 INFO:tasks.workunit.client.1.smithi156.stdout:3/497: dread dc/d10/f18 [0,4194304] 0 2023-12-16T05:56:40.303 INFO:tasks.workunit.client.1.smithi156.stdout:3/498: chown dc/d10 370 1 2023-12-16T05:56:40.303 INFO:tasks.workunit.client.0.smithi155.stdout:1/920: dwrite d1/d7/d16/f21 [8388608,4194304] 0 2023-12-16T05:56:40.305 INFO:tasks.workunit.client.0.smithi155.stdout:6/977: rename d0/d3/d7a/db0/dc3/dce/ddd/ff0 to d0/d3/d2c/db8/f148 0 2023-12-16T05:56:40.305 INFO:tasks.workunit.client.1.smithi156.stdout:0/645: rename d2/d7/dd/d29/d38/d51/d65/f6f to d2/d7/dd/d29/d4b/fcb 0 2023-12-16T05:56:40.306 INFO:tasks.workunit.client.1.smithi156.stdout:4/551: read d9/f28 [217004,94576] 0 2023-12-16T05:56:40.306 INFO:tasks.workunit.client.0.smithi155.stdout:1/921: dread d1/d7/d4b/d8e/dc7/d28/d85/de0/d79/f9c [0,4194304] 0 2023-12-16T05:56:40.306 INFO:tasks.workunit.client.0.smithi155.stdout:1/922: fdatasync d1/d7/f75 0 2023-12-16T05:56:40.306 INFO:tasks.workunit.client.0.smithi155.stdout:1/923: fsync d1/d25/d43/d5d/d102/f111 0 2023-12-16T05:56:40.307 INFO:tasks.workunit.client.0.smithi155.stdout:1/924: write d1/d7/d16/de4/fef [832556,85827] 0 2023-12-16T05:56:40.307 INFO:tasks.workunit.client.0.smithi155.stdout:1/925: write d1/d7/d16/de4/fef [1241519,80544] 0 2023-12-16T05:56:40.307 INFO:tasks.workunit.client.0.smithi155.stdout:1/926: readlink d1/d92/l109 0 2023-12-16T05:56:40.307 INFO:tasks.workunit.client.1.smithi156.stdout:2/583: mknod d9/dd/d17/d33/cbb 0 2023-12-16T05:56:40.307 INFO:tasks.workunit.client.0.smithi155.stdout:1/927: dread d1/d7/d4b/d8e/fd3 [0,4194304] 0 2023-12-16T05:56:40.308 INFO:tasks.workunit.client.1.smithi156.stdout:3/499: unlink dc/df/f2f 0 2023-12-16T05:56:40.309 INFO:tasks.workunit.client.0.smithi155.stdout:6/978: dread d0/d3/d2c/d8b/f11d [0,4194304] 0 2023-12-16T05:56:40.310 INFO:tasks.workunit.client.1.smithi156.stdout:9/532: rename d6/d19/d25/f9e to d6/da3/fb4 0 2023-12-16T05:56:40.311 INFO:tasks.workunit.client.1.smithi156.stdout:0/646: mknod d2/d7/dd/d29/d38/d51/ccc 0 2023-12-16T05:56:40.311 INFO:tasks.workunit.client.1.smithi156.stdout:2/584: symlink d9/dd/d17/d33/db5/lbc 0 2023-12-16T05:56:40.312 INFO:tasks.workunit.client.1.smithi156.stdout:3/500: mknod dc/d10/d1d/db2/cba 0 2023-12-16T05:56:40.313 INFO:tasks.workunit.client.0.smithi155.stdout:6/979: dread d0/d3/d7a/d77/fa3 [0,4194304] 0 2023-12-16T05:56:40.313 INFO:tasks.workunit.client.0.smithi155.stdout:6/980: chown d0/df/d5e/d46/d6d/c143 191456 1 2023-12-16T05:56:40.314 INFO:tasks.workunit.client.1.smithi156.stdout:1/449: rename d3/d17/d1c/d22/d57/d61/l66 to d3/d17/d2d/l96 0 2023-12-16T05:56:40.314 INFO:tasks.workunit.client.1.smithi156.stdout:1/450: fdatasync d3/d17/f33 0 2023-12-16T05:56:40.314 INFO:tasks.workunit.client.1.smithi156.stdout:1/451: chown d3/d17/d2d/l88 90951106 1 2023-12-16T05:56:40.314 INFO:tasks.workunit.client.0.smithi155.stdout:0/879: dwrite d7/df/d73/fe2 [0,4194304] 0 2023-12-16T05:56:40.315 INFO:tasks.workunit.client.1.smithi156.stdout:9/533: unlink d6/d19/d25/d3a/l5d 0 2023-12-16T05:56:40.316 INFO:tasks.workunit.client.0.smithi155.stdout:6/981: creat d0/d3/d2c/d3e/f149 x:0 0 0 2023-12-16T05:56:40.317 INFO:tasks.workunit.client.1.smithi156.stdout:2/585: creat d9/dd/d17/d33/dae/fbd x:0 0 0 2023-12-16T05:56:40.317 INFO:tasks.workunit.client.1.smithi156.stdout:2/586: readlink d9/d68/daa/la8 0 2023-12-16T05:56:40.317 INFO:tasks.workunit.client.1.smithi156.stdout:8/411: sync 2023-12-16T05:56:40.317 INFO:tasks.workunit.client.1.smithi156.stdout:5/752: sync 2023-12-16T05:56:40.317 INFO:tasks.workunit.client.1.smithi156.stdout:8/412: stat d3/d12/d16/f2d 0 2023-12-16T05:56:40.318 INFO:tasks.workunit.client.0.smithi155.stdout:0/880: creat d7/df/d41/d23/d36/dad/f121 x:0 0 0 2023-12-16T05:56:40.318 INFO:tasks.workunit.client.1.smithi156.stdout:8/413: write d3/d7/d27/d46/d6e/d3c/f6a [13936296,31764] 0 2023-12-16T05:56:40.319 INFO:tasks.workunit.client.1.smithi156.stdout:3/501: creat dc/d10/d3d/db5/fbb x:0 0 0 2023-12-16T05:56:40.319 INFO:tasks.workunit.client.1.smithi156.stdout:0/647: dread d2/f3d [0,4194304] 0 2023-12-16T05:56:40.319 INFO:tasks.workunit.client.1.smithi156.stdout:0/648: fdatasync d2/d7/dd/d1c/fb1 0 2023-12-16T05:56:40.320 INFO:tasks.workunit.client.1.smithi156.stdout:1/452: truncate d3/f6 70804 0 2023-12-16T05:56:40.320 INFO:tasks.workunit.client.0.smithi155.stdout:6/982: rename d0/d3/d2c/d8b/c6f to d0/df/d5e/d7e/dd8/d12b/d103/d137/c14a 0 2023-12-16T05:56:40.320 INFO:tasks.workunit.client.0.smithi155.stdout:6/983: chown d0/d3/d7a/db0/dc3 1438333131 1 2023-12-16T05:56:40.320 INFO:tasks.workunit.client.0.smithi155.stdout:1/928: dread d1/d69/f8a [0,4194304] 0 2023-12-16T05:56:40.320 INFO:tasks.workunit.client.0.smithi155.stdout:6/984: dread d0/df/d5e/d7e/dd8/ff8 [0,4194304] 0 2023-12-16T05:56:40.321 INFO:tasks.workunit.client.0.smithi155.stdout:0/881: creat d7/db7/f122 x:0 0 0 2023-12-16T05:56:40.321 INFO:tasks.workunit.client.0.smithi155.stdout:0/882: write d7/d13/d45/f49 [8479090,95904] 0 2023-12-16T05:56:40.322 INFO:tasks.workunit.client.1.smithi156.stdout:5/753: rename da/dc/d4b/d6c/d81/cee to da/dc/d4b/d6c/d77/cf5 0 2023-12-16T05:56:40.322 INFO:tasks.workunit.client.0.smithi155.stdout:1/929: mknod d1/d7/c127 0 2023-12-16T05:56:40.323 INFO:tasks.workunit.client.1.smithi156.stdout:3/502: symlink dc/d10/d3d/db5/lbc 0 2023-12-16T05:56:40.323 INFO:tasks.workunit.client.1.smithi156.stdout:3/503: fdatasync dc/d56/d67/d6e/fb3 0 2023-12-16T05:56:40.323 INFO:tasks.workunit.client.1.smithi156.stdout:3/504: write dc/df/d34/d62/d75/fa9 [315959,54224] 0 2023-12-16T05:56:40.324 INFO:tasks.workunit.client.1.smithi156.stdout:3/505: truncate dc/d10/d1d/d4b/f9d 300629 0 2023-12-16T05:56:40.324 INFO:tasks.workunit.client.1.smithi156.stdout:3/506: dread - dc/d10/d1d/f8e zero size 2023-12-16T05:56:40.325 INFO:tasks.workunit.client.0.smithi155.stdout:0/883: truncate d7/f83 833422 0 2023-12-16T05:56:40.325 INFO:tasks.workunit.client.0.smithi155.stdout:0/884: truncate d7/df/d73/d8d/fc8 775296 0 2023-12-16T05:56:40.325 INFO:tasks.workunit.client.0.smithi155.stdout:0/885: dread - d7/d2d/ff1 zero size 2023-12-16T05:56:40.326 INFO:tasks.workunit.client.1.smithi156.stdout:0/649: rmdir d2/d7/dd/d29/d38/d51/d52/d88/dba 0 2023-12-16T05:56:40.326 INFO:tasks.workunit.client.0.smithi155.stdout:1/930: mkdir d1/d7/d4b/d5c/dec/d128 0 2023-12-16T05:56:40.327 INFO:tasks.workunit.client.0.smithi155.stdout:0/886: creat d7/df/d41/d23/d36/dad/f123 x:0 0 0 2023-12-16T05:56:40.328 INFO:tasks.workunit.client.1.smithi156.stdout:1/453: symlink d3/d17/d19/l97 0 2023-12-16T05:56:40.329 INFO:tasks.workunit.client.1.smithi156.stdout:9/534: dread d6/d2e/f52 [0,4194304] 0 2023-12-16T05:56:40.330 INFO:tasks.workunit.client.0.smithi155.stdout:0/887: truncate d7/df/d73/d8d/d4d/f10b 7219854 0 2023-12-16T05:56:40.330 INFO:tasks.workunit.client.0.smithi155.stdout:0/888: fsync d7/df/d73/db3/fc6 0 2023-12-16T05:56:40.330 INFO:tasks.workunit.client.0.smithi155.stdout:0/889: chown d7/db7/cfd 414574863 1 2023-12-16T05:56:40.330 INFO:tasks.workunit.client.1.smithi156.stdout:8/414: rename d3/d18/f22 to d3/d7a/f81 0 2023-12-16T05:56:40.331 INFO:tasks.workunit.client.1.smithi156.stdout:5/754: mkdir da/dc/d2d/d34/df6 0 2023-12-16T05:56:40.333 INFO:tasks.workunit.client.1.smithi156.stdout:3/507: link dc/d10/d1d/f32 dc/df/d70/fbd 0 2023-12-16T05:56:40.333 INFO:tasks.workunit.client.1.smithi156.stdout:3/508: readlink dc/le 0 2023-12-16T05:56:40.338 INFO:tasks.workunit.client.1.smithi156.stdout:5/755: creat da/dc/d4b/d6c/d77/d8f/ff7 x:0 0 0 2023-12-16T05:56:40.338 INFO:tasks.workunit.client.1.smithi156.stdout:7/783: sync 2023-12-16T05:56:40.339 INFO:tasks.workunit.client.1.smithi156.stdout:3/509: mkdir dc/d56/d67/dbe 0 2023-12-16T05:56:40.342 INFO:tasks.workunit.client.1.smithi156.stdout:5/756: mkdir da/dc/d4b/d6c/d81/dc5/df8 0 2023-12-16T05:56:40.348 INFO:tasks.workunit.client.1.smithi156.stdout:7/784: rename d1e/d55/d71/df5/lf0 to d1e/dbf/l114 0 2023-12-16T05:56:40.348 INFO:tasks.workunit.client.1.smithi156.stdout:7/785: write d1e/d55/fde [5001257,78065] 0 2023-12-16T05:56:40.352 INFO:tasks.workunit.client.0.smithi155.stdout:6/985: dwrite d0/df/d5e/d7e/dd8/d12b/fc9 [0,4194304] 0 2023-12-16T05:56:40.353 INFO:tasks.workunit.client.1.smithi156.stdout:3/510: creat dc/d10/d3d/db5/fbf x:0 0 0 2023-12-16T05:56:40.355 INFO:tasks.workunit.client.1.smithi156.stdout:5/757: rmdir da/dc/d4b/d6c/d7c 39 2023-12-16T05:56:40.355 INFO:tasks.workunit.client.1.smithi156.stdout:5/758: readlink da/dc/d2d/d4d/d54/d67/la7 0 2023-12-16T05:56:40.356 INFO:tasks.workunit.client.1.smithi156.stdout:1/454: dwrite d3/d3a/f5d [4194304,4194304] 0 2023-12-16T05:56:40.357 INFO:tasks.workunit.client.1.smithi156.stdout:1/455: read d3/d1b/f37 [775,69183] 0 2023-12-16T05:56:40.357 INFO:tasks.workunit.client.1.smithi156.stdout:1/456: truncate d3/f5 4426013 0 2023-12-16T05:56:40.357 INFO:tasks.workunit.client.1.smithi156.stdout:1/457: fdatasync d3/d3a/f7a 0 2023-12-16T05:56:40.360 INFO:tasks.workunit.client.1.smithi156.stdout:3/511: rename dc/d10/d3d/l48 to dc/df/d70/lc0 0 2023-12-16T05:56:40.362 INFO:tasks.workunit.client.1.smithi156.stdout:5/759: symlink da/dc/d2d/d4d/db9/lf9 0 2023-12-16T05:56:40.362 INFO:tasks.workunit.client.1.smithi156.stdout:5/760: write da/dc/d4b/d6c/f92 [413339,53296] 0 2023-12-16T05:56:40.363 INFO:tasks.workunit.client.1.smithi156.stdout:1/458: mknod d3/d1b/c98 0 2023-12-16T05:56:40.366 INFO:tasks.workunit.client.1.smithi156.stdout:3/512: mknod dc/d10/d1d/cc1 0 2023-12-16T05:56:40.366 INFO:tasks.workunit.client.1.smithi156.stdout:3/513: write dc/d56/f83 [996527,57110] 0 2023-12-16T05:56:40.369 INFO:tasks.workunit.client.0.smithi155.stdout:6/986: dread d0/df/d5e/d99/f9b [0,4194304] 0 2023-12-16T05:56:40.369 INFO:tasks.workunit.client.1.smithi156.stdout:2/587: dwrite d9/dd/d17/d33/dae/fbd [0,4194304] 0 2023-12-16T05:56:40.369 INFO:tasks.workunit.client.1.smithi156.stdout:2/588: fdatasync d9/dd/d17/d33/db5/f81 0 2023-12-16T05:56:40.371 INFO:tasks.workunit.client.0.smithi155.stdout:6/987: creat d0/d3/d7a/db0/dc3/dce/ddd/dd4/dfb/f14b x:0 0 0 2023-12-16T05:56:40.373 INFO:tasks.workunit.client.0.smithi155.stdout:6/988: creat d0/df/d5e/f14c x:0 0 0 2023-12-16T05:56:40.373 INFO:tasks.workunit.client.1.smithi156.stdout:3/514: dread dc/df/fb8 [0,4194304] 0 2023-12-16T05:56:40.373 INFO:tasks.workunit.client.1.smithi156.stdout:3/515: truncate dc/d10/f50 1011388 0 2023-12-16T05:56:40.374 INFO:tasks.workunit.client.0.smithi155.stdout:1/931: dwrite d1/d7/d4b/d8e/dc7/d28/d8f/ff2 [0,4194304] 0 2023-12-16T05:56:40.376 INFO:tasks.workunit.client.1.smithi156.stdout:2/589: read d9/dd/d17/d33/d78/f70 [1407931,110651] 0 2023-12-16T05:56:40.377 INFO:tasks.workunit.client.0.smithi155.stdout:0/890: dwrite d7/df/d73/db3/fc6 [0,4194304] 0 2023-12-16T05:56:40.377 INFO:tasks.workunit.client.0.smithi155.stdout:0/891: truncate d7/df/d73/dba/fca 1466614 0 2023-12-16T05:56:40.378 INFO:tasks.workunit.client.1.smithi156.stdout:2/590: getdents d9/dd 0 2023-12-16T05:56:40.379 INFO:tasks.workunit.client.0.smithi155.stdout:1/932: mknod d1/d25/dc8/c129 0 2023-12-16T05:56:40.380 INFO:tasks.workunit.client.0.smithi155.stdout:0/892: symlink d7/df/d73/db3/dce/l124 0 2023-12-16T05:56:40.381 INFO:tasks.workunit.client.0.smithi155.stdout:1/933: creat d1/d25/d43/d5d/d102/f12a x:0 0 0 2023-12-16T05:56:40.382 INFO:tasks.workunit.client.1.smithi156.stdout:9/535: dwrite d6/d2e/f6e [0,4194304] 0 2023-12-16T05:56:40.382 INFO:tasks.workunit.client.1.smithi156.stdout:5/761: dread da/dc/f21 [0,4194304] 0 2023-12-16T05:56:40.382 INFO:tasks.workunit.client.1.smithi156.stdout:8/415: dwrite d3/d7/d66/d76/f7e [0,4194304] 0 2023-12-16T05:56:40.382 INFO:tasks.workunit.client.1.smithi156.stdout:5/762: dread - da/dc/d2d/f3c zero size 2023-12-16T05:56:40.382 INFO:tasks.workunit.client.1.smithi156.stdout:8/416: dread - d3/d7/d27/d46/f79 zero size 2023-12-16T05:56:40.382 INFO:tasks.workunit.client.1.smithi156.stdout:8/417: chown d3/d7 3858640 1 2023-12-16T05:56:40.382 INFO:tasks.workunit.client.1.smithi156.stdout:9/536: write d6/d19/f1f [1871376,64445] 0 2023-12-16T05:56:40.382 INFO:tasks.workunit.client.1.smithi156.stdout:0/650: dwrite d2/d7/dd/d29/f6b [0,4194304] 0 2023-12-16T05:56:40.382 INFO:tasks.workunit.client.1.smithi156.stdout:0/651: chown d2/l1d 47 1 2023-12-16T05:56:40.382 INFO:tasks.workunit.client.1.smithi156.stdout:2/591: mkdir d9/dd/d17/d33/d78/d39/d8c/dbe 0 2023-12-16T05:56:40.383 INFO:tasks.workunit.client.0.smithi155.stdout:0/893: mkdir d7/d13/d46/d125 0 2023-12-16T05:56:40.383 INFO:tasks.workunit.client.0.smithi155.stdout:1/934: mkdir d1/d7/d4b/d12b 0 2023-12-16T05:56:40.383 INFO:tasks.workunit.client.0.smithi155.stdout:0/894: creat d7/d13/d45/f126 x:0 0 0 2023-12-16T05:56:40.388 INFO:tasks.workunit.client.1.smithi156.stdout:1/459: dwrite d3/d1b/f46 [0,4194304] 0 2023-12-16T05:56:40.393 INFO:tasks.workunit.client.1.smithi156.stdout:3/516: rmdir dc/d56/d67 39 2023-12-16T05:56:40.395 INFO:tasks.workunit.client.1.smithi156.stdout:8/418: link d3/d12/d74/f7b d3/d7/d66/f82 0 2023-12-16T05:56:40.401 INFO:tasks.workunit.client.1.smithi156.stdout:9/537: creat d6/d19/d25/d3a/fb5 x:0 0 0 2023-12-16T05:56:40.401 INFO:tasks.workunit.client.1.smithi156.stdout:7/786: link d1e/dbf/l114 d1e/d55/d71/d94/d108/l115 0 2023-12-16T05:56:40.401 INFO:tasks.workunit.client.1.smithi156.stdout:0/652: symlink d2/d7/dd/d2d/d5e/d8f/dc9/lcd 0 2023-12-16T05:56:40.403 INFO:tasks.workunit.client.1.smithi156.stdout:2/592: dwrite d9/dd/d17/d33/d78/d39/d8c/da2/da6/f64 [0,4194304] 0 2023-12-16T05:56:40.403 INFO:tasks.workunit.client.1.smithi156.stdout:2/593: chown d9/d68/daa/d83/da1/d96/c98 2869838 1 2023-12-16T05:56:40.407 INFO:tasks.workunit.client.1.smithi156.stdout:1/460: getdents d3/d17/d4d 0 2023-12-16T05:56:40.407 INFO:tasks.workunit.client.0.smithi155.stdout:6/989: dwrite d0/df/d5e/d46/f47 [0,4194304] 0 2023-12-16T05:56:40.408 INFO:tasks.workunit.client.0.smithi155.stdout:6/990: mknod d0/d3/d2c/c14d 0 2023-12-16T05:56:40.408 INFO:tasks.workunit.client.0.smithi155.stdout:6/991: chown d0/d3/d7a/db0/dc3/dce/ddd/d1b/dea/def/ff4 4982 1 2023-12-16T05:56:40.408 INFO:tasks.workunit.client.0.smithi155.stdout:6/992: readlink d0/d3/d7a/db0/dc3/dce/ld3 0 2023-12-16T05:56:40.409 INFO:tasks.workunit.client.0.smithi155.stdout:6/993: symlink d0/dbd/l14e 0 2023-12-16T05:56:40.409 INFO:tasks.workunit.client.0.smithi155.stdout:6/994: creat d0/df/d5e/d7e/dd8/d12b/d103/f14f x:0 0 0 2023-12-16T05:56:40.410 INFO:tasks.workunit.client.0.smithi155.stdout:6/995: mkdir d0/d3/d2c/db8/d150 0 2023-12-16T05:56:40.410 INFO:tasks.workunit.client.0.smithi155.stdout:6/996: chown d0/d3/d7a/db0/dc3/dce/l10c 1764 1 2023-12-16T05:56:40.410 INFO:tasks.workunit.client.0.smithi155.stdout:6/997: readlink d0/d3/l52 0 2023-12-16T05:56:40.411 INFO:tasks.workunit.client.0.smithi155.stdout:1/935: dwrite d1/d7/f11d [0,4194304] 0 2023-12-16T05:56:40.411 INFO:tasks.workunit.client.0.smithi155.stdout:3/561: sync 2023-12-16T05:56:40.411 INFO:tasks.workunit.client.0.smithi155.stdout:7/714: sync 2023-12-16T05:56:40.411 INFO:tasks.workunit.client.0.smithi155.stdout:7/715: write d0/fce [925260,66154] 0 2023-12-16T05:56:40.412 INFO:tasks.workunit.client.0.smithi155.stdout:0/895: dwrite d7/d13/d46/f11f [0,4194304] 0 2023-12-16T05:56:40.412 INFO:tasks.workunit.client.1.smithi156.stdout:8/419: dwrite d3/d7a/f81 [4194304,4194304] 0 2023-12-16T05:56:40.412 INFO:tasks.workunit.client.1.smithi156.stdout:2/594: dread d9/d12/d3d/f48 [0,4194304] 0 2023-12-16T05:56:40.414 INFO:tasks.workunit.client.1.smithi156.stdout:2/595: write f5 [1614778,61547] 0 2023-12-16T05:56:40.414 INFO:tasks.workunit.client.0.smithi155.stdout:0/896: write d7/df/f58 [902623,93188] 0 2023-12-16T05:56:40.414 INFO:tasks.workunit.client.0.smithi155.stdout:0/897: truncate d7/df/d73/fbf 341980 0 2023-12-16T05:56:40.414 INFO:tasks.workunit.client.0.smithi155.stdout:0/898: chown d7/d2d/f9e 8718611 1 2023-12-16T05:56:40.415 INFO:tasks.workunit.client.0.smithi155.stdout:3/562: rename d0/d14/d36/d83/la4 to d0/d14/d36/d47/lab 0 2023-12-16T05:56:40.416 INFO:tasks.workunit.client.0.smithi155.stdout:7/716: truncate d0/d1/d5/f9 948814 0 2023-12-16T05:56:40.416 INFO:tasks.workunit.client.0.smithi155.stdout:7/717: write d0/d6a/d31/f32 [1912258,16681] 0 2023-12-16T05:56:40.419 INFO:tasks.workunit.client.1.smithi156.stdout:5/763: truncate da/dc/d4b/f93 3469440 0 2023-12-16T05:56:40.420 INFO:tasks.workunit.client.1.smithi156.stdout:3/517: symlink dc/d56/d67/dbe/lc2 0 2023-12-16T05:56:40.420 INFO:tasks.workunit.client.0.smithi155.stdout:6/998: dread d0/d3/f12 [0,4194304] 0 2023-12-16T05:56:40.420 INFO:tasks.workunit.client.0.smithi155.stdout:6/999: chown d0/cc0 0 1 2023-12-16T05:56:40.421 INFO:tasks.workunit.client.1.smithi156.stdout:9/538: mknod d6/d19/d30/d95/cb6 0 2023-12-16T05:56:40.422 INFO:tasks.workunit.client.0.smithi155.stdout:0/899: rename d7/df/d73/d8d/c8b to d7/d2d/c127 0 2023-12-16T05:56:40.424 INFO:tasks.workunit.client.1.smithi156.stdout:7/787: creat d1e/d55/d71/d61/daa/db4/f116 x:0 0 0 2023-12-16T05:56:40.424 INFO:tasks.workunit.client.1.smithi156.stdout:7/788: chown d1e/d1f/d22/d75/d77/c7a 54 1 2023-12-16T05:56:40.424 INFO:tasks.workunit.client.1.smithi156.stdout:7/789: fdatasync d1e/d55/dba/fec 0 2023-12-16T05:56:40.425 INFO:tasks.workunit.client.1.smithi156.stdout:0/653: unlink d2/d7/dd/d29/fa4 0 2023-12-16T05:56:40.425 INFO:tasks.workunit.client.1.smithi156.stdout:0/654: dread - d2/d7/dd/d29/d38/d51/d52/fbf zero size 2023-12-16T05:56:40.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:40 smithi156 ceph-mon[121001]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:56:40.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:40 smithi156 ceph-mon[121001]: pgmap v16: 65 pgs: 65 active+clean; 1.9 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 124 MiB/s rd, 243 MiB/s wr, 384 op/s 2023-12-16T05:56:40.430 INFO:tasks.workunit.client.1.smithi156.stdout:1/461: symlink d3/d1b/d8b/l99 0 2023-12-16T05:56:40.430 INFO:tasks.workunit.client.0.smithi155.stdout:1/936: dwrite d1/d25/d43/f77 [0,4194304] 0 2023-12-16T05:56:40.431 INFO:tasks.workunit.client.1.smithi156.stdout:3/518: dread dc/d10/f7e [0,4194304] 0 2023-12-16T05:56:40.432 INFO:tasks.workunit.client.1.smithi156.stdout:3/519: write dc/d56/f92 [283973,101186] 0 2023-12-16T05:56:40.432 INFO:tasks.workunit.client.0.smithi155.stdout:1/937: mkdir d1/d7/d4b/d8e/dc7/d28/d85/de0/d79/daa/d12c 0 2023-12-16T05:56:40.433 INFO:tasks.workunit.client.0.smithi155.stdout:1/938: stat d1/d7/c53 0 2023-12-16T05:56:40.433 INFO:tasks.workunit.client.1.smithi156.stdout:2/596: stat d9/dd/d17/d33/d78/d39/c46 0 2023-12-16T05:56:40.437 INFO:tasks.workunit.client.1.smithi156.stdout:5/764: mkdir da/dc/d2d/d4d/db9/dc9/dfa 0 2023-12-16T05:56:40.439 INFO:tasks.workunit.client.1.smithi156.stdout:2/597: dread d9/f20 [0,4194304] 0 2023-12-16T05:56:40.439 INFO:tasks.workunit.client.1.smithi156.stdout:2/598: truncate d9/dd/d17/d33/d78/fa4 5357711 0 2023-12-16T05:56:40.439 INFO:tasks.workunit.client.1.smithi156.stdout:9/539: getdents d6/d19/d25/d3a/d5e 0 2023-12-16T05:56:40.439 INFO:tasks.workunit.client.1.smithi156.stdout:9/540: chown d6/d19/fa2 168198554 1 2023-12-16T05:56:40.439 INFO:tasks.workunit.client.1.smithi156.stdout:9/541: stat d6/f1e 0 2023-12-16T05:56:40.441 INFO:tasks.workunit.client.1.smithi156.stdout:3/520: dread dc/d10/d1d/f49 [0,4194304] 0 2023-12-16T05:56:40.442 INFO:tasks.workunit.client.1.smithi156.stdout:7/790: unlink d1e/d1f/l30 0 2023-12-16T05:56:40.443 INFO:tasks.workunit.client.1.smithi156.stdout:1/462: mknod d3/d17/c9a 0 2023-12-16T05:56:40.443 INFO:tasks.workunit.client.1.smithi156.stdout:1/463: chown d3/d17/d1c/l47 142607 1 2023-12-16T05:56:40.444 INFO:tasks.workunit.client.0.smithi155.stdout:1/939: write d1/d7/d4b/d8e/dc7/fd5 [314709,77857] 0 2023-12-16T05:56:40.444 INFO:tasks.workunit.client.0.smithi155.stdout:0/900: dwrite d7/d13/d46/f11f [4194304,4194304] 0 2023-12-16T05:56:40.444 INFO:tasks.workunit.client.1.smithi156.stdout:8/420: mkdir d3/d6/d83 0 2023-12-16T05:56:40.445 INFO:tasks.workunit.client.0.smithi155.stdout:0/901: creat d7/d112/f128 x:0 0 0 2023-12-16T05:56:40.446 INFO:tasks.workunit.client.0.smithi155.stdout:0/902: fsync d7/df/d41/d23/f68 0 2023-12-16T05:56:40.446 INFO:tasks.workunit.client.1.smithi156.stdout:6/606: sync 2023-12-16T05:56:40.451 INFO:tasks.workunit.client.1.smithi156.stdout:5/765: rmdir da/dc/d4b/d6c/d81/dc5 39 2023-12-16T05:56:40.451 INFO:tasks.workunit.client.1.smithi156.stdout:5/766: write da/f98 [791791,129323] 0 2023-12-16T05:56:40.453 INFO:tasks.workunit.client.1.smithi156.stdout:2/599: mkdir d9/dd/d17/d33/d78/d39/d8c/da2/da6/d80/dbf 0 2023-12-16T05:56:40.454 INFO:tasks.workunit.client.1.smithi156.stdout:4/552: sync 2023-12-16T05:56:40.454 INFO:tasks.workunit.client.1.smithi156.stdout:9/542: mkdir d6/d19/d30/dae/db7 0 2023-12-16T05:56:40.454 INFO:tasks.workunit.client.1.smithi156.stdout:9/543: truncate d6/d19/d30/d95/fa7 149023 0 2023-12-16T05:56:40.454 INFO:tasks.workunit.client.1.smithi156.stdout:9/544: fsync d6/d19/d25/d3a/d5e/f7b 0 2023-12-16T05:56:40.456 INFO:tasks.workunit.client.0.smithi155.stdout:1/940: dread d1/d7/d4b/d8e/dc7/d28/d85/fe1 [0,4194304] 0 2023-12-16T05:56:40.456 INFO:tasks.workunit.client.1.smithi156.stdout:3/521: mkdir dc/d56/d67/dbe/dc3 0 2023-12-16T05:56:40.456 INFO:tasks.workunit.client.1.smithi156.stdout:7/791: dwrite f7 [0,4194304] 0 2023-12-16T05:56:40.457 INFO:tasks.workunit.client.0.smithi155.stdout:1/941: truncate d1/d7/d4b/d8e/dc7/d28/d85/fe1 1450859 0 2023-12-16T05:56:40.457 INFO:tasks.workunit.client.1.smithi156.stdout:3/522: write dc/d10/f18 [3465857,111783] 0 2023-12-16T05:56:40.457 INFO:tasks.workunit.client.1.smithi156.stdout:3/523: stat dc/d10/d3d/db5/fbb 0 2023-12-16T05:56:40.457 INFO:tasks.workunit.client.1.smithi156.stdout:3/524: chown dc/d56/c84 133957009 1 2023-12-16T05:56:40.457 INFO:tasks.workunit.client.1.smithi156.stdout:1/464: getdents d3/d17/d1c/d22/d57/d61 0 2023-12-16T05:56:40.457 INFO:tasks.workunit.client.1.smithi156.stdout:1/465: write d3/d17/d19/f2a [1117505,30563] 0 2023-12-16T05:56:40.457 INFO:tasks.workunit.client.1.smithi156.stdout:1/466: chown d3/d17/c69 6156 1 2023-12-16T05:56:40.458 INFO:tasks.workunit.client.1.smithi156.stdout:1/467: fsync d3/d17/d2d/f74 0 2023-12-16T05:56:40.458 INFO:tasks.workunit.client.0.smithi155.stdout:1/942: unlink d1/d25/d43/f10c 0 2023-12-16T05:56:40.458 INFO:tasks.workunit.client.0.smithi155.stdout:1/943: getdents d1/d7/d4b/d5c/dec 0 2023-12-16T05:56:40.459 INFO:tasks.workunit.client.1.smithi156.stdout:8/421: unlink d3/d6/f5 0 2023-12-16T05:56:40.460 INFO:tasks.workunit.client.0.smithi155.stdout:1/944: rmdir d1/d7/d16/d30 39 2023-12-16T05:56:40.460 INFO:tasks.workunit.client.0.smithi155.stdout:1/945: dread - d1/d7/d4b/d8e/dc7/d28/d85/ffd zero size 2023-12-16T05:56:40.460 INFO:tasks.workunit.client.0.smithi155.stdout:1/946: dread - d1/d7/d4b/d8e/dc7/d28/d85/de0/d7e/ffc zero size 2023-12-16T05:56:40.460 INFO:tasks.workunit.client.0.smithi155.stdout:1/947: chown d1/d7/d4b/d8e/dc7/d28/d85/de0/d7e/cb4 39 1 2023-12-16T05:56:40.460 INFO:tasks.workunit.client.1.smithi156.stdout:6/607: mknod d9/d13/d3e/d5f/cb8 0 2023-12-16T05:56:40.462 INFO:tasks.workunit.client.0.smithi155.stdout:1/948: creat d1/d7/d4b/d8e/dc7/d28/d8f/db2/d103/d11a/f12d x:0 0 0 2023-12-16T05:56:40.462 INFO:tasks.workunit.client.0.smithi155.stdout:1/949: truncate d1/d7/d4b/d5c/f108 896788 0 2023-12-16T05:56:40.463 INFO:tasks.workunit.client.1.smithi156.stdout:2/600: mknod d9/d56/d5f/cc0 0 2023-12-16T05:56:40.463 INFO:tasks.workunit.client.1.smithi156.stdout:2/601: write d9/f2d [340396,12458] 0 2023-12-16T05:56:40.464 INFO:tasks.workunit.client.1.smithi156.stdout:2/602: write d9/d12/f18 [186051,5652] 0 2023-12-16T05:56:40.464 INFO:tasks.workunit.client.1.smithi156.stdout:2/603: getdents d9/dd/d17/d33/d78/d39/d8c/da2/da6/d80/dbf 0 2023-12-16T05:56:40.465 INFO:tasks.workunit.client.1.smithi156.stdout:4/553: mknod d9/d43/d58/d7d/d82/cb8 0 2023-12-16T05:56:40.465 INFO:tasks.workunit.client.1.smithi156.stdout:4/554: fsync d9/f21 0 2023-12-16T05:56:40.467 INFO:tasks.workunit.client.0.smithi155.stdout:0/903: dwrite d7/df/d41/d23/de1/ff6 [0,4194304] 0 2023-12-16T05:56:40.468 INFO:tasks.workunit.client.0.smithi155.stdout:0/904: chown d7/df/d65 26256 1 2023-12-16T05:56:40.468 INFO:tasks.workunit.client.0.smithi155.stdout:0/905: stat d7/df/d73/d8d/d4d/faf 0 2023-12-16T05:56:40.468 INFO:tasks.workunit.client.0.smithi155.stdout:0/906: chown d7/df/d73/d8d/lb4 14743562 1 2023-12-16T05:56:40.469 INFO:tasks.workunit.client.1.smithi156.stdout:9/545: mkdir d6/d19/d25/d3a/d88/d8b/dac/db8 0 2023-12-16T05:56:40.473 INFO:tasks.workunit.client.1.smithi156.stdout:7/792: mkdir d1e/d1f/da6/d10d/d117 0 2023-12-16T05:56:40.475 INFO:tasks.workunit.client.1.smithi156.stdout:3/525: truncate dc/d10/d3d/f37 2925345 0 2023-12-16T05:56:40.475 INFO:tasks.workunit.client.1.smithi156.stdout:3/526: truncate dc/d56/d67/f79 4940879 0 2023-12-16T05:56:40.475 INFO:tasks.workunit.client.1.smithi156.stdout:1/468: creat d3/d17/d1c/d22/f9b x:0 0 0 2023-12-16T05:56:40.478 INFO:tasks.workunit.client.1.smithi156.stdout:6/608: dread d9/d13/d2f/f68 [0,4194304] 0 2023-12-16T05:56:40.478 INFO:tasks.workunit.client.1.smithi156.stdout:6/609: write d9/d13/d2f/d51/d6b/d77/d7e/fa6 [368040,101961] 0 2023-12-16T05:56:40.481 INFO:tasks.workunit.client.1.smithi156.stdout:2/604: creat d9/dd/d17/d33/d47/fc1 x:0 0 0 2023-12-16T05:56:40.481 INFO:tasks.workunit.client.1.smithi156.stdout:4/555: creat d9/d2c/d7a/fb9 x:0 0 0 2023-12-16T05:56:40.482 INFO:tasks.workunit.client.1.smithi156.stdout:9/546: symlink d6/d19/d30/d95/lb9 0 2023-12-16T05:56:40.483 INFO:tasks.workunit.client.1.smithi156.stdout:7/793: mknod d1e/c118 0 2023-12-16T05:56:40.483 INFO:tasks.workunit.client.1.smithi156.stdout:7/794: write d1e/d1f/da6/d57/f86 [5385258,6705] 0 2023-12-16T05:56:40.483 INFO:tasks.workunit.client.1.smithi156.stdout:7/795: chown d1e/d1f/d72 27226 1 2023-12-16T05:56:40.484 INFO:tasks.workunit.client.1.smithi156.stdout:1/469: mknod d3/d1b/d8b/c9c 0 2023-12-16T05:56:40.486 INFO:tasks.workunit.client.0.smithi155.stdout:0/907: dwrite d7/d13/d45/fec [0,4194304] 0 2023-12-16T05:56:40.486 INFO:tasks.workunit.client.0.smithi155.stdout:1/950: dwrite d1/d7/d4b/d8e/dc7/d28/d85/fc9 [0,4194304] 0 2023-12-16T05:56:40.487 INFO:tasks.workunit.client.0.smithi155.stdout:1/951: write d1/d7/d4b/d8e/dc7/d28/d85/de0/d7e/ffc [355861,14757] 0 2023-12-16T05:56:40.487 INFO:tasks.workunit.client.1.smithi156.stdout:3/527: dread dc/d10/f7e [0,4194304] 0 2023-12-16T05:56:40.489 INFO:tasks.workunit.client.0.smithi155.stdout:1/952: write d1/d7/d4b/d8e/dc7/d28/d74/faf [1590645,54432] 0 2023-12-16T05:56:40.492 INFO:tasks.workunit.client.0.smithi155.stdout:1/953: symlink d1/d25/l12e 0 2023-12-16T05:56:40.492 INFO:tasks.workunit.client.1.smithi156.stdout:9/547: mknod d6/d19/d30/d48/cba 0 2023-12-16T05:56:40.493 INFO:tasks.workunit.client.1.smithi156.stdout:7/796: mknod d1e/d1f/d22/d75/c119 0 2023-12-16T05:56:40.493 INFO:tasks.workunit.client.1.smithi156.stdout:6/610: mkdir d9/d13/d2f/d51/d69/d99/db9 0 2023-12-16T05:56:40.493 INFO:tasks.workunit.client.1.smithi156.stdout:4/556: rename d9 to d9/d2b/dba 22 2023-12-16T05:56:40.493 INFO:tasks.workunit.client.0.smithi155.stdout:1/954: rmdir d1/d7/d4b/d8e/dc7/d28/d85 39 2023-12-16T05:56:40.494 INFO:tasks.workunit.client.1.smithi156.stdout:8/422: mkdir d3/d7/d27/d46/d84 0 2023-12-16T05:56:40.496 INFO:tasks.workunit.client.1.smithi156.stdout:3/528: getdents dc/df/d70 0 2023-12-16T05:56:40.506 INFO:tasks.workunit.client.1.smithi156.stdout:8/423: mkdir d3/d7/d27/d46/d84/d85 0 2023-12-16T05:56:40.506 INFO:tasks.workunit.client.1.smithi156.stdout:3/529: rename dc/d10/d1d/db2/cba to dc/d56/d69/cc4 0 2023-12-16T05:56:40.508 INFO:tasks.workunit.client.1.smithi156.stdout:8/424: mknod d3/d7/d27/d46/d6e/d3b/c86 0 2023-12-16T05:56:40.508 INFO:tasks.workunit.client.1.smithi156.stdout:8/425: dread - d3/d7/d62/d6b/f7c zero size 2023-12-16T05:56:40.509 INFO:tasks.workunit.client.1.smithi156.stdout:3/530: creat dc/df/d34/d62/d75/fc5 x:0 0 0 2023-12-16T05:56:40.509 INFO:tasks.workunit.client.1.smithi156.stdout:3/531: stat dc/df/d34/l97 0 2023-12-16T05:56:40.509 INFO:tasks.workunit.client.1.smithi156.stdout:2/605: dwrite f8 [4194304,4194304] 0 2023-12-16T05:56:40.511 INFO:tasks.workunit.client.1.smithi156.stdout:6/611: write d9/d1c/d50/f74 [5951280,28945] 0 2023-12-16T05:56:40.511 INFO:tasks.workunit.client.1.smithi156.stdout:6/612: chown d9/d13/d2f/d51/d82/d89/d8e/cb0 126 1 2023-12-16T05:56:40.511 INFO:tasks.workunit.client.1.smithi156.stdout:6/613: write d9/d13/d2f/f34 [4959616,37821] 0 2023-12-16T05:56:40.511 INFO:tasks.workunit.client.1.smithi156.stdout:6/614: write d9/d13/d2f/d51/d6b/fae [524109,67366] 0 2023-12-16T05:56:40.511 INFO:tasks.workunit.client.1.smithi156.stdout:6/615: write f6 [8488330,27941] 0 2023-12-16T05:56:40.511 INFO:tasks.workunit.client.1.smithi156.stdout:6/616: readlink d9/d13/d2f/d51/d82/la9 0 2023-12-16T05:56:40.513 INFO:tasks.workunit.client.1.smithi156.stdout:3/532: mkdir dc/d10/dc6 0 2023-12-16T05:56:40.513 INFO:tasks.workunit.client.1.smithi156.stdout:3/533: fdatasync dc/d10/f50 0 2023-12-16T05:56:40.515 INFO:tasks.workunit.client.1.smithi156.stdout:2/606: mkdir d9/d12/dc2 0 2023-12-16T05:56:40.515 INFO:tasks.workunit.client.1.smithi156.stdout:6/617: dread d9/d13/d2f/d51/f56 [0,4194304] 0 2023-12-16T05:56:40.516 INFO:tasks.workunit.client.1.smithi156.stdout:8/426: link d3/d6/c1e d3/d7/c87 0 2023-12-16T05:56:40.516 INFO:tasks.workunit.client.1.smithi156.stdout:4/557: getdents d9/d2c/d7a 0 2023-12-16T05:56:40.518 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:40 smithi155 ceph-mon[112451]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:56:40.518 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:40 smithi155 ceph-mon[112451]: pgmap v16: 65 pgs: 65 active+clean; 1.9 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 124 MiB/s rd, 243 MiB/s wr, 384 op/s 2023-12-16T05:56:40.518 INFO:tasks.workunit.client.1.smithi156.stdout:2/607: link d9/f34 d9/dd/d17/d33/d78/d39/d8c/da2/dad/fc3 0 2023-12-16T05:56:40.519 INFO:tasks.workunit.client.1.smithi156.stdout:6/618: mkdir d9/d1c/dba 0 2023-12-16T05:56:40.524 INFO:tasks.workunit.client.1.smithi156.stdout:2/608: mknod d9/d68/daa/db4/cc4 0 2023-12-16T05:56:40.525 INFO:tasks.workunit.client.1.smithi156.stdout:2/609: write f2 [2528600,86682] 0 2023-12-16T05:56:40.526 INFO:tasks.workunit.client.1.smithi156.stdout:8/427: symlink d3/d7/d27/d46/l88 0 2023-12-16T05:56:40.527 INFO:tasks.workunit.client.1.smithi156.stdout:2/610: rename d9/dd/d17/fa0 to d9/dd/d17/d33/fc5 0 2023-12-16T05:56:40.528 INFO:tasks.workunit.client.1.smithi156.stdout:8/428: symlink d3/d7/d66/l89 0 2023-12-16T05:56:40.530 INFO:tasks.workunit.client.1.smithi156.stdout:2/611: rename d9/dd/d17/d33/l41 to d9/dd/d17/d33/d78/d39/d60/lc6 0 2023-12-16T05:56:40.531 INFO:tasks.workunit.client.1.smithi156.stdout:2/612: write d9/d12/f5e [118882,9033] 0 2023-12-16T05:56:40.532 INFO:tasks.workunit.client.1.smithi156.stdout:8/429: getdents d3/d7/d62 0 2023-12-16T05:56:40.532 INFO:tasks.workunit.client.1.smithi156.stdout:8/430: dread - d3/d7/d27/d46/d6e/f40 zero size 2023-12-16T05:56:40.532 INFO:tasks.workunit.client.1.smithi156.stdout:8/431: stat d3/d12/f3d 0 2023-12-16T05:56:40.532 INFO:tasks.workunit.client.1.smithi156.stdout:8/432: chown d3/d12/d16/f73 0 1 2023-12-16T05:56:40.534 INFO:tasks.workunit.client.1.smithi156.stdout:2/613: creat d9/d12/dc2/fc7 x:0 0 0 2023-12-16T05:56:40.535 INFO:tasks.workunit.client.0.smithi155.stdout:1/955: dwrite d1/d25/f33 [0,4194304] 0 2023-12-16T05:56:40.535 INFO:tasks.workunit.client.0.smithi155.stdout:1/956: chown d1/d7/f68 468 1 2023-12-16T05:56:40.536 INFO:tasks.workunit.client.1.smithi156.stdout:1/470: dwrite d3/d3a/f6c [0,4194304] 0 2023-12-16T05:56:40.536 INFO:tasks.workunit.client.1.smithi156.stdout:1/471: write d3/d17/d4d/f7c [428681,113755] 0 2023-12-16T05:56:40.537 INFO:tasks.workunit.client.1.smithi156.stdout:8/433: creat d3/d6/f8a x:0 0 0 2023-12-16T05:56:40.537 INFO:tasks.workunit.client.0.smithi155.stdout:0/908: dwrite d7/d112/f128 [0,4194304] 0 2023-12-16T05:56:40.538 INFO:tasks.workunit.client.0.smithi155.stdout:1/957: rename d1/d7/d4b/d8e/dc7/d28/d8f/dad to d1/d7/d4b/d12f 0 2023-12-16T05:56:40.540 INFO:tasks.workunit.client.1.smithi156.stdout:1/472: link d3/d17/f1f d3/d17/d4d/f9d 0 2023-12-16T05:56:40.540 INFO:tasks.workunit.client.1.smithi156.stdout:1/473: truncate d3/d17/d1c/d22/f51 1536987 0 2023-12-16T05:56:40.540 INFO:tasks.workunit.client.1.smithi156.stdout:1/474: stat d3/d1b/d8b/c9c 0 2023-12-16T05:56:40.540 INFO:tasks.workunit.client.1.smithi156.stdout:1/475: fdatasync d3/d1b/f79 0 2023-12-16T05:56:40.540 INFO:tasks.workunit.client.1.smithi156.stdout:1/476: chown d3/d17/l38 220510 1 2023-12-16T05:56:40.540 INFO:tasks.workunit.client.1.smithi156.stdout:1/477: truncate d3/f6 461897 0 2023-12-16T05:56:40.541 INFO:tasks.workunit.client.1.smithi156.stdout:1/478: creat d3/d1b/d8b/f9e x:0 0 0 2023-12-16T05:56:40.542 INFO:tasks.workunit.client.1.smithi156.stdout:8/434: symlink d3/d12/d74/l8b 0 2023-12-16T05:56:40.542 INFO:tasks.workunit.client.0.smithi155.stdout:0/909: creat d7/d2d/f129 x:0 0 0 2023-12-16T05:56:40.542 INFO:tasks.workunit.client.0.smithi155.stdout:0/910: fdatasync d7/df/d73/d8d/d4d/d115/d53/f7d 0 2023-12-16T05:56:40.543 INFO:tasks.workunit.client.1.smithi156.stdout:1/479: rmdir d3/d17/d1c/d22/d57/d61 39 2023-12-16T05:56:40.543 INFO:tasks.workunit.client.1.smithi156.stdout:1/480: dread - d3/d17/d1c/d22/d57/f85 zero size 2023-12-16T05:56:40.543 INFO:tasks.workunit.client.1.smithi156.stdout:1/481: dread - d3/d1b/d8b/f9e zero size 2023-12-16T05:56:40.543 INFO:tasks.workunit.client.1.smithi156.stdout:8/435: creat d3/d6/f8c x:0 0 0 2023-12-16T05:56:40.543 INFO:tasks.workunit.client.1.smithi156.stdout:8/436: write d3/d6/f8a [241382,80507] 0 2023-12-16T05:56:40.543 INFO:tasks.workunit.client.1.smithi156.stdout:1/482: creat d3/d3a/f9f x:0 0 0 2023-12-16T05:56:40.544 INFO:tasks.workunit.client.0.smithi155.stdout:1/958: unlink d1/c3e 0 2023-12-16T05:56:40.545 INFO:tasks.workunit.client.0.smithi155.stdout:0/911: mkdir d7/df/d12a 0 2023-12-16T05:56:40.545 INFO:tasks.workunit.client.0.smithi155.stdout:0/912: fsync d7/df/d41/d23/de1/f110 0 2023-12-16T05:56:40.546 INFO:tasks.workunit.client.1.smithi156.stdout:7/797: dwrite d1e/d1f/f3a [0,4194304] 0 2023-12-16T05:56:40.546 INFO:tasks.workunit.client.1.smithi156.stdout:7/798: write d1e/d1f/da6/d57/dbb/fcc [1026619,90016] 0 2023-12-16T05:56:40.546 INFO:tasks.workunit.client.1.smithi156.stdout:9/548: dwrite f3 [0,4194304] 0 2023-12-16T05:56:40.547 INFO:tasks.workunit.client.0.smithi155.stdout:1/959: link d1/d69/lb9 d1/d7/d4b/d8e/dc7/d28/d85/de0/d79/daa/d12c/l130 0 2023-12-16T05:56:40.547 INFO:tasks.workunit.client.0.smithi155.stdout:1/960: write d1/d7/f5a [4676371,20688] 0 2023-12-16T05:56:40.548 INFO:tasks.workunit.client.0.smithi155.stdout:0/913: symlink d7/db7/l12b 0 2023-12-16T05:56:40.548 INFO:tasks.workunit.client.1.smithi156.stdout:4/558: dwrite d9/d2b/f75 [0,4194304] 0 2023-12-16T05:56:40.548 INFO:tasks.workunit.client.1.smithi156.stdout:4/559: chown d9/d2b/d35/f86 5163 1 2023-12-16T05:56:40.548 INFO:tasks.workunit.client.1.smithi156.stdout:4/560: chown d9/d43/d58/fa8 1 1 2023-12-16T05:56:40.551 INFO:tasks.workunit.client.1.smithi156.stdout:3/534: dwrite dc/d56/d67/d6e/f81 [0,4194304] 0 2023-12-16T05:56:40.551 INFO:tasks.workunit.client.1.smithi156.stdout:3/535: write dc/d10/d3d/db5/fbf [962540,85476] 0 2023-12-16T05:56:40.552 INFO:tasks.workunit.client.0.smithi155.stdout:1/961: mkdir d1/d7/d4b/d5c/dec/d131 0 2023-12-16T05:56:40.553 INFO:tasks.workunit.client.1.smithi156.stdout:8/437: write d3/d7/d66/d76/f7e [2000319,109502] 0 2023-12-16T05:56:40.553 INFO:tasks.workunit.client.1.smithi156.stdout:6/619: dwrite d9/d13/d2f/d51/d82/d89/d8e/f9d [0,4194304] 0 2023-12-16T05:56:40.554 INFO:tasks.workunit.client.0.smithi155.stdout:0/914: truncate f2 3726321 0 2023-12-16T05:56:40.556 INFO:tasks.workunit.client.0.smithi155.stdout:0/915: truncate d7/df/d73/d8d/d4d/d115/d53/fdc 1399740 0 2023-12-16T05:56:40.559 INFO:tasks.workunit.client.0.smithi155.stdout:1/962: write d1/d7/d4b/d8e/dc7/d28/d8f/db2/fbe [2988069,71541] 0 2023-12-16T05:56:40.559 INFO:tasks.workunit.client.0.smithi155.stdout:1/963: chown d1/d25/dc8/c129 29810040 1 2023-12-16T05:56:40.562 INFO:tasks.workunit.client.0.smithi155.stdout:1/964: write d1/d7/f18 [2611115,29192] 0 2023-12-16T05:56:40.562 INFO:tasks.workunit.client.0.smithi155.stdout:1/965: chown d1/d7/d4b/d8e/fd3 0 1 2023-12-16T05:56:40.563 INFO:tasks.workunit.client.1.smithi156.stdout:9/549: dread d6/f51 [0,4194304] 0 2023-12-16T05:56:40.564 INFO:tasks.workunit.client.1.smithi156.stdout:6/620: creat d9/d13/d2f/d51/d69/d99/fbb x:0 0 0 2023-12-16T05:56:40.564 INFO:tasks.workunit.client.1.smithi156.stdout:6/621: write d9/d13/f73 [4465033,42490] 0 2023-12-16T05:56:40.566 INFO:tasks.workunit.client.1.smithi156.stdout:9/550: stat d6/d2e/f35 0 2023-12-16T05:56:40.567 INFO:tasks.workunit.client.1.smithi156.stdout:2/614: dwrite d9/dd/d17/d33/f10 [0,4194304] 0 2023-12-16T05:56:40.569 INFO:tasks.workunit.client.0.smithi155.stdout:0/916: dread d7/d13/d45/fec [0,4194304] 0 2023-12-16T05:56:40.572 INFO:tasks.workunit.client.1.smithi156.stdout:6/622: unlink d9/d13/d2f/d51/f56 0 2023-12-16T05:56:40.580 INFO:tasks.workunit.client.1.smithi156.stdout:2/615: creat d9/d56/fc8 x:0 0 0 2023-12-16T05:56:40.583 INFO:tasks.workunit.client.1.smithi156.stdout:1/483: dwrite d3/d17/d1c/d22/d57/d61/f80 [0,4194304] 0 2023-12-16T05:56:40.583 INFO:tasks.workunit.client.1.smithi156.stdout:1/484: chown d3/d17/d19 0 1 2023-12-16T05:56:40.583 INFO:tasks.workunit.client.1.smithi156.stdout:4/561: dwrite d9/d2b/f31 [0,4194304] 0 2023-12-16T05:56:40.583 INFO:tasks.workunit.client.1.smithi156.stdout:1/485: chown d3/d17/d1c/d22/d57/f68 976 1 2023-12-16T05:56:40.583 INFO:tasks.workunit.client.1.smithi156.stdout:1/486: fdatasync d3/d17/d1c/f4b 0 2023-12-16T05:56:40.583 INFO:tasks.workunit.client.1.smithi156.stdout:4/562: write d9/d43/f4b [1716307,44008] 0 2023-12-16T05:56:40.584 INFO:tasks.workunit.client.1.smithi156.stdout:1/487: write d3/d1b/d27/f67 [706305,101540] 0 2023-12-16T05:56:40.584 INFO:tasks.workunit.client.1.smithi156.stdout:2/616: truncate d9/f5c 3786350 0 2023-12-16T05:56:40.585 INFO:tasks.workunit.client.1.smithi156.stdout:3/536: dwrite dc/d10/f82 [0,4194304] 0 2023-12-16T05:56:40.586 INFO:tasks.workunit.client.0.smithi155.stdout:4/739: sync 2023-12-16T05:56:40.586 INFO:tasks.workunit.client.0.smithi155.stdout:4/740: truncate d0/da/de0/d16/d30/dce/d75/d50/fba 831654 0 2023-12-16T05:56:40.586 INFO:tasks.workunit.client.1.smithi156.stdout:8/438: dwrite d3/d18/f65 [0,4194304] 0 2023-12-16T05:56:40.587 INFO:tasks.workunit.client.1.smithi156.stdout:8/439: dread - d3/d7/f31 zero size 2023-12-16T05:56:40.588 INFO:tasks.workunit.client.1.smithi156.stdout:7/799: dwrite d1e/d55/d71/d61/daa/db4/fc2 [0,4194304] 0 2023-12-16T05:56:40.589 INFO:tasks.workunit.client.0.smithi155.stdout:4/741: rename d0/da/de0/d16/d30/dce/d75/d3d/d49/dbb/ld4 to d0/da/de0/d16/d30/dce/d75/lf2 0 2023-12-16T05:56:40.590 INFO:tasks.workunit.client.0.smithi155.stdout:4/742: write d0/da/de0/d16/d30/d52/d88/d9e/fc4 [187051,7639] 0 2023-12-16T05:56:40.590 INFO:tasks.workunit.client.0.smithi155.stdout:4/743: read - d0/da/fa7 zero size 2023-12-16T05:56:40.592 INFO:tasks.workunit.client.0.smithi155.stdout:4/744: mknod d0/da/de0/d16/d30/dce/d75/d86/cf3 0 2023-12-16T05:56:40.594 INFO:tasks.workunit.client.0.smithi155.stdout:4/745: truncate d0/da/de0/d16/d30/dce/d75/d3d/d49/f61 461357 0 2023-12-16T05:56:40.597 INFO:tasks.workunit.client.0.smithi155.stdout:4/746: write d0/da/f5e [223715,28248] 0 2023-12-16T05:56:40.597 INFO:tasks.workunit.client.0.smithi155.stdout:4/747: chown d0/da/de0/d16/d30/dce/d75/f45 940 1 2023-12-16T05:56:40.598 INFO:tasks.workunit.client.0.smithi155.stdout:4/748: mknod d0/da/de0/d16/d30/dce/d75/d3d/d49/dbb/dd8/cf4 0 2023-12-16T05:56:40.600 INFO:tasks.workunit.client.0.smithi155.stdout:4/749: symlink d0/lf5 0 2023-12-16T05:56:40.601 INFO:tasks.workunit.client.1.smithi156.stdout:4/563: rename d9/d2b/d35/ca7 to d9/d2c/cbb 0 2023-12-16T05:56:40.604 INFO:tasks.workunit.client.1.smithi156.stdout:2/617: unlink d9/dd/l42 0 2023-12-16T05:56:40.604 INFO:tasks.workunit.client.1.smithi156.stdout:2/618: read - d9/d68/daa/f9c zero size 2023-12-16T05:56:40.604 INFO:tasks.workunit.client.1.smithi156.stdout:2/619: stat d9/dd/d17/d33/d78/d39/c46 0 2023-12-16T05:56:40.604 INFO:tasks.workunit.client.1.smithi156.stdout:2/620: chown d9/d68/daa/l62 15 1 2023-12-16T05:56:40.604 INFO:tasks.workunit.client.1.smithi156.stdout:2/621: chown d9/dd/d17/d33/d78/d39/c55 4 1 2023-12-16T05:56:40.604 INFO:tasks.workunit.client.0.smithi155.stdout:4/750: read d0/f28 [1968145,82630] 0 2023-12-16T05:56:40.605 INFO:tasks.workunit.client.0.smithi155.stdout:1/966: dwrite d1/f35 [0,4194304] 0 2023-12-16T05:56:40.606 INFO:tasks.workunit.client.1.smithi156.stdout:3/537: symlink dc/d56/d67/dbe/lc7 0 2023-12-16T05:56:40.606 INFO:tasks.workunit.client.1.smithi156.stdout:3/538: dread - dc/df/d34/d62/f8d zero size 2023-12-16T05:56:40.606 INFO:tasks.workunit.client.1.smithi156.stdout:6/623: dwrite d9/f53 [0,4194304] 0 2023-12-16T05:56:40.607 INFO:tasks.workunit.client.0.smithi155.stdout:1/967: creat d1/d7/d4b/d8e/dc7/d28/d85/f132 x:0 0 0 2023-12-16T05:56:40.607 INFO:tasks.workunit.client.0.smithi155.stdout:1/968: chown d1/d7/d4b/d8e/c10f 16 1 2023-12-16T05:56:40.607 INFO:tasks.workunit.client.0.smithi155.stdout:1/969: truncate d1/d7/d4b/d8e/dc7/df4/f117 1016400 0 2023-12-16T05:56:40.607 INFO:tasks.workunit.client.0.smithi155.stdout:1/970: stat d1/d7/d4b/d8e/dc7/d28/d85/de0/d79 0 2023-12-16T05:56:40.609 INFO:tasks.workunit.client.1.smithi156.stdout:8/440: symlink d3/d7/d27/d46/d6e/d3b/l8d 0 2023-12-16T05:56:40.609 INFO:tasks.workunit.client.1.smithi156.stdout:1/488: dwrite d3/d17/d1c/d22/d57/f85 [0,4194304] 0 2023-12-16T05:56:40.609 INFO:tasks.workunit.client.0.smithi155.stdout:1/971: creat d1/d25/f133 x:0 0 0 2023-12-16T05:56:40.609 INFO:tasks.workunit.client.0.smithi155.stdout:1/972: chown d1/d25/d43/d5d/d5e/fbd 9 1 2023-12-16T05:56:40.611 INFO:tasks.workunit.client.0.smithi155.stdout:1/973: link d1/d7/d4b/d8e/dc7/cba d1/d7/d4b/d10a/c134 0 2023-12-16T05:56:40.611 INFO:tasks.workunit.client.0.smithi155.stdout:1/974: fsync d1/d7/d4b/d8e/dc7/d28/d8f/f96 0 2023-12-16T05:56:40.611 INFO:tasks.workunit.client.0.smithi155.stdout:1/975: rename d1/d7 to d1/d7/d4b/de3/d135 22 2023-12-16T05:56:40.611 INFO:tasks.workunit.client.0.smithi155.stdout:1/976: stat d1/d7/d4b/de3/l107 0 2023-12-16T05:56:40.612 INFO:tasks.workunit.client.0.smithi155.stdout:1/977: mknod d1/d25/c136 0 2023-12-16T05:56:40.612 INFO:tasks.workunit.client.0.smithi155.stdout:1/978: chown d1/d7/d4b/d8e/dc7/d28/d85/de0/f7d 58143350 1 2023-12-16T05:56:40.613 INFO:tasks.workunit.client.0.smithi155.stdout:1/979: symlink d1/d25/dc8/l137 0 2023-12-16T05:56:40.614 INFO:tasks.workunit.client.0.smithi155.stdout:4/751: dread d0/da/de0/d16/d30/dce/d75/d89/d9a/f9c [0,4194304] 0 2023-12-16T05:56:40.616 INFO:tasks.workunit.client.1.smithi156.stdout:7/800: symlink d1e/d1f/da6/d57/dbb/l11a 0 2023-12-16T05:56:40.616 INFO:tasks.workunit.client.1.smithi156.stdout:7/801: chown d1e/d1f/d72/df4 0 1 2023-12-16T05:56:40.618 INFO:tasks.workunit.client.1.smithi156.stdout:2/622: creat d9/dd/d17/d8f/fc9 x:0 0 0 2023-12-16T05:56:40.619 INFO:tasks.workunit.client.1.smithi156.stdout:2/623: chown d9/d12/f58 8 1 2023-12-16T05:56:40.620 INFO:tasks.workunit.client.0.smithi155.stdout:4/752: creat d0/da/de0/d16/ff6 x:0 0 0 2023-12-16T05:56:40.620 INFO:tasks.workunit.client.1.smithi156.stdout:3/539: unlink dc/d10/c22 0 2023-12-16T05:56:40.620 INFO:tasks.workunit.client.1.smithi156.stdout:4/564: dwrite d9/d2c/d48/dae/f91 [0,4194304] 0 2023-12-16T05:56:40.621 INFO:tasks.workunit.client.0.smithi155.stdout:2/750: sync 2023-12-16T05:56:40.621 INFO:tasks.workunit.client.0.smithi155.stdout:5/817: sync 2023-12-16T05:56:40.621 INFO:tasks.workunit.client.0.smithi155.stdout:4/753: truncate d0/da/de0/d16/d30/dce/d75/d50/fba 1039540 0 2023-12-16T05:56:40.622 INFO:tasks.workunit.client.1.smithi156.stdout:6/624: mknod d9/d13/d2f/d36/cbc 0 2023-12-16T05:56:40.623 INFO:tasks.workunit.client.0.smithi155.stdout:5/818: rename d0/fe3 to d0/d2/d4f/f107 0 2023-12-16T05:56:40.623 INFO:tasks.workunit.client.0.smithi155.stdout:5/819: fsync d0/d2/f1a 0 2023-12-16T05:56:40.623 INFO:tasks.workunit.client.0.smithi155.stdout:5/820: truncate d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/dd9/fe5 447786 0 2023-12-16T05:56:40.623 INFO:tasks.workunit.client.0.smithi155.stdout:5/821: chown d0/d2/d2a/d30/d53/d7b/db3 3 1 2023-12-16T05:56:40.623 INFO:tasks.workunit.client.0.smithi155.stdout:5/822: stat d0/d2/d2a/d30/d53/d7b/d99/d47/f6b 0 2023-12-16T05:56:40.624 INFO:tasks.workunit.client.0.smithi155.stdout:2/751: creat d0/d5/d8a/ffa x:0 0 0 2023-12-16T05:56:40.625 INFO:tasks.workunit.client.0.smithi155.stdout:4/754: truncate d0/d10/f5b 1117513 0 2023-12-16T05:56:40.627 INFO:tasks.workunit.client.1.smithi156.stdout:8/441: mkdir d3/d7/d27/d46/d84/d8e 0 2023-12-16T05:56:40.628 INFO:tasks.workunit.client.0.smithi155.stdout:5/823: creat d0/d2/d2a/d30/d53/d7b/db3/f108 x:0 0 0 2023-12-16T05:56:40.628 INFO:tasks.workunit.client.0.smithi155.stdout:5/824: read - d0/d2/d2a/fda zero size 2023-12-16T05:56:40.629 INFO:tasks.workunit.client.0.smithi155.stdout:2/752: mknod d0/d7/dd/d49/d4b/cfb 0 2023-12-16T05:56:40.631 INFO:tasks.workunit.client.0.smithi155.stdout:4/755: read d0/d10/f3b [3708161,78600] 0 2023-12-16T05:56:40.632 INFO:tasks.workunit.client.1.smithi156.stdout:1/489: unlink d3/d17/d1c/d22/c39 0 2023-12-16T05:56:40.633 INFO:tasks.workunit.client.1.smithi156.stdout:7/802: rename d1e/l7b to d1e/d1f/da6/d10d/d117/l11b 0 2023-12-16T05:56:40.633 INFO:tasks.workunit.client.1.smithi156.stdout:7/803: fsync d1e/d1f/da6/d57/dca/fd3 0 2023-12-16T05:56:40.633 INFO:tasks.workunit.client.1.smithi156.stdout:2/624: rmdir d9/dd/d17/d33/d78/d39/d8c/da2/da6 39 2023-12-16T05:56:40.634 INFO:tasks.workunit.client.1.smithi156.stdout:3/540: mknod dc/d56/d67/d6e/cc8 0 2023-12-16T05:56:40.636 INFO:tasks.workunit.client.0.smithi155.stdout:2/753: creat d0/d5/ffc x:0 0 0 2023-12-16T05:56:40.636 INFO:tasks.workunit.client.0.smithi155.stdout:5/825: creat d0/d2/d2a/d19/dd7/dee/f109 x:0 0 0 2023-12-16T05:56:40.638 INFO:tasks.workunit.client.1.smithi156.stdout:8/442: mkdir d3/d6/d83/d8f 0 2023-12-16T05:56:40.638 INFO:tasks.workunit.client.1.smithi156.stdout:8/443: dread - d3/d7/d27/d46/f79 zero size 2023-12-16T05:56:40.638 INFO:tasks.workunit.client.1.smithi156.stdout:8/444: fsync d3/d6/f36 0 2023-12-16T05:56:40.639 INFO:tasks.workunit.client.0.smithi155.stdout:4/756: creat d0/da/de0/d16/d30/dce/ff7 x:0 0 0 2023-12-16T05:56:40.641 INFO:tasks.workunit.client.0.smithi155.stdout:2/754: rmdir d0/d5/def 0 2023-12-16T05:56:40.641 INFO:tasks.workunit.client.0.smithi155.stdout:5/826: symlink d0/d2/d2a/d19/dd7/l10a 0 2023-12-16T05:56:40.643 INFO:tasks.workunit.client.0.smithi155.stdout:2/755: rmdir d0/d7/d57/dad 0 2023-12-16T05:56:40.644 INFO:tasks.workunit.client.1.smithi156.stdout:2/625: dread d9/dd/d17/d33/d78/d39/d8c/da2/da6/f64 [0,4194304] 0 2023-12-16T05:56:40.644 INFO:tasks.workunit.client.0.smithi155.stdout:2/756: rmdir d0/d7 39 2023-12-16T05:56:40.645 INFO:tasks.workunit.client.1.smithi156.stdout:1/490: creat d3/d17/d1c/fa0 x:0 0 0 2023-12-16T05:56:40.645 INFO:tasks.workunit.client.1.smithi156.stdout:3/541: dread dc/df/f2b [0,4194304] 0 2023-12-16T05:56:40.645 INFO:tasks.workunit.client.1.smithi156.stdout:7/804: mknod d1e/d39/c11c 0 2023-12-16T05:56:40.645 INFO:tasks.workunit.client.1.smithi156.stdout:8/445: mknod d3/d7/c90 0 2023-12-16T05:56:40.645 INFO:tasks.workunit.client.1.smithi156.stdout:0/655: sync 2023-12-16T05:56:40.645 INFO:tasks.workunit.client.1.smithi156.stdout:0/656: fdatasync d2/d7/dd/d29/d2e/f57 0 2023-12-16T05:56:40.646 INFO:tasks.workunit.client.0.smithi155.stdout:2/757: read d0/d7/d1f/d74/f36 [2293926,58100] 0 2023-12-16T05:56:40.646 INFO:tasks.workunit.client.0.smithi155.stdout:2/758: fsync d0/d7/d1f/f97 0 2023-12-16T05:56:40.647 INFO:tasks.workunit.client.1.smithi156.stdout:1/491: symlink d3/d17/d4d/la1 0 2023-12-16T05:56:40.647 INFO:tasks.workunit.client.1.smithi156.stdout:1/492: read - d3/d17/d4d/f8c zero size 2023-12-16T05:56:40.647 INFO:tasks.workunit.client.1.smithi156.stdout:1/493: truncate d3/d1b/d8b/f93 585096 0 2023-12-16T05:56:40.649 INFO:tasks.workunit.client.1.smithi156.stdout:2/626: dread d9/f20 [0,4194304] 0 2023-12-16T05:56:40.651 INFO:tasks.workunit.client.1.smithi156.stdout:3/542: getdents dc/d10/d1d/d4b 0 2023-12-16T05:56:40.654 INFO:tasks.workunit.client.0.smithi155.stdout:5/827: dread d0/d2/d2a/d19/d21/f23 [4194304,4194304] 0 2023-12-16T05:56:40.654 INFO:tasks.workunit.client.0.smithi155.stdout:5/828: truncate d0/d2/d2a/d19/d21/ff7 653389 0 2023-12-16T05:56:40.655 INFO:tasks.workunit.client.0.smithi155.stdout:5/829: mkdir d0/d2/d2a/d30/d53/d7b/d99/d47/d61/db6/def/d10b 0 2023-12-16T05:56:40.655 INFO:tasks.workunit.client.1.smithi156.stdout:7/805: creat d1e/d55/d71/f11d x:0 0 0 2023-12-16T05:56:40.656 INFO:tasks.workunit.client.1.smithi156.stdout:7/806: write d1e/d55/db6/ddb/fe0 [466761,40462] 0 2023-12-16T05:56:40.656 INFO:tasks.workunit.client.1.smithi156.stdout:7/807: chown d1e/d1f/da6/d57/d59/ldc 1911700677 1 2023-12-16T05:56:40.656 INFO:tasks.workunit.client.0.smithi155.stdout:5/830: symlink d0/d2/d2a/d19/d59/l10c 0 2023-12-16T05:56:40.656 INFO:tasks.workunit.client.0.smithi155.stdout:1/980: dwrite d1/d25/d43/fcb [0,4194304] 0 2023-12-16T05:56:40.657 INFO:tasks.workunit.client.0.smithi155.stdout:2/759: dread d0/f4 [0,4194304] 0 2023-12-16T05:56:40.657 INFO:tasks.workunit.client.0.smithi155.stdout:5/831: creat d0/d2/d2a/d30/d53/d7b/d99/d47/f10d x:0 0 0 2023-12-16T05:56:40.657 INFO:tasks.workunit.client.0.smithi155.stdout:5/832: readlink d0/d60/l89 0 2023-12-16T05:56:40.657 INFO:tasks.workunit.client.1.smithi156.stdout:8/446: creat d3/d6/d83/f91 x:0 0 0 2023-12-16T05:56:40.658 INFO:tasks.workunit.client.0.smithi155.stdout:2/760: creat d0/d7/dd/d14/db6/ffd x:0 0 0 2023-12-16T05:56:40.658 INFO:tasks.workunit.client.1.smithi156.stdout:6/625: dwrite d9/d13/d2f/d51/fb1 [0,4194304] 0 2023-12-16T05:56:40.658 INFO:tasks.workunit.client.1.smithi156.stdout:6/626: write d9/d13/d2f/fb2 [574789,76711] 0 2023-12-16T05:56:40.659 INFO:tasks.workunit.client.1.smithi156.stdout:0/657: unlink d2/d7/dd/l56 0 2023-12-16T05:56:40.659 INFO:tasks.workunit.client.1.smithi156.stdout:0/658: chown d2/d7/dd/d1c/l37 1033919 1 2023-12-16T05:56:40.659 INFO:tasks.workunit.client.0.smithi155.stdout:5/833: creat d0/d2/d2a/d30/d53/d7b/d99/d47/d61/db6/f10e x:0 0 0 2023-12-16T05:56:40.659 INFO:tasks.workunit.client.0.smithi155.stdout:5/834: write d0/d2/d2a/d19/d71/f7e [53564,84131] 0 2023-12-16T05:56:40.660 INFO:tasks.workunit.client.1.smithi156.stdout:2/627: mkdir d9/d68/daa/d83/da1/d96/dca 0 2023-12-16T05:56:40.660 INFO:tasks.workunit.client.1.smithi156.stdout:2/628: fdatasync d9/dd/d17/d33/d78/d39/f76 0 2023-12-16T05:56:40.660 INFO:tasks.workunit.client.1.smithi156.stdout:2/629: chown d9/dd/d17/d8f/cab 12 1 2023-12-16T05:56:40.661 INFO:tasks.workunit.client.1.smithi156.stdout:4/565: dwrite d9/d43/d58/d95/f97 [0,4194304] 0 2023-12-16T05:56:40.661 INFO:tasks.workunit.client.0.smithi155.stdout:1/981: read d1/f51 [624117,129161] 0 2023-12-16T05:56:40.661 INFO:tasks.workunit.client.1.smithi156.stdout:3/543: rename dc/d56/d69/f7f to dc/d56/d67/fc9 0 2023-12-16T05:56:40.661 INFO:tasks.workunit.client.1.smithi156.stdout:3/544: getdents dc/d56/d67/dbe/dc3 0 2023-12-16T05:56:40.662 INFO:tasks.workunit.client.0.smithi155.stdout:4/757: dwrite d0/da/de0/d16/d30/dce/d7b/dcb/fd0 [0,4194304] 0 2023-12-16T05:56:40.662 INFO:tasks.workunit.client.0.smithi155.stdout:4/758: read d0/da/de0/d16/d30/dce/d75/d3d/d43/feb [304773,53387] 0 2023-12-16T05:56:40.663 INFO:tasks.workunit.client.1.smithi156.stdout:7/808: mkdir d1e/d55/db6/ddb/d11e 0 2023-12-16T05:56:40.663 INFO:tasks.workunit.client.1.smithi156.stdout:7/809: chown d1e/d1f/d72/d107/c10a 4777 1 2023-12-16T05:56:40.664 INFO:tasks.workunit.client.1.smithi156.stdout:8/447: mknod d3/d7/d27/d46/d6e/d3c/c92 0 2023-12-16T05:56:40.665 INFO:tasks.workunit.client.1.smithi156.stdout:8/448: write d3/d18/f65 [2074167,83914] 0 2023-12-16T05:56:40.665 INFO:tasks.workunit.client.1.smithi156.stdout:7/810: write d1e/f8c [1111266,117420] 0 2023-12-16T05:56:40.665 INFO:tasks.workunit.client.1.smithi156.stdout:7/811: truncate d1e/d55/d71/f11d 954031 0 2023-12-16T05:56:40.665 INFO:tasks.workunit.client.1.smithi156.stdout:7/812: truncate d1e/d55/d71/fc3 498885 0 2023-12-16T05:56:40.666 INFO:tasks.workunit.client.0.smithi155.stdout:1/982: write d1/d25/d43/d5d/d5e/fbd [1760373,1337] 0 2023-12-16T05:56:40.667 INFO:tasks.workunit.client.1.smithi156.stdout:5/767: sync 2023-12-16T05:56:40.667 INFO:tasks.workunit.client.1.smithi156.stdout:5/768: chown da/dc/f1d 38999 1 2023-12-16T05:56:40.669 INFO:tasks.workunit.client.0.smithi155.stdout:1/983: read d1/d69/fc1 [3543017,59199] 0 2023-12-16T05:56:40.669 INFO:tasks.workunit.client.0.smithi155.stdout:1/984: readlink d1/d7/d4b/d5c/dec/l10e 0 2023-12-16T05:56:40.669 INFO:tasks.workunit.client.0.smithi155.stdout:1/985: chown d1/d7/d4b/f124 650111391 1 2023-12-16T05:56:40.670 INFO:tasks.workunit.client.1.smithi156.stdout:5/769: dread da/dc/f9f [0,4194304] 0 2023-12-16T05:56:40.670 INFO:tasks.workunit.client.1.smithi156.stdout:6/627: link d9/d13/d3e/fb5 d9/d13/d2f/d36/fbd 0 2023-12-16T05:56:40.670 INFO:tasks.workunit.client.1.smithi156.stdout:5/770: chown da/dc/d2d/d4d/db9/dc9 23394 1 2023-12-16T05:56:40.670 INFO:tasks.workunit.client.1.smithi156.stdout:0/659: creat d2/d23/d55/fce x:0 0 0 2023-12-16T05:56:40.670 INFO:tasks.workunit.client.1.smithi156.stdout:0/660: fsync d2/f28 0 2023-12-16T05:56:40.671 INFO:tasks.workunit.client.0.smithi155.stdout:1/986: unlink d1/d7/d4b/d8e/c10f 0 2023-12-16T05:56:40.671 INFO:tasks.workunit.client.0.smithi155.stdout:2/761: dread d0/f12 [0,4194304] 0 2023-12-16T05:56:40.671 INFO:tasks.workunit.client.0.smithi155.stdout:1/987: read d1/d7/d4b/d8e/dc7/df4/f117 [142686,20143] 0 2023-12-16T05:56:40.671 INFO:tasks.workunit.client.0.smithi155.stdout:1/988: truncate d1/d69/fd9 865534 0 2023-12-16T05:56:40.673 INFO:tasks.workunit.client.1.smithi156.stdout:2/630: creat d9/d68/daa/d83/da1/d96/fcb x:0 0 0 2023-12-16T05:56:40.673 INFO:tasks.workunit.client.0.smithi155.stdout:1/989: creat d1/f138 x:0 0 0 2023-12-16T05:56:40.675 INFO:tasks.workunit.client.0.smithi155.stdout:2/762: read d0/d7/d69/f91 [2548534,91676] 0 2023-12-16T05:56:40.675 INFO:tasks.workunit.client.0.smithi155.stdout:2/763: fsync d0/d5/d8a/ffa 0 2023-12-16T05:56:40.675 INFO:tasks.workunit.client.0.smithi155.stdout:2/764: dread - d0/d7/d1f/d74/d85/d88/fe3 zero size 2023-12-16T05:56:40.676 INFO:tasks.workunit.client.0.smithi155.stdout:2/765: symlink d0/d7/dc1/lfe 0 2023-12-16T05:56:40.677 INFO:tasks.workunit.client.1.smithi156.stdout:4/566: link d9/d43/f8e d9/d2c/fbc 0 2023-12-16T05:56:40.677 INFO:tasks.workunit.client.1.smithi156.stdout:4/567: truncate d9/d2b/d35/f3f 638162 0 2023-12-16T05:56:40.677 INFO:tasks.workunit.client.1.smithi156.stdout:4/568: readlink d9/d43/l4e 0 2023-12-16T05:56:40.678 INFO:tasks.workunit.client.0.smithi155.stdout:2/766: creat d0/d7/d57/d63/de7/fff x:0 0 0 2023-12-16T05:56:40.679 INFO:tasks.workunit.client.0.smithi155.stdout:2/767: read d0/d7/dd/d14/f19 [56311,97424] 0 2023-12-16T05:56:40.679 INFO:tasks.workunit.client.0.smithi155.stdout:2/768: write d0/d7/dd/d62/d66/f6a [1157712,39356] 0 2023-12-16T05:56:40.679 INFO:tasks.workunit.client.1.smithi156.stdout:1/494: dwrite f1 [0,4194304] 0 2023-12-16T05:56:40.680 INFO:tasks.workunit.client.1.smithi156.stdout:8/449: dread d3/d18/f1b [4194304,4194304] 0 2023-12-16T05:56:40.680 INFO:tasks.workunit.client.1.smithi156.stdout:8/450: truncate d3/d7/d27/d46/d6e/d3c/f55 568121 0 2023-12-16T05:56:40.681 INFO:tasks.workunit.client.1.smithi156.stdout:3/545: unlink dc/df/d34/d62/la1 0 2023-12-16T05:56:40.684 INFO:tasks.workunit.client.1.smithi156.stdout:6/628: symlink d9/d13/d3e/d5f/lbe 0 2023-12-16T05:56:40.685 INFO:tasks.workunit.client.1.smithi156.stdout:5/771: creat da/dc/d4b/d6c/d77/ffb x:0 0 0 2023-12-16T05:56:40.685 INFO:tasks.workunit.client.1.smithi156.stdout:5/772: write da/dc/d4b/d6c/d77/ffb [142523,21568] 0 2023-12-16T05:56:40.685 INFO:tasks.workunit.client.1.smithi156.stdout:5/773: fdatasync da/dc/d4b/d6c/fe5 0 2023-12-16T05:56:40.685 INFO:tasks.workunit.client.1.smithi156.stdout:5/774: truncate da/f68 5147621 0 2023-12-16T05:56:40.686 INFO:tasks.workunit.client.1.smithi156.stdout:5/775: dread - da/dc/d2d/d4d/d54/faa zero size 2023-12-16T05:56:40.686 INFO:tasks.workunit.client.1.smithi156.stdout:5/776: readlink da/dc/d2d/l39 0 2023-12-16T05:56:40.686 INFO:tasks.workunit.client.1.smithi156.stdout:7/813: dwrite d1e/d1f/d22/f23 [0,4194304] 0 2023-12-16T05:56:40.686 INFO:tasks.workunit.client.1.smithi156.stdout:7/814: fsync d1e/d55/d71/d61/f5d 0 2023-12-16T05:56:40.687 INFO:tasks.workunit.client.0.smithi155.stdout:5/835: dwrite d0/d2/d2a/f42 [0,4194304] 0 2023-12-16T05:56:40.688 INFO:tasks.workunit.client.1.smithi156.stdout:0/661: rename d2/d7/dd/d29/d4b/d76/d85 to d2/d7/dd/d2d/dcf 0 2023-12-16T05:56:40.688 INFO:tasks.workunit.client.1.smithi156.stdout:0/662: stat d2/d47 0 2023-12-16T05:56:40.689 INFO:tasks.workunit.client.1.smithi156.stdout:2/631: mknod d9/dd/d17/d33/d47/ccc 0 2023-12-16T05:56:40.690 INFO:tasks.workunit.client.0.smithi155.stdout:5/836: creat d0/d60/d79/f10f x:0 0 0 2023-12-16T05:56:40.692 INFO:tasks.workunit.client.0.smithi155.stdout:5/837: mknod d0/d2/d2a/d30/d53/d7b/d99/d47/d61/de1/c110 0 2023-12-16T05:56:40.694 INFO:tasks.workunit.client.1.smithi156.stdout:8/451: dread d3/d18/f19 [0,4194304] 0 2023-12-16T05:56:40.694 INFO:tasks.workunit.client.1.smithi156.stdout:8/452: readlink d3/d12/l4b 0 2023-12-16T05:56:40.694 INFO:tasks.workunit.client.1.smithi156.stdout:1/495: symlink d3/d17/d2d/la2 0 2023-12-16T05:56:40.694 INFO:tasks.workunit.client.1.smithi156.stdout:4/569: dwrite d9/f27 [0,4194304] 0 2023-12-16T05:56:40.695 INFO:tasks.workunit.client.1.smithi156.stdout:7/815: dread d1e/d55/d71/d61/daa/f50 [0,4194304] 0 2023-12-16T05:56:40.695 INFO:tasks.workunit.client.1.smithi156.stdout:4/570: read d9/d2b/f3c [55415,87614] 0 2023-12-16T05:56:40.695 INFO:tasks.workunit.client.1.smithi156.stdout:4/571: write d9/d43/d58/f76 [124501,115739] 0 2023-12-16T05:56:40.698 INFO:tasks.workunit.client.1.smithi156.stdout:5/777: mknod da/cfc 0 2023-12-16T05:56:40.701 INFO:tasks.workunit.client.1.smithi156.stdout:6/629: rename d9/d1c/dba to d9/d1c/d50/dbf 0 2023-12-16T05:56:40.702 INFO:tasks.workunit.client.1.smithi156.stdout:0/663: mkdir d2/d7/dd/d2d/dcf/dd0 0 2023-12-16T05:56:40.702 INFO:tasks.workunit.client.1.smithi156.stdout:0/664: write d2/d23/d55/f97 [45512,60778] 0 2023-12-16T05:56:40.704 INFO:tasks.workunit.client.1.smithi156.stdout:2/632: truncate d9/dd/d17/f61 225879 0 2023-12-16T05:56:40.704 INFO:tasks.workunit.client.1.smithi156.stdout:2/633: truncate d9/d68/daa/d83/f84 51337 0 2023-12-16T05:56:40.705 INFO:tasks.workunit.client.0.smithi155.stdout:5/838: dread d0/d2/fa6 [0,4194304] 0 2023-12-16T05:56:40.705 INFO:tasks.workunit.client.1.smithi156.stdout:8/453: creat d3/d7/d27/f93 x:0 0 0 2023-12-16T05:56:40.706 INFO:tasks.workunit.client.0.smithi155.stdout:2/769: dwrite d0/d7/dd/d62/d66/f6a [0,4194304] 0 2023-12-16T05:56:40.707 INFO:tasks.workunit.client.0.smithi155.stdout:5/839: creat d0/d2/d2a/d19/d48/df5/f111 x:0 0 0 2023-12-16T05:56:40.711 INFO:tasks.workunit.client.0.smithi155.stdout:5/840: rmdir d0/d2/d2a/d19/d48 39 2023-12-16T05:56:40.712 INFO:tasks.workunit.client.0.smithi155.stdout:5/841: creat d0/d2/d2a/d30/d53/d7b/d99/d47/d61/db6/f112 x:0 0 0 2023-12-16T05:56:40.712 INFO:tasks.workunit.client.0.smithi155.stdout:5/842: chown d0/d2/fd1 6501704 1 2023-12-16T05:56:40.712 INFO:tasks.workunit.client.0.smithi155.stdout:5/843: chown d0/d2/d2a 76556 1 2023-12-16T05:56:40.713 INFO:tasks.workunit.client.0.smithi155.stdout:5/844: link d0/d2/d4f/fa4 d0/d2/d2a/d30/d53/db5/f113 0 2023-12-16T05:56:40.715 INFO:tasks.workunit.client.0.smithi155.stdout:5/845: truncate d0/d2/d2a/d19/f38 1799072 0 2023-12-16T05:56:40.715 INFO:tasks.workunit.client.0.smithi155.stdout:5/846: chown d0/d60/d79/df1/ldc 15841474 1 2023-12-16T05:56:40.715 INFO:tasks.workunit.client.0.smithi155.stdout:5/847: write d0/d2/d2a/d30/d53/fba [985488,53440] 0 2023-12-16T05:56:40.716 INFO:tasks.workunit.client.0.smithi155.stdout:5/848: mknod d0/c114 0 2023-12-16T05:56:40.718 INFO:tasks.workunit.client.1.smithi156.stdout:7/816: creat d1e/d1f/da6/d57/d59/dfb/f11f x:0 0 0 2023-12-16T05:56:40.720 INFO:tasks.workunit.client.1.smithi156.stdout:3/546: symlink dc/d56/d67/dbe/dc3/lca 0 2023-12-16T05:56:40.722 INFO:tasks.workunit.client.1.smithi156.stdout:5/778: dwrite da/dc/d2d/f41 [0,4194304] 0 2023-12-16T05:56:40.724 INFO:tasks.workunit.client.1.smithi156.stdout:1/496: rename d3/d1b/d27/f29 to d3/d17/d1c/d22/fa3 0 2023-12-16T05:56:40.725 INFO:tasks.workunit.client.1.smithi156.stdout:6/630: mkdir d9/d1c/d50/dbf/dc0 0 2023-12-16T05:56:40.725 INFO:tasks.workunit.client.1.smithi156.stdout:6/631: readlink d9/d1c/l5e 0 2023-12-16T05:56:40.731 INFO:tasks.workunit.client.1.smithi156.stdout:8/454: mkdir d3/d18/d94 0 2023-12-16T05:56:40.731 INFO:tasks.workunit.client.0.smithi155.stdout:5/849: dread d0/d2/d2a/d19/d21/d56/fac [0,4194304] 0 2023-12-16T05:56:40.732 INFO:tasks.workunit.client.0.smithi155.stdout:5/850: getdents d0/d2/d2a 0 2023-12-16T05:56:40.732 INFO:tasks.workunit.client.0.smithi155.stdout:5/851: truncate d0/d2/d2a/d19/d21/f23 8748089 0 2023-12-16T05:56:40.733 INFO:tasks.workunit.client.1.smithi156.stdout:1/497: dread d3/d1b/d27/f5c [0,4194304] 0 2023-12-16T05:56:40.733 INFO:tasks.workunit.client.1.smithi156.stdout:1/498: chown d3/d17/d19/c63 18134 1 2023-12-16T05:56:40.734 INFO:tasks.workunit.client.1.smithi156.stdout:7/817: link d1e/d55/d71/d61/cf3 d1e/d55/d71/d61/dac/c120 0 2023-12-16T05:56:40.734 INFO:tasks.workunit.client.1.smithi156.stdout:7/818: write d1e/d1f/d22/f23 [5377199,104906] 0 2023-12-16T05:56:40.734 INFO:tasks.workunit.client.1.smithi156.stdout:7/819: truncate d1e/d55/dba/f109 662402 0 2023-12-16T05:56:40.735 INFO:tasks.workunit.client.0.smithi155.stdout:5/852: write d0/d2/f22 [6070264,33168] 0 2023-12-16T05:56:40.736 INFO:tasks.workunit.client.1.smithi156.stdout:6/632: dread d9/d13/d2f/d51/d82/d89/d8e/f9d [0,4194304] 0 2023-12-16T05:56:40.737 INFO:tasks.workunit.client.1.smithi156.stdout:4/572: link f0 d9/d2b/fbd 0 2023-12-16T05:56:40.737 INFO:tasks.workunit.client.1.smithi156.stdout:3/547: truncate dc/d10/f11 1845213 0 2023-12-16T05:56:40.740 INFO:tasks.workunit.client.1.smithi156.stdout:2/634: rename d9/f27 to d9/dd/d17/d33/d78/d39/d8c/da2/fcd 0 2023-12-16T05:56:40.740 INFO:tasks.workunit.client.1.smithi156.stdout:2/635: chown d9/dd/d17/d8f/c9d 970 1 2023-12-16T05:56:40.740 INFO:tasks.workunit.client.1.smithi156.stdout:2/636: dread - d9/d12/dc2/fc7 zero size 2023-12-16T05:56:40.742 INFO:tasks.workunit.client.1.smithi156.stdout:8/455: mkdir d3/d12/d95 0 2023-12-16T05:56:40.744 INFO:tasks.workunit.client.1.smithi156.stdout:1/499: rmdir d3/d17/d1c/d22/d57 39 2023-12-16T05:56:40.746 INFO:tasks.workunit.client.1.smithi156.stdout:7/820: rmdir d1e/d55/d71/d61/d102 0 2023-12-16T05:56:40.748 INFO:tasks.workunit.client.1.smithi156.stdout:3/548: creat dc/d10/d1d/db2/fcb x:0 0 0 2023-12-16T05:56:40.749 INFO:tasks.workunit.client.1.smithi156.stdout:3/549: read dc/d10/d1d/f5d [1342107,111550] 0 2023-12-16T05:56:40.749 INFO:tasks.workunit.client.1.smithi156.stdout:2/637: mknod d9/dd/d17/d33/d78/cce 0 2023-12-16T05:56:40.751 INFO:tasks.workunit.client.1.smithi156.stdout:8/456: link d3/d18/c4c d3/d7/d62/c96 0 2023-12-16T05:56:40.752 INFO:tasks.workunit.client.1.smithi156.stdout:7/821: rmdir d1e/d55/d71/d94/d108 39 2023-12-16T05:56:40.754 INFO:tasks.workunit.client.1.smithi156.stdout:7/822: write d1e/d1f/da6/d57/f86 [397047,79119] 0 2023-12-16T05:56:40.754 INFO:tasks.workunit.client.1.smithi156.stdout:7/823: fdatasync d1e/d39/f7d 0 2023-12-16T05:56:40.755 INFO:tasks.workunit.client.1.smithi156.stdout:4/573: dread d9/f42 [0,4194304] 0 2023-12-16T05:56:40.757 INFO:tasks.workunit.client.1.smithi156.stdout:2/638: link d9/dd/d17/d33/d78/f95 d9/d12/dc2/fcf 0 2023-12-16T05:56:40.760 INFO:tasks.workunit.client.1.smithi156.stdout:7/824: rename d1e/d55/d71/d61/daa/f3d to d1e/d1f/da6/d57/d59/f121 0 2023-12-16T05:56:40.760 INFO:tasks.workunit.client.1.smithi156.stdout:9/551: sync 2023-12-16T05:56:40.761 INFO:tasks.workunit.client.1.smithi156.stdout:7/825: dread d1e/d55/d71/d61/f5d [0,4194304] 0 2023-12-16T05:56:40.762 INFO:tasks.workunit.client.1.smithi156.stdout:3/550: link dc/d56/d69/cc4 dc/df/d66/ccc 0 2023-12-16T05:56:40.763 INFO:tasks.workunit.client.1.smithi156.stdout:4/574: mknod d9/d2b/d98/cbe 0 2023-12-16T05:56:40.763 INFO:tasks.workunit.client.1.smithi156.stdout:4/575: chown d9/d2c/c5f 247 1 2023-12-16T05:56:40.763 INFO:tasks.workunit.client.1.smithi156.stdout:4/576: chown d9/d2b/d98/fb3 0 1 2023-12-16T05:56:40.766 INFO:tasks.workunit.client.1.smithi156.stdout:5/779: dwrite da/dc/d2d/d4d/f88 [4194304,4194304] 0 2023-12-16T05:56:40.766 INFO:tasks.workunit.client.1.smithi156.stdout:5/780: chown da/d46/l6e 13152 1 2023-12-16T05:56:40.766 INFO:tasks.workunit.client.1.smithi156.stdout:2/639: getdents d9/dd/d17/d33/db5 0 2023-12-16T05:56:40.766 INFO:tasks.workunit.client.1.smithi156.stdout:2/640: chown d9/dd/d17/d8f/fc9 292689 1 2023-12-16T05:56:40.766 INFO:tasks.workunit.client.1.smithi156.stdout:0/665: dwrite d2/d7/dd/d2d/d5e/f94 [0,4194304] 0 2023-12-16T05:56:40.766 INFO:tasks.workunit.client.0.smithi155.stdout:5/853: dwrite d0/d2/d2a/f63 [0,4194304] 0 2023-12-16T05:56:40.767 INFO:tasks.workunit.client.0.smithi155.stdout:5/854: write d0/d2/d2a/d30/d53/d7b/d99/f5c [26795,82647] 0 2023-12-16T05:56:40.767 INFO:tasks.workunit.client.0.smithi155.stdout:5/855: chown d0/d2/d2a/fbd 398229 1 2023-12-16T05:56:40.767 INFO:tasks.workunit.client.1.smithi156.stdout:8/457: dwrite d3/d12/f3d [4194304,4194304] 0 2023-12-16T05:56:40.767 INFO:tasks.workunit.client.1.smithi156.stdout:8/458: truncate d3/d7/d27/d46/f79 224986 0 2023-12-16T05:56:40.767 INFO:tasks.workunit.client.1.smithi156.stdout:1/500: dwrite d3/d1b/d27/d4f/d75/f72 [0,4194304] 0 2023-12-16T05:56:40.767 INFO:tasks.workunit.client.1.smithi156.stdout:9/552: creat d6/d19/d25/d72/fbb x:0 0 0 2023-12-16T05:56:40.769 INFO:tasks.workunit.client.1.smithi156.stdout:7/826: getdents d1e/d1f/da6/d10d/d117 0 2023-12-16T05:56:40.770 INFO:tasks.workunit.client.0.smithi155.stdout:5/856: mknod d0/d2/d2a/d30/d53/d7b/d99/d47/d61/de1/c115 0 2023-12-16T05:56:40.771 INFO:tasks.workunit.client.0.smithi155.stdout:5/857: truncate d0/d2/fd1 1508408 0 2023-12-16T05:56:40.772 INFO:tasks.workunit.client.0.smithi155.stdout:5/858: creat d0/d2/d4f/f116 x:0 0 0 2023-12-16T05:56:40.781 INFO:tasks.workunit.client.1.smithi156.stdout:4/577: mkdir d9/d2c/dbf 0 2023-12-16T05:56:40.783 INFO:tasks.workunit.client.1.smithi156.stdout:5/781: mknod da/dc/d2d/d4d/db9/dc9/dfa/cfd 0 2023-12-16T05:56:40.783 INFO:tasks.workunit.client.1.smithi156.stdout:9/553: dwrite d6/d19/d30/f44 [0,4194304] 0 2023-12-16T05:56:40.784 INFO:tasks.workunit.client.1.smithi156.stdout:2/641: rename d9/dd/d17/d33/dae/daf to d9/dd/d17/d33/d78/d74/dd0 0 2023-12-16T05:56:40.786 INFO:tasks.workunit.client.1.smithi156.stdout:0/666: truncate d2/f3d 2060564 0 2023-12-16T05:56:40.786 INFO:tasks.workunit.client.0.smithi155.stdout:5/859: dwrite d0/d2/d2a/f45 [0,4194304] 0 2023-12-16T05:56:40.787 INFO:tasks.workunit.client.1.smithi156.stdout:8/459: creat d3/d7/d27/d46/d6e/d3c/f97 x:0 0 0 2023-12-16T05:56:40.787 INFO:tasks.workunit.client.1.smithi156.stdout:8/460: truncate d3/d7/d27/f32 475547 0 2023-12-16T05:56:40.787 INFO:tasks.workunit.client.0.smithi155.stdout:5/860: mkdir d0/d60/d79/d8e/d117 0 2023-12-16T05:56:40.789 INFO:tasks.workunit.client.0.smithi155.stdout:5/861: read d0/d2/d2a/f45 [172300,99620] 0 2023-12-16T05:56:40.790 INFO:tasks.workunit.client.0.smithi155.stdout:5/862: creat d0/d2/d2a/d30/d53/d7b/d99/d47/d61/db6/f118 x:0 0 0 2023-12-16T05:56:40.791 INFO:tasks.workunit.client.1.smithi156.stdout:9/554: dread d6/f98 [4194304,4194304] 0 2023-12-16T05:56:40.791 INFO:tasks.workunit.client.0.smithi155.stdout:5/863: mkdir d0/d2/d2a/d30/d53/d7b/d99/d47/d61/d119 0 2023-12-16T05:56:40.792 INFO:tasks.workunit.client.0.smithi155.stdout:5/864: dread d0/d2/d4f/fa4 [0,4194304] 0 2023-12-16T05:56:40.794 INFO:tasks.workunit.client.1.smithi156.stdout:2/642: dread d9/d68/f90 [0,4194304] 0 2023-12-16T05:56:40.794 INFO:tasks.workunit.client.1.smithi156.stdout:2/643: chown d9/d68/daa/d83 202 1 2023-12-16T05:56:40.795 INFO:tasks.workunit.client.1.smithi156.stdout:1/501: mkdir d3/d17/d1c/d22/da4 0 2023-12-16T05:56:40.795 INFO:tasks.workunit.client.1.smithi156.stdout:1/502: write d3/d17/d1c/d22/f9b [314533,4908] 0 2023-12-16T05:56:40.795 INFO:tasks.workunit.client.1.smithi156.stdout:1/503: truncate d3/d17/d2d/f86 947205 0 2023-12-16T05:56:40.795 INFO:tasks.workunit.client.1.smithi156.stdout:1/504: chown d3/d1b/d8b/c9c 164213 1 2023-12-16T05:56:40.798 INFO:tasks.workunit.client.1.smithi156.stdout:7/827: creat d1e/d55/d71/d61/daa/db4/f122 x:0 0 0 2023-12-16T05:56:40.799 INFO:tasks.workunit.client.1.smithi156.stdout:4/578: mkdir d9/d2c/d7a/dc0 0 2023-12-16T05:56:40.799 INFO:tasks.workunit.client.1.smithi156.stdout:4/579: chown d9/d2b/d98/d99/ca4 491307837 1 2023-12-16T05:56:40.799 INFO:tasks.workunit.client.1.smithi156.stdout:4/580: fdatasync d9/d2c/f9b 0 2023-12-16T05:56:40.804 INFO:tasks.workunit.client.1.smithi156.stdout:3/551: rmdir dc 39 2023-12-16T05:56:40.804 INFO:tasks.workunit.client.1.smithi156.stdout:3/552: chown dc/d10/d3d/d4e 2 1 2023-12-16T05:56:40.805 INFO:tasks.workunit.client.1.smithi156.stdout:5/782: truncate da/d46/fb5 1854460 0 2023-12-16T05:56:40.807 INFO:tasks.workunit.client.1.smithi156.stdout:9/555: dwrite d6/d19/f1f [0,4194304] 0 2023-12-16T05:56:40.807 INFO:tasks.workunit.client.1.smithi156.stdout:0/667: getdents d2/d7/dd/d29/d38/d51 0 2023-12-16T05:56:40.809 INFO:tasks.workunit.client.1.smithi156.stdout:8/461: symlink d3/d7/d27/l98 0 2023-12-16T05:56:40.809 INFO:tasks.workunit.client.1.smithi156.stdout:2/644: stat d9/d68/daa/la8 0 2023-12-16T05:56:40.811 INFO:tasks.workunit.client.1.smithi156.stdout:1/505: mkdir d3/d17/d1c/da5 0 2023-12-16T05:56:40.811 INFO:tasks.workunit.client.1.smithi156.stdout:4/581: rmdir d9/d2b/d9a 39 2023-12-16T05:56:40.814 INFO:tasks.workunit.client.1.smithi156.stdout:3/553: creat dc/df/fcd x:0 0 0 2023-12-16T05:56:40.816 INFO:tasks.workunit.client.1.smithi156.stdout:5/783: rename da/dc/d2d/d4d/d54/d90/fdb to da/dc/d2d/d4d/d54/ffe 0 2023-12-16T05:56:40.820 INFO:tasks.workunit.client.1.smithi156.stdout:9/556: symlink d6/d19/d30/dae/lbc 0 2023-12-16T05:56:40.821 INFO:tasks.workunit.client.1.smithi156.stdout:0/668: symlink d2/d7/dd/d29/d38/d51/d52/d88/dbc/dc2/ld1 0 2023-12-16T05:56:40.822 INFO:tasks.workunit.client.1.smithi156.stdout:0/669: write d2/d7/dd/d29/d2e/f53 [1710368,34679] 0 2023-12-16T05:56:40.822 INFO:tasks.workunit.client.1.smithi156.stdout:2/645: getdents d9/dd/d17/d33/d78/d39/d8c/da2/da6 0 2023-12-16T05:56:40.823 INFO:tasks.workunit.client.1.smithi156.stdout:7/828: dwrite d1e/d1f/d22/f25 [0,4194304] 0 2023-12-16T05:56:40.823 INFO:tasks.workunit.client.1.smithi156.stdout:7/829: stat d1e/d1f/da6/d57/l7c 0 2023-12-16T05:56:40.824 INFO:tasks.workunit.client.1.smithi156.stdout:7/830: fsync d1e/d1f/d72/fd9 0 2023-12-16T05:56:40.824 INFO:tasks.workunit.client.0.smithi155.stdout:8/852: sync 2023-12-16T05:56:40.824 INFO:tasks.workunit.client.0.smithi155.stdout:7/718: sync 2023-12-16T05:56:40.824 INFO:tasks.workunit.client.0.smithi155.stdout:3/563: sync 2023-12-16T05:56:40.832 INFO:tasks.workunit.client.1.smithi156.stdout:1/506: dwrite d3/d17/d4d/f56 [0,4194304] 0 2023-12-16T05:56:40.832 INFO:tasks.workunit.client.1.smithi156.stdout:3/554: mkdir dc/df/dce 0 2023-12-16T05:56:40.833 INFO:tasks.workunit.client.1.smithi156.stdout:8/462: dread d3/f29 [0,4194304] 0 2023-12-16T05:56:40.833 INFO:tasks.workunit.client.1.smithi156.stdout:4/582: mknod d9/d43/d58/d95/cc1 0 2023-12-16T05:56:40.833 INFO:tasks.workunit.client.0.smithi155.stdout:7/719: unlink d0/d6a/d1a/da0/fdc 0 2023-12-16T05:56:40.833 INFO:tasks.workunit.client.0.smithi155.stdout:7/720: write d0/d6a/d1a/d2b/d2c/d5d/f62 [4850930,113434] 0 2023-12-16T05:56:40.834 INFO:tasks.workunit.client.0.smithi155.stdout:3/564: truncate d0/d1e/f9f 2708532 0 2023-12-16T05:56:40.834 INFO:tasks.workunit.client.0.smithi155.stdout:3/565: fsync d0/d14/d36/f3d 0 2023-12-16T05:56:40.834 INFO:tasks.workunit.client.0.smithi155.stdout:3/566: truncate d0/fa9 1125021 0 2023-12-16T05:56:40.834 INFO:tasks.workunit.client.0.smithi155.stdout:8/853: mkdir d4/d62/d66/d78/d88/d1b/d1c/d19/da3/d11d 0 2023-12-16T05:56:40.834 INFO:tasks.workunit.client.0.smithi155.stdout:7/721: mknod d0/d6a/d1a/d8c/d34/d6c/cea 0 2023-12-16T05:56:40.835 INFO:tasks.workunit.client.0.smithi155.stdout:3/567: rename d0/f12 to d0/d14/d36/d7c/fac 0 2023-12-16T05:56:40.835 INFO:tasks.workunit.client.1.smithi156.stdout:5/784: mknod da/dc/d2d/d4d/db9/cff 0 2023-12-16T05:56:40.836 INFO:tasks.workunit.client.1.smithi156.stdout:5/785: chown da/dc/d2d/d9b 55994435 1 2023-12-16T05:56:40.836 INFO:tasks.workunit.client.1.smithi156.stdout:9/557: write d6/d2e/f7a [1378028,125140] 0 2023-12-16T05:56:40.836 INFO:tasks.workunit.client.1.smithi156.stdout:8/463: write d3/d7/d27/d46/d6e/f33 [29617,103454] 0 2023-12-16T05:56:40.836 INFO:tasks.workunit.client.0.smithi155.stdout:3/568: mknod d0/d14/d36/d47/da7/cad 0 2023-12-16T05:56:40.838 INFO:tasks.workunit.client.0.smithi155.stdout:3/569: creat d0/d14/d36/d83/fae x:0 0 0 2023-12-16T05:56:40.838 INFO:tasks.workunit.client.0.smithi155.stdout:8/854: creat d4/d62/d66/d78/d88/d1b/d5f/f11e x:0 0 0 2023-12-16T05:56:40.840 INFO:tasks.workunit.client.0.smithi155.stdout:8/855: creat d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/f11f x:0 0 0 2023-12-16T05:56:40.842 INFO:tasks.workunit.client.0.smithi155.stdout:8/856: mkdir d4/d62/d10c/d120 0 2023-12-16T05:56:40.843 INFO:tasks.workunit.client.1.smithi156.stdout:0/670: dwrite d2/d23/d4a/f8b [0,4194304] 0 2023-12-16T05:56:40.845 INFO:tasks.workunit.client.1.smithi156.stdout:2/646: unlink d9/dd/d17/d33/l32 0 2023-12-16T05:56:40.846 INFO:tasks.workunit.client.1.smithi156.stdout:2/647: stat d9/d68/f97 0 2023-12-16T05:56:40.846 INFO:tasks.workunit.client.1.smithi156.stdout:2/648: write d9/dd/d17/d33/d78/d39/d8c/da2/dad/fb8 [895058,3304] 0 2023-12-16T05:56:40.846 INFO:tasks.workunit.client.1.smithi156.stdout:2/649: write d9/dd/d17/d33/d78/d39/d8c/da2/da6/f6f [823041,108178] 0 2023-12-16T05:56:40.846 INFO:tasks.workunit.client.1.smithi156.stdout:2/650: write d9/d12/f36 [1105149,55587] 0 2023-12-16T05:56:40.846 INFO:tasks.workunit.client.1.smithi156.stdout:2/651: dread d9/dd/d17/f61 [0,4194304] 0 2023-12-16T05:56:40.847 INFO:tasks.workunit.client.1.smithi156.stdout:7/831: dwrite d1e/d1f/da6/d57/f86 [4194304,4194304] 0 2023-12-16T05:56:40.849 INFO:tasks.workunit.client.0.smithi155.stdout:7/722: dwrite d0/d1/d5/fbd [0,4194304] 0 2023-12-16T05:56:40.849 INFO:tasks.workunit.client.0.smithi155.stdout:7/723: fdatasync d0/d6a/d1a/d8c/d34/d4b/d64/fa4 0 2023-12-16T05:56:40.849 INFO:tasks.workunit.client.0.smithi155.stdout:7/724: fsync d0/d6a/d1a/d8c/d42/d98/f50 0 2023-12-16T05:56:40.849 INFO:tasks.workunit.client.0.smithi155.stdout:8/857: creat d4/d62/d66/d78/d88/d9e/f121 x:0 0 0 2023-12-16T05:56:40.849 INFO:tasks.workunit.client.0.smithi155.stdout:8/858: truncate d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/f104 45737 0 2023-12-16T05:56:40.852 INFO:tasks.workunit.client.0.smithi155.stdout:7/725: symlink d0/d6a/d1a/d2b/d2c/leb 0 2023-12-16T05:56:40.853 INFO:tasks.workunit.client.0.smithi155.stdout:8/859: write d4/d62/d66/d78/d88/d12/f94 [468505,83294] 0 2023-12-16T05:56:40.854 INFO:tasks.workunit.client.1.smithi156.stdout:2/652: dread d9/d12/f36 [0,4194304] 0 2023-12-16T05:56:40.855 INFO:tasks.workunit.client.0.smithi155.stdout:8/860: mknod d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/db7/c122 0 2023-12-16T05:56:40.856 INFO:tasks.workunit.client.1.smithi156.stdout:1/507: creat d3/d17/d19/fa6 x:0 0 0 2023-12-16T05:56:40.856 INFO:tasks.workunit.client.1.smithi156.stdout:1/508: chown d3/d1b/d8b/f9e 21 1 2023-12-16T05:56:40.856 INFO:tasks.workunit.client.0.smithi155.stdout:3/570: dwrite d0/d14/d36/fa6 [0,4194304] 0 2023-12-16T05:56:40.856 INFO:tasks.workunit.client.1.smithi156.stdout:3/555: creat dc/d10/d3d/db5/fcf x:0 0 0 2023-12-16T05:56:40.857 INFO:tasks.workunit.client.1.smithi156.stdout:4/583: mkdir d9/d2b/d9a/dc2 0 2023-12-16T05:56:40.857 INFO:tasks.workunit.client.0.smithi155.stdout:8/861: link d4/d62/d66/d78/d88/d1b/d2a/d51/c98 d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/db7/c123 0 2023-12-16T05:56:40.858 INFO:tasks.workunit.client.1.smithi156.stdout:5/786: rmdir da/d46 39 2023-12-16T05:56:40.858 INFO:tasks.workunit.client.1.smithi156.stdout:5/787: chown da/d46/fb5 22 1 2023-12-16T05:56:40.860 INFO:tasks.workunit.client.1.smithi156.stdout:9/558: symlink d6/d19/d30/d48/d87/d65/lbd 0 2023-12-16T05:56:40.861 INFO:tasks.workunit.client.0.smithi155.stdout:8/862: unlink d4/d62/d66/d78/d88/d1b/d1c/d1a/lf6 0 2023-12-16T05:56:40.861 INFO:tasks.workunit.client.0.smithi155.stdout:8/863: chown d4/d62/d66/d78/d88/d1b/d1c/d1a/fd1 1431582 1 2023-12-16T05:56:40.862 INFO:tasks.workunit.client.1.smithi156.stdout:8/464: creat d3/d12/d16/d54/f99 x:0 0 0 2023-12-16T05:56:40.865 INFO:tasks.workunit.client.1.smithi156.stdout:0/671: mkdir d2/d7/dd/d29/d38/d51/d52/d88/dbc/dd2 0 2023-12-16T05:56:40.866 INFO:tasks.workunit.client.1.smithi156.stdout:0/672: write d2/d7/dd/d2d/dcf/f99 [569032,44380] 0 2023-12-16T05:56:40.866 INFO:tasks.workunit.client.1.smithi156.stdout:0/673: getdents d2/d7 0 2023-12-16T05:56:40.867 INFO:tasks.workunit.client.1.smithi156.stdout:7/832: creat d1e/d55/db6/f123 x:0 0 0 2023-12-16T05:56:40.867 INFO:tasks.workunit.client.1.smithi156.stdout:0/674: write d2/d7/dd/d29/d2e/f57 [1248600,51786] 0 2023-12-16T05:56:40.869 INFO:tasks.workunit.client.1.smithi156.stdout:2/653: mknod d9/d68/daa/db4/cd1 0 2023-12-16T05:56:40.871 INFO:tasks.workunit.client.1.smithi156.stdout:1/509: link d3/d17/d19/l45 d3/d17/d2d/la7 0 2023-12-16T05:56:40.876 INFO:tasks.workunit.client.1.smithi156.stdout:3/556: rename dc/d10/d1d/l20 to dc/df/d34/d62/d75/ld0 0 2023-12-16T05:56:40.876 INFO:tasks.workunit.client.1.smithi156.stdout:3/557: write dc/df/d66/f8f [79751,107792] 0 2023-12-16T05:56:40.877 INFO:tasks.workunit.client.1.smithi156.stdout:4/584: creat d9/d2b/d98/d99/fc3 x:0 0 0 2023-12-16T05:56:40.881 INFO:tasks.workunit.client.1.smithi156.stdout:5/788: creat da/dc/d4b/d6c/d7c/f100 x:0 0 0 2023-12-16T05:56:40.881 INFO:tasks.workunit.client.1.smithi156.stdout:9/559: creat d6/d2e/fbe x:0 0 0 2023-12-16T05:56:40.882 INFO:tasks.workunit.client.1.smithi156.stdout:8/465: link d3/d12/d16/d54/f99 d3/d7a/f9a 0 2023-12-16T05:56:40.885 INFO:tasks.workunit.client.1.smithi156.stdout:0/675: creat d2/d7/dd/d29/d4b/fd3 x:0 0 0 2023-12-16T05:56:40.885 INFO:tasks.workunit.client.1.smithi156.stdout:0/676: stat d2/d23/d55/fc7 0 2023-12-16T05:56:40.886 INFO:tasks.workunit.client.1.smithi156.stdout:2/654: mknod d9/d68/daa/d83/da1/d96/dca/cd2 0 2023-12-16T05:56:40.888 INFO:tasks.workunit.client.1.smithi156.stdout:2/655: write d9/dd/f1b [3533825,110478] 0 2023-12-16T05:56:40.889 INFO:tasks.workunit.client.1.smithi156.stdout:1/510: rmdir d3/d1b/d27/d4f/d75 39 2023-12-16T05:56:40.890 INFO:tasks.workunit.client.1.smithi156.stdout:9/560: dread d6/d19/f1f [0,4194304] 0 2023-12-16T05:56:40.892 INFO:tasks.workunit.client.1.smithi156.stdout:5/789: rmdir da/dc/d4b/d6c/d77 39 2023-12-16T05:56:40.892 INFO:tasks.workunit.client.1.smithi156.stdout:4/585: truncate d9/f19 3218568 0 2023-12-16T05:56:40.894 INFO:tasks.workunit.client.1.smithi156.stdout:0/677: unlink d2/d7/dd/d29/d38/d51/d52/d88/f9e 0 2023-12-16T05:56:40.894 INFO:tasks.workunit.client.1.smithi156.stdout:0/678: chown d2/d7/dd/d29/d4b 47 1 2023-12-16T05:56:40.895 INFO:tasks.workunit.client.0.smithi155.stdout:3/571: dwrite d0/d1e/f9f [0,4194304] 0 2023-12-16T05:56:40.895 INFO:tasks.workunit.client.0.smithi155.stdout:3/572: chown d0/d14/d36/d47/d5f/d9a 980161952 1 2023-12-16T05:56:40.896 INFO:tasks.workunit.client.1.smithi156.stdout:2/656: rmdir d9/dd/d17/d33/d78/d39/d8c/da2/dad 39 2023-12-16T05:56:40.896 INFO:tasks.workunit.client.0.smithi155.stdout:3/573: rmdir d0/d1e/d4e 39 2023-12-16T05:56:40.897 INFO:tasks.workunit.client.1.smithi156.stdout:1/511: rename d3/d1b/d8b/c9c to d3/d1b/d27/d4f/ca8 0 2023-12-16T05:56:40.897 INFO:tasks.workunit.client.1.smithi156.stdout:1/512: write d3/d17/d19/f7b [831368,7953] 0 2023-12-16T05:56:40.898 INFO:tasks.workunit.client.0.smithi155.stdout:3/574: creat d0/d14/d87/d94/da1/d73/faf x:0 0 0 2023-12-16T05:56:40.898 INFO:tasks.workunit.client.0.smithi155.stdout:3/575: truncate d0/d14/d36/d47/d5f/f7d 1280474 0 2023-12-16T05:56:40.898 INFO:tasks.workunit.client.0.smithi155.stdout:3/576: fsync d0/f11 0 2023-12-16T05:56:40.899 INFO:tasks.workunit.client.1.smithi156.stdout:1/513: dread d3/d1b/f37 [0,4194304] 0 2023-12-16T05:56:40.899 INFO:tasks.workunit.client.1.smithi156.stdout:1/514: chown d3/d17/d19/fa6 490 1 2023-12-16T05:56:40.899 INFO:tasks.workunit.client.1.smithi156.stdout:9/561: creat d6/d19/d25/fbf x:0 0 0 2023-12-16T05:56:40.900 INFO:tasks.workunit.client.1.smithi156.stdout:5/790: mkdir da/dc/d4b/d6c/d81/dc5/deb/d101 0 2023-12-16T05:56:40.902 INFO:tasks.workunit.client.1.smithi156.stdout:0/679: creat d2/d7/dd/d29/fd4 x:0 0 0 2023-12-16T05:56:40.904 INFO:tasks.workunit.client.1.smithi156.stdout:2/657: getdents d9/dd/d17/d33/d47 0 2023-12-16T05:56:40.906 INFO:tasks.workunit.client.0.smithi155.stdout:8/864: dwrite d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/f104 [0,4194304] 0 2023-12-16T05:56:40.908 INFO:tasks.workunit.client.0.smithi155.stdout:8/865: creat d4/d62/d10c/f124 x:0 0 0 2023-12-16T05:56:40.909 INFO:tasks.workunit.client.1.smithi156.stdout:7/833: dwrite d1e/d1f/da6/d10d/f112 [0,4194304] 0 2023-12-16T05:56:40.909 INFO:tasks.workunit.client.1.smithi156.stdout:3/558: dwrite dc/d10/d1d/f3a [0,4194304] 0 2023-12-16T05:56:40.909 INFO:tasks.workunit.client.1.smithi156.stdout:3/559: fsync dc/d10/d1d/d4b/fa7 0 2023-12-16T05:56:40.910 INFO:tasks.workunit.client.1.smithi156.stdout:1/515: mkdir d3/d3a/da9 0 2023-12-16T05:56:40.911 INFO:tasks.workunit.client.1.smithi156.stdout:9/562: mkdir d6/d19/d25/d3a/d80/dc0 0 2023-12-16T05:56:40.912 INFO:tasks.workunit.client.1.smithi156.stdout:5/791: symlink da/dc/d2d/l102 0 2023-12-16T05:56:40.913 INFO:tasks.workunit.client.1.smithi156.stdout:2/658: mknod d9/d68/cd3 0 2023-12-16T05:56:40.914 INFO:tasks.workunit.client.1.smithi156.stdout:7/834: dread d1e/d55/d71/d61/daa/f6f [0,4194304] 0 2023-12-16T05:56:40.924 INFO:tasks.workunit.client.1.smithi156.stdout:4/586: getdents d9/d2b/d98/d99 0 2023-12-16T05:56:40.935 INFO:tasks.workunit.client.0.smithi155.stdout:8/866: dwrite d4/d62/d66/d78/d88/d1b/f61 [0,4194304] 0 2023-12-16T05:56:40.936 INFO:tasks.workunit.client.1.smithi156.stdout:1/516: mkdir d3/d17/daa 0 2023-12-16T05:56:40.939 INFO:tasks.workunit.client.1.smithi156.stdout:5/792: rename da/dc/d2d/f58 to da/dc/d4b/d6c/d7c/d85/f103 0 2023-12-16T05:56:40.939 INFO:tasks.workunit.client.1.smithi156.stdout:2/659: truncate d9/dd/d17/d33/db5/f81 2329584 0 2023-12-16T05:56:40.941 INFO:tasks.workunit.client.1.smithi156.stdout:2/660: write d9/d12/f36 [382661,40385] 0 2023-12-16T05:56:40.941 INFO:tasks.workunit.client.1.smithi156.stdout:8/466: truncate d3/d7/d27/d46/d6e/f33 3073621 0 2023-12-16T05:56:40.942 INFO:tasks.workunit.client.1.smithi156.stdout:1/517: unlink d3/d1b/d27/d4f/d75/f7d 0 2023-12-16T05:56:40.945 INFO:tasks.workunit.client.0.smithi155.stdout:0/917: sync 2023-12-16T05:56:40.946 INFO:tasks.workunit.client.1.smithi156.stdout:8/467: rename d3/d6/d83/d8f to d3/d7/d27/d46/d84/d85/d9b 0 2023-12-16T05:56:40.946 INFO:tasks.workunit.client.1.smithi156.stdout:3/560: dwrite dc/d10/d1d/d4b/fa7 [0,4194304] 0 2023-12-16T05:56:40.947 INFO:tasks.workunit.client.0.smithi155.stdout:0/918: link d7/d2d/lf4 d7/df/d73/df8/l12c 0 2023-12-16T05:56:40.948 INFO:tasks.workunit.client.1.smithi156.stdout:1/518: getdents d3/d1b 0 2023-12-16T05:56:40.948 INFO:tasks.workunit.client.1.smithi156.stdout:2/661: write d9/dd/d17/f1d [3814846,28719] 0 2023-12-16T05:56:40.949 INFO:tasks.workunit.client.1.smithi156.stdout:0/680: dwrite d2/d23/d4a/fa3 [0,4194304] 0 2023-12-16T05:56:40.950 INFO:tasks.workunit.client.0.smithi155.stdout:0/919: creat d7/df/d73/d8d/d4d/d115/d5d/f12d x:0 0 0 2023-12-16T05:56:40.950 INFO:tasks.workunit.client.0.smithi155.stdout:3/577: dwrite d0/d14/f35 [0,4194304] 0 2023-12-16T05:56:40.950 INFO:tasks.workunit.client.1.smithi156.stdout:9/563: dwrite d6/d19/d25/f6f [0,4194304] 0 2023-12-16T05:56:40.950 INFO:tasks.workunit.client.1.smithi156.stdout:7/835: dwrite d1e/d55/f7e [0,4194304] 0 2023-12-16T05:56:40.950 INFO:tasks.workunit.client.0.smithi155.stdout:0/920: truncate d7/df/f9a 3950652 0 2023-12-16T05:56:40.951 INFO:tasks.workunit.client.1.smithi156.stdout:5/793: dread da/f14 [0,4194304] 0 2023-12-16T05:56:40.951 INFO:tasks.workunit.client.1.smithi156.stdout:2/662: dread d9/d12/f36 [0,4194304] 0 2023-12-16T05:56:40.951 INFO:tasks.workunit.client.1.smithi156.stdout:2/663: chown d9/dd/d17/d8f/cab 330 1 2023-12-16T05:56:40.952 INFO:tasks.workunit.client.1.smithi156.stdout:2/664: chown d9/dd/d17/d33/d78/d39/d8c/da2/da6/d80/f85 305643412 1 2023-12-16T05:56:40.957 INFO:tasks.workunit.client.0.smithi155.stdout:8/867: dwrite d4/d62/d66/d78/d88/d1b/d1c/d97/fd7 [0,4194304] 0 2023-12-16T05:56:40.958 INFO:tasks.workunit.client.1.smithi156.stdout:9/564: symlink d6/d19/d30/dae/db7/lc1 0 2023-12-16T05:56:40.959 INFO:tasks.workunit.client.1.smithi156.stdout:9/565: write d6/d19/d25/d3a/d80/f96 [149422,93125] 0 2023-12-16T05:56:40.960 INFO:tasks.workunit.client.1.smithi156.stdout:3/561: dread dc/d56/f83 [0,4194304] 0 2023-12-16T05:56:40.960 INFO:tasks.workunit.client.1.smithi156.stdout:7/836: creat d1e/d1f/d22/d75/f124 x:0 0 0 2023-12-16T05:56:40.962 INFO:tasks.workunit.client.1.smithi156.stdout:5/794: creat da/dc/de2/f104 x:0 0 0 2023-12-16T05:56:40.963 INFO:tasks.workunit.client.0.smithi155.stdout:8/868: write d4/d62/d66/d78/d88/d1b/f20 [2172456,104033] 0 2023-12-16T05:56:40.963 INFO:tasks.workunit.client.1.smithi156.stdout:2/665: getdents d9/d68 0 2023-12-16T05:56:40.963 INFO:tasks.workunit.client.0.smithi155.stdout:3/578: dread d0/d1a/d33/d57/f63 [0,4194304] 0 2023-12-16T05:56:40.964 INFO:tasks.workunit.client.1.smithi156.stdout:0/681: symlink d2/d7/dd/d2d/d5e/dc4/ld5 0 2023-12-16T05:56:40.967 INFO:tasks.workunit.client.1.smithi156.stdout:2/666: mkdir d9/dd/d17/d33/d78/d39/d8c/db2/dd4 0 2023-12-16T05:56:40.967 INFO:tasks.workunit.client.1.smithi156.stdout:9/566: dread d6/d19/d25/d3a/d5e/f68 [0,4194304] 0 2023-12-16T05:56:40.968 INFO:tasks.workunit.client.0.smithi155.stdout:8/869: write d4/d62/d66/d78/d88/d1b/f61 [1304952,76859] 0 2023-12-16T05:56:40.969 INFO:tasks.workunit.client.1.smithi156.stdout:0/682: creat d2/d7/dd/fd6 x:0 0 0 2023-12-16T05:56:40.969 INFO:tasks.workunit.client.1.smithi156.stdout:0/683: write d2/d23/d4a/fc1 [636543,53341] 0 2023-12-16T05:56:40.969 INFO:tasks.workunit.client.0.smithi155.stdout:8/870: symlink d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/d11b/l125 0 2023-12-16T05:56:40.971 INFO:tasks.workunit.client.1.smithi156.stdout:3/562: dread dc/d10/f82 [0,4194304] 0 2023-12-16T05:56:40.972 INFO:tasks.workunit.client.1.smithi156.stdout:2/667: rename d9/dd/f8a to d9/dd/d17/d33/d78/d39/d8c/db2/dd4/fd5 0 2023-12-16T05:56:40.973 INFO:tasks.workunit.client.0.smithi155.stdout:8/871: read d4/d62/d66/d78/d88/d1b/d1c/d97/f8c [694509,124028] 0 2023-12-16T05:56:40.973 INFO:tasks.workunit.client.0.smithi155.stdout:8/872: stat d4/d62/d66/d78/d88/d12/c43 0 2023-12-16T05:56:40.974 INFO:tasks.workunit.client.0.smithi155.stdout:8/873: read d4/d62/d66/d78/d88/d1b/d1c/d97/fd7 [3650348,3937] 0 2023-12-16T05:56:40.974 INFO:tasks.workunit.client.0.smithi155.stdout:8/874: stat d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d103 0 2023-12-16T05:56:40.974 INFO:tasks.workunit.client.1.smithi156.stdout:9/567: creat d6/d19/d25/fc2 x:0 0 0 2023-12-16T05:56:40.977 INFO:tasks.workunit.client.0.smithi155.stdout:8/875: rename d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/db7/cd5 to d4/d62/d66/d78/d88/d12/c126 0 2023-12-16T05:56:40.977 INFO:tasks.workunit.client.1.smithi156.stdout:3/563: link dc/df/f2e dc/d56/d67/d6e/fd1 0 2023-12-16T05:56:40.977 INFO:tasks.workunit.client.1.smithi156.stdout:1/519: dwrite d3/d1b/f37 [0,4194304] 0 2023-12-16T05:56:40.978 INFO:tasks.workunit.client.0.smithi155.stdout:3/579: dread d0/d14/d45/f54 [0,4194304] 0 2023-12-16T05:56:40.978 INFO:tasks.workunit.client.0.smithi155.stdout:3/580: chown d0/d14/d36/d47/d5f/c86 186 1 2023-12-16T05:56:40.978 INFO:tasks.workunit.client.1.smithi156.stdout:0/684: write d2/f24 [4140282,7006] 0 2023-12-16T05:56:40.978 INFO:tasks.workunit.client.1.smithi156.stdout:9/568: truncate d6/d19/d30/f44 3460009 0 2023-12-16T05:56:40.979 INFO:tasks.workunit.client.0.smithi155.stdout:3/581: dread d0/f7f [0,4194304] 0 2023-12-16T05:56:40.979 INFO:tasks.workunit.client.1.smithi156.stdout:6/633: sync 2023-12-16T05:56:40.981 INFO:tasks.workunit.client.1.smithi156.stdout:6/634: write d9/d13/d2f/d51/d82/d89/f92 [117138,77063] 0 2023-12-16T05:56:40.982 INFO:tasks.workunit.client.0.smithi155.stdout:8/876: rmdir d4/d62/d66/d78/d88/d1b/d1c/d97/df3/df5/d106 0 2023-12-16T05:56:40.982 INFO:tasks.workunit.client.1.smithi156.stdout:6/635: read d9/f35 [7151814,49665] 0 2023-12-16T05:56:40.983 INFO:tasks.workunit.client.1.smithi156.stdout:3/564: creat dc/df/dce/fd2 x:0 0 0 2023-12-16T05:56:40.983 INFO:tasks.workunit.client.1.smithi156.stdout:3/565: chown dc 14 1 2023-12-16T05:56:40.983 INFO:tasks.workunit.client.0.smithi155.stdout:3/582: mknod d0/d14/cb0 0 2023-12-16T05:56:40.984 INFO:tasks.workunit.client.0.smithi155.stdout:3/583: creat d0/d1e/d4e/fb1 x:0 0 0 2023-12-16T05:56:40.985 INFO:tasks.workunit.client.1.smithi156.stdout:1/520: rename d3/d17/d4d/f7c to d3/d17/d2d/fab 0 2023-12-16T05:56:40.985 INFO:tasks.workunit.client.1.smithi156.stdout:5/795: dread da/dc/f21 [0,4194304] 0 2023-12-16T05:56:40.985 INFO:tasks.workunit.client.0.smithi155.stdout:3/584: creat d0/d1e/d4e/fb2 x:0 0 0 2023-12-16T05:56:40.986 INFO:tasks.workunit.client.0.smithi155.stdout:3/585: mkdir d0/d14/d87/d94/da1/db3 0 2023-12-16T05:56:40.988 INFO:tasks.workunit.client.0.smithi155.stdout:3/586: rename d0/d1e/d4e/fb2 to d0/d14/d87/d94/da1/fb4 0 2023-12-16T05:56:40.989 INFO:tasks.workunit.client.1.smithi156.stdout:0/685: symlink d2/d7/dd/d29/d4b/dc0/ld7 0 2023-12-16T05:56:40.989 INFO:tasks.workunit.client.1.smithi156.stdout:0/686: readlink d2/d7/dd/d29/d4b/dc0/ld7 0 2023-12-16T05:56:40.990 INFO:tasks.workunit.client.0.smithi155.stdout:3/587: read d0/d1a/d33/d57/f63 [1937341,9722] 0 2023-12-16T05:56:40.990 INFO:tasks.workunit.client.1.smithi156.stdout:3/566: stat dc/d56/c93 0 2023-12-16T05:56:40.993 INFO:tasks.workunit.client.1.smithi156.stdout:9/569: rename d6/d19/d25/d3a/d88/d8b/dac/db8 to d6/d19/d25/d3a/dc3 0 2023-12-16T05:56:40.997 INFO:tasks.workunit.client.1.smithi156.stdout:0/687: dread d2/d7/dd/d29/d38/d3f/f58 [0,4194304] 0 2023-12-16T05:56:40.999 INFO:tasks.workunit.client.1.smithi156.stdout:3/567: truncate dc/d56/d67/d6e/f81 4111882 0 2023-12-16T05:56:41.001 INFO:tasks.workunit.client.1.smithi156.stdout:9/570: truncate d6/d19/d30/d48/d87/d65/fa8 73627 0 2023-12-16T05:56:41.001 INFO:tasks.workunit.client.1.smithi156.stdout:5/796: getdents da/dc/de2 0 2023-12-16T05:56:41.003 INFO:tasks.workunit.client.0.smithi155.stdout:3/588: dread d0/d14/f35 [0,4194304] 0 2023-12-16T05:56:41.003 INFO:tasks.workunit.client.1.smithi156.stdout:6/636: dwrite d9/d1c/f3a [0,4194304] 0 2023-12-16T05:56:41.004 INFO:tasks.workunit.client.1.smithi156.stdout:2/668: dwrite d9/dd/d17/f3a [0,4194304] 0 2023-12-16T05:56:41.004 INFO:tasks.workunit.client.0.smithi155.stdout:8/877: dwrite d4/d62/d66/fbd [0,4194304] 0 2023-12-16T05:56:41.004 INFO:tasks.workunit.client.0.smithi155.stdout:8/878: write d4/d62/d66/d78/d88/d1b/d1c/d19/f73 [1357556,28740] 0 2023-12-16T05:56:41.004 INFO:tasks.workunit.client.1.smithi156.stdout:1/521: rename d3/fb to d3/d1b/d27/d4f/fac 0 2023-12-16T05:56:41.006 INFO:tasks.workunit.client.0.smithi155.stdout:3/589: read d0/d1a/d33/d57/f6c [608586,45350] 0 2023-12-16T05:56:41.006 INFO:tasks.workunit.client.0.smithi155.stdout:3/590: write d0/d14/d87/d94/da1/d73/f84 [1699098,4169] 0 2023-12-16T05:56:41.006 INFO:tasks.workunit.client.0.smithi155.stdout:3/591: readlink d0/d14/d36/d47/l92 0 2023-12-16T05:56:41.006 INFO:tasks.workunit.client.0.smithi155.stdout:8/879: mkdir d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/d127 0 2023-12-16T05:56:41.006 INFO:tasks.workunit.client.0.smithi155.stdout:8/880: chown d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/db7/c122 10184946 1 2023-12-16T05:56:41.006 INFO:tasks.workunit.client.0.smithi155.stdout:8/881: write d4/fe1 [659762,116313] 0 2023-12-16T05:56:41.007 INFO:tasks.workunit.client.1.smithi156.stdout:9/571: write d6/d19/f2a [3466334,86417] 0 2023-12-16T05:56:41.007 INFO:tasks.workunit.client.1.smithi156.stdout:9/572: chown d6/d19/d25/l2b 36148368 1 2023-12-16T05:56:41.007 INFO:tasks.workunit.client.0.smithi155.stdout:3/592: rmdir d0/d1a/d33/d57 39 2023-12-16T05:56:41.007 INFO:tasks.workunit.client.0.smithi155.stdout:3/593: readlink d0/d14/d87/d94/da1/l8c 0 2023-12-16T05:56:41.008 INFO:tasks.workunit.client.1.smithi156.stdout:0/688: symlink d2/d7/dd/d29/d38/d51/d65/ld8 0 2023-12-16T05:56:41.008 INFO:tasks.workunit.client.1.smithi156.stdout:0/689: stat d2/d23/d4a/fc1 0 2023-12-16T05:56:41.008 INFO:tasks.workunit.client.1.smithi156.stdout:3/568: creat dc/fd3 x:0 0 0 2023-12-16T05:56:41.009 INFO:tasks.workunit.client.1.smithi156.stdout:3/569: read dc/f14 [5156524,110014] 0 2023-12-16T05:56:41.010 INFO:tasks.workunit.client.0.smithi155.stdout:3/594: symlink d0/d1a/d33/d57/lb5 0 2023-12-16T05:56:41.010 INFO:tasks.workunit.client.0.smithi155.stdout:3/595: fsync d0/d1e/f49 0 2023-12-16T05:56:41.011 INFO:tasks.workunit.client.1.smithi156.stdout:5/797: creat da/dc/d2d/d4d/d54/d67/f105 x:0 0 0 2023-12-16T05:56:41.011 INFO:tasks.workunit.client.0.smithi155.stdout:3/596: write d0/d14/d51/f4a [150138,43059] 0 2023-12-16T05:56:41.011 INFO:tasks.workunit.client.0.smithi155.stdout:3/597: chown d0/d1a/d33/d57/f63 0 1 2023-12-16T05:56:41.011 INFO:tasks.workunit.client.0.smithi155.stdout:3/598: fsync d0/d14/d36/f82 0 2023-12-16T05:56:41.012 INFO:tasks.workunit.client.1.smithi156.stdout:6/637: rmdir d9/d13/d2f/d51/d69 39 2023-12-16T05:56:41.013 INFO:tasks.workunit.client.1.smithi156.stdout:1/522: dread d3/d17/d1c/d22/f6a [0,4194304] 0 2023-12-16T05:56:41.013 INFO:tasks.workunit.client.1.smithi156.stdout:1/523: write d3/d17/d2d/f86 [1662238,43902] 0 2023-12-16T05:56:41.017 INFO:tasks.workunit.client.1.smithi156.stdout:2/669: symlink d9/d68/daa/ld6 0 2023-12-16T05:56:41.026 INFO:tasks.workunit.client.1.smithi156.stdout:9/573: chown d6/d2e/l76 777 1 2023-12-16T05:56:41.026 INFO:tasks.workunit.client.1.smithi156.stdout:9/574: write d6/d19/d30/d48/d87/f70 [83217,31008] 0 2023-12-16T05:56:41.027 INFO:tasks.workunit.client.1.smithi156.stdout:0/690: symlink d2/d7/dd/d29/d38/dae/ld9 0 2023-12-16T05:56:41.027 INFO:tasks.workunit.client.1.smithi156.stdout:0/691: read d2/d23/f70 [222400,41832] 0 2023-12-16T05:56:41.028 INFO:tasks.workunit.client.1.smithi156.stdout:5/798: creat da/dc/d4b/d6c/d81/dc5/deb/d101/f106 x:0 0 0 2023-12-16T05:56:41.028 INFO:tasks.workunit.client.1.smithi156.stdout:5/799: dread - da/dc/d4b/d6c/d81/dc5/fed zero size 2023-12-16T05:56:41.029 INFO:tasks.workunit.client.1.smithi156.stdout:2/670: creat d9/dd/d17/fd7 x:0 0 0 2023-12-16T05:56:41.031 INFO:tasks.workunit.client.1.smithi156.stdout:9/575: chown d6/l23 50 1 2023-12-16T05:56:41.032 INFO:tasks.workunit.client.1.smithi156.stdout:3/570: dwrite f8 [0,4194304] 0 2023-12-16T05:56:41.034 INFO:tasks.workunit.client.1.smithi156.stdout:5/800: creat da/dc/d2d/d4d/d54/d67/f107 x:0 0 0 2023-12-16T05:56:41.035 INFO:tasks.workunit.client.0.smithi155.stdout:3/599: dwrite d0/f7f [0,4194304] 0 2023-12-16T05:56:41.035 INFO:tasks.workunit.client.1.smithi156.stdout:6/638: dwrite d9/d13/d2f/d51/f90 [0,4194304] 0 2023-12-16T05:56:41.035 INFO:tasks.workunit.client.1.smithi156.stdout:6/639: getdents d9/d13/d2f/d51/d69/d99/db9 0 2023-12-16T05:56:41.039 INFO:tasks.workunit.client.1.smithi156.stdout:2/671: rename d9/dd/d17/d33/d78/d39/d8c/da2 to d9/d12/dc2/dd8 0 2023-12-16T05:56:41.044 INFO:tasks.workunit.client.1.smithi156.stdout:5/801: unlink da/dc/d2d/d4d/db9/cff 0 2023-12-16T05:56:41.046 INFO:tasks.workunit.client.0.smithi155.stdout:3/600: dread d0/f10 [4194304,4194304] 0 2023-12-16T05:56:41.046 INFO:tasks.workunit.client.1.smithi156.stdout:0/692: dread d2/d7/dd/d29/d2e/f57 [0,4194304] 0 2023-12-16T05:56:41.046 INFO:tasks.workunit.client.1.smithi156.stdout:2/672: symlink d9/dd/d17/d33/d78/ld9 0 2023-12-16T05:56:41.047 INFO:tasks.workunit.client.0.smithi155.stdout:3/601: mkdir d0/d1e/d4e/db6 0 2023-12-16T05:56:41.048 INFO:tasks.workunit.client.0.smithi155.stdout:3/602: read d0/d1e/f20 [4052274,4200] 0 2023-12-16T05:56:41.048 INFO:tasks.workunit.client.1.smithi156.stdout:5/802: symlink da/dc/d2d/d34/l108 0 2023-12-16T05:56:41.049 INFO:tasks.workunit.client.1.smithi156.stdout:2/673: symlink d9/d12/dc2/lda 0 2023-12-16T05:56:41.053 INFO:tasks.workunit.client.1.smithi156.stdout:3/571: dwrite dc/fb7 [0,4194304] 0 2023-12-16T05:56:41.053 INFO:tasks.workunit.client.0.smithi155.stdout:3/603: write d0/d1e/f68 [1287065,102806] 0 2023-12-16T05:56:41.053 INFO:tasks.workunit.client.0.smithi155.stdout:3/604: fdatasync d0/d1a/f1d 0 2023-12-16T05:56:41.057 INFO:tasks.workunit.client.1.smithi156.stdout:3/572: symlink dc/d10/d1d/d4b/dac/ld4 0 2023-12-16T05:56:41.059 INFO:tasks.workunit.client.1.smithi156.stdout:3/573: getdents dc/df/d34/d62 0 2023-12-16T05:56:41.059 INFO:tasks.workunit.client.0.smithi155.stdout:3/605: unlink d0/d1e/f2b 0 2023-12-16T05:56:41.060 INFO:tasks.workunit.client.1.smithi156.stdout:6/640: dwrite d9/f11 [0,4194304] 0 2023-12-16T05:56:41.060 INFO:tasks.workunit.client.1.smithi156.stdout:3/574: symlink dc/d10/d3d/d4e/ld5 0 2023-12-16T05:56:41.060 INFO:tasks.workunit.client.1.smithi156.stdout:3/575: dread - dc/df/dce/fd2 zero size 2023-12-16T05:56:41.061 INFO:tasks.workunit.client.0.smithi155.stdout:3/606: creat d0/d1a/d33/fb7 x:0 0 0 2023-12-16T05:56:41.061 INFO:tasks.workunit.client.0.smithi155.stdout:3/607: chown d0/f7f 940207960 1 2023-12-16T05:56:41.063 INFO:tasks.workunit.client.0.smithi155.stdout:3/608: creat d0/d14/fb8 x:0 0 0 2023-12-16T05:56:41.063 INFO:tasks.workunit.client.0.smithi155.stdout:3/609: stat d0/d14/c3f 0 2023-12-16T05:56:41.064 INFO:tasks.workunit.client.1.smithi156.stdout:6/641: link d9/d1c/l33 d9/d13/d2f/d51/d69/d99/lc1 0 2023-12-16T05:56:41.065 INFO:tasks.workunit.client.1.smithi156.stdout:9/576: dwrite d6/d2e/d8a/da5/fb1 [0,4194304] 0 2023-12-16T05:56:41.068 INFO:tasks.workunit.client.1.smithi156.stdout:0/693: dwrite d2/d7/dd/d2d/dcf/f99 [0,4194304] 0 2023-12-16T05:56:41.068 INFO:tasks.workunit.client.1.smithi156.stdout:0/694: stat d2/d7/dd/d29/d38/d51/d65 0 2023-12-16T05:56:41.069 INFO:tasks.workunit.client.0.smithi155.stdout:3/610: dread d0/f11 [0,4194304] 0 2023-12-16T05:56:41.069 INFO:tasks.workunit.client.1.smithi156.stdout:5/803: dwrite da/dc/f2e [0,4194304] 0 2023-12-16T05:56:41.070 INFO:tasks.workunit.client.1.smithi156.stdout:9/577: symlink d6/d19/d30/d48/d87/d65/lc4 0 2023-12-16T05:56:41.070 INFO:tasks.workunit.client.1.smithi156.stdout:9/578: fsync d6/d19/d30/f3f 0 2023-12-16T05:56:41.071 INFO:tasks.workunit.client.0.smithi155.stdout:3/611: getdents d0/d14/d45 0 2023-12-16T05:56:41.073 INFO:tasks.workunit.client.0.smithi155.stdout:3/612: mknod d0/d14/d87/d94/cb9 0 2023-12-16T05:56:41.079 INFO:tasks.workunit.client.1.smithi156.stdout:0/695: symlink d2/d7/dd/d2d/d5e/d8f/lda 0 2023-12-16T05:56:41.079 INFO:tasks.workunit.client.1.smithi156.stdout:5/804: mknod da/dc/d2d/d4d/db9/dc9/dfa/c109 0 2023-12-16T05:56:41.079 INFO:tasks.workunit.client.1.smithi156.stdout:5/805: fsync da/dc/d2d/d34/fda 0 2023-12-16T05:56:41.081 INFO:tasks.workunit.client.1.smithi156.stdout:9/579: creat d6/d2e/fc5 x:0 0 0 2023-12-16T05:56:41.081 INFO:tasks.workunit.client.1.smithi156.stdout:9/580: write d6/d19/f56 [343631,9638] 0 2023-12-16T05:56:41.084 INFO:tasks.workunit.client.1.smithi156.stdout:0/696: mkdir d2/d7/ddb 0 2023-12-16T05:56:41.085 INFO:tasks.workunit.client.0.smithi155.stdout:3/613: dread d0/d1a/f1d [0,4194304] 0 2023-12-16T05:56:41.085 INFO:tasks.workunit.client.0.smithi155.stdout:3/614: write d0/d14/d87/d94/da1/f7a [213518,90716] 0 2023-12-16T05:56:41.085 INFO:tasks.workunit.client.1.smithi156.stdout:5/806: truncate da/dc/d4b/d6c/d81/f83 3889685 0 2023-12-16T05:56:41.085 INFO:tasks.workunit.client.1.smithi156.stdout:5/807: truncate da/dc/d2d/d4d/d54/d90/fab 4752852 0 2023-12-16T05:56:41.089 INFO:tasks.workunit.client.1.smithi156.stdout:0/697: getdents d2/d7/dd/d2d/dcf 0 2023-12-16T05:56:41.089 INFO:tasks.workunit.client.1.smithi156.stdout:5/808: write da/dc/d2d/f41 [3147347,33139] 0 2023-12-16T05:56:41.090 INFO:tasks.workunit.client.1.smithi156.stdout:6/642: dwrite d9/d13/d2f/d51/d82/f94 [0,4194304] 0 2023-12-16T05:56:41.094 INFO:tasks.workunit.client.1.smithi156.stdout:6/643: rename d9/d13/d3e/f6c to d9/d13/d2f/d51/d82/fc2 0 2023-12-16T05:56:41.094 INFO:tasks.workunit.client.1.smithi156.stdout:6/644: chown d9/d13/d2f/d51/d69/d99/la5 318 1 2023-12-16T05:56:41.097 INFO:tasks.workunit.client.1.smithi156.stdout:9/581: dwrite d6/d19/d25/d3a/d5e/f7b [0,4194304] 0 2023-12-16T05:56:41.100 INFO:tasks.workunit.client.1.smithi156.stdout:9/582: creat d6/d19/d30/dae/fc6 x:0 0 0 2023-12-16T05:56:41.101 INFO:tasks.workunit.client.1.smithi156.stdout:9/583: fdatasync d6/f98 0 2023-12-16T05:56:41.109 INFO:tasks.workunit.client.0.smithi155.stdout:3/615: dwrite d0/d14/d36/d47/d5f/f60 [0,4194304] 0 2023-12-16T05:56:41.111 INFO:tasks.workunit.client.0.smithi155.stdout:3/616: mkdir d0/d1a/d33/d57/dba 0 2023-12-16T05:56:41.114 INFO:tasks.workunit.client.0.smithi155.stdout:3/617: rename d0/d14/d36/f82 to d0/d14/d36/d47/d5f/fbb 0 2023-12-16T05:56:41.118 INFO:tasks.workunit.client.1.smithi156.stdout:0/698: dwrite d2/d23/d55/fce [0,4194304] 0 2023-12-16T05:56:41.118 INFO:tasks.workunit.client.1.smithi156.stdout:9/584: dread d6/d19/d30/f54 [0,4194304] 0 2023-12-16T05:56:41.118 INFO:tasks.workunit.client.1.smithi156.stdout:0/699: write d2/d23/d4a/fc1 [1329660,54969] 0 2023-12-16T05:56:41.118 INFO:tasks.workunit.client.1.smithi156.stdout:9/585: write d6/d19/d25/fa6 [527940,81701] 0 2023-12-16T05:56:41.118 INFO:tasks.workunit.client.1.smithi156.stdout:5/809: dwrite da/dc/d4b/d6c/d7c/d85/f103 [0,4194304] 0 2023-12-16T05:56:41.121 INFO:tasks.workunit.client.0.smithi155.stdout:4/759: sync 2023-12-16T05:56:41.121 INFO:tasks.workunit.client.0.smithi155.stdout:1/990: sync 2023-12-16T05:56:41.121 INFO:tasks.workunit.client.0.smithi155.stdout:2/770: sync 2023-12-16T05:56:41.121 INFO:tasks.workunit.client.0.smithi155.stdout:1/991: write d1/d7/d4b/d8e/dc7/f112 [561818,74672] 0 2023-12-16T05:56:41.121 INFO:tasks.workunit.client.0.smithi155.stdout:1/992: readlink d1/d7/d4b/d8e/dc7/d28/d8f/db2/d103/l11c 0 2023-12-16T05:56:41.121 INFO:tasks.workunit.client.0.smithi155.stdout:4/760: rmdir d0/da/de0/d16/d30/dce/d75/d3d/d49/dbb 39 2023-12-16T05:56:41.122 INFO:tasks.workunit.client.0.smithi155.stdout:2/771: symlink d0/d7/dd/d49/d4b/d8c/dcd/l100 0 2023-12-16T05:56:41.124 INFO:tasks.workunit.client.0.smithi155.stdout:1/993: write d1/d7/d4b/d8e/ff9 [4144209,116822] 0 2023-12-16T05:56:41.124 INFO:tasks.workunit.client.0.smithi155.stdout:1/994: chown d1/d25/d43/d5d/d5e/c6c 36286964 1 2023-12-16T05:56:41.124 INFO:tasks.workunit.client.0.smithi155.stdout:4/761: mknod d0/da/de0/d16/d30/dce/d75/d86/cf8 0 2023-12-16T05:56:41.124 INFO:tasks.workunit.client.0.smithi155.stdout:4/762: readlink d0/da/de0/d16/d1a/d70/d92/daf/db7/lbf 0 2023-12-16T05:56:41.124 INFO:tasks.workunit.client.0.smithi155.stdout:4/763: chown d0/da/de0/d16/d30/dce/d75/d3d/l99 197 1 2023-12-16T05:56:41.124 INFO:tasks.workunit.client.0.smithi155.stdout:4/764: truncate d0/da/de0/d16/d30/dce/d75/d50/f6a 4770738 0 2023-12-16T05:56:41.124 INFO:tasks.workunit.client.0.smithi155.stdout:4/765: stat d0/da/de0 0 2023-12-16T05:56:41.124 INFO:tasks.workunit.client.0.smithi155.stdout:4/766: getdents d0/da/de0/d16/d1a/dd1/ddf 0 2023-12-16T05:56:41.125 INFO:tasks.workunit.client.0.smithi155.stdout:2/772: mkdir d0/d7/d57/daf/d101 0 2023-12-16T05:56:41.125 INFO:tasks.workunit.client.0.smithi155.stdout:1/995: symlink d1/d92/l139 0 2023-12-16T05:56:41.125 INFO:tasks.workunit.client.0.smithi155.stdout:1/996: read d1/d7/d4b/d8e/dc7/d28/d85/de0/f7d [3903598,13146] 0 2023-12-16T05:56:41.126 INFO:tasks.workunit.client.0.smithi155.stdout:1/997: fdatasync d1/f138 0 2023-12-16T05:56:41.127 INFO:tasks.workunit.client.0.smithi155.stdout:4/767: link d0/da/de0/d16/d30/dce/d75/d3d/d49/lb6 d0/da/de0/d16/de8/lf9 0 2023-12-16T05:56:41.127 INFO:tasks.workunit.client.0.smithi155.stdout:4/768: chown d0/da/de0/d16/d1a/d70/c8b 234957717 1 2023-12-16T05:56:41.127 INFO:tasks.workunit.client.0.smithi155.stdout:4/769: chown d0/da/de0/d16/d30/d52/l59 964920 1 2023-12-16T05:56:41.127 INFO:tasks.workunit.client.0.smithi155.stdout:4/770: chown d0/da/de0/d16/d30/dcd/c80 16 1 2023-12-16T05:56:41.127 INFO:tasks.workunit.client.0.smithi155.stdout:4/771: fsync d0/da/de0/d16/d30/dce/d75/f51 0 2023-12-16T05:56:41.129 INFO:tasks.workunit.client.1.smithi156.stdout:5/810: unlink da/dc/d4b/d6c/d77/c89 0 2023-12-16T05:56:41.129 INFO:tasks.workunit.client.1.smithi156.stdout:5/811: truncate da/dc/d4b/d6c/d77/fb7 722478 0 2023-12-16T05:56:41.130 INFO:tasks.workunit.client.1.smithi156.stdout:5/812: chown da/dc/d2d/d4d/d54/d90/cd1 752330779 1 2023-12-16T05:56:41.130 INFO:tasks.workunit.client.1.smithi156.stdout:5/813: write da/dc/d2d/d4d/d54/ffe [911539,128907] 0 2023-12-16T05:56:41.130 INFO:tasks.workunit.client.0.smithi155.stdout:2/773: getdents d0/d7/dd/d49/d4b/d8c 0 2023-12-16T05:56:41.130 INFO:tasks.workunit.client.0.smithi155.stdout:1/998: unlink d1/d7/d4b/d8e/dc7/d28/d85/de0/d79/daa/lce 0 2023-12-16T05:56:41.131 INFO:tasks.workunit.client.0.smithi155.stdout:4/772: link d0/da/d36/fea d0/da/de0/d16/d1a/d70/d92/ffa 0 2023-12-16T05:56:41.132 INFO:tasks.workunit.client.0.smithi155.stdout:4/773: stat d0/da/de0/d16/d30/d52/l59 0 2023-12-16T05:56:41.132 INFO:tasks.workunit.client.0.smithi155.stdout:1/999: truncate d1/d7/d4b/d8e/dc7/d28/d8f/ff2 2416267 0 2023-12-16T05:56:41.134 INFO:tasks.workunit.client.0.smithi155.stdout:4/774: creat d0/ffb x:0 0 0 2023-12-16T05:56:41.135 INFO:tasks.workunit.client.1.smithi156.stdout:4/587: sync 2023-12-16T05:56:41.136 INFO:tasks.workunit.client.0.smithi155.stdout:2/774: write d0/d34/d3c/fe9 [28347,81403] 0 2023-12-16T05:56:41.137 INFO:tasks.workunit.client.0.smithi155.stdout:4/775: rename d0/da/de0/d16/d30/dce/d75/d89/fe1 to d0/da/de0/d16/d30/dce/d75/d3d/ffc 0 2023-12-16T05:56:41.137 INFO:tasks.workunit.client.0.smithi155.stdout:4/776: fdatasync d0/d10/f12 0 2023-12-16T05:56:41.141 INFO:tasks.workunit.client.0.smithi155.stdout:2/775: mknod d0/d7/d57/c102 0 2023-12-16T05:56:41.141 INFO:tasks.workunit.client.0.smithi155.stdout:4/777: mkdir d0/da/de0/d16/d1a/d70/d92/daf/db7/dfd 0 2023-12-16T05:56:41.143 INFO:tasks.workunit.client.0.smithi155.stdout:4/778: rename d0/da/de0/d16/d1a/d70/c8b to d0/da/de0/d16/d1a/d70/d92/cfe 0 2023-12-16T05:56:41.143 INFO:tasks.workunit.client.0.smithi155.stdout:4/779: fsync d0/da/de0/d16/d30/dce/d75/d3d/d43/feb 0 2023-12-16T05:56:41.143 INFO:tasks.workunit.client.0.smithi155.stdout:4/780: write d0/da/de0/d16/d30/d52/d88/d9e/fc4 [393167,78485] 0 2023-12-16T05:56:41.149 INFO:tasks.workunit.client.0.smithi155.stdout:2/776: dread d0/d34/d3c/fc8 [0,4194304] 0 2023-12-16T05:56:41.149 INFO:tasks.workunit.client.0.smithi155.stdout:2/777: rename d0/d7/d57/d63 to d0/d7/d57/d63/d103 22 2023-12-16T05:56:41.152 INFO:tasks.workunit.client.0.smithi155.stdout:2/778: creat d0/d7/d1f/d74/d3a/f104 x:0 0 0 2023-12-16T05:56:41.152 INFO:tasks.workunit.client.0.smithi155.stdout:2/779: mknod d0/d5/d8a/c105 0 2023-12-16T05:56:41.152 INFO:tasks.workunit.client.0.smithi155.stdout:2/780: chown d0 27 1 2023-12-16T05:56:41.153 INFO:tasks.workunit.client.0.smithi155.stdout:2/781: creat d0/d7/f106 x:0 0 0 2023-12-16T05:56:41.154 INFO:tasks.workunit.client.0.smithi155.stdout:2/782: fsync d0/d7/dd/d14/db6/ffd 0 2023-12-16T05:56:41.162 INFO:tasks.workunit.client.0.smithi155.stdout:2/783: dread d0/d5/d6/f83 [0,4194304] 0 2023-12-16T05:56:41.162 INFO:tasks.workunit.client.1.smithi156.stdout:9/586: dwrite d6/d19/f1a [0,4194304] 0 2023-12-16T05:56:41.162 INFO:tasks.workunit.client.0.smithi155.stdout:2/784: truncate d0/d7/d69/f93 130265 0 2023-12-16T05:56:41.164 INFO:tasks.workunit.client.0.smithi155.stdout:2/785: mknod d0/d7/dd/d49/d4b/c107 0 2023-12-16T05:56:41.164 INFO:tasks.workunit.client.0.smithi155.stdout:3/618: dwrite d0/d14/f50 [0,4194304] 0 2023-12-16T05:56:41.164 INFO:tasks.workunit.client.0.smithi155.stdout:2/786: read - d0/d7/dd/d62/faa zero size 2023-12-16T05:56:41.164 INFO:tasks.workunit.client.0.smithi155.stdout:3/619: dread - d0/d1e/d4e/f88 zero size 2023-12-16T05:56:41.164 INFO:tasks.workunit.client.1.smithi156.stdout:0/700: dwrite d2/d7/f18 [4194304,4194304] 0 2023-12-16T05:56:41.167 INFO:tasks.workunit.client.1.smithi156.stdout:5/814: dwrite da/dc/d2d/ff4 [0,4194304] 0 2023-12-16T05:56:41.167 INFO:tasks.workunit.client.1.smithi156.stdout:0/701: creat d2/d7/dd/d29/d38/d51/d65/d7e/fdc x:0 0 0 2023-12-16T05:56:41.167 INFO:tasks.workunit.client.1.smithi156.stdout:4/588: dwrite d9/d43/d58/f5c [0,4194304] 0 2023-12-16T05:56:41.167 INFO:tasks.workunit.client.1.smithi156.stdout:4/589: fsync d9/d43/f8e 0 2023-12-16T05:56:41.169 INFO:tasks.workunit.client.1.smithi156.stdout:9/587: dread d6/f46 [0,4194304] 0 2023-12-16T05:56:41.171 INFO:tasks.workunit.client.0.smithi155.stdout:2/787: mkdir d0/d7/dd/d49/d4b/d8c/dcd/d108 0 2023-12-16T05:56:41.171 INFO:tasks.workunit.client.1.smithi156.stdout:5/815: read f0 [3855283,105989] 0 2023-12-16T05:56:41.171 INFO:tasks.workunit.client.1.smithi156.stdout:5/816: fdatasync da/dc/d4b/d6c/d81/dc5/deb/d101/f106 0 2023-12-16T05:56:41.174 INFO:tasks.workunit.client.1.smithi156.stdout:0/702: mknod d2/d7/dd/d2d/cdd 0 2023-12-16T05:56:41.177 INFO:tasks.workunit.client.0.smithi155.stdout:5/865: sync 2023-12-16T05:56:41.178 INFO:tasks.workunit.client.0.smithi155.stdout:7/726: sync 2023-12-16T05:56:41.178 INFO:tasks.workunit.client.0.smithi155.stdout:5/866: dread - d0/ff3 zero size 2023-12-16T05:56:41.178 INFO:tasks.workunit.client.0.smithi155.stdout:7/727: chown d0/d6a/d1a/da0/de6 1247911 1 2023-12-16T05:56:41.178 INFO:tasks.workunit.client.0.smithi155.stdout:7/728: chown d0/d6a/d31/f8a 0 1 2023-12-16T05:56:41.178 INFO:tasks.workunit.client.1.smithi156.stdout:4/590: rename d9/d2c/d7a/fb9 to d9/d43/d58/fc4 0 2023-12-16T05:56:41.178 INFO:tasks.workunit.client.1.smithi156.stdout:4/591: fsync d9/f27 0 2023-12-16T05:56:41.179 INFO:tasks.workunit.client.1.smithi156.stdout:9/588: creat d6/d19/d30/d48/d87/fc7 x:0 0 0 2023-12-16T05:56:41.179 INFO:tasks.workunit.client.1.smithi156.stdout:9/589: write d6/d19/d25/f34 [1164275,60483] 0 2023-12-16T05:56:41.180 INFO:tasks.workunit.client.1.smithi156.stdout:9/590: getdents d6/d19/d30/d95 0 2023-12-16T05:56:41.180 INFO:tasks.workunit.client.1.smithi156.stdout:9/591: readlink d6/d19/d25/l2b 0 2023-12-16T05:56:41.180 INFO:tasks.workunit.client.0.smithi155.stdout:5/867: creat d0/d2/d2a/d30/d53/d7b/d99/daf/f11a x:0 0 0 2023-12-16T05:56:41.180 INFO:tasks.workunit.client.1.smithi156.stdout:9/592: write d6/f46 [4193312,99409] 0 2023-12-16T05:56:41.181 INFO:tasks.workunit.client.1.smithi156.stdout:9/593: unlink d6/d19/d25/d3a/d5e/f79 0 2023-12-16T05:56:41.182 INFO:tasks.workunit.client.1.smithi156.stdout:9/594: fsync d6/d19/d30/d48/d87/f70 0 2023-12-16T05:56:41.182 INFO:tasks.workunit.client.1.smithi156.stdout:9/595: stat d6/d19/d30/d48/l53 0 2023-12-16T05:56:41.183 INFO:tasks.workunit.client.0.smithi155.stdout:7/729: creat d0/d6a/d1a/d22/fec x:0 0 0 2023-12-16T05:56:41.186 INFO:tasks.workunit.client.0.smithi155.stdout:7/730: symlink d0/d6a/d1a/d8c/d34/d4b/d64/d6f/dba/led 0 2023-12-16T05:56:41.188 INFO:tasks.workunit.client.1.smithi156.stdout:0/703: dread d2/d7/dd/d29/d2e/f3a [4194304,4194304] 0 2023-12-16T05:56:41.188 INFO:tasks.workunit.client.1.smithi156.stdout:0/704: truncate d2/d7/dd/d29/d38/d3f/f58 2016358 0 2023-12-16T05:56:41.188 INFO:tasks.workunit.client.1.smithi156.stdout:0/705: chown d2/d7/dd/d29/d4b/d76/f78 10347 1 2023-12-16T05:56:41.188 INFO:tasks.workunit.client.1.smithi156.stdout:0/706: read d2/d7/dd/d29/d38/f91 [387898,40145] 0 2023-12-16T05:56:41.189 INFO:tasks.workunit.client.0.smithi155.stdout:7/731: write d0/d6a/f30 [3691248,64017] 0 2023-12-16T05:56:41.191 INFO:tasks.workunit.client.0.smithi155.stdout:7/732: creat d0/d6a/d1a/d8c/d34/d4b/d64/d6f/fee x:0 0 0 2023-12-16T05:56:41.191 INFO:tasks.workunit.client.0.smithi155.stdout:7/733: fdatasync d0/d6a/d1a/d8c/d34/d4b/fb6 0 2023-12-16T05:56:41.191 INFO:tasks.workunit.client.0.smithi155.stdout:7/734: write d0/d6a/d1a/d8c/f7c [4842255,78662] 0 2023-12-16T05:56:41.191 INFO:tasks.workunit.client.0.smithi155.stdout:7/735: chown d0/d6a/d1a/d2b/d2c/d5d/f62 1 1 2023-12-16T05:56:41.191 INFO:tasks.workunit.client.0.smithi155.stdout:7/736: chown d0/d6a/d1a/d2b/d2c 685975976 1 2023-12-16T05:56:41.197 INFO:tasks.workunit.client.0.smithi155.stdout:0/921: sync 2023-12-16T05:56:41.197 INFO:tasks.workunit.client.1.smithi156.stdout:0/707: dread d2/d7/dd/d1c/f36 [0,4194304] 0 2023-12-16T05:56:41.198 INFO:tasks.workunit.client.1.smithi156.stdout:0/708: symlink d2/d7/dd/d29/d38/d51/lde 0 2023-12-16T05:56:41.198 INFO:tasks.workunit.client.1.smithi156.stdout:0/709: chown d2/d7/dd/d1c/l7f 512574 1 2023-12-16T05:56:41.199 INFO:tasks.workunit.client.0.smithi155.stdout:8/882: sync 2023-12-16T05:56:41.199 INFO:tasks.workunit.client.0.smithi155.stdout:8/883: chown d4/d62/d66/d78/d88/d1b/d2a/d51/c79 64747 1 2023-12-16T05:56:41.200 INFO:tasks.workunit.client.1.smithi156.stdout:0/710: unlink d2/d7/dd/d29/f84 0 2023-12-16T05:56:41.201 INFO:tasks.workunit.client.0.smithi155.stdout:5/868: dread d0/d2/d2a/d19/f4c [0,4194304] 0 2023-12-16T05:56:41.203 INFO:tasks.workunit.client.1.smithi156.stdout:9/596: dread d6/d2e/f52 [0,4194304] 0 2023-12-16T05:56:41.203 INFO:tasks.workunit.client.1.smithi156.stdout:0/711: unlink d2/d7/dd/d29/d38/d51/l81 0 2023-12-16T05:56:41.203 INFO:tasks.workunit.client.0.smithi155.stdout:3/620: dwrite d0/f30 [4194304,4194304] 0 2023-12-16T05:56:41.203 INFO:tasks.workunit.client.1.smithi156.stdout:9/597: creat d6/d19/d25/d3a/dc3/fc8 x:0 0 0 2023-12-16T05:56:41.204 INFO:tasks.workunit.client.0.smithi155.stdout:0/922: creat d7/df/d73/f12e x:0 0 0 2023-12-16T05:56:41.204 INFO:tasks.workunit.client.0.smithi155.stdout:8/884: getdents d4/d62/d66/d78/d88/d1b/d1c/d19/dd0 0 2023-12-16T05:56:41.205 INFO:tasks.workunit.client.1.smithi156.stdout:9/598: mkdir d6/d19/d25/d3a/d88/d8b/dac/dc9 0 2023-12-16T05:56:41.205 INFO:tasks.workunit.client.1.smithi156.stdout:4/592: dwrite d9/d2b/f65 [0,4194304] 0 2023-12-16T05:56:41.207 INFO:tasks.workunit.client.0.smithi155.stdout:3/621: rmdir d0/d1e/d4e 39 2023-12-16T05:56:41.207 INFO:tasks.workunit.client.0.smithi155.stdout:3/622: chown d0/cf 415353 1 2023-12-16T05:56:41.207 INFO:tasks.workunit.client.0.smithi155.stdout:3/623: fsync d0/d14/f50 0 2023-12-16T05:56:41.208 INFO:tasks.workunit.client.0.smithi155.stdout:0/923: getdents d7/d13/d45/d3e 0 2023-12-16T05:56:41.208 INFO:tasks.workunit.client.0.smithi155.stdout:0/924: dread - d7/df/d73/d8d/d4d/d115/d53/f11e zero size 2023-12-16T05:56:41.209 INFO:tasks.workunit.client.0.smithi155.stdout:8/885: creat d4/d62/d66/d78/d88/d1b/d1c/d97/df3/df5/f128 x:0 0 0 2023-12-16T05:56:41.209 INFO:tasks.workunit.client.1.smithi156.stdout:9/599: creat d6/d19/d25/d3a/d88/d8b/fca x:0 0 0 2023-12-16T05:56:41.210 INFO:tasks.workunit.client.1.smithi156.stdout:9/600: mknod d6/d2e/d8a/ccb 0 2023-12-16T05:56:41.210 INFO:tasks.workunit.client.0.smithi155.stdout:3/624: unlink d0/d1a/d33/f56 0 2023-12-16T05:56:41.210 INFO:tasks.workunit.client.0.smithi155.stdout:8/886: write d4/d62/d66/d78/d88/d1b/d1c/d97/fd7 [3646109,116093] 0 2023-12-16T05:56:41.211 INFO:tasks.workunit.client.0.smithi155.stdout:8/887: truncate d4/d62/d66/d78/d88/d1b/d5f/fc8 235448 0 2023-12-16T05:56:41.211 INFO:tasks.workunit.client.0.smithi155.stdout:0/925: mkdir d7/d13/d45/d12f 0 2023-12-16T05:56:41.212 INFO:tasks.workunit.client.1.smithi156.stdout:9/601: creat d6/da3/db0/fcc x:0 0 0 2023-12-16T05:56:41.212 INFO:tasks.workunit.client.1.smithi156.stdout:9/602: chown d6/d19/d25/f31 0 1 2023-12-16T05:56:41.213 INFO:tasks.workunit.client.0.smithi155.stdout:0/926: dread d7/df/d73/dba/fca [0,4194304] 0 2023-12-16T05:56:41.213 INFO:tasks.workunit.client.1.smithi156.stdout:9/603: mknod d6/d19/d25/d3a/d88/d8b/dac/dc9/ccd 0 2023-12-16T05:56:41.214 INFO:tasks.workunit.client.1.smithi156.stdout:9/604: creat d6/d19/d25/d3a/d80/fce x:0 0 0 2023-12-16T05:56:41.214 INFO:tasks.workunit.client.0.smithi155.stdout:8/888: rename d4/d62/l91 to d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/d11b/l129 0 2023-12-16T05:56:41.215 INFO:tasks.workunit.client.1.smithi156.stdout:9/605: getdents d6/d19/d30/d5b 0 2023-12-16T05:56:41.215 INFO:tasks.workunit.client.1.smithi156.stdout:9/606: fdatasync d6/d19/d25/d3a/d5e/f68 0 2023-12-16T05:56:41.216 INFO:tasks.workunit.client.1.smithi156.stdout:9/607: creat d6/d19/d25/d3a/fcf x:0 0 0 2023-12-16T05:56:41.216 INFO:tasks.workunit.client.1.smithi156.stdout:9/608: chown d6/d19/d25/l41 202152122 1 2023-12-16T05:56:41.216 INFO:tasks.workunit.client.0.smithi155.stdout:0/927: creat d7/df/d73/d8d/d4d/de8/de5/f130 x:0 0 0 2023-12-16T05:56:41.216 INFO:tasks.workunit.client.0.smithi155.stdout:0/928: getdents d7/df/d73/d8d/d4d/d115/d5d/d84 0 2023-12-16T05:56:41.218 INFO:tasks.workunit.client.1.smithi156.stdout:9/609: mkdir d6/d19/d25/d3a/d80/dc0/dd0 0 2023-12-16T05:56:41.219 INFO:tasks.workunit.client.0.smithi155.stdout:0/929: creat d7/d13/d45/f131 x:0 0 0 2023-12-16T05:56:41.220 INFO:tasks.workunit.client.0.smithi155.stdout:0/930: creat d7/df/d73/d8d/d4d/d115/d5d/d6a/f132 x:0 0 0 2023-12-16T05:56:41.220 INFO:tasks.workunit.client.0.smithi155.stdout:0/931: dread - d7/d2d/f129 zero size 2023-12-16T05:56:41.221 INFO:tasks.workunit.client.0.smithi155.stdout:7/737: dwrite d0/d6a/d1a/d38/f41 [0,4194304] 0 2023-12-16T05:56:41.221 INFO:tasks.workunit.client.0.smithi155.stdout:5/869: dwrite d0/d2/d2a/d19/dd7/dee/f109 [0,4194304] 0 2023-12-16T05:56:41.221 INFO:tasks.workunit.client.0.smithi155.stdout:5/870: write d0/d2/d4f/f116 [792555,62948] 0 2023-12-16T05:56:41.222 INFO:tasks.workunit.client.0.smithi155.stdout:0/932: link d7/df/d73/d8d/d4d/d115/d5d/d6a/f132 d7/d13/d46/f133 0 2023-12-16T05:56:41.223 INFO:tasks.workunit.client.0.smithi155.stdout:5/871: write d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/dd9/fe5 [885262,58419] 0 2023-12-16T05:56:41.223 INFO:tasks.workunit.client.0.smithi155.stdout:5/872: dread - d0/d2/d2a/d30/d53/d7b/d99/d47/d61/db6/f118 zero size 2023-12-16T05:56:41.223 INFO:tasks.workunit.client.0.smithi155.stdout:5/873: dread - d0/d60/d79/fde zero size 2023-12-16T05:56:41.223 INFO:tasks.workunit.client.1.smithi156.stdout:4/593: dread d9/f16 [0,4194304] 0 2023-12-16T05:56:41.224 INFO:tasks.workunit.client.0.smithi155.stdout:7/738: rmdir d0/d6a/d1a/d8c/d34/d4b/d64/d6f 39 2023-12-16T05:56:41.227 INFO:tasks.workunit.client.1.smithi156.stdout:4/594: link d9/d43/d58/d7d/d82/cb8 d9/d43/d58/d95/cc5 0 2023-12-16T05:56:41.228 INFO:tasks.workunit.client.1.smithi156.stdout:4/595: creat d9/d2c/dbf/fc6 x:0 0 0 2023-12-16T05:56:41.229 INFO:tasks.workunit.client.0.smithi155.stdout:8/889: rmdir d4/d62/d66/d78/d88/d1b/d1c/d97/d29 39 2023-12-16T05:56:41.229 INFO:tasks.workunit.client.0.smithi155.stdout:8/890: fdatasync d4/d62/d66/d78/d88/d1b/d1c/d19/d64/f116 0 2023-12-16T05:56:41.229 INFO:tasks.workunit.client.0.smithi155.stdout:8/891: truncate d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/fc1 742970 0 2023-12-16T05:56:41.229 INFO:tasks.workunit.client.0.smithi155.stdout:8/892: fdatasync d4/d62/d66/d78/d88/d1b/d1c/d97/d29/fe9 0 2023-12-16T05:56:41.230 INFO:tasks.workunit.client.1.smithi156.stdout:4/596: creat d9/d43/d58/d7d/fc7 x:0 0 0 2023-12-16T05:56:41.230 INFO:tasks.workunit.client.0.smithi155.stdout:0/933: symlink d7/df/d73/df8/l134 0 2023-12-16T05:56:41.233 INFO:tasks.workunit.client.0.smithi155.stdout:5/874: unlink d0/d2/d2a/d30/d53/d7b/d99/d47/f6b 0 2023-12-16T05:56:41.234 INFO:tasks.workunit.client.0.smithi155.stdout:7/739: creat d0/d1/fef x:0 0 0 2023-12-16T05:56:41.235 INFO:tasks.workunit.client.0.smithi155.stdout:7/740: fsync d0/d6a/d1a/d8c/d34/d4b/d64/d6f/fee 0 2023-12-16T05:56:41.235 INFO:tasks.workunit.client.0.smithi155.stdout:7/741: chown d0/d6a/d1a/d8c/d34/d4b/fb6 744 1 2023-12-16T05:56:41.235 INFO:tasks.workunit.client.0.smithi155.stdout:8/893: dread d4/d62/d66/d78/d88/d1b/d1c/f8d [0,4194304] 0 2023-12-16T05:56:41.238 INFO:tasks.workunit.client.0.smithi155.stdout:5/875: rename d0/d2/d2a/d30/d53/d7b/d99/d47/f73 to d0/d2/d2a/d30/d53/d7b/d99/d47/f11b 0 2023-12-16T05:56:41.239 INFO:tasks.workunit.client.0.smithi155.stdout:7/742: creat d0/d6a/d1a/d2b/ff0 x:0 0 0 2023-12-16T05:56:41.240 INFO:tasks.workunit.client.0.smithi155.stdout:8/894: mknod d4/c12a 0 2023-12-16T05:56:41.242 INFO:tasks.workunit.client.0.smithi155.stdout:5/876: link d0/d2/d2a/d30/d53/d7b/d99/d47/ldb d0/d2/l11c 0 2023-12-16T05:56:41.242 INFO:tasks.workunit.client.0.smithi155.stdout:5/877: stat d0/d2/d2a/d30/d53/d7b/d99/d101 0 2023-12-16T05:56:41.244 INFO:tasks.workunit.client.0.smithi155.stdout:7/743: getdents d0/d6a/d1a/d22 0 2023-12-16T05:56:41.247 INFO:tasks.workunit.client.0.smithi155.stdout:5/878: rename d0/c114 to d0/d2/d2a/d30/d53/d7b/c11d 0 2023-12-16T05:56:41.247 INFO:tasks.workunit.client.0.smithi155.stdout:7/744: symlink d0/d6a/d1a/lf1 0 2023-12-16T05:56:41.247 INFO:tasks.workunit.client.0.smithi155.stdout:5/879: write d0/d2/d4f/f9b [10749155,4067] 0 2023-12-16T05:56:41.248 INFO:tasks.workunit.client.1.smithi156.stdout:9/610: dwrite d6/d19/d25/f3c [0,4194304] 0 2023-12-16T05:56:41.248 INFO:tasks.workunit.client.0.smithi155.stdout:3/625: dwrite d0/f2e [0,4194304] 0 2023-12-16T05:56:41.248 INFO:tasks.workunit.client.0.smithi155.stdout:7/745: unlink d0/d6a/d31/f32 0 2023-12-16T05:56:41.249 INFO:tasks.workunit.client.0.smithi155.stdout:5/880: mkdir d0/d2/d2a/d19/d71/d11e 0 2023-12-16T05:56:41.250 INFO:tasks.workunit.client.0.smithi155.stdout:5/881: write d0/d2/d2a/d19/f20 [3926593,28045] 0 2023-12-16T05:56:41.250 INFO:tasks.workunit.client.1.smithi156.stdout:9/611: symlink d6/d2e/dad/ld1 0 2023-12-16T05:56:41.252 INFO:tasks.workunit.client.1.smithi156.stdout:9/612: mknod d6/d19/d25/cd2 0 2023-12-16T05:56:41.253 INFO:tasks.workunit.client.0.smithi155.stdout:3/626: symlink d0/d14/d36/d47/da7/lbc 0 2023-12-16T05:56:41.255 INFO:tasks.workunit.client.0.smithi155.stdout:3/627: creat d0/d14/fbd x:0 0 0 2023-12-16T05:56:41.262 INFO:tasks.workunit.client.0.smithi155.stdout:5/882: dread d0/d2/d2a/d30/d53/fbe [0,4194304] 0 2023-12-16T05:56:41.262 INFO:tasks.workunit.client.0.smithi155.stdout:5/883: write d0/d2/d2a/d30/d53/d7b/d99/d47/fe7 [203353,27303] 0 2023-12-16T05:56:41.263 INFO:tasks.workunit.client.1.smithi156.stdout:4/597: dwrite d9/d43/d58/fa8 [0,4194304] 0 2023-12-16T05:56:41.266 INFO:tasks.workunit.client.0.smithi155.stdout:8/895: dwrite d4/d62/d66/d78/d88/d1b/d1c/d19/dd0/fe0 [0,4194304] 0 2023-12-16T05:56:41.266 INFO:tasks.workunit.client.0.smithi155.stdout:5/884: rename d0/d2/d4f to d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/dd9/d11f 0 2023-12-16T05:56:41.267 INFO:tasks.workunit.client.1.smithi156.stdout:4/598: unlink d9/d2b/d35/f3f 0 2023-12-16T05:56:41.268 INFO:tasks.workunit.client.1.smithi156.stdout:4/599: mknod d9/d2c/cc8 0 2023-12-16T05:56:41.269 INFO:tasks.workunit.client.1.smithi156.stdout:4/600: symlink d9/d2b/d9a/dc2/lc9 0 2023-12-16T05:56:41.271 INFO:tasks.workunit.client.1.smithi156.stdout:4/601: creat d9/d2b/d35/fca x:0 0 0 2023-12-16T05:56:41.271 INFO:tasks.workunit.client.0.smithi155.stdout:8/896: dread d4/d62/d66/d78/d88/d1b/d1c/d19/d64/fa4 [0,4194304] 0 2023-12-16T05:56:41.271 INFO:tasks.workunit.client.0.smithi155.stdout:8/897: dread - d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/f10b zero size 2023-12-16T05:56:41.271 INFO:tasks.workunit.client.0.smithi155.stdout:8/898: write d4/d62/d66/d78/d88/d1b/d1c/d19/f73 [2329230,107443] 0 2023-12-16T05:56:41.271 INFO:tasks.workunit.client.0.smithi155.stdout:8/899: write d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/ffa [859566,62402] 0 2023-12-16T05:56:41.272 INFO:tasks.workunit.client.0.smithi155.stdout:8/900: readlink d4/lcb 0 2023-12-16T05:56:41.272 INFO:tasks.workunit.client.1.smithi156.stdout:4/602: mknod d9/d43/d58/d95/ccb 0 2023-12-16T05:56:41.275 INFO:tasks.workunit.client.1.smithi156.stdout:1/524: sync 2023-12-16T05:56:41.276 INFO:tasks.workunit.client.1.smithi156.stdout:1/525: dread - d3/d1b/f40 zero size 2023-12-16T05:56:41.276 INFO:tasks.workunit.client.1.smithi156.stdout:1/526: chown d3/d17/d1c/l47 11912141 1 2023-12-16T05:56:41.276 INFO:tasks.workunit.client.1.smithi156.stdout:7/837: sync 2023-12-16T05:56:41.276 INFO:tasks.workunit.client.1.smithi156.stdout:8/468: sync 2023-12-16T05:56:41.277 INFO:tasks.workunit.client.1.smithi156.stdout:9/613: dwrite d6/d19/d25/d3a/f43 [4194304,4194304] 0 2023-12-16T05:56:41.278 INFO:tasks.workunit.client.1.smithi156.stdout:8/469: mknod d3/d7/c9c 0 2023-12-16T05:56:41.279 INFO:tasks.workunit.client.0.smithi155.stdout:5/885: dread d0/d2/d2a/fe [4194304,4194304] 0 2023-12-16T05:56:41.280 INFO:tasks.workunit.client.1.smithi156.stdout:8/470: creat d3/d7/d62/f9d x:0 0 0 2023-12-16T05:56:41.281 INFO:tasks.workunit.client.1.smithi156.stdout:1/527: write d3/d17/f48 [3866926,61796] 0 2023-12-16T05:56:41.282 INFO:tasks.workunit.client.0.smithi155.stdout:5/886: creat d0/d2/d2a/d19/dd7/f120 x:0 0 0 2023-12-16T05:56:41.282 INFO:tasks.workunit.client.0.smithi155.stdout:5/887: chown d0/d2/d2a/d19/d21/ff7 27 1 2023-12-16T05:56:41.282 INFO:tasks.workunit.client.1.smithi156.stdout:8/471: mknod d3/d7/d27/d46/d84/d85/d9b/c9e 0 2023-12-16T05:56:41.282 INFO:tasks.workunit.client.1.smithi156.stdout:8/472: write d3/d7/f31 [875111,28215] 0 2023-12-16T05:56:41.282 INFO:tasks.workunit.client.1.smithi156.stdout:9/614: read d6/d19/d30/f54 [3492098,121954] 0 2023-12-16T05:56:41.283 INFO:tasks.workunit.client.1.smithi156.stdout:1/528: rename d3/d1b/f46 to d3/d17/d1c/d22/da4/fad 0 2023-12-16T05:56:41.284 INFO:tasks.workunit.client.1.smithi156.stdout:9/615: mknod d6/da3/db0/cd3 0 2023-12-16T05:56:41.285 INFO:tasks.workunit.client.0.smithi155.stdout:3/628: dwrite d0/d14/d87/d94/da1/d73/faf [0,4194304] 0 2023-12-16T05:56:41.289 INFO:tasks.workunit.client.1.smithi156.stdout:8/473: rename d3/d7/d62/c96 to d3/d7a/c9f 0 2023-12-16T05:56:41.289 INFO:tasks.workunit.client.1.smithi156.stdout:1/529: creat d3/fae x:0 0 0 2023-12-16T05:56:41.289 INFO:tasks.workunit.client.1.smithi156.stdout:1/530: stat d3/d17/c54 0 2023-12-16T05:56:41.291 INFO:tasks.workunit.client.0.smithi155.stdout:3/629: creat d0/d14/d36/d47/fbe x:0 0 0 2023-12-16T05:56:41.292 INFO:tasks.workunit.client.1.smithi156.stdout:7/838: dread d1e/d55/fb3 [0,4194304] 0 2023-12-16T05:56:41.292 INFO:tasks.workunit.client.1.smithi156.stdout:7/839: stat d1e/d55/d71/d61/daa/f50 0 2023-12-16T05:56:41.292 INFO:tasks.workunit.client.1.smithi156.stdout:1/531: rename d3/d17/d1c/d22/d57/f7e to d3/faf 0 2023-12-16T05:56:41.294 INFO:tasks.workunit.client.1.smithi156.stdout:7/840: truncate d1e/fb2 205097 0 2023-12-16T05:56:41.296 INFO:tasks.workunit.client.1.smithi156.stdout:1/532: creat d3/d17/d4d/fb0 x:0 0 0 2023-12-16T05:56:41.296 INFO:tasks.workunit.client.1.smithi156.stdout:1/533: chown d3/d17/d1c/d22/d57/d61/f80 9362711 1 2023-12-16T05:56:41.298 INFO:tasks.workunit.client.1.smithi156.stdout:1/534: mkdir d3/d3a/db1 0 2023-12-16T05:56:41.302 INFO:tasks.workunit.client.1.smithi156.stdout:1/535: link d3/d17/d19/fa6 d3/d3a/db1/fb2 0 2023-12-16T05:56:41.304 INFO:tasks.workunit.client.0.smithi155.stdout:0/934: dwrite d7/df/d73/d8d/d4d/de8/dd6/f108 [0,4194304] 0 2023-12-16T05:56:41.304 INFO:tasks.workunit.client.0.smithi155.stdout:0/935: fdatasync d7/df/d73/d8d/d4d/de8/dd6/f108 0 2023-12-16T05:56:41.307 INFO:tasks.workunit.client.1.smithi156.stdout:1/536: dread d3/d17/d1c/d22/f6a [0,4194304] 0 2023-12-16T05:56:41.308 INFO:tasks.workunit.client.1.smithi156.stdout:1/537: truncate d3/d17/f33 2157405 0 2023-12-16T05:56:41.310 INFO:tasks.workunit.client.1.smithi156.stdout:1/538: mknod d3/d17/d1c/d22/d57/cb3 0 2023-12-16T05:56:41.310 INFO:tasks.workunit.client.0.smithi155.stdout:8/901: dwrite d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/f72 [4194304,4194304] 0 2023-12-16T05:56:41.312 INFO:tasks.workunit.client.0.smithi155.stdout:7/746: dwrite d0/d6a/f30 [0,4194304] 0 2023-12-16T05:56:41.312 INFO:tasks.workunit.client.0.smithi155.stdout:5/888: dwrite d0/d2/d2a/d30/d53/db5/f113 [0,4194304] 0 2023-12-16T05:56:41.312 INFO:tasks.workunit.client.0.smithi155.stdout:5/889: fsync d0/d2/d2a/d30/f70 0 2023-12-16T05:56:41.312 INFO:tasks.workunit.client.1.smithi156.stdout:4/603: dwrite d9/d2b/d98/fa0 [0,4194304] 0 2023-12-16T05:56:41.313 INFO:tasks.workunit.client.0.smithi155.stdout:8/902: creat d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/f12b x:0 0 0 2023-12-16T05:56:41.313 INFO:tasks.workunit.client.0.smithi155.stdout:8/903: chown d4/d62/d66/d78/d88/d1b/d1c/d97/d29/faf 31 1 2023-12-16T05:56:41.314 INFO:tasks.workunit.client.1.smithi156.stdout:4/604: creat d9/d43/fcc x:0 0 0 2023-12-16T05:56:41.314 INFO:tasks.workunit.client.0.smithi155.stdout:3/630: getdents d0/d14/d36/d47 0 2023-12-16T05:56:41.314 INFO:tasks.workunit.client.0.smithi155.stdout:3/631: fdatasync d0/d14/d45/fa0 0 2023-12-16T05:56:41.315 INFO:tasks.workunit.client.0.smithi155.stdout:3/632: readlink d0/d14/d36/d47/l92 0 2023-12-16T05:56:41.315 INFO:tasks.workunit.client.0.smithi155.stdout:3/633: fdatasync d0/d14/d36/d47/d5f/f7d 0 2023-12-16T05:56:41.315 INFO:tasks.workunit.client.1.smithi156.stdout:4/605: mkdir d9/d2b/d98/dcd 0 2023-12-16T05:56:41.316 INFO:tasks.workunit.client.0.smithi155.stdout:7/747: rename d0/d6a/d1a/d8c/d42/f80 to d0/d6a/d1a/d2b/d65/ff2 0 2023-12-16T05:56:41.316 INFO:tasks.workunit.client.1.smithi156.stdout:4/606: rename d9/d2c/l3a to d9/d2c/d7a/lce 0 2023-12-16T05:56:41.317 INFO:tasks.workunit.client.1.smithi156.stdout:4/607: mkdir d9/d2c/dbf/dcf 0 2023-12-16T05:56:41.320 INFO:tasks.workunit.client.1.smithi156.stdout:9/616: dwrite d6/d19/d30/d48/d87/d65/fa8 [0,4194304] 0 2023-12-16T05:56:41.321 INFO:tasks.workunit.client.1.smithi156.stdout:9/617: stat d6/d19/d25/l7f 0 2023-12-16T05:56:41.321 INFO:tasks.workunit.client.1.smithi156.stdout:9/618: fdatasync d6/d19/d25/f31 0 2023-12-16T05:56:41.321 INFO:tasks.workunit.client.1.smithi156.stdout:9/619: write d6/d19/d25/d3a/fcf [116969,48052] 0 2023-12-16T05:56:41.321 INFO:tasks.workunit.client.1.smithi156.stdout:9/620: truncate d6/d19/d30/d48/d87/f9b 376389 0 2023-12-16T05:56:41.321 INFO:tasks.workunit.client.1.smithi156.stdout:9/621: dread - d6/d19/d25/fc2 zero size 2023-12-16T05:56:41.321 INFO:tasks.workunit.client.0.smithi155.stdout:3/634: mknod d0/d1e/d4e/db6/cbf 0 2023-12-16T05:56:41.322 INFO:tasks.workunit.client.1.smithi156.stdout:9/622: mkdir d6/d19/d25/d3a/d80/dc0/dd4 0 2023-12-16T05:56:41.323 INFO:tasks.workunit.client.0.smithi155.stdout:7/748: unlink d0/d6a/d1a/d8c/d42/d98/cae 0 2023-12-16T05:56:41.323 INFO:tasks.workunit.client.0.smithi155.stdout:7/749: fdatasync d0/d6a/d1a/d2b/d2c/d5d/f62 0 2023-12-16T05:56:41.328 INFO:tasks.workunit.client.0.smithi155.stdout:8/904: rmdir d4/d62/d66/d78/d88 39 2023-12-16T05:56:41.328 INFO:tasks.workunit.client.0.smithi155.stdout:8/905: fdatasync d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/f63 0 2023-12-16T05:56:41.331 INFO:tasks.workunit.client.1.smithi156.stdout:1/539: dwrite d3/f5a [0,4194304] 0 2023-12-16T05:56:41.331 INFO:tasks.workunit.client.0.smithi155.stdout:5/890: dread d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/dd9/d11f/f55 [0,4194304] 0 2023-12-16T05:56:41.334 INFO:tasks.workunit.client.1.smithi156.stdout:8/474: dwrite d3/f5a [0,4194304] 0 2023-12-16T05:56:41.336 INFO:tasks.workunit.client.1.smithi156.stdout:8/475: read d3/f5c [880839,18126] 0 2023-12-16T05:56:41.336 INFO:tasks.workunit.client.1.smithi156.stdout:8/476: chown d3/d7/d27/d46/d84/d85 5361998 1 2023-12-16T05:56:41.339 INFO:tasks.workunit.client.1.smithi156.stdout:1/540: rename d3/d17/d19/f2a to d3/fb4 0 2023-12-16T05:56:41.340 INFO:tasks.workunit.client.1.smithi156.stdout:8/477: mknod d3/ca0 0 2023-12-16T05:56:41.341 INFO:tasks.workunit.client.1.smithi156.stdout:8/478: write d3/d7/d27/d46/f4e [2690408,123112] 0 2023-12-16T05:56:41.342 INFO:tasks.workunit.client.1.smithi156.stdout:1/541: mknod d3/d17/d19/cb5 0 2023-12-16T05:56:41.342 INFO:tasks.workunit.client.1.smithi156.stdout:1/542: readlink d3/d17/d19/l55 0 2023-12-16T05:56:41.342 INFO:tasks.workunit.client.1.smithi156.stdout:8/479: symlink d3/d18/d94/la1 0 2023-12-16T05:56:41.344 INFO:tasks.workunit.client.1.smithi156.stdout:1/543: symlink d3/d17/d1c/d22/d57/lb6 0 2023-12-16T05:56:41.382 INFO:tasks.workunit.client.1.smithi156.stdout:7/841: dwrite d1e/d55/dba/fec [0,4194304] 0 2023-12-16T05:56:41.382 INFO:tasks.workunit.client.1.smithi156.stdout:7/842: truncate d1e/d55/dba/fe6 907670 0 2023-12-16T05:56:41.382 INFO:tasks.workunit.client.1.smithi156.stdout:7/843: dread d1e/fb2 [0,4194304] 0 2023-12-16T05:56:41.384 INFO:tasks.workunit.client.1.smithi156.stdout:7/844: rename d1e/d1f/d22/l9a to d1e/d55/l125 0 2023-12-16T05:56:41.384 INFO:tasks.workunit.client.1.smithi156.stdout:7/845: fdatasync d1e/d55/dba/fcd 0 2023-12-16T05:56:41.385 INFO:tasks.workunit.client.1.smithi156.stdout:7/846: mknod d1e/d39/c126 0 2023-12-16T05:56:41.386 INFO:tasks.workunit.client.1.smithi156.stdout:7/847: mknod d1e/d55/d71/c127 0 2023-12-16T05:56:41.386 INFO:tasks.workunit.client.0.smithi155.stdout:5/891: dread d0/d2/d2a/f2e [0,4194304] 0 2023-12-16T05:56:41.386 INFO:tasks.workunit.client.1.smithi156.stdout:7/848: symlink d1e/d55/db6/ddb/l128 0 2023-12-16T05:56:41.389 INFO:tasks.workunit.client.0.smithi155.stdout:3/635: rename d0/d14/d36/d47/da7/laa to d0/d14/d36/d7c/lc0 0 2023-12-16T05:56:41.391 INFO:tasks.workunit.client.0.smithi155.stdout:8/906: rename d4/d62/d66/d78/d88/d1b/d1c/d46 to d4/dd3/df8/d12c 0 2023-12-16T05:56:41.391 INFO:tasks.workunit.client.1.smithi156.stdout:8/480: dread d3/d12/f25 [0,4194304] 0 2023-12-16T05:56:41.392 INFO:tasks.workunit.client.0.smithi155.stdout:3/636: creat d0/d14/d36/d83/da8/fc1 x:0 0 0 2023-12-16T05:56:41.393 INFO:tasks.workunit.client.1.smithi156.stdout:8/481: symlink d3/d7/d27/d46/d84/la2 0 2023-12-16T05:56:41.393 INFO:tasks.workunit.client.1.smithi156.stdout:8/482: write d3/d7/d27/f32 [617718,115917] 0 2023-12-16T05:56:41.394 INFO:tasks.workunit.client.0.smithi155.stdout:5/892: rename d0/d2/d2a/d30/d53/d7b/d99/d47/f10d to d0/d2/f121 0 2023-12-16T05:56:41.394 INFO:tasks.workunit.client.1.smithi156.stdout:8/483: link d3/d7/d66/f71 d3/d7/d27/d46/d84/fa3 0 2023-12-16T05:56:41.395 INFO:tasks.workunit.client.1.smithi156.stdout:8/484: getdents d3/d7/d66 0 2023-12-16T05:56:41.396 INFO:tasks.workunit.client.1.smithi156.stdout:8/485: write d3/d7a/f81 [3291388,114380] 0 2023-12-16T05:56:41.397 INFO:tasks.workunit.client.0.smithi155.stdout:3/637: unlink d0/d1a/d33/l38 0 2023-12-16T05:56:41.397 INFO:tasks.workunit.client.0.smithi155.stdout:8/907: dread d4/d62/d66/d78/d88/d1b/f7c [0,4194304] 0 2023-12-16T05:56:41.397 INFO:tasks.workunit.client.1.smithi156.stdout:8/486: getdents d3/d7/d27/d46 0 2023-12-16T05:56:41.398 INFO:tasks.workunit.client.1.smithi156.stdout:8/487: creat d3/d7a/fa4 x:0 0 0 2023-12-16T05:56:41.399 INFO:tasks.workunit.client.0.smithi155.stdout:5/893: unlink d0/d2/d2a/d30/d53/d7b/d99/d47/c54 0 2023-12-16T05:56:41.399 INFO:tasks.workunit.client.0.smithi155.stdout:5/894: write d0/d2/d2a/fbd [1302360,73551] 0 2023-12-16T05:56:41.399 INFO:tasks.workunit.client.0.smithi155.stdout:5/895: write d0/d2/d2a/d19/d88/fc0 [225678,110109] 0 2023-12-16T05:56:41.400 INFO:tasks.workunit.client.1.smithi156.stdout:8/488: mknod d3/ca5 0 2023-12-16T05:56:41.401 INFO:tasks.workunit.client.1.smithi156.stdout:8/489: creat d3/d7a/d7d/fa6 x:0 0 0 2023-12-16T05:56:41.401 INFO:tasks.workunit.client.1.smithi156.stdout:8/490: dread - d3/d7a/fa4 zero size 2023-12-16T05:56:41.401 INFO:tasks.workunit.client.1.smithi156.stdout:8/491: getdents d3/d12/d16 0 2023-12-16T05:56:41.401 INFO:tasks.workunit.client.1.smithi156.stdout:1/544: dread d3/d17/d19/f2e [0,4194304] 0 2023-12-16T05:56:41.401 INFO:tasks.workunit.client.0.smithi155.stdout:3/638: dread d0/d14/d87/d94/da1/d73/f84 [0,4194304] 0 2023-12-16T05:56:41.402 INFO:tasks.workunit.client.1.smithi156.stdout:8/492: read d3/f5c [2379247,6447] 0 2023-12-16T05:56:41.404 INFO:tasks.workunit.client.1.smithi156.stdout:1/545: creat d3/d1b/d27/d4f/d75/fb7 x:0 0 0 2023-12-16T05:56:41.404 INFO:tasks.workunit.client.1.smithi156.stdout:1/546: fdatasync d3/d17/d19/f58 0 2023-12-16T05:56:41.405 INFO:tasks.workunit.client.1.smithi156.stdout:1/547: creat d3/d3a/db1/fb8 x:0 0 0 2023-12-16T05:56:41.408 INFO:tasks.workunit.client.1.smithi156.stdout:9/623: dwrite d6/d19/d25/f38 [0,4194304] 0 2023-12-16T05:56:41.408 INFO:tasks.workunit.client.1.smithi156.stdout:9/624: stat d6/d19/d25/d3a/f4e 0 2023-12-16T05:56:41.408 INFO:tasks.workunit.client.1.smithi156.stdout:4/608: dwrite d9/f28 [0,4194304] 0 2023-12-16T05:56:41.409 INFO:tasks.workunit.client.0.smithi155.stdout:7/750: dwrite d0/d6a/d1a/d22/f23 [0,4194304] 0 2023-12-16T05:56:41.409 INFO:tasks.workunit.client.0.smithi155.stdout:7/751: chown d0/f15 1607883636 1 2023-12-16T05:56:41.409 INFO:tasks.workunit.client.1.smithi156.stdout:7/849: dwrite d1e/d55/d71/d61/dac/fd4 [4194304,4194304] 0 2023-12-16T05:56:41.410 INFO:tasks.workunit.client.1.smithi156.stdout:9/625: rmdir d6/d2e/d8a 39 2023-12-16T05:56:41.411 INFO:tasks.workunit.client.0.smithi155.stdout:7/752: symlink d0/d6a/d1a/d8c/d42/d98/db1/lf3 0 2023-12-16T05:56:41.411 INFO:tasks.workunit.client.0.smithi155.stdout:7/753: write d0/d6a/d1a/d22/f91 [4691798,95650] 0 2023-12-16T05:56:41.412 INFO:tasks.workunit.client.0.smithi155.stdout:5/896: truncate d0/d2/d2a/f45 2061137 0 2023-12-16T05:56:41.412 INFO:tasks.workunit.client.0.smithi155.stdout:5/897: readlink d0/d2/d2a/d30/d53/d7b/d99/d47/la5 0 2023-12-16T05:56:41.412 INFO:tasks.workunit.client.0.smithi155.stdout:5/898: chown d0/d2/d2a/d19/dd7/l10a 3 1 2023-12-16T05:56:41.413 INFO:tasks.workunit.client.0.smithi155.stdout:5/899: write d0/d2/d2a/d19/d21/f6a [1100864,3031] 0 2023-12-16T05:56:41.415 INFO:tasks.workunit.client.0.smithi155.stdout:7/754: rename d0/d1b/d78/fcc to d0/d6a/d31/de8/ff4 0 2023-12-16T05:56:41.417 INFO:tasks.workunit.client.0.smithi155.stdout:7/755: symlink d0/d6a/d1a/d8c/d34/d4b/d64/d6f/lf5 0 2023-12-16T05:56:41.417 INFO:tasks.workunit.client.0.smithi155.stdout:7/756: read - d0/d6a/d1a/d8c/d42/d98/fbf zero size 2023-12-16T05:56:41.419 INFO:tasks.workunit.client.0.smithi155.stdout:4/781: sync 2023-12-16T05:56:41.419 INFO:tasks.workunit.client.0.smithi155.stdout:4/782: chown d0/da/de0/d16/d1a/d70/d92/ffa 8583 1 2023-12-16T05:56:41.420 INFO:tasks.workunit.client.1.smithi156.stdout:4/609: symlink d9/d2b/d98/d99/ld0 0 2023-12-16T05:56:41.420 INFO:tasks.workunit.client.1.smithi156.stdout:4/610: chown d9/d43/d58/d7d/d82/cb8 186 1 2023-12-16T05:56:41.420 INFO:tasks.workunit.client.1.smithi156.stdout:4/611: readlink d9/d2b/d98/d99/ld0 0 2023-12-16T05:56:41.420 INFO:tasks.workunit.client.1.smithi156.stdout:4/612: truncate d9/d2b/d35/fb5 710205 0 2023-12-16T05:56:41.422 INFO:tasks.workunit.client.1.smithi156.stdout:4/613: unlink d9/d43/d58/f89 0 2023-12-16T05:56:41.423 INFO:tasks.workunit.client.1.smithi156.stdout:4/614: creat d9/d2c/d7a/dc0/fd1 x:0 0 0 2023-12-16T05:56:41.427 INFO:tasks.workunit.client.0.smithi155.stdout:7/757: dread d0/d6a/d1a/d8c/d34/d4b/d64/d6f/f81 [0,4194304] 0 2023-12-16T05:56:41.438 INFO:tasks.workunit.client.1.smithi156.stdout:4/615: dread d9/f19 [0,4194304] 0 2023-12-16T05:56:41.439 INFO:tasks.workunit.client.1.smithi156.stdout:4/616: chown d9/f38 4103938 1 2023-12-16T05:56:41.440 INFO:tasks.workunit.client.1.smithi156.stdout:9/626: dwrite d6/f1e [4194304,4194304] 0 2023-12-16T05:56:41.440 INFO:tasks.workunit.client.1.smithi156.stdout:9/627: fdatasync d6/d19/d30/d48/f75 0 2023-12-16T05:56:41.440 INFO:tasks.workunit.client.1.smithi156.stdout:9/628: readlink d6/d19/d25/l63 0 2023-12-16T05:56:41.440 INFO:tasks.workunit.client.0.smithi155.stdout:7/758: dread d0/f15 [0,4194304] 0 2023-12-16T05:56:41.441 INFO:tasks.workunit.client.0.smithi155.stdout:5/900: dwrite d0/d2/d2a/d19/d71/f7e [0,4194304] 0 2023-12-16T05:56:41.445 INFO:tasks.workunit.client.0.smithi155.stdout:4/783: dwrite d0/da/de0/d16/d30/dce/d75/f45 [0,4194304] 0 2023-12-16T05:56:41.446 INFO:tasks.workunit.client.1.smithi156.stdout:5/817: sync 2023-12-16T05:56:41.446 INFO:tasks.workunit.client.1.smithi156.stdout:5/818: truncate da/dc/f19 801824 0 2023-12-16T05:56:41.446 INFO:tasks.workunit.client.1.smithi156.stdout:5/819: truncate da/dc/d2d/d4d/d54/d67/f107 937364 0 2023-12-16T05:56:41.446 INFO:tasks.workunit.client.1.smithi156.stdout:3/576: sync 2023-12-16T05:56:41.446 INFO:tasks.workunit.client.1.smithi156.stdout:3/577: dread - dc/d10/d1d/fa3 zero size 2023-12-16T05:56:41.446 INFO:tasks.workunit.client.1.smithi156.stdout:3/578: fdatasync dc/df/d34/d62/f9a 0 2023-12-16T05:56:41.446 INFO:tasks.workunit.client.1.smithi156.stdout:0/712: sync 2023-12-16T05:56:41.446 INFO:tasks.workunit.client.1.smithi156.stdout:2/674: sync 2023-12-16T05:56:41.446 INFO:tasks.workunit.client.1.smithi156.stdout:2/675: stat d9/d68 0 2023-12-16T05:56:41.446 INFO:tasks.workunit.client.1.smithi156.stdout:6/645: sync 2023-12-16T05:56:41.447 INFO:tasks.workunit.client.0.smithi155.stdout:4/784: dread d0/da/de0/d16/d30/dce/d75/d89/fc9 [0,4194304] 0 2023-12-16T05:56:41.448 INFO:tasks.workunit.client.0.smithi155.stdout:4/785: mkdir d0/d10/def/dff 0 2023-12-16T05:56:41.450 INFO:tasks.workunit.client.0.smithi155.stdout:4/786: creat d0/da/de0/d16/d30/dce/d75/f100 x:0 0 0 2023-12-16T05:56:41.450 INFO:tasks.workunit.client.0.smithi155.stdout:4/787: fsync d0/da/de0/d16/d30/f33 0 2023-12-16T05:56:41.451 INFO:tasks.workunit.client.1.smithi156.stdout:3/579: creat dc/d56/d67/d6e/fd6 x:0 0 0 2023-12-16T05:56:41.451 INFO:tasks.workunit.client.1.smithi156.stdout:3/580: fsync dc/d10/d1d/d4b/d52/fae 0 2023-12-16T05:56:41.452 INFO:tasks.workunit.client.0.smithi155.stdout:5/901: dread d0/d2/d2a/d19/d71/f7e [0,4194304] 0 2023-12-16T05:56:41.452 INFO:tasks.workunit.client.0.smithi155.stdout:5/902: write d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/dd9/d11f/f55 [9195966,28788] 0 2023-12-16T05:56:41.452 INFO:tasks.workunit.client.0.smithi155.stdout:4/788: rename d0/da/de0/d16/d1a/d70/lca to d0/da/de0/d16/d1a/l101 0 2023-12-16T05:56:41.453 INFO:tasks.workunit.client.1.smithi156.stdout:0/713: mknod d2/d7/dd/d2d/d5e/d8f/cdf 0 2023-12-16T05:56:41.453 INFO:tasks.workunit.client.1.smithi156.stdout:0/714: stat d2/d7/dd/d1c/f36 0 2023-12-16T05:56:41.453 INFO:tasks.workunit.client.0.smithi155.stdout:7/759: rmdir d0/d6a/d1a/d8c/d34 39 2023-12-16T05:56:41.454 INFO:tasks.workunit.client.1.smithi156.stdout:4/617: dwrite d9/f38 [0,4194304] 0 2023-12-16T05:56:41.454 INFO:tasks.workunit.client.1.smithi156.stdout:6/646: creat d9/d1c/d50/fc3 x:0 0 0 2023-12-16T05:56:41.454 INFO:tasks.workunit.client.1.smithi156.stdout:6/647: chown d9/d13/d2f/d51/dad 46121791 1 2023-12-16T05:56:41.455 INFO:tasks.workunit.client.0.smithi155.stdout:4/789: symlink d0/da/de0/d16/d30/dce/d7b/de2/l102 0 2023-12-16T05:56:41.456 INFO:tasks.workunit.client.1.smithi156.stdout:0/715: creat d2/d7/dd/d2d/d5e/dc4/fe0 x:0 0 0 2023-12-16T05:56:41.456 INFO:tasks.workunit.client.0.smithi155.stdout:5/903: write d0/d2/d2a/d30/d53/d7b/d99/fca [1293474,65137] 0 2023-12-16T05:56:41.457 INFO:tasks.workunit.client.0.smithi155.stdout:5/904: fdatasync d0/d2/d2a/fda 0 2023-12-16T05:56:41.459 INFO:tasks.workunit.client.0.smithi155.stdout:5/905: symlink d0/d2/d2a/d30/d53/d7b/d99/l122 0 2023-12-16T05:56:41.459 INFO:tasks.workunit.client.0.smithi155.stdout:5/906: write d0/d60/d79/d8e/fdf [769397,58278] 0 2023-12-16T05:56:41.459 INFO:tasks.workunit.client.0.smithi155.stdout:7/760: dread d0/d6a/d31/de8/ff4 [0,4194304] 0 2023-12-16T05:56:41.459 INFO:tasks.workunit.client.0.smithi155.stdout:7/761: truncate d0/d6a/d31/de8/ff4 4487472 0 2023-12-16T05:56:41.461 INFO:tasks.workunit.client.0.smithi155.stdout:7/762: creat d0/d6a/d1a/d38/d4f/ff6 x:0 0 0 2023-12-16T05:56:41.464 INFO:tasks.workunit.client.1.smithi156.stdout:3/581: dread dc/f19 [0,4194304] 0 2023-12-16T05:56:41.464 INFO:tasks.workunit.client.1.smithi156.stdout:3/582: write fb [3691563,38628] 0 2023-12-16T05:56:41.465 INFO:tasks.workunit.client.1.smithi156.stdout:6/648: dread d9/d13/d2f/d51/f91 [0,4194304] 0 2023-12-16T05:56:41.465 INFO:tasks.workunit.client.1.smithi156.stdout:6/649: chown d9/f35 310 1 2023-12-16T05:56:41.467 INFO:tasks.workunit.client.1.smithi156.stdout:5/820: dwrite da/dc/d4b/d6c/d81/f83 [4194304,4194304] 0 2023-12-16T05:56:41.469 INFO:tasks.workunit.client.0.smithi155.stdout:4/790: rename d0/da/de0/d16/d30/dce/d7b to d0/da/de0/d16/d30/d52/d88/d9e/d103 0 2023-12-16T05:56:41.470 INFO:tasks.workunit.client.1.smithi156.stdout:2/676: dwrite d9/d68/daa/d83/f84 [0,4194304] 0 2023-12-16T05:56:41.471 INFO:tasks.workunit.client.1.smithi156.stdout:0/716: dread d2/d7/dd/d2d/f9a [0,4194304] 0 2023-12-16T05:56:41.472 INFO:tasks.workunit.client.0.smithi155.stdout:4/791: getdents d0/da/de0/d16/d30/dce/d75/d89 0 2023-12-16T05:56:41.472 INFO:tasks.workunit.client.1.smithi156.stdout:6/650: creat d9/d13/d2f/d51/d82/fc4 x:0 0 0 2023-12-16T05:56:41.474 INFO:tasks.workunit.client.0.smithi155.stdout:4/792: dread d0/da/de0/d16/d30/dce/d75/d3d/ffc [0,4194304] 0 2023-12-16T05:56:41.475 INFO:tasks.workunit.client.0.smithi155.stdout:4/793: unlink d0/da/de0/d16/d30/dce/d75/d89/d9a/fb5 0 2023-12-16T05:56:41.475 INFO:tasks.workunit.client.0.smithi155.stdout:4/794: chown d0/da/f5e 3629635 1 2023-12-16T05:56:41.477 INFO:tasks.workunit.client.0.smithi155.stdout:7/763: dwrite d0/d6a/d31/fcf [0,4194304] 0 2023-12-16T05:56:41.482 INFO:tasks.workunit.client.0.smithi155.stdout:7/764: rename d0/d6a/d1a/d2b/d2c/d5d/cbc to d0/d6a/d85/cf7 0 2023-12-16T05:56:41.482 INFO:tasks.workunit.client.0.smithi155.stdout:7/765: write d0/d6a/d1a/d22/f25 [4355997,100508] 0 2023-12-16T05:56:41.482 INFO:tasks.workunit.client.0.smithi155.stdout:7/766: fsync d0/d6a/d1a/d38/f9d 0 2023-12-16T05:56:41.482 INFO:tasks.workunit.client.0.smithi155.stdout:7/767: chown d0/d6a/d1a/d2b/d2c/d5d/l6d 9177 1 2023-12-16T05:56:41.482 INFO:tasks.workunit.client.0.smithi155.stdout:7/768: readlink d0/d6a/d1a/d2b/d2c/leb 0 2023-12-16T05:56:41.485 INFO:tasks.workunit.client.0.smithi155.stdout:7/769: rename d0/d6a/f30 to d0/d6a/d1a/d8c/d34/d4b/d64/d6f/dba/ff8 0 2023-12-16T05:56:41.485 INFO:tasks.workunit.client.0.smithi155.stdout:7/770: chown d0/d6a/d1a/d2b/d2c/d5d/c7a 0 1 2023-12-16T05:56:41.486 INFO:tasks.workunit.client.1.smithi156.stdout:6/651: dread f8 [0,4194304] 0 2023-12-16T05:56:41.486 INFO:tasks.workunit.client.1.smithi156.stdout:6/652: fdatasync d9/d13/d2f/d36/f63 0 2023-12-16T05:56:41.486 INFO:tasks.workunit.client.1.smithi156.stdout:6/653: chown d9/d13/d3e/d5f/d6e 267073675 1 2023-12-16T05:56:41.486 INFO:tasks.workunit.client.1.smithi156.stdout:3/583: dwrite dc/d10/d3d/f38 [0,4194304] 0 2023-12-16T05:56:41.487 INFO:tasks.workunit.client.0.smithi155.stdout:7/771: creat d0/d6a/d1a/d22/dc8/ff9 x:0 0 0 2023-12-16T05:56:41.488 INFO:tasks.workunit.client.0.smithi155.stdout:4/795: dread d0/d10/f3b [0,4194304] 0 2023-12-16T05:56:41.488 INFO:tasks.workunit.client.0.smithi155.stdout:4/796: chown d0/da/de0/d16/d30/d52/d88/d9e/la1 734233399 1 2023-12-16T05:56:41.488 INFO:tasks.workunit.client.0.smithi155.stdout:4/797: truncate d0/da/de0/d16/d30/d52/d88/f94 1243881 0 2023-12-16T05:56:41.488 INFO:tasks.workunit.client.0.smithi155.stdout:4/798: chown d0/da/de0/d16/d30/d52 9723 1 2023-12-16T05:56:41.489 INFO:tasks.workunit.client.0.smithi155.stdout:7/772: mkdir d0/dfa 0 2023-12-16T05:56:41.489 INFO:tasks.workunit.client.0.smithi155.stdout:7/773: fdatasync d0/d1/fb 0 2023-12-16T05:56:41.489 INFO:tasks.workunit.client.0.smithi155.stdout:7/774: readlink d0/d6a/d1a/d8c/d34/d4b/d64/d6f/dba/led 0 2023-12-16T05:56:41.493 INFO:tasks.workunit.client.0.smithi155.stdout:4/799: link d0/da/de0/d16/d30/dce/d75/d3d/d49/l53 d0/da/de0/d16/d30/dce/d75/d3d/d85/l104 0 2023-12-16T05:56:41.493 INFO:tasks.workunit.client.0.smithi155.stdout:4/800: stat d0/da/de0/d16/d30/dce/d75/d86 0 2023-12-16T05:56:41.493 INFO:tasks.workunit.client.0.smithi155.stdout:4/801: read - d0/da/de0/d16/ff6 zero size 2023-12-16T05:56:41.493 INFO:tasks.workunit.client.0.smithi155.stdout:5/907: dwrite d0/d2/d2a/d19/d21/f6a [8388608,4194304] 0 2023-12-16T05:56:41.494 INFO:tasks.workunit.client.0.smithi155.stdout:4/802: symlink d0/da/de0/d16/d1a/d70/d92/daf/db7/dfd/l105 0 2023-12-16T05:56:41.494 INFO:tasks.workunit.client.0.smithi155.stdout:5/908: mkdir d0/d60/d79/d8e/d123 0 2023-12-16T05:56:41.494 INFO:tasks.workunit.client.0.smithi155.stdout:4/803: symlink d0/da/de0/d16/de8/l106 0 2023-12-16T05:56:41.496 INFO:tasks.workunit.client.0.smithi155.stdout:5/909: link d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/dd9/d11f/f55 d0/d2/d2a/d30/d53/f124 0 2023-12-16T05:56:41.496 INFO:tasks.workunit.client.0.smithi155.stdout:5/910: fdatasync d0/f1c 0 2023-12-16T05:56:41.497 INFO:tasks.workunit.client.0.smithi155.stdout:4/804: creat d0/da/de0/d16/d30/dcd/f107 x:0 0 0 2023-12-16T05:56:41.498 INFO:tasks.workunit.client.0.smithi155.stdout:7/775: dread d0/d6a/d1a/d8c/d34/d4b/f51 [0,4194304] 0 2023-12-16T05:56:41.498 INFO:tasks.workunit.client.0.smithi155.stdout:7/776: dread - d0/d6a/d1a/d38/fc0 zero size 2023-12-16T05:56:41.498 INFO:tasks.workunit.client.0.smithi155.stdout:7/777: truncate d0/d6a/d1a/d38/d4f/ff6 573740 0 2023-12-16T05:56:41.498 INFO:tasks.workunit.client.0.smithi155.stdout:5/911: symlink d0/d2/d2a/d30/d53/d7b/d99/d47/d61/l125 0 2023-12-16T05:56:41.499 INFO:tasks.workunit.client.0.smithi155.stdout:4/805: unlink d0/da/de0/d16/d30/dcd/f107 0 2023-12-16T05:56:41.499 INFO:tasks.workunit.client.0.smithi155.stdout:4/806: fsync d0/da/de0/d16/d30/fc5 0 2023-12-16T05:56:41.499 INFO:tasks.workunit.client.0.smithi155.stdout:4/807: chown d0/da/de0/d16/d1a/d70/cee 1162627 1 2023-12-16T05:56:41.499 INFO:tasks.workunit.client.0.smithi155.stdout:4/808: stat d0/da/de0/d16/d1a/d70/d92/fde 0 2023-12-16T05:56:41.499 INFO:tasks.workunit.client.0.smithi155.stdout:4/809: fdatasync d0/da/de0/d16/d1a/f5c 0 2023-12-16T05:56:41.500 INFO:tasks.workunit.client.0.smithi155.stdout:7/778: creat d0/d6a/d1a/d8c/ffb x:0 0 0 2023-12-16T05:56:41.500 INFO:tasks.workunit.client.0.smithi155.stdout:4/810: creat d0/da/de0/d16/d30/dcd/f108 x:0 0 0 2023-12-16T05:56:41.503 INFO:tasks.workunit.client.0.smithi155.stdout:4/811: symlink d0/da/de0/d16/d30/dce/d75/d3d/d49/l109 0 2023-12-16T05:56:41.513 INFO:tasks.workunit.client.0.smithi155.stdout:4/812: rename d0/da/de0/d16/de8 to d0/d10/def/dff/d10a 0 2023-12-16T05:56:41.513 INFO:tasks.workunit.client.1.smithi156.stdout:5/821: creat da/dc/d2d/d4d/db9/dc9/dfa/f10a x:0 0 0 2023-12-16T05:56:41.514 INFO:tasks.workunit.client.0.smithi155.stdout:4/813: creat d0/da/de0/f10b x:0 0 0 2023-12-16T05:56:41.516 INFO:tasks.workunit.client.1.smithi156.stdout:2/677: rmdir d9/d68 39 2023-12-16T05:56:41.518 INFO:tasks.workunit.client.1.smithi156.stdout:0/717: rename d2/d47/f46 to d2/d7/dd/d29/d38/dad/fe1 0 2023-12-16T05:56:41.520 INFO:tasks.workunit.client.1.smithi156.stdout:6/654: creat d9/d1c/d50/dbf/fc5 x:0 0 0 2023-12-16T05:56:41.520 INFO:tasks.workunit.client.1.smithi156.stdout:6/655: stat d9/d13/d2f/f34 0 2023-12-16T05:56:41.520 INFO:tasks.workunit.client.1.smithi156.stdout:6/656: truncate d9/d13/d2f/d51/d6b/d77/d7e/f87 350012 0 2023-12-16T05:56:41.522 INFO:tasks.workunit.client.1.smithi156.stdout:3/584: creat dc/d10/db4/fd7 x:0 0 0 2023-12-16T05:56:41.523 INFO:tasks.workunit.client.1.smithi156.stdout:3/585: write dc/df/d34/d62/f8d [494863,94832] 0 2023-12-16T05:56:41.524 INFO:tasks.workunit.client.0.smithi155.stdout:5/912: dwrite d0/d2/d2a/d30/d53/f124 [4194304,4194304] 0 2023-12-16T05:56:41.525 INFO:tasks.workunit.client.0.smithi155.stdout:5/913: mkdir d0/d2/d2a/d30/d53/d7b/d99/d47/d61/de1/d126 0 2023-12-16T05:56:41.526 INFO:tasks.workunit.client.0.smithi155.stdout:5/914: symlink d0/d2/d2a/d19/dd7/l127 0 2023-12-16T05:56:41.526 INFO:tasks.workunit.client.0.smithi155.stdout:5/915: readlink d0/l29 0 2023-12-16T05:56:41.526 INFO:tasks.workunit.client.0.smithi155.stdout:5/916: fdatasync d0/d2/d2a/d30/d53/d7b/db3/fcb 0 2023-12-16T05:56:41.527 INFO:tasks.workunit.client.1.smithi156.stdout:5/822: creat da/d9a/dcd/f10b x:0 0 0 2023-12-16T05:56:41.527 INFO:tasks.workunit.client.1.smithi156.stdout:0/718: getdents d2/d7/dd/d29/d4b/dc0 0 2023-12-16T05:56:41.527 INFO:tasks.workunit.client.1.smithi156.stdout:0/719: chown d2/d7/dd/d29/c9b 2243 1 2023-12-16T05:56:41.529 INFO:tasks.workunit.client.0.smithi155.stdout:7/779: dwrite d0/fe3 [0,4194304] 0 2023-12-16T05:56:41.531 INFO:tasks.workunit.client.1.smithi156.stdout:6/657: creat d9/d13/d2f/d51/fc6 x:0 0 0 2023-12-16T05:56:41.532 INFO:tasks.workunit.client.1.smithi156.stdout:0/720: creat d2/d7/dd/d1c/fe2 x:0 0 0 2023-12-16T05:56:41.534 INFO:tasks.workunit.client.1.smithi156.stdout:6/658: creat d9/d13/d2f/d51/d6b/d77/fc7 x:0 0 0 2023-12-16T05:56:41.536 INFO:tasks.workunit.client.0.smithi155.stdout:7/780: write d0/d1b/dbe/fc4 [1794826,44228] 0 2023-12-16T05:56:41.536 INFO:tasks.workunit.client.0.smithi155.stdout:7/781: write d0/d1/fef [305183,96933] 0 2023-12-16T05:56:41.537 INFO:tasks.workunit.client.1.smithi156.stdout:0/721: dread d2/ff [0,4194304] 0 2023-12-16T05:56:41.537 INFO:tasks.workunit.client.0.smithi155.stdout:4/814: dwrite d0/da/de0/d16/d1a/d70/d92/daf/fb8 [0,4194304] 0 2023-12-16T05:56:41.539 INFO:tasks.workunit.client.0.smithi155.stdout:7/782: mknod d0/d6a/d1a/d8c/d34/d4b/d64/d6f/dba/dc9/cfc 0 2023-12-16T05:56:41.539 INFO:tasks.workunit.client.1.smithi156.stdout:0/722: symlink d2/d7/dd/d29/d38/d51/d52/d88/dbc/dd2/le3 0 2023-12-16T05:56:41.539 INFO:tasks.workunit.client.1.smithi156.stdout:0/723: chown d2/d7/dd/d2d/d5e/l7d 0 1 2023-12-16T05:56:41.543 INFO:tasks.workunit.client.1.smithi156.stdout:0/724: rmdir d2/d7/dd/d29/d38/d51/d69 0 2023-12-16T05:56:41.544 INFO:tasks.workunit.client.1.smithi156.stdout:2/678: dwrite d9/dd/d17/d33/dae/fb0 [0,4194304] 0 2023-12-16T05:56:41.544 INFO:tasks.workunit.client.1.smithi156.stdout:2/679: write d9/dd/d17/d33/d78/d39/f79 [489790,9201] 0 2023-12-16T05:56:41.544 INFO:tasks.workunit.client.0.smithi155.stdout:4/815: rename d0/da/de0/d16/d30/d52/d88/d9e/d103/dcb/fd0 to d0/f10c 0 2023-12-16T05:56:41.544 INFO:tasks.workunit.client.1.smithi156.stdout:0/725: creat d2/d7/dd/d29/d38/d51/d52/d88/dbc/dc2/fe4 x:0 0 0 2023-12-16T05:56:41.545 INFO:tasks.workunit.client.1.smithi156.stdout:0/726: chown d2/d7/dd/d2d/dcf/f99 1053 1 2023-12-16T05:56:41.545 INFO:tasks.workunit.client.1.smithi156.stdout:0/727: fdatasync d2/d7/dd/fd6 0 2023-12-16T05:56:41.545 INFO:tasks.workunit.client.1.smithi156.stdout:3/586: dwrite dc/d56/d67/d6e/fd1 [4194304,4194304] 0 2023-12-16T05:56:41.548 INFO:tasks.workunit.client.1.smithi156.stdout:2/680: getdents d9/d12/dc2/dd8 0 2023-12-16T05:56:41.548 INFO:tasks.workunit.client.1.smithi156.stdout:2/681: fsync d9/d12/dc2/dd8/da6/f6f 0 2023-12-16T05:56:41.548 INFO:tasks.workunit.client.1.smithi156.stdout:2/682: readlink d9/dd/d17/d33/d78/d74/l92 0 2023-12-16T05:56:41.548 INFO:tasks.workunit.client.1.smithi156.stdout:0/728: rmdir d2/d7/dd/d29/d38/d3f/d44 39 2023-12-16T05:56:41.549 INFO:tasks.workunit.client.1.smithi156.stdout:3/587: creat dc/d10/d3d/db5/fd8 x:0 0 0 2023-12-16T05:56:41.551 INFO:tasks.workunit.client.1.smithi156.stdout:5/823: dwrite da/dc/f21 [0,4194304] 0 2023-12-16T05:56:41.551 INFO:tasks.workunit.client.1.smithi156.stdout:5/824: chown da/dc/d2d/d34/c4e 63064 1 2023-12-16T05:56:41.553 INFO:tasks.workunit.client.1.smithi156.stdout:0/729: dread d2/f28 [0,4194304] 0 2023-12-16T05:56:41.553 INFO:tasks.workunit.client.1.smithi156.stdout:6/659: rmdir d9/d13/d2f/d51/d6b/d77 39 2023-12-16T05:56:41.555 INFO:tasks.workunit.client.1.smithi156.stdout:0/730: mknod d2/d7/dd/d29/d38/dae/ce5 0 2023-12-16T05:56:41.557 INFO:tasks.workunit.client.1.smithi156.stdout:0/731: write d2/d7/dd/d29/f89 [72153,85173] 0 2023-12-16T05:56:41.557 INFO:tasks.workunit.client.1.smithi156.stdout:6/660: creat d9/fc8 x:0 0 0 2023-12-16T05:56:41.557 INFO:tasks.workunit.client.0.smithi155.stdout:4/816: dwrite d0/da/de0/d16/d30/dce/d75/d89/d9a/f9c [4194304,4194304] 0 2023-12-16T05:56:41.557 INFO:tasks.workunit.client.0.smithi155.stdout:4/817: write d0/da/de0/d16/d30/dce/d75/f100 [579230,81890] 0 2023-12-16T05:56:41.559 INFO:tasks.workunit.client.0.smithi155.stdout:4/818: getdents d0/da/de0/d16/d30/d52 0 2023-12-16T05:56:41.560 INFO:tasks.workunit.client.0.smithi155.stdout:4/819: mknod d0/da/de0/d16/d30/dce/d75/d3d/d85/c10d 0 2023-12-16T05:56:41.570 INFO:tasks.workunit.client.1.smithi156.stdout:3/588: dwrite dc/d10/f82 [0,4194304] 0 2023-12-16T05:56:41.570 INFO:tasks.workunit.client.1.smithi156.stdout:3/589: truncate dc/df/d70/faa 609065 0 2023-12-16T05:56:41.572 INFO:tasks.workunit.client.1.smithi156.stdout:3/590: mkdir dc/d56/d67/dbe/dd9 0 2023-12-16T05:56:41.572 INFO:tasks.workunit.client.1.smithi156.stdout:3/591: readlink l9 0 2023-12-16T05:56:41.573 INFO:tasks.workunit.client.0.smithi155.stdout:4/820: dread d0/da/f73 [0,4194304] 0 2023-12-16T05:56:41.573 INFO:tasks.workunit.client.1.smithi156.stdout:3/592: creat dc/df/d66/fda x:0 0 0 2023-12-16T05:56:41.574 INFO:tasks.workunit.client.1.smithi156.stdout:3/593: dread dc/df/d70/fbd [0,4194304] 0 2023-12-16T05:56:41.574 INFO:tasks.workunit.client.1.smithi156.stdout:3/594: fsync dc/df/dce/fd2 0 2023-12-16T05:56:41.574 INFO:tasks.workunit.client.1.smithi156.stdout:3/595: readlink dc/df/l17 0 2023-12-16T05:56:41.575 INFO:tasks.workunit.client.0.smithi155.stdout:4/821: rename d0/da/de0/d16/d1a to d0/da/de0/d16/d30/dce/d75/d10e 0 2023-12-16T05:56:41.575 INFO:tasks.workunit.client.0.smithi155.stdout:4/822: creat d0/da/de0/d16/d30/dce/d75/d3d/d49/dbb/f10f x:0 0 0 2023-12-16T05:56:41.576 INFO:tasks.workunit.client.1.smithi156.stdout:0/732: dwrite d2/d7/dd/d2d/d5e/dc4/fe0 [0,4194304] 0 2023-12-16T05:56:41.576 INFO:tasks.workunit.client.1.smithi156.stdout:3/596: rename dc/d10/d3d/f39 to dc/d56/fdb 0 2023-12-16T05:56:41.577 INFO:tasks.workunit.client.0.smithi155.stdout:2/788: sync 2023-12-16T05:56:41.577 INFO:tasks.workunit.client.0.smithi155.stdout:2/789: readlink d0/d7/dd/l3f 0 2023-12-16T05:56:41.577 INFO:tasks.workunit.client.0.smithi155.stdout:2/790: chown d0/d7/dd/d49/d4b/cfb 5305 1 2023-12-16T05:56:41.581 INFO:tasks.workunit.client.1.smithi156.stdout:3/597: creat dc/d56/d67/fdc x:0 0 0 2023-12-16T05:56:41.581 INFO:tasks.workunit.client.1.smithi156.stdout:6/661: dwrite d9/d13/d2f/d51/d82/fc2 [0,4194304] 0 2023-12-16T05:56:41.583 INFO:tasks.workunit.client.1.smithi156.stdout:0/733: rename d2/d7/dd/d29/d38/d51/d65/cb7 to d2/d7/dd/d29/d38/ce6 0 2023-12-16T05:56:41.585 INFO:tasks.workunit.client.1.smithi156.stdout:6/662: write d9/f35 [1662597,81638] 0 2023-12-16T05:56:41.586 INFO:tasks.workunit.client.1.smithi156.stdout:3/598: link dc/f14 dc/df/d66/fdd 0 2023-12-16T05:56:41.588 INFO:tasks.workunit.client.1.smithi156.stdout:0/734: symlink d2/d47/le7 0 2023-12-16T05:56:41.588 INFO:tasks.workunit.client.1.smithi156.stdout:0/735: truncate d2/d7/dd/d1c/f36 1527088 0 2023-12-16T05:56:41.588 INFO:tasks.workunit.client.1.smithi156.stdout:0/736: stat d2/d7/dd/d66/l7c 0 2023-12-16T05:56:41.590 INFO:tasks.workunit.client.1.smithi156.stdout:3/599: symlink dc/d56/d67/dbe/dd9/lde 0 2023-12-16T05:56:41.590 INFO:tasks.workunit.client.1.smithi156.stdout:3/600: readlink dc/d10/d1d/d4b/dac/ld4 0 2023-12-16T05:56:41.590 INFO:tasks.workunit.client.1.smithi156.stdout:0/737: creat d2/d7/dd/d29/d38/d51/d52/fe8 x:0 0 0 2023-12-16T05:56:41.591 INFO:tasks.workunit.client.1.smithi156.stdout:3/601: unlink dc/df/l17 0 2023-12-16T05:56:41.606 INFO:tasks.workunit.client.1.smithi156.stdout:0/738: dwrite d2/d7/dd/f96 [0,4194304] 0 2023-12-16T05:56:41.608 INFO:tasks.workunit.client.1.smithi156.stdout:0/739: symlink d2/d7/dd/d2d/dcf/dd0/le9 0 2023-12-16T05:56:41.612 INFO:tasks.workunit.client.1.smithi156.stdout:0/740: dread d2/d7/dd/d29/d2e/f57 [0,4194304] 0 2023-12-16T05:56:41.612 INFO:tasks.workunit.client.1.smithi156.stdout:0/741: chown d2/d7/dd/d29/fd4 263534 1 2023-12-16T05:56:41.612 INFO:tasks.workunit.client.1.smithi156.stdout:0/742: truncate d2/d7/dd/d29/fd4 114021 0 2023-12-16T05:56:41.612 INFO:tasks.workunit.client.1.smithi156.stdout:0/743: write d2/d7/dd/d29/d2e/f57 [3069473,399] 0 2023-12-16T05:56:41.612 INFO:tasks.workunit.client.1.smithi156.stdout:0/744: read - d2/d7/dd/d29/d38/d51/d65/d7e/fdc zero size 2023-12-16T05:56:41.612 INFO:tasks.workunit.client.1.smithi156.stdout:0/745: chown d2/d7/dd/d29/d38/d51/d52/d88/dbc/dd2 462126 1 2023-12-16T05:56:41.771 INFO:tasks.workunit.client.0.smithi155.stdout:2/791: dwrite d0/d7/d57/d63/de7/fa1 [0,4194304] 0 2023-12-16T05:56:41.772 INFO:tasks.workunit.client.0.smithi155.stdout:2/792: mkdir d0/d7/d57/d63/de7/d109 0 2023-12-16T05:56:41.772 INFO:tasks.workunit.client.0.smithi155.stdout:4/823: dwrite d0/da/de0/d16/ff6 [0,4194304] 0 2023-12-16T05:56:41.772 INFO:tasks.workunit.client.0.smithi155.stdout:4/824: readlink d0/da/de0/d16/l21 0 2023-12-16T05:56:41.773 INFO:tasks.workunit.client.1.smithi156.stdout:3/602: dwrite dc/d10/d3d/f87 [0,4194304] 0 2023-12-16T05:56:41.773 INFO:tasks.workunit.client.1.smithi156.stdout:6/663: dwrite d9/d1c/f2c [0,4194304] 0 2023-12-16T05:56:41.774 INFO:tasks.workunit.client.1.smithi156.stdout:0/746: dwrite d2/d7/dd/d29/d38/d51/d65/d7e/fdc [0,4194304] 0 2023-12-16T05:56:41.774 INFO:tasks.workunit.client.1.smithi156.stdout:0/747: chown d2/d7/dd/d29/d38/d51/d52/d88/dbc/dc2 25015 1 2023-12-16T05:56:41.774 INFO:tasks.workunit.client.1.smithi156.stdout:3/603: mknod dc/d10/d1d/db2/cdf 0 2023-12-16T05:56:41.774 INFO:tasks.workunit.client.1.smithi156.stdout:3/604: readlink dc/df/d34/d62/d75/lab 0 2023-12-16T05:56:41.775 INFO:tasks.workunit.client.0.smithi155.stdout:4/825: mkdir d0/da/de0/d16/d30/dce/d75/d3d/d110 0 2023-12-16T05:56:41.776 INFO:tasks.workunit.client.0.smithi155.stdout:2/793: mkdir d0/d5/d6/d10a 0 2023-12-16T05:56:41.778 INFO:tasks.workunit.client.0.smithi155.stdout:4/826: creat d0/da/de0/d16/d30/dcd/f111 x:0 0 0 2023-12-16T05:56:41.779 INFO:tasks.workunit.client.0.smithi155.stdout:4/827: symlink d0/da/de0/d16/d30/dce/d75/d3d/d85/dac/l112 0 2023-12-16T05:56:41.779 INFO:tasks.workunit.client.1.smithi156.stdout:6/664: creat d9/d13/d3e/d5f/d6e/fc9 x:0 0 0 2023-12-16T05:56:41.780 INFO:tasks.workunit.client.0.smithi155.stdout:4/828: creat d0/da/de0/d16/d30/dce/d75/d10e/dd1/f113 x:0 0 0 2023-12-16T05:56:41.781 INFO:tasks.workunit.client.0.smithi155.stdout:4/829: symlink d0/da/de0/d16/d30/dce/d75/d10e/d70/d92/l114 0 2023-12-16T05:56:41.782 INFO:tasks.workunit.client.1.smithi156.stdout:0/748: rmdir d2/d23/d4a 39 2023-12-16T05:56:41.784 INFO:tasks.workunit.client.1.smithi156.stdout:3/605: mknod dc/df/d34/d62/ce0 0 2023-12-16T05:56:41.786 INFO:tasks.workunit.client.0.smithi155.stdout:2/794: dread d0/d7/d57/d9b/fb7 [0,4194304] 0 2023-12-16T05:56:41.786 INFO:tasks.workunit.client.0.smithi155.stdout:2/795: chown d0/d5/d6/d5f/df9 30987233 1 2023-12-16T05:56:41.787 INFO:tasks.workunit.client.1.smithi156.stdout:8/493: sync 2023-12-16T05:56:41.787 INFO:tasks.workunit.client.1.smithi156.stdout:1/548: sync 2023-12-16T05:56:41.787 INFO:tasks.workunit.client.1.smithi156.stdout:9/629: sync 2023-12-16T05:56:41.787 INFO:tasks.workunit.client.1.smithi156.stdout:9/630: write d6/d19/d30/d5b/f82 [4241328,93446] 0 2023-12-16T05:56:41.787 INFO:tasks.workunit.client.1.smithi156.stdout:9/631: chown d6/d19/d25/d3a/d5e/f67 4497 1 2023-12-16T05:56:41.788 INFO:tasks.workunit.client.0.smithi155.stdout:2/796: mknod d0/d7/dd/d49/d4b/d8c/dcd/c10b 0 2023-12-16T05:56:41.788 INFO:tasks.workunit.client.0.smithi155.stdout:2/797: chown d0/d7/dd/d49/d4b/c107 44405091 1 2023-12-16T05:56:41.788 INFO:tasks.workunit.client.0.smithi155.stdout:2/798: getdents d0/d7/dd/d49/d4b/d8c 0 2023-12-16T05:56:41.789 INFO:tasks.workunit.client.1.smithi156.stdout:7/850: sync 2023-12-16T05:56:41.790 INFO:tasks.workunit.client.1.smithi156.stdout:1/549: rename d3/c94 to d3/d17/daa/cb9 0 2023-12-16T05:56:41.790 INFO:tasks.workunit.client.1.smithi156.stdout:1/550: chown d3/d17/c77 19 1 2023-12-16T05:56:41.791 INFO:tasks.workunit.client.1.smithi156.stdout:9/632: dread d6/d19/d30/d48/d87/f9b [0,4194304] 0 2023-12-16T05:56:41.792 INFO:tasks.workunit.client.1.smithi156.stdout:0/749: dread d2/d23/d4a/f54 [0,4194304] 0 2023-12-16T05:56:41.792 INFO:tasks.workunit.client.1.smithi156.stdout:0/750: fsync d2/d7/dd/d2d/d5e/f94 0 2023-12-16T05:56:41.793 INFO:tasks.workunit.client.1.smithi156.stdout:0/751: write d2/d47/f80 [2220494,118708] 0 2023-12-16T05:56:41.793 INFO:tasks.workunit.client.1.smithi156.stdout:8/494: rename d3/d7/d27/l47 to d3/d7a/d7d/la7 0 2023-12-16T05:56:41.793 INFO:tasks.workunit.client.0.smithi155.stdout:0/936: sync 2023-12-16T05:56:41.793 INFO:tasks.workunit.client.0.smithi155.stdout:8/908: sync 2023-12-16T05:56:41.794 INFO:tasks.workunit.client.1.smithi156.stdout:9/633: creat d6/d19/d25/d3a/d88/fd5 x:0 0 0 2023-12-16T05:56:41.794 INFO:tasks.workunit.client.1.smithi156.stdout:0/752: rmdir d2/d7/dd/d2d/d5e/d8f/dc9 39 2023-12-16T05:56:41.794 INFO:tasks.workunit.client.0.smithi155.stdout:0/937: unlink d7/df/d6f/fa5 0 2023-12-16T05:56:41.795 INFO:tasks.workunit.client.0.smithi155.stdout:8/909: symlink d4/d62/d66/d78/d88/d1b/d2a/de2/l12d 0 2023-12-16T05:56:41.796 INFO:tasks.workunit.client.1.smithi156.stdout:8/495: creat d3/d7/d66/fa8 x:0 0 0 2023-12-16T05:56:41.798 INFO:tasks.workunit.client.0.smithi155.stdout:0/938: rename d7/d13/d45/f6c to d7/df/d73/d8d/d4d/de8/de5/f135 0 2023-12-16T05:56:41.798 INFO:tasks.workunit.client.0.smithi155.stdout:0/939: read - d7/df/d73/f12e zero size 2023-12-16T05:56:41.798 INFO:tasks.workunit.client.1.smithi156.stdout:9/634: creat d6/d19/d30/fd6 x:0 0 0 2023-12-16T05:56:41.798 INFO:tasks.workunit.client.1.smithi156.stdout:3/606: write dc/f23 [540156,57398] 0 2023-12-16T05:56:41.798 INFO:tasks.workunit.client.0.smithi155.stdout:8/910: creat d4/d62/d66/f12e x:0 0 0 2023-12-16T05:56:41.799 INFO:tasks.workunit.client.0.smithi155.stdout:8/911: fdatasync d4/d62/d66/d78/d88/d1b/d1c/d1a/f11c 0 2023-12-16T05:56:41.799 INFO:tasks.workunit.client.0.smithi155.stdout:8/912: fsync d4/d62/d66/d78/d88/d1b/d1c/d97/df3/df5/f128 0 2023-12-16T05:56:41.800 INFO:tasks.workunit.client.1.smithi156.stdout:0/753: creat d2/d7/dd/d29/d38/d51/d52/d88/fea x:0 0 0 2023-12-16T05:56:41.800 INFO:tasks.workunit.client.0.smithi155.stdout:0/940: creat d7/f136 x:0 0 0 2023-12-16T05:56:41.800 INFO:tasks.workunit.client.0.smithi155.stdout:0/941: dread - d7/df/d73/d8d/d4d/d115/d5d/f12d zero size 2023-12-16T05:56:41.800 INFO:tasks.workunit.client.0.smithi155.stdout:8/913: mknod d4/d62/c12f 0 2023-12-16T05:56:41.801 INFO:tasks.workunit.client.0.smithi155.stdout:0/942: rmdir d7/d13/d45/d3e 39 2023-12-16T05:56:41.801 INFO:tasks.workunit.client.1.smithi156.stdout:8/496: unlink d3/d12/d16/l35 0 2023-12-16T05:56:41.802 INFO:tasks.workunit.client.0.smithi155.stdout:8/914: creat d4/d62/d66/d78/d88/d1b/d1c/d97/f130 x:0 0 0 2023-12-16T05:56:41.802 INFO:tasks.workunit.client.0.smithi155.stdout:8/915: truncate d4/d62/d66/d78/d88/d9e/f121 27599 0 2023-12-16T05:56:41.803 INFO:tasks.workunit.client.1.smithi156.stdout:0/754: symlink d2/d7/dd/d29/d38/d51/d65/d7e/leb 0 2023-12-16T05:56:41.803 INFO:tasks.workunit.client.1.smithi156.stdout:0/755: dread - d2/d7/dd/d29/d38/d51/d52/d88/fea zero size 2023-12-16T05:56:41.805 INFO:tasks.workunit.client.1.smithi156.stdout:3/607: getdents dc/df/d34/d62/d75 0 2023-12-16T05:56:41.806 INFO:tasks.workunit.client.0.smithi155.stdout:8/916: link d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/l93 d4/d62/l131 0 2023-12-16T05:56:41.806 INFO:tasks.workunit.client.0.smithi155.stdout:8/917: mkdir d4/d62/d66/d78/d88/d1b/d1c/d19/da3/d10a/d132 0 2023-12-16T05:56:41.807 INFO:tasks.workunit.client.0.smithi155.stdout:8/918: symlink d4/d62/d95/l133 0 2023-12-16T05:56:41.807 INFO:tasks.workunit.client.0.smithi155.stdout:8/919: fsync d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/f60 0 2023-12-16T05:56:41.807 INFO:tasks.workunit.client.0.smithi155.stdout:8/920: chown d4/d62/d66/d78/d88/d12/c113 10 1 2023-12-16T05:56:41.813 INFO:tasks.workunit.client.1.smithi156.stdout:3/608: rmdir dc/df/d34/d62/d75 39 2023-12-16T05:56:41.815 INFO:tasks.workunit.client.1.smithi156.stdout:3/609: mkdir dc/df/de1 0 2023-12-16T05:56:41.815 INFO:tasks.workunit.client.0.smithi155.stdout:4/830: dwrite d0/da/de0/d16/d30/dce/d75/d50/f6a [0,4194304] 0 2023-12-16T05:56:41.817 INFO:tasks.workunit.client.0.smithi155.stdout:4/831: creat d0/da/de0/d16/d30/dce/d75/d10e/d70/d92/daf/db7/dbc/f115 x:0 0 0 2023-12-16T05:56:41.817 INFO:tasks.workunit.client.0.smithi155.stdout:4/832: fsync d0/da/d36/f7f 0 2023-12-16T05:56:41.818 INFO:tasks.workunit.client.1.smithi156.stdout:3/610: rename dc/d10/d1d/f49 to dc/d56/d67/d6e/fe2 0 2023-12-16T05:56:41.819 INFO:tasks.workunit.client.0.smithi155.stdout:4/833: mkdir d0/da/de0/d16/d30/dce/d75/d10e/d70/d92/daf/db7/d116 0 2023-12-16T05:56:41.819 INFO:tasks.workunit.client.1.smithi156.stdout:7/851: dwrite d1e/fb2 [0,4194304] 0 2023-12-16T05:56:41.819 INFO:tasks.workunit.client.1.smithi156.stdout:7/852: write d1e/d55/db6/ddb/fe0 [1259614,102751] 0 2023-12-16T05:56:41.820 INFO:tasks.workunit.client.1.smithi156.stdout:7/853: fdatasync d1e/fc5 0 2023-12-16T05:56:41.821 INFO:tasks.workunit.client.1.smithi156.stdout:3/611: read fb [8043604,123071] 0 2023-12-16T05:56:41.823 INFO:tasks.workunit.client.1.smithi156.stdout:7/854: creat d1e/d55/f129 x:0 0 0 2023-12-16T05:56:41.823 INFO:tasks.workunit.client.1.smithi156.stdout:7/855: stat d1e/d1f/d72/da4/fda 0 2023-12-16T05:56:41.823 INFO:tasks.workunit.client.1.smithi156.stdout:7/856: stat d1e/d55/fde 0 2023-12-16T05:56:41.824 INFO:tasks.workunit.client.1.smithi156.stdout:3/612: link dc/df/d34/d62/d75/fa9 dc/df/dce/fe3 0 2023-12-16T05:56:41.824 INFO:tasks.workunit.client.1.smithi156.stdout:3/613: write dc/df/d34/f63 [8678594,100607] 0 2023-12-16T05:56:41.825 INFO:tasks.workunit.client.1.smithi156.stdout:7/857: mknod d1e/d55/d71/d61/daa/c12a 0 2023-12-16T05:56:41.826 INFO:tasks.workunit.client.0.smithi155.stdout:4/834: write d0/f28 [1310150,40766] 0 2023-12-16T05:56:41.826 INFO:tasks.workunit.client.0.smithi155.stdout:4/835: readlink d0/da/de0/lc6 0 2023-12-16T05:56:41.826 INFO:tasks.workunit.client.0.smithi155.stdout:2/799: dwrite d0/d7/f5e [0,4194304] 0 2023-12-16T05:56:41.826 INFO:tasks.workunit.client.1.smithi156.stdout:3/614: mkdir dc/d56/d67/dbe/dc3/de4 0 2023-12-16T05:56:41.827 INFO:tasks.workunit.client.1.smithi156.stdout:7/858: rename d1e/dbf/fd1 to d1e/d1f/da6/d57/dbb/f12b 0 2023-12-16T05:56:41.828 INFO:tasks.workunit.client.1.smithi156.stdout:7/859: chown d1e/d1f/da6/d57/dbb/l11a 12 1 2023-12-16T05:56:41.828 INFO:tasks.workunit.client.0.smithi155.stdout:4/836: unlink d0/da/de0/d16/d30/d52/d88/d9e/cda 0 2023-12-16T05:56:41.828 INFO:tasks.workunit.client.1.smithi156.stdout:9/635: dwrite d6/d19/d25/d3a/faa [0,4194304] 0 2023-12-16T05:56:41.829 INFO:tasks.workunit.client.1.smithi156.stdout:9/636: write d6/d19/f32 [1866801,95318] 0 2023-12-16T05:56:41.829 INFO:tasks.workunit.client.1.smithi156.stdout:9/637: fsync d6/d19/d25/d3a/f43 0 2023-12-16T05:56:41.829 INFO:tasks.workunit.client.1.smithi156.stdout:9/638: chown d6/d2e/f35 44007562 1 2023-12-16T05:56:41.830 INFO:tasks.workunit.client.0.smithi155.stdout:0/943: dwrite d7/df/d73/d8d/d4d/de8/dd6/f108 [0,4194304] 0 2023-12-16T05:56:41.830 INFO:tasks.workunit.client.1.smithi156.stdout:0/756: dwrite d2/d7/dd/d29/fd4 [0,4194304] 0 2023-12-16T05:56:41.833 INFO:tasks.workunit.client.0.smithi155.stdout:0/944: write d7/df/d73/d8d/f6b [1885791,117870] 0 2023-12-16T05:56:41.834 INFO:tasks.workunit.client.1.smithi156.stdout:9/639: readlink d6/l11 0 2023-12-16T05:56:41.834 INFO:tasks.workunit.client.1.smithi156.stdout:9/640: readlink d6/d19/d30/d48/d87/d65/lbd 0 2023-12-16T05:56:41.835 INFO:tasks.workunit.client.0.smithi155.stdout:0/945: creat d7/df/d6f/f137 x:0 0 0 2023-12-16T05:56:41.836 INFO:tasks.workunit.client.0.smithi155.stdout:0/946: chown d7/d2d/c127 7059908 1 2023-12-16T05:56:41.836 INFO:tasks.workunit.client.1.smithi156.stdout:7/860: link d1e/d1f/d72/da4/fda d1e/d55/d71/d94/f12c 0 2023-12-16T05:56:41.836 INFO:tasks.workunit.client.0.smithi155.stdout:0/947: creat d7/df/d6f/f138 x:0 0 0 2023-12-16T05:56:41.836 INFO:tasks.workunit.client.0.smithi155.stdout:0/948: read - d7/df/d6f/f137 zero size 2023-12-16T05:56:41.837 INFO:tasks.workunit.client.1.smithi156.stdout:0/757: creat d2/d7/dd/d2d/d5e/fec x:0 0 0 2023-12-16T05:56:41.837 INFO:tasks.workunit.client.1.smithi156.stdout:0/758: dread - d2/d7/dd/d29/d38/d51/d65/fc8 zero size 2023-12-16T05:56:41.838 INFO:tasks.workunit.client.0.smithi155.stdout:4/837: dread d0/da/de0/f40 [0,4194304] 0 2023-12-16T05:56:41.838 INFO:tasks.workunit.client.0.smithi155.stdout:8/921: dwrite d4/d62/d66/d78/d88/d1b/d2a/f39 [0,4194304] 0 2023-12-16T05:56:41.839 INFO:tasks.workunit.client.1.smithi156.stdout:9/641: rename d6/d19/d30/d48/d87/l69 to d6/d19/d30/d48/ld7 0 2023-12-16T05:56:41.840 INFO:tasks.workunit.client.0.smithi155.stdout:4/838: symlink d0/da/de0/d16/d30/dce/d75/d10e/d70/l117 0 2023-12-16T05:56:41.841 INFO:tasks.workunit.client.1.smithi156.stdout:7/861: creat d1e/d1f/da6/d57/d59/f12d x:0 0 0 2023-12-16T05:56:41.841 INFO:tasks.workunit.client.1.smithi156.stdout:7/862: truncate d1e/d55/d71/d94/ffd 295019 0 2023-12-16T05:56:41.842 INFO:tasks.workunit.client.0.smithi155.stdout:8/922: symlink d4/d62/d66/d78/d88/d1b/d1c/l134 0 2023-12-16T05:56:41.842 INFO:tasks.workunit.client.0.smithi155.stdout:8/923: stat d4/d62/d66/d78/d88/d1b/d1c/d19/f73 0 2023-12-16T05:56:41.842 INFO:tasks.workunit.client.0.smithi155.stdout:4/839: mknod d0/da/de0/c118 0 2023-12-16T05:56:41.842 INFO:tasks.workunit.client.0.smithi155.stdout:4/840: chown d0/da/de0/d16/d30/dce/d75/d3d 0 1 2023-12-16T05:56:41.842 INFO:tasks.workunit.client.0.smithi155.stdout:4/841: readlink d0/da/de0/d16/d30/d52/d88/d9e/la1 0 2023-12-16T05:56:41.843 INFO:tasks.workunit.client.1.smithi156.stdout:3/615: dread dc/df/d66/fdd [0,4194304] 0 2023-12-16T05:56:41.843 INFO:tasks.workunit.client.1.smithi156.stdout:3/616: dread - dc/d10/db4/fd7 zero size 2023-12-16T05:56:41.844 INFO:tasks.workunit.client.0.smithi155.stdout:8/924: symlink d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/d117/l135 0 2023-12-16T05:56:41.844 INFO:tasks.workunit.client.1.smithi156.stdout:7/863: write d1e/d55/d71/d61/fa5 [1670085,77883] 0 2023-12-16T05:56:41.844 INFO:tasks.workunit.client.0.smithi155.stdout:2/800: dwrite d0/d7/f5e [0,4194304] 0 2023-12-16T05:56:41.845 INFO:tasks.workunit.client.1.smithi156.stdout:9/642: creat d6/d19/fd8 x:0 0 0 2023-12-16T05:56:41.845 INFO:tasks.workunit.client.1.smithi156.stdout:9/643: stat d6/d19/d25/d72/fbb 0 2023-12-16T05:56:41.845 INFO:tasks.workunit.client.0.smithi155.stdout:4/842: unlink d0/da/de0/d16/f8e 0 2023-12-16T05:56:41.846 INFO:tasks.workunit.client.1.smithi156.stdout:0/759: mkdir d2/d7/dd/ded 0 2023-12-16T05:56:41.847 INFO:tasks.workunit.client.0.smithi155.stdout:4/843: creat d0/da/de0/d16/d30/dce/d75/d3d/d85/f119 x:0 0 0 2023-12-16T05:56:41.849 INFO:tasks.workunit.client.1.smithi156.stdout:9/644: creat d6/d2e/d8a/da5/fd9 x:0 0 0 2023-12-16T05:56:41.849 INFO:tasks.workunit.client.1.smithi156.stdout:9/645: chown d6/d2e/dad 123 1 2023-12-16T05:56:41.849 INFO:tasks.workunit.client.1.smithi156.stdout:9/646: stat d6/d19/l85 0 2023-12-16T05:56:41.850 INFO:tasks.workunit.client.0.smithi155.stdout:4/844: unlink d0/d10/f34 0 2023-12-16T05:56:41.851 INFO:tasks.workunit.client.1.smithi156.stdout:9/647: mknod d6/d19/d30/d5b/cda 0 2023-12-16T05:56:41.851 INFO:tasks.workunit.client.0.smithi155.stdout:4/845: mknod d0/da/de0/d16/d30/dce/d75/d10e/d70/d92/daf/db7/d116/c11a 0 2023-12-16T05:56:41.853 INFO:tasks.workunit.client.0.smithi155.stdout:4/846: mkdir d0/da/de0/d16/d30/dce/d75/ddb/d11b 0 2023-12-16T05:56:41.854 INFO:tasks.workunit.client.1.smithi156.stdout:3/617: dread dc/fb7 [0,4194304] 0 2023-12-16T05:56:41.854 INFO:tasks.workunit.client.1.smithi156.stdout:9/648: mknod d6/d19/d30/cdb 0 2023-12-16T05:56:41.854 INFO:tasks.workunit.client.1.smithi156.stdout:3/618: read - dc/df/d66/fda zero size 2023-12-16T05:56:41.856 INFO:tasks.workunit.client.0.smithi155.stdout:4/847: creat d0/da/de0/d16/d30/d52/d88/d9e/d103/f11c x:0 0 0 2023-12-16T05:56:41.857 INFO:tasks.workunit.client.0.smithi155.stdout:0/949: dwrite d7/df/d73/d8d/d4d/d115/d5d/d6a/fd7 [0,4194304] 0 2023-12-16T05:56:41.858 INFO:tasks.workunit.client.1.smithi156.stdout:9/649: unlink d6/d2e/f6e 0 2023-12-16T05:56:41.858 INFO:tasks.workunit.client.0.smithi155.stdout:4/848: truncate d0/da/de0/d16/f4b 1245315 0 2023-12-16T05:56:41.858 INFO:tasks.workunit.client.0.smithi155.stdout:4/849: chown d0/da/de0/d16/d30/dce/d75/d10e/d70/d92/daf 144 1 2023-12-16T05:56:41.860 INFO:tasks.workunit.client.0.smithi155.stdout:0/950: rmdir d7/db0 39 2023-12-16T05:56:41.860 INFO:tasks.workunit.client.0.smithi155.stdout:0/951: fdatasync d7/df/d73/fe2 0 2023-12-16T05:56:41.862 INFO:tasks.workunit.client.0.smithi155.stdout:0/952: truncate d7/d2d/f9e 2032955 0 2023-12-16T05:56:41.863 INFO:tasks.workunit.client.1.smithi156.stdout:9/650: mknod d6/d19/d25/d3a/dc3/cdc 0 2023-12-16T05:56:41.863 INFO:tasks.workunit.client.1.smithi156.stdout:9/651: dread - d6/f8c zero size 2023-12-16T05:56:41.865 INFO:tasks.workunit.client.0.smithi155.stdout:0/953: rename d7/df/d41/f119 to d7/df/d73/d8d/d4d/de8/dd6/f139 0 2023-12-16T05:56:41.865 INFO:tasks.workunit.client.0.smithi155.stdout:0/954: readlink d7/df/d73/d8d/d4d/d115/d5d/ldf 0 2023-12-16T05:56:41.867 INFO:tasks.workunit.client.0.smithi155.stdout:0/955: mknod d7/d13/c13a 0 2023-12-16T05:56:41.867 INFO:tasks.workunit.client.0.smithi155.stdout:0/956: dread - d7/df/d73/d8d/d4d/de8/de5/ffe zero size 2023-12-16T05:56:41.868 INFO:tasks.workunit.client.1.smithi156.stdout:9/652: creat d6/d2e/d8a/fdd x:0 0 0 2023-12-16T05:56:41.868 INFO:tasks.workunit.client.1.smithi156.stdout:9/653: write d6/d19/f2a [3984001,45071] 0 2023-12-16T05:56:41.870 INFO:tasks.workunit.client.0.smithi155.stdout:2/801: dwrite d0/d5/fce [4194304,4194304] 0 2023-12-16T05:56:41.871 INFO:tasks.workunit.client.1.smithi156.stdout:9/654: creat d6/d19/d30/fde x:0 0 0 2023-12-16T05:56:41.871 INFO:tasks.workunit.client.1.smithi156.stdout:9/655: write d6/d19/d25/d3a/d80/fce [104882,55471] 0 2023-12-16T05:56:41.871 INFO:tasks.workunit.client.1.smithi156.stdout:9/656: chown d6/d19/d25/l63 27246636 1 2023-12-16T05:56:41.871 INFO:tasks.workunit.client.0.smithi155.stdout:4/850: dread d0/f5 [0,4194304] 0 2023-12-16T05:56:41.871 INFO:tasks.workunit.client.0.smithi155.stdout:4/851: readlink d0/da/de0/d16/d30/d52/d88/d9e/d103/l74 0 2023-12-16T05:56:41.872 INFO:tasks.workunit.client.1.smithi156.stdout:9/657: creat d6/d19/d25/d3a/d80/dc0/dd0/fdf x:0 0 0 2023-12-16T05:56:41.873 INFO:tasks.workunit.client.0.smithi155.stdout:2/802: creat d0/d7/dd/d49/d4b/f10c x:0 0 0 2023-12-16T05:56:41.873 INFO:tasks.workunit.client.0.smithi155.stdout:4/852: creat d0/da/de0/d16/d30/dce/f11d x:0 0 0 2023-12-16T05:56:41.873 INFO:tasks.workunit.client.1.smithi156.stdout:9/658: fdatasync d6/d2e/f89 0 2023-12-16T05:56:41.875 INFO:tasks.workunit.client.1.smithi156.stdout:9/659: creat d6/d19/d25/d3a/d5e/fe0 x:0 0 0 2023-12-16T05:56:41.875 INFO:tasks.workunit.client.0.smithi155.stdout:2/803: symlink d0/d5/d6/d5f/df9/l10d 0 2023-12-16T05:56:41.876 INFO:tasks.workunit.client.1.smithi156.stdout:9/660: mkdir d6/d19/d25/d3a/d5e/da9/de1 0 2023-12-16T05:56:41.877 INFO:tasks.workunit.client.1.smithi156.stdout:7/864: dwrite d1e/d55/fff [0,4194304] 0 2023-12-16T05:56:41.877 INFO:tasks.workunit.client.1.smithi156.stdout:7/865: chown d1e/f58 0 1 2023-12-16T05:56:41.877 INFO:tasks.workunit.client.1.smithi156.stdout:7/866: getdents d1e/d1f/d72/df4 0 2023-12-16T05:56:41.877 INFO:tasks.workunit.client.1.smithi156.stdout:7/867: readlink d1e/d1f/da6/ldf 0 2023-12-16T05:56:41.877 INFO:tasks.workunit.client.1.smithi156.stdout:7/868: chown d1e/d1f/ffa 662894911 1 2023-12-16T05:56:41.877 INFO:tasks.workunit.client.1.smithi156.stdout:9/661: creat d6/d19/d30/d5b/d9a/fe2 x:0 0 0 2023-12-16T05:56:41.877 INFO:tasks.workunit.client.1.smithi156.stdout:9/662: truncate d6/d19/d25/f31 746310 0 2023-12-16T05:56:41.879 INFO:tasks.workunit.client.1.smithi156.stdout:7/869: creat d1e/d55/d71/df5/f12e x:0 0 0 2023-12-16T05:56:41.879 INFO:tasks.workunit.client.0.smithi155.stdout:2/804: mkdir d0/d7/d57/daf/d10e 0 2023-12-16T05:56:41.879 INFO:tasks.workunit.client.0.smithi155.stdout:2/805: truncate d0/d5/d6/f75 927218 0 2023-12-16T05:56:41.880 INFO:tasks.workunit.client.0.smithi155.stdout:2/806: readlink d0/d7/d57/d63/lcb 0 2023-12-16T05:56:41.880 INFO:tasks.workunit.client.1.smithi156.stdout:9/663: rename d6/d19/d30/dae/lbc to d6/d2e/d8a/da5/le3 0 2023-12-16T05:56:41.880 INFO:tasks.workunit.client.1.smithi156.stdout:7/870: mkdir d1e/d55/d71/d61/dac/d12f 0 2023-12-16T05:56:41.882 INFO:tasks.workunit.client.1.smithi156.stdout:7/871: creat d1e/d1f/d22/f130 x:0 0 0 2023-12-16T05:56:41.882 INFO:tasks.workunit.client.1.smithi156.stdout:7/872: chown d1e/l56 11 1 2023-12-16T05:56:41.882 INFO:tasks.workunit.client.1.smithi156.stdout:7/873: chown d1e/d55/fff 485867 1 2023-12-16T05:56:41.882 INFO:tasks.workunit.client.1.smithi156.stdout:7/874: dread - d1e/d1f/ffa zero size 2023-12-16T05:56:41.882 INFO:tasks.workunit.client.0.smithi155.stdout:2/807: symlink d0/d7/d1f/d74/l10f 0 2023-12-16T05:56:41.883 INFO:tasks.workunit.client.0.smithi155.stdout:2/808: creat d0/d5/f110 x:0 0 0 2023-12-16T05:56:41.884 INFO:tasks.workunit.client.0.smithi155.stdout:8/925: dwrite d4/d62/d66/d78/d88/d1b/d1c/d19/f73 [0,4194304] 0 2023-12-16T05:56:41.885 INFO:tasks.workunit.client.0.smithi155.stdout:2/809: creat d0/d7/d57/d63/de7/d109/f111 x:0 0 0 2023-12-16T05:56:41.885 INFO:tasks.workunit.client.0.smithi155.stdout:2/810: chown d0/d7/dd/d49/d4b/d8c/lbd 727269750 1 2023-12-16T05:56:41.885 INFO:tasks.workunit.client.0.smithi155.stdout:2/811: chown d0/d7/d1f/d74/d3a/f7a 1290657 1 2023-12-16T05:56:41.887 INFO:tasks.workunit.client.1.smithi156.stdout:0/760: dwrite d2/d7/dd/d29/d38/d3f/f58 [0,4194304] 0 2023-12-16T05:56:41.887 INFO:tasks.workunit.client.1.smithi156.stdout:0/761: fsync d2/d7/dd/f30 0 2023-12-16T05:56:41.888 INFO:tasks.workunit.client.1.smithi156.stdout:3/619: dwrite dc/df/f2b [0,4194304] 0 2023-12-16T05:56:41.888 INFO:tasks.workunit.client.1.smithi156.stdout:9/664: dread d6/f98 [0,4194304] 0 2023-12-16T05:56:41.888 INFO:tasks.workunit.client.1.smithi156.stdout:9/665: fdatasync d6/d19/d30/d48/f92 0 2023-12-16T05:56:41.893 INFO:tasks.workunit.client.0.smithi155.stdout:8/926: creat d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/f136 x:0 0 0 2023-12-16T05:56:41.894 INFO:tasks.workunit.client.1.smithi156.stdout:0/762: mkdir d2/d7/dd/d29/d38/d51/d52/dee 0 2023-12-16T05:56:41.896 INFO:tasks.workunit.client.0.smithi155.stdout:2/812: link d0/d7/d69/f4e d0/d7/dd/f112 0 2023-12-16T05:56:41.897 INFO:tasks.workunit.client.1.smithi156.stdout:7/875: dwrite d1e/d55/d71/d61/daa/f6f [0,4194304] 0 2023-12-16T05:56:41.897 INFO:tasks.workunit.client.1.smithi156.stdout:7/876: fdatasync d1e/d1f/f78 0 2023-12-16T05:56:41.897 INFO:tasks.workunit.client.0.smithi155.stdout:2/813: mknod d0/d34/c113 0 2023-12-16T05:56:41.897 INFO:tasks.workunit.client.0.smithi155.stdout:2/814: readlink d0/d7/dd/d49/d4b/lf8 0 2023-12-16T05:56:41.900 INFO:tasks.workunit.client.1.smithi156.stdout:3/620: unlink dc/d10/d3d/d4e/ld5 0 2023-12-16T05:56:41.901 INFO:tasks.workunit.client.1.smithi156.stdout:9/666: creat d6/d19/d30/dae/db7/fe4 x:0 0 0 2023-12-16T05:56:41.901 INFO:tasks.workunit.client.1.smithi156.stdout:9/667: dread - d6/d2e/fbe zero size 2023-12-16T05:56:41.901 INFO:tasks.workunit.client.1.smithi156.stdout:0/763: truncate d2/d7/dd/f30 3455174 0 2023-12-16T05:56:41.901 INFO:tasks.workunit.client.0.smithi155.stdout:2/815: creat d0/d5/d6/f114 x:0 0 0 2023-12-16T05:56:41.902 INFO:tasks.workunit.client.1.smithi156.stdout:0/764: write d2/d7/dd/d1c/fa5 [76914,120690] 0 2023-12-16T05:56:41.903 INFO:tasks.workunit.client.1.smithi156.stdout:3/621: creat dc/d56/d69/fe5 x:0 0 0 2023-12-16T05:56:41.903 INFO:tasks.workunit.client.1.smithi156.stdout:3/622: chown dc 6095716 1 2023-12-16T05:56:41.903 INFO:tasks.workunit.client.1.smithi156.stdout:3/623: chown dc/l1b 91467496 1 2023-12-16T05:56:41.904 INFO:tasks.workunit.client.1.smithi156.stdout:9/668: mknod d6/d19/d25/d72/ce5 0 2023-12-16T05:56:41.904 INFO:tasks.workunit.client.0.smithi155.stdout:2/816: truncate d0/d7/dd/f112 3603651 0 2023-12-16T05:56:41.905 INFO:tasks.workunit.client.0.smithi155.stdout:4/853: rmdir d0/d10 39 2023-12-16T05:56:41.905 INFO:tasks.workunit.client.1.smithi156.stdout:3/624: symlink dc/df/le6 0 2023-12-16T05:56:41.905 INFO:tasks.workunit.client.1.smithi156.stdout:3/625: fsync dc/d10/d1d/d4b/fb6 0 2023-12-16T05:56:41.905 INFO:tasks.workunit.client.1.smithi156.stdout:0/765: dread d2/d7/dd/d29/d4b/d76/f78 [0,4194304] 0 2023-12-16T05:56:41.906 INFO:tasks.workunit.client.1.smithi156.stdout:9/669: creat d6/d19/d25/d3a/d80/dc0/fe6 x:0 0 0 2023-12-16T05:56:41.906 INFO:tasks.workunit.client.1.smithi156.stdout:9/670: dread - d6/d19/d25/fbf zero size 2023-12-16T05:56:41.906 INFO:tasks.workunit.client.1.smithi156.stdout:9/671: stat d6/laf 0 2023-12-16T05:56:41.908 INFO:tasks.workunit.client.0.smithi155.stdout:2/817: creat d0/d7/d1f/d74/d85/d88/f115 x:0 0 0 2023-12-16T05:56:41.910 INFO:tasks.workunit.client.1.smithi156.stdout:0/766: getdents d2/d7/dd/d29/d38/d51/d65/d7e 0 2023-12-16T05:56:41.910 INFO:tasks.workunit.client.1.smithi156.stdout:0/767: fdatasync d2/d7/dd/d29/d38/d51/d52/d88/fea 0 2023-12-16T05:56:41.912 INFO:tasks.workunit.client.0.smithi155.stdout:8/927: dread d4/d62/d66/d78/d88/d1b/f61 [0,4194304] 0 2023-12-16T05:56:41.912 INFO:tasks.workunit.client.1.smithi156.stdout:9/672: creat d6/d19/d25/d3a/d5e/da9/fe7 x:0 0 0 2023-12-16T05:56:41.914 INFO:tasks.workunit.client.1.smithi156.stdout:0/768: mkdir d2/d7/dd/d29/d38/d51/d52/d88/dbc/dd2/def 0 2023-12-16T05:56:41.916 INFO:tasks.workunit.client.0.smithi155.stdout:2/818: rename d0/d7/d1f/d74/d85/d88/f89 to d0/d7/d1f/d74/f116 0 2023-12-16T05:56:41.916 INFO:tasks.workunit.client.0.smithi155.stdout:4/854: dread d0/da/de0/d16/d30/dce/d75/d3d/d43/f4e [0,4194304] 0 2023-12-16T05:56:41.917 INFO:tasks.workunit.client.0.smithi155.stdout:4/855: write d0/da/de0/d16/d30/d52/d88/d9e/fc4 [188174,87088] 0 2023-12-16T05:56:41.918 INFO:tasks.workunit.client.1.smithi156.stdout:0/769: mkdir d2/df0 0 2023-12-16T05:56:41.919 INFO:tasks.workunit.client.1.smithi156.stdout:4/618: sync 2023-12-16T05:56:41.919 INFO:tasks.workunit.client.1.smithi156.stdout:2/683: sync 2023-12-16T05:56:41.919 INFO:tasks.workunit.client.1.smithi156.stdout:4/619: write d9/d2c/fbc [350411,97653] 0 2023-12-16T05:56:41.919 INFO:tasks.workunit.client.1.smithi156.stdout:4/620: stat d9/d2b/d35/f71 0 2023-12-16T05:56:41.919 INFO:tasks.workunit.client.1.smithi156.stdout:5/825: sync 2023-12-16T05:56:41.919 INFO:tasks.workunit.client.1.smithi156.stdout:5/826: fdatasync da/dc/d2d/d4d/d54/fd5 0 2023-12-16T05:56:41.920 INFO:tasks.workunit.client.1.smithi156.stdout:0/770: dread d2/ff [0,4194304] 0 2023-12-16T05:56:41.920 INFO:tasks.workunit.client.0.smithi155.stdout:4/856: dread d0/da/de0/d16/d30/dce/d75/d89/fc9 [0,4194304] 0 2023-12-16T05:56:41.924 INFO:tasks.workunit.client.0.smithi155.stdout:2/819: creat d0/d5/d6/d5f/df9/f117 x:0 0 0 2023-12-16T05:56:41.926 INFO:tasks.workunit.client.1.smithi156.stdout:4/621: write d9/d2c/f3e [3285931,126089] 0 2023-12-16T05:56:41.927 INFO:tasks.workunit.client.1.smithi156.stdout:3/626: rmdir dc/df 39 2023-12-16T05:56:41.927 INFO:tasks.workunit.client.0.smithi155.stdout:4/857: symlink d0/da/de0/d16/d30/dce/d75/d50/l11e 0 2023-12-16T05:56:41.927 INFO:tasks.workunit.client.0.smithi155.stdout:4/858: dread - d0/da/de0/d16/d30/dce/d75/d3d/d49/dbb/f10f zero size 2023-12-16T05:56:41.928 INFO:tasks.workunit.client.0.smithi155.stdout:2/820: creat d0/d7/d57/f118 x:0 0 0 2023-12-16T05:56:41.928 INFO:tasks.workunit.client.0.smithi155.stdout:2/821: fdatasync d0/d7/d69/d77/fa4 0 2023-12-16T05:56:41.929 INFO:tasks.workunit.client.1.smithi156.stdout:3/627: mkdir dc/df/d34/d62/d75/de7 0 2023-12-16T05:56:41.929 INFO:tasks.workunit.client.1.smithi156.stdout:7/877: dwrite d1e/d39/f7d [0,4194304] 0 2023-12-16T05:56:41.930 INFO:tasks.workunit.client.0.smithi155.stdout:4/859: creat d0/da/de0/d16/d30/dcd/f11f x:0 0 0 2023-12-16T05:56:41.931 INFO:tasks.workunit.client.1.smithi156.stdout:3/628: creat dc/d10/fe8 x:0 0 0 2023-12-16T05:56:41.931 INFO:tasks.workunit.client.1.smithi156.stdout:3/629: dread - dc/df/d66/fda zero size 2023-12-16T05:56:41.934 INFO:tasks.workunit.client.0.smithi155.stdout:8/928: dread d4/d62/d66/d78/d88/d1b/d1c/d97/f59 [0,4194304] 0 2023-12-16T05:56:41.934 INFO:tasks.workunit.client.1.smithi156.stdout:7/878: creat d1e/d1f/da6/d57/d59/f131 x:0 0 0 2023-12-16T05:56:41.934 INFO:tasks.workunit.client.0.smithi155.stdout:2/822: creat d0/d7/d57/daf/d10e/f119 x:0 0 0 2023-12-16T05:56:41.938 INFO:tasks.workunit.client.0.smithi155.stdout:2/823: rename d0/d7/f41 to d0/d7/d1f/d74/d3a/f11a 0 2023-12-16T05:56:41.945 INFO:tasks.workunit.client.0.smithi155.stdout:2/824: read d0/d7/d57/d63/fb1 [289682,33461] 0 2023-12-16T05:56:41.945 INFO:tasks.workunit.client.0.smithi155.stdout:2/825: read - d0/d7/dd/d49/d4b/f10c zero size 2023-12-16T05:56:41.947 INFO:tasks.workunit.client.0.smithi155.stdout:7/783: sync 2023-12-16T05:56:41.947 INFO:tasks.workunit.client.0.smithi155.stdout:3/639: sync 2023-12-16T05:56:41.947 INFO:tasks.workunit.client.1.smithi156.stdout:5/827: dread da/dc/d2d/f41 [0,4194304] 0 2023-12-16T05:56:41.948 INFO:tasks.workunit.client.0.smithi155.stdout:2/826: creat d0/d7/dd/d14/f11b x:0 0 0 2023-12-16T05:56:41.948 INFO:tasks.workunit.client.0.smithi155.stdout:2/827: chown d0/d7/dd/d62/c70 333390 1 2023-12-16T05:56:41.948 INFO:tasks.workunit.client.0.smithi155.stdout:7/784: getdents d0/d6a/d1a/d22/dc8 0 2023-12-16T05:56:41.949 INFO:tasks.workunit.client.0.smithi155.stdout:7/785: fdatasync d0/d6a/d1a/d2b/d2c/d5d/f8e 0 2023-12-16T05:56:41.949 INFO:tasks.workunit.client.0.smithi155.stdout:7/786: chown d0/d6a/d1a/d38/fa2 5667 1 2023-12-16T05:56:41.949 INFO:tasks.workunit.client.0.smithi155.stdout:7/787: chown d0/d6a/d1a/d8c/d42/d98/db1/lf3 1 1 2023-12-16T05:56:41.949 INFO:tasks.workunit.client.0.smithi155.stdout:7/788: fsync d0/d6a/d31/f5c 0 2023-12-16T05:56:41.949 INFO:tasks.workunit.client.1.smithi156.stdout:5/828: creat da/d9a/f10c x:0 0 0 2023-12-16T05:56:41.950 INFO:tasks.workunit.client.0.smithi155.stdout:2/828: rename d0/d7/dd/d49/d4b/l7b to d0/d5/l11c 0 2023-12-16T05:56:41.950 INFO:tasks.workunit.client.1.smithi156.stdout:5/829: getdents da/dc/d2d/d4d/d54/d67 0 2023-12-16T05:56:41.951 INFO:tasks.workunit.client.0.smithi155.stdout:7/789: creat d0/d1/d5/ffd x:0 0 0 2023-12-16T05:56:41.951 INFO:tasks.workunit.client.0.smithi155.stdout:7/790: fdatasync d0/d1/f67 0 2023-12-16T05:56:41.951 INFO:tasks.workunit.client.1.smithi156.stdout:5/830: mkdir da/dc/d10d 0 2023-12-16T05:56:41.952 INFO:tasks.workunit.client.0.smithi155.stdout:2/829: rmdir d0/d7/d57/daf/d101 0 2023-12-16T05:56:41.953 INFO:tasks.workunit.client.0.smithi155.stdout:7/791: getdents d0/d6a/d1a/d8c/d34/d4b/d64 0 2023-12-16T05:56:41.953 INFO:tasks.workunit.client.0.smithi155.stdout:7/792: dread - d0/d6a/d1a/d22/dc8/ff9 zero size 2023-12-16T05:56:41.953 INFO:tasks.workunit.client.1.smithi156.stdout:5/831: rename da/dc/d2d/d9b to da/dc/d4b/d6c/d77/d10e 0 2023-12-16T05:56:41.954 INFO:tasks.workunit.client.0.smithi155.stdout:7/793: mkdir d0/d6a/dfe 0 2023-12-16T05:56:41.954 INFO:tasks.workunit.client.1.smithi156.stdout:5/832: link da/dc/ce9 da/dc/d2d/d4d/db9/c10f 0 2023-12-16T05:56:41.954 INFO:tasks.workunit.client.0.smithi155.stdout:5/917: sync 2023-12-16T05:56:41.955 INFO:tasks.workunit.client.0.smithi155.stdout:7/794: creat d0/d6a/dfe/fff x:0 0 0 2023-12-16T05:56:41.955 INFO:tasks.workunit.client.0.smithi155.stdout:7/795: stat d0/d1b/d78 0 2023-12-16T05:56:41.955 INFO:tasks.workunit.client.0.smithi155.stdout:7/796: chown d0/d6a/d1a/d22/ce5 5239421 1 2023-12-16T05:56:41.957 INFO:tasks.workunit.client.0.smithi155.stdout:7/797: creat d0/d6a/d1a/d8c/d34/d4b/f100 x:0 0 0 2023-12-16T05:56:41.960 INFO:tasks.workunit.client.0.smithi155.stdout:3/640: dread d0/d1e/f49 [0,4194304] 0 2023-12-16T05:56:41.967 INFO:tasks.workunit.client.0.smithi155.stdout:2/830: dread d0/d5/d6/f83 [0,4194304] 0 2023-12-16T05:56:41.970 INFO:tasks.workunit.client.0.smithi155.stdout:2/831: creat d0/d7/d57/f11d x:0 0 0 2023-12-16T05:56:41.971 INFO:tasks.workunit.client.0.smithi155.stdout:3/641: dread d0/d14/d36/fa6 [0,4194304] 0 2023-12-16T05:56:41.971 INFO:tasks.workunit.client.0.smithi155.stdout:3/642: chown d0/d14/d36/d7c 16426316 1 2023-12-16T05:56:41.971 INFO:tasks.workunit.client.0.smithi155.stdout:2/832: creat d0/d7/d57/daf/dc4/f11e x:0 0 0 2023-12-16T05:56:41.972 INFO:tasks.workunit.client.0.smithi155.stdout:3/643: rmdir d0/d1a 39 2023-12-16T05:56:41.972 INFO:tasks.workunit.client.0.smithi155.stdout:3/644: chown d0/d14/d9d/la5 263329 1 2023-12-16T05:56:41.972 INFO:tasks.workunit.client.0.smithi155.stdout:3/645: dread - d0/d1a/d33/fb7 zero size 2023-12-16T05:56:41.972 INFO:tasks.workunit.client.0.smithi155.stdout:3/646: stat d0/f2e 0 2023-12-16T05:56:41.973 INFO:tasks.workunit.client.0.smithi155.stdout:2/833: mkdir d0/d7/dd/d49/d4b/d8c/dcd/d108/d11f 0 2023-12-16T05:56:41.975 INFO:tasks.workunit.client.0.smithi155.stdout:7/798: dread d0/d6a/d1a/d8c/f75 [0,4194304] 0 2023-12-16T05:56:41.975 INFO:tasks.workunit.client.0.smithi155.stdout:3/647: link d0/d14/d36/c48 d0/d14/d87/d94/da1/cc2 0 2023-12-16T05:56:41.975 INFO:tasks.workunit.client.0.smithi155.stdout:7/799: read d0/d6a/d1a/d22/f86 [202971,35352] 0 2023-12-16T05:56:41.975 INFO:tasks.workunit.client.1.smithi156.stdout:0/771: dwrite d2/d7/dd/d29/f4f [4194304,4194304] 0 2023-12-16T05:56:41.975 INFO:tasks.workunit.client.1.smithi156.stdout:0/772: chown d2/l34 9661 1 2023-12-16T05:56:41.976 INFO:tasks.workunit.client.0.smithi155.stdout:2/834: creat d0/d5/d6/d5f/f120 x:0 0 0 2023-12-16T05:56:41.976 INFO:tasks.workunit.client.0.smithi155.stdout:2/835: truncate d0/d5/d6/f82 4787648 0 2023-12-16T05:56:41.976 INFO:tasks.workunit.client.0.smithi155.stdout:2/836: stat d0/d7/d57/d9b/ca3 0 2023-12-16T05:56:41.976 INFO:tasks.workunit.client.0.smithi155.stdout:2/837: truncate d0/d7/d57/d63/ff1 342861 0 2023-12-16T05:56:41.977 INFO:tasks.workunit.client.1.smithi156.stdout:0/773: read d2/d7/dd/d29/d38/d51/d52/f8c [1649066,74001] 0 2023-12-16T05:56:41.979 INFO:tasks.workunit.client.0.smithi155.stdout:3/648: rename d0/d14/d51 to d0/d1a/d33/d57/dc3 0 2023-12-16T05:56:41.981 INFO:tasks.workunit.client.0.smithi155.stdout:7/800: unlink d0/d6a/d1a/d8c/d34/d4b/d64/d6f/dba/dc9/cfc 0 2023-12-16T05:56:41.982 INFO:tasks.workunit.client.0.smithi155.stdout:2/838: symlink d0/d7/dd/d49/d4b/d80/l121 0 2023-12-16T05:56:41.983 INFO:tasks.workunit.client.0.smithi155.stdout:3/649: creat d0/d14/d87/d94/da1/d73/fc4 x:0 0 0 2023-12-16T05:56:41.985 INFO:tasks.workunit.client.0.smithi155.stdout:2/839: creat d0/d7/d1f/d74/f122 x:0 0 0 2023-12-16T05:56:41.985 INFO:tasks.workunit.client.0.smithi155.stdout:2/840: getdents d0/d7/dd/d49/d4b/d8c 0 2023-12-16T05:56:41.986 INFO:tasks.workunit.client.1.smithi156.stdout:9/673: dwrite d6/fd [4194304,4194304] 0 2023-12-16T05:56:41.986 INFO:tasks.workunit.client.1.smithi156.stdout:4/622: dwrite d9/d2c/d7a/dc0/fd1 [0,4194304] 0 2023-12-16T05:56:41.986 INFO:tasks.workunit.client.1.smithi156.stdout:2/684: dwrite d9/f1f [4194304,4194304] 0 2023-12-16T05:56:41.987 INFO:tasks.workunit.client.0.smithi155.stdout:4/860: dwrite d0/da/de0/d16/d30/dce/f6d [0,4194304] 0 2023-12-16T05:56:41.987 INFO:tasks.workunit.client.0.smithi155.stdout:4/861: dread - d0/da/de0/d16/d30/dcd/f111 zero size 2023-12-16T05:56:41.987 INFO:tasks.workunit.client.0.smithi155.stdout:3/650: link d0/d1a/d33/fb7 d0/d14/fc5 0 2023-12-16T05:56:41.987 INFO:tasks.workunit.client.0.smithi155.stdout:3/651: stat d0/d1a/d33/d57/dc3/f4a 0 2023-12-16T05:56:41.987 INFO:tasks.workunit.client.0.smithi155.stdout:3/652: chown d0/d1e/d4e 11 1 2023-12-16T05:56:41.987 INFO:tasks.workunit.client.1.smithi156.stdout:4/623: write d9/d2b/f31 [1756855,118431] 0 2023-12-16T05:56:41.988 INFO:tasks.workunit.client.1.smithi156.stdout:3/630: dwrite dc/d10/d3d/db5/fbf [0,4194304] 0 2023-12-16T05:56:41.989 INFO:tasks.workunit.client.0.smithi155.stdout:5/918: dwrite d0/d2/d2a/d30/d53/fba [0,4194304] 0 2023-12-16T05:56:41.989 INFO:tasks.workunit.client.0.smithi155.stdout:5/919: truncate d0/d2/d2a/d30/d53/d7b/d99/f6c 1644056 0 2023-12-16T05:56:41.989 INFO:tasks.workunit.client.1.smithi156.stdout:5/833: dwrite da/dc/d2d/d4d/d54/fd5 [0,4194304] 0 2023-12-16T05:56:41.989 INFO:tasks.workunit.client.1.smithi156.stdout:7/879: dwrite d1e/d55/db6/f123 [0,4194304] 0 2023-12-16T05:56:41.991 INFO:tasks.workunit.client.1.smithi156.stdout:9/674: rename d6/d19/d30/d5b/d9a/l9d to d6/d19/d30/dae/db7/le8 0 2023-12-16T05:56:41.992 INFO:tasks.workunit.client.0.smithi155.stdout:5/920: write d0/d2/d2a/d19/d71/f7e [1539064,57492] 0 2023-12-16T05:56:41.994 INFO:tasks.workunit.client.1.smithi156.stdout:2/685: link d9/dd/d17/d33/d78/d39/f79 d9/dd/d17/d33/d78/d74/dd0/fdb 0 2023-12-16T05:56:41.995 INFO:tasks.workunit.client.0.smithi155.stdout:5/921: rename d0/d2/d2a/d19/d48/cbf to d0/d2/d2a/d19/d88/dd8/c128 0 2023-12-16T05:56:41.996 INFO:tasks.workunit.client.0.smithi155.stdout:5/922: creat d0/d2/d2a/d19/d88/dd8/f129 x:0 0 0 2023-12-16T05:56:41.996 INFO:tasks.workunit.client.0.smithi155.stdout:5/923: truncate d0/d2/d2a/d19/d88/dd8/ffd 1028646 0 2023-12-16T05:56:41.996 INFO:tasks.workunit.client.0.smithi155.stdout:5/924: truncate d0/d2/d2a/d30/d53/d7b/d99/fca 5066083 0 2023-12-16T05:56:41.996 INFO:tasks.workunit.client.0.smithi155.stdout:5/925: fdatasync d0/d2/d2a/d30/d53/d7b/d99/d47/fb8 0 2023-12-16T05:56:41.997 INFO:tasks.workunit.client.0.smithi155.stdout:5/926: mknod d0/d2/d2a/d19/dd7/dee/c12a 0 2023-12-16T05:56:41.997 INFO:tasks.workunit.client.0.smithi155.stdout:5/927: write d0/d2/d2a/d19/d88/fc0 [1182213,92317] 0 2023-12-16T05:56:41.998 INFO:tasks.workunit.client.0.smithi155.stdout:5/928: creat d0/d2/d2a/d19/de2/f12b x:0 0 0 2023-12-16T05:56:41.999 INFO:tasks.workunit.client.1.smithi156.stdout:7/880: dread d1e/d55/d71/d61/fa5 [0,4194304] 0 2023-12-16T05:56:42.001 INFO:tasks.workunit.client.1.smithi156.stdout:3/631: creat dc/d10/d1d/d4b/dac/fe9 x:0 0 0 2023-12-16T05:56:42.001 INFO:tasks.workunit.client.1.smithi156.stdout:3/632: write dc/fd3 [791257,74475] 0 2023-12-16T05:56:42.003 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:41 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:42.003 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:41 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:42.003 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:41 smithi155 ceph-mon[112451]: Reconfiguring alertmanager.smithi155 (dependencies changed)... 2023-12-16T05:56:42.003 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:41 smithi155 ceph-mon[112451]: Reconfiguring daemon alertmanager.smithi155 on smithi155 2023-12-16T05:56:42.003 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:41 smithi155 ceph-mon[112451]: pgmap v17: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 208 MiB/s rd, 425 MiB/s wr, 652 op/s 2023-12-16T05:56:42.004 INFO:tasks.workunit.client.1.smithi156.stdout:5/834: creat da/dc/d4b/f110 x:0 0 0 2023-12-16T05:56:42.004 INFO:tasks.workunit.client.1.smithi156.stdout:5/835: write da/f42 [841541,20934] 0 2023-12-16T05:56:42.007 INFO:tasks.workunit.client.0.smithi155.stdout:7/801: dwrite d0/d6a/d1a/d2b/d65/ff2 [0,4194304] 0 2023-12-16T05:56:42.010 INFO:tasks.workunit.client.1.smithi156.stdout:5/836: fsync da/dc/f19 0 2023-12-16T05:56:42.010 INFO:tasks.workunit.client.0.smithi155.stdout:7/802: mkdir d0/d6a/d1a/d8c/d34/d4b/d64/d101 0 2023-12-16T05:56:42.010 INFO:tasks.workunit.client.0.smithi155.stdout:7/803: stat d0/d6a/d1a/d8c/d34/d4b 0 2023-12-16T05:56:42.012 INFO:tasks.workunit.client.0.smithi155.stdout:4/862: dread d0/da/f5e [0,4194304] 0 2023-12-16T05:56:42.015 INFO:tasks.workunit.client.0.smithi155.stdout:5/929: dread d0/d2/d2a/d30/d53/fdd [0,4194304] 0 2023-12-16T05:56:42.016 INFO:tasks.workunit.client.1.smithi156.stdout:9/675: mkdir d6/d19/d25/d3a/d80/dc0/de9 0 2023-12-16T05:56:42.016 INFO:tasks.workunit.client.1.smithi156.stdout:4/624: dwrite d9/fa3 [4194304,4194304] 0 2023-12-16T05:56:42.016 INFO:tasks.workunit.client.1.smithi156.stdout:2/686: truncate d9/d12/dc2/dd8/da6/f64 1359203 0 2023-12-16T05:56:42.019 INFO:tasks.workunit.client.0.smithi155.stdout:7/804: mknod d0/d6a/d1a/d8c/d34/d4b/d60/dd8/c102 0 2023-12-16T05:56:42.019 INFO:tasks.workunit.client.0.smithi155.stdout:3/653: dread d0/d1a/d33/f72 [0,4194304] 0 2023-12-16T05:56:42.020 INFO:tasks.workunit.client.1.smithi156.stdout:5/837: dread da/dc/f2e [0,4194304] 0 2023-12-16T05:56:42.020 INFO:tasks.workunit.client.0.smithi155.stdout:4/863: unlink d0/da/de0/l19 0 2023-12-16T05:56:42.020 INFO:tasks.workunit.client.0.smithi155.stdout:4/864: fdatasync d0/f1d 0 2023-12-16T05:56:42.022 INFO:tasks.workunit.client.0.smithi155.stdout:7/805: mkdir d0/d1b/d103 0 2023-12-16T05:56:42.022 INFO:tasks.workunit.client.0.smithi155.stdout:7/806: chown d0/d6a/d1a/d8c/d34/d4b/d64/d6f/dba 2627308 1 2023-12-16T05:56:42.022 INFO:tasks.workunit.client.0.smithi155.stdout:7/807: truncate d0/d1/f67 1347488 0 2023-12-16T05:56:42.023 INFO:tasks.workunit.client.1.smithi156.stdout:4/625: write d9/f42 [2660887,128011] 0 2023-12-16T05:56:42.023 INFO:tasks.workunit.client.0.smithi155.stdout:7/808: write d0/d6a/d1a/d22/f86 [3366579,102010] 0 2023-12-16T05:56:42.023 INFO:tasks.workunit.client.0.smithi155.stdout:7/809: truncate d0/d6a/d1a/da0/fa5 94976 0 2023-12-16T05:56:42.024 INFO:tasks.workunit.client.1.smithi156.stdout:5/838: creat da/d9a/dcd/dce/f111 x:0 0 0 2023-12-16T05:56:42.024 INFO:tasks.workunit.client.1.smithi156.stdout:7/881: dwrite d1e/fc6 [0,4194304] 0 2023-12-16T05:56:42.024 INFO:tasks.workunit.client.1.smithi156.stdout:9/676: symlink d6/lea 0 2023-12-16T05:56:42.024 INFO:tasks.workunit.client.0.smithi155.stdout:3/654: symlink d0/d14/d36/d7c/lc6 0 2023-12-16T05:56:42.025 INFO:tasks.workunit.client.0.smithi155.stdout:3/655: truncate d0/d1a/d33/fb7 68818 0 2023-12-16T05:56:42.026 INFO:tasks.workunit.client.0.smithi155.stdout:4/865: symlink d0/da/de0/d16/d30/l120 0 2023-12-16T05:56:42.026 INFO:tasks.workunit.client.0.smithi155.stdout:4/866: write d0/da/de0/d16/d30/dce/ff7 [493545,112627] 0 2023-12-16T05:56:42.026 INFO:tasks.workunit.client.0.smithi155.stdout:4/867: chown d0/da/de0/d16/d30/dce/d75/d3d/d49/dbb/la5 1721685 1 2023-12-16T05:56:42.026 INFO:tasks.workunit.client.1.smithi156.stdout:4/626: mknod d9/cd2 0 2023-12-16T05:56:42.026 INFO:tasks.workunit.client.0.smithi155.stdout:5/930: dread d0/d2/d2a/d19/d88/fc0 [0,4194304] 0 2023-12-16T05:56:42.027 INFO:tasks.workunit.client.0.smithi155.stdout:3/656: rename d0/d14/d36/d47/d5f/l62 to d0/d1e/d4e/db6/lc7 0 2023-12-16T05:56:42.028 INFO:tasks.workunit.client.1.smithi156.stdout:5/839: link da/cf1 da/dc/d4b/d6c/d81/dc5/c112 0 2023-12-16T05:56:42.028 INFO:tasks.workunit.client.1.smithi156.stdout:5/840: readlink da/dc/d2d/d4d/db9/lf9 0 2023-12-16T05:56:42.028 INFO:tasks.workunit.client.0.smithi155.stdout:7/810: dread d0/d6a/d1a/d8c/d34/d4b/d64/d6e/f9b [0,4194304] 0 2023-12-16T05:56:42.029 INFO:tasks.workunit.client.1.smithi156.stdout:6/665: sync 2023-12-16T05:56:42.029 INFO:tasks.workunit.client.1.smithi156.stdout:6/666: write d9/d13/d2f/d51/d82/f8f [678513,116995] 0 2023-12-16T05:56:42.029 INFO:tasks.workunit.client.1.smithi156.stdout:6/667: dread - d9/d13/d3e/f83 zero size 2023-12-16T05:56:42.030 INFO:tasks.workunit.client.0.smithi155.stdout:4/868: link d0/da/de0/d16/d30/d52/l59 d0/da/de0/d16/d30/dce/d75/d10e/d70/d92/daf/l121 0 2023-12-16T05:56:42.032 INFO:tasks.workunit.client.0.smithi155.stdout:5/931: mkdir d0/d2/d2a/d30/d53/d12c 0 2023-12-16T05:56:42.032 INFO:tasks.workunit.client.1.smithi156.stdout:7/882: getdents d1e/d1f/d22/d75/d77 0 2023-12-16T05:56:42.033 INFO:tasks.workunit.client.1.smithi156.stdout:1/551: sync 2023-12-16T05:56:42.033 INFO:tasks.workunit.client.1.smithi156.stdout:8/497: sync 2023-12-16T05:56:42.033 INFO:tasks.workunit.client.0.smithi155.stdout:7/811: rename d0/d6a/d85/cf7 to d0/d6a/d1a/d8c/d34/d4b/d64/c104 0 2023-12-16T05:56:42.033 INFO:tasks.workunit.client.0.smithi155.stdout:7/812: fdatasync d0/d1/fef 0 2023-12-16T05:56:42.034 INFO:tasks.workunit.client.1.smithi156.stdout:9/677: creat d6/d2e/feb x:0 0 0 2023-12-16T05:56:42.035 INFO:tasks.workunit.client.1.smithi156.stdout:9/678: truncate d6/d19/f24 1146778 0 2023-12-16T05:56:42.035 INFO:tasks.workunit.client.1.smithi156.stdout:9/679: dread - d6/d19/d25/d3a/fb5 zero size 2023-12-16T05:56:42.035 INFO:tasks.workunit.client.1.smithi156.stdout:9/680: fdatasync d6/d19/d25/d3a/f4a 0 2023-12-16T05:56:42.035 INFO:tasks.workunit.client.0.smithi155.stdout:5/932: creat d0/d2/d2a/d19/d21/d56/f12d x:0 0 0 2023-12-16T05:56:42.036 INFO:tasks.workunit.client.1.smithi156.stdout:4/627: mkdir d9/d2b/d35/dd3 0 2023-12-16T05:56:42.039 INFO:tasks.workunit.client.0.smithi155.stdout:7/813: creat d0/d6a/d31/f105 x:0 0 0 2023-12-16T05:56:42.039 INFO:tasks.workunit.client.0.smithi155.stdout:7/814: fsync d0/fd2 0 2023-12-16T05:56:42.040 INFO:tasks.workunit.client.1.smithi156.stdout:2/687: dwrite d9/d68/daa/db4/f99 [0,4194304] 0 2023-12-16T05:56:42.040 INFO:tasks.workunit.client.1.smithi156.stdout:8/498: mknod d3/d7/d27/d46/d6e/d3b/ca9 0 2023-12-16T05:56:42.040 INFO:tasks.workunit.client.1.smithi156.stdout:8/499: readlink d3/d12/d74/l8b 0 2023-12-16T05:56:42.041 INFO:tasks.workunit.client.1.smithi156.stdout:1/552: symlink d3/d17/lba 0 2023-12-16T05:56:42.042 INFO:tasks.workunit.client.0.smithi155.stdout:5/933: mkdir d0/d2/d2a/d30/d53/d7b/d99/d47/d12e 0 2023-12-16T05:56:42.042 INFO:tasks.workunit.client.0.smithi155.stdout:5/934: fsync d0/d2/d2a/d30/d53/d7b/db3/fcb 0 2023-12-16T05:56:42.043 INFO:tasks.workunit.client.1.smithi156.stdout:9/681: creat d6/d19/d25/d3a/d88/d8b/dac/dc9/fec x:0 0 0 2023-12-16T05:56:42.044 INFO:tasks.workunit.client.0.smithi155.stdout:5/935: creat d0/d2/d2a/d30/d53/d7b/d99/d47/d61/d119/f12f x:0 0 0 2023-12-16T05:56:42.045 INFO:tasks.workunit.client.1.smithi156.stdout:4/628: mkdir d9/d2c/d7a/dd4 0 2023-12-16T05:56:42.045 INFO:tasks.workunit.client.1.smithi156.stdout:9/682: write d6/d19/d30/d5b/d9a/f9f [3979,100984] 0 2023-12-16T05:56:42.046 INFO:tasks.workunit.client.0.smithi155.stdout:5/936: unlink d0/d2/d2a/d30/d53/d7b/d99/d47/la9 0 2023-12-16T05:56:42.046 INFO:tasks.workunit.client.0.smithi155.stdout:5/937: getdents d0/d2/d2a/d30/d53/d7b/d99/d47/d61/db6/def 0 2023-12-16T05:56:42.047 INFO:tasks.workunit.client.1.smithi156.stdout:2/688: unlink d9/d68/daa/d83/da1/d96/fcb 0 2023-12-16T05:56:42.047 INFO:tasks.workunit.client.1.smithi156.stdout:5/841: dread da/dc/d2d/f4c [0,4194304] 0 2023-12-16T05:56:42.048 INFO:tasks.workunit.client.1.smithi156.stdout:8/500: creat d3/d7/d62/d6b/faa x:0 0 0 2023-12-16T05:56:42.049 INFO:tasks.workunit.client.1.smithi156.stdout:1/553: rmdir d3/d17/d1c 39 2023-12-16T05:56:42.050 INFO:tasks.workunit.client.0.smithi155.stdout:7/815: dread d0/d1/d5/fd [0,4194304] 0 2023-12-16T05:56:42.051 INFO:tasks.workunit.client.0.smithi155.stdout:0/957: sync 2023-12-16T05:56:42.051 INFO:tasks.workunit.client.0.smithi155.stdout:7/816: truncate d0/d1/d5/f1d 1346271 0 2023-12-16T05:56:42.053 INFO:tasks.workunit.client.0.smithi155.stdout:0/958: rename d7/d13/d45/d3e/l10d to d7/da4/l13b 0 2023-12-16T05:56:42.053 INFO:tasks.workunit.client.1.smithi156.stdout:7/883: dread d1e/d1f/da6/d57/dbb/fcc [0,4194304] 0 2023-12-16T05:56:42.053 INFO:tasks.workunit.client.1.smithi156.stdout:7/884: dread - d1e/d1f/da6/d57/dbb/f12b zero size 2023-12-16T05:56:42.054 INFO:tasks.workunit.client.1.smithi156.stdout:8/501: dread d3/d7/d27/d46/d6e/d3c/f55 [0,4194304] 0 2023-12-16T05:56:42.054 INFO:tasks.workunit.client.1.smithi156.stdout:7/885: write d1e/d1f/ffa [202552,68480] 0 2023-12-16T05:56:42.054 INFO:tasks.workunit.client.1.smithi156.stdout:7/886: readlink d1e/d55/d71/d61/daa/l69 0 2023-12-16T05:56:42.054 INFO:tasks.workunit.client.1.smithi156.stdout:9/683: unlink d6/d19/l71 0 2023-12-16T05:56:42.054 INFO:tasks.workunit.client.1.smithi156.stdout:9/684: fdatasync d6/d2e/d8a/da5/fd9 0 2023-12-16T05:56:42.055 INFO:tasks.workunit.client.0.smithi155.stdout:7/817: mkdir d0/d1b/d106 0 2023-12-16T05:56:42.055 INFO:tasks.workunit.client.0.smithi155.stdout:0/959: mkdir d7/df/d73/d8d/d4d/d115/d53/d13c 0 2023-12-16T05:56:42.055 INFO:tasks.workunit.client.0.smithi155.stdout:3/657: dwrite d0/d14/f28 [4194304,4194304] 0 2023-12-16T05:56:42.055 INFO:tasks.workunit.client.0.smithi155.stdout:3/658: chown d0/d14/d36/c3b 439472030 1 2023-12-16T05:56:42.055 INFO:tasks.workunit.client.1.smithi156.stdout:6/668: dwrite d9/d1c/d50/fa1 [0,4194304] 0 2023-12-16T05:56:42.055 INFO:tasks.workunit.client.1.smithi156.stdout:2/689: mknod d9/dd/d17/d33/d78/d39/d8c/dbe/cdc 0 2023-12-16T05:56:42.057 INFO:tasks.workunit.client.1.smithi156.stdout:5/842: mknod da/dc/d2d/c113 0 2023-12-16T05:56:42.058 INFO:tasks.workunit.client.1.smithi156.stdout:6/669: read d9/f70 [4136599,35157] 0 2023-12-16T05:56:42.060 INFO:tasks.workunit.client.1.smithi156.stdout:1/554: unlink d3/f6 0 2023-12-16T05:56:42.060 INFO:tasks.workunit.client.1.smithi156.stdout:1/555: write d3/d17/d4d/fb0 [512956,46120] 0 2023-12-16T05:56:42.061 INFO:tasks.workunit.client.1.smithi156.stdout:6/670: write d9/d13/d3e/f57 [621499,115794] 0 2023-12-16T05:56:42.061 INFO:tasks.workunit.client.1.smithi156.stdout:1/556: fdatasync d3/d17/f52 0 2023-12-16T05:56:42.062 INFO:tasks.workunit.client.1.smithi156.stdout:9/685: creat d6/d19/d25/d72/fed x:0 0 0 2023-12-16T05:56:42.062 INFO:tasks.workunit.client.1.smithi156.stdout:9/686: stat d6/f51 0 2023-12-16T05:56:42.062 INFO:tasks.workunit.client.1.smithi156.stdout:9/687: chown d6/d2e 208838 1 2023-12-16T05:56:42.062 INFO:tasks.workunit.client.1.smithi156.stdout:9/688: read - d6/d2e/fc5 zero size 2023-12-16T05:56:42.066 INFO:tasks.workunit.client.1.smithi156.stdout:7/887: dread d1e/fb2 [0,4194304] 0 2023-12-16T05:56:42.066 INFO:tasks.workunit.client.1.smithi156.stdout:4/629: dwrite d9/fa3 [0,4194304] 0 2023-12-16T05:56:42.067 INFO:tasks.workunit.client.1.smithi156.stdout:2/690: unlink d9/dd/d17/f51 0 2023-12-16T05:56:42.069 INFO:tasks.workunit.client.0.smithi155.stdout:0/960: dread d7/d13/f1b [0,4194304] 0 2023-12-16T05:56:42.071 INFO:tasks.workunit.client.1.smithi156.stdout:8/502: dwrite d3/d6/f36 [8388608,4194304] 0 2023-12-16T05:56:42.071 INFO:tasks.workunit.client.1.smithi156.stdout:8/503: truncate d3/d7/d27/d46/d6e/d3c/f55 1458840 0 2023-12-16T05:56:42.071 INFO:tasks.workunit.client.1.smithi156.stdout:1/557: truncate d3/d1b/d27/f5c 3792684 0 2023-12-16T05:56:42.071 INFO:tasks.workunit.client.1.smithi156.stdout:1/558: write d3/fae [770556,129101] 0 2023-12-16T05:56:42.072 INFO:tasks.workunit.client.1.smithi156.stdout:5/843: unlink da/d46/c57 0 2023-12-16T05:56:42.073 INFO:tasks.workunit.client.1.smithi156.stdout:6/671: mkdir d9/d1c/d50/dbf/dca 0 2023-12-16T05:56:42.075 INFO:tasks.workunit.client.1.smithi156.stdout:7/888: symlink d1e/d1f/da6/d10d/d117/l132 0 2023-12-16T05:56:42.077 INFO:tasks.workunit.client.0.smithi155.stdout:0/961: creat d7/df/d73/d8d/d4d/de8/de5/f13d x:0 0 0 2023-12-16T05:56:42.077 INFO:tasks.workunit.client.0.smithi155.stdout:0/962: fsync d7/d2d/fd3 0 2023-12-16T05:56:42.077 INFO:tasks.workunit.client.1.smithi156.stdout:4/630: mknod d9/d43/d58/d7d/cd5 0 2023-12-16T05:56:42.078 INFO:tasks.workunit.client.1.smithi156.stdout:2/691: mkdir d9/dd/d17/d33/d47/ddd 0 2023-12-16T05:56:42.078 INFO:tasks.workunit.client.1.smithi156.stdout:2/692: chown d9 182 1 2023-12-16T05:56:42.082 INFO:tasks.workunit.client.0.smithi155.stdout:3/659: dwrite d0/d1e/f9f [4194304,4194304] 0 2023-12-16T05:56:42.082 INFO:tasks.workunit.client.0.smithi155.stdout:0/963: unlink d7/df/d41/f97 0 2023-12-16T05:56:42.083 INFO:tasks.workunit.client.0.smithi155.stdout:0/964: truncate d7/df/d41/d23/d36/fb5 261099 0 2023-12-16T05:56:42.085 INFO:tasks.workunit.client.0.smithi155.stdout:3/660: symlink d0/d1a/da3/lc8 0 2023-12-16T05:56:42.086 INFO:tasks.workunit.client.0.smithi155.stdout:3/661: truncate d0/d1e/f68 1217368 0 2023-12-16T05:56:42.086 INFO:tasks.workunit.client.0.smithi155.stdout:0/965: write d7/df/d73/d8d/d4d/d115/d5d/d6a/f7c [3756236,52387] 0 2023-12-16T05:56:42.087 INFO:tasks.workunit.client.0.smithi155.stdout:3/662: getdents d0/d14/d36 0 2023-12-16T05:56:42.088 INFO:tasks.workunit.client.0.smithi155.stdout:0/966: creat d7/d13/d46/f13e x:0 0 0 2023-12-16T05:56:42.088 INFO:tasks.workunit.client.0.smithi155.stdout:0/967: readlink d7/df/d73/df8/l12c 0 2023-12-16T05:56:42.089 INFO:tasks.workunit.client.1.smithi156.stdout:8/504: dwrite d3/d18/f41 [0,4194304] 0 2023-12-16T05:56:42.089 INFO:tasks.workunit.client.1.smithi156.stdout:8/505: dread - d3/d7a/fa4 zero size 2023-12-16T05:56:42.089 INFO:tasks.workunit.client.1.smithi156.stdout:8/506: stat d3/d6 0 2023-12-16T05:56:42.089 INFO:tasks.workunit.client.1.smithi156.stdout:8/507: fdatasync d3/d7/d66/fa8 0 2023-12-16T05:56:42.089 INFO:tasks.workunit.client.1.smithi156.stdout:8/508: truncate d3/d7/d62/f9d 757817 0 2023-12-16T05:56:42.089 INFO:tasks.workunit.client.1.smithi156.stdout:8/509: chown d3/d7/d27/d46/d84/d85/d9b/c9e 223904893 1 2023-12-16T05:56:42.090 INFO:tasks.workunit.client.1.smithi156.stdout:1/559: symlink d3/d17/d1c/d22/d57/d82/lbb 0 2023-12-16T05:56:42.091 INFO:tasks.workunit.client.0.smithi155.stdout:0/968: creat d7/d13/d46/d125/f13f x:0 0 0 2023-12-16T05:56:42.091 INFO:tasks.workunit.client.0.smithi155.stdout:3/663: write d0/d1e/f9f [4705036,72899] 0 2023-12-16T05:56:42.091 INFO:tasks.workunit.client.0.smithi155.stdout:3/664: fsync d0/f10 0 2023-12-16T05:56:42.091 INFO:tasks.workunit.client.0.smithi155.stdout:3/665: dread d0/d14/fc5 [0,4194304] 0 2023-12-16T05:56:42.091 INFO:tasks.workunit.client.0.smithi155.stdout:0/969: creat d7/df/d73/d8d/d9b/f140 x:0 0 0 2023-12-16T05:56:42.092 INFO:tasks.workunit.client.0.smithi155.stdout:0/970: fdatasync d7/df/d73/d8d/d4d/f10b 0 2023-12-16T05:56:42.092 INFO:tasks.workunit.client.1.smithi156.stdout:5/844: mkdir da/d46/d114 0 2023-12-16T05:56:42.093 INFO:tasks.workunit.client.1.smithi156.stdout:6/672: creat d9/d13/d2f/d51/d82/d89/fcb x:0 0 0 2023-12-16T05:56:42.094 INFO:tasks.workunit.client.1.smithi156.stdout:6/673: write d9/d1c/d50/fc3 [289373,104090] 0 2023-12-16T05:56:42.097 INFO:tasks.workunit.client.0.smithi155.stdout:0/971: creat d7/df/d73/d8d/d4d/f141 x:0 0 0 2023-12-16T05:56:42.097 INFO:tasks.workunit.client.0.smithi155.stdout:0/972: dread - d7/df/d73/d8d/d4d/d115/d5d/f12d zero size 2023-12-16T05:56:42.097 INFO:tasks.workunit.client.0.smithi155.stdout:0/973: truncate d7/df/d73/d8d/d4d/d115/fd0 521942 0 2023-12-16T05:56:42.098 INFO:tasks.workunit.client.1.smithi156.stdout:9/689: rename d6/d19/d25/l7f to d6/lee 0 2023-12-16T05:56:42.099 INFO:tasks.workunit.client.1.smithi156.stdout:7/889: symlink d1e/d55/d71/l133 0 2023-12-16T05:56:42.099 INFO:tasks.workunit.client.0.smithi155.stdout:7/818: truncate d0/d1/f67 1304406 0 2023-12-16T05:56:42.100 INFO:tasks.workunit.client.1.smithi156.stdout:4/631: symlink d9/d2b/d9a/dc2/ld6 0 2023-12-16T05:56:42.100 INFO:tasks.workunit.client.1.smithi156.stdout:4/632: stat d9/d2c/d48/dae/f91 0 2023-12-16T05:56:42.101 INFO:tasks.workunit.client.1.smithi156.stdout:4/633: truncate d9/d2b/d98/d99/f83 607964 0 2023-12-16T05:56:42.101 INFO:tasks.workunit.client.0.smithi155.stdout:7/819: creat d0/d6a/d1a/d8c/d34/d4b/d64/f107 x:0 0 0 2023-12-16T05:56:42.102 INFO:tasks.workunit.client.0.smithi155.stdout:7/820: symlink d0/d6a/d31/l108 0 2023-12-16T05:56:42.105 INFO:tasks.workunit.client.1.smithi156.stdout:5/845: dread da/dc/d2d/f4c [0,4194304] 0 2023-12-16T05:56:42.105 INFO:tasks.workunit.client.0.smithi155.stdout:7/821: write d0/d6a/f8d [632782,119514] 0 2023-12-16T05:56:42.106 INFO:tasks.workunit.client.0.smithi155.stdout:7/822: rename d0/d6a/d1a/d8c/d34/d4b/f51 to d0/d1b/f109 0 2023-12-16T05:56:42.107 INFO:tasks.workunit.client.1.smithi156.stdout:1/560: mkdir d3/d17/d1c/d22/d57/dbc 0 2023-12-16T05:56:42.107 INFO:tasks.workunit.client.1.smithi156.stdout:1/561: truncate d3/d1b/d8b/f93 664384 0 2023-12-16T05:56:42.112 INFO:tasks.workunit.client.1.smithi156.stdout:6/674: rename d9/d13/d2f/l97 to d9/d13/d2f/d51/dad/lcc 0 2023-12-16T05:56:42.112 INFO:tasks.workunit.client.1.smithi156.stdout:6/675: write d9/d13/d2f/d51/fc6 [1038428,20006] 0 2023-12-16T05:56:42.112 INFO:tasks.workunit.client.1.smithi156.stdout:9/690: getdents d6/d19/d25/d3a/dc3 0 2023-12-16T05:56:42.112 INFO:tasks.workunit.client.1.smithi156.stdout:9/691: chown d6/da3/db0/lb3 9236619 1 2023-12-16T05:56:42.113 INFO:tasks.workunit.client.1.smithi156.stdout:7/890: mkdir d1e/d55/d71/d61/dac/d134 0 2023-12-16T05:56:42.114 INFO:tasks.workunit.client.1.smithi156.stdout:4/634: truncate d9/f18 3510387 0 2023-12-16T05:56:42.115 INFO:tasks.workunit.client.1.smithi156.stdout:5/846: link da/dc/d4b/d6c/d77/c86 da/d46/d114/c115 0 2023-12-16T05:56:42.116 INFO:tasks.workunit.client.1.smithi156.stdout:0/774: sync 2023-12-16T05:56:42.117 INFO:tasks.workunit.client.1.smithi156.stdout:1/562: mknod d3/d1b/d8b/cbd 0 2023-12-16T05:56:42.118 INFO:tasks.workunit.client.1.smithi156.stdout:8/510: dwrite d3/d7/d27/d46/d6e/f2a [0,4194304] 0 2023-12-16T05:56:42.118 INFO:tasks.workunit.client.1.smithi156.stdout:8/511: write d3/d7a/d7d/fa6 [986785,21749] 0 2023-12-16T05:56:42.119 INFO:tasks.workunit.client.1.smithi156.stdout:9/692: link d6/da3/db0/fcc d6/d2e/d8a/da5/fef 0 2023-12-16T05:56:42.120 INFO:tasks.workunit.client.1.smithi156.stdout:9/693: fsync d6/d19/d25/fbf 0 2023-12-16T05:56:42.121 INFO:tasks.workunit.client.0.smithi155.stdout:3/666: dwrite d0/f2e [0,4194304] 0 2023-12-16T05:56:42.121 INFO:tasks.workunit.client.1.smithi156.stdout:7/891: creat d1e/d1f/da6/d57/d59/f135 x:0 0 0 2023-12-16T05:56:42.121 INFO:tasks.workunit.client.1.smithi156.stdout:7/892: readlink d1e/d1f/d22/l9c 0 2023-12-16T05:56:42.121 INFO:tasks.workunit.client.1.smithi156.stdout:7/893: write d1e/d55/d71/ff9 [983702,78643] 0 2023-12-16T05:56:42.133 INFO:tasks.workunit.client.1.smithi156.stdout:0/775: stat d2/c6 0 2023-12-16T05:56:42.133 INFO:tasks.workunit.client.1.smithi156.stdout:3/633: sync 2023-12-16T05:56:42.133 INFO:tasks.workunit.client.1.smithi156.stdout:5/847: rename da/dc/d2d/d4d/db9/dc9/dfa/f10a to da/dc/d4b/d6c/d81/dc5/df8/f116 0 2023-12-16T05:56:42.138 INFO:tasks.workunit.client.1.smithi156.stdout:8/512: creat d3/d7a/fab x:0 0 0 2023-12-16T05:56:42.140 INFO:tasks.workunit.client.1.smithi156.stdout:6/676: dwrite d9/d1c/f49 [0,4194304] 0 2023-12-16T05:56:42.141 INFO:tasks.workunit.client.1.smithi156.stdout:6/677: chown d9/d1c/d50/dbf/dc0 0 1 2023-12-16T05:56:42.141 INFO:tasks.workunit.client.1.smithi156.stdout:6/678: stat d9/d13/f18 0 2023-12-16T05:56:42.143 INFO:tasks.workunit.client.1.smithi156.stdout:1/563: dwrite d3/d1b/d27/d4f/f62 [0,4194304] 0 2023-12-16T05:56:42.145 INFO:tasks.workunit.client.1.smithi156.stdout:7/894: mkdir d1e/d55/d136 0 2023-12-16T05:56:42.145 INFO:tasks.workunit.client.1.smithi156.stdout:4/635: mknod d9/d2b/cd7 0 2023-12-16T05:56:42.145 INFO:tasks.workunit.client.1.smithi156.stdout:4/636: chown d9/d2c/d7a/f92 124 1 2023-12-16T05:56:42.146 INFO:tasks.workunit.client.1.smithi156.stdout:3/634: link dc/df/d66/fdd dc/df/d66/fea 0 2023-12-16T05:56:42.146 INFO:tasks.workunit.client.1.smithi156.stdout:3/635: read - dc/d10/fe8 zero size 2023-12-16T05:56:42.147 INFO:tasks.workunit.client.0.smithi155.stdout:0/974: dwrite d7/df/d73/d8d/d4d/d115/d5d/d6a/f7c [0,4194304] 0 2023-12-16T05:56:42.147 INFO:tasks.workunit.client.0.smithi155.stdout:0/975: dread - d7/df/d41/d23/d36/dad/f123 zero size 2023-12-16T05:56:42.147 INFO:tasks.workunit.client.0.smithi155.stdout:0/976: truncate d7/df/d73/d8d/d4d/d115/fd0 998167 0 2023-12-16T05:56:42.148 INFO:tasks.workunit.client.1.smithi156.stdout:5/848: rename da/dc/d2d/d4d/d54/d90/fab to da/dc/d2d/d4d/d54/d67/f117 0 2023-12-16T05:56:42.148 INFO:tasks.workunit.client.1.smithi156.stdout:4/637: write d9/d2b/d98/fb3 [1497201,51671] 0 2023-12-16T05:56:42.148 INFO:tasks.workunit.client.0.smithi155.stdout:0/977: creat d7/df/d41/d23/d36/dad/d10a/f142 x:0 0 0 2023-12-16T05:56:42.149 INFO:tasks.workunit.client.1.smithi156.stdout:6/679: creat d9/d1c/d50/dbf/dc0/fcd x:0 0 0 2023-12-16T05:56:42.151 INFO:tasks.workunit.client.0.smithi155.stdout:0/978: link d7/da4/fde d7/df/f143 0 2023-12-16T05:56:42.151 INFO:tasks.workunit.client.0.smithi155.stdout:0/979: readlink d7/df/d73/d8d/d4d/d115/d5d/d6a/l10c 0 2023-12-16T05:56:42.151 INFO:tasks.workunit.client.0.smithi155.stdout:0/980: dread - d7/d13/d46/f133 zero size 2023-12-16T05:56:42.152 INFO:tasks.workunit.client.0.smithi155.stdout:3/667: dwrite d0/f2e [4194304,4194304] 0 2023-12-16T05:56:42.152 INFO:tasks.workunit.client.0.smithi155.stdout:3/668: fsync d0/f31 0 2023-12-16T05:56:42.154 INFO:tasks.workunit.client.0.smithi155.stdout:3/669: mknod d0/d14/d36/d7c/cc9 0 2023-12-16T05:56:42.156 INFO:tasks.workunit.client.1.smithi156.stdout:7/895: creat d1e/d1f/da6/d10d/d117/f137 x:0 0 0 2023-12-16T05:56:42.156 INFO:tasks.workunit.client.0.smithi155.stdout:3/670: mkdir d0/d14/d36/d47/d5f/dca 0 2023-12-16T05:56:42.158 INFO:tasks.workunit.client.0.smithi155.stdout:0/981: dread d7/f29 [0,4194304] 0 2023-12-16T05:56:42.158 INFO:tasks.workunit.client.0.smithi155.stdout:0/982: chown d7/df/d41/d23/c32 110505809 1 2023-12-16T05:56:42.158 INFO:tasks.workunit.client.1.smithi156.stdout:0/776: rename d2/d7/dd/d29/d4b/dc0/lca to d2/d7/dd/d29/d38/d51/d52/lf1 0 2023-12-16T05:56:42.159 INFO:tasks.workunit.client.0.smithi155.stdout:0/983: getdents d7/d13/d46 0 2023-12-16T05:56:42.160 INFO:tasks.workunit.client.0.smithi155.stdout:0/984: write d7/df/d73/d8d/d4d/d115/fcf [80366,40399] 0 2023-12-16T05:56:42.161 INFO:tasks.workunit.client.1.smithi156.stdout:6/680: unlink d9/d13/d2f/d51/d6b/d77/la4 0 2023-12-16T05:56:42.162 INFO:tasks.workunit.client.1.smithi156.stdout:7/896: creat d1e/dbf/de9/f138 x:0 0 0 2023-12-16T05:56:42.163 INFO:tasks.workunit.client.1.smithi156.stdout:5/849: link da/dc/d2d/d4d/c51 da/dc/d4b/c118 0 2023-12-16T05:56:42.164 INFO:tasks.workunit.client.0.smithi155.stdout:0/985: write d7/d13/d45/fec [954830,92945] 0 2023-12-16T05:56:42.164 INFO:tasks.workunit.client.0.smithi155.stdout:0/986: write d7/d13/f104 [165667,71103] 0 2023-12-16T05:56:42.165 INFO:tasks.workunit.client.1.smithi156.stdout:0/777: rename d2/d23/d55 to d2/d7/dd/d29/d4b/dc0/df2 0 2023-12-16T05:56:42.166 INFO:tasks.workunit.client.0.smithi155.stdout:0/987: mknod d7/d13/d45/d3e/c144 0 2023-12-16T05:56:42.167 INFO:tasks.workunit.client.1.smithi156.stdout:6/681: mkdir d9/d13/d2f/d51/d82/d89/d8e/d9a/dce 0 2023-12-16T05:56:42.167 INFO:tasks.workunit.client.1.smithi156.stdout:6/682: write d9/d1c/d50/fa1 [4236419,69861] 0 2023-12-16T05:56:42.167 INFO:tasks.workunit.client.1.smithi156.stdout:6/683: stat d9/d13/d3e/d5f/c60 0 2023-12-16T05:56:42.167 INFO:tasks.workunit.client.0.smithi155.stdout:0/988: mknod d7/d13/d46/c145 0 2023-12-16T05:56:42.168 INFO:tasks.workunit.client.0.smithi155.stdout:0/989: mkdir d7/df/d73/d8d/d4d/d115/d5d/d6a/d146 0 2023-12-16T05:56:42.168 INFO:tasks.workunit.client.1.smithi156.stdout:7/897: symlink d1e/d55/l139 0 2023-12-16T05:56:42.168 INFO:tasks.workunit.client.1.smithi156.stdout:7/898: chown d1e/d1f/da6/d57/d59/f12d 130104668 1 2023-12-16T05:56:42.169 INFO:tasks.workunit.client.1.smithi156.stdout:5/850: symlink da/dc/d2d/d4d/db9/dec/l119 0 2023-12-16T05:56:42.169 INFO:tasks.workunit.client.0.smithi155.stdout:0/990: unlink d7/df/d65/c24 0 2023-12-16T05:56:42.169 INFO:tasks.workunit.client.0.smithi155.stdout:0/991: truncate d7/d13/d45/f49 6722141 0 2023-12-16T05:56:42.170 INFO:tasks.workunit.client.0.smithi155.stdout:0/992: symlink d7/df/d65/l147 0 2023-12-16T05:56:42.170 INFO:tasks.workunit.client.0.smithi155.stdout:0/993: read - d7/df/f143 zero size 2023-12-16T05:56:42.171 INFO:tasks.workunit.client.1.smithi156.stdout:6/684: link d9/d13/d3e/d5f/c60 d9/ccf 0 2023-12-16T05:56:42.171 INFO:tasks.workunit.client.0.smithi155.stdout:0/994: creat d7/df/d41/d23/de1/f148 x:0 0 0 2023-12-16T05:56:42.171 INFO:tasks.workunit.client.0.smithi155.stdout:0/995: dread - d7/df/d73/d8d/d4d/de8/de5/ffe zero size 2023-12-16T05:56:42.171 INFO:tasks.workunit.client.0.smithi155.stdout:0/996: stat d7/d2d/c127 0 2023-12-16T05:56:42.172 INFO:tasks.workunit.client.0.smithi155.stdout:0/997: getdents d7/df/d73/d8d/d4d 0 2023-12-16T05:56:42.172 INFO:tasks.workunit.client.1.smithi156.stdout:7/899: creat d1e/d55/d71/d61/dac/d12f/f13a x:0 0 0 2023-12-16T05:56:42.172 INFO:tasks.workunit.client.1.smithi156.stdout:7/900: dread - d1e/d1f/da6/d57/d59/dfb/f11f zero size 2023-12-16T05:56:42.172 INFO:tasks.workunit.client.1.smithi156.stdout:7/901: chown d1e/d1f/da6/l48 760 1 2023-12-16T05:56:42.173 INFO:tasks.workunit.client.1.smithi156.stdout:5/851: rmdir da/d9a/dcd/dce 39 2023-12-16T05:56:42.173 INFO:tasks.workunit.client.1.smithi156.stdout:5/852: readlink da/dc/d2d/d4d/db9/dec/l119 0 2023-12-16T05:56:42.173 INFO:tasks.workunit.client.1.smithi156.stdout:5/853: readlink da/dc/l44 0 2023-12-16T05:56:42.173 INFO:tasks.workunit.client.1.smithi156.stdout:5/854: chown da/dc/d2d/d4d/db9/c10f 9 1 2023-12-16T05:56:42.173 INFO:tasks.workunit.client.1.smithi156.stdout:5/855: write da/dc/d4b/d6c/d81/dc5/df8/f116 [94766,20401] 0 2023-12-16T05:56:42.174 INFO:tasks.workunit.client.1.smithi156.stdout:6/685: symlink d9/d13/d2f/d51/ld0 0 2023-12-16T05:56:42.175 INFO:tasks.workunit.client.1.smithi156.stdout:7/902: rmdir d1e/d55/d71/d94/dea 0 2023-12-16T05:56:42.175 INFO:tasks.workunit.client.1.smithi156.stdout:7/903: write d1e/d55/d71/f11d [1252288,62074] 0 2023-12-16T05:56:42.177 INFO:tasks.workunit.client.1.smithi156.stdout:6/686: rename d9/f53 to d9/d13/d2f/d51/d69/d99/db9/fd1 0 2023-12-16T05:56:42.178 INFO:tasks.workunit.client.1.smithi156.stdout:6/687: getdents d9/d13/d2f/d51/d82/d89 0 2023-12-16T05:56:42.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:41 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:42.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:41 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:42.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:41 smithi156 ceph-mon[121001]: Reconfiguring alertmanager.smithi155 (dependencies changed)... 2023-12-16T05:56:42.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:41 smithi156 ceph-mon[121001]: Reconfiguring daemon alertmanager.smithi155 on smithi155 2023-12-16T05:56:42.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:41 smithi156 ceph-mon[121001]: pgmap v17: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 208 MiB/s rd, 425 MiB/s wr, 652 op/s 2023-12-16T05:56:42.180 INFO:tasks.workunit.client.1.smithi156.stdout:6/688: rmdir d9/d13/d2f/d36 39 2023-12-16T05:56:42.180 INFO:tasks.workunit.client.1.smithi156.stdout:6/689: read d9/d13/f27 [1905363,19838] 0 2023-12-16T05:56:42.180 INFO:tasks.workunit.client.1.smithi156.stdout:0/778: dread d2/d7/dd/d2d/d5e/f94 [0,4194304] 0 2023-12-16T05:56:42.181 INFO:tasks.workunit.client.0.smithi155.stdout:0/998: dread d7/df/d6f/f7a [0,4194304] 0 2023-12-16T05:56:42.181 INFO:tasks.workunit.client.1.smithi156.stdout:0/779: creat d2/d7/dd/d2d/d5e/ff3 x:0 0 0 2023-12-16T05:56:42.182 INFO:tasks.workunit.client.1.smithi156.stdout:0/780: creat d2/d7/dd/d29/ff4 x:0 0 0 2023-12-16T05:56:42.184 INFO:tasks.workunit.client.1.smithi156.stdout:0/781: mkdir d2/d7/dd/d1c/db3/df5 0 2023-12-16T05:56:42.184 INFO:tasks.workunit.client.1.smithi156.stdout:0/782: chown d2/d7/dd/d29/c9b 3013052 1 2023-12-16T05:56:42.185 INFO:tasks.workunit.client.1.smithi156.stdout:0/783: symlink d2/d7/dd/d29/lf6 0 2023-12-16T05:56:42.186 INFO:tasks.workunit.client.1.smithi156.stdout:0/784: truncate d2/d7/dd/d29/d38/dad/fe1 1171724 0 2023-12-16T05:56:42.186 INFO:tasks.workunit.client.1.smithi156.stdout:0/785: getdents d2/d7/dd/d29/d4b/d76 0 2023-12-16T05:56:42.187 INFO:tasks.workunit.client.1.smithi156.stdout:6/690: dread d9/d13/d2f/d51/d6b/fab [0,4194304] 0 2023-12-16T05:56:42.188 INFO:tasks.workunit.client.1.smithi156.stdout:0/786: getdents d2/d7/dd/d66 0 2023-12-16T05:56:42.188 INFO:tasks.workunit.client.1.smithi156.stdout:0/787: stat d2/d7/dd/d29/d38/d51/d52/d88/dbc/dc2 0 2023-12-16T05:56:42.190 INFO:tasks.workunit.client.1.smithi156.stdout:6/691: creat d9/d13/d2f/d51/d6b/d77/d7e/fd2 x:0 0 0 2023-12-16T05:56:42.191 INFO:tasks.workunit.client.1.smithi156.stdout:6/692: creat d9/d13/d2f/d51/d6b/fd3 x:0 0 0 2023-12-16T05:56:42.193 INFO:tasks.workunit.client.1.smithi156.stdout:0/788: mkdir d2/d7/dd/d2d/d5e/df7 0 2023-12-16T05:56:42.195 INFO:tasks.workunit.client.1.smithi156.stdout:5/856: write da/dc/d4b/d6c/d77/fb7 [702711,119664] 0 2023-12-16T05:56:42.195 INFO:tasks.workunit.client.1.smithi156.stdout:5/857: truncate da/dc/d2d/f4c 5564089 0 2023-12-16T05:56:42.197 INFO:tasks.workunit.client.1.smithi156.stdout:6/693: symlink d9/d1c/ld4 0 2023-12-16T05:56:42.199 INFO:tasks.workunit.client.1.smithi156.stdout:0/789: link d2/d7/dd/d1c/f36 d2/d7/dd/d29/d4b/ff8 0 2023-12-16T05:56:42.199 INFO:tasks.workunit.client.1.smithi156.stdout:8/513: dwrite d3/d12/f25 [0,4194304] 0 2023-12-16T05:56:42.208 INFO:tasks.workunit.client.1.smithi156.stdout:6/694: dread d9/d13/d2f/d51/d6b/d77/f8b [0,4194304] 0 2023-12-16T05:56:42.212 INFO:tasks.workunit.client.1.smithi156.stdout:6/695: creat d9/d13/d2f/d51/d6b/fd5 x:0 0 0 2023-12-16T05:56:42.212 INFO:tasks.workunit.client.1.smithi156.stdout:6/696: fdatasync d9/d1c/d50/dbf/dc0/fcd 0 2023-12-16T05:56:42.212 INFO:tasks.workunit.client.0.smithi155.stdout:3/671: dwrite d0/d14/d87/f9c [0,4194304] 0 2023-12-16T05:56:42.213 INFO:tasks.workunit.client.1.smithi156.stdout:6/697: creat d9/d1c/d50/fd6 x:0 0 0 2023-12-16T05:56:42.214 INFO:tasks.workunit.client.1.smithi156.stdout:1/564: dwrite d3/d1b/d27/f5c [4194304,4194304] 0 2023-12-16T05:56:42.215 INFO:tasks.workunit.client.1.smithi156.stdout:1/565: chown d3/d17/f48 23363047 1 2023-12-16T05:56:42.216 INFO:tasks.workunit.client.1.smithi156.stdout:6/698: truncate d9/d13/d2f/d51/d69/f71 2948942 0 2023-12-16T05:56:42.216 INFO:tasks.workunit.client.1.smithi156.stdout:6/699: fdatasync d9/d13/f20 0 2023-12-16T05:56:42.217 INFO:tasks.workunit.client.0.smithi155.stdout:3/672: dread d0/d14/d45/f8b [0,4194304] 0 2023-12-16T05:56:42.218 INFO:tasks.workunit.client.1.smithi156.stdout:1/566: mkdir d3/d17/d19/dbe 0 2023-12-16T05:56:42.220 INFO:tasks.workunit.client.1.smithi156.stdout:6/700: link d9/d13/d2f/d51/dad/cb7 d9/d13/d2f/cd7 0 2023-12-16T05:56:42.220 INFO:tasks.workunit.client.1.smithi156.stdout:8/514: dwrite d3/d7/d27/d46/d6e/f51 [0,4194304] 0 2023-12-16T05:56:42.221 INFO:tasks.workunit.client.1.smithi156.stdout:1/567: creat d3/d17/d4d/fbf x:0 0 0 2023-12-16T05:56:42.221 INFO:tasks.workunit.client.1.smithi156.stdout:7/904: getdents d1e/dbf/de9 0 2023-12-16T05:56:42.221 INFO:tasks.workunit.client.1.smithi156.stdout:7/905: fdatasync d1e/d55/d71/d61/daa/db4/f101 0 2023-12-16T05:56:42.224 INFO:tasks.workunit.client.1.smithi156.stdout:7/906: dread d1e/d1f/d22/f23 [4194304,4194304] 0 2023-12-16T05:56:42.224 INFO:tasks.workunit.client.1.smithi156.stdout:7/907: chown d1e/d55/d71/d94/d108/l115 914168303 1 2023-12-16T05:56:42.224 INFO:tasks.workunit.client.1.smithi156.stdout:6/701: truncate d9/d1c/f49 1557522 0 2023-12-16T05:56:42.224 INFO:tasks.workunit.client.1.smithi156.stdout:6/702: readlink d9/d13/d2f/d51/d82/la9 0 2023-12-16T05:56:42.225 INFO:tasks.workunit.client.1.smithi156.stdout:8/515: rename d3/d12/f58 to d3/d12/d74/fac 0 2023-12-16T05:56:42.226 INFO:tasks.workunit.client.1.smithi156.stdout:1/568: creat d3/d3a/da9/fc0 x:0 0 0 2023-12-16T05:56:42.227 INFO:tasks.workunit.client.1.smithi156.stdout:7/908: getdents d1e/d1f/da6/d10d 0 2023-12-16T05:56:42.230 INFO:tasks.workunit.client.1.smithi156.stdout:6/703: mkdir d9/d13/d2f/d51/d6b/dd8 0 2023-12-16T05:56:42.230 INFO:tasks.workunit.client.1.smithi156.stdout:6/704: chown d9/d13/d2f/d51/fb1 3362295 1 2023-12-16T05:56:42.230 INFO:tasks.workunit.client.1.smithi156.stdout:8/516: creat d3/d7/d66/d76/fad x:0 0 0 2023-12-16T05:56:42.231 INFO:tasks.workunit.client.1.smithi156.stdout:6/705: mkdir d9/d1c/d50/dd9 0 2023-12-16T05:56:42.237 INFO:tasks.workunit.client.1.smithi156.stdout:6/706: dread d9/d13/d3e/fb5 [0,4194304] 0 2023-12-16T05:56:42.238 INFO:tasks.workunit.client.1.smithi156.stdout:6/707: symlink d9/d13/d3e/d5f/lda 0 2023-12-16T05:56:42.239 INFO:tasks.workunit.client.1.smithi156.stdout:6/708: read d9/d13/d2f/f34 [41332,68589] 0 2023-12-16T05:56:42.239 INFO:tasks.workunit.client.1.smithi156.stdout:6/709: write d9/d13/d2f/d51/d6b/fd5 [797813,30143] 0 2023-12-16T05:56:42.240 INFO:tasks.workunit.client.1.smithi156.stdout:6/710: mknod d9/d13/d2f/d51/d6b/d77/d7e/cdb 0 2023-12-16T05:56:42.240 INFO:tasks.workunit.client.1.smithi156.stdout:6/711: creat d9/fdc x:0 0 0 2023-12-16T05:56:42.241 INFO:tasks.workunit.client.1.smithi156.stdout:6/712: symlink d9/d13/d2f/d51/d82/d89/d8e/d9a/ldd 0 2023-12-16T05:56:42.242 INFO:tasks.workunit.client.1.smithi156.stdout:7/909: dwrite d1e/d1f/da6/d57/d59/dfb/f11f [0,4194304] 0 2023-12-16T05:56:42.242 INFO:tasks.workunit.client.1.smithi156.stdout:7/910: write d1e/d55/d71/d61/daa/f50 [4348280,1466] 0 2023-12-16T05:56:42.242 INFO:tasks.workunit.client.1.smithi156.stdout:7/911: fsync d1e/d1f/d22/f25 0 2023-12-16T05:56:42.244 INFO:tasks.workunit.client.1.smithi156.stdout:7/912: mknod d1e/d1f/da6/d10d/c13b 0 2023-12-16T05:56:42.245 INFO:tasks.workunit.client.1.smithi156.stdout:7/913: stat d1e/d55/d71/df5 0 2023-12-16T05:56:42.283 INFO:tasks.workunit.client.1.smithi156.stdout:4/638: dwrite d9/f19 [0,4194304] 0 2023-12-16T05:56:42.283 INFO:tasks.workunit.client.1.smithi156.stdout:5/858: dwrite da/dc/d4b/d6c/d77/fc2 [0,4194304] 0 2023-12-16T05:56:42.284 INFO:tasks.workunit.client.1.smithi156.stdout:5/859: readlink da/d46/l4a 0 2023-12-16T05:56:42.286 INFO:tasks.workunit.client.1.smithi156.stdout:5/860: read da/dc/d4b/f64 [1449321,125187] 0 2023-12-16T05:56:42.286 INFO:tasks.workunit.client.1.smithi156.stdout:5/861: chown da/c3e 8012356 1 2023-12-16T05:56:42.292 INFO:tasks.workunit.client.1.smithi156.stdout:7/914: getdents d1e/d55 0 2023-12-16T05:56:42.296 INFO:tasks.workunit.client.1.smithi156.stdout:7/915: creat d1e/d55/d71/f13c x:0 0 0 2023-12-16T05:56:42.297 INFO:tasks.workunit.client.1.smithi156.stdout:7/916: symlink d1e/daf/l13d 0 2023-12-16T05:56:42.303 INFO:tasks.workunit.client.1.smithi156.stdout:0/790: dwrite d2/d7/dd/d29/d4b/dc0/df2/fb9 [0,4194304] 0 2023-12-16T05:56:42.303 INFO:tasks.workunit.client.1.smithi156.stdout:5/862: dwrite da/dc/d4b/d6c/d81/dc5/fe0 [0,4194304] 0 2023-12-16T05:56:42.303 INFO:tasks.workunit.client.0.smithi155.stdout:3/673: dwrite d0/d1a/da3/f99 [0,4194304] 0 2023-12-16T05:56:42.303 INFO:tasks.workunit.client.0.smithi155.stdout:3/674: fdatasync d0/f55 0 2023-12-16T05:56:42.305 INFO:tasks.workunit.client.0.smithi155.stdout:3/675: symlink d0/d14/d36/d47/d5f/d9a/d9b/lcb 0 2023-12-16T05:56:42.306 INFO:tasks.workunit.client.0.smithi155.stdout:3/676: creat d0/d1a/fcc x:0 0 0 2023-12-16T05:56:42.310 INFO:tasks.workunit.client.1.smithi156.stdout:5/863: mkdir da/dc/d2d/d4d/db9/d11a 0 2023-12-16T05:56:42.314 INFO:tasks.workunit.client.1.smithi156.stdout:1/569: rename d3/d17/d19 to d3/d17/d1c/d22/d57/d61/dc1 0 2023-12-16T05:56:42.316 INFO:tasks.workunit.client.1.smithi156.stdout:8/517: rename d3/d18 to d3/d7a/d7d/dae 0 2023-12-16T05:56:42.318 INFO:tasks.workunit.client.1.smithi156.stdout:1/570: unlink d3/d1b/d27/d4f/f62 0 2023-12-16T05:56:42.318 INFO:tasks.workunit.client.1.smithi156.stdout:1/571: stat d3/d17/d1c/d22/d57/d61/dc1/f20 0 2023-12-16T05:56:42.318 INFO:tasks.workunit.client.1.smithi156.stdout:1/572: truncate d3/d3a/f9f 879595 0 2023-12-16T05:56:42.318 INFO:tasks.workunit.client.1.smithi156.stdout:1/573: fsync d3/d17/f52 0 2023-12-16T05:56:42.318 INFO:tasks.workunit.client.1.smithi156.stdout:1/574: write d3/d1b/f8d [391962,42092] 0 2023-12-16T05:56:42.318 INFO:tasks.workunit.client.0.smithi155.stdout:3/677: dread d0/f55 [0,4194304] 0 2023-12-16T05:56:42.320 INFO:tasks.workunit.client.1.smithi156.stdout:8/518: truncate d3/d12/f28 3416833 0 2023-12-16T05:56:42.323 INFO:tasks.workunit.client.1.smithi156.stdout:4/639: rename d9/d2b/c94 to d9/d43/d58/cd8 0 2023-12-16T05:56:42.323 INFO:tasks.workunit.client.1.smithi156.stdout:4/640: fsync d9/f37 0 2023-12-16T05:56:42.324 INFO:tasks.workunit.client.1.smithi156.stdout:8/519: creat d3/d7a/d7d/faf x:0 0 0 2023-12-16T05:56:42.328 INFO:tasks.workunit.client.1.smithi156.stdout:4/641: creat d9/d43/d58/d7d/fd9 x:0 0 0 2023-12-16T05:56:42.328 INFO:tasks.workunit.client.1.smithi156.stdout:0/791: dwrite d2/f24 [0,4194304] 0 2023-12-16T05:56:42.329 INFO:tasks.workunit.client.1.smithi156.stdout:4/642: write d9/d43/f8e [647290,1765] 0 2023-12-16T05:56:42.329 INFO:tasks.workunit.client.1.smithi156.stdout:0/792: write d2/d7/dd/d1c/fb1 [605263,118014] 0 2023-12-16T05:56:42.330 INFO:tasks.workunit.client.1.smithi156.stdout:8/520: creat d3/d7/d27/fb0 x:0 0 0 2023-12-16T05:56:42.333 INFO:tasks.workunit.client.1.smithi156.stdout:8/521: symlink d3/d6/lb1 0 2023-12-16T05:56:42.335 INFO:tasks.workunit.client.1.smithi156.stdout:8/522: unlink d3/d7/d27/d46/d6e/ca 0 2023-12-16T05:56:42.336 INFO:tasks.workunit.client.1.smithi156.stdout:5/864: dwrite f0 [0,4194304] 0 2023-12-16T05:56:42.337 INFO:tasks.workunit.client.1.smithi156.stdout:8/523: write d3/d7a/d7d/dae/f39 [1728376,94377] 0 2023-12-16T05:56:42.337 INFO:tasks.workunit.client.1.smithi156.stdout:8/524: chown d3/d7/c15 326 1 2023-12-16T05:56:42.337 INFO:tasks.workunit.client.1.smithi156.stdout:5/865: truncate da/f48 3068232 0 2023-12-16T05:56:42.339 INFO:tasks.workunit.client.1.smithi156.stdout:8/525: creat d3/d7/fb2 x:0 0 0 2023-12-16T05:56:42.343 INFO:tasks.workunit.client.1.smithi156.stdout:8/526: rmdir d3/d7/d27/d46/d84/d8e 0 2023-12-16T05:56:42.343 INFO:tasks.workunit.client.1.smithi156.stdout:8/527: chown d3/d6/c1e 128357169 1 2023-12-16T05:56:42.344 INFO:tasks.workunit.client.1.smithi156.stdout:8/528: mkdir d3/d7/d62/db3 0 2023-12-16T05:56:42.345 INFO:tasks.workunit.client.1.smithi156.stdout:8/529: rmdir d3/d7/d27/d46/d84 39 2023-12-16T05:56:42.348 INFO:tasks.workunit.client.1.smithi156.stdout:8/530: dread d3/d6/f8a [0,4194304] 0 2023-12-16T05:56:42.349 INFO:tasks.workunit.client.1.smithi156.stdout:8/531: mkdir d3/d12/d16/db4 0 2023-12-16T05:56:42.349 INFO:tasks.workunit.client.1.smithi156.stdout:8/532: chown d3/l26 1982990 1 2023-12-16T05:56:42.349 INFO:tasks.workunit.client.1.smithi156.stdout:8/533: write d3/d7/d27/d46/d84/fa3 [684232,48825] 0 2023-12-16T05:56:42.349 INFO:tasks.workunit.client.1.smithi156.stdout:8/534: write d3/d12/d16/f2d [17520332,112344] 0 2023-12-16T05:56:42.350 INFO:tasks.workunit.client.1.smithi156.stdout:2/693: sync 2023-12-16T05:56:42.350 INFO:tasks.workunit.client.1.smithi156.stdout:2/694: chown d9/d12/dc2/dd8/da6/c6b 640049 1 2023-12-16T05:56:42.357 INFO:tasks.workunit.client.1.smithi156.stdout:1/575: dwrite d3/d17/f52 [0,4194304] 0 2023-12-16T05:56:42.358 INFO:tasks.workunit.client.1.smithi156.stdout:1/576: dread - d3/faf zero size 2023-12-16T05:56:42.358 INFO:tasks.workunit.client.1.smithi156.stdout:1/577: readlink d3/d1b/l1d 0 2023-12-16T05:56:42.364 INFO:tasks.workunit.client.0.smithi155.stdout:3/678: dwrite d0/d14/d45/fa0 [0,4194304] 0 2023-12-16T05:56:42.364 INFO:tasks.workunit.client.1.smithi156.stdout:5/866: dwrite da/f3a [0,4194304] 0 2023-12-16T05:56:42.365 INFO:tasks.workunit.client.1.smithi156.stdout:4/643: dwrite d9/d43/f4b [0,4194304] 0 2023-12-16T05:56:42.366 INFO:tasks.workunit.client.0.smithi155.stdout:3/679: mkdir d0/d14/d45/dcd 0 2023-12-16T05:56:42.366 INFO:tasks.workunit.client.0.smithi155.stdout:3/680: write d0/d14/d87/d94/da1/d73/fc4 [114146,100641] 0 2023-12-16T05:56:42.367 INFO:tasks.workunit.client.0.smithi155.stdout:3/681: write d0/f2e [557310,17117] 0 2023-12-16T05:56:42.368 INFO:tasks.workunit.client.0.smithi155.stdout:3/682: symlink d0/d14/d87/d94/da1/d73/lce 0 2023-12-16T05:56:42.369 INFO:tasks.workunit.client.0.smithi155.stdout:3/683: mkdir d0/d14/d87/dcf 0 2023-12-16T05:56:42.369 INFO:tasks.workunit.client.0.smithi155.stdout:3/684: getdents d0/d14/d36/d83/d95 0 2023-12-16T05:56:42.370 INFO:tasks.workunit.client.0.smithi155.stdout:3/685: symlink d0/d1a/d33/d57/dba/ld0 0 2023-12-16T05:56:42.370 INFO:tasks.workunit.client.0.smithi155.stdout:3/686: chown d0/d1e/f59 32270260 1 2023-12-16T05:56:42.372 INFO:tasks.workunit.client.1.smithi156.stdout:4/644: dread d9/d2c/f32 [4194304,4194304] 0 2023-12-16T05:56:42.372 INFO:tasks.workunit.client.1.smithi156.stdout:4/645: chown d9/d2b/f75 0 1 2023-12-16T05:56:42.381 INFO:tasks.workunit.client.0.smithi155.stdout:5/938: sync 2023-12-16T05:56:42.381 INFO:tasks.workunit.client.0.smithi155.stdout:8/929: sync 2023-12-16T05:56:42.381 INFO:tasks.workunit.client.0.smithi155.stdout:2/841: sync 2023-12-16T05:56:42.381 INFO:tasks.workunit.client.0.smithi155.stdout:5/939: truncate d0/d2/d2a/d19/d48/df5/f111 779279 0 2023-12-16T05:56:42.382 INFO:tasks.workunit.client.0.smithi155.stdout:8/930: write d4/d62/fa2 [6617172,115567] 0 2023-12-16T05:56:42.382 INFO:tasks.workunit.client.0.smithi155.stdout:2/842: creat d0/d7/dd/d14/db6/f123 x:0 0 0 2023-12-16T05:56:42.382 INFO:tasks.workunit.client.0.smithi155.stdout:4/869: sync 2023-12-16T05:56:42.383 INFO:tasks.workunit.client.0.smithi155.stdout:7/823: sync 2023-12-16T05:56:42.383 INFO:tasks.workunit.client.0.smithi155.stdout:0/999: sync 2023-12-16T05:56:42.383 INFO:tasks.workunit.client.0.smithi155.stdout:4/870: fdatasync d0/fe5 0 2023-12-16T05:56:42.383 INFO:tasks.workunit.client.0.smithi155.stdout:5/940: creat d0/d2/d2a/d19/d88/f130 x:0 0 0 2023-12-16T05:56:42.383 INFO:tasks.workunit.client.0.smithi155.stdout:5/941: write d0/d2/d2a/d19/d48/f58 [1186678,61443] 0 2023-12-16T05:56:42.386 INFO:tasks.workunit.client.0.smithi155.stdout:8/931: rename d4/d62/d66/d78/d88/d12/c126 to d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/d127/c137 0 2023-12-16T05:56:42.387 INFO:tasks.workunit.client.0.smithi155.stdout:7/824: truncate d0/d1/fb 1282181 0 2023-12-16T05:56:42.389 INFO:tasks.workunit.client.0.smithi155.stdout:4/871: unlink d0/da/de0/d16/d30/dce/d75/d3d/d49/dbb/f10f 0 2023-12-16T05:56:42.390 INFO:tasks.workunit.client.0.smithi155.stdout:8/932: rmdir d4/d62/d66/d78/d88/d12 39 2023-12-16T05:56:42.392 INFO:tasks.workunit.client.0.smithi155.stdout:7/825: creat d0/d6a/d1a/d8c/d34/d6c/f10a x:0 0 0 2023-12-16T05:56:42.392 INFO:tasks.workunit.client.0.smithi155.stdout:7/826: read d0/d1/fef [136624,84065] 0 2023-12-16T05:56:42.393 INFO:tasks.workunit.client.0.smithi155.stdout:4/872: truncate d0/da/de0/d16/d30/dce/d75/d3d/d43/f62 1123637 0 2023-12-16T05:56:42.393 INFO:tasks.workunit.client.1.smithi156.stdout:4/646: dwrite d9/d43/d58/d95/f97 [0,4194304] 0 2023-12-16T05:56:42.395 INFO:tasks.workunit.client.0.smithi155.stdout:7/827: mkdir d0/d6a/d1a/d8c/d10b 0 2023-12-16T05:56:42.396 INFO:tasks.workunit.client.0.smithi155.stdout:4/873: link d0/da/de0/d16/d30/dce/d75/d3d/fc2 d0/da/de0/d16/d30/dce/d75/ddb/f122 0 2023-12-16T05:56:42.399 INFO:tasks.workunit.client.0.smithi155.stdout:7/828: link d0/d6a/f8d d0/d6a/d1a/d38/f10c 0 2023-12-16T05:56:42.401 INFO:tasks.workunit.client.0.smithi155.stdout:2/843: dwrite d0/d7/d69/fd5 [0,4194304] 0 2023-12-16T05:56:42.401 INFO:tasks.workunit.client.0.smithi155.stdout:5/942: dwrite d0/d2/d2a/d30/d53/d7b/f80 [4194304,4194304] 0 2023-12-16T05:56:42.402 INFO:tasks.workunit.client.0.smithi155.stdout:5/943: chown d0/d2/d2a/d30/d53/d7b/d99/d47/d61/db6/dce/cf0 53 1 2023-12-16T05:56:42.403 INFO:tasks.workunit.client.0.smithi155.stdout:8/933: dread d4/dd3/fea [0,4194304] 0 2023-12-16T05:56:42.403 INFO:tasks.workunit.client.0.smithi155.stdout:8/934: write d4/d62/d66/d78/d88/d1b/d1c/d19/fb4 [595518,33407] 0 2023-12-16T05:56:42.403 INFO:tasks.workunit.client.0.smithi155.stdout:8/935: stat d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/l55 0 2023-12-16T05:56:42.403 INFO:tasks.workunit.client.0.smithi155.stdout:8/936: write d4/d62/d66/d78/d88/d1b/d1c/d19/d64/f116 [613644,18575] 0 2023-12-16T05:56:42.403 INFO:tasks.workunit.client.0.smithi155.stdout:4/874: creat d0/da/de0/d16/d30/dce/d75/f123 x:0 0 0 2023-12-16T05:56:42.407 INFO:tasks.workunit.client.0.smithi155.stdout:7/829: mknod d0/d6a/d1a/d38/d4f/c10d 0 2023-12-16T05:56:42.407 INFO:tasks.workunit.client.0.smithi155.stdout:7/830: chown d0/d6a/d1a/d8c/d34/d4b/d60/fde 0 1 2023-12-16T05:56:42.409 INFO:tasks.workunit.client.0.smithi155.stdout:7/831: write d0/d6a/d1a/d38/f9f [3655306,88030] 0 2023-12-16T05:56:42.412 INFO:tasks.workunit.client.0.smithi155.stdout:5/944: creat d0/d2/d2a/d30/d53/d7b/f131 x:0 0 0 2023-12-16T05:56:42.412 INFO:tasks.workunit.client.0.smithi155.stdout:5/945: stat d0/d2/cfe 0 2023-12-16T05:56:42.412 INFO:tasks.workunit.client.0.smithi155.stdout:5/946: chown d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/cfc 4603415 1 2023-12-16T05:56:42.413 INFO:tasks.workunit.client.0.smithi155.stdout:4/875: symlink d0/da/de0/d16/d30/dce/d75/d10e/d70/d92/daf/db7/l124 0 2023-12-16T05:56:42.413 INFO:tasks.workunit.client.0.smithi155.stdout:4/876: write d0/da/de0/d16/d30/dce/d75/d10e/dd1/f113 [1018910,18993] 0 2023-12-16T05:56:42.413 INFO:tasks.workunit.client.0.smithi155.stdout:4/877: fsync d0/da/de0/d16/d30/fc5 0 2023-12-16T05:56:42.414 INFO:tasks.workunit.client.1.smithi156.stdout:8/535: creat d3/d7/d27/fb5 x:0 0 0 2023-12-16T05:56:42.415 INFO:tasks.workunit.client.0.smithi155.stdout:7/832: creat d0/dfa/f10e x:0 0 0 2023-12-16T05:56:42.416 INFO:tasks.workunit.client.0.smithi155.stdout:5/947: unlink d0/d2/d2a/d19/d21/f6a 0 2023-12-16T05:56:42.416 INFO:tasks.workunit.client.0.smithi155.stdout:5/948: write d0/d2/d2a/d19/d48/ff4 [986492,15129] 0 2023-12-16T05:56:42.417 INFO:tasks.workunit.client.0.smithi155.stdout:4/878: creat d0/da/de0/d16/d30/dce/f125 x:0 0 0 2023-12-16T05:56:42.417 INFO:tasks.workunit.client.1.smithi156.stdout:2/695: link d9/f22 d9/d12/dc2/fde 0 2023-12-16T05:56:42.417 INFO:tasks.workunit.client.1.smithi156.stdout:2/696: chown d9/l59 2412 1 2023-12-16T05:56:42.418 INFO:tasks.workunit.client.0.smithi155.stdout:7/833: mkdir d0/d10f 0 2023-12-16T05:56:42.419 INFO:tasks.workunit.client.1.smithi156.stdout:1/578: rename d3/d1b/d27 to d3/d17/d4d/dc2 0 2023-12-16T05:56:42.420 INFO:tasks.workunit.client.0.smithi155.stdout:4/879: unlink d0/da/de0/d16/d30/dce/d75/d3d/l67 0 2023-12-16T05:56:42.420 INFO:tasks.workunit.client.0.smithi155.stdout:4/880: fsync d0/da/de0/d16/d30/dce/d75/d3d/fc2 0 2023-12-16T05:56:42.422 INFO:tasks.workunit.client.0.smithi155.stdout:7/834: mknod d0/d6a/d1a/d8c/d34/d4b/d60/c110 0 2023-12-16T05:56:42.424 INFO:tasks.workunit.client.0.smithi155.stdout:7/835: creat d0/d6a/d31/de8/f111 x:0 0 0 2023-12-16T05:56:42.427 INFO:tasks.workunit.client.0.smithi155.stdout:7/836: rename d0/d1/f83 to d0/d6a/d1a/d2b/d65/db8/f112 0 2023-12-16T05:56:42.427 INFO:tasks.workunit.client.1.smithi156.stdout:5/867: mknod da/dc/d2d/c11b 0 2023-12-16T05:56:42.430 INFO:tasks.workunit.client.0.smithi155.stdout:8/937: dwrite d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/fc1 [0,4194304] 0 2023-12-16T05:56:42.430 INFO:tasks.workunit.client.0.smithi155.stdout:2/844: dwrite d0/d7/fab [0,4194304] 0 2023-12-16T05:56:42.430 INFO:tasks.workunit.client.0.smithi155.stdout:2/845: dread - d0/d7/d57/d63/de7/fff zero size 2023-12-16T05:56:42.433 INFO:tasks.workunit.client.0.smithi155.stdout:7/837: creat d0/d6a/d1a/d2b/d2c/f113 x:0 0 0 2023-12-16T05:56:42.433 INFO:tasks.workunit.client.0.smithi155.stdout:7/838: chown d0/d1b/d78/f96 553 1 2023-12-16T05:56:42.435 INFO:tasks.workunit.client.0.smithi155.stdout:5/949: dwrite d0/d2/f1d [0,4194304] 0 2023-12-16T05:56:42.435 INFO:tasks.workunit.client.0.smithi155.stdout:5/950: chown d0/d2/d2a/d19/d21/c92 10 1 2023-12-16T05:56:42.436 INFO:tasks.workunit.client.1.smithi156.stdout:4/647: mknod d9/d2c/cda 0 2023-12-16T05:56:42.437 INFO:tasks.workunit.client.0.smithi155.stdout:2/846: creat d0/d7/dd/d62/d66/dbc/f124 x:0 0 0 2023-12-16T05:56:42.439 INFO:tasks.workunit.client.0.smithi155.stdout:7/839: mknod d0/d6a/d1a/d8c/d42/d98/db1/c114 0 2023-12-16T05:56:42.439 INFO:tasks.workunit.client.0.smithi155.stdout:7/840: chown d0/d6a/d1a/d8c/d34/d4b/d64/d6e/f7e 398928806 1 2023-12-16T05:56:42.440 INFO:tasks.workunit.client.0.smithi155.stdout:2/847: write d0/d34/d3c/f43 [211089,114469] 0 2023-12-16T05:56:42.440 INFO:tasks.workunit.client.1.smithi156.stdout:8/536: creat d3/d7/d27/fb6 x:0 0 0 2023-12-16T05:56:42.441 INFO:tasks.workunit.client.0.smithi155.stdout:5/951: mkdir d0/d60/d79/d8e/d123/d132 0 2023-12-16T05:56:42.444 INFO:tasks.workunit.client.1.smithi156.stdout:1/579: creat d3/d3a/fc3 x:0 0 0 2023-12-16T05:56:42.446 INFO:tasks.workunit.client.0.smithi155.stdout:7/841: rename d0/d6a/d1a/d2b/d2c/leb to d0/d6a/d1a/d8c/d34/d4b/d64/l115 0 2023-12-16T05:56:42.446 INFO:tasks.workunit.client.1.smithi156.stdout:5/868: mkdir da/d46/d114/d11c 0 2023-12-16T05:56:42.446 INFO:tasks.workunit.client.1.smithi156.stdout:5/869: readlink da/dc/d2d/l102 0 2023-12-16T05:56:42.447 INFO:tasks.workunit.client.1.smithi156.stdout:4/648: mknod d9/d2b/d35/dd3/cdb 0 2023-12-16T05:56:42.449 INFO:tasks.workunit.client.0.smithi155.stdout:2/848: dread d0/d7/d57/d63/de7/fa1 [0,4194304] 0 2023-12-16T05:56:42.451 INFO:tasks.workunit.client.1.smithi156.stdout:4/649: write d9/f19 [196404,48623] 0 2023-12-16T05:56:42.452 INFO:tasks.workunit.client.0.smithi155.stdout:8/938: dwrite d4/d62/d66/d78/d88/d1b/d1c/d19/d64/fb2 [0,4194304] 0 2023-12-16T05:56:42.455 INFO:tasks.workunit.client.0.smithi155.stdout:8/939: write d4/d62/d66/d78/d88/d1b/d1c/d19/d64/fb2 [2136376,121982] 0 2023-12-16T05:56:42.456 INFO:tasks.workunit.client.1.smithi156.stdout:5/870: rename da/d46/fb5 to da/d9a/f11d 0 2023-12-16T05:56:42.456 INFO:tasks.workunit.client.1.smithi156.stdout:5/871: chown da/f68 31228755 1 2023-12-16T05:56:42.457 INFO:tasks.workunit.client.1.smithi156.stdout:5/872: chown da/d9a/dcd/dce 124775529 1 2023-12-16T05:56:42.457 INFO:tasks.workunit.client.0.smithi155.stdout:8/940: symlink d4/d62/d66/d78/d88/d1b/l138 0 2023-12-16T05:56:42.462 INFO:tasks.workunit.client.1.smithi156.stdout:1/580: dread d3/d17/d4d/f64 [0,4194304] 0 2023-12-16T05:56:42.462 INFO:tasks.workunit.client.1.smithi156.stdout:1/581: fsync d3/d1b/f25 0 2023-12-16T05:56:42.462 INFO:tasks.workunit.client.0.smithi155.stdout:2/849: read d0/f3d [6339884,44652] 0 2023-12-16T05:56:42.463 INFO:tasks.workunit.client.0.smithi155.stdout:2/850: chown d0/d7/d69/f91 49 1 2023-12-16T05:56:42.463 INFO:tasks.workunit.client.0.smithi155.stdout:2/851: fsync d0/d5/d6/f82 0 2023-12-16T05:56:42.465 INFO:tasks.workunit.client.1.smithi156.stdout:2/697: rmdir d9/d12/dc2/dd8/da6/d80/dbf 0 2023-12-16T05:56:42.468 INFO:tasks.workunit.client.0.smithi155.stdout:5/952: dwrite d0/d2/d2a/d19/d21/f23 [8388608,4194304] 0 2023-12-16T05:56:42.468 INFO:tasks.workunit.client.0.smithi155.stdout:5/953: fsync d0/d2/d2a/d30/d53/d7b/d99/f83 0 2023-12-16T05:56:42.469 INFO:tasks.workunit.client.1.smithi156.stdout:1/582: truncate d3/d17/f60 926988 0 2023-12-16T05:56:42.470 INFO:tasks.workunit.client.1.smithi156.stdout:2/698: creat d9/d12/dc2/dd8/dad/fdf x:0 0 0 2023-12-16T05:56:42.471 INFO:tasks.workunit.client.0.smithi155.stdout:5/954: mkdir d0/d2/d2a/d19/d133 0 2023-12-16T05:56:42.471 INFO:tasks.workunit.client.1.smithi156.stdout:9/694: sync 2023-12-16T05:56:42.471 INFO:tasks.workunit.client.1.smithi156.stdout:9/695: readlink d6/d19/d30/l62 0 2023-12-16T05:56:42.471 INFO:tasks.workunit.client.1.smithi156.stdout:9/696: fdatasync d6/d19/d25/f6f 0 2023-12-16T05:56:42.473 INFO:tasks.workunit.client.1.smithi156.stdout:2/699: link d9/d68/f97 d9/d12/d3d/fe0 0 2023-12-16T05:56:42.474 INFO:tasks.workunit.client.1.smithi156.stdout:2/700: truncate d9/f5c 4384411 0 2023-12-16T05:56:42.475 INFO:tasks.workunit.client.1.smithi156.stdout:9/697: symlink d6/d2e/lf0 0 2023-12-16T05:56:42.477 INFO:tasks.workunit.client.1.smithi156.stdout:8/537: dwrite d3/d7/d27/d46/d6e/d3c/f55 [0,4194304] 0 2023-12-16T05:56:42.477 INFO:tasks.workunit.client.1.smithi156.stdout:8/538: chown d3/d7/f31 115786964 1 2023-12-16T05:56:42.478 INFO:tasks.workunit.client.0.smithi155.stdout:5/955: write d0/d2/d2a/d30/d53/db5/f113 [2492746,8875] 0 2023-12-16T05:56:42.479 INFO:tasks.workunit.client.0.smithi155.stdout:2/852: dwrite d0/d7/dd/d14/db6/f123 [0,4194304] 0 2023-12-16T05:56:42.480 INFO:tasks.workunit.client.1.smithi156.stdout:9/698: link d6/d19/f56 d6/d2e/dad/ff1 0 2023-12-16T05:56:42.480 INFO:tasks.workunit.client.1.smithi156.stdout:9/699: fdatasync d6/d2e/d8a/da5/fd9 0 2023-12-16T05:56:42.483 INFO:tasks.workunit.client.0.smithi155.stdout:2/853: mkdir d0/d125 0 2023-12-16T05:56:42.483 INFO:tasks.workunit.client.0.smithi155.stdout:7/842: dwrite d0/d6a/d31/fcf [0,4194304] 0 2023-12-16T05:56:42.483 INFO:tasks.workunit.client.0.smithi155.stdout:7/843: chown d0/d1/f44 463 1 2023-12-16T05:56:42.483 INFO:tasks.workunit.client.1.smithi156.stdout:5/873: dwrite da/f42 [0,4194304] 0 2023-12-16T05:56:42.484 INFO:tasks.workunit.client.1.smithi156.stdout:8/539: symlink d3/d12/d74/lb7 0 2023-12-16T05:56:42.484 INFO:tasks.workunit.client.1.smithi156.stdout:5/874: write da/dc/d2d/d4d/db9/dc9/fdd [681266,100894] 0 2023-12-16T05:56:42.484 INFO:tasks.workunit.client.0.smithi155.stdout:2/854: truncate d0/d7/d69/f58 3521629 0 2023-12-16T05:56:42.486 INFO:tasks.workunit.client.0.smithi155.stdout:2/855: unlink d0/d7/d57/d63/fb1 0 2023-12-16T05:56:42.487 INFO:tasks.workunit.client.0.smithi155.stdout:2/856: mkdir d0/d7/dd/d49/d4b/d8c/dcd/d108/d126 0 2023-12-16T05:56:42.493 INFO:tasks.workunit.client.1.smithi156.stdout:5/875: write da/dc/d2d/d4d/d54/d90/dc3/fc8 [1585142,46650] 0 2023-12-16T05:56:42.494 INFO:tasks.workunit.client.0.smithi155.stdout:7/844: dread d0/d1/d5/fbd [0,4194304] 0 2023-12-16T05:56:42.495 INFO:tasks.workunit.client.1.smithi156.stdout:2/701: dwrite f8 [4194304,4194304] 0 2023-12-16T05:56:42.495 INFO:tasks.workunit.client.1.smithi156.stdout:2/702: chown d9/dd/d17/d33/d78/d74/l92 2386490 1 2023-12-16T05:56:42.496 INFO:tasks.workunit.client.1.smithi156.stdout:1/583: dread d3/d17/f60 [0,4194304] 0 2023-12-16T05:56:42.497 INFO:tasks.workunit.client.1.smithi156.stdout:1/584: truncate d3/d17/d2d/fab 652581 0 2023-12-16T05:56:42.499 INFO:tasks.workunit.client.1.smithi156.stdout:1/585: creat d3/d3a/db1/fc4 x:0 0 0 2023-12-16T05:56:42.499 INFO:tasks.workunit.client.1.smithi156.stdout:1/586: chown d3/d17/d1c/d22/d57/d61/dc1/l97 117 1 2023-12-16T05:56:42.499 INFO:tasks.workunit.client.1.smithi156.stdout:1/587: fsync d3/d17/d4d/f56 0 2023-12-16T05:56:42.500 INFO:tasks.workunit.client.1.smithi156.stdout:9/700: dwrite d6/d19/d25/d3a/d88/d8b/dac/dc9/fec [0,4194304] 0 2023-12-16T05:56:42.500 INFO:tasks.workunit.client.1.smithi156.stdout:1/588: dread d3/d17/d4d/f56 [0,4194304] 0 2023-12-16T05:56:42.500 INFO:tasks.workunit.client.1.smithi156.stdout:9/701: write d6/d19/d30/d5b/f82 [1849836,1366] 0 2023-12-16T05:56:42.503 INFO:tasks.workunit.client.1.smithi156.stdout:8/540: dread d3/d12/f25 [0,4194304] 0 2023-12-16T05:56:42.503 INFO:tasks.workunit.client.1.smithi156.stdout:8/541: chown d3/d7/d27/d46/d6e/f33 0 1 2023-12-16T05:56:42.503 INFO:tasks.workunit.client.1.smithi156.stdout:9/702: write d6/d19/f56 [59754,45951] 0 2023-12-16T05:56:42.504 INFO:tasks.workunit.client.1.smithi156.stdout:9/703: fsync d6/d19/d25/f4c 0 2023-12-16T05:56:42.513 INFO:tasks.workunit.client.1.smithi156.stdout:5/876: dread da/dc/f21 [0,4194304] 0 2023-12-16T05:56:42.514 INFO:tasks.workunit.client.1.smithi156.stdout:5/877: mknod da/d9a/c11e 0 2023-12-16T05:56:42.516 INFO:tasks.workunit.client.1.smithi156.stdout:5/878: link da/cfc da/dc/d2d/d34/df6/c11f 0 2023-12-16T05:56:42.516 INFO:tasks.workunit.client.1.smithi156.stdout:9/704: dread d6/d19/d25/f34 [0,4194304] 0 2023-12-16T05:56:42.517 INFO:tasks.workunit.client.1.smithi156.stdout:9/705: rename d6/d19/l1d to d6/d19/d25/d3a/dc3/lf2 0 2023-12-16T05:56:42.520 INFO:tasks.workunit.client.1.smithi156.stdout:9/706: rename d6/lee to d6/da3/lf3 0 2023-12-16T05:56:42.520 INFO:tasks.workunit.client.1.smithi156.stdout:9/707: fdatasync d6/fd 0 2023-12-16T05:56:42.520 INFO:tasks.workunit.client.1.smithi156.stdout:9/708: fdatasync d6/d19/d25/d3a/fb5 0 2023-12-16T05:56:42.521 INFO:tasks.workunit.client.1.smithi156.stdout:9/709: rmdir d6/d19/d25/d3a/d80/dc0/dd0 39 2023-12-16T05:56:42.524 INFO:tasks.workunit.client.1.smithi156.stdout:2/703: dwrite d9/dd/d17/d33/d78/d39/d8c/fb7 [0,4194304] 0 2023-12-16T05:56:42.524 INFO:tasks.workunit.client.1.smithi156.stdout:2/704: chown d9/d12/dc2/dd8/da6/d80/f85 81445708 1 2023-12-16T05:56:42.525 INFO:tasks.workunit.client.1.smithi156.stdout:2/705: creat d9/dd/d17/d33/d47/d9e/fe1 x:0 0 0 2023-12-16T05:56:42.526 INFO:tasks.workunit.client.0.smithi155.stdout:8/941: getdents d4/d62/d66/d78/d88/d1b 0 2023-12-16T05:56:42.527 INFO:tasks.workunit.client.1.smithi156.stdout:8/542: dwrite d3/d7/d27/d46/f79 [0,4194304] 0 2023-12-16T05:56:42.527 INFO:tasks.workunit.client.1.smithi156.stdout:1/589: dwrite d3/d17/d2d/f4e [0,4194304] 0 2023-12-16T05:56:42.529 INFO:tasks.workunit.client.0.smithi155.stdout:2/857: creat d0/d5/d6/d5f/f127 x:0 0 0 2023-12-16T05:56:42.529 INFO:tasks.workunit.client.1.smithi156.stdout:8/543: symlink d3/d12/d16/db4/lb8 0 2023-12-16T05:56:42.530 INFO:tasks.workunit.client.1.smithi156.stdout:2/706: write d9/d12/f18 [3042336,84583] 0 2023-12-16T05:56:42.531 INFO:tasks.workunit.client.0.smithi155.stdout:7/845: symlink d0/d1/d5/l116 0 2023-12-16T05:56:42.532 INFO:tasks.workunit.client.1.smithi156.stdout:5/879: dwrite da/dc/d4b/d6c/fe5 [0,4194304] 0 2023-12-16T05:56:42.532 INFO:tasks.workunit.client.1.smithi156.stdout:5/880: write da/dc/d4b/d6c/d77/fb7 [1817422,17260] 0 2023-12-16T05:56:42.532 INFO:tasks.workunit.client.1.smithi156.stdout:8/544: unlink d3/d12/d74/f7b 0 2023-12-16T05:56:42.534 INFO:tasks.workunit.client.0.smithi155.stdout:8/942: rmdir d4/d62/d66/d78/d88 39 2023-12-16T05:56:42.534 INFO:tasks.workunit.client.1.smithi156.stdout:2/707: creat d9/d12/dc2/fe2 x:0 0 0 2023-12-16T05:56:42.535 INFO:tasks.workunit.client.0.smithi155.stdout:5/956: truncate d0/d2/d2a/d19/d48/df5/f111 688811 0 2023-12-16T05:56:42.538 INFO:tasks.workunit.client.0.smithi155.stdout:8/943: truncate d4/d62/d66/fbd 1444110 0 2023-12-16T05:56:42.538 INFO:tasks.workunit.client.0.smithi155.stdout:8/944: readlink d4/lcb 0 2023-12-16T05:56:42.538 INFO:tasks.workunit.client.0.smithi155.stdout:5/957: symlink d0/d60/d79/df1/l134 0 2023-12-16T05:56:42.541 INFO:tasks.workunit.client.0.smithi155.stdout:2/858: dread d0/d5/f23 [0,4194304] 0 2023-12-16T05:56:42.545 INFO:tasks.workunit.client.1.smithi156.stdout:2/708: unlink d9/dd/d17/f3a 0 2023-12-16T05:56:42.545 INFO:tasks.workunit.client.1.smithi156.stdout:5/881: rename da/d9a/c11e to da/dc/d4b/d6c/c120 0 2023-12-16T05:56:42.547 INFO:tasks.workunit.client.1.smithi156.stdout:2/709: creat d9/dd/d17/d33/d78/d74/dd0/fe3 x:0 0 0 2023-12-16T05:56:42.548 INFO:tasks.workunit.client.1.smithi156.stdout:5/882: mkdir da/dc/d4b/d6c/d81/dc5/deb/d101/d121 0 2023-12-16T05:56:42.550 INFO:tasks.workunit.client.1.smithi156.stdout:8/545: rename d3/d12/c24 to d3/d6/d83/cb9 0 2023-12-16T05:56:42.550 INFO:tasks.workunit.client.1.smithi156.stdout:8/546: fdatasync d3/d12/f70 0 2023-12-16T05:56:42.551 INFO:tasks.workunit.client.1.smithi156.stdout:1/590: dwrite d3/d3a/f7a [0,4194304] 0 2023-12-16T05:56:42.551 INFO:tasks.workunit.client.1.smithi156.stdout:1/591: readlink d3/d3a/l87 0 2023-12-16T05:56:42.551 INFO:tasks.workunit.client.1.smithi156.stdout:1/592: chown d3/d1b 3 1 2023-12-16T05:56:42.551 INFO:tasks.workunit.client.1.smithi156.stdout:5/883: symlink da/dc/d2d/d4d/db9/dc9/dfa/l122 0 2023-12-16T05:56:42.552 INFO:tasks.workunit.client.1.smithi156.stdout:2/710: rename d9/dd/d17/d33/d78/d74/dd0/fdb to d9/fe4 0 2023-12-16T05:56:42.554 INFO:tasks.workunit.client.1.smithi156.stdout:1/593: creat d3/d17/d2d/fc5 x:0 0 0 2023-12-16T05:56:42.557 INFO:tasks.workunit.client.1.smithi156.stdout:2/711: link d9/dd/d17/d33/d47/f4d d9/dd/d17/d33/d78/d39/d8c/dbe/fe5 0 2023-12-16T05:56:42.557 INFO:tasks.workunit.client.1.smithi156.stdout:2/712: chown d9/dd/d17 0 1 2023-12-16T05:56:42.559 INFO:tasks.workunit.client.1.smithi156.stdout:1/594: write d3/d17/d2d/f53 [1794173,64706] 0 2023-12-16T05:56:42.561 INFO:tasks.workunit.client.1.smithi156.stdout:5/884: mkdir da/dc/d4b/d123 0 2023-12-16T05:56:42.565 INFO:tasks.workunit.client.1.smithi156.stdout:1/595: creat d3/d17/d1c/da5/fc6 x:0 0 0 2023-12-16T05:56:42.566 INFO:tasks.workunit.client.1.smithi156.stdout:5/885: symlink da/dc/d10d/l124 0 2023-12-16T05:56:42.566 INFO:tasks.workunit.client.1.smithi156.stdout:5/886: stat da/dc/d4b/d6c/ldc 0 2023-12-16T05:56:42.567 INFO:tasks.workunit.client.1.smithi156.stdout:1/596: symlink d3/d17/lc7 0 2023-12-16T05:56:42.567 INFO:tasks.workunit.client.1.smithi156.stdout:1/597: readlink d3/d17/lc7 0 2023-12-16T05:56:42.568 INFO:tasks.workunit.client.1.smithi156.stdout:5/887: creat da/dc/d4b/d6c/f125 x:0 0 0 2023-12-16T05:56:42.568 INFO:tasks.workunit.client.1.smithi156.stdout:1/598: creat d3/d17/d4d/dc2/d4f/fc8 x:0 0 0 2023-12-16T05:56:42.568 INFO:tasks.workunit.client.1.smithi156.stdout:1/599: chown d3/d3a/f6c 120 1 2023-12-16T05:56:42.569 INFO:tasks.workunit.client.1.smithi156.stdout:5/888: symlink da/dc/d4b/d6c/d81/dc5/l126 0 2023-12-16T05:56:42.569 INFO:tasks.workunit.client.1.smithi156.stdout:1/600: symlink d3/d17/d1c/da5/lc9 0 2023-12-16T05:56:42.581 INFO:tasks.workunit.client.1.smithi156.stdout:9/710: dwrite d6/d19/d30/d48/d87/f70 [0,4194304] 0 2023-12-16T05:56:42.583 INFO:tasks.workunit.client.0.smithi155.stdout:8/945: mknod d4/dd3/df8/c139 0 2023-12-16T05:56:42.583 INFO:tasks.workunit.client.0.smithi155.stdout:8/946: fsync d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/f60 0 2023-12-16T05:56:42.584 INFO:tasks.workunit.client.0.smithi155.stdout:5/958: creat d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/dd9/f135 x:0 0 0 2023-12-16T05:56:42.587 INFO:tasks.workunit.client.0.smithi155.stdout:7/846: dwrite d0/d6a/d1a/d8c/d34/d6c/fcb [0,4194304] 0 2023-12-16T05:56:42.588 INFO:tasks.workunit.client.0.smithi155.stdout:2/859: mkdir d0/d7/d128 0 2023-12-16T05:56:42.589 INFO:tasks.workunit.client.1.smithi156.stdout:9/711: rmdir d6/d19/d30 39 2023-12-16T05:56:42.589 INFO:tasks.workunit.client.0.smithi155.stdout:7/847: write d0/d1b/f39 [2591021,67659] 0 2023-12-16T05:56:42.590 INFO:tasks.workunit.client.1.smithi156.stdout:2/713: fsync d9/dd/d17/d33/d47/f4d 0 2023-12-16T05:56:42.594 INFO:tasks.workunit.client.0.smithi155.stdout:2/860: rename d0/d7/d57/d95 to d0/d7/d1f/d74/d129 0 2023-12-16T05:56:42.599 INFO:tasks.workunit.client.1.smithi156.stdout:3/636: sync 2023-12-16T05:56:42.599 INFO:tasks.workunit.client.0.smithi155.stdout:2/861: rename d0/d5/d6/d5f/f99 to d0/d7/dd/d62/d66/dbc/f12a 0 2023-12-16T05:56:42.601 INFO:tasks.workunit.client.1.smithi156.stdout:2/714: dread d9/d68/f97 [0,4194304] 0 2023-12-16T05:56:42.602 INFO:tasks.workunit.client.0.smithi155.stdout:2/862: mkdir d0/d5/d6/d12b 0 2023-12-16T05:56:42.602 INFO:tasks.workunit.client.0.smithi155.stdout:2/863: truncate d0/d7/dd/d49/d4b/d80/f9c 1846835 0 2023-12-16T05:56:42.603 INFO:tasks.workunit.client.0.smithi155.stdout:2/864: mkdir d0/d7/d128/d12c 0 2023-12-16T05:56:42.604 INFO:tasks.workunit.client.0.smithi155.stdout:7/848: dread d0/d6a/d31/fcf [0,4194304] 0 2023-12-16T05:56:42.605 INFO:tasks.workunit.client.0.smithi155.stdout:2/865: creat d0/d5/d6/d10a/f12d x:0 0 0 2023-12-16T05:56:42.606 INFO:tasks.workunit.client.0.smithi155.stdout:2/866: unlink d0/d7/dd/f112 0 2023-12-16T05:56:42.607 INFO:tasks.workunit.client.1.smithi156.stdout:2/715: write d9/dd/d17/d33/dae/fb0 [1461633,92453] 0 2023-12-16T05:56:42.608 INFO:tasks.workunit.client.0.smithi155.stdout:2/867: symlink d0/d7/dd/l12e 0 2023-12-16T05:56:42.609 INFO:tasks.workunit.client.0.smithi155.stdout:2/868: mknod d0/d7/d57/c12f 0 2023-12-16T05:56:42.609 INFO:tasks.workunit.client.1.smithi156.stdout:2/716: unlink d9/dd/d17/d33/d78/d39/f76 0 2023-12-16T05:56:42.611 INFO:tasks.workunit.client.1.smithi156.stdout:5/889: dwrite da/dc/d2d/d4d/d54/d67/f8c [0,4194304] 0 2023-12-16T05:56:42.611 INFO:tasks.workunit.client.1.smithi156.stdout:5/890: write da/dc/d4b/d6c/d81/fa9 [425398,26662] 0 2023-12-16T05:56:42.611 INFO:tasks.workunit.client.0.smithi155.stdout:2/869: mknod d0/d7/d1f/d74/d129/c130 0 2023-12-16T05:56:42.612 INFO:tasks.workunit.client.1.smithi156.stdout:5/891: dread da/f50 [0,4194304] 0 2023-12-16T05:56:42.612 INFO:tasks.workunit.client.1.smithi156.stdout:5/892: chown da/dc/d4b/d6c/d77/d10e/lbe 11181155 1 2023-12-16T05:56:42.612 INFO:tasks.workunit.client.1.smithi156.stdout:5/893: dread - da/dc/d4b/d6c/d7c/d85/fd4 zero size 2023-12-16T05:56:42.615 INFO:tasks.workunit.client.0.smithi155.stdout:8/947: dwrite d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/f10f [0,4194304] 0 2023-12-16T05:56:42.615 INFO:tasks.workunit.client.0.smithi155.stdout:8/948: write d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/f118 [120789,99241] 0 2023-12-16T05:56:42.615 INFO:tasks.workunit.client.1.smithi156.stdout:5/894: rmdir da/dc/d2d/d4d/d54/d90 39 2023-12-16T05:56:42.617 INFO:tasks.workunit.client.1.smithi156.stdout:5/895: link da/d46/l71 da/dc/d2d/d4d/d54/d90/l127 0 2023-12-16T05:56:42.617 INFO:tasks.workunit.client.0.smithi155.stdout:8/949: dread d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/fe3 [4194304,4194304] 0 2023-12-16T05:56:42.618 INFO:tasks.workunit.client.1.smithi156.stdout:5/896: mknod da/dc/d10d/c128 0 2023-12-16T05:56:42.619 INFO:tasks.workunit.client.0.smithi155.stdout:8/950: truncate d4/f41 831298 0 2023-12-16T05:56:42.621 INFO:tasks.workunit.client.1.smithi156.stdout:3/637: dread dc/d10/d1d/d4b/fa7 [0,4194304] 0 2023-12-16T05:56:42.621 INFO:tasks.workunit.client.1.smithi156.stdout:9/712: dwrite d6/d19/f24 [0,4194304] 0 2023-12-16T05:56:42.621 INFO:tasks.workunit.client.1.smithi156.stdout:5/897: creat da/dc/d4b/d6c/d77/d10e/f129 x:0 0 0 2023-12-16T05:56:42.621 INFO:tasks.workunit.client.1.smithi156.stdout:5/898: chown da/dc/d2d/d4d/d54/d67/l7b 21 1 2023-12-16T05:56:42.621 INFO:tasks.workunit.client.0.smithi155.stdout:8/951: link d4/dd3/df8/c139 d4/d62/d66/d78/d88/d1b/d1c/d1a/c13a 0 2023-12-16T05:56:42.623 INFO:tasks.workunit.client.0.smithi155.stdout:8/952: creat d4/d62/d10c/f13b x:0 0 0 2023-12-16T05:56:42.627 INFO:tasks.workunit.client.1.smithi156.stdout:5/899: rename da/dc/d2d/d4d/d54/da6/cb6 to da/dc/de2/c12a 0 2023-12-16T05:56:42.627 INFO:tasks.workunit.client.1.smithi156.stdout:5/900: chown da/c2f 8 1 2023-12-16T05:56:42.632 INFO:tasks.workunit.client.1.smithi156.stdout:5/901: mkdir da/dc/d2d/db0/d12b 0 2023-12-16T05:56:42.634 INFO:tasks.workunit.client.1.smithi156.stdout:5/902: rename da/dc/d4b/d6c/d7c/d85/l99 to da/dc/d4b/d6c/d7c/l12c 0 2023-12-16T05:56:42.636 INFO:tasks.workunit.client.1.smithi156.stdout:5/903: rename da/dc/d4b/d6c/f125 to da/d46/f12d 0 2023-12-16T05:56:42.636 INFO:tasks.workunit.client.1.smithi156.stdout:2/717: dwrite f5 [4194304,4194304] 0 2023-12-16T05:56:42.636 INFO:tasks.workunit.client.1.smithi156.stdout:2/718: truncate d9/d56/d5f/fb3 1012150 0 2023-12-16T05:56:42.637 INFO:tasks.workunit.client.0.smithi155.stdout:2/870: dwrite d0/d34/d3c/fe9 [0,4194304] 0 2023-12-16T05:56:42.637 INFO:tasks.workunit.client.0.smithi155.stdout:2/871: truncate d0/d7/dd/d14/f11b 270078 0 2023-12-16T05:56:42.639 INFO:tasks.workunit.client.1.smithi156.stdout:3/638: dwrite dc/df/d34/d62/f9a [0,4194304] 0 2023-12-16T05:56:42.639 INFO:tasks.workunit.client.1.smithi156.stdout:3/639: chown dc/d10/f50 2 1 2023-12-16T05:56:42.639 INFO:tasks.workunit.client.1.smithi156.stdout:3/640: read - dc/d10/d3d/f91 zero size 2023-12-16T05:56:42.640 INFO:tasks.workunit.client.0.smithi155.stdout:2/872: rmdir d0/d7/d57/daf/d10e 39 2023-12-16T05:56:42.640 INFO:tasks.workunit.client.1.smithi156.stdout:5/904: read da/dc/d2d/d4d/d54/f5d [3345399,43463] 0 2023-12-16T05:56:42.640 INFO:tasks.workunit.client.0.smithi155.stdout:2/873: creat d0/d7/dd/d49/d4b/d8c/f131 x:0 0 0 2023-12-16T05:56:42.641 INFO:tasks.workunit.client.1.smithi156.stdout:9/713: dwrite d6/d2e/f66 [0,4194304] 0 2023-12-16T05:56:42.641 INFO:tasks.workunit.client.1.smithi156.stdout:9/714: fdatasync d6/d19/d30/d5b/d9a/f9f 0 2023-12-16T05:56:42.641 INFO:tasks.workunit.client.1.smithi156.stdout:9/715: truncate d6/d19/f1b 5179735 0 2023-12-16T05:56:42.642 INFO:tasks.workunit.client.0.smithi155.stdout:2/874: rename d0/d7/dd/d14/db6/ffd to d0/d7/d1f/d74/d85/d88/f132 0 2023-12-16T05:56:42.643 INFO:tasks.workunit.client.0.smithi155.stdout:2/875: mknod d0/d7/d1f/d74/d85/c133 0 2023-12-16T05:56:42.644 INFO:tasks.workunit.client.0.smithi155.stdout:2/876: link d0/d7/d57/fa7 d0/d7/d1f/d74/d85/d88/f134 0 2023-12-16T05:56:42.647 INFO:tasks.workunit.client.1.smithi156.stdout:3/641: dread dc/d10/f50 [0,4194304] 0 2023-12-16T05:56:42.652 INFO:tasks.workunit.client.1.smithi156.stdout:3/642: dread dc/df/f2d [0,4194304] 0 2023-12-16T05:56:42.653 INFO:tasks.workunit.client.1.smithi156.stdout:3/643: chown dc/d10/dc6 8960 1 2023-12-16T05:56:42.653 INFO:tasks.workunit.client.1.smithi156.stdout:3/644: chown dc/d10/f11 24437 1 2023-12-16T05:56:42.653 INFO:tasks.workunit.client.1.smithi156.stdout:3/645: write dc/d10/d1d/f32 [639720,127956] 0 2023-12-16T05:56:42.653 INFO:tasks.workunit.client.1.smithi156.stdout:3/646: fsync dc/d10/d3d/f38 0 2023-12-16T05:56:42.657 INFO:tasks.workunit.client.1.smithi156.stdout:2/719: dread d9/dd/d17/d33/dae/fb0 [0,4194304] 0 2023-12-16T05:56:42.659 INFO:tasks.workunit.client.1.smithi156.stdout:5/905: dread da/dc/d4b/d6c/f7a [0,4194304] 0 2023-12-16T05:56:42.661 INFO:tasks.workunit.client.1.smithi156.stdout:5/906: mknod da/dc/d4b/d6c/c12e 0 2023-12-16T05:56:42.663 INFO:tasks.workunit.client.1.smithi156.stdout:5/907: rename da/dc/d4b/d6c/d7c/fcb to da/dc/d4b/d6c/d77/f12f 0 2023-12-16T05:56:42.663 INFO:tasks.workunit.client.1.smithi156.stdout:5/908: fdatasync da/d46/f4f 0 2023-12-16T05:56:42.663 INFO:tasks.workunit.client.1.smithi156.stdout:5/909: truncate da/f3a 3482990 0 2023-12-16T05:56:42.663 INFO:tasks.workunit.client.1.smithi156.stdout:5/910: write da/dc/d4b/d6c/f7a [711529,129701] 0 2023-12-16T05:56:42.666 INFO:tasks.workunit.client.1.smithi156.stdout:9/716: dwrite d6/d2e/f66 [0,4194304] 0 2023-12-16T05:56:42.671 INFO:tasks.workunit.client.0.smithi155.stdout:2/877: dwrite d0/d7/dd/d49/d4b/d80/f9c [0,4194304] 0 2023-12-16T05:56:42.671 INFO:tasks.workunit.client.0.smithi155.stdout:2/878: chown d0/d7/d1f/d74/d129/fe1 2 1 2023-12-16T05:56:42.671 INFO:tasks.workunit.client.0.smithi155.stdout:2/879: truncate d0/d7/d57/d9b/fd6 730695 0 2023-12-16T05:56:42.671 INFO:tasks.workunit.client.0.smithi155.stdout:2/880: fdatasync d0/d5/d6/f7c 0 2023-12-16T05:56:42.674 INFO:tasks.workunit.client.0.smithi155.stdout:2/881: rename d0/d7/d1f/d74/ca5 to d0/d7/d69/c135 0 2023-12-16T05:56:42.676 INFO:tasks.workunit.client.0.smithi155.stdout:2/882: link d0/d7/dd/f6e d0/f136 0 2023-12-16T05:56:42.676 INFO:tasks.workunit.client.0.smithi155.stdout:2/883: readlink d0/d5/l11c 0 2023-12-16T05:56:42.677 INFO:tasks.workunit.client.0.smithi155.stdout:2/884: rename d0/d7/d69/dae/lb0 to d0/d7/dc1/l137 0 2023-12-16T05:56:42.678 INFO:tasks.workunit.client.0.smithi155.stdout:2/885: write d0/d7/d57/daf/d10e/f119 [716551,19050] 0 2023-12-16T05:56:42.678 INFO:tasks.workunit.client.0.smithi155.stdout:2/886: write d0/d7/dd/d49/d4b/d8c/f131 [168117,50378] 0 2023-12-16T05:56:42.679 INFO:tasks.workunit.client.0.smithi155.stdout:8/953: dwrite d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/f118 [0,4194304] 0 2023-12-16T05:56:42.680 INFO:tasks.workunit.client.1.smithi156.stdout:2/720: dwrite d9/dd/d17/d33/f10 [4194304,4194304] 0 2023-12-16T05:56:42.680 INFO:tasks.workunit.client.1.smithi156.stdout:2/721: fsync d9/d12/dc2/dd8/da6/f64 0 2023-12-16T05:56:42.680 INFO:tasks.workunit.client.1.smithi156.stdout:2/722: fdatasync d9/dd/d17/d33/d78/f3c 0 2023-12-16T05:56:42.684 INFO:tasks.workunit.client.0.smithi155.stdout:8/954: symlink d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/l13c 0 2023-12-16T05:56:42.688 INFO:tasks.workunit.client.1.smithi156.stdout:9/717: dwrite d6/d19/d25/f31 [0,4194304] 0 2023-12-16T05:56:42.688 INFO:tasks.workunit.client.1.smithi156.stdout:9/718: chown d6/d19/d25/c94 111 1 2023-12-16T05:56:42.699 INFO:tasks.workunit.client.0.smithi155.stdout:2/887: dwrite d0/d7/d1f/d74/d85/d88/f115 [0,4194304] 0 2023-12-16T05:56:42.699 INFO:tasks.workunit.client.1.smithi156.stdout:2/723: dwrite d9/dd/d17/d33/d78/d74/dd0/fe3 [0,4194304] 0 2023-12-16T05:56:42.699 INFO:tasks.workunit.client.1.smithi156.stdout:2/724: write d9/d12/f45 [1035525,37037] 0 2023-12-16T05:56:42.704 INFO:tasks.workunit.client.1.smithi156.stdout:6/713: sync 2023-12-16T05:56:42.704 INFO:tasks.workunit.client.1.smithi156.stdout:7/917: sync 2023-12-16T05:56:42.705 INFO:tasks.workunit.client.1.smithi156.stdout:7/918: truncate d1e/d1f/f76 452100 0 2023-12-16T05:56:42.707 INFO:tasks.workunit.client.1.smithi156.stdout:6/714: truncate d9/d13/f27 514392 0 2023-12-16T05:56:42.708 INFO:tasks.workunit.client.1.smithi156.stdout:6/715: chown d9/d13/d2f/d51/d82/cb3 2542630 1 2023-12-16T05:56:42.711 INFO:tasks.workunit.client.1.smithi156.stdout:7/919: rmdir d1e/d55/db6 39 2023-12-16T05:56:42.712 INFO:tasks.workunit.client.0.smithi155.stdout:8/955: dwrite d4/d62/d66/d78/d88/d1b/d1c/d19/f73 [0,4194304] 0 2023-12-16T05:56:42.713 INFO:tasks.workunit.client.1.smithi156.stdout:7/920: read d1e/f8c [6641158,35391] 0 2023-12-16T05:56:42.714 INFO:tasks.workunit.client.0.smithi155.stdout:8/956: unlink d4/d62/d66/d78/d88/d1b/d1c/d1a/fd1 0 2023-12-16T05:56:42.715 INFO:tasks.workunit.client.1.smithi156.stdout:7/921: dread d1e/d1f/da6/f45 [4194304,4194304] 0 2023-12-16T05:56:42.716 INFO:tasks.workunit.client.1.smithi156.stdout:7/922: stat d1e/d1f/d72/d107/c10a 0 2023-12-16T05:56:42.716 INFO:tasks.workunit.client.0.smithi155.stdout:8/957: read d4/dd3/fea [3075332,118271] 0 2023-12-16T05:56:42.716 INFO:tasks.workunit.client.0.smithi155.stdout:8/958: fdatasync d4/d62/d10c/f13b 0 2023-12-16T05:56:42.716 INFO:tasks.workunit.client.1.smithi156.stdout:7/923: creat d1e/d1f/d22/f13e x:0 0 0 2023-12-16T05:56:42.717 INFO:tasks.workunit.client.0.smithi155.stdout:8/959: creat d4/d62/d66/d78/d88/d1b/d2a/f13d x:0 0 0 2023-12-16T05:56:42.721 INFO:tasks.workunit.client.1.smithi156.stdout:7/924: write d1e/d1f/da6/d57/d59/f121 [1734877,21106] 0 2023-12-16T05:56:42.749 INFO:tasks.workunit.client.0.smithi155.stdout:3/687: sync 2023-12-16T05:56:42.749 INFO:tasks.workunit.client.0.smithi155.stdout:3/688: readlink d0/d1a/d33/l4d 0 2023-12-16T05:56:42.750 INFO:tasks.workunit.client.0.smithi155.stdout:3/689: mknod d0/d14/d36/cd1 0 2023-12-16T05:56:42.750 INFO:tasks.workunit.client.0.smithi155.stdout:3/690: dread - d0/d14/d36/d83/da8/fc1 zero size 2023-12-16T05:56:42.751 INFO:tasks.workunit.client.0.smithi155.stdout:3/691: rename d0/d14/d36/d79 to d0/d14/d36/d47/d5f/d9a/dd2 0 2023-12-16T05:56:42.752 INFO:tasks.workunit.client.0.smithi155.stdout:3/692: write d0/d14/d36/d7c/fac [11821485,89726] 0 2023-12-16T05:56:42.752 INFO:tasks.workunit.client.0.smithi155.stdout:3/693: symlink d0/d14/d36/d47/ld3 0 2023-12-16T05:56:42.754 INFO:tasks.workunit.client.1.smithi156.stdout:7/925: write d1e/d55/d71/d61/f36 [1137701,59221] 0 2023-12-16T05:56:42.755 INFO:tasks.workunit.client.0.smithi155.stdout:3/694: read d0/d1e/f68 [337337,107681] 0 2023-12-16T05:56:42.755 INFO:tasks.workunit.client.0.smithi155.stdout:3/695: chown d0/d14/d36/d7c/c7e 335 1 2023-12-16T05:56:42.755 INFO:tasks.workunit.client.0.smithi155.stdout:3/696: write d0/d14/d45/f8b [1613629,78678] 0 2023-12-16T05:56:42.755 INFO:tasks.workunit.client.0.smithi155.stdout:3/697: creat d0/d14/d87/fd4 x:0 0 0 2023-12-16T05:56:42.756 INFO:tasks.workunit.client.0.smithi155.stdout:3/698: mkdir d0/d1a/d33/d57/dba/dd5 0 2023-12-16T05:56:42.758 INFO:tasks.workunit.client.0.smithi155.stdout:2/888: dwrite d0/d7/f5e [0,4194304] 0 2023-12-16T05:56:42.760 INFO:tasks.workunit.client.0.smithi155.stdout:2/889: rename d0/d125 to d0/d7/d1f/d74/d85/d138 0 2023-12-16T05:56:42.761 INFO:tasks.workunit.client.0.smithi155.stdout:2/890: truncate d0/f30 2728369 0 2023-12-16T05:56:42.761 INFO:tasks.workunit.client.0.smithi155.stdout:8/960: dwrite d4/dd3/df8/d12c/fec [0,4194304] 0 2023-12-16T05:56:42.762 INFO:tasks.workunit.client.0.smithi155.stdout:2/891: link d0/d7/dd/d49/d4b/d80/lf3 d0/d7/d1f/d74/d129/l139 0 2023-12-16T05:56:42.762 INFO:tasks.workunit.client.0.smithi155.stdout:2/892: write d0/d5/d6/d5f/f120 [638964,106836] 0 2023-12-16T05:56:42.764 INFO:tasks.workunit.client.1.smithi156.stdout:7/926: dread d1e/d55/fff [0,4194304] 0 2023-12-16T05:56:42.764 INFO:tasks.workunit.client.1.smithi156.stdout:6/716: dwrite d9/d13/d2f/d51/d82/fa0 [0,4194304] 0 2023-12-16T05:56:42.765 INFO:tasks.workunit.client.0.smithi155.stdout:2/893: write d0/d7/dd/f26 [2290713,34457] 0 2023-12-16T05:56:42.768 INFO:tasks.workunit.client.0.smithi155.stdout:3/699: dread d0/d14/d36/f3d [0,4194304] 0 2023-12-16T05:56:42.768 INFO:tasks.workunit.client.1.smithi156.stdout:6/717: symlink d9/d13/d2f/d51/d82/lde 0 2023-12-16T05:56:42.768 INFO:tasks.workunit.client.1.smithi156.stdout:6/718: write d9/d13/d2f/d51/d82/d89/fcb [174128,73006] 0 2023-12-16T05:56:42.769 INFO:tasks.workunit.client.0.smithi155.stdout:3/700: mknod d0/d14/d36/d47/d5f/cd6 0 2023-12-16T05:56:42.769 INFO:tasks.workunit.client.1.smithi156.stdout:6/719: rmdir d9/d13/d2f/d51/d6b/d77/d7e 39 2023-12-16T05:56:42.769 INFO:tasks.workunit.client.1.smithi156.stdout:6/720: truncate d9/d13/d2f/d51/d69/d99/f9c 347547 0 2023-12-16T05:56:42.771 INFO:tasks.workunit.client.0.smithi155.stdout:3/701: symlink d0/d1a/d33/d57/dba/ld7 0 2023-12-16T05:56:42.771 INFO:tasks.workunit.client.0.smithi155.stdout:3/702: mknod d0/d1a/d33/d57/cd8 0 2023-12-16T05:56:42.773 INFO:tasks.workunit.client.0.smithi155.stdout:3/703: mknod d0/d1a/d33/d57/dba/dd5/cd9 0 2023-12-16T05:56:42.774 INFO:tasks.workunit.client.1.smithi156.stdout:7/927: dread d1e/d1f/d22/f25 [0,4194304] 0 2023-12-16T05:56:42.774 INFO:tasks.workunit.client.0.smithi155.stdout:2/894: dread d0/d5/d6/f82 [0,4194304] 0 2023-12-16T05:56:42.776 INFO:tasks.workunit.client.0.smithi155.stdout:3/704: getdents d0/d14/d36/d47/da7 0 2023-12-16T05:56:42.776 INFO:tasks.workunit.client.1.smithi156.stdout:6/721: write d9/d13/f17 [1163819,38598] 0 2023-12-16T05:56:42.776 INFO:tasks.workunit.client.1.smithi156.stdout:6/722: write d9/d1c/d50/dbf/dc0/fcd [145034,16003] 0 2023-12-16T05:56:42.776 INFO:tasks.workunit.client.1.smithi156.stdout:6/723: rmdir d9/d13/d2f/d36 39 2023-12-16T05:56:42.777 INFO:tasks.workunit.client.0.smithi155.stdout:2/895: creat d0/d7/d69/db8/f13a x:0 0 0 2023-12-16T05:56:42.778 INFO:tasks.workunit.client.1.smithi156.stdout:6/724: rmdir d9/d13/d2f/d51/d6b/d77/d7e 39 2023-12-16T05:56:42.778 INFO:tasks.workunit.client.1.smithi156.stdout:6/725: symlink d9/d13/d2f/d51/dad/ldf 0 2023-12-16T05:56:42.779 INFO:tasks.workunit.client.0.smithi155.stdout:3/705: unlink d0/d14/d87/d94/da1/c96 0 2023-12-16T05:56:42.779 INFO:tasks.workunit.client.0.smithi155.stdout:4/881: sync 2023-12-16T05:56:42.779 INFO:tasks.workunit.client.0.smithi155.stdout:3/706: mknod d0/d14/d36/d47/cda 0 2023-12-16T05:56:42.780 INFO:tasks.workunit.client.0.smithi155.stdout:3/707: readlink d0/d14/d36/d47/d5f/d9a/d9b/lcb 0 2023-12-16T05:56:42.780 INFO:tasks.workunit.client.1.smithi156.stdout:6/726: dread d9/d13/f4d [0,4194304] 0 2023-12-16T05:56:42.781 INFO:tasks.workunit.client.0.smithi155.stdout:3/708: creat d0/d14/d87/dcf/fdb x:0 0 0 2023-12-16T05:56:42.781 INFO:tasks.workunit.client.0.smithi155.stdout:3/709: write d0/d14/d36/f89 [4447356,20148] 0 2023-12-16T05:56:42.782 INFO:tasks.workunit.client.0.smithi155.stdout:3/710: rename d0/d14/d87/d94/da1/d73/f84 to d0/d1e/d4e/db6/fdc 0 2023-12-16T05:56:42.783 INFO:tasks.workunit.client.0.smithi155.stdout:3/711: creat d0/d14/d36/d47/fdd x:0 0 0 2023-12-16T05:56:42.784 INFO:tasks.workunit.client.0.smithi155.stdout:2/896: dread d0/d7/f73 [0,4194304] 0 2023-12-16T05:56:42.784 INFO:tasks.workunit.client.0.smithi155.stdout:2/897: chown d0/d7/d57/fa7 94544788 1 2023-12-16T05:56:42.784 INFO:tasks.workunit.client.0.smithi155.stdout:2/898: read - d0/d7/d1f/d74/f122 zero size 2023-12-16T05:56:42.784 INFO:tasks.workunit.client.0.smithi155.stdout:3/712: getdents d0/d1a 0 2023-12-16T05:56:42.785 INFO:tasks.workunit.client.0.smithi155.stdout:2/899: creat d0/d7/dd/d49/f13b x:0 0 0 2023-12-16T05:56:42.786 INFO:tasks.workunit.client.0.smithi155.stdout:3/713: rmdir d0/d1a 39 2023-12-16T05:56:42.788 INFO:tasks.workunit.client.0.smithi155.stdout:2/900: creat d0/d7/dd/d14/f13c x:0 0 0 2023-12-16T05:56:42.788 INFO:tasks.workunit.client.0.smithi155.stdout:2/901: stat d0/d5/d6/d10a/f12d 0 2023-12-16T05:56:42.788 INFO:tasks.workunit.client.0.smithi155.stdout:2/902: readlink d0/d7/dd/l3f 0 2023-12-16T05:56:42.788 INFO:tasks.workunit.client.1.smithi156.stdout:6/727: dread d9/f35 [0,4194304] 0 2023-12-16T05:56:42.789 INFO:tasks.workunit.client.0.smithi155.stdout:3/714: mkdir d0/d1a/d91/dde 0 2023-12-16T05:56:42.789 INFO:tasks.workunit.client.1.smithi156.stdout:6/728: mknod d9/d13/ce0 0 2023-12-16T05:56:42.790 INFO:tasks.workunit.client.1.smithi156.stdout:6/729: symlink d9/d13/d2f/d51/d82/le1 0 2023-12-16T05:56:42.790 INFO:tasks.workunit.client.1.smithi156.stdout:6/730: truncate d9/d13/d2f/d51/d6b/fd3 581046 0 2023-12-16T05:56:42.791 INFO:tasks.workunit.client.0.smithi155.stdout:3/715: mkdir d0/d1a/d33/d57/dc3/ddf 0 2023-12-16T05:56:42.791 INFO:tasks.workunit.client.1.smithi156.stdout:6/731: rmdir d9/d13/d2f/d51/dad 39 2023-12-16T05:56:42.791 INFO:tasks.workunit.client.1.smithi156.stdout:6/732: mkdir d9/d13/d2f/d51/d9b/de2 0 2023-12-16T05:56:42.792 INFO:tasks.workunit.client.0.smithi155.stdout:3/716: creat d0/d14/d36/d47/d5f/dca/fe0 x:0 0 0 2023-12-16T05:56:42.792 INFO:tasks.workunit.client.0.smithi155.stdout:3/717: readlink d0/d14/d9d/la5 0 2023-12-16T05:56:42.792 INFO:tasks.workunit.client.0.smithi155.stdout:3/718: read d0/d14/d87/d94/da1/d73/fc4 [4534,22866] 0 2023-12-16T05:56:42.793 INFO:tasks.workunit.client.1.smithi156.stdout:6/733: dread d9/d1c/fac [0,4194304] 0 2023-12-16T05:56:42.794 INFO:tasks.workunit.client.0.smithi155.stdout:3/719: write d0/d1a/d33/f72 [5035538,115133] 0 2023-12-16T05:56:42.794 INFO:tasks.workunit.client.1.smithi156.stdout:6/734: read d9/f35 [7809791,64100] 0 2023-12-16T05:56:42.796 INFO:tasks.workunit.client.1.smithi156.stdout:6/735: symlink d9/d13/d2f/d51/d9b/le3 0 2023-12-16T05:56:42.798 INFO:tasks.workunit.client.0.smithi155.stdout:3/720: write d0/d14/d36/d47/f98 [2384702,121048] 0 2023-12-16T05:56:42.798 INFO:tasks.workunit.client.1.smithi156.stdout:6/736: write d9/d13/d2f/d51/d82/fa0 [3960562,97109] 0 2023-12-16T05:56:42.799 INFO:tasks.workunit.client.1.smithi156.stdout:6/737: symlink d9/d13/d3e/d5f/le4 0 2023-12-16T05:56:42.800 INFO:tasks.workunit.client.0.smithi155.stdout:3/721: write d0/f55 [1911503,30326] 0 2023-12-16T05:56:42.801 INFO:tasks.workunit.client.1.smithi156.stdout:6/738: rename d9/d13/d2f/d51/d82/lde to d9/d13/d2f/le5 0 2023-12-16T05:56:42.801 INFO:tasks.workunit.client.1.smithi156.stdout:6/739: fdatasync d9/d13/d3e/d5f/f75 0 2023-12-16T05:56:42.801 INFO:tasks.workunit.client.0.smithi155.stdout:4/882: dwrite d0/da/de0/d16/fcc [0,4194304] 0 2023-12-16T05:56:42.801 INFO:tasks.workunit.client.0.smithi155.stdout:4/883: read d0/da/de0/d16/d30/d52/d88/d9e/fc4 [445918,63159] 0 2023-12-16T05:56:42.802 INFO:tasks.workunit.client.0.smithi155.stdout:3/722: rename d0/f2e to d0/d1a/d91/dde/fe1 0 2023-12-16T05:56:42.803 INFO:tasks.workunit.client.1.smithi156.stdout:6/740: rename d9/d13/d3e/d5f/c60 to d9/d13/d2f/d51/d69/d99/db9/ce6 0 2023-12-16T05:56:42.803 INFO:tasks.workunit.client.1.smithi156.stdout:6/741: dread - d9/d1c/d50/dbf/fc5 zero size 2023-12-16T05:56:42.803 INFO:tasks.workunit.client.1.smithi156.stdout:6/742: dread - d9/fdc zero size 2023-12-16T05:56:42.803 INFO:tasks.workunit.client.1.smithi156.stdout:6/743: chown d9/d13/d3e/f83 35663 1 2023-12-16T05:56:42.804 INFO:tasks.workunit.client.0.smithi155.stdout:4/884: link d0/da/de0/d16/d30/d52/d88/d9e/la1 d0/da/de0/d16/d30/d52/d88/d9e/d103/de2/l126 0 2023-12-16T05:56:42.805 INFO:tasks.workunit.client.1.smithi156.stdout:6/744: creat d9/d1c/d50/dbf/dca/fe7 x:0 0 0 2023-12-16T05:56:42.806 INFO:tasks.workunit.client.0.smithi155.stdout:3/723: creat d0/d1a/d33/d57/dba/dd5/fe2 x:0 0 0 2023-12-16T05:56:42.806 INFO:tasks.workunit.client.1.smithi156.stdout:0/793: sync 2023-12-16T05:56:42.806 INFO:tasks.workunit.client.1.smithi156.stdout:4/650: sync 2023-12-16T05:56:42.806 INFO:tasks.workunit.client.0.smithi155.stdout:4/885: dread d0/da/de0/d16/d30/dce/d75/f100 [0,4194304] 0 2023-12-16T05:56:42.807 INFO:tasks.workunit.client.1.smithi156.stdout:6/745: rename d9/d1c/l5e to d9/le8 0 2023-12-16T05:56:42.807 INFO:tasks.workunit.client.1.smithi156.stdout:4/651: creat d9/d2c/d48/fdc x:0 0 0 2023-12-16T05:56:42.808 INFO:tasks.workunit.client.0.smithi155.stdout:4/886: getdents d0/da/de0/d16/d30/d52/d88/d9e 0 2023-12-16T05:56:42.809 INFO:tasks.workunit.client.1.smithi156.stdout:6/746: creat d9/d13/d2f/d51/d69/d99/fe9 x:0 0 0 2023-12-16T05:56:42.810 INFO:tasks.workunit.client.1.smithi156.stdout:6/747: mknod d9/d1c/d50/dbf/dca/cea 0 2023-12-16T05:56:42.811 INFO:tasks.workunit.client.1.smithi156.stdout:4/652: mkdir d9/d43/d58/d7d/ddd 0 2023-12-16T05:56:42.815 INFO:tasks.workunit.client.0.smithi155.stdout:2/903: dwrite d0/d7/d1f/d74/d85/fc3 [0,4194304] 0 2023-12-16T05:56:42.815 INFO:tasks.workunit.client.0.smithi155.stdout:2/904: chown d0/d7/dd/d62/faa 13 1 2023-12-16T05:56:42.818 INFO:tasks.workunit.client.0.smithi155.stdout:3/724: dread d0/d14/f35 [0,4194304] 0 2023-12-16T05:56:42.820 INFO:tasks.workunit.client.0.smithi155.stdout:4/887: dread d0/f5 [0,4194304] 0 2023-12-16T05:56:42.820 INFO:tasks.workunit.client.0.smithi155.stdout:4/888: stat d0/da/d36/c58 0 2023-12-16T05:56:42.820 INFO:tasks.workunit.client.0.smithi155.stdout:4/889: fdatasync d0/da/de0/d16/d30/dce/d75/d3d/fc2 0 2023-12-16T05:56:42.820 INFO:tasks.workunit.client.1.smithi156.stdout:4/653: rmdir d9/d2c 39 2023-12-16T05:56:42.824 INFO:tasks.workunit.client.1.smithi156.stdout:0/794: dread d2/d7/dd/d29/f6b [0,4194304] 0 2023-12-16T05:56:42.824 INFO:tasks.workunit.client.1.smithi156.stdout:0/795: chown d2/d7/dd/d29/d38/d51/d52/d88/dbc 2310024 1 2023-12-16T05:56:42.824 INFO:tasks.workunit.client.1.smithi156.stdout:0/796: fsync d2/d23/d4a/fa3 0 2023-12-16T05:56:42.827 INFO:tasks.workunit.client.1.smithi156.stdout:0/797: mknod d2/d7/dd/d29/d38/cf9 0 2023-12-16T05:56:42.828 INFO:tasks.workunit.client.0.smithi155.stdout:2/905: dread d0/d7/d69/fd5 [0,4194304] 0 2023-12-16T05:56:42.829 INFO:tasks.workunit.client.0.smithi155.stdout:2/906: dread - d0/d7/d57/daf/dc4/f11e zero size 2023-12-16T05:56:42.829 INFO:tasks.workunit.client.1.smithi156.stdout:0/798: mknod d2/d7/dd/d29/d38/d51/d52/d88/dbc/dd2/cfa 0 2023-12-16T05:56:42.829 INFO:tasks.workunit.client.1.smithi156.stdout:0/799: chown d2/d7/dd/d2d/d5e/dc4 2040573 1 2023-12-16T05:56:42.830 INFO:tasks.workunit.client.0.smithi155.stdout:2/907: dread d0/d7/d57/d63/de7/fda [0,4194304] 0 2023-12-16T05:56:42.831 INFO:tasks.workunit.client.1.smithi156.stdout:0/800: creat d2/d7/dd/d29/d38/d3f/d44/ffb x:0 0 0 2023-12-16T05:56:42.832 INFO:tasks.workunit.client.1.smithi156.stdout:0/801: rename d2/d7/dd/d29/d38/d51/d52/d88/dbc/dd2/le3 to d2/df0/lfc 0 2023-12-16T05:56:42.833 INFO:tasks.workunit.client.1.smithi156.stdout:0/802: read d2/d7/dd/f33 [4834364,120052] 0 2023-12-16T05:56:42.837 INFO:tasks.workunit.client.1.smithi156.stdout:6/748: dwrite d9/d13/d2f/d51/d6b/d77/d7e/fd2 [0,4194304] 0 2023-12-16T05:56:42.839 INFO:tasks.workunit.client.1.smithi156.stdout:6/749: symlink d9/d13/d2f/d51/dad/leb 0 2023-12-16T05:56:42.842 INFO:tasks.workunit.client.0.smithi155.stdout:2/908: dread d0/f3d [0,4194304] 0 2023-12-16T05:56:42.842 INFO:tasks.workunit.client.0.smithi155.stdout:2/909: readlink d0/d7/d69/d77/l94 0 2023-12-16T05:56:42.842 INFO:tasks.workunit.client.1.smithi156.stdout:4/654: dwrite d9/f24 [4194304,4194304] 0 2023-12-16T05:56:42.844 INFO:tasks.workunit.client.0.smithi155.stdout:2/910: unlink d0/d5/fdc 0 2023-12-16T05:56:42.845 INFO:tasks.workunit.client.1.smithi156.stdout:4/655: unlink d9/d43/l4e 0 2023-12-16T05:56:42.845 INFO:tasks.workunit.client.1.smithi156.stdout:4/656: chown d9/d2c/d48/c5d 20051 1 2023-12-16T05:56:42.845 INFO:tasks.workunit.client.0.smithi155.stdout:3/725: dwrite d0/f11 [0,4194304] 0 2023-12-16T05:56:42.846 INFO:tasks.workunit.client.0.smithi155.stdout:3/726: chown d0/d14/d36/d47/ld3 1797 1 2023-12-16T05:56:42.846 INFO:tasks.workunit.client.0.smithi155.stdout:3/727: read - d0/d14/d36/d47/fdd zero size 2023-12-16T05:56:42.846 INFO:tasks.workunit.client.0.smithi155.stdout:3/728: fsync d0/d14/fb8 0 2023-12-16T05:56:42.846 INFO:tasks.workunit.client.0.smithi155.stdout:3/729: chown d0/d14/d9d/la5 273224193 1 2023-12-16T05:56:42.846 INFO:tasks.workunit.client.1.smithi156.stdout:4/657: rename d9/d2b/d35/f86 to d9/d2c/dbf/dcf/fde 0 2023-12-16T05:56:42.846 INFO:tasks.workunit.client.0.smithi155.stdout:2/911: getdents d0/d7/d128 0 2023-12-16T05:56:42.847 INFO:tasks.workunit.client.0.smithi155.stdout:3/730: symlink d0/d14/le3 0 2023-12-16T05:56:42.848 INFO:tasks.workunit.client.0.smithi155.stdout:2/912: creat d0/d7/dd/d14/f13d x:0 0 0 2023-12-16T05:56:42.849 INFO:tasks.workunit.client.0.smithi155.stdout:2/913: dread d0/f1a [0,4194304] 0 2023-12-16T05:56:42.850 INFO:tasks.workunit.client.0.smithi155.stdout:3/731: write d0/d14/d45/f54 [1072252,112472] 0 2023-12-16T05:56:42.851 INFO:tasks.workunit.client.0.smithi155.stdout:3/732: read d0/d1e/f68 [872834,50980] 0 2023-12-16T05:56:42.852 INFO:tasks.workunit.client.0.smithi155.stdout:3/733: creat d0/d1e/d4e/d81/fe4 x:0 0 0 2023-12-16T05:56:42.853 INFO:tasks.workunit.client.0.smithi155.stdout:3/734: fdatasync d0/d1e/d4e/db6/fdc 0 2023-12-16T05:56:42.853 INFO:tasks.workunit.client.0.smithi155.stdout:3/735: creat d0/d1e/d4e/db6/fe5 x:0 0 0 2023-12-16T05:56:42.861 INFO:tasks.workunit.client.1.smithi156.stdout:4/658: dread d9/f70 [0,4194304] 0 2023-12-16T05:56:42.867 INFO:tasks.workunit.client.0.smithi155.stdout:2/914: dread d0/d7/f7e [0,4194304] 0 2023-12-16T05:56:42.868 INFO:tasks.workunit.client.0.smithi155.stdout:2/915: creat d0/d7/d1f/d74/d3a/f13e x:0 0 0 2023-12-16T05:56:42.879 INFO:tasks.workunit.client.1.smithi156.stdout:0/803: dwrite d2/d7/dd/d29/d38/d51/d52/d88/fea [0,4194304] 0 2023-12-16T05:56:42.879 INFO:tasks.workunit.client.1.smithi156.stdout:0/804: chown d2/d7/dd/d29/ff4 46558 1 2023-12-16T05:56:42.881 INFO:tasks.workunit.client.1.smithi156.stdout:0/805: truncate d2/d7/dd/d29/d38/d51/d52/d88/f8e 4165362 0 2023-12-16T05:56:42.882 INFO:tasks.workunit.client.1.smithi156.stdout:0/806: mknod d2/d7/dd/d2d/d5e/d8f/dc9/cfd 0 2023-12-16T05:56:42.882 INFO:tasks.workunit.client.1.smithi156.stdout:0/807: write d2/ff [75742,76802] 0 2023-12-16T05:56:42.884 INFO:tasks.workunit.client.1.smithi156.stdout:0/808: rename d2/d7/dd/d29/d38/d51/d65/d7e/fbd to d2/d7/dd/ded/ffe 0 2023-12-16T05:56:42.886 INFO:tasks.workunit.client.1.smithi156.stdout:6/750: dwrite d9/f93 [0,4194304] 0 2023-12-16T05:56:42.887 INFO:tasks.workunit.client.0.smithi155.stdout:3/736: dwrite d0/d1a/d33/f9e [0,4194304] 0 2023-12-16T05:56:42.888 INFO:tasks.workunit.client.0.smithi155.stdout:7/849: sync 2023-12-16T05:56:42.888 INFO:tasks.workunit.client.0.smithi155.stdout:5/959: sync 2023-12-16T05:56:42.888 INFO:tasks.workunit.client.1.smithi156.stdout:6/751: creat d9/d13/d2f/d51/d69/d99/fec x:0 0 0 2023-12-16T05:56:42.889 INFO:tasks.workunit.client.0.smithi155.stdout:3/737: mkdir d0/d1a/da3/de6 0 2023-12-16T05:56:42.889 INFO:tasks.workunit.client.0.smithi155.stdout:3/738: fsync d0/f10 0 2023-12-16T05:56:42.889 INFO:tasks.workunit.client.0.smithi155.stdout:3/739: rename d0/d14 to d0/d14/d87/d94/da1/d73/de7 22 2023-12-16T05:56:42.889 INFO:tasks.workunit.client.0.smithi155.stdout:3/740: fsync d0/f10 0 2023-12-16T05:56:42.890 INFO:tasks.workunit.client.1.smithi156.stdout:4/659: dwrite d9/d2c/d48/f84 [0,4194304] 0 2023-12-16T05:56:42.890 INFO:tasks.workunit.client.0.smithi155.stdout:7/850: write d0/d6a/d1a/d8c/f7c [3390009,107220] 0 2023-12-16T05:56:42.891 INFO:tasks.workunit.client.0.smithi155.stdout:2/916: dwrite d0/d7/dd/d49/fb3 [0,4194304] 0 2023-12-16T05:56:42.891 INFO:tasks.workunit.client.1.smithi156.stdout:6/752: mknod d9/d13/d2f/d51/ced 0 2023-12-16T05:56:42.891 INFO:tasks.workunit.client.1.smithi156.stdout:4/660: write d9/f1e [3293524,51671] 0 2023-12-16T05:56:42.891 INFO:tasks.workunit.client.1.smithi156.stdout:4/661: readlink d9/d2c/lad 0 2023-12-16T05:56:42.892 INFO:tasks.workunit.client.0.smithi155.stdout:3/741: link d0/d1a/d33/d57/dba/ld0 d0/d1e/le8 0 2023-12-16T05:56:42.892 INFO:tasks.workunit.client.0.smithi155.stdout:7/851: symlink d0/d6a/d1a/d2b/d65/l117 0 2023-12-16T05:56:42.893 INFO:tasks.workunit.client.1.smithi156.stdout:6/753: symlink d9/d13/d2f/d51/d9b/lee 0 2023-12-16T05:56:42.893 INFO:tasks.workunit.client.1.smithi156.stdout:6/754: readlink d9/d1c/l33 0 2023-12-16T05:56:42.893 INFO:tasks.workunit.client.1.smithi156.stdout:6/755: write d9/d13/d3e/d5f/f7f [1639033,35648] 0 2023-12-16T05:56:42.894 INFO:tasks.workunit.client.0.smithi155.stdout:3/742: creat d0/d14/d45/dcd/fe9 x:0 0 0 2023-12-16T05:56:42.894 INFO:tasks.workunit.client.0.smithi155.stdout:3/743: fdatasync d0/d1e/f20 0 2023-12-16T05:56:42.894 INFO:tasks.workunit.client.0.smithi155.stdout:7/852: symlink d0/d6a/d1a/d2b/d65/db8/l118 0 2023-12-16T05:56:42.894 INFO:tasks.workunit.client.0.smithi155.stdout:7/853: dread - d0/d6a/d1a/d2b/fd3 zero size 2023-12-16T05:56:42.895 INFO:tasks.workunit.client.0.smithi155.stdout:5/960: dread d0/d2/d2a/d19/f38 [0,4194304] 0 2023-12-16T05:56:42.895 INFO:tasks.workunit.client.0.smithi155.stdout:5/961: getdents d0/d2/d2a/d19/d71/d11e 0 2023-12-16T05:56:42.896 INFO:tasks.workunit.client.0.smithi155.stdout:3/744: unlink d0/d14/f5e 0 2023-12-16T05:56:42.896 INFO:tasks.workunit.client.1.smithi156.stdout:6/756: creat d9/d1c/d50/dd9/fef x:0 0 0 2023-12-16T05:56:42.898 INFO:tasks.workunit.client.1.smithi156.stdout:0/809: dwrite d2/d23/f32 [0,4194304] 0 2023-12-16T05:56:42.898 INFO:tasks.workunit.client.0.smithi155.stdout:7/854: mknod d0/d6a/d1a/d8c/d42/d98/c119 0 2023-12-16T05:56:42.898 INFO:tasks.workunit.client.1.smithi156.stdout:6/757: dread d9/d13/d2f/d36/f79 [0,4194304] 0 2023-12-16T05:56:42.903 INFO:tasks.workunit.client.0.smithi155.stdout:5/962: rmdir d0 39 2023-12-16T05:56:42.904 INFO:tasks.workunit.client.1.smithi156.stdout:1/601: sync 2023-12-16T05:56:42.905 INFO:tasks.workunit.client.1.smithi156.stdout:8/547: sync 2023-12-16T05:56:42.905 INFO:tasks.workunit.client.1.smithi156.stdout:8/548: fsync d3/d7a/d7d/dae/f1b 0 2023-12-16T05:56:42.905 INFO:tasks.workunit.client.1.smithi156.stdout:8/549: truncate d3/d7/d27/f32 4966844 0 2023-12-16T05:56:42.905 INFO:tasks.workunit.client.1.smithi156.stdout:8/550: write d3/d12/d16/d54/f99 [746040,54372] 0 2023-12-16T05:56:42.905 INFO:tasks.workunit.client.0.smithi155.stdout:3/745: creat d0/d14/d36/d83/d95/fea x:0 0 0 2023-12-16T05:56:42.906 INFO:tasks.workunit.client.0.smithi155.stdout:5/963: creat d0/d60/f136 x:0 0 0 2023-12-16T05:56:42.906 INFO:tasks.workunit.client.1.smithi156.stdout:1/602: mkdir d3/d17/d4d/dc2/d4f/dca 0 2023-12-16T05:56:42.906 INFO:tasks.workunit.client.1.smithi156.stdout:1/603: fdatasync d3/d17/d1c/fa0 0 2023-12-16T05:56:42.907 INFO:tasks.workunit.client.1.smithi156.stdout:8/551: mknod d3/d12/d16/d54/cba 0 2023-12-16T05:56:42.907 INFO:tasks.workunit.client.0.smithi155.stdout:5/964: unlink d0/d2/f5 0 2023-12-16T05:56:42.907 INFO:tasks.workunit.client.0.smithi155.stdout:5/965: stat d0/d2/d2a/d30/d53/d7b/d99/f6c 0 2023-12-16T05:56:42.908 INFO:tasks.workunit.client.1.smithi156.stdout:0/810: dread d2/d7/dd/d29/d2e/f57 [0,4194304] 0 2023-12-16T05:56:42.908 INFO:tasks.workunit.client.1.smithi156.stdout:0/811: readlink d2/d7/dd/d2d/d5e/d8f/dc9/lcd 0 2023-12-16T05:56:42.908 INFO:tasks.workunit.client.1.smithi156.stdout:1/604: unlink d3/d1b/f25 0 2023-12-16T05:56:42.910 INFO:tasks.workunit.client.1.smithi156.stdout:0/812: link d2/d7/dd/d2d/d5e/d8f/dc9/lcd d2/d7/dd/d29/lff 0 2023-12-16T05:56:42.911 INFO:tasks.workunit.client.1.smithi156.stdout:1/605: symlink d3/d17/lcb 0 2023-12-16T05:56:42.913 INFO:tasks.workunit.client.1.smithi156.stdout:1/606: mknod d3/d17/d1c/d22/d57/dbc/ccc 0 2023-12-16T05:56:42.916 INFO:tasks.workunit.client.1.smithi156.stdout:1/607: mknod d3/d17/d4d/dc2/d4f/dca/ccd 0 2023-12-16T05:56:42.921 INFO:tasks.workunit.client.0.smithi155.stdout:2/917: dwrite d0/d7/dd/d62/d66/f6a [0,4194304] 0 2023-12-16T05:56:42.921 INFO:tasks.workunit.client.0.smithi155.stdout:2/918: chown d0/d7/d1f/f97 604951 1 2023-12-16T05:56:42.921 INFO:tasks.workunit.client.0.smithi155.stdout:2/919: symlink d0/d7/dd/d49/d4b/l13f 0 2023-12-16T05:56:42.921 INFO:tasks.workunit.client.0.smithi155.stdout:2/920: readlink d0/d7/d57/d63/l6d 0 2023-12-16T05:56:42.921 INFO:tasks.workunit.client.0.smithi155.stdout:2/921: truncate d0/d7/f5e 1124082 0 2023-12-16T05:56:42.922 INFO:tasks.workunit.client.0.smithi155.stdout:2/922: chown d0/d7/d69/d77/l94 2 1 2023-12-16T05:56:42.923 INFO:tasks.workunit.client.1.smithi156.stdout:1/608: mknod d3/d17/d4d/dc2/d4f/dca/cce 0 2023-12-16T05:56:42.923 INFO:tasks.workunit.client.1.smithi156.stdout:4/662: dwrite f4 [0,4194304] 0 2023-12-16T05:56:42.923 INFO:tasks.workunit.client.0.smithi155.stdout:2/923: rename d0/d7/dd/d49/fb3 to d0/d7/dd/d62/d66/dbc/f140 0 2023-12-16T05:56:42.924 INFO:tasks.workunit.client.0.smithi155.stdout:2/924: unlink d0/d7/dd/d62/d66/dbc/f12a 0 2023-12-16T05:56:42.926 INFO:tasks.workunit.client.1.smithi156.stdout:8/552: write d3/d7a/f81 [4500284,61119] 0 2023-12-16T05:56:42.930 INFO:tasks.workunit.client.1.smithi156.stdout:4/663: rename d9/d2b/cd7 to d9/d2c/d7a/dd4/cdf 0 2023-12-16T05:56:42.931 INFO:tasks.workunit.client.1.smithi156.stdout:8/553: rename d3/f5e to d3/d7/d27/d46/d6e/d3b/d77/fbb 0 2023-12-16T05:56:42.932 INFO:tasks.workunit.client.1.smithi156.stdout:4/664: creat d9/d2b/fe0 x:0 0 0 2023-12-16T05:56:42.935 INFO:tasks.workunit.client.1.smithi156.stdout:4/665: rename d9/d43/d58/f5c to d9/d2c/d48/fe1 0 2023-12-16T05:56:42.935 INFO:tasks.workunit.client.1.smithi156.stdout:4/666: chown d9/d2c/d7a/l87 2034 1 2023-12-16T05:56:42.935 INFO:tasks.workunit.client.1.smithi156.stdout:8/554: write d3/d7a/d7d/dae/f41 [1724294,117007] 0 2023-12-16T05:56:42.936 INFO:tasks.workunit.client.1.smithi156.stdout:8/555: dread d3/d12/d16/f73 [0,4194304] 0 2023-12-16T05:56:42.936 INFO:tasks.workunit.client.0.smithi155.stdout:7/855: dwrite d0/d6a/f8d [0,4194304] 0 2023-12-16T05:56:42.937 INFO:tasks.workunit.client.1.smithi156.stdout:4/667: unlink d9/d2b/d35/la6 0 2023-12-16T05:56:42.940 INFO:tasks.workunit.client.0.smithi155.stdout:7/856: read d0/d6a/d1a/d8c/d34/d4b/d64/d6f/dba/dc9/fe1 [103799,33803] 0 2023-12-16T05:56:42.940 INFO:tasks.workunit.client.1.smithi156.stdout:8/556: creat d3/d7a/d7d/dae/fbc x:0 0 0 2023-12-16T05:56:42.940 INFO:tasks.workunit.client.1.smithi156.stdout:8/557: chown d3/d7/d27/f32 2771 1 2023-12-16T05:56:42.941 INFO:tasks.workunit.client.1.smithi156.stdout:1/609: dread d3/d17/d1c/d22/d57/d61/dc1/f20 [0,4194304] 0 2023-12-16T05:56:42.941 INFO:tasks.workunit.client.1.smithi156.stdout:8/558: getdents d3/d7/d27/d46/d84 0 2023-12-16T05:56:42.941 INFO:tasks.workunit.client.0.smithi155.stdout:7/857: truncate d0/f35 1421210 0 2023-12-16T05:56:42.941 INFO:tasks.workunit.client.0.smithi155.stdout:7/858: rmdir d0/d6a/d1a/d22/dc8 39 2023-12-16T05:56:42.943 INFO:tasks.workunit.client.0.smithi155.stdout:7/859: write d0/d6a/d1a/d38/f41 [7925509,77451] 0 2023-12-16T05:56:42.945 INFO:tasks.workunit.client.0.smithi155.stdout:7/860: rmdir d0/d1b/d106 0 2023-12-16T05:56:42.950 INFO:tasks.workunit.client.1.smithi156.stdout:3/647: sync 2023-12-16T05:56:42.950 INFO:tasks.workunit.client.1.smithi156.stdout:2/725: sync 2023-12-16T05:56:42.951 INFO:tasks.workunit.client.1.smithi156.stdout:7/928: sync 2023-12-16T05:56:42.951 INFO:tasks.workunit.client.1.smithi156.stdout:5/911: sync 2023-12-16T05:56:42.951 INFO:tasks.workunit.client.1.smithi156.stdout:2/726: truncate d9/d12/f45 1366914 0 2023-12-16T05:56:42.951 INFO:tasks.workunit.client.1.smithi156.stdout:9/719: sync 2023-12-16T05:56:42.951 INFO:tasks.workunit.client.1.smithi156.stdout:9/720: write d6/d2e/d8a/da5/fb1 [4979198,63732] 0 2023-12-16T05:56:42.951 INFO:tasks.workunit.client.1.smithi156.stdout:9/721: write d6/d19/d25/d3a/d80/dc0/fe6 [453440,37169] 0 2023-12-16T05:56:42.953 INFO:tasks.workunit.client.1.smithi156.stdout:3/648: mknod dc/df/d34/d62/d75/ceb 0 2023-12-16T05:56:42.954 INFO:tasks.workunit.client.1.smithi156.stdout:6/758: dwrite d9/d13/d3e/d5f/f7f [0,4194304] 0 2023-12-16T05:56:42.954 INFO:tasks.workunit.client.0.smithi155.stdout:5/966: dwrite d0/d2/d2a/d30/d53/f124 [4194304,4194304] 0 2023-12-16T05:56:42.956 INFO:tasks.workunit.client.1.smithi156.stdout:5/912: mkdir da/dc/d4b/d123/d130 0 2023-12-16T05:56:42.956 INFO:tasks.workunit.client.1.smithi156.stdout:5/913: read - da/d46/f12d zero size 2023-12-16T05:56:42.956 INFO:tasks.workunit.client.1.smithi156.stdout:2/727: creat d9/dd/d17/d33/d78/d74/fe6 x:0 0 0 2023-12-16T05:56:42.956 INFO:tasks.workunit.client.0.smithi155.stdout:5/967: creat d0/d2/d2a/d19/dd7/f137 x:0 0 0 2023-12-16T05:56:42.957 INFO:tasks.workunit.client.0.smithi155.stdout:5/968: mknod d0/d2/d2a/d19/d21/d56/c138 0 2023-12-16T05:56:42.957 INFO:tasks.workunit.client.0.smithi155.stdout:5/969: chown d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/dd9/fe5 1145357 1 2023-12-16T05:56:42.958 INFO:tasks.workunit.client.1.smithi156.stdout:9/722: unlink d6/d19/d30/d48/d87/d65/l83 0 2023-12-16T05:56:42.958 INFO:tasks.workunit.client.1.smithi156.stdout:9/723: readlink d6/d19/d30/l62 0 2023-12-16T05:56:42.958 INFO:tasks.workunit.client.1.smithi156.stdout:9/724: write d6/d2e/f7a [4422472,123974] 0 2023-12-16T05:56:42.958 INFO:tasks.workunit.client.1.smithi156.stdout:9/725: dread - d6/d19/d30/d48/d87/fc7 zero size 2023-12-16T05:56:42.958 INFO:tasks.workunit.client.0.smithi155.stdout:5/970: mkdir d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/d139 0 2023-12-16T05:56:42.959 INFO:tasks.workunit.client.1.smithi156.stdout:3/649: mknod dc/d10/d3d/d4e/cec 0 2023-12-16T05:56:42.959 INFO:tasks.workunit.client.1.smithi156.stdout:3/650: readlink dc/df/l16 0 2023-12-16T05:56:42.959 INFO:tasks.workunit.client.1.smithi156.stdout:0/813: dwrite d2/d7/dd/d1c/fe2 [0,4194304] 0 2023-12-16T05:56:42.959 INFO:tasks.workunit.client.0.smithi155.stdout:5/971: write d0/d2/d2a/d19/d88/dd8/ffd [144472,46715] 0 2023-12-16T05:56:42.960 INFO:tasks.workunit.client.0.smithi155.stdout:2/925: dwrite d0/f30 [0,4194304] 0 2023-12-16T05:56:42.961 INFO:tasks.workunit.client.0.smithi155.stdout:2/926: creat d0/d5/f141 x:0 0 0 2023-12-16T05:56:42.962 INFO:tasks.workunit.client.1.smithi156.stdout:6/759: mkdir d9/d13/d2f/d51/d82/d89/d8e/d9a/dce/df0 0 2023-12-16T05:56:42.962 INFO:tasks.workunit.client.1.smithi156.stdout:6/760: readlink d9/lb4 0 2023-12-16T05:56:42.963 INFO:tasks.workunit.client.1.smithi156.stdout:4/668: dwrite d9/d2b/fe0 [0,4194304] 0 2023-12-16T05:56:42.964 INFO:tasks.workunit.client.0.smithi155.stdout:2/927: unlink d0/d7/c68 0 2023-12-16T05:56:42.964 INFO:tasks.workunit.client.1.smithi156.stdout:2/728: rmdir d9/dd/d17/d33/d78/d39/d8c/db2 39 2023-12-16T05:56:42.964 INFO:tasks.workunit.client.1.smithi156.stdout:2/729: dread - d9/d12/fb9 zero size 2023-12-16T05:56:42.964 INFO:tasks.workunit.client.1.smithi156.stdout:5/914: creat da/dc/d2d/d4d/d54/d90/dc3/f131 x:0 0 0 2023-12-16T05:56:42.965 INFO:tasks.workunit.client.0.smithi155.stdout:2/928: write d0/d7/dd/d14/f2d [97694,49598] 0 2023-12-16T05:56:42.965 INFO:tasks.workunit.client.0.smithi155.stdout:2/929: readlink d0/d7/dd/d49/d4b/lf8 0 2023-12-16T05:56:42.965 INFO:tasks.workunit.client.1.smithi156.stdout:9/726: dread d6/d19/d30/f44 [0,4194304] 0 2023-12-16T05:56:42.965 INFO:tasks.workunit.client.1.smithi156.stdout:3/651: mkdir dc/d56/d67/dbe/dc3/ded 0 2023-12-16T05:56:42.965 INFO:tasks.workunit.client.1.smithi156.stdout:3/652: write dc/d10/d1d/db2/fcb [753715,84890] 0 2023-12-16T05:56:42.966 INFO:tasks.workunit.client.1.smithi156.stdout:1/610: dwrite d3/d3a/db1/fc4 [0,4194304] 0 2023-12-16T05:56:42.970 INFO:tasks.workunit.client.1.smithi156.stdout:8/559: dread d3/d12/d16/d54/f99 [0,4194304] 0 2023-12-16T05:56:42.970 INFO:tasks.workunit.client.1.smithi156.stdout:8/560: chown d3/d6/d83 2 1 2023-12-16T05:56:42.974 INFO:tasks.workunit.client.1.smithi156.stdout:4/669: creat d9/d2c/d48/dae/fe2 x:0 0 0 2023-12-16T05:56:42.976 INFO:tasks.workunit.client.1.smithi156.stdout:2/730: symlink d9/dd/d17/d33/d47/d9e/le7 0 2023-12-16T05:56:42.976 INFO:tasks.workunit.client.1.smithi156.stdout:3/653: dread dc/d10/d1d/fa8 [0,4194304] 0 2023-12-16T05:56:42.978 INFO:tasks.workunit.client.1.smithi156.stdout:5/915: creat da/dc/d2d/d4d/d54/f132 x:0 0 0 2023-12-16T05:56:42.983 INFO:tasks.workunit.client.1.smithi156.stdout:1/611: creat d3/d3a/db1/fcf x:0 0 0 2023-12-16T05:56:42.983 INFO:tasks.workunit.client.1.smithi156.stdout:0/814: dwrite d2/d7/dd/d2d/d5e/ff3 [0,4194304] 0 2023-12-16T05:56:42.983 INFO:tasks.workunit.client.1.smithi156.stdout:6/761: dwrite d9/d13/d3e/d5f/f7f [0,4194304] 0 2023-12-16T05:56:42.983 INFO:tasks.workunit.client.1.smithi156.stdout:6/762: write d9/d13/f14 [5756193,53497] 0 2023-12-16T05:56:42.984 INFO:tasks.workunit.client.1.smithi156.stdout:3/654: mknod dc/df/cee 0 2023-12-16T05:56:42.985 INFO:tasks.workunit.client.1.smithi156.stdout:9/727: mknod d6/cf4 0 2023-12-16T05:56:42.986 INFO:tasks.workunit.client.1.smithi156.stdout:9/728: stat d6/d19/d30/d5b/f82 0 2023-12-16T05:56:42.986 INFO:tasks.workunit.client.1.smithi156.stdout:3/655: dread dc/df/d70/fbd [0,4194304] 0 2023-12-16T05:56:42.986 INFO:tasks.workunit.client.1.smithi156.stdout:3/656: truncate dc/d56/d67/fc9 1437530 0 2023-12-16T05:56:42.987 INFO:tasks.workunit.client.1.smithi156.stdout:2/731: dread d9/d12/dc2/dd8/da6/d80/f85 [0,4194304] 0 2023-12-16T05:56:42.987 INFO:tasks.workunit.client.1.smithi156.stdout:2/732: stat d9/dd/d17/d33/f10 0 2023-12-16T05:56:42.989 INFO:tasks.workunit.client.1.smithi156.stdout:2/733: write d9/f1f [1961164,6833] 0 2023-12-16T05:56:42.989 INFO:tasks.workunit.client.1.smithi156.stdout:2/734: write d9/dd/d17/d33/d47/f4d [674581,130860] 0 2023-12-16T05:56:42.992 INFO:tasks.workunit.client.1.smithi156.stdout:4/670: rename d9/d2b/d35/fca to d9/d2b/fe3 0 2023-12-16T05:56:42.994 INFO:tasks.workunit.client.1.smithi156.stdout:4/671: write d9/f18 [3253995,129113] 0 2023-12-16T05:56:42.994 INFO:tasks.workunit.client.1.smithi156.stdout:4/672: chown d9/d43/d58/f76 1477 1 2023-12-16T05:56:42.999 INFO:tasks.workunit.client.1.smithi156.stdout:6/763: mknod d9/d13/d2f/d51/d69/cf1 0 2023-12-16T05:56:43.002 INFO:tasks.workunit.client.1.smithi156.stdout:3/657: symlink dc/d56/d67/dbe/dc3/lef 0 2023-12-16T05:56:43.003 INFO:tasks.workunit.client.1.smithi156.stdout:1/612: mkdir d3/dd0 0 2023-12-16T05:56:43.003 INFO:tasks.workunit.client.1.smithi156.stdout:1/613: dread - d3/f76 zero size 2023-12-16T05:56:43.005 INFO:tasks.workunit.client.1.smithi156.stdout:2/735: creat d9/dd/d17/d33/fe8 x:0 0 0 2023-12-16T05:56:43.008 INFO:tasks.workunit.client.1.smithi156.stdout:5/916: rename da/dc/d4b/d6c/d81/f83 to da/dc/d2d/d4d/db9/dc9/f133 0 2023-12-16T05:56:43.008 INFO:tasks.workunit.client.1.smithi156.stdout:5/917: dread - da/d9a/fac zero size 2023-12-16T05:56:43.009 INFO:tasks.workunit.client.1.smithi156.stdout:4/673: truncate d9/d2c/f2f 3678669 0 2023-12-16T05:56:43.010 INFO:tasks.workunit.client.1.smithi156.stdout:4/674: fdatasync d9/d2c/dbf/fc6 0 2023-12-16T05:56:43.010 INFO:tasks.workunit.client.1.smithi156.stdout:5/918: read da/dc/d4b/d6c/d77/fc2 [1915783,53412] 0 2023-12-16T05:56:43.010 INFO:tasks.workunit.client.1.smithi156.stdout:6/764: creat d9/d13/d2f/d51/d82/d89/d8e/d9a/ff2 x:0 0 0 2023-12-16T05:56:43.010 INFO:tasks.workunit.client.1.smithi156.stdout:6/765: fdatasync d9/d13/d2f/d36/f5a 0 2023-12-16T05:56:43.011 INFO:tasks.workunit.client.1.smithi156.stdout:5/919: write da/f50 [280401,116737] 0 2023-12-16T05:56:43.011 INFO:tasks.workunit.client.1.smithi156.stdout:3/658: creat dc/d10/d3d/ff0 x:0 0 0 2023-12-16T05:56:43.013 INFO:tasks.workunit.client.1.smithi156.stdout:2/736: mknod d9/d68/daa/d83/ce9 0 2023-12-16T05:56:43.015 INFO:tasks.workunit.client.1.smithi156.stdout:6/766: creat d9/d13/d3e/ff3 x:0 0 0 2023-12-16T05:56:43.015 INFO:tasks.workunit.client.1.smithi156.stdout:6/767: write d9/d13/d2f/d51/d82/fc4 [1029967,59494] 0 2023-12-16T05:56:43.015 INFO:tasks.workunit.client.1.smithi156.stdout:6/768: stat d9/d1c/fac 0 2023-12-16T05:56:43.016 INFO:tasks.workunit.client.1.smithi156.stdout:1/614: dread d3/d17/d4d/f9d [0,4194304] 0 2023-12-16T05:56:43.016 INFO:tasks.workunit.client.1.smithi156.stdout:5/920: mknod da/dc/d4b/d123/c134 0 2023-12-16T05:56:43.016 INFO:tasks.workunit.client.1.smithi156.stdout:5/921: fdatasync da/dc/f6b 0 2023-12-16T05:56:43.017 INFO:tasks.workunit.client.1.smithi156.stdout:3/659: mknod dc/d56/d67/dbe/dd9/cf1 0 2023-12-16T05:56:43.018 INFO:tasks.workunit.client.1.smithi156.stdout:4/675: dread d9/d43/d58/d7d/f8b [0,4194304] 0 2023-12-16T05:56:43.019 INFO:tasks.workunit.client.1.smithi156.stdout:9/729: dwrite d6/d2e/f86 [4194304,4194304] 0 2023-12-16T05:56:43.021 INFO:tasks.workunit.client.1.smithi156.stdout:2/737: rename l6 to d9/d68/daa/d83/da1/lea 0 2023-12-16T05:56:43.024 INFO:tasks.workunit.client.1.smithi156.stdout:6/769: symlink d9/d1c/d50/dbf/dca/lf4 0 2023-12-16T05:56:43.026 INFO:tasks.workunit.client.1.smithi156.stdout:1/615: creat d3/d3a/fd1 x:0 0 0 2023-12-16T05:56:43.026 INFO:tasks.workunit.client.1.smithi156.stdout:1/616: truncate d3/d3a/db1/fcf 764039 0 2023-12-16T05:56:43.029 INFO:tasks.workunit.client.1.smithi156.stdout:5/922: getdents da/dc/d10d 0 2023-12-16T05:56:43.029 INFO:tasks.workunit.client.1.smithi156.stdout:5/923: fsync da/dc/d2d/d4d/d54/d67/f105 0 2023-12-16T05:56:43.030 INFO:tasks.workunit.client.1.smithi156.stdout:3/660: symlink dc/d10/db4/lf2 0 2023-12-16T05:56:43.030 INFO:tasks.workunit.client.1.smithi156.stdout:3/661: fdatasync dc/d10/d1d/f5d 0 2023-12-16T05:56:43.031 INFO:tasks.workunit.client.1.smithi156.stdout:3/662: dread - dc/df/d66/fda zero size 2023-12-16T05:56:43.031 INFO:tasks.workunit.client.1.smithi156.stdout:3/663: write dc/d10/f7a [538741,35826] 0 2023-12-16T05:56:43.031 INFO:tasks.workunit.client.1.smithi156.stdout:3/664: write dc/d10/d1d/f32 [187595,130496] 0 2023-12-16T05:56:43.032 INFO:tasks.workunit.client.1.smithi156.stdout:4/676: creat d9/d2b/d9a/fe4 x:0 0 0 2023-12-16T05:56:43.032 INFO:tasks.workunit.client.1.smithi156.stdout:4/677: truncate d9/d2b/d98/d99/fc3 1033065 0 2023-12-16T05:56:43.032 INFO:tasks.workunit.client.1.smithi156.stdout:4/678: chown d9/d2c/f2f 22 1 2023-12-16T05:56:43.033 INFO:tasks.workunit.client.1.smithi156.stdout:9/730: dread d6/d19/d25/f3c [0,4194304] 0 2023-12-16T05:56:43.036 INFO:tasks.workunit.client.1.smithi156.stdout:6/770: getdents d9/d13/d2f 0 2023-12-16T05:56:43.037 INFO:tasks.workunit.client.1.smithi156.stdout:2/738: dwrite d9/d12/dc2/dd8/dad/fc3 [0,4194304] 0 2023-12-16T05:56:43.037 INFO:tasks.workunit.client.1.smithi156.stdout:3/665: truncate dc/d10/d3d/f38 2070945 0 2023-12-16T05:56:43.039 INFO:tasks.workunit.client.1.smithi156.stdout:2/739: dread d9/d12/f45 [0,4194304] 0 2023-12-16T05:56:43.042 INFO:tasks.workunit.client.1.smithi156.stdout:4/679: rename d9/d2c/d48/f67 to d9/d2b/d98/fe5 0 2023-12-16T05:56:43.043 INFO:tasks.workunit.client.1.smithi156.stdout:9/731: symlink d6/d19/d25/d3a/d88/d8b/dac/dc9/lf5 0 2023-12-16T05:56:43.045 INFO:tasks.workunit.client.1.smithi156.stdout:5/924: mkdir da/dc/d4b/d6c/d135 0 2023-12-16T05:56:43.045 INFO:tasks.workunit.client.1.smithi156.stdout:5/925: dread - da/dc/d4b/d6c/d77/d8f/fe8 zero size 2023-12-16T05:56:43.048 INFO:tasks.workunit.client.1.smithi156.stdout:1/617: dwrite d3/d3a/da9/fc0 [0,4194304] 0 2023-12-16T05:56:43.055 INFO:tasks.workunit.client.1.smithi156.stdout:2/740: unlink d9/d68/f75 0 2023-12-16T05:56:43.055 INFO:tasks.workunit.client.1.smithi156.stdout:2/741: write d9/d12/dc2/fe2 [858020,50414] 0 2023-12-16T05:56:43.057 INFO:tasks.workunit.client.1.smithi156.stdout:9/732: creat d6/ff6 x:0 0 0 2023-12-16T05:56:43.058 INFO:tasks.workunit.client.1.smithi156.stdout:6/771: dread d9/d13/d2f/d36/f65 [4194304,4194304] 0 2023-12-16T05:56:43.059 INFO:tasks.workunit.client.1.smithi156.stdout:6/772: chown d9/d13/c80 108642 1 2023-12-16T05:56:43.062 INFO:tasks.workunit.client.1.smithi156.stdout:6/773: read f5 [2700402,98410] 0 2023-12-16T05:56:43.062 INFO:tasks.workunit.client.1.smithi156.stdout:3/666: rename dc/d10/d1d/d4b/l5c to dc/d56/d67/dbe/lf3 0 2023-12-16T05:56:43.062 INFO:tasks.workunit.client.1.smithi156.stdout:3/667: fsync dc/d10/f82 0 2023-12-16T05:56:43.062 INFO:tasks.workunit.client.1.smithi156.stdout:3/668: fdatasync dc/d10/d3d/f38 0 2023-12-16T05:56:43.063 INFO:tasks.workunit.client.1.smithi156.stdout:2/742: write d9/dd/d17/d33/d78/f70 [1053253,109663] 0 2023-12-16T05:56:43.064 INFO:tasks.workunit.client.1.smithi156.stdout:2/743: chown d9/dd/d17/d33/d78/fa4 8 1 2023-12-16T05:56:43.064 INFO:tasks.workunit.client.1.smithi156.stdout:4/680: dread d9/f15 [0,4194304] 0 2023-12-16T05:56:43.064 INFO:tasks.workunit.client.1.smithi156.stdout:4/681: chown d9/d43/fb4 119 1 2023-12-16T05:56:43.064 INFO:tasks.workunit.client.1.smithi156.stdout:5/926: dwrite da/dc/d2d/d4d/d54/fd5 [0,4194304] 0 2023-12-16T05:56:43.068 INFO:tasks.workunit.client.1.smithi156.stdout:6/774: write d9/f85 [1812652,68572] 0 2023-12-16T05:56:43.068 INFO:tasks.workunit.client.1.smithi156.stdout:9/733: unlink d6/d19/d30/d5b/cda 0 2023-12-16T05:56:43.069 INFO:tasks.workunit.client.1.smithi156.stdout:3/669: link dc/d10/f18 dc/d56/d69/ff4 0 2023-12-16T05:56:43.069 INFO:tasks.workunit.client.1.smithi156.stdout:3/670: dread - dc/d10/fe8 zero size 2023-12-16T05:56:43.069 INFO:tasks.workunit.client.1.smithi156.stdout:3/671: truncate dc/d10/d1d/d4b/fb6 565905 0 2023-12-16T05:56:43.073 INFO:tasks.workunit.client.1.smithi156.stdout:4/682: unlink d9/d43/d58/d95/cc5 0 2023-12-16T05:56:43.074 INFO:tasks.workunit.client.1.smithi156.stdout:1/618: dwrite d3/d17/d1c/d22/d57/d61/dc1/fa6 [0,4194304] 0 2023-12-16T05:56:43.075 INFO:tasks.workunit.client.1.smithi156.stdout:5/927: getdents da/d9a/dcd/dce 0 2023-12-16T05:56:43.077 INFO:tasks.workunit.client.1.smithi156.stdout:6/775: chown d9/d13/d3e/d5f/d6e/fa3 7 1 2023-12-16T05:56:43.080 INFO:tasks.workunit.client.1.smithi156.stdout:9/734: mkdir d6/d2e/d8a/da5/df7 0 2023-12-16T05:56:43.089 INFO:tasks.workunit.client.1.smithi156.stdout:4/683: creat d9/d43/d58/d7d/d82/fe6 x:0 0 0 2023-12-16T05:56:43.092 INFO:tasks.workunit.client.1.smithi156.stdout:1/619: mkdir d3/d17/d1c/d22/d57/d61/dc1/dbe/dd2 0 2023-12-16T05:56:43.093 INFO:tasks.workunit.client.1.smithi156.stdout:3/672: dwrite dc/d10/d3d/f95 [0,4194304] 0 2023-12-16T05:56:43.097 INFO:tasks.workunit.client.1.smithi156.stdout:5/928: creat da/dc/d4b/d6c/d7c/f136 x:0 0 0 2023-12-16T05:56:43.097 INFO:tasks.workunit.client.1.smithi156.stdout:6/776: mkdir d9/d13/d2f/d51/d9b/df5 0 2023-12-16T05:56:43.098 INFO:tasks.workunit.client.1.smithi156.stdout:4/684: creat d9/d2b/d35/dd3/fe7 x:0 0 0 2023-12-16T05:56:43.098 INFO:tasks.workunit.client.1.smithi156.stdout:4/685: fsync d9/d43/fac 0 2023-12-16T05:56:43.103 INFO:tasks.workunit.client.1.smithi156.stdout:1/620: unlink d3/d17/d4d/f8c 0 2023-12-16T05:56:43.106 INFO:tasks.workunit.client.1.smithi156.stdout:5/929: creat da/dc/d4b/f137 x:0 0 0 2023-12-16T05:56:43.107 INFO:tasks.workunit.client.1.smithi156.stdout:9/735: dwrite d6/d19/d30/fd6 [0,4194304] 0 2023-12-16T05:56:43.107 INFO:tasks.workunit.client.1.smithi156.stdout:9/736: truncate d6/d19/d25/fbf 537250 0 2023-12-16T05:56:43.108 INFO:tasks.workunit.client.1.smithi156.stdout:6/777: symlink d9/d1c/d50/lf6 0 2023-12-16T05:56:43.113 INFO:tasks.workunit.client.1.smithi156.stdout:4/686: truncate d9/d2b/d98/fb3 4169391 0 2023-12-16T05:56:43.113 INFO:tasks.workunit.client.1.smithi156.stdout:3/673: dwrite dc/d10/d3d/ff0 [0,4194304] 0 2023-12-16T05:56:43.113 INFO:tasks.workunit.client.1.smithi156.stdout:1/621: creat d3/d17/d4d/dc2/d4f/fd3 x:0 0 0 2023-12-16T05:56:43.113 INFO:tasks.workunit.client.1.smithi156.stdout:1/622: dread - d3/d1b/f40 zero size 2023-12-16T05:56:43.115 INFO:tasks.workunit.client.1.smithi156.stdout:5/930: creat da/dc/d4b/d6c/d77/d8f/f138 x:0 0 0 2023-12-16T05:56:43.119 INFO:tasks.workunit.client.1.smithi156.stdout:6/778: symlink d9/d13/d2f/d36/lf7 0 2023-12-16T05:56:43.120 INFO:tasks.workunit.client.1.smithi156.stdout:4/687: creat d9/d2b/d98/dcd/fe8 x:0 0 0 2023-12-16T05:56:43.121 INFO:tasks.workunit.client.1.smithi156.stdout:6/779: write d9/d13/d2f/d51/d82/fc4 [492094,65562] 0 2023-12-16T05:56:43.125 INFO:tasks.workunit.client.1.smithi156.stdout:3/674: creat dc/df/dce/ff5 x:0 0 0 2023-12-16T05:56:43.128 INFO:tasks.workunit.client.1.smithi156.stdout:1/623: link d3/d17/d1c/d22/d57/d61/dc1/l95 d3/d17/ld4 0 2023-12-16T05:56:43.129 INFO:tasks.workunit.client.0.smithi155.stdout:8/961: sync 2023-12-16T05:56:43.130 INFO:tasks.workunit.client.0.smithi155.stdout:8/962: symlink d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/d11b/l13e 0 2023-12-16T05:56:43.130 INFO:tasks.workunit.client.0.smithi155.stdout:8/963: fdatasync d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d103/ffb 0 2023-12-16T05:56:43.130 INFO:tasks.workunit.client.0.smithi155.stdout:8/964: write d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/f11a [642275,28159] 0 2023-12-16T05:56:43.130 INFO:tasks.workunit.client.0.smithi155.stdout:8/965: chown d4/d62/d66/d78/d88/d1b/d1c 16341 1 2023-12-16T05:56:43.131 INFO:tasks.workunit.client.1.smithi156.stdout:4/688: rename d9/d2b/d98/d99/ld0 to d9/d43/d58/d95/le9 0 2023-12-16T05:56:43.131 INFO:tasks.workunit.client.0.smithi155.stdout:8/966: mkdir d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/d13f 0 2023-12-16T05:56:43.133 INFO:tasks.workunit.client.1.smithi156.stdout:6/780: mkdir d9/d13/d2f/d51/d82/d89/d8e/d9a/dce/df0/df8 0 2023-12-16T05:56:43.133 INFO:tasks.workunit.client.0.smithi155.stdout:8/967: mknod d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/d127/c140 0 2023-12-16T05:56:43.134 INFO:tasks.workunit.client.1.smithi156.stdout:5/931: dwrite da/fe3 [0,4194304] 0 2023-12-16T05:56:43.134 INFO:tasks.workunit.client.1.smithi156.stdout:3/675: symlink dc/d56/d67/d6e/lf6 0 2023-12-16T05:56:43.134 INFO:tasks.workunit.client.1.smithi156.stdout:3/676: fsync dc/df/d34/f68 0 2023-12-16T05:56:43.135 INFO:tasks.workunit.client.1.smithi156.stdout:4/689: mknod d9/d2c/d7a/dc0/cea 0 2023-12-16T05:56:43.138 INFO:tasks.workunit.client.1.smithi156.stdout:6/781: rename f6 to d9/d13/d2f/d51/d82/d89/d8e/d9a/dce/df0/ff9 0 2023-12-16T05:56:43.138 INFO:tasks.workunit.client.1.smithi156.stdout:6/782: chown d9/d1c/d50/fa1 348109112 1 2023-12-16T05:56:43.140 INFO:tasks.workunit.client.1.smithi156.stdout:5/932: creat da/dc/d4b/f139 x:0 0 0 2023-12-16T05:56:43.141 INFO:tasks.workunit.client.1.smithi156.stdout:5/933: write da/dc/d2d/d34/fcf [1271142,78858] 0 2023-12-16T05:56:43.141 INFO:tasks.workunit.client.1.smithi156.stdout:5/934: fsync da/dc/f11 0 2023-12-16T05:56:43.142 INFO:tasks.workunit.client.1.smithi156.stdout:4/690: creat d9/d2c/d7a/dd4/feb x:0 0 0 2023-12-16T05:56:43.142 INFO:tasks.workunit.client.1.smithi156.stdout:4/691: fdatasync d9/d2c/d7a/dd4/feb 0 2023-12-16T05:56:43.142 INFO:tasks.workunit.client.1.smithi156.stdout:7/929: sync 2023-12-16T05:56:43.142 INFO:tasks.workunit.client.1.smithi156.stdout:8/561: sync 2023-12-16T05:56:43.142 INFO:tasks.workunit.client.1.smithi156.stdout:0/815: sync 2023-12-16T05:56:43.144 INFO:tasks.workunit.client.1.smithi156.stdout:6/783: symlink d9/d13/d2f/d51/lfa 0 2023-12-16T05:56:43.146 INFO:tasks.workunit.client.1.smithi156.stdout:5/935: rename da/dc/d2d/d4d/d54/f132 to da/dc/d4b/d6c/d81/dc5/deb/d101/f13a 0 2023-12-16T05:56:43.147 INFO:tasks.workunit.client.1.smithi156.stdout:5/936: write da/d9a/dcd/dce/f111 [35526,18923] 0 2023-12-16T05:56:43.147 INFO:tasks.workunit.client.1.smithi156.stdout:5/937: read - da/dc/d4b/d6c/d77/f12f zero size 2023-12-16T05:56:43.150 INFO:tasks.workunit.client.1.smithi156.stdout:8/562: write d3/d7a/d7d/dae/f1b [2028409,23366] 0 2023-12-16T05:56:43.150 INFO:tasks.workunit.client.1.smithi156.stdout:3/677: dread dc/f14 [4194304,4194304] 0 2023-12-16T05:56:43.150 INFO:tasks.workunit.client.1.smithi156.stdout:3/678: fdatasync dc/d10/d3d/db5/fcf 0 2023-12-16T05:56:43.156 INFO:tasks.workunit.client.1.smithi156.stdout:0/816: read d2/d23/d4a/fa3 [2552178,69087] 0 2023-12-16T05:56:43.157 INFO:tasks.workunit.client.1.smithi156.stdout:6/784: mknod d9/d1c/cfb 0 2023-12-16T05:56:43.157 INFO:tasks.workunit.client.1.smithi156.stdout:4/692: truncate d9/d2c/f2d 176208 0 2023-12-16T05:56:43.157 INFO:tasks.workunit.client.1.smithi156.stdout:4/693: write d9/d2b/d35/dd3/fe7 [176009,11674] 0 2023-12-16T05:56:43.161 INFO:tasks.workunit.client.1.smithi156.stdout:5/938: mkdir da/dc/d2d/d4d/d54/d90/d13b 0 2023-12-16T05:56:43.168 INFO:tasks.workunit.client.1.smithi156.stdout:8/563: creat d3/d7/d66/fbd x:0 0 0 2023-12-16T05:56:43.168 INFO:tasks.workunit.client.1.smithi156.stdout:4/694: dread f4 [0,4194304] 0 2023-12-16T05:56:43.169 INFO:tasks.workunit.client.1.smithi156.stdout:3/679: unlink dc/d10/d3d/f37 0 2023-12-16T05:56:43.172 INFO:tasks.workunit.client.1.smithi156.stdout:0/817: rename d2/d7/dd/d29/d38/d3f to d2/d7/dd/d29/d38/dae/d100 0 2023-12-16T05:56:43.176 INFO:tasks.workunit.client.1.smithi156.stdout:7/930: dwrite d1e/d1f/da6/d57/d59/f121 [4194304,4194304] 0 2023-12-16T05:56:43.176 INFO:tasks.workunit.client.1.smithi156.stdout:7/931: getdents d1e/d55/db6/ddb/d11e 0 2023-12-16T05:56:43.177 INFO:tasks.workunit.client.1.smithi156.stdout:6/785: rmdir d9/d1c/d50/dd9 39 2023-12-16T05:56:43.178 INFO:tasks.workunit.client.0.smithi155.stdout:8/968: dwrite d4/d62/d66/d78/d88/d12/f21 [0,4194304] 0 2023-12-16T05:56:43.180 INFO:tasks.workunit.client.0.smithi155.stdout:8/969: mkdir d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/d13f/d141 0 2023-12-16T05:56:43.180 INFO:tasks.workunit.client.1.smithi156.stdout:8/564: mknod d3/d7a/d7d/cbe 0 2023-12-16T05:56:43.181 INFO:tasks.workunit.client.1.smithi156.stdout:8/565: fsync d3/f5a 0 2023-12-16T05:56:43.182 INFO:tasks.workunit.client.1.smithi156.stdout:4/695: symlink d9/d2c/d48/lec 0 2023-12-16T05:56:43.182 INFO:tasks.workunit.client.0.smithi155.stdout:8/970: creat d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d103/f142 x:0 0 0 2023-12-16T05:56:43.183 INFO:tasks.workunit.client.1.smithi156.stdout:7/932: dread d1e/d1f/f53 [0,4194304] 0 2023-12-16T05:56:43.183 INFO:tasks.workunit.client.1.smithi156.stdout:0/818: creat d2/d7/dd/d29/d38/d51/d65/d7e/f101 x:0 0 0 2023-12-16T05:56:43.184 INFO:tasks.workunit.client.0.smithi155.stdout:8/971: write d4/d62/d66/f10d [322317,110713] 0 2023-12-16T05:56:43.185 INFO:tasks.workunit.client.1.smithi156.stdout:8/566: creat d3/d7/d27/d46/d6e/d3c/fbf x:0 0 0 2023-12-16T05:56:43.186 INFO:tasks.workunit.client.0.smithi155.stdout:8/972: write d4/d62/d66/d78/d88/d12/f2e [1445715,56929] 0 2023-12-16T05:56:43.187 INFO:tasks.workunit.client.1.smithi156.stdout:1/624: dwrite d3/f5 [0,4194304] 0 2023-12-16T05:56:43.187 INFO:tasks.workunit.client.1.smithi156.stdout:4/696: rmdir d9/d2c/dbf 39 2023-12-16T05:56:43.187 INFO:tasks.workunit.client.1.smithi156.stdout:6/786: dread d9/d13/d2f/d51/d6b/d77/d7e/f8c [0,4194304] 0 2023-12-16T05:56:43.188 INFO:tasks.workunit.client.0.smithi155.stdout:8/973: creat d4/d62/d66/f143 x:0 0 0 2023-12-16T05:56:43.188 INFO:tasks.workunit.client.1.smithi156.stdout:4/697: creat d9/d2b/fed x:0 0 0 2023-12-16T05:56:43.188 INFO:tasks.workunit.client.1.smithi156.stdout:4/698: chown d9/d2c/caf 535639939 1 2023-12-16T05:56:43.189 INFO:tasks.workunit.client.0.smithi155.stdout:8/974: truncate d4/d62/fa2 3809318 0 2023-12-16T05:56:43.190 INFO:tasks.workunit.client.1.smithi156.stdout:0/819: dread d2/d7/dd/d1c/fb1 [0,4194304] 0 2023-12-16T05:56:43.190 INFO:tasks.workunit.client.1.smithi156.stdout:5/939: dwrite da/dc/d4b/d6c/d77/fb7 [0,4194304] 0 2023-12-16T05:56:43.190 INFO:tasks.workunit.client.1.smithi156.stdout:5/940: dread - da/dc/f6b zero size 2023-12-16T05:56:43.190 INFO:tasks.workunit.client.1.smithi156.stdout:5/941: fdatasync da/dc/d2d/d4d/d54/d67/f107 0 2023-12-16T05:56:43.190 INFO:tasks.workunit.client.0.smithi155.stdout:8/975: creat d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/d117/f144 x:0 0 0 2023-12-16T05:56:43.191 INFO:tasks.workunit.client.1.smithi156.stdout:0/820: mkdir d2/d7/dd/d2d/d5e/d8f/d102 0 2023-12-16T05:56:43.191 INFO:tasks.workunit.client.1.smithi156.stdout:0/821: chown d2/d7/dd/d29/d38/d51/d65/d7e/la1 2911 1 2023-12-16T05:56:43.193 INFO:tasks.workunit.client.0.smithi155.stdout:8/976: creat d4/d62/d66/d78/d88/d1b/d1c/d19/da3/d11d/f145 x:0 0 0 2023-12-16T05:56:43.193 INFO:tasks.workunit.client.0.smithi155.stdout:8/977: read - d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/f11f zero size 2023-12-16T05:56:43.194 INFO:tasks.workunit.client.1.smithi156.stdout:3/680: dwrite dc/d10/db4/fd7 [0,4194304] 0 2023-12-16T05:56:43.194 INFO:tasks.workunit.client.1.smithi156.stdout:3/681: stat dc/d56/d67/d6e/c88 0 2023-12-16T05:56:43.194 INFO:tasks.workunit.client.1.smithi156.stdout:6/787: write d9/f11 [3300856,28436] 0 2023-12-16T05:56:43.194 INFO:tasks.workunit.client.1.smithi156.stdout:6/788: write d9/fc8 [511139,31068] 0 2023-12-16T05:56:43.198 INFO:tasks.workunit.client.1.smithi156.stdout:1/625: write d3/d17/d1c/d22/d57/d61/dc1/fa6 [2557543,130611] 0 2023-12-16T05:56:43.198 INFO:tasks.workunit.client.1.smithi156.stdout:1/626: write d3/fb4 [2507995,54972] 0 2023-12-16T05:56:43.198 INFO:tasks.workunit.client.1.smithi156.stdout:1/627: fsync d3/f15 0 2023-12-16T05:56:43.201 INFO:tasks.workunit.client.1.smithi156.stdout:0/822: dread d2/d7/dd/f30 [0,4194304] 0 2023-12-16T05:56:43.216 INFO:tasks.workunit.client.1.smithi156.stdout:0/823: rmdir d2/d23/d4a 39 2023-12-16T05:56:43.216 INFO:tasks.workunit.client.1.smithi156.stdout:0/824: fdatasync d2/f86 0 2023-12-16T05:56:43.223 INFO:tasks.workunit.client.1.smithi156.stdout:0/825: dread d2/d7/dd/d29/d38/dae/d100/d44/f45 [0,4194304] 0 2023-12-16T05:56:43.227 INFO:tasks.workunit.client.1.smithi156.stdout:8/567: dwrite d3/d12/f6c [0,4194304] 0 2023-12-16T05:56:43.228 INFO:tasks.workunit.client.1.smithi156.stdout:0/826: rename d2/d7/dd/d29/d4b/d76/f78 to d2/d7/dd/d29/d38/d51/d52/d88/dbc/dd2/f103 0 2023-12-16T05:56:43.229 INFO:tasks.workunit.client.1.smithi156.stdout:0/827: dread d2/d23/f70 [0,4194304] 0 2023-12-16T05:56:43.229 INFO:tasks.workunit.client.1.smithi156.stdout:0/828: truncate d2/d7/dd/d29/d38/d51/d52/d88/f95 338758 0 2023-12-16T05:56:43.229 INFO:tasks.workunit.client.1.smithi156.stdout:0/829: truncate d2/ff 1825760 0 2023-12-16T05:56:43.229 INFO:tasks.workunit.client.1.smithi156.stdout:3/682: getdents dc/d10/d3d 0 2023-12-16T05:56:43.231 INFO:tasks.workunit.client.1.smithi156.stdout:7/933: dwrite d1e/d1f/d22/f13e [0,4194304] 0 2023-12-16T05:56:43.231 INFO:tasks.workunit.client.1.smithi156.stdout:7/934: readlink d1e/d1f/da6/l8a 0 2023-12-16T05:56:43.231 INFO:tasks.workunit.client.1.smithi156.stdout:0/830: creat d2/d7/dd/d2d/f104 x:0 0 0 2023-12-16T05:56:43.232 INFO:tasks.workunit.client.1.smithi156.stdout:6/789: dwrite d9/d13/d2f/d51/d82/d89/f92 [0,4194304] 0 2023-12-16T05:56:43.232 INFO:tasks.workunit.client.1.smithi156.stdout:6/790: fdatasync d9/d13/d3e/d5f/f7f 0 2023-12-16T05:56:43.232 INFO:tasks.workunit.client.1.smithi156.stdout:6/791: stat d9/d13/d2f/c4f 0 2023-12-16T05:56:43.232 INFO:tasks.workunit.client.1.smithi156.stdout:4/699: dwrite d9/d2b/d98/dcd/fe8 [0,4194304] 0 2023-12-16T05:56:43.233 INFO:tasks.workunit.client.0.smithi155.stdout:8/978: dwrite d4/d62/d66/d78/d88/d1b/d2a/d51/f6e [0,4194304] 0 2023-12-16T05:56:43.234 INFO:tasks.workunit.client.1.smithi156.stdout:8/568: write d3/d7/d27/f32 [2924397,118096] 0 2023-12-16T05:56:43.234 INFO:tasks.workunit.client.1.smithi156.stdout:8/569: fdatasync d3/d12/f70 0 2023-12-16T05:56:43.234 INFO:tasks.workunit.client.1.smithi156.stdout:8/570: chown d3/d12/d16/d54/cba 7694434 1 2023-12-16T05:56:43.235 INFO:tasks.workunit.client.1.smithi156.stdout:3/683: dread dc/d10/d1d/fa8 [0,4194304] 0 2023-12-16T05:56:43.235 INFO:tasks.workunit.client.1.smithi156.stdout:3/684: stat dc/d10/d1d/f42 0 2023-12-16T05:56:43.235 INFO:tasks.workunit.client.1.smithi156.stdout:1/628: dwrite d3/faf [0,4194304] 0 2023-12-16T05:56:43.235 INFO:tasks.workunit.client.0.smithi155.stdout:8/979: creat d4/d62/d66/d78/d88/d1b/d1c/d97/df3/d10e/f146 x:0 0 0 2023-12-16T05:56:43.238 INFO:tasks.workunit.client.0.smithi155.stdout:8/980: write d4/d62/d66/d78/d88/d12/f21 [909109,26211] 0 2023-12-16T05:56:43.238 INFO:tasks.workunit.client.1.smithi156.stdout:7/935: creat d1e/f13f x:0 0 0 2023-12-16T05:56:43.239 INFO:tasks.workunit.client.1.smithi156.stdout:7/936: truncate d1e/d1f/d22/d75/fa9 98747 0 2023-12-16T05:56:43.239 INFO:tasks.workunit.client.1.smithi156.stdout:7/937: chown d1e/d55/d71/d61/l46 7121 1 2023-12-16T05:56:43.239 INFO:tasks.workunit.client.1.smithi156.stdout:0/831: rmdir d2/d7/dd/d66 39 2023-12-16T05:56:43.245 INFO:tasks.workunit.client.1.smithi156.stdout:4/700: creat d9/d2b/d35/fee x:0 0 0 2023-12-16T05:56:43.245 INFO:tasks.workunit.client.1.smithi156.stdout:4/701: fsync d9/d2c/f3e 0 2023-12-16T05:56:43.245 INFO:tasks.workunit.client.1.smithi156.stdout:4/702: chown d9/l1d 168 1 2023-12-16T05:56:43.247 INFO:tasks.workunit.client.1.smithi156.stdout:8/571: mknod d3/d7/d27/d46/cc0 0 2023-12-16T05:56:43.252 INFO:tasks.workunit.client.0.smithi155.stdout:8/981: dread d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/fb3 [0,4194304] 0 2023-12-16T05:56:43.261 INFO:tasks.workunit.client.1.smithi156.stdout:0/832: dread d2/d7/dd/f5b [0,4194304] 0 2023-12-16T05:56:43.262 INFO:tasks.workunit.client.1.smithi156.stdout:7/938: mkdir d1e/d1f/d72/df4/d140 0 2023-12-16T05:56:43.263 INFO:tasks.workunit.client.1.smithi156.stdout:4/703: mknod d9/d2b/d98/dcd/cef 0 2023-12-16T05:56:43.263 INFO:tasks.workunit.client.1.smithi156.stdout:4/704: write d9/d2b/d35/fb5 [869034,31507] 0 2023-12-16T05:56:43.264 INFO:tasks.workunit.client.1.smithi156.stdout:0/833: mknod d2/d7/dd/d29/c105 0 2023-12-16T05:56:43.267 INFO:tasks.workunit.client.1.smithi156.stdout:7/939: link d1e/d55/db6/ddb/fe0 d1e/d1f/da6/d57/dca/f141 0 2023-12-16T05:56:43.267 INFO:tasks.workunit.client.1.smithi156.stdout:7/940: dread - d1e/d55/d71/f13c zero size 2023-12-16T05:56:43.267 INFO:tasks.workunit.client.1.smithi156.stdout:7/941: write d1e/d55/d71/d61/daa/db4/fcb [1008907,122854] 0 2023-12-16T05:56:43.268 INFO:tasks.workunit.client.1.smithi156.stdout:6/792: dwrite d9/d13/d2f/d36/f96 [0,4194304] 0 2023-12-16T05:56:43.268 INFO:tasks.workunit.client.1.smithi156.stdout:6/793: fdatasync d9/d13/d2f/d36/f55 0 2023-12-16T05:56:43.268 INFO:tasks.workunit.client.1.smithi156.stdout:4/705: mkdir d9/d2c/d7a/dd4/df0 0 2023-12-16T05:56:43.270 INFO:tasks.workunit.client.1.smithi156.stdout:0/834: truncate d2/d7/dd/d29/d38/f91 53175 0 2023-12-16T05:56:43.270 INFO:tasks.workunit.client.1.smithi156.stdout:7/942: rmdir d1e/d1f/d72/df4 39 2023-12-16T05:56:43.273 INFO:tasks.workunit.client.1.smithi156.stdout:6/794: link d9/d13/d2f/d51/dad/leb d9/d13/d2f/d51/d69/lfc 0 2023-12-16T05:56:43.273 INFO:tasks.workunit.client.1.smithi156.stdout:6/795: truncate d9/fdc 971183 0 2023-12-16T05:56:43.275 INFO:tasks.workunit.client.1.smithi156.stdout:7/943: link c16 d1e/d1f/da6/d57/dca/c142 0 2023-12-16T05:56:43.277 INFO:tasks.workunit.client.1.smithi156.stdout:6/796: truncate d9/d13/d2f/d51/d6b/d77/d7e/fd2 826716 0 2023-12-16T05:56:43.278 INFO:tasks.workunit.client.1.smithi156.stdout:6/797: mknod d9/d13/d2f/d51/d6b/d77/d7e/cfd 0 2023-12-16T05:56:43.279 INFO:tasks.workunit.client.1.smithi156.stdout:6/798: symlink d9/d13/lfe 0 2023-12-16T05:56:43.280 INFO:tasks.workunit.client.0.smithi155.stdout:8/982: dwrite d4/d62/d66/d78/d88/d1b/d1c/d97/d4f/fe8 [0,4194304] 0 2023-12-16T05:56:43.280 INFO:tasks.workunit.client.1.smithi156.stdout:1/629: dwrite d3/fc [0,4194304] 0 2023-12-16T05:56:43.280 INFO:tasks.workunit.client.1.smithi156.stdout:1/630: chown d3/fb4 7 1 2023-12-16T05:56:43.281 INFO:tasks.workunit.client.0.smithi155.stdout:8/983: symlink d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/l147 0 2023-12-16T05:56:43.282 INFO:tasks.workunit.client.1.smithi156.stdout:3/685: dwrite dc/df/d34/d62/d75/fc5 [0,4194304] 0 2023-12-16T05:56:43.283 INFO:tasks.workunit.client.1.smithi156.stdout:6/799: mkdir d9/d1c/d50/dbf/dca/dff 0 2023-12-16T05:56:43.284 INFO:tasks.workunit.client.0.smithi155.stdout:8/984: unlink d4/d62/d66/d78/d88/d12/c113 0 2023-12-16T05:56:43.285 INFO:tasks.workunit.client.0.smithi155.stdout:8/985: dread d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/fcd [0,4194304] 0 2023-12-16T05:56:43.287 INFO:tasks.workunit.client.0.smithi155.stdout:8/986: symlink d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d8b/d13f/d141/l148 0 2023-12-16T05:56:43.287 INFO:tasks.workunit.client.1.smithi156.stdout:8/572: dwrite d3/d7a/fa4 [0,4194304] 0 2023-12-16T05:56:43.287 INFO:tasks.workunit.client.0.smithi155.stdout:8/987: mkdir d4/d62/d66/d78/d88/d1b/d1c/d19/da3/d10a/d132/d149 0 2023-12-16T05:56:43.289 INFO:tasks.workunit.client.0.smithi155.stdout:8/988: creat d4/d62/d66/d78/d88/d1b/f14a x:0 0 0 2023-12-16T05:56:43.289 INFO:tasks.workunit.client.0.smithi155.stdout:8/989: fsync d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/fbb 0 2023-12-16T05:56:43.299 INFO:tasks.workunit.client.1.smithi156.stdout:3/686: dread dc/df/d34/f68 [0,4194304] 0 2023-12-16T05:56:43.303 INFO:tasks.workunit.client.1.smithi156.stdout:4/706: dwrite d9/d2b/f31 [0,4194304] 0 2023-12-16T05:56:43.303 INFO:tasks.workunit.client.1.smithi156.stdout:6/800: mknod d9/d13/d2f/d51/d82/d89/d8e/c100 0 2023-12-16T05:56:43.303 INFO:tasks.workunit.client.1.smithi156.stdout:6/801: chown d9/fdc 22598 1 2023-12-16T05:56:43.310 INFO:tasks.workunit.client.1.smithi156.stdout:1/631: truncate d3/f5 1655383 0 2023-12-16T05:56:43.311 INFO:tasks.workunit.client.1.smithi156.stdout:0/835: dwrite d2/d7/dd/d1c/fb1 [0,4194304] 0 2023-12-16T05:56:43.311 INFO:tasks.workunit.client.1.smithi156.stdout:4/707: symlink d9/d2b/d35/lf1 0 2023-12-16T05:56:43.312 INFO:tasks.workunit.client.1.smithi156.stdout:7/944: dwrite d1e/d55/dba/f109 [0,4194304] 0 2023-12-16T05:56:43.312 INFO:tasks.workunit.client.1.smithi156.stdout:7/945: dread - d1e/d1f/da6/d57/d59/f131 zero size 2023-12-16T05:56:43.312 INFO:tasks.workunit.client.1.smithi156.stdout:7/946: dread - d1e/d55/d71/d61/daa/db4/f122 zero size 2023-12-16T05:56:43.313 INFO:tasks.workunit.client.0.smithi155.stdout:8/990: dwrite d4/d62/d66/d78/d88/d1b/d1c/d97/d29/d103/f142 [0,4194304] 0 2023-12-16T05:56:43.313 INFO:tasks.workunit.client.0.smithi155.stdout:8/991: write d4/d62/fbf [763928,104934] 0 2023-12-16T05:56:43.315 INFO:tasks.workunit.client.1.smithi156.stdout:1/632: link d3/d17/d1c/d22/d57/d61/dc1/f2e d3/d17/d4d/dc2/fd5 0 2023-12-16T05:56:43.316 INFO:tasks.workunit.client.1.smithi156.stdout:8/573: dwrite d3/d7/d27/f59 [0,4194304] 0 2023-12-16T05:56:43.317 INFO:tasks.workunit.client.1.smithi156.stdout:4/708: write d9/d2b/f8f [1486701,57996] 0 2023-12-16T05:56:43.317 INFO:tasks.workunit.client.1.smithi156.stdout:4/709: chown d9/d43/d58/d7d/fd9 0 1 2023-12-16T05:56:43.317 INFO:tasks.workunit.client.1.smithi156.stdout:4/710: readlink d9/l1d 0 2023-12-16T05:56:43.317 INFO:tasks.workunit.client.1.smithi156.stdout:4/711: readlink d9/d2c/d48/dae/l6c 0 2023-12-16T05:56:43.319 INFO:tasks.workunit.client.1.smithi156.stdout:3/687: dwrite dc/d10/db4/fd7 [0,4194304] 0 2023-12-16T05:56:43.319 INFO:tasks.workunit.client.1.smithi156.stdout:3/688: write dc/d56/d67/fdc [36910,32103] 0 2023-12-16T05:56:43.321 INFO:tasks.workunit.client.1.smithi156.stdout:0/836: mknod d2/d23/d4a/c106 0 2023-12-16T05:56:43.321 INFO:tasks.workunit.client.1.smithi156.stdout:0/837: chown d2/d7/dd/d29/d4b/dc0/df2/l72 960409214 1 2023-12-16T05:56:43.323 INFO:tasks.workunit.client.1.smithi156.stdout:0/838: write d2/d7/dd/d2d/dcf/f99 [2105452,113216] 0 2023-12-16T05:56:43.323 INFO:tasks.workunit.client.1.smithi156.stdout:0/839: chown d2/d7/dd/d29/d38/dae/d100/d44 796 1 2023-12-16T05:56:43.326 INFO:tasks.workunit.client.1.smithi156.stdout:7/947: creat d1e/d1f/da6/d57/f143 x:0 0 0 2023-12-16T05:56:43.331 INFO:tasks.workunit.client.1.smithi156.stdout:6/802: dwrite d9/d13/d3e/fb5 [0,4194304] 0 2023-12-16T05:56:43.331 INFO:tasks.workunit.client.1.smithi156.stdout:1/633: creat d3/d17/d1c/d22/fd6 x:0 0 0 2023-12-16T05:56:43.331 INFO:tasks.workunit.client.0.smithi155.stdout:8/992: dread d4/d62/d66/d78/d88/d1b/d1c/f54 [0,4194304] 0 2023-12-16T05:56:43.331 INFO:tasks.workunit.client.0.smithi155.stdout:8/993: mknod d4/d62/d66/d78/def/c14b 0 2023-12-16T05:56:43.331 INFO:tasks.workunit.client.0.smithi155.stdout:8/994: symlink d4/d62/d66/d78/d88/d1b/l14c 0 2023-12-16T05:56:43.331 INFO:tasks.workunit.client.0.smithi155.stdout:8/995: chown d4/d62/d66/d78/d88/d1b/d1c/d19/cc5 850003995 1 2023-12-16T05:56:43.332 INFO:tasks.workunit.client.0.smithi155.stdout:4/890: sync 2023-12-16T05:56:43.332 INFO:tasks.workunit.client.0.smithi155.stdout:8/996: rename d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/l13c to d4/d62/d66/d78/def/l14d 0 2023-12-16T05:56:43.336 INFO:tasks.workunit.client.1.smithi156.stdout:0/840: mkdir d2/d7/dd/d2d/d5e/d8f/d102/d107 0 2023-12-16T05:56:43.337 INFO:tasks.workunit.client.1.smithi156.stdout:7/948: mkdir d1e/d55/db6/ddb/d144 0 2023-12-16T05:56:43.337 INFO:tasks.workunit.client.1.smithi156.stdout:3/689: dwrite f8 [0,4194304] 0 2023-12-16T05:56:43.341 INFO:tasks.workunit.client.1.smithi156.stdout:1/634: truncate d3/d17/d4d/dc2/d4f/d75/f72 4119627 0 2023-12-16T05:56:43.345 INFO:tasks.workunit.client.1.smithi156.stdout:7/949: creat d1e/d1f/da6/d10d/f145 x:0 0 0 2023-12-16T05:56:43.346 INFO:tasks.workunit.client.1.smithi156.stdout:0/841: dread d2/d7/dd/d29/d4b/fcb [0,4194304] 0 2023-12-16T05:56:43.346 INFO:tasks.workunit.client.1.smithi156.stdout:0/842: write d2/d7/f18 [9161238,95568] 0 2023-12-16T05:56:43.347 INFO:tasks.workunit.client.1.smithi156.stdout:0/843: write d2/d7/dd/d2d/d5e/dc4/fe0 [1686554,60612] 0 2023-12-16T05:56:43.352 INFO:tasks.workunit.client.1.smithi156.stdout:0/844: dread d2/d23/d4a/fa6 [0,4194304] 0 2023-12-16T05:56:43.353 INFO:tasks.workunit.client.1.smithi156.stdout:3/690: link dc/df/d34/f63 dc/d56/d67/dbe/dc3/de4/ff7 0 2023-12-16T05:56:43.353 INFO:tasks.workunit.client.1.smithi156.stdout:3/691: truncate dc/df/fcd 708578 0 2023-12-16T05:56:43.353 INFO:tasks.workunit.client.1.smithi156.stdout:3/692: chown dc/df/dce 188 1 2023-12-16T05:56:43.354 INFO:tasks.workunit.client.1.smithi156.stdout:1/635: creat d3/d17/fd7 x:0 0 0 2023-12-16T05:56:43.354 INFO:tasks.workunit.client.1.smithi156.stdout:0/845: creat d2/d7/dd/d2d/d5e/dc4/f108 x:0 0 0 2023-12-16T05:56:43.356 INFO:tasks.workunit.client.1.smithi156.stdout:0/846: creat d2/d7/dd/d29/f109 x:0 0 0 2023-12-16T05:56:43.357 INFO:tasks.workunit.client.0.smithi155.stdout:4/891: dwrite d0/da/de0/d16/d30/dce/d75/d50/fba [0,4194304] 0 2023-12-16T05:56:43.362 INFO:tasks.workunit.client.1.smithi156.stdout:0/847: mknod d2/d7/dd/d29/d38/d51/d52/d88/dbc/dc2/c10a 0 2023-12-16T05:56:43.362 INFO:tasks.workunit.client.1.smithi156.stdout:0/848: fsync d2/d7/dd/d29/d2e/f3a 0 2023-12-16T05:56:43.362 INFO:tasks.workunit.client.1.smithi156.stdout:0/849: readlink d2/d7/dd/d29/d38/d51/d52/lf1 0 2023-12-16T05:56:43.370 INFO:tasks.workunit.client.1.smithi156.stdout:6/803: truncate d9/d13/d2f/d36/fbd 3947437 0 2023-12-16T05:56:43.370 INFO:tasks.workunit.client.1.smithi156.stdout:7/950: dwrite d1e/f27 [0,4194304] 0 2023-12-16T05:56:43.370 INFO:tasks.workunit.client.1.smithi156.stdout:6/804: fdatasync d9/d13/f17 0 2023-12-16T05:56:43.372 INFO:tasks.workunit.client.1.smithi156.stdout:3/693: dwrite dc/d56/d67/d6e/fe2 [0,4194304] 0 2023-12-16T05:56:43.373 INFO:tasks.workunit.client.1.smithi156.stdout:6/805: truncate d9/d13/d3e/d5f/f75 2500963 0 2023-12-16T05:56:43.373 INFO:tasks.workunit.client.1.smithi156.stdout:7/951: mknod d1e/d1f/da6/d57/dbb/c146 0 2023-12-16T05:56:43.373 INFO:tasks.workunit.client.1.smithi156.stdout:7/952: fdatasync d1e/d1f/d22/d75/f9f 0 2023-12-16T05:56:43.374 INFO:tasks.workunit.client.1.smithi156.stdout:0/850: dread d2/d7/dd/d29/d38/f68 [0,4194304] 0 2023-12-16T05:56:43.374 INFO:tasks.workunit.client.1.smithi156.stdout:0/851: rename d2/d7/dd to d2/d7/dd/d2d/d10b 22 2023-12-16T05:56:43.374 INFO:tasks.workunit.client.1.smithi156.stdout:3/694: mkdir dc/d10/d3d/df8 0 2023-12-16T05:56:43.375 INFO:tasks.workunit.client.1.smithi156.stdout:6/806: symlink d9/d13/l101 0 2023-12-16T05:56:43.375 INFO:tasks.workunit.client.1.smithi156.stdout:6/807: chown d9/d13/d2f/c4f 27063114 1 2023-12-16T05:56:43.377 INFO:tasks.workunit.client.1.smithi156.stdout:7/953: unlink d1e/d55/dba/fcd 0 2023-12-16T05:56:43.377 INFO:tasks.workunit.client.1.smithi156.stdout:1/636: dwrite d3/d3a/db1/fb2 [0,4194304] 0 2023-12-16T05:56:43.377 INFO:tasks.workunit.client.1.smithi156.stdout:0/852: mkdir d2/d7/da8/d10c 0 2023-12-16T05:56:43.378 INFO:tasks.workunit.client.1.smithi156.stdout:0/853: readlink d2/d7/dd/d2d/d5e/d8f/lda 0 2023-12-16T05:56:43.378 INFO:tasks.workunit.client.1.smithi156.stdout:3/695: mkdir dc/d56/d67/dbe/df9 0 2023-12-16T05:56:43.379 INFO:tasks.workunit.client.1.smithi156.stdout:3/696: readlink dc/d10/d3d/d4e/l6d 0 2023-12-16T05:56:43.379 INFO:tasks.workunit.client.1.smithi156.stdout:6/808: getdents d9/d1c/d50/dd9 0 2023-12-16T05:56:43.380 INFO:tasks.workunit.client.1.smithi156.stdout:6/809: write d9/d13/d2f/d51/d6b/fd3 [566719,108676] 0 2023-12-16T05:56:43.380 INFO:tasks.workunit.client.1.smithi156.stdout:6/810: stat d9/d13/d2f/d51/d6b/fae 0 2023-12-16T05:56:43.381 INFO:tasks.workunit.client.1.smithi156.stdout:0/854: write d2/d7/dd/d29/d2e/f3a [1042517,116229] 0 2023-12-16T05:56:43.381 INFO:tasks.workunit.client.1.smithi156.stdout:7/954: rename d1e/d1f/da6/f4d to d1e/d1f/d22/d75/d77/f147 0 2023-12-16T05:56:43.383 INFO:tasks.workunit.client.1.smithi156.stdout:1/637: rmdir d3/d17/d1c/d22/d57 39 2023-12-16T05:56:43.384 INFO:tasks.workunit.client.1.smithi156.stdout:1/638: write d3/d17/d2d/f86 [1409499,2428] 0 2023-12-16T05:56:43.385 INFO:tasks.workunit.client.1.smithi156.stdout:3/697: mknod dc/d10/d3d/db5/cfa 0 2023-12-16T05:56:43.385 INFO:tasks.workunit.client.1.smithi156.stdout:2/744: sync 2023-12-16T05:56:43.386 INFO:tasks.workunit.client.1.smithi156.stdout:1/639: write d3/d17/d2d/fab [266562,106550] 0 2023-12-16T05:56:43.389 INFO:tasks.workunit.client.1.smithi156.stdout:6/811: creat d9/d1c/d50/dd9/f102 x:0 0 0 2023-12-16T05:56:43.389 INFO:tasks.workunit.client.1.smithi156.stdout:6/812: chown d9/d13/d2f/d51/d82/d89/d8e/c100 77017 1 2023-12-16T05:56:43.391 INFO:tasks.workunit.client.1.smithi156.stdout:0/855: mknod d2/d7/dd/d29/d38/dad/c10d 0 2023-12-16T05:56:43.392 INFO:tasks.workunit.client.1.smithi156.stdout:2/745: symlink d9/dd/d17/d33/leb 0 2023-12-16T05:56:43.395 INFO:tasks.workunit.client.1.smithi156.stdout:0/856: unlink d2/d7/dd/d29/c105 0 2023-12-16T05:56:43.396 INFO:tasks.workunit.client.1.smithi156.stdout:0/857: truncate d2/f3d 414783 0 2023-12-16T05:56:43.397 INFO:tasks.workunit.client.1.smithi156.stdout:0/858: truncate d2/d7/dd/d1c/fe2 765443 0 2023-12-16T05:56:43.397 INFO:tasks.workunit.client.1.smithi156.stdout:0/859: write d2/d7/dd/d29/d38/dae/d100/d44/f45 [1645080,91449] 0 2023-12-16T05:56:43.399 INFO:tasks.workunit.client.1.smithi156.stdout:0/860: link d2/d7/dd/d2d/d5e/fec d2/d7/dd/d29/d4b/dc0/f10e 0 2023-12-16T05:56:43.401 INFO:tasks.workunit.client.1.smithi156.stdout:7/955: dwrite d1e/f58 [0,4194304] 0 2023-12-16T05:56:43.402 INFO:tasks.workunit.client.1.smithi156.stdout:7/956: readlink d1e/d55/l139 0 2023-12-16T05:56:43.404 INFO:tasks.workunit.client.1.smithi156.stdout:7/957: symlink d1e/d55/d71/d61/dac/l148 0 2023-12-16T05:56:43.405 INFO:tasks.workunit.client.1.smithi156.stdout:7/958: mknod d1e/d1f/da6/d10d/d117/c149 0 2023-12-16T05:56:43.405 INFO:tasks.workunit.client.1.smithi156.stdout:7/959: fsync d1e/d1f/da6/d57/f92 0 2023-12-16T05:56:43.405 INFO:tasks.workunit.client.1.smithi156.stdout:7/960: chown d1e/d39/c5a 156 1 2023-12-16T05:56:43.405 INFO:tasks.workunit.client.1.smithi156.stdout:7/961: write d1e/d55/d71/ff9 [1976037,17432] 0 2023-12-16T05:56:43.411 INFO:tasks.workunit.client.1.smithi156.stdout:7/962: dread d1e/fb2 [0,4194304] 0 2023-12-16T05:56:43.411 INFO:tasks.workunit.client.1.smithi156.stdout:7/963: getdents d1e/d55/db6/ddb/d144 0 2023-12-16T05:56:43.415 INFO:tasks.workunit.client.1.smithi156.stdout:6/813: dwrite d9/d13/d2f/d36/f55 [4194304,4194304] 0 2023-12-16T05:56:43.416 INFO:tasks.workunit.client.1.smithi156.stdout:1/640: dwrite d3/d17/d1c/f4b [0,4194304] 0 2023-12-16T05:56:43.419 INFO:tasks.workunit.client.1.smithi156.stdout:1/641: mkdir d3/d17/d4d/dc2/dd8 0 2023-12-16T05:56:43.420 INFO:tasks.workunit.client.1.smithi156.stdout:1/642: mkdir d3/d17/d1c/d22/d57/dbc/dd9 0 2023-12-16T05:56:43.421 INFO:tasks.workunit.client.1.smithi156.stdout:1/643: symlink d3/d17/d4d/dc2/d4f/dca/lda 0 2023-12-16T05:56:43.421 INFO:tasks.workunit.client.1.smithi156.stdout:1/644: write d3/d17/d4d/dc2/f73 [720067,85235] 0 2023-12-16T05:56:43.422 INFO:tasks.workunit.client.1.smithi156.stdout:7/964: dwrite d1e/d1f/f3a [0,4194304] 0 2023-12-16T05:56:43.423 INFO:tasks.workunit.client.1.smithi156.stdout:1/645: rename d3/d17/d1c/d22/c3b to d3/d17/d4d/cdb 0 2023-12-16T05:56:43.423 INFO:tasks.workunit.client.1.smithi156.stdout:1/646: chown d3/d17/d1c/d22/c6f 32788 1 2023-12-16T05:56:43.424 INFO:tasks.workunit.client.1.smithi156.stdout:7/965: creat d1e/d1f/f14a x:0 0 0 2023-12-16T05:56:43.425 INFO:tasks.workunit.client.1.smithi156.stdout:1/647: rename d3/d17/d1c/d22/d57/d61/dc1/c50 to d3/d17/d1c/d22/d57/d61/dc1/dbe/cdc 0 2023-12-16T05:56:43.425 INFO:tasks.workunit.client.1.smithi156.stdout:7/966: dread d1e/d55/db6/ddb/fe0 [0,4194304] 0 2023-12-16T05:56:43.426 INFO:tasks.workunit.client.1.smithi156.stdout:1/648: symlink d3/d17/d1c/d22/d57/d61/dc1/ldd 0 2023-12-16T05:56:43.426 INFO:tasks.workunit.client.1.smithi156.stdout:1/649: fdatasync d3/d17/d2d/f74 0 2023-12-16T05:56:43.426 INFO:tasks.workunit.client.1.smithi156.stdout:1/650: chown d3/d17/d1c/d22/da4/fad 424790325 1 2023-12-16T05:56:43.427 INFO:tasks.workunit.client.1.smithi156.stdout:7/967: mknod d1e/d1f/d72/df4/c14b 0 2023-12-16T05:56:43.427 INFO:tasks.workunit.client.1.smithi156.stdout:1/651: truncate d3/f18 765229 0 2023-12-16T05:56:43.430 INFO:tasks.workunit.client.1.smithi156.stdout:3/698: write dc/df/f2d [13684,70868] 0 2023-12-16T05:56:43.430 INFO:tasks.workunit.client.1.smithi156.stdout:3/699: chown dc/d10/d1d/d4b/dac/ld4 97996 1 2023-12-16T05:56:43.430 INFO:tasks.workunit.client.1.smithi156.stdout:1/652: write d3/d17/f48 [3609252,111588] 0 2023-12-16T05:56:43.431 INFO:tasks.workunit.client.1.smithi156.stdout:3/700: write dc/d56/f92 [1382723,32030] 0 2023-12-16T05:56:43.431 INFO:tasks.workunit.client.1.smithi156.stdout:3/701: fdatasync dc/d10/d1d/f3a 0 2023-12-16T05:56:43.431 INFO:tasks.workunit.client.1.smithi156.stdout:1/653: write d3/d17/d4d/dc2/d4f/f65 [348042,5087] 0 2023-12-16T05:56:43.432 INFO:tasks.workunit.client.1.smithi156.stdout:1/654: stat d3/d17/d2d/l96 0 2023-12-16T05:56:43.432 INFO:tasks.workunit.client.1.smithi156.stdout:1/655: write d3/d3a/db1/fb8 [971710,66123] 0 2023-12-16T05:56:43.433 INFO:tasks.workunit.client.1.smithi156.stdout:1/656: fdatasync d3/f5 0 2023-12-16T05:56:43.433 INFO:tasks.workunit.client.0.smithi155.stdout:4/892: dwrite d0/fb [0,4194304] 0 2023-12-16T05:56:43.434 INFO:tasks.workunit.client.0.smithi155.stdout:4/893: creat d0/da/de0/d16/f127 x:0 0 0 2023-12-16T05:56:43.435 INFO:tasks.workunit.client.0.smithi155.stdout:4/894: write d0/d10/f9d [497320,14538] 0 2023-12-16T05:56:43.442 INFO:tasks.workunit.client.1.smithi156.stdout:7/968: dread d1e/d55/d71/d61/daa/f50 [0,4194304] 0 2023-12-16T05:56:43.442 INFO:tasks.workunit.client.1.smithi156.stdout:7/969: write d1e/d55/d71/d61/fa3 [381806,67389] 0 2023-12-16T05:56:43.445 INFO:tasks.workunit.client.1.smithi156.stdout:7/970: unlink d1e/d1f/d22/f79 0 2023-12-16T05:56:43.446 INFO:tasks.workunit.client.1.smithi156.stdout:6/814: dwrite d9/d1c/d50/dbf/dc0/fcd [0,4194304] 0 2023-12-16T05:56:43.453 INFO:tasks.workunit.client.1.smithi156.stdout:7/971: symlink d1e/d1f/da6/d57/dca/l14c 0 2023-12-16T05:56:43.455 INFO:tasks.workunit.client.1.smithi156.stdout:7/972: dread d1e/d55/db6/ddb/fe0 [0,4194304] 0 2023-12-16T05:56:43.456 INFO:tasks.workunit.client.1.smithi156.stdout:1/657: dwrite d3/d17/d1c/d22/fa3 [0,4194304] 0 2023-12-16T05:56:43.457 INFO:tasks.workunit.client.0.smithi155.stdout:7/861: sync 2023-12-16T05:56:43.457 INFO:tasks.workunit.client.0.smithi155.stdout:7/862: read - d0/d6a/d1a/d8c/d42/d98/f74 zero size 2023-12-16T05:56:43.457 INFO:tasks.workunit.client.0.smithi155.stdout:3/746: sync 2023-12-16T05:56:43.458 INFO:tasks.workunit.client.0.smithi155.stdout:7/863: creat d0/d1b/d103/f11a x:0 0 0 2023-12-16T05:56:43.459 INFO:tasks.workunit.client.0.smithi155.stdout:3/747: symlink d0/d14/d36/d83/d95/leb 0 2023-12-16T05:56:43.459 INFO:tasks.workunit.client.0.smithi155.stdout:3/748: fdatasync d0/d1a/fcc 0 2023-12-16T05:56:43.459 INFO:tasks.workunit.client.0.smithi155.stdout:3/749: stat d0/d14/d36/d83/da8/fc1 0 2023-12-16T05:56:43.459 INFO:tasks.workunit.client.0.smithi155.stdout:3/750: chown d0/d14/d36/d47/fbe 5751 1 2023-12-16T05:56:43.459 INFO:tasks.workunit.client.0.smithi155.stdout:3/751: truncate d0/d14/d36/d83/fae 682866 0 2023-12-16T05:56:43.460 INFO:tasks.workunit.client.0.smithi155.stdout:3/752: rename d0/d1e/d4e/db6 to d0/d14/d87/dec 0 2023-12-16T05:56:43.461 INFO:tasks.workunit.client.0.smithi155.stdout:3/753: creat d0/d1a/da3/fed x:0 0 0 2023-12-16T05:56:43.461 INFO:tasks.workunit.client.1.smithi156.stdout:7/973: dread d1e/f32 [0,4194304] 0 2023-12-16T05:56:43.462 INFO:tasks.workunit.client.1.smithi156.stdout:6/815: mknod d9/d13/d2f/d51/d9b/de2/c103 0 2023-12-16T05:56:43.471 INFO:tasks.workunit.client.1.smithi156.stdout:1/658: mkdir d3/d17/d4d/dc2/dd8/dde 0 2023-12-16T05:56:43.474 INFO:tasks.workunit.client.1.smithi156.stdout:7/974: creat d1e/d1f/da6/d57/dca/f14d x:0 0 0 2023-12-16T05:56:43.474 INFO:tasks.workunit.client.1.smithi156.stdout:7/975: fsync d1e/fc5 0 2023-12-16T05:56:43.475 INFO:tasks.workunit.client.0.smithi155.stdout:4/895: dwrite d0/d10/f9d [0,4194304] 0 2023-12-16T05:56:43.476 INFO:tasks.workunit.client.1.smithi156.stdout:1/659: rename d3/d1b/d8b/cbd to d3/d17/d1c/da5/cdf 0 2023-12-16T05:56:43.477 INFO:tasks.workunit.client.0.smithi155.stdout:4/896: creat d0/da/de0/d16/d30/dce/d75/d10e/d70/f128 x:0 0 0 2023-12-16T05:56:43.478 INFO:tasks.workunit.client.1.smithi156.stdout:7/976: creat d1e/d55/d71/d94/d108/f14e x:0 0 0 2023-12-16T05:56:43.478 INFO:tasks.workunit.client.1.smithi156.stdout:7/977: dread - d1e/d55/d71/d94/f12c zero size 2023-12-16T05:56:43.478 INFO:tasks.workunit.client.1.smithi156.stdout:0/861: dwrite d2/d7/dd/d29/d2e/f3a [0,4194304] 0 2023-12-16T05:56:43.478 INFO:tasks.workunit.client.1.smithi156.stdout:0/862: write d2/d7/dd/d2d/f104 [132142,102318] 0 2023-12-16T05:56:43.478 INFO:tasks.workunit.client.0.smithi155.stdout:4/897: mknod d0/da/de0/d16/d30/d52/d88/d9e/d103/dcb/c129 0 2023-12-16T05:56:43.479 INFO:tasks.workunit.client.1.smithi156.stdout:7/978: creat d1e/d55/d71/d61/dac/d134/f14f x:0 0 0 2023-12-16T05:56:43.480 INFO:tasks.workunit.client.1.smithi156.stdout:0/863: symlink d2/d7/dd/d29/d38/d51/d52/d88/l10f 0 2023-12-16T05:56:43.481 INFO:tasks.workunit.client.0.smithi155.stdout:4/898: mkdir d0/da/de0/d16/d30/dce/d75/d3d/d49/d12a 0 2023-12-16T05:56:43.482 INFO:tasks.workunit.client.0.smithi155.stdout:4/899: unlink d0/da/f5e 0 2023-12-16T05:56:43.482 INFO:tasks.workunit.client.1.smithi156.stdout:7/979: rename d1e/d1f/ffa to d1e/d1f/da6/d10d/f150 0 2023-12-16T05:56:43.485 INFO:tasks.workunit.client.0.smithi155.stdout:7/864: dwrite d0/fe3 [0,4194304] 0 2023-12-16T05:56:43.487 INFO:tasks.workunit.client.0.smithi155.stdout:3/754: dwrite d0/d1e/f32 [0,4194304] 0 2023-12-16T05:56:43.488 INFO:tasks.workunit.client.0.smithi155.stdout:3/755: write d0/d14/d45/dcd/fe9 [378738,58638] 0 2023-12-16T05:56:43.488 INFO:tasks.workunit.client.0.smithi155.stdout:3/756: write d0/d14/fb8 [457283,66728] 0 2023-12-16T05:56:43.488 INFO:tasks.workunit.client.0.smithi155.stdout:3/757: dread - d0/d1a/da3/fed zero size 2023-12-16T05:56:43.507 INFO:tasks.workunit.client.1.smithi156.stdout:1/660: dread d3/d17/d4d/dc2/fd5 [0,4194304] 0 2023-12-16T05:56:43.507 INFO:tasks.workunit.client.1.smithi156.stdout:1/661: stat d3/d17/l38 0 2023-12-16T05:56:43.508 INFO:tasks.workunit.client.1.smithi156.stdout:1/662: creat d3/d17/d2d/fe0 x:0 0 0 2023-12-16T05:56:43.510 INFO:tasks.workunit.client.1.smithi156.stdout:1/663: creat d3/d3a/fe1 x:0 0 0 2023-12-16T05:56:43.510 INFO:tasks.workunit.client.1.smithi156.stdout:1/664: stat d3/d17/l30 0 2023-12-16T05:56:43.512 INFO:tasks.workunit.client.1.smithi156.stdout:1/665: truncate d3/f5 645413 0 2023-12-16T05:56:43.512 INFO:tasks.workunit.client.1.smithi156.stdout:1/666: chown d3/d17/d4d/f9d 17 1 2023-12-16T05:56:43.515 INFO:tasks.workunit.client.1.smithi156.stdout:1/667: unlink d3/d3a/fc3 0 2023-12-16T05:56:43.515 INFO:tasks.workunit.client.1.smithi156.stdout:1/668: write d3/d17/d1c/d22/d57/f68 [24193,59389] 0 2023-12-16T05:56:43.516 INFO:tasks.workunit.client.0.smithi155.stdout:4/900: dwrite d0/da/de0/d16/d30/dce/d75/d10e/d70/d92/fde [0,4194304] 0 2023-12-16T05:56:43.517 INFO:tasks.workunit.client.1.smithi156.stdout:1/669: mknod d3/d17/d1c/d22/d57/dbc/ce2 0 2023-12-16T05:56:43.521 INFO:tasks.workunit.client.1.smithi156.stdout:1/670: creat d3/d17/d1c/d22/d57/d61/dc1/fe3 x:0 0 0 2023-12-16T05:56:43.521 INFO:tasks.workunit.client.0.smithi155.stdout:7/865: dwrite d0/d6a/d1a/d38/f9f [4194304,4194304] 0 2023-12-16T05:56:43.523 INFO:tasks.workunit.client.0.smithi155.stdout:7/866: creat d0/d6a/d31/f11b x:0 0 0 2023-12-16T05:56:43.524 INFO:tasks.workunit.client.0.smithi155.stdout:7/867: symlink d0/d6a/l11c 0 2023-12-16T05:56:43.527 INFO:tasks.workunit.client.0.smithi155.stdout:3/758: dwrite d0/d14/d36/d83/d95/fea [0,4194304] 0 2023-12-16T05:56:43.527 INFO:tasks.workunit.client.0.smithi155.stdout:3/759: chown d0/d14/d36/d83/d95/fea 105 1 2023-12-16T05:56:43.527 INFO:tasks.workunit.client.0.smithi155.stdout:3/760: write d0/d14/fb8 [506437,121818] 0 2023-12-16T05:56:43.527 INFO:tasks.workunit.client.1.smithi156.stdout:0/864: dwrite d2/d7/dd/d29/d38/dad/fe1 [0,4194304] 0 2023-12-16T05:56:43.529 INFO:tasks.workunit.client.1.smithi156.stdout:7/980: dwrite d1e/d55/d71/f4b [4194304,4194304] 0 2023-12-16T05:56:43.529 INFO:tasks.workunit.client.1.smithi156.stdout:7/981: write d1e/d55/db6/ddb/fdd [380447,2110] 0 2023-12-16T05:56:43.533 INFO:tasks.workunit.client.1.smithi156.stdout:1/671: dread d3/d3a/f6c [0,4194304] 0 2023-12-16T05:56:43.533 INFO:tasks.workunit.client.1.smithi156.stdout:7/982: mknod d1e/d1f/d72/d107/c151 0 2023-12-16T05:56:43.533 INFO:tasks.workunit.client.1.smithi156.stdout:7/983: fdatasync d1e/f27 0 2023-12-16T05:56:43.537 INFO:tasks.workunit.client.0.smithi155.stdout:3/761: link d0/d14/d36/d83/fae d0/d14/fee 0 2023-12-16T05:56:43.537 INFO:tasks.workunit.client.1.smithi156.stdout:0/865: rename d2/d7/dd/d29/d38/d51/d52/d88 to d2/d7/dd/d2d/d5e/d110 0 2023-12-16T05:56:43.538 INFO:tasks.workunit.client.1.smithi156.stdout:7/984: mknod d1e/d1f/da6/d57/d59/dd8/c152 0 2023-12-16T05:56:43.538 INFO:tasks.workunit.client.1.smithi156.stdout:7/985: fsync d1e/d1f/d22/d75/f9f 0 2023-12-16T05:56:43.539 INFO:tasks.workunit.client.1.smithi156.stdout:0/866: creat d2/d7/ddb/f111 x:0 0 0 2023-12-16T05:56:43.539 INFO:tasks.workunit.client.1.smithi156.stdout:0/867: chown d2/d7/dd/d29/d38/d51/d65/d7e/leb 117604 1 2023-12-16T05:56:43.539 INFO:tasks.workunit.client.1.smithi156.stdout:0/868: write d2/d7/dd/d29/d38/d51/d52/fbf [841351,44500] 0 2023-12-16T05:56:43.540 INFO:tasks.workunit.client.1.smithi156.stdout:7/986: symlink d1e/d1f/da6/d57/l153 0 2023-12-16T05:56:43.540 INFO:tasks.workunit.client.1.smithi156.stdout:7/987: stat d1e/d55/d71/f4b 0 2023-12-16T05:56:43.540 INFO:tasks.workunit.client.1.smithi156.stdout:7/988: write d1e/d55/d71/df5/f12e [23952,68702] 0 2023-12-16T05:56:43.541 INFO:tasks.workunit.client.0.smithi155.stdout:5/972: sync 2023-12-16T05:56:43.541 INFO:tasks.workunit.client.0.smithi155.stdout:2/930: sync 2023-12-16T05:56:43.542 INFO:tasks.workunit.client.0.smithi155.stdout:8/997: sync 2023-12-16T05:56:43.542 INFO:tasks.workunit.client.1.smithi156.stdout:0/869: creat d2/d7/dd/d29/d38/d51/d65/f112 x:0 0 0 2023-12-16T05:56:43.542 INFO:tasks.workunit.client.1.smithi156.stdout:0/870: write d2/f3d [1199063,37367] 0 2023-12-16T05:56:43.542 INFO:tasks.workunit.client.0.smithi155.stdout:3/762: write d0/d1e/f23 [33327,54088] 0 2023-12-16T05:56:43.542 INFO:tasks.workunit.client.0.smithi155.stdout:3/763: chown d0/d14/fb8 122 1 2023-12-16T05:56:43.543 INFO:tasks.workunit.client.1.smithi156.stdout:7/989: symlink d1e/d1f/d22/d75/d77/l154 0 2023-12-16T05:56:43.543 INFO:tasks.workunit.client.0.smithi155.stdout:2/931: rename d0/d7/dd/d62/d66/dbc/f124 to d0/d7/dd/d49/d4b/d8c/f142 0 2023-12-16T05:56:43.544 INFO:tasks.workunit.client.0.smithi155.stdout:2/932: chown d0/d7/dc1/fcc 0 1 2023-12-16T05:56:43.545 INFO:tasks.workunit.client.0.smithi155.stdout:8/998: symlink d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/dab/d127/l14e 0 2023-12-16T05:56:43.545 INFO:tasks.workunit.client.0.smithi155.stdout:3/764: stat d0/d14/d87/d94/da1/c8f 0 2023-12-16T05:56:43.545 INFO:tasks.workunit.client.0.smithi155.stdout:3/765: chown d0/d1a/d33/d57/dc3/f4a 2628055 1 2023-12-16T05:56:43.545 INFO:tasks.workunit.client.0.smithi155.stdout:5/973: dread d0/d2/d2a/d19/d48/f58 [0,4194304] 0 2023-12-16T05:56:43.546 INFO:tasks.workunit.client.1.smithi156.stdout:7/990: creat d1e/d1f/d72/df4/f155 x:0 0 0 2023-12-16T05:56:43.546 INFO:tasks.workunit.client.0.smithi155.stdout:8/999: mknod d4/d62/d66/d78/d88/d1b/d1c/d19/d7d/c14f 0 2023-12-16T05:56:43.546 INFO:tasks.workunit.client.1.smithi156.stdout:7/991: mknod d1e/d1f/da6/d10d/c156 0 2023-12-16T05:56:43.547 INFO:tasks.workunit.client.0.smithi155.stdout:3/766: creat d0/d14/d36/d47/da7/fef x:0 0 0 2023-12-16T05:56:43.548 INFO:tasks.workunit.client.1.smithi156.stdout:7/992: creat d1e/d55/db6/ddb/d144/f157 x:0 0 0 2023-12-16T05:56:43.548 INFO:tasks.workunit.client.1.smithi156.stdout:7/993: truncate d1e/d1f/da6/d57/dbb/f12b 887888 0 2023-12-16T05:56:43.548 INFO:tasks.workunit.client.1.smithi156.stdout:7/994: fsync d1e/d1f/da6/d57/dca/fd3 0 2023-12-16T05:56:43.549 INFO:tasks.workunit.client.0.smithi155.stdout:5/974: unlink d0/d2/d2a/d19/d48/cf2 0 2023-12-16T05:56:43.550 INFO:tasks.workunit.client.0.smithi155.stdout:3/767: rmdir d0/d1a/d91/dde 39 2023-12-16T05:56:43.551 INFO:tasks.workunit.client.1.smithi156.stdout:7/995: write d1e/f27 [3198095,110762] 0 2023-12-16T05:56:43.552 INFO:tasks.workunit.client.1.smithi156.stdout:7/996: write d1e/d1f/da6/d57/dbb/fcc [867302,23098] 0 2023-12-16T05:56:43.552 INFO:tasks.workunit.client.1.smithi156.stdout:7/997: dread - d1e/d1f/d72/da4/fda zero size 2023-12-16T05:56:43.553 INFO:tasks.workunit.client.0.smithi155.stdout:5/975: unlink d0/d60/l89 0 2023-12-16T05:56:43.557 INFO:tasks.workunit.client.1.smithi156.stdout:1/672: dwrite d3/d17/f33 [0,4194304] 0 2023-12-16T05:56:43.557 INFO:tasks.workunit.client.1.smithi156.stdout:0/871: dread d2/d7/dd/d1c/fb1 [0,4194304] 0 2023-12-16T05:56:43.557 INFO:tasks.workunit.client.1.smithi156.stdout:5/942: sync 2023-12-16T05:56:43.557 INFO:tasks.workunit.client.1.smithi156.stdout:9/737: sync 2023-12-16T05:56:43.558 INFO:tasks.workunit.client.0.smithi155.stdout:5/976: creat d0/d2/d2a/d30/d53/d7b/d99/d47/d61/de1/f13a x:0 0 0 2023-12-16T05:56:43.559 INFO:tasks.workunit.client.1.smithi156.stdout:0/872: getdents d2/d7/dd/ded 0 2023-12-16T05:56:43.559 INFO:tasks.workunit.client.0.smithi155.stdout:5/977: creat d0/d60/f13b x:0 0 0 2023-12-16T05:56:43.560 INFO:tasks.workunit.client.0.smithi155.stdout:5/978: truncate d0/d2/d2a/d19/f20 3602496 0 2023-12-16T05:56:43.561 INFO:tasks.workunit.client.0.smithi155.stdout:5/979: read d0/d2/d2a/d19/d71/fb1 [1218670,38086] 0 2023-12-16T05:56:43.561 INFO:tasks.workunit.client.1.smithi156.stdout:9/738: link d6/d19/d25/d3a/f43 d6/d19/d25/d72/ff8 0 2023-12-16T05:56:43.561 INFO:tasks.workunit.client.0.smithi155.stdout:5/980: rmdir d0/d2/d2a/d19/de2 39 2023-12-16T05:56:43.562 INFO:tasks.workunit.client.1.smithi156.stdout:5/943: creat da/d9a/f13c x:0 0 0 2023-12-16T05:56:43.562 INFO:tasks.workunit.client.1.smithi156.stdout:5/944: fsync da/dc/d4b/d6c/d77/d10e/f129 0 2023-12-16T05:56:43.562 INFO:tasks.workunit.client.1.smithi156.stdout:5/945: truncate da/dc/d2d/d4d/d54/d67/f105 762359 0 2023-12-16T05:56:43.563 INFO:tasks.workunit.client.1.smithi156.stdout:0/873: link d2/d7/dd/f96 d2/d7/dd/ded/f113 0 2023-12-16T05:56:43.564 INFO:tasks.workunit.client.1.smithi156.stdout:9/739: mknod d6/d19/d25/d72/cf9 0 2023-12-16T05:56:43.564 INFO:tasks.workunit.client.1.smithi156.stdout:9/740: dread - d6/d19/d30/d48/d87/f99 zero size 2023-12-16T05:56:43.565 INFO:tasks.workunit.client.1.smithi156.stdout:5/946: mkdir da/dc/d4b/d6c/d81/dc5/d13d 0 2023-12-16T05:56:43.569 INFO:tasks.workunit.client.1.smithi156.stdout:5/947: mknod da/dc/d4b/d123/c13e 0 2023-12-16T05:56:43.569 INFO:tasks.workunit.client.1.smithi156.stdout:5/948: stat da/d9a/f10c 0 2023-12-16T05:56:43.569 INFO:tasks.workunit.client.1.smithi156.stdout:0/874: creat d2/d7/dd/d1c/db3/df5/f114 x:0 0 0 2023-12-16T05:56:43.569 INFO:tasks.workunit.client.1.smithi156.stdout:7/998: fsync d1e/d55/db6/ddb/fdd 0 2023-12-16T05:56:43.572 INFO:tasks.workunit.client.1.smithi156.stdout:1/673: dread d3/d17/f33 [0,4194304] 0 2023-12-16T05:56:43.573 INFO:tasks.workunit.client.1.smithi156.stdout:1/674: chown d3/d3a/fe1 0 1 2023-12-16T05:56:43.573 INFO:tasks.workunit.client.1.smithi156.stdout:5/949: creat da/dc/de2/f13f x:0 0 0 2023-12-16T05:56:43.573 INFO:tasks.workunit.client.1.smithi156.stdout:5/950: dread - da/dc/d2d/d34/fd7 zero size 2023-12-16T05:56:43.574 INFO:tasks.workunit.client.1.smithi156.stdout:7/999: truncate d1e/dbf/fee 1641558 0 2023-12-16T05:56:43.575 INFO:tasks.workunit.client.0.smithi155.stdout:3/768: dwrite d0/d1e/d4e/f88 [0,4194304] 0 2023-12-16T05:56:43.575 INFO:tasks.workunit.client.0.smithi155.stdout:3/769: truncate d0/d1a/d33/fb7 951520 0 2023-12-16T05:56:43.575 INFO:tasks.workunit.client.1.smithi156.stdout:1/675: creat d3/d17/d1c/d22/d57/d61/fe4 x:0 0 0 2023-12-16T05:56:43.576 INFO:tasks.workunit.client.1.smithi156.stdout:9/741: dread d6/f1e [0,4194304] 0 2023-12-16T05:56:43.576 INFO:tasks.workunit.client.1.smithi156.stdout:9/742: fdatasync d6/d19/d30/fde 0 2023-12-16T05:56:43.577 INFO:tasks.workunit.client.0.smithi155.stdout:3/770: mkdir d0/d14/d36/d7c/df0 0 2023-12-16T05:56:43.578 INFO:tasks.workunit.client.0.smithi155.stdout:3/771: symlink d0/d1a/d33/lf1 0 2023-12-16T05:56:43.581 INFO:tasks.workunit.client.0.smithi155.stdout:3/772: mknod d0/d1a/d91/dde/cf2 0 2023-12-16T05:56:43.583 INFO:tasks.workunit.client.0.smithi155.stdout:5/981: dwrite d0/d2/d2a/d19/d88/fc3 [4194304,4194304] 0 2023-12-16T05:56:43.583 INFO:tasks.workunit.client.0.smithi155.stdout:5/982: write d0/d60/f13b [285086,15993] 0 2023-12-16T05:56:43.583 INFO:tasks.workunit.client.1.smithi156.stdout:5/951: dread da/d9a/fc4 [0,4194304] 0 2023-12-16T05:56:43.583 INFO:tasks.workunit.client.1.smithi156.stdout:5/952: readlink da/dc/d2d/d4d/db9/lf9 0 2023-12-16T05:56:43.586 INFO:tasks.workunit.client.1.smithi156.stdout:1/676: link d3/d17/lcb d3/d1b/le5 0 2023-12-16T05:56:43.586 INFO:tasks.workunit.client.1.smithi156.stdout:9/743: getdents d6/d19/d30/dae 0 2023-12-16T05:56:43.589 INFO:tasks.workunit.client.1.smithi156.stdout:5/953: rename da/dc/d2d/d4d/d54/d67/f8c to da/dc/d4b/d6c/d81/f140 0 2023-12-16T05:56:43.591 INFO:tasks.workunit.client.1.smithi156.stdout:5/954: rmdir da/dc/d4b/d6c/d81/dc5 39 2023-12-16T05:56:43.592 INFO:tasks.workunit.client.1.smithi156.stdout:0/875: dwrite d2/d7/f18 [0,4194304] 0 2023-12-16T05:56:43.592 INFO:tasks.workunit.client.1.smithi156.stdout:0/876: write d2/d7/dd/d29/d38/d51/d52/fbf [1467965,26074] 0 2023-12-16T05:56:43.594 INFO:tasks.workunit.client.1.smithi156.stdout:5/955: symlink da/dc/d4b/d6c/d77/d10e/l141 0 2023-12-16T05:56:43.594 INFO:tasks.workunit.client.1.smithi156.stdout:5/956: dread - da/dc/d4b/d6c/d77/fef zero size 2023-12-16T05:56:43.599 INFO:tasks.workunit.client.0.smithi155.stdout:3/773: dread d0/f10 [0,4194304] 0 2023-12-16T05:56:43.606 INFO:tasks.workunit.client.1.smithi156.stdout:5/957: creat da/dc/d4b/f142 x:0 0 0 2023-12-16T05:56:43.621 INFO:tasks.workunit.client.0.smithi155.stdout:5/983: dwrite d0/d2/d2a/d30/d53/d7b/d99/fca [0,4194304] 0 2023-12-16T05:56:43.622 INFO:tasks.workunit.client.0.smithi155.stdout:5/984: fdatasync d0/d2/d2a/d19/d48/f58 0 2023-12-16T05:56:43.624 INFO:tasks.workunit.client.0.smithi155.stdout:5/985: symlink d0/d2/d2a/d30/l13c 0 2023-12-16T05:56:43.628 INFO:tasks.workunit.client.1.smithi156.stdout:8/574: sync 2023-12-16T05:56:43.630 INFO:tasks.workunit.client.1.smithi156.stdout:8/575: creat d3/d12/fc1 x:0 0 0 2023-12-16T05:56:43.631 INFO:tasks.workunit.client.1.smithi156.stdout:8/576: write d3/d7/d27/d46/d6e/d3c/f6a [14076886,41138] 0 2023-12-16T05:56:43.631 INFO:tasks.workunit.client.1.smithi156.stdout:8/577: dread - d3/d7/d27/fb6 zero size 2023-12-16T05:56:43.643 INFO:tasks.workunit.client.1.smithi156.stdout:9/744: dwrite d6/d19/d25/d3a/f43 [8388608,4194304] 0 2023-12-16T05:56:43.643 INFO:tasks.workunit.client.1.smithi156.stdout:9/745: chown d6/d19/d25/f3c 3195647 1 2023-12-16T05:56:43.644 INFO:tasks.workunit.client.1.smithi156.stdout:9/746: chown d6/d19/l85 158 1 2023-12-16T05:56:43.644 INFO:tasks.workunit.client.1.smithi156.stdout:9/747: getdents d6/d19/d25/d3a/d80/dc0/dd0 0 2023-12-16T05:56:43.644 INFO:tasks.workunit.client.1.smithi156.stdout:1/677: dwrite d3/d17/d4d/dc2/d4f/fc8 [0,4194304] 0 2023-12-16T05:56:43.644 INFO:tasks.workunit.client.0.smithi155.stdout:3/774: dwrite d0/d1a/f78 [4194304,4194304] 0 2023-12-16T05:56:43.645 INFO:tasks.workunit.client.1.smithi156.stdout:5/958: dwrite da/dc/d2d/d34/fcf [0,4194304] 0 2023-12-16T05:56:43.645 INFO:tasks.workunit.client.1.smithi156.stdout:5/959: dread - da/dc/d2d/d4d/d54/d90/fbc zero size 2023-12-16T05:56:43.649 INFO:tasks.workunit.client.0.smithi155.stdout:3/775: write d0/d1e/f20 [1678800,16746] 0 2023-12-16T05:56:43.649 INFO:tasks.workunit.client.0.smithi155.stdout:3/776: readlink d0/d1e/la2 0 2023-12-16T05:56:43.650 INFO:tasks.workunit.client.1.smithi156.stdout:5/960: readlink da/dc/d4b/l9d 0 2023-12-16T05:56:43.651 INFO:tasks.workunit.client.1.smithi156.stdout:1/678: write d3/d17/d4d/dc2/d4f/f65 [2126986,61632] 0 2023-12-16T05:56:43.651 INFO:tasks.workunit.client.0.smithi155.stdout:3/777: unlink d0/d1a/da3/f99 0 2023-12-16T05:56:43.652 INFO:tasks.workunit.client.1.smithi156.stdout:1/679: symlink d3/d17/d1c/d22/d57/dbc/le6 0 2023-12-16T05:56:43.652 INFO:tasks.workunit.client.0.smithi155.stdout:3/778: creat d0/d14/d87/d94/da1/db3/ff3 x:0 0 0 2023-12-16T05:56:43.653 INFO:tasks.workunit.client.1.smithi156.stdout:1/680: dread d3/d3a/f9f [0,4194304] 0 2023-12-16T05:56:43.655 INFO:tasks.workunit.client.1.smithi156.stdout:5/961: read da/dc/d4b/f93 [1095749,87586] 0 2023-12-16T05:56:43.667 INFO:tasks.workunit.client.0.smithi155.stdout:3/779: dread d0/d1e/f59 [0,4194304] 0 2023-12-16T05:56:43.670 INFO:tasks.workunit.client.0.smithi155.stdout:3/780: unlink d0/d14/d45/f8b 0 2023-12-16T05:56:43.670 INFO:tasks.workunit.client.0.smithi155.stdout:3/781: fsync d0/d14/f65 0 2023-12-16T05:56:43.671 INFO:tasks.workunit.client.0.smithi155.stdout:3/782: link d0/d1a/d33/d57/f63 d0/d1a/d33/ff4 0 2023-12-16T05:56:43.672 INFO:tasks.workunit.client.1.smithi156.stdout:1/681: dread d3/d17/d1c/d22/d57/f85 [0,4194304] 0 2023-12-16T05:56:43.672 INFO:tasks.workunit.client.0.smithi155.stdout:3/783: symlink d0/d14/d36/d47/d5f/lf5 0 2023-12-16T05:56:43.672 INFO:tasks.workunit.client.0.smithi155.stdout:5/986: dwrite d0/ff3 [0,4194304] 0 2023-12-16T05:56:43.673 INFO:tasks.workunit.client.0.smithi155.stdout:5/987: readlink d0/d2/d2a/d30/d53/d7b/d99/d47/ldb 0 2023-12-16T05:56:43.673 INFO:tasks.workunit.client.1.smithi156.stdout:1/682: creat d3/d17/d4d/dc2/d4f/d75/fe7 x:0 0 0 2023-12-16T05:56:43.673 INFO:tasks.workunit.client.0.smithi155.stdout:3/784: creat d0/d14/d36/d47/da7/ff6 x:0 0 0 2023-12-16T05:56:43.675 INFO:tasks.workunit.client.1.smithi156.stdout:1/683: link d3/d17/d4d/dc2/d4f/dca/ccd d3/d17/d1c/da5/ce8 0 2023-12-16T05:56:43.676 INFO:tasks.workunit.client.0.smithi155.stdout:3/785: creat d0/d1a/da3/de6/ff7 x:0 0 0 2023-12-16T05:56:43.676 INFO:tasks.workunit.client.0.smithi155.stdout:3/786: truncate d0/d1a/da3/fed 88207 0 2023-12-16T05:56:43.676 INFO:tasks.workunit.client.0.smithi155.stdout:3/787: creat d0/d14/d87/d94/ff8 x:0 0 0 2023-12-16T05:56:43.677 INFO:tasks.workunit.client.1.smithi156.stdout:1/684: rename d3/d17/d4d/f56 to d3/d17/d1c/d22/d57/dbc/fe9 0 2023-12-16T05:56:43.677 INFO:tasks.workunit.client.1.smithi156.stdout:1/685: chown d3/d3a/fd1 1970739288 1 2023-12-16T05:56:43.679 INFO:tasks.workunit.client.1.smithi156.stdout:1/686: rename d3/f5a to d3/d17/d2d/fea 0 2023-12-16T05:56:43.680 INFO:tasks.workunit.client.0.smithi155.stdout:3/788: rmdir d0/d14/d45 39 2023-12-16T05:56:43.680 INFO:tasks.workunit.client.0.smithi155.stdout:3/789: fsync d0/d1e/f23 0 2023-12-16T05:56:43.680 INFO:tasks.workunit.client.0.smithi155.stdout:3/790: chown d0/d14/d36/c48 7824604 1 2023-12-16T05:56:43.680 INFO:tasks.workunit.client.0.smithi155.stdout:3/791: write d0/d1a/d33/d57/dc3/f4a [4587402,17014] 0 2023-12-16T05:56:43.681 INFO:tasks.workunit.client.1.smithi156.stdout:1/687: creat d3/d17/d1c/da5/feb x:0 0 0 2023-12-16T05:56:43.681 INFO:tasks.workunit.client.1.smithi156.stdout:1/688: rename d3/d17/d1c/da5/fc6 to d3/d17/fec 0 2023-12-16T05:56:43.682 INFO:tasks.workunit.client.0.smithi155.stdout:3/792: mknod d0/d1a/da3/cf9 0 2023-12-16T05:56:43.682 INFO:tasks.workunit.client.0.smithi155.stdout:3/793: chown d0/d14/d36 105410235 1 2023-12-16T05:56:43.682 INFO:tasks.workunit.client.0.smithi155.stdout:3/794: dread - d0/d1e/d4e/d81/fe4 zero size 2023-12-16T05:56:43.683 INFO:tasks.workunit.client.0.smithi155.stdout:3/795: read d0/fa9 [1003402,98159] 0 2023-12-16T05:56:43.684 INFO:tasks.workunit.client.0.smithi155.stdout:3/796: symlink d0/d14/d36/d47/da7/lfa 0 2023-12-16T05:56:43.684 INFO:tasks.workunit.client.0.smithi155.stdout:3/797: read d0/d1e/f20 [8597787,33437] 0 2023-12-16T05:56:43.685 INFO:tasks.workunit.client.1.smithi156.stdout:8/578: dwrite d3/d7/d27/fb0 [0,4194304] 0 2023-12-16T05:56:43.686 INFO:tasks.workunit.client.0.smithi155.stdout:3/798: truncate d0/d14/d36/d47/d5f/f7d 923222 0 2023-12-16T05:56:43.686 INFO:tasks.workunit.client.0.smithi155.stdout:3/799: fsync d0/d1a/fcc 0 2023-12-16T05:56:43.686 INFO:tasks.workunit.client.0.smithi155.stdout:3/800: chown d0/d14/c37 774 1 2023-12-16T05:56:43.686 INFO:tasks.workunit.client.0.smithi155.stdout:3/801: mknod d0/d1a/da3/de6/cfb 0 2023-12-16T05:56:43.687 INFO:tasks.workunit.client.1.smithi156.stdout:9/748: dwrite d6/d19/d30/dae/fc6 [0,4194304] 0 2023-12-16T05:56:43.687 INFO:tasks.workunit.client.1.smithi156.stdout:9/749: chown d6/d19/d25/d3a/dc3/fc8 37 1 2023-12-16T05:56:43.687 INFO:tasks.workunit.client.1.smithi156.stdout:8/579: mkdir d3/d7/d27/d46/d84/d85/dc2 0 2023-12-16T05:56:43.690 INFO:tasks.workunit.client.0.smithi155.stdout:7/868: sync 2023-12-16T05:56:43.690 INFO:tasks.workunit.client.0.smithi155.stdout:7/869: write d0/d1b/d78/f96 [1186751,19667] 0 2023-12-16T05:56:43.690 INFO:tasks.workunit.client.0.smithi155.stdout:2/933: sync 2023-12-16T05:56:43.690 INFO:tasks.workunit.client.0.smithi155.stdout:2/934: fdatasync d0/d5/d6/d5f/f8e 0 2023-12-16T05:56:43.690 INFO:tasks.workunit.client.0.smithi155.stdout:2/935: write d0/d7/d57/d63/de7/fda [650989,114422] 0 2023-12-16T05:56:43.690 INFO:tasks.workunit.client.0.smithi155.stdout:4/901: sync 2023-12-16T05:56:43.692 INFO:tasks.workunit.client.1.smithi156.stdout:9/750: rename d6/d19/d30/d48/d87/f70 to d6/d19/d25/d3a/dc3/ffa 0 2023-12-16T05:56:43.692 INFO:tasks.workunit.client.1.smithi156.stdout:9/751: chown d6/d19/d25/d3a/d88/d8b 8 1 2023-12-16T05:56:43.692 INFO:tasks.workunit.client.0.smithi155.stdout:5/988: dwrite d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/dd9/d11f/f107 [0,4194304] 0 2023-12-16T05:56:43.692 INFO:tasks.workunit.client.0.smithi155.stdout:7/870: truncate d0/d1/f61 3368171 0 2023-12-16T05:56:43.692 INFO:tasks.workunit.client.1.smithi156.stdout:5/962: dwrite da/dc/d4b/d6c/d81/fa9 [0,4194304] 0 2023-12-16T05:56:43.693 INFO:tasks.workunit.client.1.smithi156.stdout:8/580: rmdir d3/d7/d62/db3 0 2023-12-16T05:56:43.694 INFO:tasks.workunit.client.0.smithi155.stdout:2/936: creat d0/d7/dd/d49/d4b/d8c/dcd/d108/d126/f143 x:0 0 0 2023-12-16T05:56:43.694 INFO:tasks.workunit.client.0.smithi155.stdout:2/937: write d0/d7/d69/db8/f13a [621462,80632] 0 2023-12-16T05:56:43.694 INFO:tasks.workunit.client.0.smithi155.stdout:2/938: write d0/d5/d8a/ffa [961725,20058] 0 2023-12-16T05:56:43.694 INFO:tasks.workunit.client.1.smithi156.stdout:8/581: write d3/d7/f63 [3636381,64267] 0 2023-12-16T05:56:43.694 INFO:tasks.workunit.client.1.smithi156.stdout:9/752: creat d6/d19/d25/d3a/d5e/ffb x:0 0 0 2023-12-16T05:56:43.695 INFO:tasks.workunit.client.0.smithi155.stdout:4/902: creat d0/da/de0/d16/d30/dce/d75/d10e/f12b x:0 0 0 2023-12-16T05:56:43.695 INFO:tasks.workunit.client.0.smithi155.stdout:4/903: chown d0/da/de0/d16/d30/dce/d75/f100 29093429 1 2023-12-16T05:56:43.696 INFO:tasks.workunit.client.1.smithi156.stdout:6/816: sync 2023-12-16T05:56:43.696 INFO:tasks.workunit.client.1.smithi156.stdout:2/746: sync 2023-12-16T05:56:43.696 INFO:tasks.workunit.client.1.smithi156.stdout:3/702: sync 2023-12-16T05:56:43.696 INFO:tasks.workunit.client.1.smithi156.stdout:4/712: sync 2023-12-16T05:56:43.697 INFO:tasks.workunit.client.0.smithi155.stdout:5/989: mkdir d0/d60/d79/d8e/d123/d13d 0 2023-12-16T05:56:43.697 INFO:tasks.workunit.client.0.smithi155.stdout:5/990: chown d0/d2/d2a/d30/d53/d7b/f80 56233 1 2023-12-16T05:56:43.697 INFO:tasks.workunit.client.1.smithi156.stdout:5/963: mknod da/dc/d2d/d4d/d54/da6/c143 0 2023-12-16T05:56:43.697 INFO:tasks.workunit.client.1.smithi156.stdout:5/964: fsync f0 0 2023-12-16T05:56:43.697 INFO:tasks.workunit.client.1.smithi156.stdout:5/965: fsync da/dc/d4b/d6c/d81/fd8 0 2023-12-16T05:56:43.698 INFO:tasks.workunit.client.0.smithi155.stdout:7/871: mkdir d0/d6a/d1a/da0/de6/d11d 0 2023-12-16T05:56:43.699 INFO:tasks.workunit.client.1.smithi156.stdout:8/582: creat d3/d7/d66/fc3 x:0 0 0 2023-12-16T05:56:43.699 INFO:tasks.workunit.client.1.smithi156.stdout:8/583: chown d3/d12/d16 289 1 2023-12-16T05:56:43.700 INFO:tasks.workunit.client.1.smithi156.stdout:8/584: dread d3/d12/d16/d54/f60 [0,4194304] 0 2023-12-16T05:56:43.701 INFO:tasks.workunit.client.1.smithi156.stdout:9/753: unlink d6/d19/d25/l7d 0 2023-12-16T05:56:43.701 INFO:tasks.workunit.client.0.smithi155.stdout:2/939: rmdir d0/d7/d57 39 2023-12-16T05:56:43.702 INFO:tasks.workunit.client.1.smithi156.stdout:2/747: write d9/dd/d17/d33/dae/fb0 [78570,12250] 0 2023-12-16T05:56:43.702 INFO:tasks.workunit.client.1.smithi156.stdout:4/713: chown d9/d2b/l4a 114041823 1 2023-12-16T05:56:43.703 INFO:tasks.workunit.client.0.smithi155.stdout:4/904: creat d0/da/de0/d16/d30/dce/d75/d10e/dd1/ddf/f12c x:0 0 0 2023-12-16T05:56:43.704 INFO:tasks.workunit.client.0.smithi155.stdout:7/872: creat d0/d6a/d1a/d22/f11e x:0 0 0 2023-12-16T05:56:43.704 INFO:tasks.workunit.client.1.smithi156.stdout:3/703: unlink dc/d10/d3d/c8b 0 2023-12-16T05:56:43.705 INFO:tasks.workunit.client.0.smithi155.stdout:2/940: getdents d0/d7/dd/d62 0 2023-12-16T05:56:43.706 INFO:tasks.workunit.client.1.smithi156.stdout:5/966: mknod da/dc/d2d/db0/c144 0 2023-12-16T05:56:43.706 INFO:tasks.workunit.client.0.smithi155.stdout:4/905: mknod d0/da/de0/d16/d30/dce/d75/c12d 0 2023-12-16T05:56:43.707 INFO:tasks.workunit.client.0.smithi155.stdout:2/941: mknod d0/d5/d8a/c144 0 2023-12-16T05:56:43.710 INFO:tasks.workunit.client.0.smithi155.stdout:7/873: dread d0/d6a/d1a/d2b/d65/db8/f112 [0,4194304] 0 2023-12-16T05:56:43.710 INFO:tasks.workunit.client.0.smithi155.stdout:2/942: creat d0/d7/dd/d49/d4b/df0/f145 x:0 0 0 2023-12-16T05:56:43.710 INFO:tasks.workunit.client.0.smithi155.stdout:3/802: dwrite d0/d14/d87/d94/da1/d73/faf [4194304,4194304] 0 2023-12-16T05:56:43.710 INFO:tasks.workunit.client.0.smithi155.stdout:2/943: symlink d0/d7/d69/l146 0 2023-12-16T05:56:43.711 INFO:tasks.workunit.client.1.smithi156.stdout:6/817: dread d9/d13/d2f/d51/d82/fc2 [0,4194304] 0 2023-12-16T05:56:43.711 INFO:tasks.workunit.client.1.smithi156.stdout:6/818: truncate d9/d1c/f6a 963733 0 2023-12-16T05:56:43.712 INFO:tasks.workunit.client.1.smithi156.stdout:8/585: unlink d3/d7a/d7d/dae/f1b 0 2023-12-16T05:56:43.714 INFO:tasks.workunit.client.0.smithi155.stdout:3/803: rename d0/d14/d36/d7c/l90 to d0/d1a/lfc 0 2023-12-16T05:56:43.714 INFO:tasks.workunit.client.0.smithi155.stdout:3/804: readlink d0/d14/d36/d83/d95/leb 0 2023-12-16T05:56:43.716 INFO:tasks.workunit.client.1.smithi156.stdout:9/754: rename d6/d19/d30/d95 to d6/d19/d25/d3a/d5e/da9/de1/dfc 0 2023-12-16T05:56:43.717 INFO:tasks.workunit.client.1.smithi156.stdout:4/714: rmdir d9/d2c/d7a 39 2023-12-16T05:56:43.718 INFO:tasks.workunit.client.1.smithi156.stdout:1/689: fsync d3/d17/fec 0 2023-12-16T05:56:43.718 INFO:tasks.workunit.client.1.smithi156.stdout:1/690: chown d3/d17/d2d 13469624 1 2023-12-16T05:56:43.718 INFO:tasks.workunit.client.0.smithi155.stdout:2/944: mkdir d0/d7/d147 0 2023-12-16T05:56:43.720 INFO:tasks.workunit.client.0.smithi155.stdout:5/991: dwrite d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/dd9/fe5 [0,4194304] 0 2023-12-16T05:56:43.721 INFO:tasks.workunit.client.1.smithi156.stdout:3/704: unlink dc/df/d34/d62/c85 0 2023-12-16T05:56:43.722 INFO:tasks.workunit.client.0.smithi155.stdout:4/906: dread d0/da/de0/d16/d30/dce/d75/d10e/d70/d92/daf/fb8 [0,4194304] 0 2023-12-16T05:56:43.722 INFO:tasks.workunit.client.1.smithi156.stdout:6/819: creat d9/d13/d2f/d51/d82/d89/d8e/f104 x:0 0 0 2023-12-16T05:56:43.723 INFO:tasks.workunit.client.0.smithi155.stdout:2/945: mkdir d0/d7/dd/d49/d4b/d8c/dcd/d108/d11f/d148 0 2023-12-16T05:56:43.724 INFO:tasks.workunit.client.1.smithi156.stdout:8/586: getdents d3/d7/d62/d6b 0 2023-12-16T05:56:43.724 INFO:tasks.workunit.client.1.smithi156.stdout:8/587: truncate d3/d12/f6c 4942837 0 2023-12-16T05:56:43.727 INFO:tasks.workunit.client.1.smithi156.stdout:1/691: mknod d3/d17/d1c/d22/da4/ced 0 2023-12-16T05:56:43.728 INFO:tasks.workunit.client.1.smithi156.stdout:3/705: creat dc/df/d66/ffb x:0 0 0 2023-12-16T05:56:43.728 INFO:tasks.workunit.client.1.smithi156.stdout:3/706: truncate dc/df/dce/ff5 355647 0 2023-12-16T05:56:43.730 INFO:tasks.workunit.client.0.smithi155.stdout:2/946: symlink d0/d7/d57/d9b/l149 0 2023-12-16T05:56:43.731 INFO:tasks.workunit.client.1.smithi156.stdout:6/820: mkdir d9/d13/d2f/d51/d82/d89/d8e/d9a/dce/df0/d105 0 2023-12-16T05:56:43.737 INFO:tasks.workunit.client.0.smithi155.stdout:3/805: dread d0/d1e/f59 [0,4194304] 0 2023-12-16T05:56:43.737 INFO:tasks.workunit.client.0.smithi155.stdout:3/806: read - d0/d1e/d4e/d81/fe4 zero size 2023-12-16T05:56:43.737 INFO:tasks.workunit.client.0.smithi155.stdout:2/947: truncate d0/d7/d57/d63/de7/fa1 4092882 0 2023-12-16T05:56:43.737 INFO:tasks.workunit.client.0.smithi155.stdout:2/948: write d0/d5/d6/d5f/df9/f117 [339688,43082] 0 2023-12-16T05:56:43.737 INFO:tasks.workunit.client.1.smithi156.stdout:6/821: dread d9/fc8 [0,4194304] 0 2023-12-16T05:56:43.738 INFO:tasks.workunit.client.1.smithi156.stdout:8/588: mkdir d3/d7/d62/dc4 0 2023-12-16T05:56:43.738 INFO:tasks.workunit.client.1.smithi156.stdout:9/755: unlink d6/d2e/c61 0 2023-12-16T05:56:43.738 INFO:tasks.workunit.client.0.smithi155.stdout:3/807: link d0/f7f d0/d14/d87/dec/ffd 0 2023-12-16T05:56:43.739 INFO:tasks.workunit.client.0.smithi155.stdout:3/808: write d0/d14/d87/dec/fdc [755637,10771] 0 2023-12-16T05:56:43.739 INFO:tasks.workunit.client.0.smithi155.stdout:3/809: fdatasync d0/f55 0 2023-12-16T05:56:43.739 INFO:tasks.workunit.client.0.smithi155.stdout:2/949: truncate d0/d7/dd/d14/f2d 537003 0 2023-12-16T05:56:43.745 INFO:tasks.workunit.client.1.smithi156.stdout:1/692: creat d3/d3a/db1/fee x:0 0 0 2023-12-16T05:56:43.746 INFO:tasks.workunit.client.1.smithi156.stdout:6/822: creat d9/d13/d2f/d51/d82/d89/f106 x:0 0 0 2023-12-16T05:56:43.747 INFO:tasks.workunit.client.1.smithi156.stdout:8/589: fdatasync d3/d7/d66/f71 0 2023-12-16T05:56:43.748 INFO:tasks.workunit.client.1.smithi156.stdout:1/693: rename d3/l13 to d3/d17/d1c/d22/d57/d61/dc1/dbe/dd2/lef 0 2023-12-16T05:56:43.748 INFO:tasks.workunit.client.1.smithi156.stdout:1/694: truncate d3/d17/d4d/f83 1022187 0 2023-12-16T05:56:43.748 INFO:tasks.workunit.client.1.smithi156.stdout:1/695: truncate d3/d1b/d8b/f93 1691619 0 2023-12-16T05:56:43.748 INFO:tasks.workunit.client.1.smithi156.stdout:1/696: chown d3/cd 20719 1 2023-12-16T05:56:43.749 INFO:tasks.workunit.client.1.smithi156.stdout:6/823: mkdir d9/d13/d2f/d51/d82/d89/d8e/d9a/dce/df0/d107 0 2023-12-16T05:56:43.749 INFO:tasks.workunit.client.1.smithi156.stdout:8/590: creat d3/d12/d16/db4/fc5 x:0 0 0 2023-12-16T05:56:43.750 INFO:tasks.workunit.client.1.smithi156.stdout:1/697: creat d3/d17/daa/ff0 x:0 0 0 2023-12-16T05:56:43.750 INFO:tasks.workunit.client.1.smithi156.stdout:1/698: chown d3/d17/d2d/fc5 17774 1 2023-12-16T05:56:43.751 INFO:tasks.workunit.client.1.smithi156.stdout:6/824: rmdir d9/d13/d2f/d51/d82/d89/d8e/d9a/dce/df0/d105 0 2023-12-16T05:56:43.752 INFO:tasks.workunit.client.1.smithi156.stdout:8/591: mknod d3/d12/d95/cc6 0 2023-12-16T05:56:43.753 INFO:tasks.workunit.client.0.smithi155.stdout:7/874: dwrite d0/d6a/d1a/d8c/d34/d4b/d60/f7b [0,4194304] 0 2023-12-16T05:56:43.753 INFO:tasks.workunit.client.1.smithi156.stdout:1/699: creat d3/d3a/db1/ff1 x:0 0 0 2023-12-16T05:56:43.754 INFO:tasks.workunit.client.1.smithi156.stdout:8/592: creat d3/d7a/d7d/fc7 x:0 0 0 2023-12-16T05:56:43.754 INFO:tasks.workunit.client.1.smithi156.stdout:8/593: stat d3/d7/d66/f71 0 2023-12-16T05:56:43.754 INFO:tasks.workunit.client.1.smithi156.stdout:1/700: link d3/d17/d1c/l6d d3/d17/d2d/lf2 0 2023-12-16T05:56:43.755 INFO:tasks.workunit.client.1.smithi156.stdout:1/701: symlink d3/d17/d4d/dc2/d4f/d75/lf3 0 2023-12-16T05:56:43.756 INFO:tasks.workunit.client.0.smithi155.stdout:7/875: creat d0/d6a/d1a/d8c/d34/d4b/d64/f11f x:0 0 0 2023-12-16T05:56:43.756 INFO:tasks.workunit.client.0.smithi155.stdout:7/876: getdents d0/d6a/d1a/d8c/d34/d4b/d64/d101 0 2023-12-16T05:56:43.756 INFO:tasks.workunit.client.1.smithi156.stdout:1/702: mknod d3/d17/d1c/d22/d57/d61/dc1/dbe/dd2/cf4 0 2023-12-16T05:56:43.756 INFO:tasks.workunit.client.0.smithi155.stdout:3/810: dread d0/f7f [0,4194304] 0 2023-12-16T05:56:43.762 INFO:tasks.workunit.client.1.smithi156.stdout:8/594: write d3/d7a/d7d/dae/f57 [118248,91790] 0 2023-12-16T05:56:43.764 INFO:tasks.workunit.client.1.smithi156.stdout:8/595: creat d3/d7/d27/d46/d6e/d3c/fc8 x:0 0 0 2023-12-16T05:56:43.766 INFO:tasks.workunit.client.1.smithi156.stdout:6/825: dread d9/d13/d3e/d5f/f75 [0,4194304] 0 2023-12-16T05:56:43.770 INFO:tasks.workunit.client.0.smithi155.stdout:3/811: dread d0/f11 [0,4194304] 0 2023-12-16T05:56:43.779 INFO:tasks.workunit.client.0.smithi155.stdout:3/812: dread d0/d14/f50 [0,4194304] 0 2023-12-16T05:56:43.783 INFO:tasks.workunit.client.1.smithi156.stdout:3/707: dwrite dc/d56/fdb [0,4194304] 0 2023-12-16T05:56:43.787 INFO:tasks.workunit.client.1.smithi156.stdout:5/967: dwrite da/f1e [0,4194304] 0 2023-12-16T05:56:43.787 INFO:tasks.workunit.client.1.smithi156.stdout:6/826: dread d9/d1c/d50/fa1 [0,4194304] 0 2023-12-16T05:56:43.788 INFO:tasks.workunit.client.1.smithi156.stdout:5/968: link da/dc/d2d/c75 da/dc/d4b/d6c/d7c/c145 0 2023-12-16T05:56:43.789 INFO:tasks.workunit.client.0.smithi155.stdout:4/907: dwrite d0/da/de0/d16/d30/dce/d75/d10e/d70/d92/daf/db7/fd9 [0,4194304] 0 2023-12-16T05:56:43.789 INFO:tasks.workunit.client.1.smithi156.stdout:9/756: dwrite d6/d19/d25/d3a/d88/d8b/f90 [0,4194304] 0 2023-12-16T05:56:43.789 INFO:tasks.workunit.client.1.smithi156.stdout:9/757: write d6/d19/d25/d3a/dc3/fc8 [364285,113107] 0 2023-12-16T05:56:43.790 INFO:tasks.workunit.client.1.smithi156.stdout:2/748: dwrite d9/dd/f19 [0,4194304] 0 2023-12-16T05:56:43.790 INFO:tasks.workunit.client.1.smithi156.stdout:6/827: rename d9/d13/d2f/d51/d82/f8f to d9/f108 0 2023-12-16T05:56:43.791 INFO:tasks.workunit.client.1.smithi156.stdout:4/715: dwrite d9/d2b/d98/d99/f83 [0,4194304] 0 2023-12-16T05:56:43.792 INFO:tasks.workunit.client.1.smithi156.stdout:5/969: link da/dc/d2d/d4d/c51 da/dc/d2d/d4d/d54/da6/c146 0 2023-12-16T05:56:43.793 INFO:tasks.workunit.client.0.smithi155.stdout:7/877: dwrite d0/d6a/d1a/d22/fec [0,4194304] 0 2023-12-16T05:56:43.796 INFO:tasks.workunit.client.1.smithi156.stdout:8/596: dwrite d3/d7/d27/d46/d6e/d3c/f55 [0,4194304] 0 2023-12-16T05:56:43.796 INFO:tasks.workunit.client.0.smithi155.stdout:7/878: write d0/d6a/d1a/d8c/d34/d4b/d64/d6e/f7e [1191360,42151] 0 2023-12-16T05:56:43.797 INFO:tasks.workunit.client.0.smithi155.stdout:7/879: chown d0/d6a/d1a/d38/f9f 919953 1 2023-12-16T05:56:43.798 INFO:tasks.workunit.client.1.smithi156.stdout:9/758: getdents d6/da3 0 2023-12-16T05:56:43.800 INFO:tasks.workunit.client.1.smithi156.stdout:2/749: rmdir d9/d12/dc2/dd8/da6/d80 39 2023-12-16T05:56:43.801 INFO:tasks.workunit.client.1.smithi156.stdout:2/750: chown d9/dd/d17/f1d 433 1 2023-12-16T05:56:43.801 INFO:tasks.workunit.client.1.smithi156.stdout:9/759: write d6/fd [7938709,13547] 0 2023-12-16T05:56:43.801 INFO:tasks.workunit.client.1.smithi156.stdout:9/760: write d6/d19/d25/d3a/d5e/f67 [904801,18670] 0 2023-12-16T05:56:43.805 INFO:tasks.workunit.client.1.smithi156.stdout:9/761: write d6/d2e/f7a [2209430,34163] 0 2023-12-16T05:56:43.805 INFO:tasks.workunit.client.1.smithi156.stdout:9/762: write d6/d19/d25/d3a/d5e/da9/de1/dfc/fa7 [386346,51756] 0 2023-12-16T05:56:43.805 INFO:tasks.workunit.client.1.smithi156.stdout:9/763: stat d6/da3/lf3 0 2023-12-16T05:56:43.805 INFO:tasks.workunit.client.1.smithi156.stdout:6/828: dwrite d9/d13/d3e/ff3 [0,4194304] 0 2023-12-16T05:56:43.805 INFO:tasks.workunit.client.1.smithi156.stdout:6/829: fsync d9/d1c/d50/dbf/fc5 0 2023-12-16T05:56:43.806 INFO:tasks.workunit.client.1.smithi156.stdout:6/830: read - d9/d1c/d50/dd9/f102 zero size 2023-12-16T05:56:43.806 INFO:tasks.workunit.client.0.smithi155.stdout:3/813: dwrite d0/d14/d36/d47/fdd [0,4194304] 0 2023-12-16T05:56:43.807 INFO:tasks.workunit.client.1.smithi156.stdout:8/597: dread d3/d7/d27/d46/d6e/d3c/f6a [12582912,4194304] 0 2023-12-16T05:56:43.808 INFO:tasks.workunit.client.1.smithi156.stdout:8/598: truncate d3/d6/f8c 694108 0 2023-12-16T05:56:43.813 INFO:tasks.workunit.client.1.smithi156.stdout:4/716: truncate d9/d2b/f3c 527728 0 2023-12-16T05:56:43.817 INFO:tasks.workunit.client.1.smithi156.stdout:2/751: getdents d9/d68/daa/db4 0 2023-12-16T05:56:43.821 INFO:tasks.workunit.client.1.smithi156.stdout:9/764: creat d6/d19/d25/d3a/d88/d8b/ffd x:0 0 0 2023-12-16T05:56:43.823 INFO:tasks.workunit.client.1.smithi156.stdout:6/831: mknod d9/d1c/c109 0 2023-12-16T05:56:43.825 INFO:tasks.workunit.client.1.smithi156.stdout:4/717: creat d9/d2b/d9a/ff2 x:0 0 0 2023-12-16T05:56:43.826 INFO:tasks.workunit.client.1.smithi156.stdout:9/765: mknod d6/d19/d25/d3a/d80/dc0/dd4/cfe 0 2023-12-16T05:56:43.829 INFO:tasks.workunit.client.1.smithi156.stdout:6/832: mkdir d9/d13/d3e/d5f/d10a 0 2023-12-16T05:56:43.829 INFO:tasks.workunit.client.1.smithi156.stdout:6/833: write d9/d13/d2f/d51/fc6 [1199796,47108] 0 2023-12-16T05:56:43.830 INFO:tasks.workunit.client.1.smithi156.stdout:9/766: mkdir d6/d19/d25/d3a/d88/d8b/dac/dff 0 2023-12-16T05:56:43.831 INFO:tasks.workunit.client.1.smithi156.stdout:6/834: mkdir d9/d13/d2f/d51/dad/d10b 0 2023-12-16T05:56:43.831 INFO:tasks.workunit.client.1.smithi156.stdout:6/835: write d9/fdc [218973,111534] 0 2023-12-16T05:56:43.832 INFO:tasks.workunit.client.1.smithi156.stdout:6/836: readlink d9/d13/d2f/d51/ld0 0 2023-12-16T05:56:43.832 INFO:tasks.workunit.client.1.smithi156.stdout:9/767: creat d6/d19/d25/d3a/d5e/da9/de1/dfc/f100 x:0 0 0 2023-12-16T05:56:43.833 INFO:tasks.workunit.client.1.smithi156.stdout:6/837: unlink d9/d13/d2f/d51/d82/d89/fcb 0 2023-12-16T05:56:43.833 INFO:tasks.workunit.client.1.smithi156.stdout:6/838: truncate d9/d13/d2f/d51/d6b/d77/fc7 970284 0 2023-12-16T05:56:43.834 INFO:tasks.workunit.client.1.smithi156.stdout:6/839: mknod d9/d13/d2f/d36/c10c 0 2023-12-16T05:56:43.834 INFO:tasks.workunit.client.1.smithi156.stdout:6/840: fdatasync d9/d1c/f9e 0 2023-12-16T05:56:43.837 INFO:tasks.workunit.client.1.smithi156.stdout:6/841: link d9/d13/d3e/d5f/d6e/c95 d9/d1c/d50/dbf/dc0/c10d 0 2023-12-16T05:56:43.837 INFO:tasks.workunit.client.1.smithi156.stdout:6/842: stat d9/d13/d3e/d5f 0 2023-12-16T05:56:43.858 INFO:tasks.workunit.client.0.smithi155.stdout:4/908: mknod d0/da/de0/d16/d30/d52/d88/d9e/d103/de2/c12e 0 2023-12-16T05:56:43.859 INFO:tasks.workunit.client.0.smithi155.stdout:4/909: stat d0/da/de0/d16/d30/d52/d88/dab 0 2023-12-16T05:56:43.861 INFO:tasks.workunit.client.1.smithi156.stdout:8/599: dread d3/d7/d27/d46/d6e/d3c/f6a [4194304,4194304] 0 2023-12-16T05:56:43.863 INFO:tasks.workunit.client.1.smithi156.stdout:8/600: creat d3/d7/d27/d46/d6e/fc9 x:0 0 0 2023-12-16T05:56:43.863 INFO:tasks.workunit.client.1.smithi156.stdout:8/601: write d3/d7/d27/f59 [4552200,89372] 0 2023-12-16T05:56:43.866 INFO:tasks.workunit.client.0.smithi155.stdout:7/880: rename d0/d6a/d1a/d8c/d34/d4b/d60/dd8/c102 to d0/d6a/d31/c120 0 2023-12-16T05:56:43.866 INFO:tasks.workunit.client.0.smithi155.stdout:7/881: readlink d0/d6a/d1a/d8c/d34/d4b/d64/lb0 0 2023-12-16T05:56:43.868 INFO:tasks.workunit.client.1.smithi156.stdout:0/877: sync 2023-12-16T05:56:43.869 INFO:tasks.workunit.client.0.smithi155.stdout:3/814: link d0/d14/d36/d47/d5f/c86 d0/d1a/d33/d57/dba/cfe 0 2023-12-16T05:56:43.871 INFO:tasks.workunit.client.0.smithi155.stdout:7/882: rename d0/d6a/d1a/cb5 to d0/d1b/dbe/c121 0 2023-12-16T05:56:43.871 INFO:tasks.workunit.client.0.smithi155.stdout:7/883: write d0/d6a/d1a/d2b/d2c/d5d/f8e [379336,15831] 0 2023-12-16T05:56:43.872 INFO:tasks.workunit.client.0.smithi155.stdout:3/815: getdents d0/d14/d36 0 2023-12-16T05:56:43.873 INFO:tasks.workunit.client.0.smithi155.stdout:7/884: rename d0/d6a/d1a/d8c/d42 to d0/d1b/d122 0 2023-12-16T05:56:43.874 INFO:tasks.workunit.client.0.smithi155.stdout:3/816: mkdir d0/d14/d45/dcd/dff 0 2023-12-16T05:56:43.874 INFO:tasks.workunit.client.0.smithi155.stdout:3/817: write d0/f11 [4616569,89723] 0 2023-12-16T05:56:43.875 INFO:tasks.workunit.client.0.smithi155.stdout:3/818: read d0/d14/f50 [3565520,114089] 0 2023-12-16T05:56:43.876 INFO:tasks.workunit.client.1.smithi156.stdout:9/768: dwrite f3 [0,4194304] 0 2023-12-16T05:56:43.878 INFO:tasks.workunit.client.1.smithi156.stdout:9/769: creat d6/d19/d25/d72/f101 x:0 0 0 2023-12-16T05:56:43.880 INFO:tasks.workunit.client.1.smithi156.stdout:0/878: dread d2/d23/d4a/f8b [0,4194304] 0 2023-12-16T05:56:43.880 INFO:tasks.workunit.client.1.smithi156.stdout:0/879: stat d2/d7/dd/d2d/d5e/d110/dbc/dd2/f103 0 2023-12-16T05:56:43.880 INFO:tasks.workunit.client.1.smithi156.stdout:4/718: dwrite d9/d2c/dbf/dcf/fde [0,4194304] 0 2023-12-16T05:56:43.880 INFO:tasks.workunit.client.1.smithi156.stdout:4/719: fdatasync f0 0 2023-12-16T05:56:43.880 INFO:tasks.workunit.client.1.smithi156.stdout:4/720: fdatasync d9/d43/f62 0 2023-12-16T05:56:43.882 INFO:tasks.workunit.client.0.smithi155.stdout:3/819: write d0/d14/d36/d47/f98 [5173956,64371] 0 2023-12-16T05:56:43.882 INFO:tasks.workunit.client.0.smithi155.stdout:3/820: chown d0/d1a/d91/dde 0 1 2023-12-16T05:56:43.882 INFO:tasks.workunit.client.0.smithi155.stdout:3/821: write d0/d14/d45/dcd/fe9 [648091,32657] 0 2023-12-16T05:56:43.882 INFO:tasks.workunit.client.0.smithi155.stdout:3/822: readlink d0/d1e/le8 0 2023-12-16T05:56:43.882 INFO:tasks.workunit.client.0.smithi155.stdout:3/823: truncate d0/d14/d36/d47/d5f/dca/fe0 716698 0 2023-12-16T05:56:43.883 INFO:tasks.workunit.client.1.smithi156.stdout:2/752: dwrite d9/d12/dc2/dd8/da6/f6f [0,4194304] 0 2023-12-16T05:56:43.883 INFO:tasks.workunit.client.1.smithi156.stdout:9/770: getdents d6/d2e/d8a 0 2023-12-16T05:56:43.885 INFO:tasks.workunit.client.1.smithi156.stdout:8/602: dwrite d3/d7a/d7d/dae/f39 [0,4194304] 0 2023-12-16T05:56:43.885 INFO:tasks.workunit.client.1.smithi156.stdout:8/603: chown d3/d12/d95/cc6 463 1 2023-12-16T05:56:43.885 INFO:tasks.workunit.client.1.smithi156.stdout:8/604: fsync d3/d12/d16/d54/f99 0 2023-12-16T05:56:43.888 INFO:tasks.workunit.client.0.smithi155.stdout:3/824: read d0/d1e/f68 [789411,92990] 0 2023-12-16T05:56:43.888 INFO:tasks.workunit.client.0.smithi155.stdout:3/825: fsync d0/d14/d45/f54 0 2023-12-16T05:56:43.889 INFO:tasks.workunit.client.0.smithi155.stdout:3/826: write d0/d14/d87/d94/da1/fb4 [131480,125581] 0 2023-12-16T05:56:43.891 INFO:tasks.workunit.client.0.smithi155.stdout:4/910: dwrite d0/d10/f2c [0,4194304] 0 2023-12-16T05:56:43.891 INFO:tasks.workunit.client.0.smithi155.stdout:4/911: write d0/da/de0/d16/d30/dce/d75/f100 [1590540,81237] 0 2023-12-16T05:56:43.892 INFO:tasks.workunit.client.1.smithi156.stdout:6/843: dwrite d9/d13/f3d [0,4194304] 0 2023-12-16T05:56:43.892 INFO:tasks.workunit.client.1.smithi156.stdout:6/844: fsync d9/d1c/f46 0 2023-12-16T05:56:43.892 INFO:tasks.workunit.client.1.smithi156.stdout:6/845: write d9/d13/d2f/d36/f79 [1981464,110651] 0 2023-12-16T05:56:43.892 INFO:tasks.workunit.client.0.smithi155.stdout:3/827: write d0/d14/d87/f9c [1128153,70167] 0 2023-12-16T05:56:43.892 INFO:tasks.workunit.client.0.smithi155.stdout:4/912: mknod d0/da/de0/d16/d30/d52/d88/dab/c12f 0 2023-12-16T05:56:43.894 INFO:tasks.workunit.client.0.smithi155.stdout:3/828: creat d0/d1a/d33/f100 x:0 0 0 2023-12-16T05:56:43.894 INFO:tasks.workunit.client.0.smithi155.stdout:3/829: readlink d0/d14/d36/d7c/lc0 0 2023-12-16T05:56:43.895 INFO:tasks.workunit.client.1.smithi156.stdout:4/721: truncate d9/d2c/f3e 1361235 0 2023-12-16T05:56:43.897 INFO:tasks.workunit.client.0.smithi155.stdout:4/913: rmdir d0/da/de0/d16/d30/dce/d75/d3d/d49/dbb 39 2023-12-16T05:56:43.899 INFO:tasks.workunit.client.0.smithi155.stdout:3/830: unlink d0/d14/d36/d47/d5f/fbb 0 2023-12-16T05:56:43.900 INFO:tasks.workunit.client.0.smithi155.stdout:3/831: mkdir d0/d14/d87/d94/d101 0 2023-12-16T05:56:43.900 INFO:tasks.workunit.client.0.smithi155.stdout:3/832: fdatasync d0/d14/d87/d94/ff8 0 2023-12-16T05:56:43.900 INFO:tasks.workunit.client.0.smithi155.stdout:3/833: stat d0/d1e/l64 0 2023-12-16T05:56:43.901 INFO:tasks.workunit.client.1.smithi156.stdout:4/722: read d9/d2c/d48/fe1 [3553789,75818] 0 2023-12-16T05:56:43.901 INFO:tasks.workunit.client.1.smithi156.stdout:9/771: dread d6/d19/f1a [0,4194304] 0 2023-12-16T05:56:43.904 INFO:tasks.workunit.client.1.smithi156.stdout:4/723: creat d9/d2c/d48/dae/ff3 x:0 0 0 2023-12-16T05:56:43.905 INFO:tasks.workunit.client.0.smithi155.stdout:7/885: dwrite d0/d6a/d1a/d8c/d34/d6c/fcb [0,4194304] 0 2023-12-16T05:56:43.905 INFO:tasks.workunit.client.0.smithi155.stdout:3/834: write d0/d1e/f49 [245402,22310] 0 2023-12-16T05:56:43.905 INFO:tasks.workunit.client.1.smithi156.stdout:9/772: creat d6/d2e/d8a/da5/f102 x:0 0 0 2023-12-16T05:56:43.907 INFO:tasks.workunit.client.0.smithi155.stdout:3/835: write d0/d1a/d33/ff4 [2738760,93640] 0 2023-12-16T05:56:43.907 INFO:tasks.workunit.client.1.smithi156.stdout:4/724: creat d9/d2b/d35/dd3/ff4 x:0 0 0 2023-12-16T05:56:43.909 INFO:tasks.workunit.client.0.smithi155.stdout:7/886: unlink d0/d1b/d122/d98/f50 0 2023-12-16T05:56:43.909 INFO:tasks.workunit.client.1.smithi156.stdout:4/725: creat d9/d2b/d35/dd3/ff5 x:0 0 0 2023-12-16T05:56:43.911 INFO:tasks.workunit.client.1.smithi156.stdout:9/773: mkdir d6/d103 0 2023-12-16T05:56:43.911 INFO:tasks.workunit.client.0.smithi155.stdout:3/836: creat d0/d14/d36/f102 x:0 0 0 2023-12-16T05:56:43.912 INFO:tasks.workunit.client.1.smithi156.stdout:4/726: creat d9/d2c/d7a/dd4/ff6 x:0 0 0 2023-12-16T05:56:43.913 INFO:tasks.workunit.client.0.smithi155.stdout:7/887: truncate d0/d1/f21 1874487 0 2023-12-16T05:56:43.913 INFO:tasks.workunit.client.1.smithi156.stdout:9/774: creat d6/d19/d25/d3a/d5e/f104 x:0 0 0 2023-12-16T05:56:43.913 INFO:tasks.workunit.client.1.smithi156.stdout:2/753: dwrite f5 [0,4194304] 0 2023-12-16T05:56:43.914 INFO:tasks.workunit.client.1.smithi156.stdout:0/880: dwrite d2/d7/dd/d2d/d5e/d110/dbc/dd2/f103 [0,4194304] 0 2023-12-16T05:56:43.915 INFO:tasks.workunit.client.1.smithi156.stdout:0/881: write d2/d7/dd/f33 [5752335,99389] 0 2023-12-16T05:56:43.916 INFO:tasks.workunit.client.1.smithi156.stdout:9/775: mknod d6/da3/c105 0 2023-12-16T05:56:43.920 INFO:tasks.workunit.client.1.smithi156.stdout:9/776: mknod d6/d19/d30/c106 0 2023-12-16T05:56:43.921 INFO:tasks.workunit.client.1.smithi156.stdout:9/777: write d6/d19/d25/d3a/f4a [502103,120971] 0 2023-12-16T05:56:43.921 INFO:tasks.workunit.client.1.smithi156.stdout:9/778: read - d6/f15 zero size 2023-12-16T05:56:43.922 INFO:tasks.workunit.client.1.smithi156.stdout:9/779: unlink d6/d19/d25/d72/ce5 0 2023-12-16T05:56:43.925 INFO:tasks.workunit.client.1.smithi156.stdout:9/780: unlink d6/d19/d25/l2b 0 2023-12-16T05:56:43.927 INFO:tasks.workunit.client.1.smithi156.stdout:9/781: link d6/d19/d25/d3a/dc3/lf2 d6/d19/d30/d48/d87/l107 0 2023-12-16T05:56:43.927 INFO:tasks.workunit.client.1.smithi156.stdout:9/782: readlink d6/d19/d30/dae/db7/lc1 0 2023-12-16T05:56:43.928 INFO:tasks.workunit.client.1.smithi156.stdout:9/783: truncate d6/f98 489237 0 2023-12-16T05:56:43.930 INFO:tasks.workunit.client.1.smithi156.stdout:9/784: symlink d6/da3/db0/l108 0 2023-12-16T05:56:43.935 INFO:tasks.workunit.client.1.smithi156.stdout:0/882: dread d2/d7/dd/d29/d4b/dc0/df2/fce [0,4194304] 0 2023-12-16T05:56:43.937 INFO:tasks.workunit.client.1.smithi156.stdout:9/785: dread d6/d19/f32 [0,4194304] 0 2023-12-16T05:56:43.941 INFO:tasks.workunit.client.1.smithi156.stdout:9/786: rmdir d6/d19/d25/d3a/d88/d8b/dac/dff 0 2023-12-16T05:56:43.941 INFO:tasks.workunit.client.1.smithi156.stdout:9/787: write d6/d19/d25/d3a/fcf [210498,65764] 0 2023-12-16T05:56:43.941 INFO:tasks.workunit.client.1.smithi156.stdout:9/788: unlink d6/d19/f20 0 2023-12-16T05:56:43.944 INFO:tasks.workunit.client.1.smithi156.stdout:8/605: dwrite d3/d7/d27/fb0 [0,4194304] 0 2023-12-16T05:56:43.945 INFO:tasks.workunit.client.0.smithi155.stdout:4/914: dwrite d0/da/de0/d16/d30/dce/d75/f23 [0,4194304] 0 2023-12-16T05:56:43.945 INFO:tasks.workunit.client.0.smithi155.stdout:4/915: chown d0/da/de0/d16/l21 229639477 1 2023-12-16T05:56:43.955 INFO:tasks.workunit.client.1.smithi156.stdout:4/727: dwrite d9/d2b/d35/fee [0,4194304] 0 2023-12-16T05:56:43.956 INFO:tasks.workunit.client.1.smithi156.stdout:2/754: dwrite d9/d12/dc2/dd8/dad/fb8 [0,4194304] 0 2023-12-16T05:56:43.959 INFO:tasks.workunit.client.1.smithi156.stdout:2/755: creat d9/dd/d17/d33/d47/fec x:0 0 0 2023-12-16T05:56:43.963 INFO:tasks.workunit.client.1.smithi156.stdout:6/846: dwrite d9/d13/d2f/d36/f65 [4194304,4194304] 0 2023-12-16T05:56:43.963 INFO:tasks.workunit.client.0.smithi155.stdout:3/837: fsync d0/f11 0 2023-12-16T05:56:43.963 INFO:tasks.workunit.client.0.smithi155.stdout:7/888: dwrite d0/d6a/d1a/d8c/d34/d6c/f10a [0,4194304] 0 2023-12-16T05:56:43.964 INFO:tasks.workunit.client.1.smithi156.stdout:6/847: dread d9/d13/d2f/d51/d69/d99/f9c [0,4194304] 0 2023-12-16T05:56:43.964 INFO:tasks.workunit.client.1.smithi156.stdout:6/848: fdatasync d9/d13/d2f/d51/d6b/fae 0 2023-12-16T05:56:43.966 INFO:tasks.workunit.client.1.smithi156.stdout:6/849: mknod d9/d13/d2f/d51/c10e 0 2023-12-16T05:56:43.966 INFO:tasks.workunit.client.1.smithi156.stdout:5/970: sync 2023-12-16T05:56:43.966 INFO:tasks.workunit.client.1.smithi156.stdout:3/708: sync 2023-12-16T05:56:43.967 INFO:tasks.workunit.client.1.smithi156.stdout:5/971: fsync da/dc/d4b/d6c/d77/d8f/fe8 0 2023-12-16T05:56:43.967 INFO:tasks.workunit.client.1.smithi156.stdout:1/703: sync 2023-12-16T05:56:43.967 INFO:tasks.workunit.client.1.smithi156.stdout:1/704: dread - d3/d1b/f40 zero size 2023-12-16T05:56:43.967 INFO:tasks.workunit.client.1.smithi156.stdout:5/972: write da/dc/f9f [1353779,41546] 0 2023-12-16T05:56:43.967 INFO:tasks.workunit.client.1.smithi156.stdout:5/973: truncate da/dc/d4b/d6c/d81/dc5/fea 97700 0 2023-12-16T05:56:43.968 INFO:tasks.workunit.client.1.smithi156.stdout:6/850: mknod d9/d13/d2f/d51/d82/d89/d8e/c10f 0 2023-12-16T05:56:43.969 INFO:tasks.workunit.client.1.smithi156.stdout:3/709: symlink dc/d10/d1d/d4b/d52/lfc 0 2023-12-16T05:56:43.969 INFO:tasks.workunit.client.1.smithi156.stdout:3/710: chown dc/d10/d3d/db5 9 1 2023-12-16T05:56:43.969 INFO:tasks.workunit.client.1.smithi156.stdout:1/705: creat d3/d3a/db1/ff5 x:0 0 0 2023-12-16T05:56:43.970 INFO:tasks.workunit.client.0.smithi155.stdout:7/889: write d0/fd2 [1814042,93047] 0 2023-12-16T05:56:43.970 INFO:tasks.workunit.client.0.smithi155.stdout:3/838: creat d0/d14/d45/dcd/dff/f103 x:0 0 0 2023-12-16T05:56:43.971 INFO:tasks.workunit.client.1.smithi156.stdout:5/974: write da/dc/d2d/ff4 [1917445,2961] 0 2023-12-16T05:56:43.971 INFO:tasks.workunit.client.1.smithi156.stdout:5/975: stat da/dc/c65 0 2023-12-16T05:56:43.972 INFO:tasks.workunit.client.1.smithi156.stdout:3/711: mknod dc/df/d34/cfd 0 2023-12-16T05:56:43.973 INFO:tasks.workunit.client.1.smithi156.stdout:1/706: unlink d3/d17/c42 0 2023-12-16T05:56:43.976 INFO:tasks.workunit.client.0.smithi155.stdout:7/890: dread d0/d1b/d78/f96 [0,4194304] 0 2023-12-16T05:56:43.976 INFO:tasks.workunit.client.0.smithi155.stdout:3/839: rename d0/cf to d0/d14/d36/d7c/df0/c104 0 2023-12-16T05:56:43.977 INFO:tasks.workunit.client.0.smithi155.stdout:7/891: symlink d0/d1b/d103/l123 0 2023-12-16T05:56:43.977 INFO:tasks.workunit.client.1.smithi156.stdout:5/976: rmdir da/dc/d4b/d6c/d7c 39 2023-12-16T05:56:43.979 INFO:tasks.workunit.client.0.smithi155.stdout:3/840: mkdir d0/d1a/d33/d105 0 2023-12-16T05:56:43.979 INFO:tasks.workunit.client.1.smithi156.stdout:5/977: creat da/dc/d2d/d34/df6/f147 x:0 0 0 2023-12-16T05:56:43.985 INFO:tasks.workunit.client.0.smithi155.stdout:7/892: rename d0/d1/d5/c40 to d0/d1b/c124 0 2023-12-16T05:56:43.986 INFO:tasks.workunit.client.1.smithi156.stdout:0/883: dwrite d2/d7/dd/d1c/f25 [0,4194304] 0 2023-12-16T05:56:43.986 INFO:tasks.workunit.client.1.smithi156.stdout:0/884: chown d2/d7/dd/d2d 1 1 2023-12-16T05:56:43.986 INFO:tasks.workunit.client.1.smithi156.stdout:0/885: chown d2/d7/dd/d29/d38/c9d 1070577 1 2023-12-16T05:56:43.986 INFO:tasks.workunit.client.1.smithi156.stdout:0/886: truncate d2/d7/dd/d2d/d5e/fec 340450 0 2023-12-16T05:56:43.986 INFO:tasks.workunit.client.1.smithi156.stdout:0/887: chown d2/d7/dd/d29/d38/d51/l9f 98804 1 2023-12-16T05:56:43.986 INFO:tasks.workunit.client.1.smithi156.stdout:0/888: fsync d2/d7/f3c 0 2023-12-16T05:56:43.986 INFO:tasks.workunit.client.1.smithi156.stdout:2/756: dwrite d9/dd/d17/d33/d78/d74/fe6 [0,4194304] 0 2023-12-16T05:56:43.987 INFO:tasks.workunit.client.0.smithi155.stdout:4/916: dwrite d0/da/de0/d16/d30/d52/d88/f94 [0,4194304] 0 2023-12-16T05:56:43.987 INFO:tasks.workunit.client.0.smithi155.stdout:4/917: fsync d0/da/de0/d16/d30/d52/d88/d9e/fc4 0 2023-12-16T05:56:43.987 INFO:tasks.workunit.client.0.smithi155.stdout:7/893: unlink d0/d6a/d1a/d8c/d34/d4b/f7f 0 2023-12-16T05:56:43.997 INFO:tasks.workunit.client.1.smithi156.stdout:8/606: dwrite d3/f29 [0,4194304] 0 2023-12-16T05:56:44.000 INFO:tasks.workunit.client.1.smithi156.stdout:9/789: truncate d6/f46 860314 0 2023-12-16T05:56:44.001 INFO:tasks.workunit.client.1.smithi156.stdout:4/728: dwrite d9/d43/d58/fa8 [0,4194304] 0 2023-12-16T05:56:44.001 INFO:tasks.workunit.client.1.smithi156.stdout:4/729: chown d9/d2b/fe0 91377521 1 2023-12-16T05:56:44.001 INFO:tasks.workunit.client.1.smithi156.stdout:3/712: dwrite dc/df/fcd [0,4194304] 0 2023-12-16T05:56:44.002 INFO:tasks.workunit.client.1.smithi156.stdout:3/713: write dc/d10/db4/fd7 [4031228,108681] 0 2023-12-16T05:56:44.006 INFO:tasks.workunit.client.1.smithi156.stdout:8/607: mkdir d3/d7/d62/dca 0 2023-12-16T05:56:44.006 INFO:tasks.workunit.client.1.smithi156.stdout:8/608: dread - d3/d7/fb2 zero size 2023-12-16T05:56:44.006 INFO:tasks.workunit.client.1.smithi156.stdout:8/609: stat d3/d7a/fa4 0 2023-12-16T05:56:44.007 INFO:tasks.workunit.client.0.smithi155.stdout:7/894: getdents d0/d1b 0 2023-12-16T05:56:44.012 INFO:tasks.workunit.client.0.smithi155.stdout:4/918: write d0/da/de0/d16/d30/dce/d75/d3d/f4d [630891,48660] 0 2023-12-16T05:56:44.012 INFO:tasks.workunit.client.0.smithi155.stdout:5/992: sync 2023-12-16T05:56:44.012 INFO:tasks.workunit.client.0.smithi155.stdout:2/950: sync 2023-12-16T05:56:44.014 INFO:tasks.workunit.client.0.smithi155.stdout:4/919: creat d0/da/de0/d16/d30/f130 x:0 0 0 2023-12-16T05:56:44.014 INFO:tasks.workunit.client.1.smithi156.stdout:3/714: creat dc/df/d34/ffe x:0 0 0 2023-12-16T05:56:44.015 INFO:tasks.workunit.client.0.smithi155.stdout:5/993: symlink d0/d2/d2a/d30/d53/d7b/d99/d47/d61/l13e 0 2023-12-16T05:56:44.016 INFO:tasks.workunit.client.0.smithi155.stdout:2/951: mkdir d0/d7/dd/d49/d4b/d80/d14a 0 2023-12-16T05:56:44.016 INFO:tasks.workunit.client.0.smithi155.stdout:2/952: read - d0/d5/ffc zero size 2023-12-16T05:56:44.016 INFO:tasks.workunit.client.0.smithi155.stdout:2/953: chown d0/d7/dd/d49/d4b/leb 32331293 1 2023-12-16T05:56:44.016 INFO:tasks.workunit.client.1.smithi156.stdout:8/610: creat d3/d12/d16/db4/fcb x:0 0 0 2023-12-16T05:56:44.017 INFO:tasks.workunit.client.1.smithi156.stdout:8/611: truncate d3/d7/d27/f32 5583911 0 2023-12-16T05:56:44.017 INFO:tasks.workunit.client.1.smithi156.stdout:8/612: write d3/d7/d62/d6b/faa [239203,103667] 0 2023-12-16T05:56:44.017 INFO:tasks.workunit.client.0.smithi155.stdout:4/920: getdents d0/da/de0/d16/d30/dce 0 2023-12-16T05:56:44.017 INFO:tasks.workunit.client.1.smithi156.stdout:3/715: mkdir dc/d10/d1d/dff 0 2023-12-16T05:56:44.019 INFO:tasks.workunit.client.1.smithi156.stdout:6/851: rename d9/d13/d2f/d51/d82/d89 to d9/d13/d2f/d51/d69/d99/db9/d110 0 2023-12-16T05:56:44.019 INFO:tasks.workunit.client.1.smithi156.stdout:6/852: chown d9/f85 49 1 2023-12-16T05:56:44.019 INFO:tasks.workunit.client.1.smithi156.stdout:6/853: dread - d9/d1c/d50/dd9/fef zero size 2023-12-16T05:56:44.020 INFO:tasks.workunit.client.1.smithi156.stdout:8/613: unlink d3/d12/d16/d54/c56 0 2023-12-16T05:56:44.021 INFO:tasks.workunit.client.1.smithi156.stdout:6/854: mknod d9/d13/d2f/d51/d69/d99/db9/d110/d8e/d9a/dce/df0/df8/c111 0 2023-12-16T05:56:44.021 INFO:tasks.workunit.client.0.smithi155.stdout:5/994: mknod d0/d2/d2a/d19/d59/c13f 0 2023-12-16T05:56:44.021 INFO:tasks.workunit.client.0.smithi155.stdout:4/921: creat d0/da/de0/d16/d30/d52/d88/d9e/d103/f131 x:0 0 0 2023-12-16T05:56:44.022 INFO:tasks.workunit.client.0.smithi155.stdout:5/995: mknod d0/d60/d79/d8e/d123/c140 0 2023-12-16T05:56:44.023 INFO:tasks.workunit.client.1.smithi156.stdout:8/614: rename d3/d7/d62/l69 to d3/d7/d27/d46/d84/d85/d9b/lcc 0 2023-12-16T05:56:44.023 INFO:tasks.workunit.client.0.smithi155.stdout:4/922: creat d0/d10/def/dff/d10a/f132 x:0 0 0 2023-12-16T05:56:44.024 INFO:tasks.workunit.client.1.smithi156.stdout:8/615: stat d3/d7/d66/d76/fad 0 2023-12-16T05:56:44.025 INFO:tasks.workunit.client.0.smithi155.stdout:4/923: symlink d0/da/de0/d16/d30/dce/d75/d3d/d49/db1/l133 0 2023-12-16T05:56:44.025 INFO:tasks.workunit.client.0.smithi155.stdout:4/924: chown d0/da/de0/d16/l38 7582630 1 2023-12-16T05:56:44.027 INFO:tasks.workunit.client.1.smithi156.stdout:6/855: write d9/d13/d3e/d5f/f75 [1906942,81844] 0 2023-12-16T05:56:44.029 INFO:tasks.workunit.client.1.smithi156.stdout:6/856: creat d9/d13/d2f/d51/d69/d99/db9/d110/d8e/d9a/dce/df0/df8/f112 x:0 0 0 2023-12-16T05:56:44.029 INFO:tasks.workunit.client.1.smithi156.stdout:6/857: dread - d9/d13/d2f/d51/d69/d99/db9/d110/d8e/d9a/dce/df0/df8/f112 zero size 2023-12-16T05:56:44.030 INFO:tasks.workunit.client.1.smithi156.stdout:6/858: truncate d9/d13/d2f/f68 3525830 0 2023-12-16T05:56:44.033 INFO:tasks.workunit.client.1.smithi156.stdout:6/859: write d9/d1c/fac [274171,54386] 0 2023-12-16T05:56:44.036 INFO:tasks.workunit.client.0.smithi155.stdout:3/841: dwrite d0/d14/d36/d7c/fac [0,4194304] 0 2023-12-16T05:56:44.036 INFO:tasks.workunit.client.0.smithi155.stdout:3/842: write d0/d14/d87/d94/da1/db3/ff3 [652136,49818] 0 2023-12-16T05:56:44.036 INFO:tasks.workunit.client.1.smithi156.stdout:6/860: mkdir d9/d13/d3e/d5f/d113 0 2023-12-16T05:56:44.040 INFO:tasks.workunit.client.0.smithi155.stdout:4/925: dread d0/da/de0/d16/d30/d52/d88/f94 [0,4194304] 0 2023-12-16T05:56:44.041 INFO:tasks.workunit.client.1.smithi156.stdout:3/716: dread dc/d10/d1d/d4b/fa7 [0,4194304] 0 2023-12-16T05:56:44.041 INFO:tasks.workunit.client.1.smithi156.stdout:6/861: write d9/d13/d2f/d36/f63 [1461725,9686] 0 2023-12-16T05:56:44.042 INFO:tasks.workunit.client.0.smithi155.stdout:4/926: creat d0/da/de0/d16/d30/d52/f134 x:0 0 0 2023-12-16T05:56:44.042 INFO:tasks.workunit.client.1.smithi156.stdout:3/717: write fb [6135041,24277] 0 2023-12-16T05:56:44.043 INFO:tasks.workunit.client.1.smithi156.stdout:3/718: stat dc/d56/d69 0 2023-12-16T05:56:44.043 INFO:tasks.workunit.client.1.smithi156.stdout:6/862: mknod d9/d13/d2f/d51/dad/d10b/c114 0 2023-12-16T05:56:44.043 INFO:tasks.workunit.client.1.smithi156.stdout:6/863: chown d9/d13/d2f/d51/d6b/fd5 18430920 1 2023-12-16T05:56:44.043 INFO:tasks.workunit.client.1.smithi156.stdout:6/864: fdatasync d9/d13/d2f/d51/d69/d99/db9/d110/f106 0 2023-12-16T05:56:44.043 INFO:tasks.workunit.client.1.smithi156.stdout:3/719: chown dc/d56/d67/dbe/df9 114407713 1 2023-12-16T05:56:44.043 INFO:tasks.workunit.client.0.smithi155.stdout:4/927: mkdir d0/da/de0/d16/d30/dce/d75/d10e/dd1/d135 0 2023-12-16T05:56:44.044 INFO:tasks.workunit.client.1.smithi156.stdout:6/865: creat d9/d1c/d50/dbf/dc0/f115 x:0 0 0 2023-12-16T05:56:44.044 INFO:tasks.workunit.client.1.smithi156.stdout:3/720: getdents dc/df/d34/d62 0 2023-12-16T05:56:44.044 INFO:tasks.workunit.client.1.smithi156.stdout:6/866: getdents d9/d13/d2f/d51/d69/d99/db9/d110/d8e/d9a/dce 0 2023-12-16T05:56:44.045 INFO:tasks.workunit.client.0.smithi155.stdout:4/928: write d0/da/de0/d16/d30/dce/f66 [175624,93869] 0 2023-12-16T05:56:44.045 INFO:tasks.workunit.client.1.smithi156.stdout:3/721: dread - dc/d56/d67/d6e/fd6 zero size 2023-12-16T05:56:44.046 INFO:tasks.workunit.client.1.smithi156.stdout:6/867: mkdir d9/d1c/d50/d116 0 2023-12-16T05:56:44.046 INFO:tasks.workunit.client.0.smithi155.stdout:4/929: creat d0/da/de0/d16/d30/d52/d88/d9e/f136 x:0 0 0 2023-12-16T05:56:44.046 INFO:tasks.workunit.client.1.smithi156.stdout:3/722: symlink dc/d10/d1d/dff/l100 0 2023-12-16T05:56:44.047 INFO:tasks.workunit.client.0.smithi155.stdout:4/930: creat d0/da/de0/d16/d30/d52/f137 x:0 0 0 2023-12-16T05:56:44.047 INFO:tasks.workunit.client.1.smithi156.stdout:6/868: mkdir d9/d1c/d50/d116/d117 0 2023-12-16T05:56:44.048 INFO:tasks.workunit.client.1.smithi156.stdout:6/869: truncate d9/d13/d2f/d36/f5a 740955 0 2023-12-16T05:56:44.048 INFO:tasks.workunit.client.1.smithi156.stdout:0/889: dwrite d2/d23/d4a/f8b [0,4194304] 0 2023-12-16T05:56:44.049 INFO:tasks.workunit.client.1.smithi156.stdout:0/890: mknod d2/d7/dd/d2d/d5e/d8f/d102/d107/c115 0 2023-12-16T05:56:44.049 INFO:tasks.workunit.client.1.smithi156.stdout:0/891: write d2/d23/f70 [458432,112911] 0 2023-12-16T05:56:44.052 INFO:tasks.workunit.client.0.smithi155.stdout:3/843: dread d0/d14/d87/f9c [0,4194304] 0 2023-12-16T05:56:44.054 INFO:tasks.workunit.client.1.smithi156.stdout:9/790: dwrite d6/d19/f24 [4194304,4194304] 0 2023-12-16T05:56:44.055 INFO:tasks.workunit.client.1.smithi156.stdout:3/723: write dc/df/d34/f68 [462864,76086] 0 2023-12-16T05:56:44.055 INFO:tasks.workunit.client.1.smithi156.stdout:3/724: chown dc/df/d70/lc0 57068331 1 2023-12-16T05:56:44.056 INFO:tasks.workunit.client.0.smithi155.stdout:7/895: dwrite d0/d6a/d31/f5c [0,4194304] 0 2023-12-16T05:56:44.058 INFO:tasks.workunit.client.1.smithi156.stdout:0/892: creat d2/d7/dd/d29/d4b/f116 x:0 0 0 2023-12-16T05:56:44.060 INFO:tasks.workunit.client.1.smithi156.stdout:9/791: truncate d6/d19/d30/f7c 424250 0 2023-12-16T05:56:44.060 INFO:tasks.workunit.client.0.smithi155.stdout:3/844: dread d0/f55 [0,4194304] 0 2023-12-16T05:56:44.062 INFO:tasks.workunit.client.0.smithi155.stdout:3/845: write d0/d14/d87/dec/fdc [1475479,57761] 0 2023-12-16T05:56:44.062 INFO:tasks.workunit.client.1.smithi156.stdout:3/725: symlink dc/d56/d67/dbe/dd9/l101 0 2023-12-16T05:56:44.065 INFO:tasks.workunit.client.1.smithi156.stdout:4/730: dwrite d9/d2b/d35/f53 [0,4194304] 0 2023-12-16T05:56:44.065 INFO:tasks.workunit.client.1.smithi156.stdout:4/731: write d9/d2b/d35/fb5 [1594198,85699] 0 2023-12-16T05:56:44.065 INFO:tasks.workunit.client.0.smithi155.stdout:2/954: dwrite d0/d5/d6/f7c [0,4194304] 0 2023-12-16T05:56:44.067 INFO:tasks.workunit.client.1.smithi156.stdout:0/893: rename d2/d7/dd/d2d/d5e/c8a to d2/d7/dd/d2d/d5e/d110/dbc/c117 0 2023-12-16T05:56:44.067 INFO:tasks.workunit.client.1.smithi156.stdout:0/894: fdatasync d2/d7/dd/d29/d38/d51/d65/d7e/f101 0 2023-12-16T05:56:44.069 INFO:tasks.workunit.client.0.smithi155.stdout:2/955: mknod d0/d7/dd/d49/d4b/d8c/dcd/d108/d11f/c14b 0 2023-12-16T05:56:44.073 INFO:tasks.workunit.client.0.smithi155.stdout:5/996: dwrite d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/dc9/fed [0,4194304] 0 2023-12-16T05:56:44.078 INFO:tasks.workunit.client.1.smithi156.stdout:4/732: read d9/d2b/d35/fee [1097011,91475] 0 2023-12-16T05:56:44.078 INFO:tasks.workunit.client.0.smithi155.stdout:4/931: dwrite d0/da/de0/d16/d30/dce/d75/d10e/d70/f128 [0,4194304] 0 2023-12-16T05:56:44.081 INFO:tasks.workunit.client.1.smithi156.stdout:4/733: mknod d9/cf7 0 2023-12-16T05:56:44.082 INFO:tasks.workunit.client.1.smithi156.stdout:4/734: creat d9/d2c/ff8 x:0 0 0 2023-12-16T05:56:44.082 INFO:tasks.workunit.client.1.smithi156.stdout:4/735: chown d9/d2c/caf 70 1 2023-12-16T05:56:44.082 INFO:tasks.workunit.client.1.smithi156.stdout:8/616: rmdir d3/d12/d16 39 2023-12-16T05:56:44.083 INFO:tasks.workunit.client.0.smithi155.stdout:7/896: dwrite d0/d6a/d1a/d2b/ff0 [0,4194304] 0 2023-12-16T05:56:44.083 INFO:tasks.workunit.client.0.smithi155.stdout:2/956: dread d0/f2 [0,4194304] 0 2023-12-16T05:56:44.083 INFO:tasks.workunit.client.0.smithi155.stdout:7/897: write d0/d6a/d1a/d22/dc8/ff9 [833199,15543] 0 2023-12-16T05:56:44.084 INFO:tasks.workunit.client.0.smithi155.stdout:2/957: write d0/d5/d6/d5f/fe8 [1473462,44787] 0 2023-12-16T05:56:44.084 INFO:tasks.workunit.client.0.smithi155.stdout:7/898: readlink d0/d1/d5/l116 0 2023-12-16T05:56:44.084 INFO:tasks.workunit.client.0.smithi155.stdout:5/997: rename d0/d2/d2a/d30/d53/d7b/d99/d47/d9d/dd9/d11f/f55 to d0/d2/d2a/d30/d53/d12c/f141 0 2023-12-16T05:56:44.084 INFO:tasks.workunit.client.0.smithi155.stdout:5/998: stat d0/c1f 0 2023-12-16T05:56:44.084 INFO:tasks.workunit.client.0.smithi155.stdout:5/999: chown d0/d2/d2a/d19/dd7/dee/c12a 6292356 1 2023-12-16T05:56:44.084 INFO:tasks.workunit.client.0.smithi155.stdout:4/932: truncate d0/f10c 3636683 0 2023-12-16T05:56:44.085 INFO:tasks.workunit.client.0.smithi155.stdout:4/933: write d0/da/de0/d16/d30/f8d [464908,98344] 0 2023-12-16T05:56:44.085 INFO:tasks.workunit.client.1.smithi156.stdout:4/736: link d9/d2b/d9a/ff2 d9/d2b/d98/ff9 0 2023-12-16T05:56:44.085 INFO:tasks.workunit.client.1.smithi156.stdout:4/737: write d9/d2b/d35/dd3/ff5 [986795,89470] 0 2023-12-16T05:56:44.088 INFO:tasks.workunit.client.1.smithi156.stdout:8/617: mknod d3/d7/d27/d46/d6e/ccd 0 2023-12-16T05:56:44.088 INFO:tasks.workunit.client.1.smithi156.stdout:4/738: unlink d9/f70 0 2023-12-16T05:56:44.088 INFO:tasks.workunit.client.0.smithi155.stdout:3/846: dwrite d0/f30 [0,4194304] 0 2023-12-16T05:56:44.090 INFO:tasks.workunit.client.0.smithi155.stdout:7/899: symlink d0/d6a/d1a/d8c/d34/d4b/d60/dd8/l125 0 2023-12-16T05:56:44.091 INFO:tasks.workunit.client.0.smithi155.stdout:7/900: getdents d0/d6a/d1a/d2b/d2c 0 2023-12-16T05:56:44.091 INFO:tasks.workunit.client.0.smithi155.stdout:7/901: chown d0/d1b/d122/ccd 1 1 2023-12-16T05:56:44.091 INFO:tasks.workunit.client.0.smithi155.stdout:2/958: mknod d0/d7/d1f/c14c 0 2023-12-16T05:56:44.091 INFO:tasks.workunit.client.0.smithi155.stdout:2/959: fdatasync d0/d7/d1f/d74/fde 0 2023-12-16T05:56:44.091 INFO:tasks.workunit.client.0.smithi155.stdout:2/960: chown d0/d7/dd/d49/d4b/d80/l121 1245299 1 2023-12-16T05:56:44.092 INFO:tasks.workunit.client.0.smithi155.stdout:2/961: chown d0/d34/d3c/f79 897447 1 2023-12-16T05:56:44.093 INFO:tasks.workunit.client.1.smithi156.stdout:4/739: rename d9/d43/d58 to d9/d2c/dbf/dfa 0 2023-12-16T05:56:44.093 INFO:tasks.workunit.client.1.smithi156.stdout:4/740: readlink d9/d2c/lad 0 2023-12-16T05:56:44.095 INFO:tasks.workunit.client.1.smithi156.stdout:4/741: symlink d9/d2c/d7a/lfb 0 2023-12-16T05:56:44.098 INFO:tasks.workunit.client.0.smithi155.stdout:2/962: write d0/d34/d3c/f43 [1689104,95798] 0 2023-12-16T05:56:44.099 INFO:tasks.workunit.client.1.smithi156.stdout:9/792: dwrite d6/d19/d25/d3a/d88/d8b/dac/dc9/fec [4194304,4194304] 0 2023-12-16T05:56:44.099 INFO:tasks.workunit.client.1.smithi156.stdout:9/793: fsync d6/d19/d30/fde 0 2023-12-16T05:56:44.099 INFO:tasks.workunit.client.1.smithi156.stdout:9/794: truncate d6/d19/d25/d3a/d5e/da9/de1/dfc/f100 65329 0 2023-12-16T05:56:44.103 INFO:tasks.workunit.client.1.smithi156.stdout:9/795: rmdir d6/d19/d30 39 2023-12-16T05:56:44.105 INFO:tasks.workunit.client.1.smithi156.stdout:3/726: dwrite dc/d56/f83 [0,4194304] 0 2023-12-16T05:56:44.108 INFO:tasks.workunit.client.1.smithi156.stdout:3/727: mknod dc/d56/d67/dbe/dc3/ded/c102 0 2023-12-16T05:56:44.108 INFO:tasks.workunit.client.1.smithi156.stdout:3/728: truncate dc/d10/d1d/d4b/f76 755073 0 2023-12-16T05:56:44.108 INFO:tasks.workunit.client.1.smithi156.stdout:3/729: write dc/d10/d1d/d4b/f9d [808396,18103] 0 2023-12-16T05:56:44.110 INFO:tasks.workunit.client.1.smithi156.stdout:3/730: getdents dc/d56/d67 0 2023-12-16T05:56:44.110 INFO:tasks.workunit.client.1.smithi156.stdout:3/731: stat dc/d10/fb1 0 2023-12-16T05:56:44.110 INFO:tasks.workunit.client.1.smithi156.stdout:3/732: read - dc/df/d70/f9b zero size 2023-12-16T05:56:44.111 INFO:tasks.workunit.client.0.smithi155.stdout:7/902: dread d0/d6a/d1a/d8c/d34/d4b/d64/d6f/dba/ff8 [0,4194304] 0 2023-12-16T05:56:44.111 INFO:tasks.workunit.client.1.smithi156.stdout:8/618: dwrite d3/d7/d66/f82 [0,4194304] 0 2023-12-16T05:56:44.111 INFO:tasks.workunit.client.1.smithi156.stdout:8/619: write d3/d6/d83/f91 [603024,68162] 0 2023-12-16T05:56:44.111 INFO:tasks.workunit.client.1.smithi156.stdout:8/620: write d3/d7/d66/d76/fad [498012,47567] 0 2023-12-16T05:56:44.111 INFO:tasks.workunit.client.1.smithi156.stdout:3/733: creat dc/d10/d3d/df8/f103 x:0 0 0 2023-12-16T05:56:44.113 INFO:tasks.workunit.client.1.smithi156.stdout:9/796: dread d6/d19/f56 [0,4194304] 0 2023-12-16T05:56:44.114 INFO:tasks.workunit.client.1.smithi156.stdout:8/621: rename d3/d12/d74/lb7 to d3/d7/d27/d46/d84/d85/lce 0 2023-12-16T05:56:44.115 INFO:tasks.workunit.client.1.smithi156.stdout:3/734: mkdir dc/d56/d67/d104 0 2023-12-16T05:56:44.116 INFO:tasks.workunit.client.1.smithi156.stdout:9/797: creat d6/d19/d25/d72/f109 x:0 0 0 2023-12-16T05:56:44.117 INFO:tasks.workunit.client.1.smithi156.stdout:8/622: getdents d3/d7/d27/d46 0 2023-12-16T05:56:44.119 INFO:tasks.workunit.client.1.smithi156.stdout:8/623: link d3/d7a/d7d/fa6 d3/d12/d16/db4/fcf 0 2023-12-16T05:56:44.120 INFO:tasks.workunit.client.1.smithi156.stdout:9/798: mknod d6/d19/c10a 0 2023-12-16T05:56:44.121 INFO:tasks.workunit.client.1.smithi156.stdout:3/735: write dc/d10/f7e [928163,96400] 0 2023-12-16T05:56:44.121 INFO:tasks.workunit.client.1.smithi156.stdout:3/736: readlink dc/d10/d3d/l44 0 2023-12-16T05:56:44.122 INFO:tasks.workunit.client.1.smithi156.stdout:8/624: truncate d3/d7/d27/d46/d6e/d3c/f6a 5166551 0 2023-12-16T05:56:44.124 INFO:tasks.workunit.client.1.smithi156.stdout:8/625: rename d3/d7/d27/d46/d6e/f51 to d3/d7/d62/fd0 0 2023-12-16T05:56:44.124 INFO:tasks.workunit.client.1.smithi156.stdout:8/626: fdatasync d3/d12/d16/d54/f99 0 2023-12-16T05:56:44.124 INFO:tasks.workunit.client.1.smithi156.stdout:0/895: rmdir d2/d7/dd/d29/d4b 39 2023-12-16T05:56:44.126 INFO:tasks.workunit.client.1.smithi156.stdout:3/737: write dc/d10/d1d/fa8 [3585691,114247] 0 2023-12-16T05:56:44.127 INFO:tasks.workunit.client.1.smithi156.stdout:8/627: creat d3/d7/fd1 x:0 0 0 2023-12-16T05:56:44.127 INFO:tasks.workunit.client.1.smithi156.stdout:8/628: truncate d3/f5c 4986684 0 2023-12-16T05:56:44.127 INFO:tasks.workunit.client.1.smithi156.stdout:8/629: fdatasync d3/d7/d27/fb0 0 2023-12-16T05:56:44.133 INFO:tasks.workunit.client.1.smithi156.stdout:8/630: symlink d3/d7/d62/dca/ld2 0 2023-12-16T05:56:44.135 INFO:tasks.workunit.client.1.smithi156.stdout:8/631: getdents d3/d7/d27/d46/d84/d85/d9b 0 2023-12-16T05:56:44.137 INFO:tasks.workunit.client.1.smithi156.stdout:8/632: rename d3/d7/d27/d46/d6e/d3c/fbf to d3/d12/d16/fd3 0 2023-12-16T05:56:44.138 INFO:tasks.workunit.client.0.smithi155.stdout:3/847: dwrite d0/d1e/f32 [0,4194304] 0 2023-12-16T05:56:44.139 INFO:tasks.workunit.client.1.smithi156.stdout:8/633: dread d3/d7/f31 [0,4194304] 0 2023-12-16T05:56:44.140 INFO:tasks.workunit.client.1.smithi156.stdout:8/634: write d3/d12/fc1 [238371,7555] 0 2023-12-16T05:56:44.140 INFO:tasks.workunit.client.1.smithi156.stdout:8/635: write d3/d12/f70 [427489,51212] 0 2023-12-16T05:56:44.140 INFO:tasks.workunit.client.1.smithi156.stdout:8/636: creat d3/d7/d66/d76/fd4 x:0 0 0 2023-12-16T05:56:44.141 INFO:tasks.workunit.client.1.smithi156.stdout:8/637: symlink d3/d7/d62/d6b/ld5 0 2023-12-16T05:56:44.145 INFO:tasks.workunit.client.1.smithi156.stdout:3/738: dread dc/d10/d3d/f87 [0,4194304] 0 2023-12-16T05:56:44.145 INFO:tasks.workunit.client.1.smithi156.stdout:8/638: dread d3/d6/f8a [0,4194304] 0 2023-12-16T05:56:44.145 INFO:tasks.workunit.client.1.smithi156.stdout:3/739: mknod dc/d56/d67/dbe/dc3/ded/c105 0 2023-12-16T05:56:44.147 INFO:tasks.workunit.client.0.smithi155.stdout:2/963: dwrite d0/d7/d69/f91 [0,4194304] 0 2023-12-16T05:56:44.147 INFO:tasks.workunit.client.0.smithi155.stdout:2/964: stat d0/d7/dd/d62/d66/f6a 0 2023-12-16T05:56:44.149 INFO:tasks.workunit.client.0.smithi155.stdout:3/848: dread d0/d1a/d33/d57/f63 [0,4194304] 0 2023-12-16T05:56:44.149 INFO:tasks.workunit.client.1.smithi156.stdout:4/742: dwrite d9/d2c/d48/fdc [0,4194304] 0 2023-12-16T05:56:44.149 INFO:tasks.workunit.client.1.smithi156.stdout:4/743: chown d9/d43/f62 46388 1 2023-12-16T05:56:44.151 INFO:tasks.workunit.client.1.smithi156.stdout:0/896: dwrite d2/f86 [0,4194304] 0 2023-12-16T05:56:44.151 INFO:tasks.workunit.client.0.smithi155.stdout:7/903: dwrite d0/d6a/d31/f46 [0,4194304] 0 2023-12-16T05:56:44.151 INFO:tasks.workunit.client.0.smithi155.stdout:7/904: fsync d0/d6a/d1a/d22/fec 0 2023-12-16T05:56:44.151 INFO:tasks.workunit.client.0.smithi155.stdout:7/905: readlink d0/d6a/d1a/d8c/l79 0 2023-12-16T05:56:44.152 INFO:tasks.workunit.client.1.smithi156.stdout:4/744: mknod d9/d43/cfc 0 2023-12-16T05:56:44.152 INFO:tasks.workunit.client.1.smithi156.stdout:9/799: dwrite d6/d19/f1f [0,4194304] 0 2023-12-16T05:56:44.155 INFO:tasks.workunit.client.1.smithi156.stdout:9/800: write d6/d19/d25/d72/f84 [2722714,79906] 0 2023-12-16T05:56:44.155 INFO:tasks.workunit.client.1.smithi156.stdout:0/897: truncate d2/d7/f18 5637895 0 2023-12-16T05:56:44.156 INFO:tasks.workunit.client.0.smithi155.stdout:7/906: dread d0/d1/fb [0,4194304] 0 2023-12-16T05:56:44.156 INFO:tasks.workunit.client.1.smithi156.stdout:8/639: getdents d3/d12/d74 0 2023-12-16T05:56:44.163 INFO:tasks.workunit.client.1.smithi156.stdout:4/745: symlink d9/d2b/d9a/lfd 0 2023-12-16T05:56:44.170 INFO:tasks.workunit.client.0.smithi155.stdout:3/849: creat d0/d1a/d91/dde/f106 x:0 0 0 2023-12-16T05:56:44.170 INFO:tasks.workunit.client.1.smithi156.stdout:0/898: creat d2/d7/dd/d29/d38/d51/d65/d7e/f118 x:0 0 0 2023-12-16T05:56:44.171 INFO:tasks.workunit.client.1.smithi156.stdout:9/801: dwrite d6/d19/d25/d3a/d80/dc0/dd0/fdf [0,4194304] 0 2023-12-16T05:56:44.172 INFO:tasks.workunit.client.1.smithi156.stdout:8/640: rename d3/d7/d27/d46/d6e/d3b/d77/fbb to d3/d7a/d7d/dae/fd6 0 2023-12-16T05:56:44.173 INFO:tasks.workunit.client.0.smithi155.stdout:7/907: symlink d0/d6a/d1a/d2b/d2c/l126 0 2023-12-16T05:56:44.174 INFO:tasks.workunit.client.1.smithi156.stdout:4/746: mkdir d9/d2c/dbf/dfe 0 2023-12-16T05:56:44.174 INFO:tasks.workunit.client.1.smithi156.stdout:4/747: chown d9/d43/f4b 15257014 1 2023-12-16T05:56:44.174 INFO:tasks.workunit.client.1.smithi156.stdout:8/641: dread d3/d12/fc1 [0,4194304] 0 2023-12-16T05:56:44.174 INFO:tasks.workunit.client.1.smithi156.stdout:4/748: fsync d9/d2c/dbf/dfa/d7d/f90 0 2023-12-16T05:56:44.174 INFO:tasks.workunit.client.1.smithi156.stdout:8/642: truncate d3/d7/d27/fb0 4633194 0 2023-12-16T05:56:44.174 INFO:tasks.workunit.client.1.smithi156.stdout:8/643: readlink d3/d7/d62/dca/ld2 0 2023-12-16T05:56:44.175 INFO:tasks.workunit.client.1.smithi156.stdout:4/749: write d9/d2b/d98/fb3 [3344044,128990] 0 2023-12-16T05:56:44.175 INFO:tasks.workunit.client.1.smithi156.stdout:4/750: write d9/d2c/d7a/dd4/ff6 [842590,108193] 0 2023-12-16T05:56:44.175 INFO:tasks.workunit.client.1.smithi156.stdout:0/899: mknod d2/d7/dd/d29/c119 0 2023-12-16T05:56:44.176 INFO:tasks.workunit.client.1.smithi156.stdout:4/751: dread d9/d2c/dbf/dfa/f76 [0,4194304] 0 2023-12-16T05:56:44.176 INFO:tasks.workunit.client.0.smithi155.stdout:3/850: creat d0/d14/d36/d47/f107 x:0 0 0 2023-12-16T05:56:44.177 INFO:tasks.workunit.client.1.smithi156.stdout:8/644: creat d3/d12/d16/fd7 x:0 0 0 2023-12-16T05:56:44.179 INFO:tasks.workunit.client.1.smithi156.stdout:0/900: creat d2/d7/f11a x:0 0 0 2023-12-16T05:56:44.179 INFO:tasks.workunit.client.1.smithi156.stdout:0/901: chown d2/l1d 37756819 1 2023-12-16T05:56:44.180 INFO:tasks.workunit.client.1.smithi156.stdout:4/752: mknod d9/cff 0 2023-12-16T05:56:44.180 INFO:tasks.workunit.client.1.smithi156.stdout:4/753: read - d9/d2c/dbf/fc6 zero size 2023-12-16T05:56:44.183 INFO:tasks.workunit.client.0.smithi155.stdout:3/851: getdents d0/d14/d87/dcf 0 2023-12-16T05:56:44.184 INFO:tasks.workunit.client.1.smithi156.stdout:8/645: rename d3/d7/d27/d46/d6e/d3c/f97 to d3/d7/d27/d46/d6e/d3b/d77/fd8 0 2023-12-16T05:56:44.184 INFO:tasks.workunit.client.0.smithi155.stdout:3/852: read d0/f10 [2668800,104443] 0 2023-12-16T05:56:44.184 INFO:tasks.workunit.client.0.smithi155.stdout:3/853: truncate d0/d1e/f68 1789551 0 2023-12-16T05:56:44.184 INFO:tasks.workunit.client.0.smithi155.stdout:3/854: chown d0/d1a/f78 110968390 1 2023-12-16T05:56:44.185 INFO:tasks.workunit.client.0.smithi155.stdout:3/855: mknod d0/d1a/d33/d105/c108 0 2023-12-16T05:56:44.185 INFO:tasks.workunit.client.1.smithi156.stdout:8/646: symlink d3/d7/d62/ld9 0 2023-12-16T05:56:44.186 INFO:tasks.workunit.client.0.smithi155.stdout:3/856: mknod d0/d1a/d33/d57/dc3/c109 0 2023-12-16T05:56:44.186 INFO:tasks.workunit.client.0.smithi155.stdout:3/857: write d0/d1a/f78 [9403696,1380] 0 2023-12-16T05:56:44.187 INFO:tasks.workunit.client.0.smithi155.stdout:3/858: mknod d0/d1a/da3/de6/c10a 0 2023-12-16T05:56:44.187 INFO:tasks.workunit.client.0.smithi155.stdout:3/859: dread - d0/d14/d87/dec/fe5 zero size 2023-12-16T05:56:44.187 INFO:tasks.workunit.client.0.smithi155.stdout:3/860: write d0/d1a/d33/fb7 [1448503,52327] 0 2023-12-16T05:56:44.188 INFO:tasks.workunit.client.1.smithi156.stdout:8/647: creat d3/d12/fda x:0 0 0 2023-12-16T05:56:44.190 INFO:tasks.workunit.client.0.smithi155.stdout:3/861: creat d0/d14/d36/f10b x:0 0 0 2023-12-16T05:56:44.191 INFO:tasks.workunit.client.1.smithi156.stdout:8/648: read d3/d6/f8a [40760,122985] 0 2023-12-16T05:56:44.192 INFO:tasks.workunit.client.1.smithi156.stdout:8/649: fsync d3/d12/d16/db4/fc5 0 2023-12-16T05:56:44.192 INFO:tasks.workunit.client.1.smithi156.stdout:8/650: write d3/d7/d66/f71 [1174269,31859] 0 2023-12-16T05:56:44.192 INFO:tasks.workunit.client.1.smithi156.stdout:1/707: sync 2023-12-16T05:56:44.192 INFO:tasks.workunit.client.1.smithi156.stdout:2/757: sync 2023-12-16T05:56:44.192 INFO:tasks.workunit.client.1.smithi156.stdout:6/870: sync 2023-12-16T05:56:44.192 INFO:tasks.workunit.client.1.smithi156.stdout:5/978: sync 2023-12-16T05:56:44.192 INFO:tasks.workunit.client.1.smithi156.stdout:5/979: fdatasync da/dc/d4b/d6c/d7c/f100 0 2023-12-16T05:56:44.192 INFO:tasks.workunit.client.0.smithi155.stdout:3/862: link d0/d14/d87/dec/fe5 d0/d1a/f10c 0 2023-12-16T05:56:44.193 INFO:tasks.workunit.client.1.smithi156.stdout:8/651: creat d3/d7/d27/d46/d6e/d3c/fdb x:0 0 0 2023-12-16T05:56:44.195 INFO:tasks.workunit.client.1.smithi156.stdout:1/708: link d3/d17/d1c/d22/d57/d61/dc1/f58 d3/d17/d2d/ff6 0 2023-12-16T05:56:44.195 INFO:tasks.workunit.client.1.smithi156.stdout:1/709: readlink d3/d17/d1c/d22/d57/d61/dc1/dbe/dd2/lef 0 2023-12-16T05:56:44.195 INFO:tasks.workunit.client.1.smithi156.stdout:2/758: dread d9/f2d [0,4194304] 0 2023-12-16T05:56:44.198 INFO:tasks.workunit.client.1.smithi156.stdout:6/871: rename d9/d1c/f46 to d9/d1c/d50/dbf/dc0/f118 0 2023-12-16T05:56:44.200 INFO:tasks.workunit.client.1.smithi156.stdout:5/980: mkdir da/d9a/dcd/dce/d148 0 2023-12-16T05:56:44.203 INFO:tasks.workunit.client.1.smithi156.stdout:1/710: symlink d3/d17/d1c/d22/d57/d61/dc1/dbe/dd2/lf7 0 2023-12-16T05:56:44.204 INFO:tasks.workunit.client.1.smithi156.stdout:2/759: creat d9/d12/dc2/dd8/fed x:0 0 0 2023-12-16T05:56:44.206 INFO:tasks.workunit.client.1.smithi156.stdout:6/872: creat d9/d13/d2f/d51/d69/d99/db9/d110/d8e/d9a/dce/df0/f119 x:0 0 0 2023-12-16T05:56:44.206 INFO:tasks.workunit.client.1.smithi156.stdout:6/873: truncate d9/d1c/d50/dbf/dc0/fcd 4925360 0 2023-12-16T05:56:44.207 INFO:tasks.workunit.client.1.smithi156.stdout:5/981: creat da/dc/d10d/f149 x:0 0 0 2023-12-16T05:56:44.208 INFO:tasks.workunit.client.1.smithi156.stdout:1/711: link d3/d17/d2d/fea d3/d17/d4d/ff8 0 2023-12-16T05:56:44.209 INFO:tasks.workunit.client.1.smithi156.stdout:2/760: mkdir d9/dd/d17/dee 0 2023-12-16T05:56:44.209 INFO:tasks.workunit.client.1.smithi156.stdout:5/982: read da/dc/d2d/d4d/d54/d67/f117 [1849601,51849] 0 2023-12-16T05:56:44.210 INFO:tasks.workunit.client.1.smithi156.stdout:6/874: creat d9/d1c/d50/d116/f11a x:0 0 0 2023-12-16T05:56:44.210 INFO:tasks.workunit.client.1.smithi156.stdout:6/875: readlink d9/d1c/l33 0 2023-12-16T05:56:44.210 INFO:tasks.workunit.client.1.smithi156.stdout:6/876: chown d9/d1c/d50/c86 115 1 2023-12-16T05:56:44.211 INFO:tasks.workunit.client.1.smithi156.stdout:5/983: mknod da/dc/d4b/d6c/d81/dc5/deb/c14a 0 2023-12-16T05:56:44.211 INFO:tasks.workunit.client.1.smithi156.stdout:5/984: readlink da/d46/l6e 0 2023-12-16T05:56:44.211 INFO:tasks.workunit.client.1.smithi156.stdout:5/985: read - da/d46/f12d zero size 2023-12-16T05:56:44.212 INFO:tasks.workunit.client.1.smithi156.stdout:6/877: creat d9/d13/d2f/d51/d69/d99/db9/d110/d8e/d9a/dce/f11b x:0 0 0 2023-12-16T05:56:44.218 INFO:tasks.workunit.client.0.smithi155.stdout:7/908: dwrite d0/d6a/d1a/d38/f9d [0,4194304] 0 2023-12-16T05:56:44.218 INFO:tasks.workunit.client.0.smithi155.stdout:7/909: dread - d0/d6a/d1a/d38/fc0 zero size 2023-12-16T05:56:44.219 INFO:tasks.workunit.client.0.smithi155.stdout:7/910: getdents d0/d1b 0 2023-12-16T05:56:44.219 INFO:tasks.workunit.client.0.smithi155.stdout:7/911: readlink d0/d6a/d1a/d2b/d2c/d5d/l6d 0 2023-12-16T05:56:44.221 INFO:tasks.workunit.client.0.smithi155.stdout:7/912: rename d0/d6a/d1a/d8c/d34/d4b/d64/f11f to d0/d6a/d1a/d8c/d34/d4b/d64/d101/f127 0 2023-12-16T05:56:44.221 INFO:tasks.workunit.client.0.smithi155.stdout:7/913: write d0/d6a/d1a/d8c/d34/fa1 [707566,6848] 0 2023-12-16T05:56:44.222 INFO:tasks.workunit.client.1.smithi156.stdout:9/802: dwrite d6/fd [4194304,4194304] 0 2023-12-16T05:56:44.223 INFO:tasks.workunit.client.1.smithi156.stdout:9/803: truncate d6/d19/d25/f6f 2629969 0 2023-12-16T05:56:44.224 INFO:tasks.workunit.client.1.smithi156.stdout:9/804: symlink d6/d19/d30/d48/d87/l10b 0 2023-12-16T05:56:44.225 INFO:tasks.workunit.client.0.smithi155.stdout:7/914: unlink d0/d6a/f28 0 2023-12-16T05:56:44.225 INFO:tasks.workunit.client.0.smithi155.stdout:2/965: truncate d0/d34/d3c/f43 2350877 0 2023-12-16T05:56:44.225 INFO:tasks.workunit.client.1.smithi156.stdout:9/805: truncate d6/d2e/f86 7291946 0 2023-12-16T05:56:44.225 INFO:tasks.workunit.client.1.smithi156.stdout:9/806: chown d6/d19 0 1 2023-12-16T05:56:44.226 INFO:tasks.workunit.client.0.smithi155.stdout:7/915: rename d0/d1/d5/l6b to d0/d6a/d1a/d8c/d34/d6c/l128 0 2023-12-16T05:56:44.227 INFO:tasks.workunit.client.1.smithi156.stdout:9/807: write d6/d19/d25/d3a/d88/d8b/f90 [859850,77674] 0 2023-12-16T05:56:44.228 INFO:tasks.workunit.client.0.smithi155.stdout:2/966: creat d0/d7/dd/d49/d4b/d8c/dcd/f14d x:0 0 0 2023-12-16T05:56:44.228 INFO:tasks.workunit.client.0.smithi155.stdout:2/967: stat d0/d7/dd/d49/d4b/d8c/dcd/c10b 0 2023-12-16T05:56:44.228 INFO:tasks.workunit.client.0.smithi155.stdout:2/968: fsync d0/d34/d3c/fc8 0 2023-12-16T05:56:44.228 INFO:tasks.workunit.client.0.smithi155.stdout:2/969: stat d0/d5/fce 0 2023-12-16T05:56:44.229 INFO:tasks.workunit.client.0.smithi155.stdout:7/916: rename d0/d6a/d1a/d8c/d34/d4b/d60/f7b to d0/d1b/d78/f129 0 2023-12-16T05:56:44.230 INFO:tasks.workunit.client.0.smithi155.stdout:2/970: mkdir d0/d7/dc1/d14e 0 2023-12-16T05:56:44.231 INFO:tasks.workunit.client.0.smithi155.stdout:2/971: creat d0/d7/d1f/d74/f14f x:0 0 0 2023-12-16T05:56:44.231 INFO:tasks.workunit.client.0.smithi155.stdout:2/972: fdatasync d0/d7/dd/d49/d4b/d80/f9c 0 2023-12-16T05:56:44.232 INFO:tasks.workunit.client.0.smithi155.stdout:2/973: creat d0/d7/dc1/f150 x:0 0 0 2023-12-16T05:56:44.233 INFO:tasks.workunit.client.0.smithi155.stdout:2/974: mknod d0/d7/dc1/c151 0 2023-12-16T05:56:44.234 INFO:tasks.workunit.client.0.smithi155.stdout:2/975: rename d0/f2 to d0/d7/d69/db8/f152 0 2023-12-16T05:56:44.235 INFO:tasks.workunit.client.0.smithi155.stdout:2/976: symlink d0/d7/dd/d49/l153 0 2023-12-16T05:56:44.235 INFO:tasks.workunit.client.0.smithi155.stdout:2/977: chown d0/d7/dd/d49/d4b/d8c/lbd 1762551 1 2023-12-16T05:56:44.235 INFO:tasks.workunit.client.0.smithi155.stdout:2/978: stat d0/d5/d6/f75 0 2023-12-16T05:56:44.236 INFO:tasks.workunit.client.0.smithi155.stdout:2/979: rename d0/d7/dd/d14/db6/ff4 to d0/d7/dc1/d14e/f154 0 2023-12-16T05:56:44.237 INFO:tasks.workunit.client.1.smithi156.stdout:0/902: dwrite d2/d23/d4a/fa3 [0,4194304] 0 2023-12-16T05:56:44.240 INFO:tasks.workunit.client.1.smithi156.stdout:0/903: write d2/d7/dd/d29/fd4 [528760,106006] 0 2023-12-16T05:56:44.242 INFO:tasks.workunit.client.1.smithi156.stdout:4/754: dwrite d9/d43/f4b [0,4194304] 0 2023-12-16T05:56:44.242 INFO:tasks.workunit.client.1.smithi156.stdout:0/904: dread d2/d23/d4a/fc1 [0,4194304] 0 2023-12-16T05:56:44.244 INFO:tasks.workunit.client.1.smithi156.stdout:4/755: mkdir d9/d2c/dbf/dfa/d7d/d100 0 2023-12-16T05:56:44.248 INFO:tasks.workunit.client.1.smithi156.stdout:4/756: dread d9/d2b/d35/fb5 [0,4194304] 0 2023-12-16T05:56:44.264 INFO:tasks.workunit.client.1.smithi156.stdout:8/652: dwrite d3/d7a/d7d/dae/f64 [0,4194304] 0 2023-12-16T05:56:44.264 INFO:tasks.workunit.client.0.smithi155.stdout:3/863: dwrite d0/d14/d36/d47/f98 [0,4194304] 0 2023-12-16T05:56:44.265 INFO:tasks.workunit.client.1.smithi156.stdout:1/712: dwrite d3/d17/d1c/d22/d57/d61/dc1/f58 [0,4194304] 0 2023-12-16T05:56:44.265 INFO:tasks.workunit.client.1.smithi156.stdout:4/757: dread d9/d2b/f8f [0,4194304] 0 2023-12-16T05:56:44.265 INFO:tasks.workunit.client.1.smithi156.stdout:4/758: chown d9/d2c/d48/f9e 12177 1 2023-12-16T05:56:44.266 INFO:tasks.workunit.client.1.smithi156.stdout:1/713: write d3/d17/d4d/ff8 [3697907,10965] 0 2023-12-16T05:56:44.266 INFO:tasks.workunit.client.0.smithi155.stdout:3/864: creat d0/d14/d36/d47/d5f/f10d x:0 0 0 2023-12-16T05:56:44.266 INFO:tasks.workunit.client.0.smithi155.stdout:3/865: creat d0/d1a/d33/d57/f10e x:0 0 0 2023-12-16T05:56:44.268 INFO:tasks.workunit.client.0.smithi155.stdout:7/917: dwrite d0/d1/fe [0,4194304] 0 2023-12-16T05:56:44.269 INFO:tasks.workunit.client.1.smithi156.stdout:6/878: dwrite d9/f93 [4194304,4194304] 0 2023-12-16T05:56:44.269 INFO:tasks.workunit.client.1.smithi156.stdout:4/759: creat d9/d2c/dbf/f101 x:0 0 0 2023-12-16T05:56:44.269 INFO:tasks.workunit.client.1.smithi156.stdout:6/879: write d9/d13/f4d [449055,104946] 0 2023-12-16T05:56:44.270 INFO:tasks.workunit.client.1.smithi156.stdout:0/905: dwrite d2/d7/dd/d29/f109 [0,4194304] 0 2023-12-16T05:56:44.270 INFO:tasks.workunit.client.0.smithi155.stdout:7/918: symlink d0/d6a/d1a/d22/l12a 0 2023-12-16T05:56:44.270 INFO:tasks.workunit.client.0.smithi155.stdout:2/980: dwrite d0/d7/d1f/d74/f54 [0,4194304] 0 2023-12-16T05:56:44.271 INFO:tasks.workunit.client.0.smithi155.stdout:7/919: unlink d0/d6a/d1a/d8c/d34/d4b/l7d 0 2023-12-16T05:56:44.271 INFO:tasks.workunit.client.1.smithi156.stdout:1/714: truncate d3/faf 594121 0 2023-12-16T05:56:44.272 INFO:tasks.workunit.client.1.smithi156.stdout:1/715: write d3/d17/d1c/d22/f51 [845694,21974] 0 2023-12-16T05:56:44.274 INFO:tasks.workunit.client.0.smithi155.stdout:2/981: rename d0/d7/dd/d62/d66/dbc to d0/d7/d57/d155 0 2023-12-16T05:56:44.274 INFO:tasks.workunit.client.0.smithi155.stdout:7/920: getdents d0/d6a/d1a 0 2023-12-16T05:56:44.275 INFO:tasks.workunit.client.1.smithi156.stdout:4/760: link d9/d2c/f2e d9/d2c/dbf/dfe/f102 0 2023-12-16T05:56:44.275 INFO:tasks.workunit.client.0.smithi155.stdout:2/982: symlink d0/d7/dd/d49/d4b/df0/l156 0 2023-12-16T05:56:44.276 INFO:tasks.workunit.client.0.smithi155.stdout:7/921: symlink d0/d6a/d1a/d8c/d34/l12b 0 2023-12-16T05:56:44.276 INFO:tasks.workunit.client.0.smithi155.stdout:7/922: fdatasync d0/d1/f4a 0 2023-12-16T05:56:44.277 INFO:tasks.workunit.client.0.smithi155.stdout:2/983: mkdir d0/d5/d6/d10a/d157 0 2023-12-16T05:56:44.279 INFO:tasks.workunit.client.1.smithi156.stdout:0/906: creat d2/d7/dd/d29/d38/dae/d100/d44/f11b x:0 0 0 2023-12-16T05:56:44.282 INFO:tasks.workunit.client.1.smithi156.stdout:1/716: rename d3/d17/d4d/dc2/dd8/dde to d3/d1b/df9 0 2023-12-16T05:56:44.282 INFO:tasks.workunit.client.1.smithi156.stdout:1/717: read - d3/d1b/d8b/f9e zero size 2023-12-16T05:56:44.283 INFO:tasks.workunit.client.1.smithi156.stdout:2/761: rmdir d9/d12/dc2 39 2023-12-16T05:56:44.285 INFO:tasks.workunit.client.1.smithi156.stdout:5/986: dwrite da/dc/d4b/d6c/f7a [0,4194304] 0 2023-12-16T05:56:44.286 INFO:tasks.workunit.client.1.smithi156.stdout:4/761: write d9/d2c/dbf/dfa/d95/f97 [2255010,26707] 0 2023-12-16T05:56:44.287 INFO:tasks.workunit.client.1.smithi156.stdout:1/718: rename d3/d17/d2d/l88 to d3/d1b/lfa 0 2023-12-16T05:56:44.290 INFO:tasks.workunit.client.1.smithi156.stdout:2/762: truncate d9/f20 2248223 0 2023-12-16T05:56:44.292 INFO:tasks.workunit.client.1.smithi156.stdout:5/987: rmdir da/dc/d2d/d34 39 2023-12-16T05:56:44.292 INFO:tasks.workunit.client.1.smithi156.stdout:5/988: chown da/dc/d2d/d4d/db9 2883277 1 2023-12-16T05:56:44.292 INFO:tasks.workunit.client.1.smithi156.stdout:5/989: write da/d9a/fac [441139,80724] 0 2023-12-16T05:56:44.292 INFO:tasks.workunit.client.1.smithi156.stdout:5/990: fdatasync da/dc/d4b/d6c/d81/fd8 0 2023-12-16T05:56:44.292 INFO:tasks.workunit.client.1.smithi156.stdout:5/991: chown da/dc/d2d/d4d/d54/d90/dc3/fc8 4 1 2023-12-16T05:56:44.292 INFO:tasks.workunit.client.1.smithi156.stdout:5/992: chown da/f42 15375052 1 2023-12-16T05:56:44.294 INFO:tasks.workunit.client.1.smithi156.stdout:2/763: mkdir d9/dd/d17/d33/def 0 2023-12-16T05:56:44.299 INFO:tasks.workunit.client.1.smithi156.stdout:1/719: dread d3/d17/d1c/d22/f6a [0,4194304] 0 2023-12-16T05:56:44.301 INFO:tasks.workunit.client.1.smithi156.stdout:4/762: dread d9/d2c/f32 [0,4194304] 0 2023-12-16T05:56:44.301 INFO:tasks.workunit.client.1.smithi156.stdout:4/763: chown d9/d2c/d48/dae 606967065 1 2023-12-16T05:56:44.301 INFO:tasks.workunit.client.1.smithi156.stdout:5/993: rename da/dc/d4b/d6c/d81/dc5 to da/d9a/dcd/dce/d14b 0 2023-12-16T05:56:44.301 INFO:tasks.workunit.client.1.smithi156.stdout:5/994: dread - da/dc/d4b/d6c/d7c/d85/fd4 zero size 2023-12-16T05:56:44.302 INFO:tasks.workunit.client.1.smithi156.stdout:9/808: getdents d6/d19/d30/d48/d87 0 2023-12-16T05:56:44.304 INFO:tasks.workunit.client.1.smithi156.stdout:5/995: mkdir da/dc/d2d/d4d/db9/dc9/dfa/d14c 0 2023-12-16T05:56:44.304 INFO:tasks.workunit.client.1.smithi156.stdout:4/764: write d9/d2b/d35/f71 [563657,90813] 0 2023-12-16T05:56:44.305 INFO:tasks.workunit.client.1.smithi156.stdout:4/765: fdatasync d9/d2b/f8f 0 2023-12-16T05:56:44.305 INFO:tasks.workunit.client.1.smithi156.stdout:6/880: dwrite d9/d13/d3e/d5f/d6e/fc9 [0,4194304] 0 2023-12-16T05:56:44.306 INFO:tasks.workunit.client.1.smithi156.stdout:8/653: dwrite d3/d12/d16/db4/fcf [0,4194304] 0 2023-12-16T05:56:44.306 INFO:tasks.workunit.client.1.smithi156.stdout:9/809: mknod d6/d19/d25/d72/c10c 0 2023-12-16T05:56:44.307 INFO:tasks.workunit.client.1.smithi156.stdout:5/996: write da/dc/d2d/d34/f69 [4985533,30520] 0 2023-12-16T05:56:44.307 INFO:tasks.workunit.client.0.smithi155.stdout:7/923: dwrite d0/d6a/d1a/d2b/d2c/d5d/f62 [4194304,4194304] 0 2023-12-16T05:56:44.308 INFO:tasks.workunit.client.1.smithi156.stdout:4/766: symlink d9/d2b/d9a/l103 0 2023-12-16T05:56:44.311 INFO:tasks.workunit.client.0.smithi155.stdout:7/924: write d0/d6a/d1a/d2b/ff0 [261960,123907] 0 2023-12-16T05:56:44.320 INFO:tasks.workunit.client.1.smithi156.stdout:8/654: symlink d3/d7/d27/d46/d84/ldc 0 2023-12-16T05:56:44.324 INFO:tasks.workunit.client.1.smithi156.stdout:5/997: link da/dc/d2d/d34/df6/f147 da/dc/d4b/d123/f14d 0 2023-12-16T05:56:44.325 INFO:tasks.workunit.client.1.smithi156.stdout:5/998: chown da/c84 1210635 1 2023-12-16T05:56:44.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:44 smithi155 ceph-mon[112451]: pgmap v18: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 164 MiB/s rd, 338 MiB/s wr, 515 op/s 2023-12-16T05:56:44.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:44 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:56:44.333 INFO:tasks.workunit.client.1.smithi156.stdout:2/764: dwrite d9/dd/d17/d33/d78/d39/d8c/dbe/fe5 [0,4194304] 0 2023-12-16T05:56:44.337 INFO:tasks.workunit.client.1.smithi156.stdout:4/767: rename f0 to d9/d2c/dbf/dfa/d7d/d100/f104 0 2023-12-16T05:56:44.338 INFO:tasks.workunit.client.1.smithi156.stdout:4/768: fsync d9/d2b/d35/fee 0 2023-12-16T05:56:44.338 INFO:tasks.workunit.client.1.smithi156.stdout:4/769: write d9/d2c/d48/f9e [345449,76777] 0 2023-12-16T05:56:44.341 INFO:tasks.workunit.client.1.smithi156.stdout:2/765: mknod d9/d68/daa/d83/da1/d96/cf0 0 2023-12-16T05:56:44.341 INFO:tasks.workunit.client.1.smithi156.stdout:2/766: readlink d9/dd/d17/d33/d47/l57 0 2023-12-16T05:56:44.343 INFO:tasks.workunit.client.1.smithi156.stdout:2/767: rename d9/dd/d17/d33/d78/f70 to d9/dd/d17/dee/ff1 0 2023-12-16T05:56:44.343 INFO:tasks.workunit.client.1.smithi156.stdout:2/768: dread - d9/dd/d17/d33/fc5 zero size 2023-12-16T05:56:44.344 INFO:tasks.workunit.client.1.smithi156.stdout:2/769: creat d9/d12/dc2/dd8/ff2 x:0 0 0 2023-12-16T05:56:44.344 INFO:tasks.workunit.client.1.smithi156.stdout:2/770: chown d9/d12/dc2/dd8/fcd 0 1 2023-12-16T05:56:44.345 INFO:tasks.workunit.client.1.smithi156.stdout:2/771: mknod d9/dd/d17/d33/d78/d39/cf3 0 2023-12-16T05:56:44.345 INFO:tasks.workunit.client.1.smithi156.stdout:2/772: rmdir d9/dd/d17/d33/d78 39 2023-12-16T05:56:44.349 INFO:tasks.workunit.client.1.smithi156.stdout:2/773: write d9/dd/d17/d33/d47/f4d [545500,79530] 0 2023-12-16T05:56:44.350 INFO:tasks.workunit.client.1.smithi156.stdout:6/881: dwrite d9/d13/f18 [0,4194304] 0 2023-12-16T05:56:44.350 INFO:tasks.workunit.client.1.smithi156.stdout:6/882: fsync d9/d13/d2f/fb2 0 2023-12-16T05:56:44.350 INFO:tasks.workunit.client.1.smithi156.stdout:6/883: chown d9/d13/d2f/d51/d9b/de2 27842 1 2023-12-16T05:56:44.351 INFO:tasks.workunit.client.0.smithi155.stdout:7/925: dwrite d0/d6a/d1a/d8c/d34/d4b/d64/d6f/fee [0,4194304] 0 2023-12-16T05:56:44.351 INFO:tasks.workunit.client.1.smithi156.stdout:5/999: dwrite da/dc/f2e [0,4194304] 0 2023-12-16T05:56:44.353 INFO:tasks.workunit.client.1.smithi156.stdout:4/770: dread d9/f37 [0,4194304] 0 2023-12-16T05:56:44.353 INFO:tasks.workunit.client.1.smithi156.stdout:1/720: dwrite d3/d17/d1c/f4b [0,4194304] 0 2023-12-16T05:56:44.353 INFO:tasks.workunit.client.1.smithi156.stdout:4/771: chown d9/d43/ca1 4548247 1 2023-12-16T05:56:44.353 INFO:tasks.workunit.client.1.smithi156.stdout:1/721: readlink d3/d17/d1c/da5/lc9 0 2023-12-16T05:56:44.353 INFO:tasks.workunit.client.1.smithi156.stdout:8/655: dwrite d3/d7/d27/f59 [0,4194304] 0 2023-12-16T05:56:44.353 INFO:tasks.workunit.client.1.smithi156.stdout:8/656: chown d3/d12/d16/fd7 756720 1 2023-12-16T05:56:44.354 INFO:tasks.workunit.client.1.smithi156.stdout:6/884: write d9/d13/d2f/d51/d6b/d77/d7e/f8c [2616337,70601] 0 2023-12-16T05:56:44.356 INFO:tasks.workunit.client.0.smithi155.stdout:7/926: rename d0/fd2 to d0/d6a/d1a/d22/dc8/f12c 0 2023-12-16T05:56:44.357 INFO:tasks.workunit.client.1.smithi156.stdout:4/772: link d9/f1e d9/d2c/dbf/dfe/f105 0 2023-12-16T05:56:44.358 INFO:tasks.workunit.client.1.smithi156.stdout:1/722: symlink d3/d3a/da9/lfb 0 2023-12-16T05:56:44.358 INFO:tasks.workunit.client.1.smithi156.stdout:2/774: dread d9/d12/dc2/dd8/da6/d80/f8b [0,4194304] 0 2023-12-16T05:56:44.359 INFO:tasks.workunit.client.1.smithi156.stdout:9/810: rename d6/d19/d25/d72 to d6/d19/d25/d10d 0 2023-12-16T05:56:44.360 INFO:tasks.workunit.client.1.smithi156.stdout:2/775: read d9/d12/f18 [2045161,107607] 0 2023-12-16T05:56:44.362 INFO:tasks.workunit.client.1.smithi156.stdout:6/885: creat d9/d1c/d50/dbf/f11c x:0 0 0 2023-12-16T05:56:44.362 INFO:tasks.workunit.client.1.smithi156.stdout:2/776: write d9/d12/dc2/dd8/dad/fc3 [3775190,46414] 0 2023-12-16T05:56:44.362 INFO:tasks.workunit.client.1.smithi156.stdout:2/777: fsync d9/dd/d17/d8f/fc9 0 2023-12-16T05:56:44.363 INFO:tasks.workunit.client.1.smithi156.stdout:4/773: mknod d9/d2b/d35/c106 0 2023-12-16T05:56:44.366 INFO:tasks.workunit.client.1.smithi156.stdout:4/774: write d9/f42 [4181982,73085] 0 2023-12-16T05:56:44.366 INFO:tasks.workunit.client.1.smithi156.stdout:9/811: mknod d6/d19/d30/d5b/d9a/c10e 0 2023-12-16T05:56:44.370 INFO:tasks.workunit.client.0.smithi155.stdout:7/927: dwrite d0/d6a/d1a/d8c/d34/d4b/d64/f107 [0,4194304] 0 2023-12-16T05:56:44.370 INFO:tasks.workunit.client.0.smithi155.stdout:7/928: chown d0/d6a/d1a/da0 3614 1 2023-12-16T05:56:44.371 INFO:tasks.workunit.client.1.smithi156.stdout:6/886: dread d9/d13/d3e/d5f/f7f [0,4194304] 0 2023-12-16T05:56:44.371 INFO:tasks.workunit.client.1.smithi156.stdout:4/775: creat d9/d2c/d7a/dd4/f107 x:0 0 0 2023-12-16T05:56:44.372 INFO:tasks.workunit.client.1.smithi156.stdout:4/776: dread - d9/d43/fac zero size 2023-12-16T05:56:44.372 INFO:tasks.workunit.client.1.smithi156.stdout:9/812: symlink d6/d19/d25/d10d/l10f 0 2023-12-16T05:56:44.374 INFO:tasks.workunit.client.1.smithi156.stdout:6/887: creat d9/f11d x:0 0 0 2023-12-16T05:56:44.375 INFO:tasks.workunit.client.1.smithi156.stdout:4/777: mknod d9/d2c/dbf/dfa/c108 0 2023-12-16T05:56:44.377 INFO:tasks.workunit.client.1.smithi156.stdout:9/813: chown d6/c21 651778 1 2023-12-16T05:56:44.377 INFO:tasks.workunit.client.1.smithi156.stdout:9/814: read d6/d19/d30/d5b/d9a/f9f [295974,10477] 0 2023-12-16T05:56:44.378 INFO:tasks.workunit.client.1.smithi156.stdout:9/815: fdatasync d6/ff6 0 2023-12-16T05:56:44.378 INFO:tasks.workunit.client.1.smithi156.stdout:9/816: chown d6/d2e/dad/ld1 9228 1 2023-12-16T05:56:44.380 INFO:tasks.workunit.client.1.smithi156.stdout:6/888: getdents d9/d13/d3e/d5f 0 2023-12-16T05:56:44.381 INFO:tasks.workunit.client.1.smithi156.stdout:1/723: dwrite d3/d17/d4d/dc2/f5c [0,4194304] 0 2023-12-16T05:56:44.381 INFO:tasks.workunit.client.1.smithi156.stdout:1/724: read d3/d17/d1c/d22/f9b [86677,24501] 0 2023-12-16T05:56:44.382 INFO:tasks.workunit.client.1.smithi156.stdout:6/889: rename d9/d13/d2f/d36/f55 to d9/d13/d2f/d51/d82/f11e 0 2023-12-16T05:56:44.383 INFO:tasks.workunit.client.1.smithi156.stdout:9/817: write d6/d19/d25/d3a/f43 [9276341,34585] 0 2023-12-16T05:56:44.385 INFO:tasks.workunit.client.1.smithi156.stdout:1/725: link d3/d17/d1c/da5/lc9 d3/d17/d1c/da5/lfc 0 2023-12-16T05:56:44.387 INFO:tasks.workunit.client.1.smithi156.stdout:6/890: unlink d9/d13/d2f/d36/f63 0 2023-12-16T05:56:44.388 INFO:tasks.workunit.client.0.smithi155.stdout:7/929: dwrite d0/d6a/d1a/d38/f41 [4194304,4194304] 0 2023-12-16T05:56:44.389 INFO:tasks.workunit.client.0.smithi155.stdout:7/930: rmdir d0/d6a/d1a/d8c/d34/d6c 39 2023-12-16T05:56:44.389 INFO:tasks.workunit.client.0.smithi155.stdout:7/931: chown d0/d6a/d1a/d22 1 1 2023-12-16T05:56:44.390 INFO:tasks.workunit.client.1.smithi156.stdout:9/818: rename d6/d19/d25/d3a/f4e to d6/d19/d25/d3a/d80/f110 0 2023-12-16T05:56:44.390 INFO:tasks.workunit.client.1.smithi156.stdout:9/819: chown d6/d19/d30/fde 24399 1 2023-12-16T05:56:44.390 INFO:tasks.workunit.client.1.smithi156.stdout:9/820: write d6/d2e/feb [51676,41137] 0 2023-12-16T05:56:44.390 INFO:tasks.workunit.client.0.smithi155.stdout:7/932: mkdir d0/d1b/d122/d98/d12d 0 2023-12-16T05:56:44.391 INFO:tasks.workunit.client.1.smithi156.stdout:1/726: creat d3/d17/d1c/d22/d57/dbc/dd9/ffd x:0 0 0 2023-12-16T05:56:44.392 INFO:tasks.workunit.client.0.smithi155.stdout:7/933: unlink d0/d6a/d1a/d8c/d34/d4b/c77 0 2023-12-16T05:56:44.401 INFO:tasks.workunit.client.0.smithi155.stdout:7/934: dread d0/d6a/d1a/d22/fec [0,4194304] 0 2023-12-16T05:56:44.403 INFO:tasks.workunit.client.1.smithi156.stdout:3/740: sync 2023-12-16T05:56:44.404 INFO:tasks.workunit.client.0.smithi155.stdout:7/935: write d0/d6a/d1a/d38/f9f [323128,71110] 0 2023-12-16T05:56:44.406 INFO:tasks.workunit.client.1.smithi156.stdout:3/741: write dc/d10/d3d/f95 [3084310,108817] 0 2023-12-16T05:56:44.406 INFO:tasks.workunit.client.1.smithi156.stdout:3/742: dread - dc/df/d66/fda zero size 2023-12-16T05:56:44.407 INFO:tasks.workunit.client.1.smithi156.stdout:6/891: dwrite d9/d13/f17 [0,4194304] 0 2023-12-16T05:56:44.407 INFO:tasks.workunit.client.1.smithi156.stdout:3/743: creat dc/d10/d3d/df8/f106 x:0 0 0 2023-12-16T05:56:44.408 INFO:tasks.workunit.client.1.smithi156.stdout:6/892: creat d9/d13/d2f/d51/d69/d99/db9/d110/d8e/d9a/f11f x:0 0 0 2023-12-16T05:56:44.409 INFO:tasks.workunit.client.1.smithi156.stdout:3/744: symlink dc/d10/d1d/d4b/dac/l107 0 2023-12-16T05:56:44.410 INFO:tasks.workunit.client.1.smithi156.stdout:6/893: truncate d9/d13/d2f/d51/f90 2151082 0 2023-12-16T05:56:44.410 INFO:tasks.workunit.client.1.smithi156.stdout:3/745: creat dc/d56/d67/d104/f108 x:0 0 0 2023-12-16T05:56:44.412 INFO:tasks.workunit.client.1.smithi156.stdout:6/894: creat d9/d13/f120 x:0 0 0 2023-12-16T05:56:44.412 INFO:tasks.workunit.client.1.smithi156.stdout:6/895: readlink d9/d13/d2f/d51/d69/lfc 0 2023-12-16T05:56:44.414 INFO:tasks.workunit.client.1.smithi156.stdout:6/896: creat d9/d13/d2f/d51/d69/d99/db9/d110/f121 x:0 0 0 2023-12-16T05:56:44.415 INFO:tasks.workunit.client.1.smithi156.stdout:6/897: symlink d9/d13/d2f/d51/d82/l122 0 2023-12-16T05:56:44.415 INFO:tasks.workunit.client.1.smithi156.stdout:6/898: write d9/d13/d3e/f83 [836015,106140] 0 2023-12-16T05:56:44.422 INFO:tasks.workunit.client.1.smithi156.stdout:9/821: dwrite d6/d19/d25/d3a/d5e/fe0 [0,4194304] 0 2023-12-16T05:56:44.424 INFO:tasks.workunit.client.1.smithi156.stdout:9/822: symlink d6/d19/d25/l111 0 2023-12-16T05:56:44.425 INFO:tasks.workunit.client.1.smithi156.stdout:9/823: unlink d6/d19/d25/d3a/d88/d8b/ffd 0 2023-12-16T05:56:44.427 INFO:tasks.workunit.client.1.smithi156.stdout:9/824: unlink d6/d2e/f50 0 2023-12-16T05:56:44.427 INFO:tasks.workunit.client.1.smithi156.stdout:3/746: dwrite dc/df/d66/fea [4194304,4194304] 0 2023-12-16T05:56:44.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:44 smithi156 ceph-mon[121001]: pgmap v18: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 164 MiB/s rd, 338 MiB/s wr, 515 op/s 2023-12-16T05:56:44.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:44 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:56:44.430 INFO:tasks.workunit.client.1.smithi156.stdout:1/727: dwrite d3/d3a/f6c [0,4194304] 0 2023-12-16T05:56:44.430 INFO:tasks.workunit.client.1.smithi156.stdout:9/825: creat d6/d19/d25/d3a/d88/f112 x:0 0 0 2023-12-16T05:56:44.430 INFO:tasks.workunit.client.1.smithi156.stdout:1/728: write d3/d17/d4d/dc2/d4f/f65 [4355077,69815] 0 2023-12-16T05:56:44.430 INFO:tasks.workunit.client.0.smithi155.stdout:7/936: write d0/d1/f21 [1082520,82343] 0 2023-12-16T05:56:44.431 INFO:tasks.workunit.client.1.smithi156.stdout:3/747: mknod dc/d10/d1d/d4b/dac/c109 0 2023-12-16T05:56:44.431 INFO:tasks.workunit.client.1.smithi156.stdout:3/748: stat dc/l9c 0 2023-12-16T05:56:44.431 INFO:tasks.workunit.client.1.smithi156.stdout:3/749: write dc/df/d66/ffb [276289,54658] 0 2023-12-16T05:56:44.432 INFO:tasks.workunit.client.1.smithi156.stdout:9/826: creat d6/d2e/d8a/f113 x:0 0 0 2023-12-16T05:56:44.433 INFO:tasks.workunit.client.1.smithi156.stdout:1/729: creat d3/d17/d1c/d22/da4/ffe x:0 0 0 2023-12-16T05:56:44.434 INFO:tasks.workunit.client.1.smithi156.stdout:9/827: read d6/d19/d25/d10d/ff8 [2367437,44215] 0 2023-12-16T05:56:44.443 INFO:tasks.workunit.client.0.smithi155.stdout:7/937: dread d0/d6a/d1a/d8c/d34/f73 [0,4194304] 0 2023-12-16T05:56:44.443 INFO:tasks.workunit.client.0.smithi155.stdout:7/938: stat d0/d1/l29 0 2023-12-16T05:56:44.443 INFO:tasks.workunit.client.0.smithi155.stdout:7/939: chown d0/d1/le4 55758609 1 2023-12-16T05:56:44.448 INFO:tasks.workunit.client.0.smithi155.stdout:7/940: write d0/d6a/d1a/d8c/d34/d4b/d64/fd7 [3512842,37181] 0 2023-12-16T05:56:44.448 INFO:tasks.workunit.client.0.smithi155.stdout:7/941: fsync d0/d6a/d31/f46 0 2023-12-16T05:56:44.449 INFO:tasks.workunit.client.0.smithi155.stdout:7/942: creat d0/d6a/d1a/d2b/d2c/f12e x:0 0 0 2023-12-16T05:56:44.449 INFO:tasks.workunit.client.1.smithi156.stdout:9/828: dwrite d6/d19/d25/f31 [4194304,4194304] 0 2023-12-16T05:56:44.450 INFO:tasks.workunit.client.1.smithi156.stdout:9/829: creat d6/d2e/f114 x:0 0 0 2023-12-16T05:56:44.450 INFO:tasks.workunit.client.1.smithi156.stdout:9/830: chown d6/d19/d30/dae/db7/fe4 1154859499 1 2023-12-16T05:56:44.453 INFO:tasks.workunit.client.1.smithi156.stdout:3/750: dwrite dc/df/f55 [0,4194304] 0 2023-12-16T05:56:44.455 INFO:tasks.workunit.client.1.smithi156.stdout:3/751: mkdir dc/d10/d1d/db2/d10a 0 2023-12-16T05:56:44.456 INFO:tasks.workunit.client.1.smithi156.stdout:3/752: mkdir dc/d10/d10b 0 2023-12-16T05:56:44.458 INFO:tasks.workunit.client.1.smithi156.stdout:3/753: symlink dc/d56/d67/dbe/dc3/l10c 0 2023-12-16T05:56:44.459 INFO:tasks.workunit.client.1.smithi156.stdout:3/754: mknod dc/d10/d1d/d90/c10d 0 2023-12-16T05:56:44.461 INFO:tasks.workunit.client.0.smithi155.stdout:7/943: dread d0/d6a/d1a/f89 [0,4194304] 0 2023-12-16T05:56:44.461 INFO:tasks.workunit.client.0.smithi155.stdout:7/944: chown d0/d6a/d31/f5c 583780 1 2023-12-16T05:56:44.465 INFO:tasks.workunit.client.1.smithi156.stdout:9/831: dwrite d6/d19/d25/fa6 [0,4194304] 0 2023-12-16T05:56:44.470 INFO:tasks.workunit.client.0.smithi155.stdout:7/945: dread d0/fe3 [0,4194304] 0 2023-12-16T05:56:44.471 INFO:tasks.workunit.client.0.smithi155.stdout:3/866: sync 2023-12-16T05:56:44.471 INFO:tasks.workunit.client.0.smithi155.stdout:2/984: sync 2023-12-16T05:56:44.471 INFO:tasks.workunit.client.0.smithi155.stdout:3/867: chown d0/d1e/d4e/fb1 3 1 2023-12-16T05:56:44.471 INFO:tasks.workunit.client.0.smithi155.stdout:2/985: fsync d0/d7/d69/d77/fac 0 2023-12-16T05:56:44.472 INFO:tasks.workunit.client.1.smithi156.stdout:9/832: dread d6/d19/d30/f3f [0,4194304] 0 2023-12-16T05:56:44.472 INFO:tasks.workunit.client.1.smithi156.stdout:9/833: write d6/d19/d25/d3a/dc3/fc8 [808193,98540] 0 2023-12-16T05:56:44.473 INFO:tasks.workunit.client.0.smithi155.stdout:4/934: sync 2023-12-16T05:56:44.474 INFO:tasks.workunit.client.1.smithi156.stdout:9/834: rmdir d6/d19/d25/d3a/d5e/da9 39 2023-12-16T05:56:44.474 INFO:tasks.workunit.client.1.smithi156.stdout:9/835: write d6/d2e/d8a/f113 [818098,67362] 0 2023-12-16T05:56:44.475 INFO:tasks.workunit.client.0.smithi155.stdout:4/935: creat d0/da/de0/d16/d30/d52/d88/d9e/f138 x:0 0 0 2023-12-16T05:56:44.476 INFO:tasks.workunit.client.1.smithi156.stdout:9/836: rename d6/d19/d30/d48/d87/d65/fa0 to d6/d19/d25/d3a/f115 0 2023-12-16T05:56:44.477 INFO:tasks.workunit.client.0.smithi155.stdout:4/936: mkdir d0/da/de0/d16/d30/dce/d75/d3d/d49/dbb/d139 0 2023-12-16T05:56:44.477 INFO:tasks.workunit.client.1.smithi156.stdout:9/837: mkdir d6/d19/d25/d3a/d88/d8b/dac/d116 0 2023-12-16T05:56:44.479 INFO:tasks.workunit.client.1.smithi156.stdout:9/838: link d6/d19/d30/d48/d87/d65/lc4 d6/d19/d30/l117 0 2023-12-16T05:56:44.480 INFO:tasks.workunit.client.1.smithi156.stdout:9/839: mknod d6/d19/d30/c118 0 2023-12-16T05:56:44.482 INFO:tasks.workunit.client.0.smithi155.stdout:3/868: dread d0/f11 [0,4194304] 0 2023-12-16T05:56:44.484 INFO:tasks.workunit.client.0.smithi155.stdout:3/869: write d0/d14/d45/fa0 [2743650,10896] 0 2023-12-16T05:56:44.486 INFO:tasks.workunit.client.0.smithi155.stdout:3/870: symlink d0/d14/d36/d47/d5f/d9a/dd2/l10f 0 2023-12-16T05:56:44.487 INFO:tasks.workunit.client.1.smithi156.stdout:3/755: dwrite dc/d10/d1d/fa3 [0,4194304] 0 2023-12-16T05:56:44.487 INFO:tasks.workunit.client.1.smithi156.stdout:3/756: read dc/d56/f92 [922792,38873] 0 2023-12-16T05:56:44.490 INFO:tasks.workunit.client.1.smithi156.stdout:3/757: creat dc/d10/d1d/db2/d10a/f10e x:0 0 0 2023-12-16T05:56:44.491 INFO:tasks.workunit.client.1.smithi156.stdout:3/758: mknod dc/d10/d1d/d4b/d52/c10f 0 2023-12-16T05:56:44.492 INFO:tasks.workunit.client.1.smithi156.stdout:3/759: mkdir dc/d10/dc6/d110 0 2023-12-16T05:56:44.492 INFO:tasks.workunit.client.1.smithi156.stdout:3/760: truncate dc/d10/d3d/db5/fcf 380973 0 2023-12-16T05:56:44.492 INFO:tasks.workunit.client.1.smithi156.stdout:3/761: readlink dc/d10/l53 0 2023-12-16T05:56:44.492 INFO:tasks.workunit.client.1.smithi156.stdout:3/762: link dc/d56/d67/f79 dc/d56/d67/dbe/dd9/f111 0 2023-12-16T05:56:44.493 INFO:tasks.workunit.client.1.smithi156.stdout:3/763: write dc/d10/d1d/f5d [1778581,56229] 0 2023-12-16T05:56:44.499 INFO:tasks.workunit.client.0.smithi155.stdout:2/986: dwrite d0/d7/dd/d14/fa6 [0,4194304] 0 2023-12-16T05:56:44.499 INFO:tasks.workunit.client.0.smithi155.stdout:2/987: chown d0/d5/d8a/la2 795 1 2023-12-16T05:56:44.499 INFO:tasks.workunit.client.0.smithi155.stdout:2/988: stat d0/d7/dc1/fcc 0 2023-12-16T05:56:44.500 INFO:tasks.workunit.client.0.smithi155.stdout:3/871: dread d0/d1e/d4e/f88 [0,4194304] 0 2023-12-16T05:56:44.501 INFO:tasks.workunit.client.0.smithi155.stdout:7/946: dwrite d0/d6a/dfe/fff [0,4194304] 0 2023-12-16T05:56:44.501 INFO:tasks.workunit.client.0.smithi155.stdout:4/937: dwrite d0/da/de0/d16/d30/dce/d75/d10e/f69 [0,4194304] 0 2023-12-16T05:56:44.501 INFO:tasks.workunit.client.0.smithi155.stdout:4/938: rename d0/da to d0/da/de0/d16/d30/dce/d75/d10e/dd1/d13a 22 2023-12-16T05:56:44.508 INFO:tasks.workunit.client.0.smithi155.stdout:3/872: rmdir d0/d14/d87/d94/da1 39 2023-12-16T05:56:44.509 INFO:tasks.workunit.client.0.smithi155.stdout:3/873: write d0/d14/d36/d47/f98 [4927161,16166] 0 2023-12-16T05:56:44.510 INFO:tasks.workunit.client.0.smithi155.stdout:7/947: link d0/d6a/d1a/d8c/d34/d4b/d60/fd0 d0/d6a/d31/f12f 0 2023-12-16T05:56:44.511 INFO:tasks.workunit.client.1.smithi156.stdout:3/764: dwrite dc/d10/db4/fd7 [0,4194304] 0 2023-12-16T05:56:44.512 INFO:tasks.workunit.client.0.smithi155.stdout:4/939: mkdir d0/da/de0/d16/d30/dce/d75/d10e/d70/d92/d13b 0 2023-12-16T05:56:44.513 INFO:tasks.workunit.client.0.smithi155.stdout:3/874: rename d0/c2 to d0/d1a/d33/c110 0 2023-12-16T05:56:44.514 INFO:tasks.workunit.client.0.smithi155.stdout:3/875: chown d0/d1e/l64 18 1 2023-12-16T05:56:44.514 INFO:tasks.workunit.client.0.smithi155.stdout:3/876: fdatasync d0/d14/fb8 0 2023-12-16T05:56:44.514 INFO:tasks.workunit.client.0.smithi155.stdout:3/877: fsync d0/d14/d36/d47/fbe 0 2023-12-16T05:56:44.514 INFO:tasks.workunit.client.0.smithi155.stdout:3/878: chown d0/d14/fee 16258173 1 2023-12-16T05:56:44.514 INFO:tasks.workunit.client.0.smithi155.stdout:3/879: fsync d0/f55 0 2023-12-16T05:56:44.514 INFO:tasks.workunit.client.0.smithi155.stdout:3/880: readlink d0/d14/d36/d7c/lc0 0 2023-12-16T05:56:44.514 INFO:tasks.workunit.client.0.smithi155.stdout:3/881: stat d0/d1a/d33/c7b 0 2023-12-16T05:56:44.515 INFO:tasks.workunit.client.0.smithi155.stdout:4/940: dread d0/da/de0/d16/d30/dce/d75/d89/f8a [0,4194304] 0 2023-12-16T05:56:44.515 INFO:tasks.workunit.client.0.smithi155.stdout:7/948: creat d0/d6a/d1a/d22/dc8/f130 x:0 0 0 2023-12-16T05:56:44.515 INFO:tasks.workunit.client.1.smithi156.stdout:3/765: rename dc/df/d66/ccc to dc/df/c112 0 2023-12-16T05:56:44.515 INFO:tasks.workunit.client.1.smithi156.stdout:3/766: creat dc/d10/db4/f113 x:0 0 0 2023-12-16T05:56:44.516 INFO:tasks.workunit.client.0.smithi155.stdout:3/882: symlink d0/d14/d36/d7c/l111 0 2023-12-16T05:56:44.516 INFO:tasks.workunit.client.1.smithi156.stdout:3/767: link dc/d56/d67/d6e/l94 dc/d56/d67/d104/l114 0 2023-12-16T05:56:44.516 INFO:tasks.workunit.client.1.smithi156.stdout:3/768: chown dc/d56/d67/d6e/lf6 16 1 2023-12-16T05:56:44.518 INFO:tasks.workunit.client.1.smithi156.stdout:3/769: getdents dc/d56/d69 0 2023-12-16T05:56:44.518 INFO:tasks.workunit.client.0.smithi155.stdout:2/989: dwrite d0/d7/dc1/f150 [0,4194304] 0 2023-12-16T05:56:44.519 INFO:tasks.workunit.client.0.smithi155.stdout:3/883: creat d0/d14/d36/d47/d5f/d9a/f112 x:0 0 0 2023-12-16T05:56:44.525 INFO:tasks.workunit.client.0.smithi155.stdout:4/941: dread d0/da/de0/d16/d30/dce/f6d [0,4194304] 0 2023-12-16T05:56:44.533 INFO:tasks.workunit.client.1.smithi156.stdout:3/770: dread dc/df/d34/f63 [0,4194304] 0 2023-12-16T05:56:44.538 INFO:tasks.workunit.client.1.smithi156.stdout:0/907: sync 2023-12-16T05:56:44.538 INFO:tasks.workunit.client.1.smithi156.stdout:0/908: fsync d2/d7/dd/d29/d38/d51/d65/d7e/fdc 0 2023-12-16T05:56:44.539 INFO:tasks.workunit.client.1.smithi156.stdout:0/909: symlink d2/d7/dd/d29/d4b/l11c 0 2023-12-16T05:56:44.541 INFO:tasks.workunit.client.0.smithi155.stdout:7/949: dwrite d0/d6a/d1a/d8c/d34/d4b/d64/d6f/dba/dc9/fe1 [0,4194304] 0 2023-12-16T05:56:44.541 INFO:tasks.workunit.client.1.smithi156.stdout:0/910: mkdir d2/df0/d11d 0 2023-12-16T05:56:44.545 INFO:tasks.workunit.client.0.smithi155.stdout:3/884: dread d0/d1e/f9f [0,4194304] 0 2023-12-16T05:56:44.545 INFO:tasks.workunit.client.0.smithi155.stdout:2/990: dwrite d0/d7/d1f/d74/d3a/f7a [0,4194304] 0 2023-12-16T05:56:44.546 INFO:tasks.workunit.client.0.smithi155.stdout:2/991: chown d0/d5/d6/d10a 0 1 2023-12-16T05:56:44.546 INFO:tasks.workunit.client.0.smithi155.stdout:3/885: fdatasync d0/d14/d87/d94/da1/f7a 0 2023-12-16T05:56:44.546 INFO:tasks.workunit.client.0.smithi155.stdout:2/992: chown d0/d7/dd/d49/d4b/d8c/dcd 31239 1 2023-12-16T05:56:44.547 INFO:tasks.workunit.client.1.smithi156.stdout:0/911: write d2/d7/dd/d1c/f25 [1758934,31321] 0 2023-12-16T05:56:44.551 INFO:tasks.workunit.client.0.smithi155.stdout:2/993: link d0/d7/dc1/fcc d0/d7/d57/daf/dc4/f158 0 2023-12-16T05:56:44.552 INFO:tasks.workunit.client.0.smithi155.stdout:7/950: dread d0/d6a/d1a/d8c/d34/d4b/d64/d6e/f7e [0,4194304] 0 2023-12-16T05:56:44.558 INFO:tasks.workunit.client.1.smithi156.stdout:0/912: write d2/d7/dd/d29/f6b [1216322,79161] 0 2023-12-16T05:56:44.558 INFO:tasks.workunit.client.1.smithi156.stdout:3/771: dwrite dc/d10/d3d/f29 [0,4194304] 0 2023-12-16T05:56:44.559 INFO:tasks.workunit.client.1.smithi156.stdout:3/772: chown dc/d56/l65 40855785 1 2023-12-16T05:56:44.560 INFO:tasks.workunit.client.1.smithi156.stdout:0/913: write d2/d47/f80 [1823612,61661] 0 2023-12-16T05:56:44.561 INFO:tasks.workunit.client.0.smithi155.stdout:7/951: dread d0/d6a/d1a/d8c/d34/d4b/d64/d6f/f81 [0,4194304] 0 2023-12-16T05:56:44.561 INFO:tasks.workunit.client.0.smithi155.stdout:7/952: symlink d0/d6a/d1a/d8c/d34/d4b/l131 0 2023-12-16T05:56:44.562 INFO:tasks.workunit.client.0.smithi155.stdout:7/953: dread - d0/d1b/d103/f11a zero size 2023-12-16T05:56:44.562 INFO:tasks.workunit.client.0.smithi155.stdout:7/954: rmdir d0 39 2023-12-16T05:56:44.566 INFO:tasks.workunit.client.1.smithi156.stdout:0/914: creat d2/d7/dd/d29/d38/dae/d100/d44/f11e x:0 0 0 2023-12-16T05:56:44.566 INFO:tasks.workunit.client.1.smithi156.stdout:0/915: stat d2/d7/dd/d29/d4b/f116 0 2023-12-16T05:56:44.575 INFO:tasks.workunit.client.0.smithi155.stdout:7/955: dread d0/d6a/d1a/d8c/d34/d4b/d64/d6e/f7e [0,4194304] 0 2023-12-16T05:56:44.575 INFO:tasks.workunit.client.0.smithi155.stdout:3/886: dwrite d0/d14/d36/f102 [0,4194304] 0 2023-12-16T05:56:44.576 INFO:tasks.workunit.client.0.smithi155.stdout:2/994: dwrite d0/d34/d3c/f43 [0,4194304] 0 2023-12-16T05:56:44.577 INFO:tasks.workunit.client.0.smithi155.stdout:2/995: fdatasync d0/d7/d57/d63/ff1 0 2023-12-16T05:56:44.577 INFO:tasks.workunit.client.0.smithi155.stdout:3/887: rename d0/d14/d36/f89 to d0/d1a/d33/d57/dc3/f113 0 2023-12-16T05:56:44.581 INFO:tasks.workunit.client.1.smithi156.stdout:3/773: dwrite dc/df/fb8 [0,4194304] 0 2023-12-16T05:56:44.583 INFO:tasks.workunit.client.1.smithi156.stdout:3/774: creat dc/d10/dc6/f115 x:0 0 0 2023-12-16T05:56:44.585 INFO:tasks.workunit.client.1.smithi156.stdout:3/775: unlink dc/d10/d1d/db2/fcb 0 2023-12-16T05:56:44.586 INFO:tasks.workunit.client.1.smithi156.stdout:3/776: rmdir dc/d10/db4 39 2023-12-16T05:56:44.586 INFO:tasks.workunit.client.1.smithi156.stdout:3/777: chown dc/d10/d1d/d90/c10d 7 1 2023-12-16T05:56:44.586 INFO:tasks.workunit.client.1.smithi156.stdout:3/778: stat dc/d56/d67/dbe 0 2023-12-16T05:56:44.587 INFO:tasks.workunit.client.0.smithi155.stdout:7/956: dread d0/d6a/d1a/d8c/d34/d4b/fb6 [0,4194304] 0 2023-12-16T05:56:44.587 INFO:tasks.workunit.client.0.smithi155.stdout:7/957: fdatasync d0/d1/f21 0 2023-12-16T05:56:44.587 INFO:tasks.workunit.client.0.smithi155.stdout:3/888: dread d0/d14/fee [0,4194304] 0 2023-12-16T05:56:44.588 INFO:tasks.workunit.client.1.smithi156.stdout:3/779: rename dc/d10/f7e to dc/d10/d1d/dff/f116 0 2023-12-16T05:56:44.588 INFO:tasks.workunit.client.0.smithi155.stdout:7/958: creat d0/d10f/f132 x:0 0 0 2023-12-16T05:56:44.589 INFO:tasks.workunit.client.1.smithi156.stdout:3/780: creat dc/d10/d3d/db5/f117 x:0 0 0 2023-12-16T05:56:44.589 INFO:tasks.workunit.client.1.smithi156.stdout:3/781: chown dc/d10/d1d/d4b/dac/c109 873476 1 2023-12-16T05:56:44.589 INFO:tasks.workunit.client.1.smithi156.stdout:3/782: dread - dc/d10/d3d/db5/fd8 zero size 2023-12-16T05:56:44.589 INFO:tasks.workunit.client.1.smithi156.stdout:3/783: chown dc/d10/d3d/db5/lbc 4700 1 2023-12-16T05:56:44.590 INFO:tasks.workunit.client.0.smithi155.stdout:3/889: mknod d0/d1a/d33/c114 0 2023-12-16T05:56:44.590 INFO:tasks.workunit.client.0.smithi155.stdout:3/890: write d0/d14/d87/d94/da1/f7a [1508887,80769] 0 2023-12-16T05:56:44.595 INFO:tasks.workunit.client.1.smithi156.stdout:3/784: dread fb [4194304,4194304] 0 2023-12-16T05:56:44.595 INFO:tasks.workunit.client.1.smithi156.stdout:3/785: stat dc/d10/d1d/d4b/fa7 0 2023-12-16T05:56:44.595 INFO:tasks.workunit.client.1.smithi156.stdout:3/786: creat dc/d10/d1d/d4b/dac/f118 x:0 0 0 2023-12-16T05:56:44.596 INFO:tasks.workunit.client.1.smithi156.stdout:3/787: symlink dc/d10/d3d/d4e/l119 0 2023-12-16T05:56:44.596 INFO:tasks.workunit.client.1.smithi156.stdout:3/788: write dc/d10/d1d/d4b/fb6 [905103,115263] 0 2023-12-16T05:56:44.597 INFO:tasks.workunit.client.1.smithi156.stdout:3/789: readlink dc/l2a 0 2023-12-16T05:56:44.600 INFO:tasks.workunit.client.0.smithi155.stdout:2/996: dwrite d0/d7/d69/d77/fac [0,4194304] 0 2023-12-16T05:56:44.603 INFO:tasks.workunit.client.0.smithi155.stdout:2/997: unlink d0/d7/d1f/d74/d85/c133 0 2023-12-16T05:56:44.603 INFO:tasks.workunit.client.0.smithi155.stdout:2/998: chown d0/d7/d57/d63/de7/lf5 362 1 2023-12-16T05:56:44.603 INFO:tasks.workunit.client.0.smithi155.stdout:2/999: chown d0/d7/d1f/cf6 21113415 1 2023-12-16T05:56:44.607 INFO:tasks.workunit.client.1.smithi156.stdout:3/790: dwrite dc/d10/d3d/df8/f103 [0,4194304] 0 2023-12-16T05:56:44.608 INFO:tasks.workunit.client.1.smithi156.stdout:3/791: creat dc/d10/d10b/f11a x:0 0 0 2023-12-16T05:56:44.609 INFO:tasks.workunit.client.1.smithi156.stdout:3/792: chown dc/d56/c84 381910 1 2023-12-16T05:56:44.615 INFO:tasks.workunit.client.1.smithi156.stdout:3/793: dread dc/df/d34/d62/f9a [0,4194304] 0 2023-12-16T05:56:44.616 INFO:tasks.workunit.client.1.smithi156.stdout:3/794: truncate dc/d10/f82 4018298 0 2023-12-16T05:56:44.645 INFO:tasks.workunit.client.1.smithi156.stdout:4/778: sync 2023-12-16T05:56:44.645 INFO:tasks.workunit.client.1.smithi156.stdout:2/778: sync 2023-12-16T05:56:44.645 INFO:tasks.workunit.client.1.smithi156.stdout:8/657: sync 2023-12-16T05:56:44.646 INFO:tasks.workunit.client.1.smithi156.stdout:8/658: chown d3/d12/d16/fd7 3 1 2023-12-16T05:56:44.646 INFO:tasks.workunit.client.1.smithi156.stdout:2/779: rmdir d9/d68/daa/db4 39 2023-12-16T05:56:44.646 INFO:tasks.workunit.client.1.smithi156.stdout:8/659: creat d3/d7a/d7d/dae/d94/fdd x:0 0 0 2023-12-16T05:56:44.647 INFO:tasks.workunit.client.1.smithi156.stdout:2/780: write d9/d68/daa/db4/f99 [963790,34927] 0 2023-12-16T05:56:44.648 INFO:tasks.workunit.client.1.smithi156.stdout:8/660: mkdir d3/d7/d62/dde 0 2023-12-16T05:56:44.660 INFO:tasks.workunit.client.1.smithi156.stdout:8/661: dread d3/d7a/d7d/dae/f19 [0,4194304] 0 2023-12-16T05:56:44.667 INFO:tasks.workunit.client.1.smithi156.stdout:8/662: dread d3/d7a/fa4 [0,4194304] 0 2023-12-16T05:56:44.667 INFO:tasks.workunit.client.1.smithi156.stdout:8/663: truncate d3/d12/fda 431470 0 2023-12-16T05:56:44.668 INFO:tasks.workunit.client.1.smithi156.stdout:8/664: creat d3/d7/d27/d46/d84/d85/fdf x:0 0 0 2023-12-16T05:56:44.668 INFO:tasks.workunit.client.1.smithi156.stdout:8/665: creat d3/d7/d27/d46/d84/fe0 x:0 0 0 2023-12-16T05:56:44.672 INFO:tasks.workunit.client.1.smithi156.stdout:4/779: dwrite d9/d2c/d7a/f8a [0,4194304] 0 2023-12-16T05:56:44.672 INFO:tasks.workunit.client.1.smithi156.stdout:4/780: fsync d9/d2c/dbf/dfa/d7d/fc7 0 2023-12-16T05:56:44.672 INFO:tasks.workunit.client.1.smithi156.stdout:4/781: readlink d9/l64 0 2023-12-16T05:56:44.673 INFO:tasks.workunit.client.1.smithi156.stdout:4/782: truncate d9/d43/fac 127974 0 2023-12-16T05:56:44.673 INFO:tasks.workunit.client.1.smithi156.stdout:2/781: dwrite d9/d12/dc2/dd8/da6/f6f [0,4194304] 0 2023-12-16T05:56:44.675 INFO:tasks.workunit.client.1.smithi156.stdout:4/783: dread d9/fa3 [0,4194304] 0 2023-12-16T05:56:44.677 INFO:tasks.workunit.client.1.smithi156.stdout:2/782: symlink d9/dd/lf4 0 2023-12-16T05:56:44.677 INFO:tasks.workunit.client.1.smithi156.stdout:4/784: creat d9/d2b/d35/dd3/f109 x:0 0 0 2023-12-16T05:56:44.677 INFO:tasks.workunit.client.1.smithi156.stdout:4/785: dread - d9/d2b/d98/ff9 zero size 2023-12-16T05:56:44.678 INFO:tasks.workunit.client.1.smithi156.stdout:2/783: mkdir d9/dd/d17/d33/d47/ddd/df5 0 2023-12-16T05:56:44.678 INFO:tasks.workunit.client.1.smithi156.stdout:2/784: fdatasync d9/dd/d17/d33/d78/d39/f4c 0 2023-12-16T05:56:44.679 INFO:tasks.workunit.client.1.smithi156.stdout:4/786: creat d9/d2c/dbf/dfa/d7d/d100/f10a x:0 0 0 2023-12-16T05:56:44.679 INFO:tasks.workunit.client.1.smithi156.stdout:4/787: fdatasync f5 0 2023-12-16T05:56:44.679 INFO:tasks.workunit.client.1.smithi156.stdout:4/788: fdatasync d9/f38 0 2023-12-16T05:56:44.680 INFO:tasks.workunit.client.1.smithi156.stdout:2/785: rename d9/dd/d17/d33/f40 to d9/d68/daa/db4/ff6 0 2023-12-16T05:56:44.682 INFO:tasks.workunit.client.1.smithi156.stdout:4/789: unlink d9/d2b/d98/ff9 0 2023-12-16T05:56:44.685 INFO:tasks.workunit.client.1.smithi156.stdout:4/790: creat d9/d2b/d35/dd3/f10b x:0 0 0 2023-12-16T05:56:44.688 INFO:tasks.workunit.client.1.smithi156.stdout:8/666: dwrite d3/d7a/d7d/dae/f39 [0,4194304] 0 2023-12-16T05:56:44.688 INFO:tasks.workunit.client.1.smithi156.stdout:8/667: chown d3/cb 256106080 1 2023-12-16T05:56:44.693 INFO:tasks.workunit.client.1.smithi156.stdout:2/786: dwrite d9/d56/f9a [4194304,4194304] 0 2023-12-16T05:56:44.701 INFO:tasks.workunit.client.1.smithi156.stdout:4/791: creat d9/d2b/f10c x:0 0 0 2023-12-16T05:56:44.705 INFO:tasks.workunit.client.1.smithi156.stdout:4/792: read d9/d2b/d98/d99/fb1 [3596812,75970] 0 2023-12-16T05:56:44.724 INFO:tasks.workunit.client.1.smithi156.stdout:8/668: symlink d3/d12/d95/le1 0 2023-12-16T05:56:44.733 INFO:tasks.workunit.client.1.smithi156.stdout:2/787: creat d9/dd/d17/d33/d47/ff7 x:0 0 0 2023-12-16T05:56:44.733 INFO:tasks.workunit.client.1.smithi156.stdout:4/793: mknod d9/d2c/dbf/dfa/d7d/c10d 0 2023-12-16T05:56:44.735 INFO:tasks.workunit.client.1.smithi156.stdout:4/794: read d9/d2c/dbf/dfa/d7d/d100/f104 [648735,124639] 0 2023-12-16T05:56:44.735 INFO:tasks.workunit.client.1.smithi156.stdout:8/669: rename d3/d7/fb2 to d3/d7/d27/d46/d84/d85/d9b/fe2 0 2023-12-16T05:56:44.737 INFO:tasks.workunit.client.1.smithi156.stdout:2/788: rmdir d9/dd/d17/d33/d78 39 2023-12-16T05:56:44.739 INFO:tasks.workunit.client.1.smithi156.stdout:4/795: creat d9/d2b/d35/dd3/f10e x:0 0 0 2023-12-16T05:56:44.739 INFO:tasks.workunit.client.1.smithi156.stdout:4/796: fdatasync d9/f23 0 2023-12-16T05:56:44.739 INFO:tasks.workunit.client.1.smithi156.stdout:4/797: chown d9/d2c/dbf/dfa/d95/f97 12 1 2023-12-16T05:56:44.739 INFO:tasks.workunit.client.1.smithi156.stdout:4/798: dread - d9/d2b/d35/dd3/f10b zero size 2023-12-16T05:56:44.741 INFO:tasks.workunit.client.1.smithi156.stdout:8/670: unlink d3/d7a/d7d/dae/f41 0 2023-12-16T05:56:44.742 INFO:tasks.workunit.client.1.smithi156.stdout:4/799: creat d9/d2b/f10f x:0 0 0 2023-12-16T05:56:44.743 INFO:tasks.workunit.client.1.smithi156.stdout:2/789: dread d9/dd/d17/d33/d78/f3c [0,4194304] 0 2023-12-16T05:56:44.744 INFO:tasks.workunit.client.1.smithi156.stdout:2/790: readlink d9/d68/daa/la8 0 2023-12-16T05:56:44.744 INFO:tasks.workunit.client.1.smithi156.stdout:2/791: write d9/dd/d17/d33/d47/f6e [3954190,103100] 0 2023-12-16T05:56:44.745 INFO:tasks.workunit.client.1.smithi156.stdout:2/792: rename d9 to d9/d12/d3d/df8 22 2023-12-16T05:56:44.745 INFO:tasks.workunit.client.1.smithi156.stdout:4/800: mkdir d9/d2c/dbf/dfa/d95/d110 0 2023-12-16T05:56:44.746 INFO:tasks.workunit.client.1.smithi156.stdout:2/793: creat d9/dd/d17/d33/d78/ff9 x:0 0 0 2023-12-16T05:56:44.748 INFO:tasks.workunit.client.1.smithi156.stdout:2/794: rename d9/fe4 to d9/d12/dc2/ffa 0 2023-12-16T05:56:44.751 INFO:tasks.workunit.client.1.smithi156.stdout:2/795: write d9/d68/daa/d83/f84 [3165562,49596] 0 2023-12-16T05:56:44.754 INFO:tasks.workunit.client.1.smithi156.stdout:2/796: symlink d9/d12/dc2/lfb 0 2023-12-16T05:56:44.764 INFO:tasks.workunit.client.1.smithi156.stdout:4/801: dwrite d9/d2c/d7a/fab [0,4194304] 0 2023-12-16T05:56:44.764 INFO:tasks.workunit.client.1.smithi156.stdout:2/797: dread d9/d68/daa/db4/ff6 [0,4194304] 0 2023-12-16T05:56:44.765 INFO:tasks.workunit.client.1.smithi156.stdout:2/798: write d9/d12/dc2/fe2 [1652742,60705] 0 2023-12-16T05:56:44.766 INFO:tasks.workunit.client.1.smithi156.stdout:8/671: unlink d3/d12/d16/c49 0 2023-12-16T05:56:44.766 INFO:tasks.workunit.client.1.smithi156.stdout:8/672: write d3/d12/d16/fd7 [539876,72836] 0 2023-12-16T05:56:44.766 INFO:tasks.workunit.client.1.smithi156.stdout:8/673: dread - d3/d7/d27/d46/d6e/d3b/d77/fd8 zero size 2023-12-16T05:56:44.770 INFO:tasks.workunit.client.1.smithi156.stdout:4/802: link d9/l1d d9/d2c/d7a/dd4/df0/l111 0 2023-12-16T05:56:44.772 INFO:tasks.workunit.client.1.smithi156.stdout:2/799: creat d9/dd/d17/d33/def/ffc x:0 0 0 2023-12-16T05:56:44.775 INFO:tasks.workunit.client.1.smithi156.stdout:8/674: link d3/d7/d27/d46/d6e/d3b/d77/fd8 d3/d12/d16/fe3 0 2023-12-16T05:56:44.776 INFO:tasks.workunit.client.1.smithi156.stdout:4/803: mknod d9/d2c/dbf/dfa/d95/c112 0 2023-12-16T05:56:44.776 INFO:tasks.workunit.client.1.smithi156.stdout:4/804: chown d9/d2c/dbf/dfa/l6e 92 1 2023-12-16T05:56:44.776 INFO:tasks.workunit.client.1.smithi156.stdout:4/805: chown d9/d2c/f2f 1224583 1 2023-12-16T05:56:44.778 INFO:tasks.workunit.client.1.smithi156.stdout:2/800: mkdir d9/d68/daa/d83/dfd 0 2023-12-16T05:56:44.784 INFO:tasks.workunit.client.1.smithi156.stdout:4/806: creat d9/d2c/dbf/f113 x:0 0 0 2023-12-16T05:56:44.812 INFO:tasks.workunit.client.1.smithi156.stdout:2/801: dwrite d9/dd/d17/d33/dae/fb0 [4194304,4194304] 0 2023-12-16T05:56:44.812 INFO:tasks.workunit.client.1.smithi156.stdout:2/802: write d9/dd/d17/f61 [191930,98556] 0 2023-12-16T05:56:44.812 INFO:tasks.workunit.client.1.smithi156.stdout:8/675: dwrite d3/d7a/fab [0,4194304] 0 2023-12-16T05:56:44.812 INFO:tasks.workunit.client.1.smithi156.stdout:8/676: chown d3/d7/d62/c75 148 1 2023-12-16T05:56:44.813 INFO:tasks.workunit.client.1.smithi156.stdout:8/677: write d3/d12/d16/d54/f99 [813239,104259] 0 2023-12-16T05:56:44.817 INFO:tasks.workunit.client.1.smithi156.stdout:2/803: mknod d9/dd/d17/d33/d47/ddd/df5/cfe 0 2023-12-16T05:56:44.823 INFO:tasks.workunit.client.1.smithi156.stdout:8/678: symlink d3/d7/le4 0 2023-12-16T05:56:44.823 INFO:tasks.workunit.client.1.smithi156.stdout:8/679: readlink d3/d7a/d7d/dae/d94/la1 0 2023-12-16T05:56:44.823 INFO:tasks.workunit.client.1.smithi156.stdout:9/840: sync 2023-12-16T05:56:44.824 INFO:tasks.workunit.client.1.smithi156.stdout:1/730: sync 2023-12-16T05:56:44.824 INFO:tasks.workunit.client.1.smithi156.stdout:3/795: sync 2023-12-16T05:56:44.824 INFO:tasks.workunit.client.1.smithi156.stdout:6/899: sync 2023-12-16T05:56:44.824 INFO:tasks.workunit.client.1.smithi156.stdout:0/916: sync 2023-12-16T05:56:44.824 INFO:tasks.workunit.client.1.smithi156.stdout:0/917: getdents d2/df0/d11d 0 2023-12-16T05:56:44.824 INFO:tasks.workunit.client.1.smithi156.stdout:0/918: chown d2/d7/dd/d2d/dcf/dd0/le9 102291 1 2023-12-16T05:56:44.824 INFO:tasks.workunit.client.1.smithi156.stdout:0/919: stat d2/d7/dd/d2d/c7b 0 2023-12-16T05:56:44.824 INFO:tasks.workunit.client.1.smithi156.stdout:0/920: chown d2/d7/dd/d2d/d5e 103 1 2023-12-16T05:56:44.825 INFO:tasks.workunit.client.1.smithi156.stdout:2/804: mknod d9/dd/d17/d33/d78/d39/cff 0 2023-12-16T05:56:44.825 INFO:tasks.workunit.client.1.smithi156.stdout:2/805: getdents d9/d12/dc2/dd8/da6 0 2023-12-16T05:56:44.825 INFO:tasks.workunit.client.1.smithi156.stdout:2/806: write d9/dd/d17/d33/d78/d39/f4c [1007003,6117] 0 2023-12-16T05:56:44.826 INFO:tasks.workunit.client.1.smithi156.stdout:9/841: mkdir d6/d2e/d8a/da5/d119 0 2023-12-16T05:56:44.827 INFO:tasks.workunit.client.1.smithi156.stdout:1/731: creat d3/d17/d1c/d22/d57/d61/dc1/fff x:0 0 0 2023-12-16T05:56:44.828 INFO:tasks.workunit.client.1.smithi156.stdout:3/796: creat dc/f11b x:0 0 0 2023-12-16T05:56:44.829 INFO:tasks.workunit.client.1.smithi156.stdout:3/797: chown dc/d10/d1d/c4d 6731832 1 2023-12-16T05:56:44.829 INFO:tasks.workunit.client.1.smithi156.stdout:3/798: readlink dc/df/le6 0 2023-12-16T05:56:44.830 INFO:tasks.workunit.client.1.smithi156.stdout:3/799: write fb [6027496,4643] 0 2023-12-16T05:56:44.830 INFO:tasks.workunit.client.1.smithi156.stdout:6/900: mknod d9/d13/d3e/d5f/c123 0 2023-12-16T05:56:44.831 INFO:tasks.workunit.client.1.smithi156.stdout:0/921: mkdir d2/d7/dd/d2d/d5e/d110/dbc/d11f 0 2023-12-16T05:56:44.832 INFO:tasks.workunit.client.1.smithi156.stdout:8/680: mkdir d3/d7/d27/d46/d84/d85/d9b/de5 0 2023-12-16T05:56:44.833 INFO:tasks.workunit.client.1.smithi156.stdout:9/842: symlink d6/d103/l11a 0 2023-12-16T05:56:44.837 INFO:tasks.workunit.client.1.smithi156.stdout:6/901: dread d9/d13/d2f/f3f [0,4194304] 0 2023-12-16T05:56:44.837 INFO:tasks.workunit.client.1.smithi156.stdout:6/902: rename d9/d13/d2f/d51/d69/d99/db9/d110/d8e to d9/d13/d2f/d51/d69/d99/db9/d110/d8e/d9a/dce/df0/d107/d124 22 2023-12-16T05:56:44.838 INFO:tasks.workunit.client.1.smithi156.stdout:2/807: dwrite d9/d12/f18 [0,4194304] 0 2023-12-16T05:56:44.839 INFO:tasks.workunit.client.1.smithi156.stdout:3/800: mkdir dc/d10/d3d/df8/d11c 0 2023-12-16T05:56:44.841 INFO:tasks.workunit.client.1.smithi156.stdout:0/922: creat d2/d7/dd/d2d/d5e/d110/f120 x:0 0 0 2023-12-16T05:56:44.841 INFO:tasks.workunit.client.1.smithi156.stdout:0/923: fsync d2/d7/dd/d2d/d5e/dc4/f108 0 2023-12-16T05:56:44.841 INFO:tasks.workunit.client.1.smithi156.stdout:0/924: truncate d2/d7/dd/d2d/f9a 4966637 0 2023-12-16T05:56:44.841 INFO:tasks.workunit.client.1.smithi156.stdout:0/925: chown d2/d7/dd/d2d/d5e/d110/dbc/dd2/def 47562 1 2023-12-16T05:56:44.841 INFO:tasks.workunit.client.1.smithi156.stdout:0/926: chown d2/d7/dd/d29/d38/dae/ld9 36 1 2023-12-16T05:56:44.843 INFO:tasks.workunit.client.1.smithi156.stdout:9/843: mknod d6/d2e/dad/c11b 0 2023-12-16T05:56:44.843 INFO:tasks.workunit.client.1.smithi156.stdout:1/732: rmdir d3 39 2023-12-16T05:56:44.844 INFO:tasks.workunit.client.1.smithi156.stdout:9/844: write d6/d2e/f66 [863979,77769] 0 2023-12-16T05:56:44.848 INFO:tasks.workunit.client.1.smithi156.stdout:6/903: unlink d9/d13/d2f/d51/caa 0 2023-12-16T05:56:44.848 INFO:tasks.workunit.client.1.smithi156.stdout:6/904: chown d9/d13/d2f/d51/d6b/d77/l76 4 1 2023-12-16T05:56:44.850 INFO:tasks.workunit.client.1.smithi156.stdout:2/808: symlink d9/dd/d17/d33/d78/d39/d8c/l100 0 2023-12-16T05:56:44.850 INFO:tasks.workunit.client.1.smithi156.stdout:2/809: write d9/d12/dc2/dd8/da6/d80/f8b [2381630,85826] 0 2023-12-16T05:56:44.851 INFO:tasks.workunit.client.1.smithi156.stdout:3/801: mkdir dc/d10/db4/d11d 0 2023-12-16T05:56:44.853 INFO:tasks.workunit.client.1.smithi156.stdout:8/681: link d3/d7/d27/d46/d6e/d3c/f55 d3/d12/d74/fe6 0 2023-12-16T05:56:44.853 INFO:tasks.workunit.client.1.smithi156.stdout:8/682: dread - d3/d7/d66/d76/fd4 zero size 2023-12-16T05:56:44.853 INFO:tasks.workunit.client.1.smithi156.stdout:1/733: getdents d3/d3a/db1 0 2023-12-16T05:56:44.854 INFO:tasks.workunit.client.1.smithi156.stdout:9/845: getdents d6/d2e/d8a/da5 0 2023-12-16T05:56:44.856 INFO:tasks.workunit.client.1.smithi156.stdout:6/905: rename d9/d13/d2f/d51/lfa to d9/d13/d2f/d51/d82/l125 0 2023-12-16T05:56:44.858 INFO:tasks.workunit.client.1.smithi156.stdout:0/927: dwrite d2/d7/dd/d29/f109 [0,4194304] 0 2023-12-16T05:56:44.858 INFO:tasks.workunit.client.1.smithi156.stdout:2/810: mkdir d9/dd/d17/d33/d78/d74/d101 0 2023-12-16T05:56:44.860 INFO:tasks.workunit.client.1.smithi156.stdout:8/683: write d3/d7/d66/d76/f7e [2280437,81918] 0 2023-12-16T05:56:44.861 INFO:tasks.workunit.client.1.smithi156.stdout:3/802: creat dc/d10/d1d/d90/f11e x:0 0 0 2023-12-16T05:56:44.862 INFO:tasks.workunit.client.1.smithi156.stdout:1/734: link d3/d17/lcb d3/d1b/df9/l100 0 2023-12-16T05:56:44.863 INFO:tasks.workunit.client.1.smithi156.stdout:9/846: getdents d6/d19/d30 0 2023-12-16T05:56:44.864 INFO:tasks.workunit.client.1.smithi156.stdout:6/906: mkdir d9/d1c/d50/dbf/dc0/d126 0 2023-12-16T05:56:44.868 INFO:tasks.workunit.client.1.smithi156.stdout:2/811: truncate d9/d68/f90 2510151 0 2023-12-16T05:56:44.868 INFO:tasks.workunit.client.1.smithi156.stdout:8/684: rmdir d3/d7/d62 39 2023-12-16T05:56:44.870 INFO:tasks.workunit.client.1.smithi156.stdout:3/803: link dc/df/fcd dc/df/d66/f11f 0 2023-12-16T05:56:44.871 INFO:tasks.workunit.client.1.smithi156.stdout:8/685: dread d3/d12/f70 [0,4194304] 0 2023-12-16T05:56:44.872 INFO:tasks.workunit.client.1.smithi156.stdout:1/735: truncate d3/d17/d1c/d22/f51 2237420 0 2023-12-16T05:56:44.873 INFO:tasks.workunit.client.1.smithi156.stdout:6/907: creat d9/d13/d2f/d51/f127 x:0 0 0 2023-12-16T05:56:44.873 INFO:tasks.workunit.client.1.smithi156.stdout:6/908: chown d9/d1c/d50/dbf/dc0 72 1 2023-12-16T05:56:44.874 INFO:tasks.workunit.client.1.smithi156.stdout:2/812: rename d9/dd/d17/d33/d78/d39/d8c/db2 to d9/d12/d3d/d102 0 2023-12-16T05:56:44.874 INFO:tasks.workunit.client.1.smithi156.stdout:2/813: write d9/d12/fb9 [715758,126998] 0 2023-12-16T05:56:44.875 INFO:tasks.workunit.client.1.smithi156.stdout:2/814: fsync d9/f20 0 2023-12-16T05:56:44.875 INFO:tasks.workunit.client.1.smithi156.stdout:2/815: write d9/d12/d3d/f48 [4514182,65211] 0 2023-12-16T05:56:44.875 INFO:tasks.workunit.client.1.smithi156.stdout:2/816: dread - d9/d12/dc2/dd8/ff2 zero size 2023-12-16T05:56:44.875 INFO:tasks.workunit.client.1.smithi156.stdout:3/804: mkdir dc/d10/d3d/d4e/d120 0 2023-12-16T05:56:44.876 INFO:tasks.workunit.client.1.smithi156.stdout:8/686: mknod d3/d6/d83/ce7 0 2023-12-16T05:56:44.877 INFO:tasks.workunit.client.1.smithi156.stdout:8/687: write d3/d7a/fab [3887638,72053] 0 2023-12-16T05:56:44.883 INFO:tasks.workunit.client.1.smithi156.stdout:3/805: rename dc/df/de1 to dc/d56/d67/dbe/dc3/ded/d121 0 2023-12-16T05:56:44.883 INFO:tasks.workunit.client.1.smithi156.stdout:3/806: chown dc/d10/d1d/db2/cdf 50272823 1 2023-12-16T05:56:44.884 INFO:tasks.workunit.client.1.smithi156.stdout:3/807: creat dc/d56/d67/f122 x:0 0 0 2023-12-16T05:56:44.884 INFO:tasks.workunit.client.1.smithi156.stdout:3/808: write dc/d10/db4/f113 [435751,101806] 0 2023-12-16T05:56:44.888 INFO:tasks.workunit.client.1.smithi156.stdout:3/809: dread dc/d10/f24 [0,4194304] 0 2023-12-16T05:56:44.891 INFO:tasks.workunit.client.1.smithi156.stdout:6/909: dread d9/d13/d2f/d36/f96 [0,4194304] 0 2023-12-16T05:56:44.891 INFO:tasks.workunit.client.1.smithi156.stdout:6/910: fdatasync d9/d13/d2f/d51/d69/d99/fe9 0 2023-12-16T05:56:44.891 INFO:tasks.workunit.client.1.smithi156.stdout:6/911: chown d9 188 1 2023-12-16T05:56:44.892 INFO:tasks.workunit.client.1.smithi156.stdout:6/912: symlink d9/d13/d3e/d5f/l128 0 2023-12-16T05:56:44.900 INFO:tasks.workunit.client.1.smithi156.stdout:8/688: dwrite d3/d7/d62/f9d [0,4194304] 0 2023-12-16T05:56:44.901 INFO:tasks.workunit.client.1.smithi156.stdout:9/847: dwrite d6/d2e/f89 [0,4194304] 0 2023-12-16T05:56:44.902 INFO:tasks.workunit.client.1.smithi156.stdout:9/848: stat d6/d19/d30/d5b/d9a/c10e 0 2023-12-16T05:56:44.902 INFO:tasks.workunit.client.1.smithi156.stdout:9/849: dread - d6/d19/d30/d48/fa4 zero size 2023-12-16T05:56:44.944 INFO:tasks.workunit.client.1.smithi156.stdout:2/817: rmdir d9/dd/d17/d33/d78/d39/d8c 39 2023-12-16T05:56:44.944 INFO:tasks.workunit.client.1.smithi156.stdout:3/810: dwrite dc/df/d34/d62/d75/fa9 [0,4194304] 0 2023-12-16T05:56:44.944 INFO:tasks.workunit.client.1.smithi156.stdout:6/913: dwrite d9/d13/d2f/d51/d82/fa0 [0,4194304] 0 2023-12-16T05:56:44.944 INFO:tasks.workunit.client.1.smithi156.stdout:6/914: truncate d9/d13/d2f/d51/d6b/fd3 794507 0 2023-12-16T05:56:44.945 INFO:tasks.workunit.client.1.smithi156.stdout:2/818: creat d9/d12/f103 x:0 0 0 2023-12-16T05:56:44.945 INFO:tasks.workunit.client.1.smithi156.stdout:8/689: dwrite d3/d7/fd1 [0,4194304] 0 2023-12-16T05:56:44.945 INFO:tasks.workunit.client.1.smithi156.stdout:8/690: chown d3/d7a/d7d/dae 4110618 1 2023-12-16T05:56:44.946 INFO:tasks.workunit.client.1.smithi156.stdout:2/819: write d9/d12/dc2/dd8/dad/fc3 [3956518,131013] 0 2023-12-16T05:56:44.947 INFO:tasks.workunit.client.0.smithi155.stdout:4/942: sync 2023-12-16T05:56:44.947 INFO:tasks.workunit.client.1.smithi156.stdout:3/811: mknod dc/d10/d3d/d4e/c123 0 2023-12-16T05:56:44.949 INFO:tasks.workunit.client.0.smithi155.stdout:4/943: creat d0/da/d36/f13c x:0 0 0 2023-12-16T05:56:44.949 INFO:tasks.workunit.client.0.smithi155.stdout:4/944: chown d0/da/de0/d16/d30/dce/d75/d3d/d85/l104 6596333 1 2023-12-16T05:56:44.950 INFO:tasks.workunit.client.0.smithi155.stdout:4/945: symlink d0/da/de0/d16/d30/d52/d88/d9e/d103/de2/l13d 0 2023-12-16T05:56:44.950 INFO:tasks.workunit.client.1.smithi156.stdout:6/915: creat d9/d13/d2f/d51/d6b/d77/f129 x:0 0 0 2023-12-16T05:56:44.951 INFO:tasks.workunit.client.0.smithi155.stdout:4/946: creat d0/da/de0/d16/d30/dce/d75/d10e/f13e x:0 0 0 2023-12-16T05:56:44.951 INFO:tasks.workunit.client.0.smithi155.stdout:4/947: truncate d0/da/de0/d16/d30/dce/d75/d10e/f72 3737624 0 2023-12-16T05:56:44.952 INFO:tasks.workunit.client.0.smithi155.stdout:4/948: write d0/da/de0/d16/d30/dce/f125 [680078,25418] 0 2023-12-16T05:56:44.952 INFO:tasks.workunit.client.0.smithi155.stdout:4/949: readlink d0/d10/ldd 0 2023-12-16T05:56:44.952 INFO:tasks.workunit.client.0.smithi155.stdout:4/950: mknod d0/da/de0/d16/d30/dce/d75/d50/c13f 0 2023-12-16T05:56:44.954 INFO:tasks.workunit.client.1.smithi156.stdout:8/691: creat d3/d12/d74/fe8 x:0 0 0 2023-12-16T05:56:44.955 INFO:tasks.workunit.client.1.smithi156.stdout:8/692: write d3/d7a/d7d/dae/f64 [3861039,55330] 0 2023-12-16T05:56:44.958 INFO:tasks.workunit.client.1.smithi156.stdout:2/820: rename d9/dd/d17/d33/d78/d74/fe6 to d9/d12/dc2/dd8/da6/d80/f104 0 2023-12-16T05:56:44.958 INFO:tasks.workunit.client.1.smithi156.stdout:3/812: dread dc/df/d66/fdd [0,4194304] 0 2023-12-16T05:56:44.959 INFO:tasks.workunit.client.1.smithi156.stdout:6/916: creat d9/d1c/d50/dbf/dc0/f12a x:0 0 0 2023-12-16T05:56:44.961 INFO:tasks.workunit.client.1.smithi156.stdout:2/821: creat d9/d12/dc2/dd8/da6/f105 x:0 0 0 2023-12-16T05:56:44.961 INFO:tasks.workunit.client.1.smithi156.stdout:2/822: chown d9/d56/f9a 25471 1 2023-12-16T05:56:44.962 INFO:tasks.workunit.client.1.smithi156.stdout:3/813: link dc/d10/d1d/d90/c10d dc/d10/d1d/db2/c124 0 2023-12-16T05:56:44.966 INFO:tasks.workunit.client.1.smithi156.stdout:6/917: mknod d9/d1c/d50/dbf/dca/c12b 0 2023-12-16T05:56:44.966 INFO:tasks.workunit.client.1.smithi156.stdout:6/918: chown d9/d13/d3e/d5f/d6e/c95 164905 1 2023-12-16T05:56:44.966 INFO:tasks.workunit.client.1.smithi156.stdout:2/823: mknod d9/d12/dc2/dd8/da6/d80/c106 0 2023-12-16T05:56:44.966 INFO:tasks.workunit.client.1.smithi156.stdout:2/824: write d9/d12/d3d/fe0 [830863,90511] 0 2023-12-16T05:56:44.967 INFO:tasks.workunit.client.1.smithi156.stdout:3/814: mkdir dc/d56/d67/dbe/dc3/d125 0 2023-12-16T05:56:44.967 INFO:tasks.workunit.client.1.smithi156.stdout:6/919: creat d9/d1c/d50/dbf/dca/dff/f12c x:0 0 0 2023-12-16T05:56:44.969 INFO:tasks.workunit.client.1.smithi156.stdout:3/815: mkdir dc/d56/d67/d104/d126 0 2023-12-16T05:56:44.969 INFO:tasks.workunit.client.1.smithi156.stdout:3/816: readlink dc/d56/d67/dbe/dc3/lef 0 2023-12-16T05:56:44.969 INFO:tasks.workunit.client.1.smithi156.stdout:3/817: fdatasync dc/d10/d3d/f87 0 2023-12-16T05:56:44.971 INFO:tasks.workunit.client.1.smithi156.stdout:6/920: creat d9/d13/d3e/d5f/d10a/f12d x:0 0 0 2023-12-16T05:56:44.971 INFO:tasks.workunit.client.1.smithi156.stdout:6/921: fdatasync d9/f70 0 2023-12-16T05:56:44.972 INFO:tasks.workunit.client.1.smithi156.stdout:6/922: mknod d9/d13/c12e 0 2023-12-16T05:56:44.973 INFO:tasks.workunit.client.1.smithi156.stdout:2/825: dread d9/d68/daa/f52 [0,4194304] 0 2023-12-16T05:56:44.974 INFO:tasks.workunit.client.1.smithi156.stdout:2/826: creat d9/d12/dc2/dd8/da6/f107 x:0 0 0 2023-12-16T05:56:44.974 INFO:tasks.workunit.client.1.smithi156.stdout:2/827: write d9/dd/d17/d33/fc5 [303128,22635] 0 2023-12-16T05:56:44.974 INFO:tasks.workunit.client.1.smithi156.stdout:6/923: dread d9/d13/d2f/d51/fc6 [0,4194304] 0 2023-12-16T05:56:44.979 INFO:tasks.workunit.client.1.smithi156.stdout:8/693: dwrite d3/d7/d27/d46/d6e/d3b/d77/fd8 [0,4194304] 0 2023-12-16T05:56:44.981 INFO:tasks.workunit.client.1.smithi156.stdout:8/694: mkdir d3/d12/d16/db4/de9 0 2023-12-16T05:56:45.001 INFO:tasks.workunit.client.1.smithi156.stdout:6/924: dwrite d9/d1c/f32 [0,4194304] 0 2023-12-16T05:56:45.001 INFO:tasks.workunit.client.1.smithi156.stdout:6/925: write d9/d1c/d50/dbf/f11c [708580,98605] 0 2023-12-16T05:56:45.002 INFO:tasks.workunit.client.1.smithi156.stdout:8/695: dwrite d3/d7/d27/d46/d6e/f40 [0,4194304] 0 2023-12-16T05:56:45.002 INFO:tasks.workunit.client.1.smithi156.stdout:6/926: mknod d9/d13/d2f/d51/d6b/d77/c12f 0 2023-12-16T05:56:45.003 INFO:tasks.workunit.client.1.smithi156.stdout:6/927: chown d9/d13/d2f/d36/f5a 867644 1 2023-12-16T05:56:45.006 INFO:tasks.workunit.client.1.smithi156.stdout:8/696: symlink d3/d7/d66/d76/lea 0 2023-12-16T05:56:45.006 INFO:tasks.workunit.client.1.smithi156.stdout:8/697: chown d3/d12/d16 79201839 1 2023-12-16T05:56:45.006 INFO:tasks.workunit.client.1.smithi156.stdout:6/928: symlink d9/l130 0 2023-12-16T05:56:45.008 INFO:tasks.workunit.client.1.smithi156.stdout:8/698: mknod d3/d12/ceb 0 2023-12-16T05:56:45.008 INFO:tasks.workunit.client.1.smithi156.stdout:8/699: fdatasync d3/d7/f63 0 2023-12-16T05:56:45.008 INFO:tasks.workunit.client.1.smithi156.stdout:8/700: read d3/d6/f8a [320323,118022] 0 2023-12-16T05:56:45.008 INFO:tasks.workunit.client.1.smithi156.stdout:8/701: write d3/d7a/fa4 [721870,123023] 0 2023-12-16T05:56:45.009 INFO:tasks.workunit.client.1.smithi156.stdout:8/702: chown d3/d6/f8a 2749 1 2023-12-16T05:56:45.013 INFO:tasks.workunit.client.0.smithi155.stdout:7/959: sync 2023-12-16T05:56:45.013 INFO:tasks.workunit.client.0.smithi155.stdout:7/960: read d0/d6a/d1a/d8c/d34/d6c/f10a [3539518,11849] 0 2023-12-16T05:56:45.014 INFO:tasks.workunit.client.0.smithi155.stdout:7/961: truncate d0/f15 1478838 0 2023-12-16T05:56:45.015 INFO:tasks.workunit.client.0.smithi155.stdout:7/962: creat d0/d6a/d1a/d8c/d34/d4b/d64/dd6/f133 x:0 0 0 2023-12-16T05:56:45.017 INFO:tasks.workunit.client.0.smithi155.stdout:7/963: mknod d0/c134 0 2023-12-16T05:56:45.018 INFO:tasks.workunit.client.0.smithi155.stdout:7/964: creat d0/d6a/d1a/d2b/d2c/f135 x:0 0 0 2023-12-16T05:56:45.020 INFO:tasks.workunit.client.0.smithi155.stdout:7/965: rename d0/d6a/d1a/d2b/d65/db8/l118 to d0/d6a/d1a/d2b/l136 0 2023-12-16T05:56:45.021 INFO:tasks.workunit.client.0.smithi155.stdout:7/966: truncate d0/d6a/d1a/d8c/d34/d4b/d64/d6f/dba/fc5 749164 0 2023-12-16T05:56:45.021 INFO:tasks.workunit.client.0.smithi155.stdout:7/967: chown d0 0 1 2023-12-16T05:56:45.021 INFO:tasks.workunit.client.0.smithi155.stdout:7/968: mkdir d0/d1b/d122/d98/db1/d137 0 2023-12-16T05:56:45.021 INFO:tasks.workunit.client.0.smithi155.stdout:7/969: readlink d0/d6a/d31/l108 0 2023-12-16T05:56:45.022 INFO:tasks.workunit.client.0.smithi155.stdout:7/970: rename d0/d6a/d1a/d38/d4f/c9a to d0/d6a/c138 0 2023-12-16T05:56:45.023 INFO:tasks.workunit.client.0.smithi155.stdout:7/971: mkdir d0/d1/d139 0 2023-12-16T05:56:45.024 INFO:tasks.workunit.client.0.smithi155.stdout:7/972: truncate d0/d6a/d1a/d8c/d34/fa1 710689 0 2023-12-16T05:56:45.049 INFO:tasks.workunit.client.1.smithi156.stdout:8/703: dwrite d3/d7/d66/fbd [0,4194304] 0 2023-12-16T05:56:45.049 INFO:tasks.workunit.client.0.smithi155.stdout:7/973: dwrite d0/d6a/d1a/d8c/d34/d4b/d64/fd7 [0,4194304] 0 2023-12-16T05:56:45.050 INFO:tasks.workunit.client.0.smithi155.stdout:7/974: creat d0/d6a/d1a/d8c/d10b/f13a x:0 0 0 2023-12-16T05:56:45.050 INFO:tasks.workunit.client.1.smithi156.stdout:8/704: mkdir d3/d7/d27/d46/d6e/d3c/dec 0 2023-12-16T05:56:45.052 INFO:tasks.workunit.client.0.smithi155.stdout:7/975: mkdir d0/d6a/d1a/d8c/d34/d4b/d60/dd8/d13b 0 2023-12-16T05:56:45.053 INFO:tasks.workunit.client.0.smithi155.stdout:7/976: creat d0/d6a/d1a/da0/f13c x:0 0 0 2023-12-16T05:56:45.053 INFO:tasks.workunit.client.1.smithi156.stdout:8/705: getdents d3/d7/d27/d46/d6e/d3c 0 2023-12-16T05:56:45.054 INFO:tasks.workunit.client.0.smithi155.stdout:7/977: read d0/d6a/d31/f46 [1021035,80202] 0 2023-12-16T05:56:45.054 INFO:tasks.workunit.client.0.smithi155.stdout:7/978: truncate d0/d6a/d1a/d22/f11e 428714 0 2023-12-16T05:56:45.054 INFO:tasks.workunit.client.1.smithi156.stdout:8/706: truncate d3/d7a/d7d/dae/f19 2607291 0 2023-12-16T05:56:45.054 INFO:tasks.workunit.client.1.smithi156.stdout:8/707: stat d3/d12/f6c 0 2023-12-16T05:56:45.055 INFO:tasks.workunit.client.1.smithi156.stdout:8/708: mknod d3/d7/d62/ced 0 2023-12-16T05:56:45.055 INFO:tasks.workunit.client.1.smithi156.stdout:8/709: chown d3/d7/d27/d46/d84/d85/d9b/de5 12571 1 2023-12-16T05:56:45.056 INFO:tasks.workunit.client.1.smithi156.stdout:8/710: mknod d3/d6/d83/cee 0 2023-12-16T05:56:45.057 INFO:tasks.workunit.client.1.smithi156.stdout:8/711: mkdir d3/d7/d27/d46/d6e/d3c/dec/def 0 2023-12-16T05:56:45.057 INFO:tasks.workunit.client.1.smithi156.stdout:8/712: dread - d3/d7/d27/d46/d6e/d3c/fdb zero size 2023-12-16T05:56:45.057 INFO:tasks.workunit.client.1.smithi156.stdout:8/713: truncate d3/d7/d27/d46/d6e/d3c/fc8 866353 0 2023-12-16T05:56:45.057 INFO:tasks.workunit.client.1.smithi156.stdout:8/714: fsync d3/d7/d66/f71 0 2023-12-16T05:56:45.057 INFO:tasks.workunit.client.1.smithi156.stdout:8/715: write d3/d12/f25 [3209483,113427] 0 2023-12-16T05:56:45.057 INFO:tasks.workunit.client.1.smithi156.stdout:8/716: stat d3/d7/c87 0 2023-12-16T05:56:45.058 INFO:tasks.workunit.client.1.smithi156.stdout:8/717: chown d3/d6 990 1 2023-12-16T05:56:45.072 INFO:tasks.workunit.client.1.smithi156.stdout:8/718: dwrite d3/f5a [0,4194304] 0 2023-12-16T05:56:45.073 INFO:tasks.workunit.client.1.smithi156.stdout:8/719: readlink d3/d7a/d7d/dae/d94/la1 0 2023-12-16T05:56:45.074 INFO:tasks.workunit.client.1.smithi156.stdout:8/720: chown d3/d7/d27/d46/l88 227561 1 2023-12-16T05:56:45.075 INFO:tasks.workunit.client.1.smithi156.stdout:8/721: rmdir d3/d6/d83 39 2023-12-16T05:56:45.075 INFO:tasks.workunit.client.1.smithi156.stdout:8/722: chown d3/d12/d74/l8b 3452446 1 2023-12-16T05:56:45.077 INFO:tasks.workunit.client.1.smithi156.stdout:4/807: sync 2023-12-16T05:56:45.078 INFO:tasks.workunit.client.1.smithi156.stdout:4/808: link f5 d9/d2c/dbf/dfa/d7d/f114 0 2023-12-16T05:56:45.079 INFO:tasks.workunit.client.1.smithi156.stdout:8/723: read d3/d7/d27/d46/d6e/f40 [1869678,107798] 0 2023-12-16T05:56:45.079 INFO:tasks.workunit.client.1.smithi156.stdout:4/809: getdents d9/d43 0 2023-12-16T05:56:45.079 INFO:tasks.workunit.client.1.smithi156.stdout:4/810: truncate d9/d2c/f9b 818204 0 2023-12-16T05:56:45.081 INFO:tasks.workunit.client.1.smithi156.stdout:4/811: creat d9/f115 x:0 0 0 2023-12-16T05:56:45.081 INFO:tasks.workunit.client.1.smithi156.stdout:8/724: write d3/d7/d27/d46/f4e [579028,126789] 0 2023-12-16T05:56:45.082 INFO:tasks.workunit.client.1.smithi156.stdout:4/812: rename d9/d2b/d9a/cb0 to d9/d2b/d98/dcd/c116 0 2023-12-16T05:56:45.082 INFO:tasks.workunit.client.1.smithi156.stdout:4/813: truncate d9/d2c/d7a/dd4/feb 257114 0 2023-12-16T05:56:45.082 INFO:tasks.workunit.client.1.smithi156.stdout:8/725: truncate d3/d12/f3d 3274536 0 2023-12-16T05:56:45.085 INFO:tasks.workunit.client.1.smithi156.stdout:4/814: fsync f5 0 2023-12-16T05:56:45.121 INFO:tasks.workunit.client.1.smithi156.stdout:8/726: dwrite d3/d12/fda [0,4194304] 0 2023-12-16T05:56:45.121 INFO:tasks.workunit.client.1.smithi156.stdout:4/815: dwrite d9/d2b/fe3 [0,4194304] 0 2023-12-16T05:56:45.121 INFO:tasks.workunit.client.1.smithi156.stdout:8/727: write d3/d12/d16/f73 [1113072,73680] 0 2023-12-16T05:56:45.127 INFO:tasks.workunit.client.1.smithi156.stdout:4/816: rename d9/d2b/d35/dd3/f109 to d9/d2c/dbf/f117 0 2023-12-16T05:56:45.128 INFO:tasks.workunit.client.1.smithi156.stdout:4/817: truncate d9/d2b/d98/fb3 815858 0 2023-12-16T05:56:45.129 INFO:tasks.workunit.client.1.smithi156.stdout:4/818: link d9/f28 d9/d2c/d48/dae/f118 0 2023-12-16T05:56:45.129 INFO:tasks.workunit.client.0.smithi155.stdout:3/891: sync 2023-12-16T05:56:45.131 INFO:tasks.workunit.client.1.smithi156.stdout:9/850: sync 2023-12-16T05:56:45.131 INFO:tasks.workunit.client.1.smithi156.stdout:1/736: sync 2023-12-16T05:56:45.131 INFO:tasks.workunit.client.1.smithi156.stdout:0/928: sync 2023-12-16T05:56:45.132 INFO:tasks.workunit.client.0.smithi155.stdout:3/892: mknod d0/c115 0 2023-12-16T05:56:45.132 INFO:tasks.workunit.client.0.smithi155.stdout:3/893: readlink d0/d14/d36/d47/d5f/d9a/dd2/l10f 0 2023-12-16T05:56:45.132 INFO:tasks.workunit.client.0.smithi155.stdout:3/894: dread - d0/d1a/d33/d57/dba/dd5/fe2 zero size 2023-12-16T05:56:45.132 INFO:tasks.workunit.client.0.smithi155.stdout:3/895: mknod d0/d1a/d33/d57/dba/dd5/c116 0 2023-12-16T05:56:45.134 INFO:tasks.workunit.client.1.smithi156.stdout:1/737: getdents d3/d17/d1c/da5 0 2023-12-16T05:56:45.134 INFO:tasks.workunit.client.1.smithi156.stdout:1/738: readlink d3/d1b/l1d 0 2023-12-16T05:56:45.136 INFO:tasks.workunit.client.1.smithi156.stdout:0/929: symlink d2/d7/dd/d2d/d5e/d110/dbc/dd2/l121 0 2023-12-16T05:56:45.136 INFO:tasks.workunit.client.1.smithi156.stdout:0/930: write d2/d7/dd/d2d/d5e/d110/dbc/dd2/f103 [4322215,16170] 0 2023-12-16T05:56:45.136 INFO:tasks.workunit.client.1.smithi156.stdout:0/931: fsync d2/d7/dd/d29/d38/dad/fe1 0 2023-12-16T05:56:45.136 INFO:tasks.workunit.client.1.smithi156.stdout:0/932: truncate d2/d23/d4a/f54 5509482 0 2023-12-16T05:56:45.137 INFO:tasks.workunit.client.1.smithi156.stdout:9/851: link d6/d19/d25/fc2 d6/da3/db0/f11c 0 2023-12-16T05:56:45.138 INFO:tasks.workunit.client.1.smithi156.stdout:9/852: chown d6/d2e/dad/ff1 6395362 1 2023-12-16T05:56:45.138 INFO:tasks.workunit.client.1.smithi156.stdout:1/739: mkdir d3/d17/d1c/da5/d101 0 2023-12-16T05:56:45.139 INFO:tasks.workunit.client.1.smithi156.stdout:8/728: dwrite d3/d7/d27/fb5 [0,4194304] 0 2023-12-16T05:56:45.139 INFO:tasks.workunit.client.1.smithi156.stdout:1/740: write d3/d17/d4d/ff8 [1068266,87594] 0 2023-12-16T05:56:45.145 INFO:tasks.workunit.client.1.smithi156.stdout:9/853: creat d6/d19/d30/dae/f11d x:0 0 0 2023-12-16T05:56:45.147 INFO:tasks.workunit.client.1.smithi156.stdout:1/741: symlink d3/d17/d1c/d22/d57/dbc/l102 0 2023-12-16T05:56:45.147 INFO:tasks.workunit.client.1.smithi156.stdout:1/742: dread - d3/d17/d1c/d22/fd6 zero size 2023-12-16T05:56:45.148 INFO:tasks.workunit.client.1.smithi156.stdout:0/933: link d2/d7/dd/d29/d38/dae/ld9 d2/d7/dd/l122 0 2023-12-16T05:56:45.151 INFO:tasks.workunit.client.1.smithi156.stdout:4/819: dwrite d9/d2b/fed [0,4194304] 0 2023-12-16T05:56:45.155 INFO:tasks.workunit.client.1.smithi156.stdout:1/743: dread d3/d17/d4d/dc2/d4f/fac [0,4194304] 0 2023-12-16T05:56:45.156 INFO:tasks.workunit.client.1.smithi156.stdout:8/729: dwrite d3/d7/d27/d46/d6e/d3c/fc8 [0,4194304] 0 2023-12-16T05:56:45.156 INFO:tasks.workunit.client.1.smithi156.stdout:8/730: fdatasync d3/d7a/d7d/faf 0 2023-12-16T05:56:45.156 INFO:tasks.workunit.client.1.smithi156.stdout:8/731: chown d3/d7/d66/d76/fad 380 1 2023-12-16T05:56:45.157 INFO:tasks.workunit.client.0.smithi155.stdout:3/896: dwrite d0/d1a/d33/d57/f6c [0,4194304] 0 2023-12-16T05:56:45.164 INFO:tasks.workunit.client.1.smithi156.stdout:8/732: dread d3/d12/d74/fac [0,4194304] 0 2023-12-16T05:56:45.164 INFO:tasks.workunit.client.1.smithi156.stdout:8/733: fdatasync d3/d12/d16/f2d 0 2023-12-16T05:56:45.164 INFO:tasks.workunit.client.1.smithi156.stdout:8/734: creat d3/d7a/d7d/dae/ff0 x:0 0 0 2023-12-16T05:56:45.165 INFO:tasks.workunit.client.1.smithi156.stdout:8/735: creat d3/d7/d27/d46/d84/d85/ff1 x:0 0 0 2023-12-16T05:56:45.165 INFO:tasks.workunit.client.1.smithi156.stdout:8/736: chown d3/d7a/d7d/dae/f39 0 1 2023-12-16T05:56:45.198 INFO:tasks.workunit.client.0.smithi155.stdout:3/897: write d0/d14/d87/d94/da1/d73/faf [7590926,520] 0 2023-12-16T05:56:45.198 INFO:tasks.workunit.client.0.smithi155.stdout:3/898: truncate d0/d14/fb8 1130050 0 2023-12-16T05:56:45.198 INFO:tasks.workunit.client.0.smithi155.stdout:3/899: write d0/d14/d87/d94/ff8 [240431,29051] 0 2023-12-16T05:56:45.199 INFO:tasks.workunit.client.1.smithi156.stdout:2/828: sync 2023-12-16T05:56:45.200 INFO:tasks.workunit.client.1.smithi156.stdout:3/818: sync 2023-12-16T05:56:45.200 INFO:tasks.workunit.client.1.smithi156.stdout:2/829: stat d9/dd/d17/d33/f10 0 2023-12-16T05:56:45.200 INFO:tasks.workunit.client.1.smithi156.stdout:9/854: dwrite d6/d19/fa2 [0,4194304] 0 2023-12-16T05:56:45.200 INFO:tasks.workunit.client.1.smithi156.stdout:8/737: write d3/d7/f63 [4285970,6958] 0 2023-12-16T05:56:45.200 INFO:tasks.workunit.client.0.smithi155.stdout:3/900: mknod d0/c117 0 2023-12-16T05:56:45.202 INFO:tasks.workunit.client.1.smithi156.stdout:3/819: rmdir dc/d10/d1d/db2 39 2023-12-16T05:56:45.203 INFO:tasks.workunit.client.1.smithi156.stdout:3/820: readlink dc/df/le6 0 2023-12-16T05:56:45.203 INFO:tasks.workunit.client.0.smithi155.stdout:3/901: rename d0/d1a/d91/dde/cf2 to d0/d14/d36/d83/c118 0 2023-12-16T05:56:45.204 INFO:tasks.workunit.client.0.smithi155.stdout:3/902: creat d0/d14/d36/d47/da7/f119 x:0 0 0 2023-12-16T05:56:45.204 INFO:tasks.workunit.client.0.smithi155.stdout:3/903: read - d0/d14/d36/d47/d5f/f10d zero size 2023-12-16T05:56:45.205 INFO:tasks.workunit.client.0.smithi155.stdout:3/904: write d0/d1a/f5a [9267997,127200] 0 2023-12-16T05:56:45.205 INFO:tasks.workunit.client.1.smithi156.stdout:2/830: truncate d9/d56/d5f/fb3 65285 0 2023-12-16T05:56:45.206 INFO:tasks.workunit.client.1.smithi156.stdout:6/929: sync 2023-12-16T05:56:45.206 INFO:tasks.workunit.client.1.smithi156.stdout:6/930: chown d9/d13/d2f/d51/d82/la9 407790 1 2023-12-16T05:56:45.207 INFO:tasks.workunit.client.1.smithi156.stdout:9/855: creat d6/da3/db0/f11e x:0 0 0 2023-12-16T05:56:45.207 INFO:tasks.workunit.client.1.smithi156.stdout:9/856: fdatasync d6/da3/db0/f11c 0 2023-12-16T05:56:45.208 INFO:tasks.workunit.client.1.smithi156.stdout:8/738: mknod d3/d7a/d7d/dae/d94/cf2 0 2023-12-16T05:56:45.209 INFO:tasks.workunit.client.1.smithi156.stdout:3/821: symlink dc/d10/d3d/df8/l127 0 2023-12-16T05:56:45.209 INFO:tasks.workunit.client.1.smithi156.stdout:1/744: dread d3/d17/d4d/dc2/d4f/f90 [0,4194304] 0 2023-12-16T05:56:45.210 INFO:tasks.workunit.client.1.smithi156.stdout:2/831: truncate d9/f44 1146786 0 2023-12-16T05:56:45.210 INFO:tasks.workunit.client.1.smithi156.stdout:3/822: write fb [7669952,100434] 0 2023-12-16T05:56:45.210 INFO:tasks.workunit.client.1.smithi156.stdout:3/823: chown dc/d56/d67/dbe/dd9/lde 7638088 1 2023-12-16T05:56:45.210 INFO:tasks.workunit.client.1.smithi156.stdout:3/824: chown dc/d10/d1d/fa3 463718897 1 2023-12-16T05:56:45.210 INFO:tasks.workunit.client.1.smithi156.stdout:2/832: write d9/d68/f90 [539281,25666] 0 2023-12-16T05:56:45.211 INFO:tasks.workunit.client.1.smithi156.stdout:6/931: mknod d9/d13/d3e/c131 0 2023-12-16T05:56:45.212 INFO:tasks.workunit.client.1.smithi156.stdout:9/857: symlink d6/d19/d25/d3a/dc3/l11f 0 2023-12-16T05:56:45.212 INFO:tasks.workunit.client.1.smithi156.stdout:9/858: write d6/da3/fb4 [830115,88288] 0 2023-12-16T05:56:45.212 INFO:tasks.workunit.client.1.smithi156.stdout:2/833: read d9/d12/f58 [327623,63754] 0 2023-12-16T05:56:45.212 INFO:tasks.workunit.client.1.smithi156.stdout:2/834: dread - d9/dd/d17/d33/d47/fc1 zero size 2023-12-16T05:56:45.213 INFO:tasks.workunit.client.1.smithi156.stdout:8/739: creat d3/ff3 x:0 0 0 2023-12-16T05:56:45.214 INFO:tasks.workunit.client.1.smithi156.stdout:3/825: rename dc/d10/d3d/d4e/d120 to dc/d10/d3d/d4e/d128 0 2023-12-16T05:56:45.214 INFO:tasks.workunit.client.1.smithi156.stdout:3/826: truncate dc/d10/d3d/db5/f117 243385 0 2023-12-16T05:56:45.214 INFO:tasks.workunit.client.1.smithi156.stdout:3/827: chown dc/d10/d3d/db5/cfa 12760 1 2023-12-16T05:56:45.215 INFO:tasks.workunit.client.1.smithi156.stdout:9/859: symlink d6/d19/d25/d3a/d5e/l120 0 2023-12-16T05:56:45.216 INFO:tasks.workunit.client.1.smithi156.stdout:8/740: mknod d3/cf4 0 2023-12-16T05:56:45.216 INFO:tasks.workunit.client.1.smithi156.stdout:8/741: fdatasync d3/d7/d27/d46/d84/fe0 0 2023-12-16T05:56:45.216 INFO:tasks.workunit.client.1.smithi156.stdout:6/932: read d9/d1c/f32 [1160644,50222] 0 2023-12-16T05:56:45.217 INFO:tasks.workunit.client.1.smithi156.stdout:4/820: dwrite d9/d2c/d7a/dd4/ff6 [0,4194304] 0 2023-12-16T05:56:45.217 INFO:tasks.workunit.client.1.smithi156.stdout:4/821: readlink d9/l8c 0 2023-12-16T05:56:45.217 INFO:tasks.workunit.client.1.smithi156.stdout:1/745: mkdir d3/d103 0 2023-12-16T05:56:45.218 INFO:tasks.workunit.client.1.smithi156.stdout:6/933: write d9/d1c/d50/f74 [5646445,108926] 0 2023-12-16T05:56:45.218 INFO:tasks.workunit.client.1.smithi156.stdout:0/934: dwrite d2/d7/f3c [0,4194304] 0 2023-12-16T05:56:45.218 INFO:tasks.workunit.client.1.smithi156.stdout:0/935: truncate d2/d7/dd/d29/d4b/ff8 1911256 0 2023-12-16T05:56:45.218 INFO:tasks.workunit.client.1.smithi156.stdout:0/936: fsync d2/d7/dd/d1c/db3/df5/f114 0 2023-12-16T05:56:45.220 INFO:tasks.workunit.client.1.smithi156.stdout:3/828: creat dc/d56/d67/dbe/dc3/f129 x:0 0 0 2023-12-16T05:56:45.221 INFO:tasks.workunit.client.1.smithi156.stdout:9/860: mknod d6/d19/d25/d3a/d80/dc0/de9/c121 0 2023-12-16T05:56:45.222 INFO:tasks.workunit.client.1.smithi156.stdout:8/742: creat d3/d7a/d7d/dae/d94/ff5 x:0 0 0 2023-12-16T05:56:45.226 INFO:tasks.workunit.client.1.smithi156.stdout:4/822: creat d9/d2c/d7a/dc0/f119 x:0 0 0 2023-12-16T05:56:45.227 INFO:tasks.workunit.client.0.smithi155.stdout:3/905: dwrite d0/d14/d36/d83/d95/fea [0,4194304] 0 2023-12-16T05:56:45.227 INFO:tasks.workunit.client.1.smithi156.stdout:6/934: creat d9/d13/d2f/d51/d69/d99/db9/d110/d8e/d9a/dce/df0/f132 x:0 0 0 2023-12-16T05:56:45.230 INFO:tasks.workunit.client.1.smithi156.stdout:2/835: dwrite d9/dd/d17/d33/d47/f4d [0,4194304] 0 2023-12-16T05:56:45.230 INFO:tasks.workunit.client.1.smithi156.stdout:8/743: fsync d3/d7/d27/d46/f4e 0 2023-12-16T05:56:45.230 INFO:tasks.workunit.client.0.smithi155.stdout:3/906: write d0/f30 [4880951,4551] 0 2023-12-16T05:56:45.230 INFO:tasks.workunit.client.0.smithi155.stdout:3/907: chown d0/d1a/d33/c41 57764213 1 2023-12-16T05:56:45.231 INFO:tasks.workunit.client.1.smithi156.stdout:0/937: dread d2/f86 [0,4194304] 0 2023-12-16T05:56:45.231 INFO:tasks.workunit.client.1.smithi156.stdout:0/938: dread - d2/d7/dd/d29/d38/dae/d100/d44/f11e zero size 2023-12-16T05:56:45.231 INFO:tasks.workunit.client.1.smithi156.stdout:3/829: unlink dc/f11b 0 2023-12-16T05:56:45.231 INFO:tasks.workunit.client.1.smithi156.stdout:8/744: write d3/d7a/fab [1321737,9437] 0 2023-12-16T05:56:45.231 INFO:tasks.workunit.client.1.smithi156.stdout:8/745: chown d3/d7/d27/d46/d84/d85/d9b/de5 169058630 1 2023-12-16T05:56:45.232 INFO:tasks.workunit.client.1.smithi156.stdout:4/823: write d9/d43/f4b [2735747,31356] 0 2023-12-16T05:56:45.233 INFO:tasks.workunit.client.1.smithi156.stdout:9/861: stat d6/da3/db0/fcc 0 2023-12-16T05:56:45.233 INFO:tasks.workunit.client.1.smithi156.stdout:9/862: chown d6/d2e/d8a/fdd 424465 1 2023-12-16T05:56:45.235 INFO:tasks.workunit.client.1.smithi156.stdout:6/935: mkdir d9/d13/d2f/d51/dad/d133 0 2023-12-16T05:56:45.235 INFO:tasks.workunit.client.1.smithi156.stdout:3/830: write dc/d56/d67/d6e/f81 [3749451,25245] 0 2023-12-16T05:56:45.235 INFO:tasks.workunit.client.1.smithi156.stdout:2/836: creat d9/dd/d17/d33/d78/d39/f108 x:0 0 0 2023-12-16T05:56:45.237 INFO:tasks.workunit.client.1.smithi156.stdout:8/746: write d3/d7a/f9a [697799,67512] 0 2023-12-16T05:56:45.237 INFO:tasks.workunit.client.1.smithi156.stdout:8/747: fsync d3/f5a 0 2023-12-16T05:56:45.237 INFO:tasks.workunit.client.1.smithi156.stdout:8/748: write d3/d7a/d7d/dae/fbc [816460,108008] 0 2023-12-16T05:56:45.237 INFO:tasks.workunit.client.1.smithi156.stdout:8/749: readlink d3/d7/d62/ld9 0 2023-12-16T05:56:45.237 INFO:tasks.workunit.client.0.smithi155.stdout:3/908: write d0/d14/d87/d94/da1/d73/faf [3168630,129877] 0 2023-12-16T05:56:45.238 INFO:tasks.workunit.client.1.smithi156.stdout:9/863: read d6/d2e/dad/ff1 [80825,121136] 0 2023-12-16T05:56:45.238 INFO:tasks.workunit.client.1.smithi156.stdout:9/864: fdatasync d6/d19/f2a 0 2023-12-16T05:56:45.238 INFO:tasks.workunit.client.1.smithi156.stdout:9/865: getdents d6/d2e/d8a/da5 0 2023-12-16T05:56:45.238 INFO:tasks.workunit.client.0.smithi155.stdout:3/909: chown d0/d14/fee 12 1 2023-12-16T05:56:45.239 INFO:tasks.workunit.client.0.smithi155.stdout:3/910: symlink d0/d14/d9d/l11a 0 2023-12-16T05:56:45.239 INFO:tasks.workunit.client.1.smithi156.stdout:4/824: unlink d9/d2c/dbf/dfa/d7d/f8b 0 2023-12-16T05:56:45.240 INFO:tasks.workunit.client.0.smithi155.stdout:3/911: symlink d0/d1a/d33/d57/dba/l11b 0 2023-12-16T05:56:45.240 INFO:tasks.workunit.client.0.smithi155.stdout:3/912: chown d0/d14/d36/d7c/fac 3464764 1 2023-12-16T05:56:45.241 INFO:tasks.workunit.client.0.smithi155.stdout:3/913: creat d0/d14/d36/d47/d5f/dca/f11c x:0 0 0 2023-12-16T05:56:45.243 INFO:tasks.workunit.client.1.smithi156.stdout:6/936: creat d9/d13/d2f/d51/d69/d99/db9/d110/d8e/d9a/dce/df0/d107/f134 x:0 0 0 2023-12-16T05:56:45.249 INFO:tasks.workunit.client.1.smithi156.stdout:3/831: symlink dc/d10/d3d/d4e/d128/l12a 0 2023-12-16T05:56:45.251 INFO:tasks.workunit.client.0.smithi155.stdout:3/914: write d0/d1a/d33/f72 [3089314,80233] 0 2023-12-16T05:56:45.251 INFO:tasks.workunit.client.0.smithi155.stdout:3/915: chown d0/d1e/d4e/d81/fe4 49022365 1 2023-12-16T05:56:45.252 INFO:tasks.workunit.client.1.smithi156.stdout:1/746: dwrite d3/d17/d4d/dc2/f8a [0,4194304] 0 2023-12-16T05:56:45.252 INFO:tasks.workunit.client.1.smithi156.stdout:0/939: dwrite d2/d7/dd/d29/d38/dae/d100/d44/f45 [0,4194304] 0 2023-12-16T05:56:45.252 INFO:tasks.workunit.client.1.smithi156.stdout:1/747: stat d3/d1b/df9 0 2023-12-16T05:56:45.252 INFO:tasks.workunit.client.1.smithi156.stdout:2/837: rename d9/d12/dc2/dd8 to d9/dd/d17/d33/d47/ddd/df5/d109 0 2023-12-16T05:56:45.252 INFO:tasks.workunit.client.1.smithi156.stdout:1/748: read d3/d3a/f9f [513836,53870] 0 2023-12-16T05:56:45.253 INFO:tasks.workunit.client.0.smithi155.stdout:3/916: symlink d0/d14/d87/d94/da1/d73/l11d 0 2023-12-16T05:56:45.253 INFO:tasks.workunit.client.1.smithi156.stdout:9/866: mknod d6/d19/d25/d3a/d88/d8b/dac/dc9/c122 0 2023-12-16T05:56:45.254 INFO:tasks.workunit.client.1.smithi156.stdout:9/867: truncate d6/d2e/f114 562308 0 2023-12-16T05:56:45.256 INFO:tasks.workunit.client.1.smithi156.stdout:6/937: getdents d9/d13/d2f/d51/d69/d99/db9 0 2023-12-16T05:56:45.256 INFO:tasks.workunit.client.1.smithi156.stdout:0/940: dread d2/d7/dd/d29/d2e/f57 [0,4194304] 0 2023-12-16T05:56:45.256 INFO:tasks.workunit.client.1.smithi156.stdout:0/941: write d2/d7/dd/d29/d38/dae/d100/d44/f11b [767676,100560] 0 2023-12-16T05:56:45.259 INFO:tasks.workunit.client.1.smithi156.stdout:3/832: symlink dc/d10/dc6/l12b 0 2023-12-16T05:56:45.260 INFO:tasks.workunit.client.1.smithi156.stdout:9/868: write d6/d19/d30/f3f [4187320,84455] 0 2023-12-16T05:56:45.268 INFO:tasks.workunit.client.1.smithi156.stdout:2/838: mknod d9/dd/d17/d33/d47/ddd/df5/d109/c10a 0 2023-12-16T05:56:45.268 INFO:tasks.workunit.client.1.smithi156.stdout:2/839: chown d9/dd/d17/cac 7507854 1 2023-12-16T05:56:45.268 INFO:tasks.workunit.client.1.smithi156.stdout:2/840: write d9/d56/fc8 [967698,103117] 0 2023-12-16T05:56:45.268 INFO:tasks.workunit.client.1.smithi156.stdout:2/841: write d9/d68/f90 [2494664,52847] 0 2023-12-16T05:56:45.269 INFO:tasks.workunit.client.1.smithi156.stdout:2/842: write d9/dd/d17/d33/d47/ddd/df5/d109/fed [61343,117152] 0 2023-12-16T05:56:45.269 INFO:tasks.workunit.client.1.smithi156.stdout:2/843: read - d9/dd/d17/d33/d47/ff7 zero size 2023-12-16T05:56:45.270 INFO:tasks.workunit.client.1.smithi156.stdout:6/938: rmdir d9/d13/d2f/d51/d9b 39 2023-12-16T05:56:45.270 INFO:tasks.workunit.client.1.smithi156.stdout:6/939: truncate d9/d13/d3e/d5f/d6e/fa3 144253 0 2023-12-16T05:56:45.272 INFO:tasks.workunit.client.1.smithi156.stdout:0/942: creat d2/df0/d11d/f123 x:0 0 0 2023-12-16T05:56:45.274 INFO:tasks.workunit.client.1.smithi156.stdout:8/750: rename d3/d7/d27/d46/d6e/ccd to d3/d7/d66/cf6 0 2023-12-16T05:56:45.276 INFO:tasks.workunit.client.1.smithi156.stdout:2/844: unlink d9/dd/d17/d33/d78/d39/f4c 0 2023-12-16T05:56:45.276 INFO:tasks.workunit.client.1.smithi156.stdout:2/845: write d9/dd/d17/d33/d47/f6e [4691595,126342] 0 2023-12-16T05:56:45.277 INFO:tasks.workunit.client.1.smithi156.stdout:6/940: creat d9/d13/d2f/d51/d6b/f135 x:0 0 0 2023-12-16T05:56:45.280 INFO:tasks.workunit.client.1.smithi156.stdout:1/749: dwrite d3/d3a/db1/ff5 [0,4194304] 0 2023-12-16T05:56:45.281 INFO:tasks.workunit.client.0.smithi155.stdout:3/917: dwrite d0/d1a/fcc [0,4194304] 0 2023-12-16T05:56:45.281 INFO:tasks.workunit.client.1.smithi156.stdout:8/751: rmdir d3/d7/d27/d46/d84/d85 39 2023-12-16T05:56:45.282 INFO:tasks.workunit.client.1.smithi156.stdout:8/752: write d3/d7/d27/fb5 [1904772,27681] 0 2023-12-16T05:56:45.283 INFO:tasks.workunit.client.1.smithi156.stdout:2/846: creat d9/d12/f10b x:0 0 0 2023-12-16T05:56:45.284 INFO:tasks.workunit.client.1.smithi156.stdout:6/941: mknod d9/d13/d2f/d51/d69/d99/db9/d110/c136 0 2023-12-16T05:56:45.287 INFO:tasks.workunit.client.1.smithi156.stdout:3/833: rename dc/d10/d3d/ff0 to dc/d56/f12c 0 2023-12-16T05:56:45.287 INFO:tasks.workunit.client.1.smithi156.stdout:3/834: write dc/d56/f92 [1482199,9729] 0 2023-12-16T05:56:45.288 INFO:tasks.workunit.client.1.smithi156.stdout:6/942: dread d9/d13/d2f/d51/d6b/fd5 [0,4194304] 0 2023-12-16T05:56:45.293 INFO:tasks.workunit.client.1.smithi156.stdout:1/750: link d3/d17/d2d/f86 d3/d17/daa/f104 0 2023-12-16T05:56:45.297 INFO:tasks.workunit.client.0.smithi155.stdout:4/951: sync 2023-12-16T05:56:45.297 INFO:tasks.workunit.client.0.smithi155.stdout:7/979: sync 2023-12-16T05:56:45.298 INFO:tasks.workunit.client.0.smithi155.stdout:7/980: write d0/d1/d5/f9 [1624182,117883] 0 2023-12-16T05:56:45.298 INFO:tasks.workunit.client.1.smithi156.stdout:0/943: dwrite d2/d7/dd/d1c/fa5 [0,4194304] 0 2023-12-16T05:56:45.299 INFO:tasks.workunit.client.0.smithi155.stdout:4/952: creat d0/da/de0/d16/d30/d52/d88/d9e/f140 x:0 0 0 2023-12-16T05:56:45.300 INFO:tasks.workunit.client.1.smithi156.stdout:8/753: creat d3/d12/d74/ff7 x:0 0 0 2023-12-16T05:56:45.300 INFO:tasks.workunit.client.1.smithi156.stdout:8/754: fdatasync d3/f5c 0 2023-12-16T05:56:45.300 INFO:tasks.workunit.client.0.smithi155.stdout:4/953: read d0/da/de0/d16/d30/dce/d75/d10e/f6f [2260521,58855] 0 2023-12-16T05:56:45.300 INFO:tasks.workunit.client.0.smithi155.stdout:4/954: chown d0/d10/c37 211 1 2023-12-16T05:56:45.301 INFO:tasks.workunit.client.1.smithi156.stdout:2/847: creat d9/dd/d17/d33/d47/ddd/df5/d109/da6/d80/f10c x:0 0 0 2023-12-16T05:56:45.301 INFO:tasks.workunit.client.0.smithi155.stdout:7/981: truncate d0/d6a/d31/de8/ff4 1972953 0 2023-12-16T05:56:45.305 INFO:tasks.workunit.client.1.smithi156.stdout:3/835: creat dc/d10/d1d/f12d x:0 0 0 2023-12-16T05:56:45.306 INFO:tasks.workunit.client.1.smithi156.stdout:6/943: symlink d9/d13/d2f/d51/d69/d99/l137 0 2023-12-16T05:56:45.306 INFO:tasks.workunit.client.1.smithi156.stdout:6/944: stat d9/d13/c21 0 2023-12-16T05:56:45.306 INFO:tasks.workunit.client.1.smithi156.stdout:6/945: chown d9/d13/d2f/d36/f79 1 1 2023-12-16T05:56:45.307 INFO:tasks.workunit.client.1.smithi156.stdout:1/751: creat d3/d17/d1c/d22/d57/f105 x:0 0 0 2023-12-16T05:56:45.308 INFO:tasks.workunit.client.0.smithi155.stdout:3/918: dwrite d0/d1a/f10c [0,4194304] 0 2023-12-16T05:56:45.308 INFO:tasks.workunit.client.0.smithi155.stdout:3/919: write d0/d14/fbd [753687,30146] 0 2023-12-16T05:56:45.308 INFO:tasks.workunit.client.0.smithi155.stdout:3/920: chown d0/d14/d45/c58 461685320 1 2023-12-16T05:56:45.308 INFO:tasks.workunit.client.0.smithi155.stdout:3/921: fdatasync d0/d1a/f1d 0 2023-12-16T05:56:45.309 INFO:tasks.workunit.client.1.smithi156.stdout:0/944: symlink d2/d7/dd/d2d/d5e/d110/dbc/dc2/l124 0 2023-12-16T05:56:45.309 INFO:tasks.workunit.client.1.smithi156.stdout:0/945: fdatasync d2/d7/dd/d29/d38/d51/d65/fc8 0 2023-12-16T05:56:45.309 INFO:tasks.workunit.client.1.smithi156.stdout:0/946: write d2/d7/dd/d2d/f104 [1040821,72073] 0 2023-12-16T05:56:45.311 INFO:tasks.workunit.client.1.smithi156.stdout:2/848: creat d9/d12/d3d/d102/dd4/f10d x:0 0 0 2023-12-16T05:56:45.312 INFO:tasks.workunit.client.0.smithi155.stdout:7/982: dread d0/d1/f61 [0,4194304] 0 2023-12-16T05:56:45.312 INFO:tasks.workunit.client.0.smithi155.stdout:7/983: fsync d0/d6a/d1a/f89 0 2023-12-16T05:56:45.312 INFO:tasks.workunit.client.0.smithi155.stdout:3/922: mknod d0/d14/d45/c11e 0 2023-12-16T05:56:45.315 INFO:tasks.workunit.client.1.smithi156.stdout:3/836: rename dc/d10/db4/lf2 to dc/d56/d67/dbe/df9/l12e 0 2023-12-16T05:56:45.318 INFO:tasks.workunit.client.1.smithi156.stdout:6/946: symlink d9/d13/d2f/d51/dad/l138 0 2023-12-16T05:56:45.318 INFO:tasks.workunit.client.1.smithi156.stdout:8/755: dwrite d3/d7/fd1 [0,4194304] 0 2023-12-16T05:56:45.321 INFO:tasks.workunit.client.1.smithi156.stdout:6/947: write d9/d13/d2f/d51/d6b/d77/d7e/f8c [3162975,129254] 0 2023-12-16T05:56:45.322 INFO:tasks.workunit.client.0.smithi155.stdout:7/984: write d0/d6a/d31/f46 [2723358,82925] 0 2023-12-16T05:56:45.323 INFO:tasks.workunit.client.1.smithi156.stdout:2/849: symlink d9/dd/d17/d33/d78/d39/l10e 0 2023-12-16T05:56:45.323 INFO:tasks.workunit.client.1.smithi156.stdout:2/850: fdatasync d9/d12/dc2/fc7 0 2023-12-16T05:56:45.324 INFO:tasks.workunit.client.0.smithi155.stdout:7/985: mkdir d0/d1b/d13d 0 2023-12-16T05:56:45.324 INFO:tasks.workunit.client.0.smithi155.stdout:7/986: truncate d0/d6a/d1a/d2b/d2c/d5d/f62 8950277 0 2023-12-16T05:56:45.324 INFO:tasks.workunit.client.0.smithi155.stdout:7/987: chown d0/d6a/d1a/d8c/d34/d4b/d64/d6f/le0 39 1 2023-12-16T05:56:45.325 INFO:tasks.workunit.client.1.smithi156.stdout:1/752: dread d3/d17/f33 [0,4194304] 0 2023-12-16T05:56:45.327 INFO:tasks.workunit.client.1.smithi156.stdout:6/948: write d9/d13/d2f/d51/d69/d99/db9/d110/d8e/f9d [3080990,36874] 0 2023-12-16T05:56:45.330 INFO:tasks.workunit.client.1.smithi156.stdout:6/949: read d9/d13/d2f/d51/d82/fc2 [4077570,129868] 0 2023-12-16T05:56:45.333 INFO:tasks.workunit.client.1.smithi156.stdout:8/756: dread d3/f5c [0,4194304] 0 2023-12-16T05:56:45.333 INFO:tasks.workunit.client.1.smithi156.stdout:8/757: fdatasync d3/d12/d16/d54/f99 0 2023-12-16T05:56:45.338 INFO:tasks.workunit.client.1.smithi156.stdout:2/851: write d9/f1f [1477001,118312] 0 2023-12-16T05:56:45.341 INFO:tasks.workunit.client.1.smithi156.stdout:0/947: dwrite d2/d7/dd/d29/d4b/ff8 [0,4194304] 0 2023-12-16T05:56:45.341 INFO:tasks.workunit.client.1.smithi156.stdout:3/837: creat dc/df/d34/d62/d75/f12f x:0 0 0 2023-12-16T05:56:45.341 INFO:tasks.workunit.client.1.smithi156.stdout:8/758: dread d3/d12/f6c [0,4194304] 0 2023-12-16T05:56:45.341 INFO:tasks.workunit.client.1.smithi156.stdout:8/759: chown d3/d7/d27/d46/d6e/d3c/dec/def 235 1 2023-12-16T05:56:45.342 INFO:tasks.workunit.client.0.smithi155.stdout:3/923: dwrite d0/d14/f65 [0,4194304] 0 2023-12-16T05:56:45.343 INFO:tasks.workunit.client.0.smithi155.stdout:3/924: fdatasync d0/f11 0 2023-12-16T05:56:45.344 INFO:tasks.workunit.client.0.smithi155.stdout:7/988: dwrite d0/d1b/d78/f96 [0,4194304] 0 2023-12-16T05:56:45.345 INFO:tasks.workunit.client.0.smithi155.stdout:3/925: write d0/d1a/fcc [1358226,39850] 0 2023-12-16T05:56:45.346 INFO:tasks.workunit.client.0.smithi155.stdout:7/989: rmdir d0/d6a/d1a/d8c/d34/d4b/d60/dd8 39 2023-12-16T05:56:45.347 INFO:tasks.workunit.client.1.smithi156.stdout:6/950: symlink d9/d13/d2f/d51/d69/d99/l139 0 2023-12-16T05:56:45.352 INFO:tasks.workunit.client.1.smithi156.stdout:3/838: link dc/d10/d3d/f57 dc/d10/d3d/df8/d11c/f130 0 2023-12-16T05:56:45.352 INFO:tasks.workunit.client.1.smithi156.stdout:8/760: creat d3/d12/d95/ff8 x:0 0 0 2023-12-16T05:56:45.352 INFO:tasks.workunit.client.1.smithi156.stdout:1/753: dwrite d3/d17/d2d/f74 [0,4194304] 0 2023-12-16T05:56:45.353 INFO:tasks.workunit.client.1.smithi156.stdout:8/761: mkdir d3/d7/d27/d46/d84/d85/d9b/de5/df9 0 2023-12-16T05:56:45.353 INFO:tasks.workunit.client.1.smithi156.stdout:8/762: fdatasync d3/d12/fc1 0 2023-12-16T05:56:45.364 INFO:tasks.workunit.client.1.smithi156.stdout:8/763: mknod d3/d7/d62/dca/cfa 0 2023-12-16T05:56:45.364 INFO:tasks.workunit.client.1.smithi156.stdout:8/764: fdatasync d3/d12/d16/db4/fcb 0 2023-12-16T05:56:45.365 INFO:tasks.workunit.client.1.smithi156.stdout:2/852: dread d9/dd/d17/d33/f10 [4194304,4194304] 0 2023-12-16T05:56:45.365 INFO:tasks.workunit.client.1.smithi156.stdout:2/853: readlink d9/d56/l8e 0 2023-12-16T05:56:45.366 INFO:tasks.workunit.client.0.smithi155.stdout:3/926: dread d0/d14/d36/d47/fdd [0,4194304] 0 2023-12-16T05:56:45.366 INFO:tasks.workunit.client.0.smithi155.stdout:3/927: dread - d0/d14/d87/dcf/fdb zero size 2023-12-16T05:56:45.367 INFO:tasks.workunit.client.1.smithi156.stdout:0/948: dread d2/d7/dd/d29/d38/dae/d100/f58 [0,4194304] 0 2023-12-16T05:56:45.367 INFO:tasks.workunit.client.0.smithi155.stdout:3/928: creat d0/d14/d36/d83/da8/f11f x:0 0 0 2023-12-16T05:56:45.368 INFO:tasks.workunit.client.1.smithi156.stdout:8/765: link d3/d7a/d7d/dae/f39 d3/d12/d16/db4/ffb 0 2023-12-16T05:56:45.368 INFO:tasks.workunit.client.0.smithi155.stdout:3/929: creat d0/d14/d87/d94/da1/f120 x:0 0 0 2023-12-16T05:56:45.369 INFO:tasks.workunit.client.0.smithi155.stdout:3/930: fdatasync d0/d1e/f68 0 2023-12-16T05:56:45.369 INFO:tasks.workunit.client.0.smithi155.stdout:3/931: unlink d0/d14/fbd 0 2023-12-16T05:56:45.370 INFO:tasks.workunit.client.0.smithi155.stdout:3/932: chown d0/d14/d36/d83/d95/fea 20 1 2023-12-16T05:56:45.370 INFO:tasks.workunit.client.0.smithi155.stdout:3/933: stat d0/d14/d87/f9c 0 2023-12-16T05:56:45.370 INFO:tasks.workunit.client.0.smithi155.stdout:3/934: chown d0/d14/d87/d94/da1/f7a 22 1 2023-12-16T05:56:45.370 INFO:tasks.workunit.client.1.smithi156.stdout:8/766: getdents d3/d7/d27/d46/d6e/d3b/d77 0 2023-12-16T05:56:45.372 INFO:tasks.workunit.client.1.smithi156.stdout:2/854: truncate d9/dd/f19 3668975 0 2023-12-16T05:56:45.372 INFO:tasks.workunit.client.1.smithi156.stdout:2/855: write d9/dd/d17/d33/d78/d39/f108 [458779,6137] 0 2023-12-16T05:56:45.372 INFO:tasks.workunit.client.1.smithi156.stdout:2/856: chown d9/dd/d17/d33/d78/f95 13753369 1 2023-12-16T05:56:45.373 INFO:tasks.workunit.client.1.smithi156.stdout:3/839: dwrite dc/d10/d1d/d4b/f76 [0,4194304] 0 2023-12-16T05:56:45.375 INFO:tasks.workunit.client.1.smithi156.stdout:2/857: creat d9/d68/daa/d83/f10f x:0 0 0 2023-12-16T05:56:45.377 INFO:tasks.workunit.client.0.smithi155.stdout:7/990: dwrite d0/d6a/d1a/d8c/d34/d4b/d64/d6e/f7e [0,4194304] 0 2023-12-16T05:56:45.377 INFO:tasks.workunit.client.1.smithi156.stdout:8/767: write d3/d7/d27/d46/d6e/d3b/d77/fd8 [1077905,88874] 0 2023-12-16T05:56:45.377 INFO:tasks.workunit.client.1.smithi156.stdout:1/754: dwrite d3/d17/d1c/d22/fa3 [0,4194304] 0 2023-12-16T05:56:45.377 INFO:tasks.workunit.client.1.smithi156.stdout:1/755: chown d3/d17/d1c/d22/d57/d61/dc1/dbe 1444565254 1 2023-12-16T05:56:45.378 INFO:tasks.workunit.client.0.smithi155.stdout:7/991: mkdir d0/d1b/dbe/d13e 0 2023-12-16T05:56:45.378 INFO:tasks.workunit.client.1.smithi156.stdout:3/840: symlink dc/d10/l131 0 2023-12-16T05:56:45.382 INFO:tasks.workunit.client.1.smithi156.stdout:8/768: creat d3/d12/d16/db4/ffc x:0 0 0 2023-12-16T05:56:45.385 INFO:tasks.workunit.client.1.smithi156.stdout:8/769: write d3/d12/d16/f73 [434499,63968] 0 2023-12-16T05:56:45.385 INFO:tasks.workunit.client.1.smithi156.stdout:8/770: write d3/d7/d62/f7f [991924,46854] 0 2023-12-16T05:56:45.385 INFO:tasks.workunit.client.1.smithi156.stdout:3/841: truncate dc/d10/f11 1730865 0 2023-12-16T05:56:45.388 INFO:tasks.workunit.client.1.smithi156.stdout:3/842: symlink dc/d56/d67/l132 0 2023-12-16T05:56:45.388 INFO:tasks.workunit.client.1.smithi156.stdout:3/843: fdatasync dc/d56/f92 0 2023-12-16T05:56:45.389 INFO:tasks.workunit.client.1.smithi156.stdout:2/858: rmdir d9/d68/daa/d83 39 2023-12-16T05:56:45.391 INFO:tasks.workunit.client.1.smithi156.stdout:3/844: getdents dc/d10/d1d/db2/d10a 0 2023-12-16T05:56:45.391 INFO:tasks.workunit.client.1.smithi156.stdout:3/845: chown dc/d10/d1d/d4b/dac/f118 1996397423 1 2023-12-16T05:56:45.391 INFO:tasks.workunit.client.0.smithi155.stdout:3/935: dwrite d0/f55 [0,4194304] 0 2023-12-16T05:56:45.392 INFO:tasks.workunit.client.1.smithi156.stdout:2/859: creat d9/dd/f110 x:0 0 0 2023-12-16T05:56:45.392 INFO:tasks.workunit.client.0.smithi155.stdout:3/936: creat d0/d1a/da3/de6/f121 x:0 0 0 2023-12-16T05:56:45.393 INFO:tasks.workunit.client.0.smithi155.stdout:3/937: mkdir d0/d1a/d33/d57/dc3/d122 0 2023-12-16T05:56:45.393 INFO:tasks.workunit.client.1.smithi156.stdout:3/846: rename dc/df/d34/d62/d75/ceb to dc/df/d34/d62/d75/c133 0 2023-12-16T05:56:45.394 INFO:tasks.workunit.client.0.smithi155.stdout:3/938: rmdir d0/d14/d36/d83/d95 39 2023-12-16T05:56:45.394 INFO:tasks.workunit.client.0.smithi155.stdout:3/939: readlink d0/d1a/d33/l4d 0 2023-12-16T05:56:45.395 INFO:tasks.workunit.client.0.smithi155.stdout:3/940: truncate d0/d14/d87/d94/da1/db3/ff3 146206 0 2023-12-16T05:56:45.395 INFO:tasks.workunit.client.1.smithi156.stdout:2/860: mkdir d9/d68/daa/d83/da1/d96/dca/d111 0 2023-12-16T05:56:45.395 INFO:tasks.workunit.client.1.smithi156.stdout:2/861: chown d9/dd/d17/d33/d47/ddd/df5/d109/dad/fc3 2683 1 2023-12-16T05:56:45.396 INFO:tasks.workunit.client.1.smithi156.stdout:3/847: symlink dc/d10/d1d/d4b/dac/l134 0 2023-12-16T05:56:45.397 INFO:tasks.workunit.client.0.smithi155.stdout:7/992: dwrite d0/d6a/d31/f11b [0,4194304] 0 2023-12-16T05:56:45.397 INFO:tasks.workunit.client.0.smithi155.stdout:7/993: chown d0/d6a/d1a/d38/d4f 792585 1 2023-12-16T05:56:45.398 INFO:tasks.workunit.client.1.smithi156.stdout:2/862: symlink d9/dd/d17/d33/dae/l112 0 2023-12-16T05:56:45.399 INFO:tasks.workunit.client.1.smithi156.stdout:3/848: symlink dc/d10/d3d/l135 0 2023-12-16T05:56:45.400 INFO:tasks.workunit.client.0.smithi155.stdout:7/994: mkdir d0/d1/d13f 0 2023-12-16T05:56:45.400 INFO:tasks.workunit.client.0.smithi155.stdout:7/995: chown d0/d6a/d1a/d8c/d34/d4b/d64/d6f/dba/led 0 1 2023-12-16T05:56:45.403 INFO:tasks.workunit.client.1.smithi156.stdout:3/849: read dc/df/d34/d62/d75/fa9 [2742470,115351] 0 2023-12-16T05:56:45.418 INFO:tasks.workunit.client.0.smithi155.stdout:3/941: dwrite d0/d14/d45/fa0 [0,4194304] 0 2023-12-16T05:56:45.418 INFO:tasks.workunit.client.0.smithi155.stdout:3/942: stat d0/d1a/da3/lc8 0 2023-12-16T05:56:45.418 INFO:tasks.workunit.client.0.smithi155.stdout:3/943: dread - d0/d1a/d33/d57/dba/dd5/fe2 zero size 2023-12-16T05:56:45.418 INFO:tasks.workunit.client.0.smithi155.stdout:7/996: dwrite d0/d6a/d1a/d8c/d34/d4b/d64/d6f/f81 [0,4194304] 0 2023-12-16T05:56:45.418 INFO:tasks.workunit.client.0.smithi155.stdout:3/944: symlink d0/d1e/d4e/l123 0 2023-12-16T05:56:45.418 INFO:tasks.workunit.client.0.smithi155.stdout:3/945: fsync d0/d14/d36/f3d 0 2023-12-16T05:56:45.418 INFO:tasks.workunit.client.0.smithi155.stdout:3/946: stat d0/d14/d87/dec/ffd 0 2023-12-16T05:56:45.419 INFO:tasks.workunit.client.0.smithi155.stdout:3/947: write d0/d14/f65 [2225148,21755] 0 2023-12-16T05:56:45.421 INFO:tasks.workunit.client.0.smithi155.stdout:3/948: creat d0/d14/d87/d94/da1/f124 x:0 0 0 2023-12-16T05:56:45.422 INFO:tasks.workunit.client.0.smithi155.stdout:3/949: mkdir d0/d14/d87/d94/da1/d73/d125 0 2023-12-16T05:56:45.423 INFO:tasks.workunit.client.0.smithi155.stdout:3/950: mkdir d0/d14/d87/dcf/d126 0 2023-12-16T05:56:45.423 INFO:tasks.workunit.client.0.smithi155.stdout:3/951: chown d0/d14/d87/d94/da1/d73/d125 188 1 2023-12-16T05:56:45.423 INFO:tasks.workunit.client.0.smithi155.stdout:3/952: truncate d0/f11 3934333 0 2023-12-16T05:56:45.425 INFO:tasks.workunit.client.0.smithi155.stdout:3/953: write d0/d14/d45/fa0 [3425592,117860] 0 2023-12-16T05:56:45.426 INFO:tasks.workunit.client.0.smithi155.stdout:3/954: getdents d0/d14/d36/d47/d5f 0 2023-12-16T05:56:45.427 INFO:tasks.workunit.client.0.smithi155.stdout:3/955: creat d0/d14/d87/f127 x:0 0 0 2023-12-16T05:56:45.428 INFO:tasks.workunit.client.0.smithi155.stdout:3/956: creat d0/d14/f128 x:0 0 0 2023-12-16T05:56:45.429 INFO:tasks.workunit.client.0.smithi155.stdout:3/957: unlink d0/d14/d87/d94/da1/d73/faf 0 2023-12-16T05:56:45.432 INFO:tasks.workunit.client.0.smithi155.stdout:3/958: creat d0/d14/d36/d47/d5f/d9a/d9b/f129 x:0 0 0 2023-12-16T05:56:45.433 INFO:tasks.workunit.client.0.smithi155.stdout:3/959: truncate d0/d14/f50 3347783 0 2023-12-16T05:56:45.433 INFO:tasks.workunit.client.0.smithi155.stdout:3/960: getdents d0/d14/d45/dcd 0 2023-12-16T05:56:45.441 INFO:tasks.workunit.client.0.smithi155.stdout:3/961: dread d0/d14/d36/f3d [0,4194304] 0 2023-12-16T05:56:45.442 INFO:tasks.workunit.client.0.smithi155.stdout:3/962: getdents d0/d14/d36/d47/d5f/d9a 0 2023-12-16T05:56:45.442 INFO:tasks.workunit.client.0.smithi155.stdout:3/963: chown d0/d1e/f49 0 1 2023-12-16T05:56:45.443 INFO:tasks.workunit.client.0.smithi155.stdout:3/964: rename d0/d14/le3 to d0/d14/d9d/l12a 0 2023-12-16T05:56:45.444 INFO:tasks.workunit.client.0.smithi155.stdout:3/965: getdents d0/d14/d45/dcd/dff 0 2023-12-16T05:56:45.499 INFO:tasks.workunit.client.0.smithi155.stdout:3/966: dwrite d0/d14/d36/d47/da7/ff6 [0,4194304] 0 2023-12-16T05:56:45.499 INFO:tasks.workunit.client.0.smithi155.stdout:3/967: read d0/d14/d36/f3e [2031392,95513] 0 2023-12-16T05:56:45.501 INFO:tasks.workunit.client.0.smithi155.stdout:3/968: unlink d0/d1e/l64 0 2023-12-16T05:56:45.502 INFO:tasks.workunit.client.0.smithi155.stdout:3/969: stat d0/d1e/d4e/l123 0 2023-12-16T05:56:45.503 INFO:tasks.workunit.client.0.smithi155.stdout:3/970: rename d0/d1a/c4c to d0/d1a/d33/d57/dc3/ddf/c12b 0 2023-12-16T05:56:45.510 INFO:tasks.workunit.client.0.smithi155.stdout:3/971: dread d0/d14/d87/dec/ffd [0,4194304] 0 2023-12-16T05:56:45.511 INFO:tasks.workunit.client.0.smithi155.stdout:3/972: mknod d0/d14/d9d/c12c 0 2023-12-16T05:56:45.512 INFO:tasks.workunit.client.0.smithi155.stdout:3/973: creat d0/d1e/f12d x:0 0 0 2023-12-16T05:56:45.512 INFO:tasks.workunit.client.0.smithi155.stdout:3/974: fsync d0/d14/fee 0 2023-12-16T05:56:45.513 INFO:tasks.workunit.client.0.smithi155.stdout:3/975: symlink d0/d14/d45/l12e 0 2023-12-16T05:56:45.513 INFO:tasks.workunit.client.0.smithi155.stdout:3/976: chown d0/d14/d87 21302 1 2023-12-16T05:56:45.513 INFO:tasks.workunit.client.0.smithi155.stdout:3/977: chown d0/d14/d45 14278 1 2023-12-16T05:56:45.513 INFO:tasks.workunit.client.0.smithi155.stdout:3/978: write d0/d14/fc5 [2123061,79678] 0 2023-12-16T05:56:45.513 INFO:tasks.workunit.client.0.smithi155.stdout:3/979: readlink d0/d14/d45/l12e 0 2023-12-16T05:56:45.513 INFO:tasks.workunit.client.0.smithi155.stdout:3/980: getdents d0/d1a/d33/d105 0 2023-12-16T05:56:45.514 INFO:tasks.workunit.client.0.smithi155.stdout:3/981: getdents d0/d14/d87/d94/da1 0 2023-12-16T05:56:45.514 INFO:tasks.workunit.client.0.smithi155.stdout:3/982: readlink d0/d1a/d33/d57/lb5 0 2023-12-16T05:56:45.515 INFO:tasks.workunit.client.0.smithi155.stdout:3/983: mkdir d0/d14/d36/d47/d5f/d9a/dd2/d12f 0 2023-12-16T05:56:45.515 INFO:tasks.workunit.client.0.smithi155.stdout:3/984: readlink d0/d14/d36/d7c/l111 0 2023-12-16T05:56:45.516 INFO:tasks.workunit.client.0.smithi155.stdout:3/985: fsync d0/d14/f65 0 2023-12-16T05:56:45.516 INFO:tasks.workunit.client.0.smithi155.stdout:3/986: write d0/d1a/d33/d57/dba/dd5/fe2 [767030,101650] 0 2023-12-16T05:56:45.517 INFO:tasks.workunit.client.0.smithi155.stdout:3/987: mkdir d0/d1a/d33/d57/dc3/d122/d130 0 2023-12-16T05:56:45.517 INFO:tasks.workunit.client.0.smithi155.stdout:3/988: truncate d0/d14/d36/d47/da7/f119 440807 0 2023-12-16T05:56:45.521 INFO:tasks.workunit.client.0.smithi155.stdout:3/989: rmdir d0/d14/d36/d47 39 2023-12-16T05:56:45.523 INFO:tasks.workunit.client.0.smithi155.stdout:3/990: link d0/d1e/f32 d0/d14/d36/d7c/df0/f131 0 2023-12-16T05:56:45.523 INFO:tasks.workunit.client.0.smithi155.stdout:3/991: write d0/d14/d87/f127 [209184,100935] 0 2023-12-16T05:56:45.526 INFO:tasks.workunit.client.0.smithi155.stdout:3/992: rmdir d0/d14/d36 39 2023-12-16T05:56:45.527 INFO:tasks.workunit.client.0.smithi155.stdout:3/993: creat d0/d14/d36/f132 x:0 0 0 2023-12-16T05:56:45.528 INFO:tasks.workunit.client.0.smithi155.stdout:3/994: unlink d0/d1a/da3/lc8 0 2023-12-16T05:56:45.528 INFO:tasks.workunit.client.0.smithi155.stdout:3/995: write d0/d14/d45/f54 [25399,27612] 0 2023-12-16T05:56:45.529 INFO:tasks.workunit.client.0.smithi155.stdout:3/996: mknod d0/d14/d45/c133 0 2023-12-16T05:56:45.531 INFO:tasks.workunit.client.0.smithi155.stdout:3/997: rename d0/d14/d87/l8d to d0/d1a/d33/d57/dc3/d122/l134 0 2023-12-16T05:56:45.554 INFO:tasks.workunit.client.0.smithi155.stdout:3/998: dwrite d0/d1a/fcc [0,4194304] 0 2023-12-16T05:56:45.554 INFO:tasks.workunit.client.0.smithi155.stdout:3/999: rmdir d0/d14/d36/d47/d5f/d9a/d9b 39 2023-12-16T05:56:45.582 INFO:tasks.workunit.client.1.smithi156.stdout:4/825: sync 2023-12-16T05:56:45.582 INFO:tasks.workunit.client.1.smithi156.stdout:9/869: sync 2023-12-16T05:56:45.582 INFO:tasks.workunit.client.1.smithi156.stdout:9/870: write d6/d19/d25/d3a/fb5 [704016,76351] 0 2023-12-16T05:56:45.583 INFO:tasks.workunit.client.1.smithi156.stdout:4/826: mkdir d9/d2b/d98/d99/d11a 0 2023-12-16T05:56:45.583 INFO:tasks.workunit.client.1.smithi156.stdout:4/827: chown d9/d2b/d35/c93 0 1 2023-12-16T05:56:45.584 INFO:tasks.workunit.client.1.smithi156.stdout:9/871: symlink d6/d19/d25/l123 0 2023-12-16T05:56:45.585 INFO:tasks.workunit.client.1.smithi156.stdout:4/828: creat d9/d2b/d98/f11b x:0 0 0 2023-12-16T05:56:45.586 INFO:tasks.workunit.client.1.smithi156.stdout:4/829: mknod d9/d2c/dbf/dfa/c11c 0 2023-12-16T05:56:45.587 INFO:tasks.workunit.client.1.smithi156.stdout:4/830: getdents d9/d2c/dbf 0 2023-12-16T05:56:45.587 INFO:tasks.workunit.client.1.smithi156.stdout:4/831: fsync d9/f1b 0 2023-12-16T05:56:45.588 INFO:tasks.workunit.client.1.smithi156.stdout:4/832: creat d9/d2b/f11d x:0 0 0 2023-12-16T05:56:45.589 INFO:tasks.workunit.client.1.smithi156.stdout:4/833: creat d9/d2b/d98/dcd/f11e x:0 0 0 2023-12-16T05:56:45.651 INFO:tasks.workunit.client.0.smithi155.stdout:7/997: sync 2023-12-16T05:56:45.651 INFO:tasks.workunit.client.0.smithi155.stdout:4/955: sync 2023-12-16T05:56:45.651 INFO:tasks.workunit.client.0.smithi155.stdout:7/998: chown d0/d6a/d1a/d2b/d65/l94 39107 1 2023-12-16T05:56:45.652 INFO:tasks.workunit.client.0.smithi155.stdout:7/999: symlink d0/d6a/d1a/d8c/d10b/l140 0 2023-12-16T05:56:45.653 INFO:tasks.workunit.client.0.smithi155.stdout:4/956: mknod d0/da/de0/d16/d30/dce/d75/d10e/d70/d92/daf/db7/c141 0 2023-12-16T05:56:45.654 INFO:tasks.workunit.client.0.smithi155.stdout:4/957: rename d0/da/de0/d16/d30/d52/d88/d9e/d103/c79 to d0/da/de0/d16/d30/dce/d75/d10e/d70/d92/daf/db7/d116/c142 0 2023-12-16T05:56:45.654 INFO:tasks.workunit.client.0.smithi155.stdout:4/958: getdents d0/da/de0/d16/d30/dce/d75/d3d/d49/dbb 0 2023-12-16T05:56:45.655 INFO:tasks.workunit.client.0.smithi155.stdout:4/959: chown d0/da/de0/d16/d30/dce/d75/f51 342 1 2023-12-16T05:56:45.656 INFO:tasks.workunit.client.0.smithi155.stdout:4/960: symlink d0/da/de0/d16/d30/dce/d75/d86/l143 0 2023-12-16T05:56:45.672 INFO:tasks.workunit.client.0.smithi155.stdout:4/961: dwrite d0/da/de0/d16/d30/dce/d75/ddb/f122 [0,4194304] 0 2023-12-16T05:56:45.674 INFO:tasks.workunit.client.0.smithi155.stdout:4/962: truncate d0/da/de0/d16/d30/dce/d75/d10e/d70/d92/fde 3432139 0 2023-12-16T05:56:45.675 INFO:tasks.workunit.client.0.smithi155.stdout:4/963: creat d0/da/de0/d16/d30/dce/d75/d3d/d85/f144 x:0 0 0 2023-12-16T05:56:45.675 INFO:tasks.workunit.client.0.smithi155.stdout:4/964: write d0/da/de0/d16/d30/dce/d75/d10e/d70/d92/fad [777730,74358] 0 2023-12-16T05:56:45.676 INFO:tasks.workunit.client.0.smithi155.stdout:4/965: unlink d0/da/de0/d16/d30/dce/d75/d3d/fc2 0 2023-12-16T05:56:45.677 INFO:tasks.workunit.client.0.smithi155.stdout:4/966: mknod d0/da/de0/d16/d30/dce/d75/d3d/d110/c145 0 2023-12-16T05:56:45.679 INFO:tasks.workunit.client.0.smithi155.stdout:4/967: mknod d0/da/de0/d16/d30/dce/d75/d89/d9a/c146 0 2023-12-16T05:56:45.681 INFO:tasks.workunit.client.0.smithi155.stdout:4/968: rename d0/da/d36/c58 to d0/d10/def/dff/c147 0 2023-12-16T05:56:45.682 INFO:tasks.workunit.client.0.smithi155.stdout:4/969: mkdir d0/da/de0/d16/d30/dce/d75/d86/d148 0 2023-12-16T05:56:45.683 INFO:tasks.workunit.client.0.smithi155.stdout:4/970: rename d0/da/de0/d16/d30/dce/d75/d50/f6a to d0/da/de0/f149 0 2023-12-16T05:56:45.683 INFO:tasks.workunit.client.0.smithi155.stdout:4/971: stat d0/d10/l64 0 2023-12-16T05:56:45.684 INFO:tasks.workunit.client.0.smithi155.stdout:4/972: mkdir d0/da/d14a 0 2023-12-16T05:56:45.684 INFO:tasks.workunit.client.0.smithi155.stdout:4/973: fsync d0/da/de0/d16/d30/dce/d75/d10e/d70/d92/ffa 0 2023-12-16T05:56:45.685 INFO:tasks.workunit.client.0.smithi155.stdout:4/974: creat d0/da/de0/d16/d30/dce/d75/d50/f14b x:0 0 0 2023-12-16T05:56:45.700 INFO:tasks.workunit.client.0.smithi155.stdout:4/975: dwrite d0/da/de0/d16/d30/dce/d75/d10e/f72 [0,4194304] 0 2023-12-16T05:56:45.700 INFO:tasks.workunit.client.0.smithi155.stdout:4/976: chown d0/da/c24 938 1 2023-12-16T05:56:45.701 INFO:tasks.workunit.client.0.smithi155.stdout:4/977: unlink d0/da/de0/d16/d30/dce/d75/d89/d9a/ca2 0 2023-12-16T05:56:45.713 INFO:tasks.workunit.client.0.smithi155.stdout:4/978: dwrite d0/da/de0/d16/d30/dce/d75/d3d/d85/f144 [0,4194304] 0 2023-12-16T05:56:45.716 INFO:tasks.workunit.client.0.smithi155.stdout:4/979: dread d0/da/de0/d16/d30/dce/d75/d89/d9a/fe6 [0,4194304] 0 2023-12-16T05:56:45.733 INFO:tasks.workunit.client.0.smithi155.stdout:4/980: dwrite d0/da/de0/f149 [0,4194304] 0 2023-12-16T05:56:45.733 INFO:tasks.workunit.client.0.smithi155.stdout:4/981: chown d0/d10/def/dff/d10a 23 1 2023-12-16T05:56:45.733 INFO:tasks.workunit.client.0.smithi155.stdout:4/982: read - d0/da/d36/f13c zero size 2023-12-16T05:56:45.741 INFO:tasks.workunit.client.0.smithi155.stdout:4/983: dread d0/da/de0/d16/d30/dce/d75/d10e/f5c [4194304,4194304] 0 2023-12-16T05:56:45.742 INFO:tasks.workunit.client.0.smithi155.stdout:4/984: link d0/da/de0/d16/d30/dce/d75/d3d/d49/l53 d0/da/de0/d16/d30/dce/d75/d3d/d49/dbb/l14c 0 2023-12-16T05:56:45.743 INFO:tasks.workunit.client.0.smithi155.stdout:4/985: creat d0/d10/f14d x:0 0 0 2023-12-16T05:56:45.756 INFO:tasks.workunit.client.0.smithi155.stdout:4/986: dwrite d0/da/de0/d16/d30/dce/d75/d3d/d85/f119 [0,4194304] 0 2023-12-16T05:56:45.764 INFO:tasks.workunit.client.0.smithi155.stdout:4/987: dread d0/da/de0/d16/d30/dce/d75/d10e/f72 [0,4194304] 0 2023-12-16T05:56:45.764 INFO:tasks.workunit.client.0.smithi155.stdout:4/988: fdatasync d0/da/de0/d16/d30/d52/d88/d9e/fc4 0 2023-12-16T05:56:45.777 INFO:tasks.workunit.client.0.smithi155.stdout:4/989: dwrite d0/da/de0/d16/d30/fc5 [0,4194304] 0 2023-12-16T05:56:45.926 INFO:tasks.workunit.client.0.smithi155.stdout:4/990: sync 2023-12-16T05:56:45.926 INFO:tasks.workunit.client.0.smithi155.stdout:4/991: readlink d0/da/de0/d16/d30/dce/d75/d3d/d49/l109 0 2023-12-16T05:56:45.927 INFO:tasks.workunit.client.0.smithi155.stdout:4/992: mkdir d0/da/de0/d16/d30/dce/d75/d3d/d14e 0 2023-12-16T05:56:45.929 INFO:tasks.workunit.client.0.smithi155.stdout:4/993: rename d0/da/de0/d16/d30/dce/c87 to d0/da/de0/d16/d30/dce/d75/d10e/dd1/d135/c14f 0 2023-12-16T05:56:45.930 INFO:tasks.workunit.client.0.smithi155.stdout:4/994: truncate d0/da/de0/d16/d30/dce/f6d 1713297 0 2023-12-16T05:56:45.943 INFO:tasks.workunit.client.0.smithi155.stdout:4/995: dwrite d0/da/de0/d16/d30/dce/d75/d3d/d49/dbb/fc8 [0,4194304] 0 2023-12-16T05:56:45.944 INFO:tasks.workunit.client.0.smithi155.stdout:4/996: mknod d0/da/de0/d16/d30/dce/d75/d10e/d70/d92/c150 0 2023-12-16T05:56:45.945 INFO:tasks.workunit.client.0.smithi155.stdout:4/997: chown d0/da/de0/d16/d30/dce/d75/d3d/d49/d12a 36862281 1 2023-12-16T05:56:45.945 INFO:tasks.workunit.client.0.smithi155.stdout:4/998: stat d0/da/de0/d16/d30/dce/d75/d50/l11e 0 2023-12-16T05:56:45.947 INFO:tasks.workunit.client.0.smithi155.stdout:4/999: write d0/da/de0/d16/d30/dce/d75/d3d/d43/f95 [1876728,37441] 0 2023-12-16T05:56:45.950 INFO:tasks.workunit.client.0.smithi155.stderr:+ rm -rf -- ./tmp.d0BeU3Hpr1 2023-12-16T05:56:46.304 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:46 smithi155 ceph-mon[112451]: pgmap v19: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 246 MiB/s rd, 504 MiB/s wr, 775 op/s 2023-12-16T05:56:46.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:46 smithi156 ceph-mon[121001]: pgmap v19: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 246 MiB/s rd, 504 MiB/s wr, 775 op/s 2023-12-16T05:56:48.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:48 smithi156 ceph-mon[121001]: pgmap v20: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 166 MiB/s rd, 348 MiB/s wr, 528 op/s 2023-12-16T05:56:48.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:48 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:48.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:48 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:48.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:48 smithi155 ceph-mon[112451]: pgmap v20: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 166 MiB/s rd, 348 MiB/s wr, 528 op/s 2023-12-16T05:56:48.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:48 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:48.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:48 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:56:49.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:49 smithi156 ceph-mon[121001]: Reconfiguring grafana.smithi155 (dependencies changed)... 2023-12-16T05:56:49.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:49 smithi156 ceph-mon[121001]: Reconfiguring daemon grafana.smithi155 on smithi155 2023-12-16T05:56:49.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:49 smithi155 ceph-mon[112451]: Reconfiguring grafana.smithi155 (dependencies changed)... 2023-12-16T05:56:49.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:49 smithi155 ceph-mon[112451]: Reconfiguring daemon grafana.smithi155 on smithi155 2023-12-16T05:56:49.798 INFO:tasks.workunit.client.1.smithi156.stdout:6/951: sync 2023-12-16T05:56:49.798 INFO:tasks.workunit.client.1.smithi156.stdout:3/850: sync 2023-12-16T05:56:49.798 INFO:tasks.workunit.client.1.smithi156.stdout:2/863: sync 2023-12-16T05:56:49.798 INFO:tasks.workunit.client.1.smithi156.stdout:2/864: truncate d9/dd/d17/d33/d47/ddd/df5/d109/fed 188551 0 2023-12-16T05:56:49.798 INFO:tasks.workunit.client.1.smithi156.stdout:4/834: sync 2023-12-16T05:56:49.798 INFO:tasks.workunit.client.1.smithi156.stdout:9/872: sync 2023-12-16T05:56:49.798 INFO:tasks.workunit.client.1.smithi156.stdout:0/949: sync 2023-12-16T05:56:49.798 INFO:tasks.workunit.client.1.smithi156.stdout:8/771: sync 2023-12-16T05:56:49.798 INFO:tasks.workunit.client.1.smithi156.stdout:9/873: fsync d6/f98 0 2023-12-16T05:56:49.798 INFO:tasks.workunit.client.1.smithi156.stdout:1/756: sync 2023-12-16T05:56:49.798 INFO:tasks.workunit.client.1.smithi156.stdout:1/757: chown d3/d17/d1c/d22/d57/d61/dc1/c43 1 1 2023-12-16T05:56:49.799 INFO:tasks.workunit.client.1.smithi156.stdout:4/835: read d9/d2c/dbf/dcf/fde [742006,78290] 0 2023-12-16T05:56:49.799 INFO:tasks.workunit.client.1.smithi156.stdout:6/952: creat d9/d1c/d50/dbf/dc0/d126/f13a x:0 0 0 2023-12-16T05:56:49.801 INFO:tasks.workunit.client.1.smithi156.stdout:6/953: dread d9/d1c/d50/dbf/dc0/f118 [0,4194304] 0 2023-12-16T05:56:49.804 INFO:tasks.workunit.client.1.smithi156.stdout:9/874: mkdir d6/d19/d25/d3a/d88/d124 0 2023-12-16T05:56:49.805 INFO:tasks.workunit.client.1.smithi156.stdout:8/772: creat d3/d12/d16/db4/de9/ffd x:0 0 0 2023-12-16T05:56:49.807 INFO:tasks.workunit.client.1.smithi156.stdout:4/836: creat d9/d2c/d7a/dd4/f11f x:0 0 0 2023-12-16T05:56:49.807 INFO:tasks.workunit.client.1.smithi156.stdout:4/837: readlink d9/d2b/d98/d99/l88 0 2023-12-16T05:56:49.811 INFO:tasks.workunit.client.1.smithi156.stdout:9/875: link d6/d19/d30/c106 d6/d19/d30/d48/d87/c125 0 2023-12-16T05:56:49.811 INFO:tasks.workunit.client.1.smithi156.stdout:9/876: fdatasync d6/d19/d25/d3a/f43 0 2023-12-16T05:56:49.811 INFO:tasks.workunit.client.1.smithi156.stdout:9/877: write d6/f98 [950863,103654] 0 2023-12-16T05:56:49.813 INFO:tasks.workunit.client.1.smithi156.stdout:4/838: chown d9/d2b/c3d 152 1 2023-12-16T05:56:49.813 INFO:tasks.workunit.client.1.smithi156.stdout:4/839: dread - d9/d2c/dbf/dfa/fc4 zero size 2023-12-16T05:56:49.815 INFO:tasks.workunit.client.1.smithi156.stdout:1/758: dwrite d3/d17/d1c/d22/d57/d61/dc1/fe3 [0,4194304] 0 2023-12-16T05:56:49.815 INFO:tasks.workunit.client.1.smithi156.stdout:1/759: stat d3/f15 0 2023-12-16T05:56:49.830 INFO:tasks.workunit.client.1.smithi156.stdout:1/760: dread d3/d17/d2d/ff6 [0,4194304] 0 2023-12-16T05:56:49.832 INFO:tasks.workunit.client.1.smithi156.stdout:0/950: rmdir d2/d7/dd/d29/d38/dae/d100 39 2023-12-16T05:56:49.833 INFO:tasks.workunit.client.1.smithi156.stdout:0/951: creat d2/d23/f125 x:0 0 0 2023-12-16T05:56:49.834 INFO:tasks.workunit.client.1.smithi156.stdout:0/952: readlink d2/d7/l11 0 2023-12-16T05:56:49.836 INFO:tasks.workunit.client.1.smithi156.stdout:0/953: symlink d2/d7/dd/d2d/dcf/l126 0 2023-12-16T05:56:49.837 INFO:tasks.workunit.client.1.smithi156.stdout:1/761: dread d3/d17/d4d/dc2/f5c [0,4194304] 0 2023-12-16T05:56:49.838 INFO:tasks.workunit.client.1.smithi156.stdout:0/954: mkdir d2/d7/dd/d29/d38/d51/d65/d7e/d127 0 2023-12-16T05:56:49.838 INFO:tasks.workunit.client.1.smithi156.stdout:1/762: write d3/d17/d4d/f9d [2642312,12031] 0 2023-12-16T05:56:49.839 INFO:tasks.workunit.client.1.smithi156.stdout:1/763: stat d3/d17/d1c/d22/d57/d82/lbb 0 2023-12-16T05:56:49.839 INFO:tasks.workunit.client.1.smithi156.stdout:1/764: chown d3/d17/d1c/d22/d57/d61/dc1/l55 338675201 1 2023-12-16T05:56:49.839 INFO:tasks.workunit.client.1.smithi156.stdout:1/765: truncate d3/d17/d4d/dc2/f73 1424854 0 2023-12-16T05:56:49.841 INFO:tasks.workunit.client.1.smithi156.stdout:1/766: link d3/d3a/db1/fee d3/d3a/f106 0 2023-12-16T05:56:49.841 INFO:tasks.workunit.client.1.smithi156.stdout:1/767: truncate d3/d3a/f106 412526 0 2023-12-16T05:56:49.842 INFO:tasks.workunit.client.1.smithi156.stdout:4/840: dwrite d9/d2c/dbf/dfa/fc4 [0,4194304] 0 2023-12-16T05:56:49.844 INFO:tasks.workunit.client.1.smithi156.stdout:9/878: dwrite d6/d19/d30/dae/db7/fe4 [0,4194304] 0 2023-12-16T05:56:49.845 INFO:tasks.workunit.client.1.smithi156.stdout:4/841: truncate d9/d2c/d48/dae/f6d 324571 0 2023-12-16T05:56:49.846 INFO:tasks.workunit.client.1.smithi156.stdout:3/851: rename dc/df/d70 to dc/d10/d3d/d4e/d136 0 2023-12-16T05:56:49.850 INFO:tasks.workunit.client.1.smithi156.stdout:9/879: mknod d6/d2e/d8a/da5/d119/c126 0 2023-12-16T05:56:49.851 INFO:tasks.workunit.client.1.smithi156.stdout:4/842: dread f5 [0,4194304] 0 2023-12-16T05:56:49.854 INFO:tasks.workunit.client.1.smithi156.stdout:3/852: unlink dc/df/d66/ffb 0 2023-12-16T05:56:49.854 INFO:tasks.workunit.client.1.smithi156.stdout:3/853: fsync dc/df/d34/d62/d75/f12f 0 2023-12-16T05:56:49.857 INFO:tasks.workunit.client.1.smithi156.stdout:0/955: dwrite d2/df0/d11d/f123 [0,4194304] 0 2023-12-16T05:56:49.864 INFO:tasks.workunit.client.1.smithi156.stdout:1/768: rename d3/d17/d1c/d22/d57/d61/f80 to d3/d17/d1c/d22/d57/d61/dc1/f107 0 2023-12-16T05:56:49.864 INFO:tasks.workunit.client.1.smithi156.stdout:1/769: write d3/d3a/fe1 [427774,63471] 0 2023-12-16T05:56:49.865 INFO:tasks.workunit.client.1.smithi156.stdout:1/770: symlink d3/d17/daa/l108 0 2023-12-16T05:56:49.865 INFO:tasks.workunit.client.1.smithi156.stdout:1/771: fsync d3/d17/d1c/d22/d57/d61/dc1/f20 0 2023-12-16T05:56:49.868 INFO:tasks.workunit.client.1.smithi156.stdout:2/865: mkdir d9/dd/d113 0 2023-12-16T05:56:49.868 INFO:tasks.workunit.client.1.smithi156.stdout:2/866: chown d9/d68/daa/d83/da1/d96/dca/cd2 1109 1 2023-12-16T05:56:49.869 INFO:tasks.workunit.client.1.smithi156.stdout:2/867: rmdir d9/dd/d17/d33/d47/d9e 39 2023-12-16T05:56:49.871 INFO:tasks.workunit.client.1.smithi156.stdout:0/956: mkdir d2/d7/dd/d128 0 2023-12-16T05:56:49.873 INFO:tasks.workunit.client.1.smithi156.stdout:0/957: truncate d2/d7/dd/d29/d4b/ff8 2399489 0 2023-12-16T05:56:49.876 INFO:tasks.workunit.client.1.smithi156.stdout:0/958: mkdir d2/d7/dd/d29/d38/dae/d100/d129 0 2023-12-16T05:56:49.876 INFO:tasks.workunit.client.1.smithi156.stdout:0/959: readlink d2/d7/dd/d29/d4b/d76/lab 0 2023-12-16T05:56:49.878 INFO:tasks.workunit.client.1.smithi156.stdout:3/854: unlink dc/d10/l53 0 2023-12-16T05:56:49.887 INFO:tasks.workunit.client.1.smithi156.stdout:9/880: creat d6/d19/d25/d3a/d5e/f127 x:0 0 0 2023-12-16T05:56:49.887 INFO:tasks.workunit.client.1.smithi156.stdout:8/773: creat d3/d7a/ffe x:0 0 0 2023-12-16T05:56:49.888 INFO:tasks.workunit.client.1.smithi156.stdout:6/954: creat d9/d13/d2f/d51/d69/d99/db9/d110/d8e/d9a/dce/f13b x:0 0 0 2023-12-16T05:56:49.888 INFO:tasks.workunit.client.1.smithi156.stdout:6/955: truncate d9/d13/d2f/d51/d69/d99/db9/d110/d8e/d9a/ff2 119603 0 2023-12-16T05:56:49.889 INFO:tasks.workunit.client.1.smithi156.stdout:4/843: rmdir d9/d2b 39 2023-12-16T05:56:49.889 INFO:tasks.workunit.client.1.smithi156.stdout:4/844: chown d9/f15 0 1 2023-12-16T05:56:49.891 INFO:tasks.workunit.client.1.smithi156.stdout:9/881: getdents d6/d19/d30/dae 0 2023-12-16T05:56:49.891 INFO:tasks.workunit.client.1.smithi156.stdout:6/956: dread d9/d1c/fac [0,4194304] 0 2023-12-16T05:56:49.893 INFO:tasks.workunit.client.1.smithi156.stdout:8/774: creat d3/d12/d95/fff x:0 0 0 2023-12-16T05:56:49.894 INFO:tasks.workunit.client.1.smithi156.stdout:4/845: rmdir d9/d2c/dbf/dfa/d95/d110 0 2023-12-16T05:56:49.895 INFO:tasks.workunit.client.1.smithi156.stdout:1/772: dwrite d3/d17/d4d/dc2/d4f/fd3 [0,4194304] 0 2023-12-16T05:56:49.897 INFO:tasks.workunit.client.1.smithi156.stdout:1/773: dread d3/faf [0,4194304] 0 2023-12-16T05:56:49.898 INFO:tasks.workunit.client.1.smithi156.stdout:6/957: mknod d9/d1c/d50/dbf/dca/dff/c13c 0 2023-12-16T05:56:49.900 INFO:tasks.workunit.client.1.smithi156.stdout:8/775: mkdir d3/d7/d27/d46/d6e/d3c/d100 0 2023-12-16T05:56:49.900 INFO:tasks.workunit.client.1.smithi156.stdout:8/776: chown d3/d7a/d7d/dae/c4c 34 1 2023-12-16T05:56:49.900 INFO:tasks.workunit.client.1.smithi156.stdout:8/777: chown d3/d12/ceb 8 1 2023-12-16T05:56:49.902 INFO:tasks.workunit.client.1.smithi156.stdout:9/882: symlink d6/l128 0 2023-12-16T05:56:49.903 INFO:tasks.workunit.client.1.smithi156.stdout:9/883: getdents d6/d19/d30/dae 0 2023-12-16T05:56:49.905 INFO:tasks.workunit.client.1.smithi156.stdout:1/774: truncate d3/d17/d4d/dc2/d4f/fac 3630774 0 2023-12-16T05:56:49.907 INFO:tasks.workunit.client.1.smithi156.stdout:9/884: unlink d6/d19/d25/d3a/d5e/da9/de1/dfc/cb6 0 2023-12-16T05:56:49.909 INFO:tasks.workunit.client.1.smithi156.stdout:1/775: dread d3/d17/d1c/d22/f9b [0,4194304] 0 2023-12-16T05:56:49.909 INFO:tasks.workunit.client.1.smithi156.stdout:1/776: write d3/d17/f5e [1189005,35764] 0 2023-12-16T05:56:49.912 INFO:tasks.workunit.client.1.smithi156.stdout:2/868: dwrite d9/dd/d17/d33/d47/ddd/df5/d109/da6/f105 [0,4194304] 0 2023-12-16T05:56:49.915 INFO:tasks.workunit.client.1.smithi156.stdout:2/869: link d9/d68/daa/d83/f84 d9/dd/d17/d33/f114 0 2023-12-16T05:56:49.916 INFO:tasks.workunit.client.1.smithi156.stdout:2/870: rmdir d9 39 2023-12-16T05:56:49.916 INFO:tasks.workunit.client.1.smithi156.stdout:3/855: dwrite dc/d56/f83 [0,4194304] 0 2023-12-16T05:56:49.918 INFO:tasks.workunit.client.1.smithi156.stdout:2/871: unlink d9/fa 0 2023-12-16T05:56:49.918 INFO:tasks.workunit.client.1.smithi156.stdout:2/872: truncate d9/dd/d17/d33/d47/ddd/df5/d109/dad/fc3 4361585 0 2023-12-16T05:56:49.919 INFO:tasks.workunit.client.1.smithi156.stdout:0/960: dwrite d2/d7/f11a [0,4194304] 0 2023-12-16T05:56:49.922 INFO:tasks.workunit.client.1.smithi156.stdout:3/856: creat dc/d10/d3d/df8/d11c/f137 x:0 0 0 2023-12-16T05:56:49.926 INFO:tasks.workunit.client.1.smithi156.stdout:0/961: creat d2/d7/dd/d29/d4b/dc0/df2/f12a x:0 0 0 2023-12-16T05:56:49.927 INFO:tasks.workunit.client.1.smithi156.stdout:0/962: write d2/f28 [561186,11850] 0 2023-12-16T05:56:49.927 INFO:tasks.workunit.client.1.smithi156.stdout:3/857: stat dc/d56/d67/dbe/lf3 0 2023-12-16T05:56:49.929 INFO:tasks.workunit.client.1.smithi156.stdout:3/858: symlink dc/d56/l138 0 2023-12-16T05:56:49.931 INFO:tasks.workunit.client.1.smithi156.stdout:3/859: mknod dc/d10/d3d/d4e/c139 0 2023-12-16T05:56:49.933 INFO:tasks.workunit.client.1.smithi156.stdout:3/860: rmdir dc/d10/dc6 39 2023-12-16T05:56:49.942 INFO:tasks.workunit.client.1.smithi156.stdout:0/963: dwrite d2/d7/dd/d2d/dcf/f99 [0,4194304] 0 2023-12-16T05:56:49.943 INFO:tasks.workunit.client.1.smithi156.stdout:0/964: link d2/f28 d2/d7/dd/d2d/d5e/df7/f12b 0 2023-12-16T05:56:49.946 INFO:tasks.workunit.client.1.smithi156.stdout:3/861: dread dc/df/fcd [0,4194304] 0 2023-12-16T05:56:49.947 INFO:tasks.workunit.client.1.smithi156.stdout:3/862: creat dc/d56/d67/d6e/f13a x:0 0 0 2023-12-16T05:56:49.947 INFO:tasks.workunit.client.1.smithi156.stdout:3/863: fsync dc/df/d66/fdd 0 2023-12-16T05:56:49.947 INFO:tasks.workunit.client.1.smithi156.stdout:3/864: dread - dc/d10/d1d/d90/f11e zero size 2023-12-16T05:56:49.948 INFO:tasks.workunit.client.1.smithi156.stdout:3/865: creat dc/d10/d1d/d4b/dac/f13b x:0 0 0 2023-12-16T05:56:49.949 INFO:tasks.workunit.client.1.smithi156.stdout:3/866: symlink dc/d10/d3d/l13c 0 2023-12-16T05:56:49.949 INFO:tasks.workunit.client.1.smithi156.stdout:3/867: chown dc/d56/c84 1030 1 2023-12-16T05:56:49.950 INFO:tasks.workunit.client.1.smithi156.stdout:3/868: truncate dc/d10/d1d/d4b/dac/f13b 313254 0 2023-12-16T05:56:49.950 INFO:tasks.workunit.client.1.smithi156.stdout:0/965: dread d2/d23/d4a/f8b [0,4194304] 0 2023-12-16T05:56:49.951 INFO:tasks.workunit.client.1.smithi156.stdout:0/966: stat d2/d7/dd/d29/d38/d51/d65/d7e/leb 0 2023-12-16T05:56:49.951 INFO:tasks.workunit.client.1.smithi156.stdout:0/967: readlink d2/l34 0 2023-12-16T05:56:49.952 INFO:tasks.workunit.client.1.smithi156.stdout:0/968: symlink d2/d7/dd/d2d/d5e/d110/dbc/dd2/def/l12c 0 2023-12-16T05:56:49.953 INFO:tasks.workunit.client.1.smithi156.stdout:0/969: creat d2/d7/dd/d29/d38/d51/d52/dee/f12d x:0 0 0 2023-12-16T05:56:49.962 INFO:tasks.workunit.client.1.smithi156.stdout:2/873: read d9/f2d [308721,89492] 0 2023-12-16T05:56:49.962 INFO:tasks.workunit.client.1.smithi156.stdout:2/874: fdatasync d9/d12/f45 0 2023-12-16T05:56:49.962 INFO:tasks.workunit.client.1.smithi156.stdout:2/875: truncate d9/dd/f110 641171 0 2023-12-16T05:56:49.962 INFO:tasks.workunit.client.1.smithi156.stdout:2/876: fdatasync d9/dd/d17/d33/d47/ddd/df5/d109/da6/f105 0 2023-12-16T05:56:49.962 INFO:tasks.workunit.client.1.smithi156.stdout:2/877: write d9/dd/d17/d33/fe8 [230706,51662] 0 2023-12-16T05:56:49.962 INFO:tasks.workunit.client.1.smithi156.stdout:2/878: chown d9/d12/dc2/fc7 1105215 1 2023-12-16T05:56:49.963 INFO:tasks.workunit.client.1.smithi156.stdout:4/846: dwrite d9/d43/fb4 [0,4194304] 0 2023-12-16T05:56:49.964 INFO:tasks.workunit.client.1.smithi156.stdout:3/869: read dc/d10/d3d/d4e/d136/fbd [416931,101433] 0 2023-12-16T05:56:49.968 INFO:tasks.workunit.client.1.smithi156.stdout:0/970: dread d2/f28 [0,4194304] 0 2023-12-16T05:56:49.968 INFO:tasks.workunit.client.1.smithi156.stdout:4/847: creat d9/d2b/d98/dcd/f120 x:0 0 0 2023-12-16T05:56:49.971 INFO:tasks.workunit.client.1.smithi156.stdout:3/870: unlink dc/d10/d1d/fa3 0 2023-12-16T05:56:49.971 INFO:tasks.workunit.client.1.smithi156.stdout:6/958: dwrite d9/f85 [0,4194304] 0 2023-12-16T05:56:49.975 INFO:tasks.workunit.client.1.smithi156.stdout:4/848: creat d9/d2c/dbf/dfa/f121 x:0 0 0 2023-12-16T05:56:49.975 INFO:tasks.workunit.client.1.smithi156.stdout:4/849: truncate d9/d2c/dbf/dfa/d95/faa 79865 0 2023-12-16T05:56:49.977 INFO:tasks.workunit.client.1.smithi156.stdout:4/850: write d9/d2b/fe0 [2264916,84525] 0 2023-12-16T05:56:49.977 INFO:tasks.workunit.client.1.smithi156.stdout:4/851: chown d9/d2c/dbf/dfa/f76 6 1 2023-12-16T05:56:49.979 INFO:tasks.workunit.client.1.smithi156.stdout:6/959: truncate d9/f93 2511241 0 2023-12-16T05:56:49.984 INFO:tasks.workunit.client.1.smithi156.stdout:6/960: mknod d9/d13/d2f/d51/d69/d99/db9/d110/d8e/d9a/c13d 0 2023-12-16T05:56:49.989 INFO:tasks.workunit.client.1.smithi156.stdout:0/971: dwrite d2/d7/dd/d29/fd4 [4194304,4194304] 0 2023-12-16T05:56:49.991 INFO:tasks.workunit.client.1.smithi156.stdout:6/961: read d9/d13/d2f/d51/fb1 [2988952,129283] 0 2023-12-16T05:56:49.991 INFO:tasks.workunit.client.1.smithi156.stdout:6/962: chown d9/d1c/c109 56083614 1 2023-12-16T05:56:49.991 INFO:tasks.workunit.client.1.smithi156.stdout:6/963: read - d9/d13/d2f/d51/d69/d99/db9/d110/d8e/d9a/dce/df0/f119 zero size 2023-12-16T05:56:49.992 INFO:tasks.workunit.client.1.smithi156.stdout:0/972: stat d2/df0/lfc 0 2023-12-16T05:56:49.992 INFO:tasks.workunit.client.1.smithi156.stdout:0/973: dread - d2/d7/dd/d2d/d5e/d110/f120 zero size 2023-12-16T05:56:49.992 INFO:tasks.workunit.client.1.smithi156.stdout:0/974: fsync d2/d7/dd/d29/d4b/dc0/df2/fb9 0 2023-12-16T05:56:49.995 INFO:tasks.workunit.client.1.smithi156.stdout:3/871: dwrite dc/d56/d67/dbe/dc3/de4/ff7 [0,4194304] 0 2023-12-16T05:56:49.995 INFO:tasks.workunit.client.1.smithi156.stdout:3/872: dread - dc/df/d34/d62/d75/f12f zero size 2023-12-16T05:56:49.995 INFO:tasks.workunit.client.1.smithi156.stdout:3/873: fdatasync dc/d10/d3d/d4e/d136/f9b 0 2023-12-16T05:56:49.995 INFO:tasks.workunit.client.1.smithi156.stdout:0/975: symlink d2/d7/dd/d29/d38/d51/d65/l12e 0 2023-12-16T05:56:49.998 INFO:tasks.workunit.client.1.smithi156.stdout:6/964: dread d9/d13/d3e/fb5 [0,4194304] 0 2023-12-16T05:56:50.000 INFO:tasks.workunit.client.1.smithi156.stdout:3/874: rename dc/d56/d67/dbe/dc3/ded/c102 to dc/d10/d1d/d4b/dac/c13d 0 2023-12-16T05:56:50.003 INFO:tasks.workunit.client.1.smithi156.stdout:0/976: mkdir d2/d12f 0 2023-12-16T05:56:50.005 INFO:tasks.workunit.client.1.smithi156.stdout:6/965: mkdir d9/d13/d3e/d5f/d10a/d13e 0 2023-12-16T05:56:50.005 INFO:tasks.workunit.client.1.smithi156.stdout:6/966: truncate d9/d13/d2f/d51/d69/d99/db9/d110/f121 1808 0 2023-12-16T05:56:50.009 INFO:tasks.workunit.client.1.smithi156.stdout:3/875: creat dc/d10/d1d/d4b/dac/f13e x:0 0 0 2023-12-16T05:56:50.009 INFO:tasks.workunit.client.1.smithi156.stdout:3/876: truncate dc/d10/d3d/db5/fd8 896896 0 2023-12-16T05:56:50.011 INFO:tasks.workunit.client.1.smithi156.stdout:6/967: creat d9/d1c/d50/dbf/dca/dff/f13f x:0 0 0 2023-12-16T05:56:50.011 INFO:tasks.workunit.client.1.smithi156.stdout:6/968: read d9/d1c/d50/dbf/f11c [331392,117749] 0 2023-12-16T05:56:50.016 INFO:tasks.workunit.client.1.smithi156.stdout:3/877: getdents dc/d10/d3d 0 2023-12-16T05:56:50.018 INFO:tasks.workunit.client.1.smithi156.stdout:3/878: truncate dc/f19 1647780 0 2023-12-16T05:56:50.019 INFO:tasks.workunit.client.1.smithi156.stdout:3/879: read dc/d10/d3d/db5/fd8 [425461,91302] 0 2023-12-16T05:56:50.019 INFO:tasks.workunit.client.1.smithi156.stdout:3/880: write dc/df/f2b [4310818,71721] 0 2023-12-16T05:56:50.021 INFO:tasks.workunit.client.1.smithi156.stdout:3/881: write dc/d56/d69/ff4 [32326,21629] 0 2023-12-16T05:56:50.021 INFO:tasks.workunit.client.1.smithi156.stdout:3/882: readlink dc/df/d34/l43 0 2023-12-16T05:56:50.023 INFO:tasks.workunit.client.1.smithi156.stdout:3/883: unlink dc/df/f2d 0 2023-12-16T05:56:50.024 INFO:tasks.workunit.client.1.smithi156.stdout:4/852: rmdir d9/d2b/d98 39 2023-12-16T05:56:50.026 INFO:tasks.workunit.client.1.smithi156.stdout:4/853: symlink d9/d2b/d35/dd3/l122 0 2023-12-16T05:56:50.027 INFO:tasks.workunit.client.1.smithi156.stdout:4/854: fdatasync d9/d2c/d7a/f8a 0 2023-12-16T05:56:50.028 INFO:tasks.workunit.client.1.smithi156.stdout:4/855: mknod d9/d2c/dbf/dfa/d7d/d82/c123 0 2023-12-16T05:56:50.028 INFO:tasks.workunit.client.1.smithi156.stdout:4/856: write d9/d2b/f11d [1027241,39991] 0 2023-12-16T05:56:50.029 INFO:tasks.workunit.client.1.smithi156.stdout:4/857: rename d9/d43/fb4 to d9/d2c/dbf/dfe/f124 0 2023-12-16T05:56:50.030 INFO:tasks.workunit.client.1.smithi156.stdout:0/977: dwrite d2/d7/dd/d29/d4b/dc0/df2/f97 [0,4194304] 0 2023-12-16T05:56:50.032 INFO:tasks.workunit.client.1.smithi156.stdout:4/858: getdents d9/d2c/dbf/dcf 0 2023-12-16T05:56:50.032 INFO:tasks.workunit.client.1.smithi156.stdout:4/859: truncate d9/d2c/dbf/f101 536678 0 2023-12-16T05:56:50.039 INFO:tasks.workunit.client.1.smithi156.stdout:6/969: dwrite d9/f85 [0,4194304] 0 2023-12-16T05:56:50.040 INFO:tasks.workunit.client.1.smithi156.stdout:4/860: creat d9/d2c/dbf/dfe/f125 x:0 0 0 2023-12-16T05:56:50.044 INFO:tasks.workunit.client.1.smithi156.stdout:6/970: creat d9/d13/d2f/d51/d69/d99/db9/f140 x:0 0 0 2023-12-16T05:56:50.045 INFO:tasks.workunit.client.1.smithi156.stdout:4/861: creat d9/d2c/d7a/dd4/f126 x:0 0 0 2023-12-16T05:56:50.046 INFO:tasks.workunit.client.1.smithi156.stdout:4/862: symlink d9/d2c/d48/l127 0 2023-12-16T05:56:50.046 INFO:tasks.workunit.client.1.smithi156.stdout:4/863: truncate d9/f37 5090691 0 2023-12-16T05:56:50.046 INFO:tasks.workunit.client.1.smithi156.stdout:4/864: write d9/d2c/d7a/dc0/fd1 [4231839,45426] 0 2023-12-16T05:56:50.050 INFO:tasks.workunit.client.1.smithi156.stdout:0/978: dwrite d2/d47/f80 [0,4194304] 0 2023-12-16T05:56:50.051 INFO:tasks.workunit.client.1.smithi156.stdout:4/865: dread d9/d2b/fbd [0,4194304] 0 2023-12-16T05:56:50.057 INFO:tasks.workunit.client.1.smithi156.stdout:0/979: write d2/d7/dd/d29/d4b/dc0/df2/f97 [4346517,37591] 0 2023-12-16T05:56:50.059 INFO:tasks.workunit.client.1.smithi156.stdout:0/980: truncate d2/d7/dd/d2d/d5e/d110/f95 1288686 0 2023-12-16T05:56:50.060 INFO:tasks.workunit.client.1.smithi156.stdout:0/981: mkdir d2/d130 0 2023-12-16T05:56:50.060 INFO:tasks.workunit.client.1.smithi156.stdout:0/982: fsync d2/d7/dd/d2d/d5e/d110/dbc/dc2/fe4 0 2023-12-16T05:56:50.060 INFO:tasks.workunit.client.1.smithi156.stdout:0/983: readlink d2/d7/dd/d29/lf6 0 2023-12-16T05:56:50.077 INFO:tasks.workunit.client.1.smithi156.stdout:4/866: dwrite d9/fa3 [0,4194304] 0 2023-12-16T05:56:50.077 INFO:tasks.workunit.client.1.smithi156.stdout:4/867: fdatasync d9/d2c/dbf/dfa/d7d/fd9 0 2023-12-16T05:56:50.077 INFO:tasks.workunit.client.1.smithi156.stdout:4/868: write d9/d2c/d7a/dd4/feb [693578,43108] 0 2023-12-16T05:56:50.077 INFO:tasks.workunit.client.1.smithi156.stdout:6/971: dwrite d9/d1c/f3a [0,4194304] 0 2023-12-16T05:56:50.078 INFO:tasks.workunit.client.1.smithi156.stdout:6/972: write d9/d1c/f6a [472237,112292] 0 2023-12-16T05:56:50.082 INFO:tasks.workunit.client.1.smithi156.stdout:4/869: unlink d9/d43/fa9 0 2023-12-16T05:56:50.083 INFO:tasks.workunit.client.1.smithi156.stdout:4/870: creat d9/d2c/d7a/dd4/f128 x:0 0 0 2023-12-16T05:56:50.083 INFO:tasks.workunit.client.1.smithi156.stdout:4/871: write d9/d2c/dbf/dfa/f76 [225753,116681] 0 2023-12-16T05:56:50.083 INFO:tasks.workunit.client.1.smithi156.stdout:4/872: write d9/d43/fac [395284,43803] 0 2023-12-16T05:56:50.083 INFO:tasks.workunit.client.1.smithi156.stdout:4/873: chown d9/d2c/cda 4087 1 2023-12-16T05:56:50.086 INFO:tasks.workunit.client.1.smithi156.stdout:4/874: unlink d9/l64 0 2023-12-16T05:56:50.091 INFO:tasks.workunit.client.1.smithi156.stdout:0/984: truncate d2/d7/dd/d29/fd4 6264063 0 2023-12-16T05:56:50.099 INFO:tasks.workunit.client.1.smithi156.stdout:0/985: write d2/d47/f80 [2889359,95341] 0 2023-12-16T05:56:50.102 INFO:tasks.workunit.client.1.smithi156.stdout:0/986: mknod d2/d7/dd/d2d/dcf/c131 0 2023-12-16T05:56:50.103 INFO:tasks.workunit.client.1.smithi156.stdout:0/987: mknod d2/d7/dd/d29/d38/dad/c132 0 2023-12-16T05:56:50.105 INFO:tasks.workunit.client.1.smithi156.stdout:6/973: dwrite d9/d13/f20 [0,4194304] 0 2023-12-16T05:56:50.105 INFO:tasks.workunit.client.1.smithi156.stdout:6/974: readlink d9/d13/d2f/d51/d9b/lee 0 2023-12-16T05:56:50.106 INFO:tasks.workunit.client.1.smithi156.stdout:0/988: rename d2/d7/dd/d2d/d5e/l82 to d2/d7/dd/l133 0 2023-12-16T05:56:50.110 INFO:tasks.workunit.client.1.smithi156.stdout:6/975: unlink d9/d13/c21 0 2023-12-16T05:56:50.111 INFO:tasks.workunit.client.1.smithi156.stdout:4/875: dwrite d9/d2c/d48/dae/ff3 [0,4194304] 0 2023-12-16T05:56:50.111 INFO:tasks.workunit.client.1.smithi156.stdout:4/876: chown d9/d2c/dbf/dfa/d7d 193635 1 2023-12-16T05:56:50.111 INFO:tasks.workunit.client.1.smithi156.stdout:4/877: fsync d9/d2b/d98/dcd/f11e 0 2023-12-16T05:56:50.112 INFO:tasks.workunit.client.1.smithi156.stdout:6/976: creat d9/d1c/d50/dbf/dc0/f141 x:0 0 0 2023-12-16T05:56:50.131 INFO:tasks.workunit.client.1.smithi156.stdout:0/989: dwrite d2/d23/d4a/fa3 [0,4194304] 0 2023-12-16T05:56:50.131 INFO:tasks.workunit.client.1.smithi156.stdout:0/990: chown d2/d7/dd/d29/d4b/dc0/df2/fce 7050 1 2023-12-16T05:56:50.133 INFO:tasks.workunit.client.1.smithi156.stdout:0/991: creat d2/d7/dd/d2d/d5e/d110/dbc/dd2/f134 x:0 0 0 2023-12-16T05:56:50.135 INFO:tasks.workunit.client.1.smithi156.stdout:0/992: rename d2/d7/dd/d29/d38/d51/d52/fbf to d2/d7/da8/f135 0 2023-12-16T05:56:50.135 INFO:tasks.workunit.client.1.smithi156.stdout:4/878: dwrite d9/fa3 [0,4194304] 0 2023-12-16T05:56:50.139 INFO:tasks.workunit.client.1.smithi156.stdout:4/879: creat d9/f129 x:0 0 0 2023-12-16T05:56:50.142 INFO:tasks.workunit.client.1.smithi156.stdout:0/993: mkdir d2/d7/dd/d29/d38/d136 0 2023-12-16T05:56:50.146 INFO:tasks.workunit.client.1.smithi156.stdout:4/880: dread d9/d2c/d48/dae/f6d [0,4194304] 0 2023-12-16T05:56:50.147 INFO:tasks.workunit.client.1.smithi156.stdout:4/881: mkdir d9/d2c/dbf/dfa/d7d/d12a 0 2023-12-16T05:56:50.149 INFO:tasks.workunit.client.1.smithi156.stdout:4/882: rename d9/f129 to d9/d2c/d7a/dd4/df0/f12b 0 2023-12-16T05:56:50.159 INFO:tasks.workunit.client.1.smithi156.stdout:4/883: dread d9/f15 [0,4194304] 0 2023-12-16T05:56:50.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:50 smithi156 ceph-mon[121001]: pgmap v21: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 166 MiB/s rd, 348 MiB/s wr, 528 op/s 2023-12-16T05:56:50.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:50 smithi155 ceph-mon[112451]: pgmap v21: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 166 MiB/s rd, 348 MiB/s wr, 528 op/s 2023-12-16T05:56:50.599 INFO:tasks.workunit.client.1.smithi156.stdout:8/778: sync 2023-12-16T05:56:50.599 INFO:tasks.workunit.client.1.smithi156.stdout:8/779: readlink d3/d7/d27/d46/d84/d85/d9b/lcc 0 2023-12-16T05:56:50.599 INFO:tasks.workunit.client.1.smithi156.stdout:8/780: dread - d3/d12/d16/db4/de9/ffd zero size 2023-12-16T05:56:50.600 INFO:tasks.workunit.client.1.smithi156.stdout:8/781: rename d3/d7/f31 to d3/d7/d62/dc4/f101 0 2023-12-16T05:56:50.603 INFO:tasks.workunit.client.1.smithi156.stdout:8/782: dread d3/d7/d66/f71 [0,4194304] 0 2023-12-16T05:56:50.610 INFO:tasks.workunit.client.1.smithi156.stdout:8/783: dread d3/d7a/fab [0,4194304] 0 2023-12-16T05:56:50.610 INFO:tasks.workunit.client.1.smithi156.stdout:8/784: fdatasync d3/d12/d74/fac 0 2023-12-16T05:56:50.623 INFO:tasks.workunit.client.1.smithi156.stdout:8/785: dwrite d3/d7a/d7d/fc7 [0,4194304] 0 2023-12-16T05:56:50.624 INFO:tasks.workunit.client.1.smithi156.stdout:8/786: write d3/d7a/d7d/dae/f19 [2753924,67143] 0 2023-12-16T05:56:50.626 INFO:tasks.workunit.client.1.smithi156.stdout:8/787: rename d3/d7/d27/d46/d84/ldc to d3/d7/d27/d46/d6e/d3c/dec/l102 0 2023-12-16T05:56:50.627 INFO:tasks.workunit.client.1.smithi156.stdout:8/788: creat d3/d7/d27/d46/d84/d85/d9b/f103 x:0 0 0 2023-12-16T05:56:50.633 INFO:tasks.workunit.client.1.smithi156.stdout:8/789: dread d3/d7/d27/d46/f4e [0,4194304] 0 2023-12-16T05:56:50.633 INFO:tasks.workunit.client.1.smithi156.stdout:8/790: getdents d3/d7a/d7d 0 2023-12-16T05:56:50.634 INFO:tasks.workunit.client.1.smithi156.stdout:8/791: symlink d3/d7a/d7d/dae/d94/l104 0 2023-12-16T05:56:50.634 INFO:tasks.workunit.client.1.smithi156.stdout:8/792: dread - d3/d7a/d7d/dae/d94/fdd zero size 2023-12-16T05:56:50.654 INFO:tasks.workunit.client.1.smithi156.stdout:8/793: dwrite d3/d12/fda [0,4194304] 0 2023-12-16T05:56:50.655 INFO:tasks.workunit.client.1.smithi156.stdout:8/794: write d3/d6/f36 [1881585,88923] 0 2023-12-16T05:56:50.655 INFO:tasks.workunit.client.1.smithi156.stdout:8/795: creat d3/d7/d66/d76/f105 x:0 0 0 2023-12-16T05:56:50.656 INFO:tasks.workunit.client.1.smithi156.stdout:8/796: mkdir d3/d7/d62/d106 0 2023-12-16T05:56:50.656 INFO:tasks.workunit.client.1.smithi156.stdout:8/797: chown d3/d7/d27/d46/d84/d85/lce 0 1 2023-12-16T05:56:50.657 INFO:tasks.workunit.client.1.smithi156.stdout:8/798: creat d3/d7/d27/d46/d84/f107 x:0 0 0 2023-12-16T05:56:50.657 INFO:tasks.workunit.client.1.smithi156.stdout:8/799: chown d3/d6/d83 3 1 2023-12-16T05:56:50.658 INFO:tasks.workunit.client.1.smithi156.stdout:8/800: unlink d3/d7a/c9f 0 2023-12-16T05:56:50.658 INFO:tasks.workunit.client.1.smithi156.stdout:8/801: write d3/d7/d27/d46/d6e/fc9 [712703,97189] 0 2023-12-16T05:56:50.659 INFO:tasks.workunit.client.1.smithi156.stdout:8/802: write d3/d12/d95/ff8 [847824,89809] 0 2023-12-16T05:56:50.659 INFO:tasks.workunit.client.1.smithi156.stdout:8/803: unlink d3/f29 0 2023-12-16T05:56:50.660 INFO:tasks.workunit.client.1.smithi156.stdout:8/804: mknod d3/d7/d27/d46/d84/d85/d9b/de5/df9/c108 0 2023-12-16T05:56:50.661 INFO:tasks.workunit.client.1.smithi156.stdout:8/805: chown d3/d7/d27/d46/d84/d85/d9b/de5/df9 37 1 2023-12-16T05:56:50.661 INFO:tasks.workunit.client.1.smithi156.stdout:8/806: truncate d3/d7a/fa4 5043742 0 2023-12-16T05:56:50.661 INFO:tasks.workunit.client.1.smithi156.stdout:8/807: rename d3/d7a/d7d/faf to d3/d7/d62/dde/f109 0 2023-12-16T05:56:50.662 INFO:tasks.workunit.client.1.smithi156.stdout:8/808: stat d3/d7a/d7d/dae/d94/la1 0 2023-12-16T05:56:50.668 INFO:tasks.workunit.client.1.smithi156.stdout:8/809: getdents d3/d7a/d7d 0 2023-12-16T05:56:50.668 INFO:tasks.workunit.client.1.smithi156.stdout:8/810: fdatasync d3/d7a/d7d/dae/d94/fdd 0 2023-12-16T05:56:50.669 INFO:tasks.workunit.client.1.smithi156.stdout:8/811: mknod d3/d7/d27/d46/c10a 0 2023-12-16T05:56:50.682 INFO:tasks.workunit.client.1.smithi156.stdout:8/812: dwrite d3/f5a [0,4194304] 0 2023-12-16T05:56:50.685 INFO:tasks.workunit.client.1.smithi156.stdout:8/813: creat d3/d7/d27/d46/d84/d85/d9b/de5/df9/f10b x:0 0 0 2023-12-16T05:56:50.685 INFO:tasks.workunit.client.1.smithi156.stdout:8/814: readlink d3/d7a/d7d/dae/d94/la1 0 2023-12-16T05:56:50.686 INFO:tasks.workunit.client.1.smithi156.stdout:8/815: creat d3/d7/d27/d46/d6e/d3b/d77/f10c x:0 0 0 2023-12-16T05:56:50.687 INFO:tasks.workunit.client.1.smithi156.stdout:8/816: write d3/d7/d62/f9d [2314664,13651] 0 2023-12-16T05:56:50.690 INFO:tasks.workunit.client.1.smithi156.stdout:8/817: creat d3/d7/d27/d46/d6e/d3c/f10d x:0 0 0 2023-12-16T05:56:50.691 INFO:tasks.workunit.client.1.smithi156.stdout:8/818: mknod d3/d7/d27/d46/d6e/d3c/dec/c10e 0 2023-12-16T05:56:50.691 INFO:tasks.workunit.client.1.smithi156.stdout:8/819: fsync d3/d7a/d7d/dae/f57 0 2023-12-16T05:56:50.692 INFO:tasks.workunit.client.1.smithi156.stdout:9/885: sync 2023-12-16T05:56:50.693 INFO:tasks.workunit.client.1.smithi156.stdout:8/820: mkdir d3/d12/d16/d54/d10f 0 2023-12-16T05:56:50.695 INFO:tasks.workunit.client.1.smithi156.stdout:9/886: mkdir d6/d19/d25/d3a/d80/dc0/de9/d129 0 2023-12-16T05:56:50.697 INFO:tasks.workunit.client.1.smithi156.stdout:8/821: rename d3/d7/d27/d46/d6e/d3c/dec/c10e to d3/d7/d27/d46/d6e/d3b/d77/c110 0 2023-12-16T05:56:50.697 INFO:tasks.workunit.client.1.smithi156.stdout:8/822: chown d3/d7/d62/ld9 191949667 1 2023-12-16T05:56:50.697 INFO:tasks.workunit.client.1.smithi156.stdout:8/823: write d3/d7/d27/f59 [865362,41750] 0 2023-12-16T05:56:50.699 INFO:tasks.workunit.client.1.smithi156.stdout:8/824: dread d3/d6/f8a [0,4194304] 0 2023-12-16T05:56:50.704 INFO:tasks.workunit.client.1.smithi156.stdout:9/887: dread d6/d19/d30/fd6 [0,4194304] 0 2023-12-16T05:56:50.721 INFO:tasks.workunit.client.1.smithi156.stdout:9/888: dwrite d6/da3/db0/fcc [0,4194304] 0 2023-12-16T05:56:50.721 INFO:tasks.workunit.client.1.smithi156.stdout:9/889: chown d6/d2e/d8a/da5/fef 3375 1 2023-12-16T05:56:50.723 INFO:tasks.workunit.client.1.smithi156.stdout:8/825: dwrite d3/d7/d66/d76/f105 [0,4194304] 0 2023-12-16T05:56:50.723 INFO:tasks.workunit.client.1.smithi156.stdout:9/890: creat d6/d19/f12a x:0 0 0 2023-12-16T05:56:50.727 INFO:tasks.workunit.client.1.smithi156.stdout:3/884: sync 2023-12-16T05:56:50.727 INFO:tasks.workunit.client.1.smithi156.stdout:0/994: sync 2023-12-16T05:56:50.727 INFO:tasks.workunit.client.1.smithi156.stdout:6/977: sync 2023-12-16T05:56:50.727 INFO:tasks.workunit.client.1.smithi156.stdout:1/777: sync 2023-12-16T05:56:50.727 INFO:tasks.workunit.client.1.smithi156.stdout:2/879: sync 2023-12-16T05:56:50.727 INFO:tasks.workunit.client.1.smithi156.stdout:3/885: write dc/f7c [6075409,70128] 0 2023-12-16T05:56:50.728 INFO:tasks.workunit.client.1.smithi156.stdout:1/778: fdatasync d3/d17/d1c/da5/feb 0 2023-12-16T05:56:50.728 INFO:tasks.workunit.client.1.smithi156.stdout:4/884: sync 2023-12-16T05:56:50.730 INFO:tasks.workunit.client.1.smithi156.stdout:2/880: mkdir d9/dd/d17/d33/d47/ddd/d115 0 2023-12-16T05:56:50.732 INFO:tasks.workunit.client.1.smithi156.stdout:3/886: rename dc/d10/d3d/l135 to dc/d10/d1d/l13f 0 2023-12-16T05:56:50.734 INFO:tasks.workunit.client.1.smithi156.stdout:1/779: mkdir d3/d17/d4d/dc2/d109 0 2023-12-16T05:56:50.734 INFO:tasks.workunit.client.1.smithi156.stdout:1/780: fdatasync d3/d3a/da9/fc0 0 2023-12-16T05:56:50.736 INFO:tasks.workunit.client.1.smithi156.stdout:4/885: mknod d9/d2c/dbf/dfa/d7d/d82/c12c 0 2023-12-16T05:56:50.736 INFO:tasks.workunit.client.1.smithi156.stdout:4/886: write d9/d2b/d98/fb3 [1468360,18644] 0 2023-12-16T05:56:50.736 INFO:tasks.workunit.client.1.smithi156.stdout:4/887: stat d9/d2b/d98/dcd/fe8 0 2023-12-16T05:56:50.738 INFO:tasks.workunit.client.1.smithi156.stdout:2/881: write d9/dd/d17/d33/d78/d39/f79 [672771,88810] 0 2023-12-16T05:56:50.739 INFO:tasks.workunit.client.1.smithi156.stdout:1/781: rename d3/d17/d2d/la7 to d3/d17/d4d/dc2/l10a 0 2023-12-16T05:56:50.739 INFO:tasks.workunit.client.1.smithi156.stdout:1/782: chown d3/d17/d4d/cdb 23 1 2023-12-16T05:56:50.740 INFO:tasks.workunit.client.1.smithi156.stdout:1/783: write d3/d17/daa/f104 [662794,52371] 0 2023-12-16T05:56:50.740 INFO:tasks.workunit.client.1.smithi156.stdout:1/784: chown d3/d17/d4d/dc2/d4f/fd3 105419624 1 2023-12-16T05:56:50.741 INFO:tasks.workunit.client.1.smithi156.stdout:2/882: mknod d9/dd/d17/d33/d47/ddd/df5/d109/da6/d80/c116 0 2023-12-16T05:56:50.741 INFO:tasks.workunit.client.1.smithi156.stdout:2/883: fsync d9/d56/d5f/f9f 0 2023-12-16T05:56:50.741 INFO:tasks.workunit.client.1.smithi156.stdout:2/884: stat d9/d12/f18 0 2023-12-16T05:56:50.742 INFO:tasks.workunit.client.1.smithi156.stdout:4/888: rename d9/d2c/d7a/dd4/df0/l111 to d9/d2c/l12d 0 2023-12-16T05:56:50.743 INFO:tasks.workunit.client.1.smithi156.stdout:1/785: write d3/d17/d4d/f9d [6605413,49555] 0 2023-12-16T05:56:50.743 INFO:tasks.workunit.client.1.smithi156.stdout:2/885: mknod d9/d68/daa/c117 0 2023-12-16T05:56:50.746 INFO:tasks.workunit.client.1.smithi156.stdout:1/786: rename d3/d17/d2d/fea to d3/d17/d1c/d22/d57/f10b 0 2023-12-16T05:56:50.747 INFO:tasks.workunit.client.1.smithi156.stdout:1/787: creat d3/d17/d1c/d22/d57/f10c x:0 0 0 2023-12-16T05:56:50.748 INFO:tasks.workunit.client.1.smithi156.stdout:1/788: write d3/d17/d1c/d22/d57/d61/dc1/fe3 [3165766,30308] 0 2023-12-16T05:56:50.749 INFO:tasks.workunit.client.1.smithi156.stdout:1/789: truncate d3/d17/d1c/d22/da4/fad 3842294 0 2023-12-16T05:56:50.751 INFO:tasks.workunit.client.1.smithi156.stdout:1/790: rmdir d3/d17/d1c/d22/da4 39 2023-12-16T05:56:50.751 INFO:tasks.workunit.client.1.smithi156.stdout:9/891: dwrite d6/d19/f2a [0,4194304] 0 2023-12-16T05:56:50.751 INFO:tasks.workunit.client.1.smithi156.stdout:9/892: fdatasync d6/d19/d30/d5b/d9a/f9f 0 2023-12-16T05:56:50.755 INFO:tasks.workunit.client.1.smithi156.stdout:0/995: dread d2/d47/f80 [0,4194304] 0 2023-12-16T05:56:50.755 INFO:tasks.workunit.client.1.smithi156.stdout:2/886: dread d9/dd/d17/d33/d47/ddd/df5/d109/dad/fc3 [0,4194304] 0 2023-12-16T05:56:50.759 INFO:tasks.workunit.client.1.smithi156.stdout:2/887: mkdir d9/dd/d17/d33/d78/d39/d60/d118 0 2023-12-16T05:56:50.759 INFO:tasks.workunit.client.1.smithi156.stdout:0/996: symlink d2/d7/dd/d2d/d5e/l137 0 2023-12-16T05:56:50.764 INFO:tasks.workunit.client.1.smithi156.stdout:4/889: getdents d9/d2c/dbf/dfa/d7d/d82 0 2023-12-16T05:56:50.768 INFO:tasks.workunit.client.1.smithi156.stdout:4/890: unlink d9/d2c/d48/f84 0 2023-12-16T05:56:50.768 INFO:tasks.workunit.client.1.smithi156.stdout:3/887: dwrite dc/d10/d1d/d90/f11e [0,4194304] 0 2023-12-16T05:56:50.771 INFO:tasks.workunit.client.1.smithi156.stdout:4/891: mknod d9/d2b/d35/dd3/c12e 0 2023-12-16T05:56:50.775 INFO:tasks.workunit.client.1.smithi156.stdout:8/826: dwrite d3/d12/f25 [0,4194304] 0 2023-12-16T05:56:50.776 INFO:tasks.workunit.client.1.smithi156.stdout:4/892: mkdir d9/d43/d12f 0 2023-12-16T05:56:50.777 INFO:tasks.workunit.client.1.smithi156.stdout:8/827: getdents d3/d7/d62/dca 0 2023-12-16T05:56:50.778 INFO:tasks.workunit.client.1.smithi156.stdout:9/893: dwrite d6/d19/d25/d3a/d80/fce [0,4194304] 0 2023-12-16T05:56:50.778 INFO:tasks.workunit.client.1.smithi156.stdout:9/894: fdatasync d6/d19/d30/d48/fa4 0 2023-12-16T05:56:50.778 INFO:tasks.workunit.client.1.smithi156.stdout:9/895: write d6/f46 [1201288,12099] 0 2023-12-16T05:56:50.779 INFO:tasks.workunit.client.1.smithi156.stdout:4/893: creat d9/d43/d12f/f130 x:0 0 0 2023-12-16T05:56:50.779 INFO:tasks.workunit.client.1.smithi156.stdout:9/896: read d6/d19/d30/d48/d87/d65/fa8 [4184066,130379] 0 2023-12-16T05:56:50.779 INFO:tasks.workunit.client.1.smithi156.stdout:6/978: dwrite d9/d13/d2f/d51/d69/f71 [0,4194304] 0 2023-12-16T05:56:50.780 INFO:tasks.workunit.client.1.smithi156.stdout:8/828: mknod d3/c111 0 2023-12-16T05:56:50.783 INFO:tasks.workunit.client.1.smithi156.stdout:9/897: rename d6/d19/d30/d48/d87/l10b to d6/d19/d25/d3a/d88/d8b/l12b 0 2023-12-16T05:56:50.783 INFO:tasks.workunit.client.1.smithi156.stdout:1/791: dwrite d3/fae [0,4194304] 0 2023-12-16T05:56:50.783 INFO:tasks.workunit.client.1.smithi156.stdout:9/898: write f3 [4773420,9819] 0 2023-12-16T05:56:50.784 INFO:tasks.workunit.client.1.smithi156.stdout:9/899: read d6/d19/d25/d3a/d80/f96 [83566,16053] 0 2023-12-16T05:56:50.784 INFO:tasks.workunit.client.1.smithi156.stdout:9/900: dread - d6/d19/d30/d48/d87/f99 zero size 2023-12-16T05:56:50.784 INFO:tasks.workunit.client.1.smithi156.stdout:8/829: creat d3/d6/d83/f112 x:0 0 0 2023-12-16T05:56:50.787 INFO:tasks.workunit.client.1.smithi156.stdout:6/979: rename d9/d13/d2f/d51/d6b/c7a to d9/d1c/d50/dbf/dc0/d126/c142 0 2023-12-16T05:56:50.787 INFO:tasks.workunit.client.1.smithi156.stdout:9/901: rename d6/d19/d25/d3a/d88/d8b to d6/d19/d25/d3a/d88/d8b/dac/dc9/d12c 22 2023-12-16T05:56:50.788 INFO:tasks.workunit.client.1.smithi156.stdout:9/902: read d6/d19/d25/d3a/d80/fce [1401582,105725] 0 2023-12-16T05:56:50.789 INFO:tasks.workunit.client.1.smithi156.stdout:8/830: link d3/d12/d74/l8b d3/d7/d27/d46/d6e/d3c/dec/def/l113 0 2023-12-16T05:56:50.790 INFO:tasks.workunit.client.1.smithi156.stdout:6/980: rmdir d9/d13/d3e/d5f/d6e 39 2023-12-16T05:56:50.790 INFO:tasks.workunit.client.1.smithi156.stdout:6/981: write d9/fc8 [825142,70525] 0 2023-12-16T05:56:50.791 INFO:tasks.workunit.client.1.smithi156.stdout:8/831: creat d3/d6/d83/f114 x:0 0 0 2023-12-16T05:56:50.793 INFO:tasks.workunit.client.1.smithi156.stdout:6/982: mknod d9/d13/d2f/d36/c143 0 2023-12-16T05:56:50.793 INFO:tasks.workunit.client.1.smithi156.stdout:6/983: write d9/d13/d2f/d51/d69/d99/db9/d110/d8e/d9a/dce/df0/f132 [537824,48577] 0 2023-12-16T05:56:50.793 INFO:tasks.workunit.client.1.smithi156.stdout:6/984: read - d9/d13/f120 zero size 2023-12-16T05:56:50.794 INFO:tasks.workunit.client.1.smithi156.stdout:8/832: mknod d3/d7/d27/d46/d84/d85/c115 0 2023-12-16T05:56:50.795 INFO:tasks.workunit.client.1.smithi156.stdout:6/985: mkdir d9/d13/d2f/d51/d144 0 2023-12-16T05:56:50.805 INFO:tasks.workunit.client.1.smithi156.stdout:6/986: dread d9/f6d [0,4194304] 0 2023-12-16T05:56:50.805 INFO:tasks.workunit.client.1.smithi156.stdout:6/987: fsync d9/d1c/d50/dbf/dc0/f115 0 2023-12-16T05:56:50.805 INFO:tasks.workunit.client.1.smithi156.stdout:6/988: chown d9/d1c/cfb 4 1 2023-12-16T05:56:50.806 INFO:tasks.workunit.client.1.smithi156.stdout:6/989: read d9/d13/d2f/d51/f90 [2056742,113829] 0 2023-12-16T05:56:50.808 INFO:tasks.workunit.client.1.smithi156.stdout:0/997: dwrite d2/d7/dd/d2d/d5e/d110/dbc/dc2/fe4 [0,4194304] 0 2023-12-16T05:56:50.810 INFO:tasks.workunit.client.1.smithi156.stdout:0/998: mknod d2/d7/dd/d2d/d5e/d110/c138 0 2023-12-16T05:56:50.811 INFO:tasks.workunit.client.1.smithi156.stdout:1/792: dwrite d3/d17/f52 [0,4194304] 0 2023-12-16T05:56:50.811 INFO:tasks.workunit.client.1.smithi156.stdout:2/888: dwrite d9/dd/d17/d33/d47/f6d [0,4194304] 0 2023-12-16T05:56:50.812 INFO:tasks.workunit.client.1.smithi156.stdout:3/888: dwrite dc/df/d34/d62/d75/fc5 [0,4194304] 0 2023-12-16T05:56:50.813 INFO:tasks.workunit.client.1.smithi156.stdout:3/889: chown dc/df/d66/fea 3 1 2023-12-16T05:56:50.813 INFO:tasks.workunit.client.1.smithi156.stdout:3/890: readlink dc/d56/d67/dbe/dd9/lde 0 2023-12-16T05:56:50.813 INFO:tasks.workunit.client.1.smithi156.stdout:0/999: creat d2/d7/dd/d29/d4b/dc0/f139 x:0 0 0 2023-12-16T05:56:50.815 INFO:tasks.workunit.client.1.smithi156.stdout:1/793: creat d3/d17/d1c/d22/d57/dbc/dd9/f10d x:0 0 0 2023-12-16T05:56:50.816 INFO:tasks.workunit.client.1.smithi156.stdout:8/833: dwrite d3/d12/f25 [0,4194304] 0 2023-12-16T05:56:50.818 INFO:tasks.workunit.client.1.smithi156.stdout:2/889: getdents d9/d12/dc2 0 2023-12-16T05:56:50.820 INFO:tasks.workunit.client.1.smithi156.stdout:9/903: dread f3 [0,4194304] 0 2023-12-16T05:56:50.823 INFO:tasks.workunit.client.1.smithi156.stdout:3/891: truncate dc/df/fcd 3013945 0 2023-12-16T05:56:50.823 INFO:tasks.workunit.client.1.smithi156.stdout:2/890: write d9/d12/dc2/fde [6688495,7808] 0 2023-12-16T05:56:50.823 INFO:tasks.workunit.client.1.smithi156.stdout:2/891: write d9/d56/d5f/f9f [447503,34350] 0 2023-12-16T05:56:50.825 INFO:tasks.workunit.client.1.smithi156.stdout:1/794: unlink d3/d1b/d8b/f93 0 2023-12-16T05:56:50.827 INFO:tasks.workunit.client.1.smithi156.stdout:1/795: dread d3/d17/d1c/d22/d57/f68 [0,4194304] 0 2023-12-16T05:56:50.827 INFO:tasks.workunit.client.1.smithi156.stdout:8/834: getdents d3/d7/d66 0 2023-12-16T05:56:50.829 INFO:tasks.workunit.client.1.smithi156.stdout:9/904: truncate d6/d19/f24 7588982 0 2023-12-16T05:56:50.831 INFO:tasks.workunit.client.1.smithi156.stdout:3/892: creat dc/d10/db4/d11d/f140 x:0 0 0 2023-12-16T05:56:50.834 INFO:tasks.workunit.client.1.smithi156.stdout:8/835: dread d3/f5a [0,4194304] 0 2023-12-16T05:56:50.835 INFO:tasks.workunit.client.1.smithi156.stdout:1/796: unlink d3/d17/d4d/ff8 0 2023-12-16T05:56:50.835 INFO:tasks.workunit.client.1.smithi156.stdout:1/797: fdatasync d3/d1b/f8d 0 2023-12-16T05:56:50.837 INFO:tasks.workunit.client.1.smithi156.stdout:9/905: link d6/d2e/dad/c11b d6/d19/d30/d5b/d9a/c12d 0 2023-12-16T05:56:50.837 INFO:tasks.workunit.client.1.smithi156.stdout:9/906: chown d6/d19/d30/fde 763165540 1 2023-12-16T05:56:50.838 INFO:tasks.workunit.client.1.smithi156.stdout:6/990: rmdir d9/d1c/d50/dbf/dc0/d126 39 2023-12-16T05:56:50.841 INFO:tasks.workunit.client.1.smithi156.stdout:3/893: truncate dc/d10/d3d/db5/fbf 559416 0 2023-12-16T05:56:50.841 INFO:tasks.workunit.client.1.smithi156.stdout:3/894: chown dc/df/d34/d62/laf 19702507 1 2023-12-16T05:56:50.842 INFO:tasks.workunit.client.1.smithi156.stdout:2/892: symlink d9/dd/d17/d33/d78/d74/dd0/l119 0 2023-12-16T05:56:50.843 INFO:tasks.workunit.client.1.smithi156.stdout:8/836: dread d3/d7/d66/fbd [0,4194304] 0 2023-12-16T05:56:50.845 INFO:tasks.workunit.client.1.smithi156.stdout:1/798: rename d3/d17/d4d/dc2/d4f/d75/fb7 to d3/d17/d4d/f10e 0 2023-12-16T05:56:50.847 INFO:tasks.workunit.client.1.smithi156.stdout:9/907: creat d6/d2e/d8a/f12e x:0 0 0 2023-12-16T05:56:50.847 INFO:tasks.workunit.client.1.smithi156.stdout:9/908: write d6/d19/d30/d48/d87/f9b [1341023,108632] 0 2023-12-16T05:56:50.849 INFO:tasks.workunit.client.1.smithi156.stdout:6/991: creat d9/d13/d2f/d51/d69/d99/db9/d110/d8e/d9a/dce/f145 x:0 0 0 2023-12-16T05:56:50.850 INFO:tasks.workunit.client.1.smithi156.stdout:3/895: mkdir dc/d10/d3d/d4e/d136/d141 0 2023-12-16T05:56:50.854 INFO:tasks.workunit.client.1.smithi156.stdout:2/893: mkdir d9/dd/d17/d33/d11a 0 2023-12-16T05:56:50.858 INFO:tasks.workunit.client.1.smithi156.stdout:8/837: mknod d3/d7/d66/d76/c116 0 2023-12-16T05:56:50.862 INFO:tasks.workunit.client.1.smithi156.stdout:6/992: creat d9/d13/d2f/d51/d69/d99/db9/d110/d8e/f146 x:0 0 0 2023-12-16T05:56:50.862 INFO:tasks.workunit.client.1.smithi156.stdout:6/993: chown d9/d13/l58 1816701766 1 2023-12-16T05:56:50.865 INFO:tasks.workunit.client.1.smithi156.stdout:9/909: dwrite d6/da3/db0/f11c [0,4194304] 0 2023-12-16T05:56:50.871 INFO:tasks.workunit.client.1.smithi156.stdout:8/838: mknod d3/d12/c117 0 2023-12-16T05:56:50.871 INFO:tasks.workunit.client.1.smithi156.stdout:8/839: fsync d3/d7/d27/d46/d6e/f2a 0 2023-12-16T05:56:50.873 INFO:tasks.workunit.client.1.smithi156.stdout:1/799: dwrite d3/d17/d4d/dc2/f5c [0,4194304] 0 2023-12-16T05:56:50.875 INFO:tasks.workunit.client.1.smithi156.stdout:6/994: rename d9/d13/f73 to d9/d1c/f147 0 2023-12-16T05:56:50.878 INFO:tasks.workunit.client.1.smithi156.stdout:6/995: dread d9/d13/d3e/d5f/f75 [0,4194304] 0 2023-12-16T05:56:50.879 INFO:tasks.workunit.client.1.smithi156.stdout:6/996: write d9/d13/d2f/d51/d82/f11e [8532699,52125] 0 2023-12-16T05:56:50.879 INFO:tasks.workunit.client.1.smithi156.stdout:6/997: fdatasync d9/d13/d2f/d51/d82/fc2 0 2023-12-16T05:56:50.879 INFO:tasks.workunit.client.1.smithi156.stdout:6/998: rename d9/d13/d2f/d51/d69/d99/db9 to d9/d13/d2f/d51/d69/d99/db9/d110/d8e/d148 22 2023-12-16T05:56:50.879 INFO:tasks.workunit.client.1.smithi156.stdout:1/800: truncate d3/d17/d4d/dc2/d4f/f65 799049 0 2023-12-16T05:56:50.879 INFO:tasks.workunit.client.1.smithi156.stdout:1/801: write d3/d17/d1c/d22/d57/f105 [284432,72719] 0 2023-12-16T05:56:50.882 INFO:tasks.workunit.client.1.smithi156.stdout:9/910: mkdir d6/da3/db0/d12f 0 2023-12-16T05:56:50.882 INFO:tasks.workunit.client.1.smithi156.stdout:2/894: dwrite d9/f1f [0,4194304] 0 2023-12-16T05:56:50.882 INFO:tasks.workunit.client.1.smithi156.stdout:2/895: dread - d9/dd/d17/d33/d47/ddd/df5/d109/dad/fdf zero size 2023-12-16T05:56:50.884 INFO:tasks.workunit.client.1.smithi156.stdout:3/896: dwrite dc/d10/d1d/d4b/f51 [0,4194304] 0 2023-12-16T05:56:50.884 INFO:tasks.workunit.client.1.smithi156.stdout:3/897: write dc/d10/dc6/f115 [796900,124179] 0 2023-12-16T05:56:50.886 INFO:tasks.workunit.client.1.smithi156.stdout:6/999: mkdir d9/d13/d2f/d51/d9b/de2/d149 0 2023-12-16T05:56:50.892 INFO:tasks.workunit.client.1.smithi156.stdout:3/898: creat dc/df/d34/f142 x:0 0 0 2023-12-16T05:56:50.896 INFO:tasks.workunit.client.1.smithi156.stdout:3/899: link dc/df/d34/d62/l9f dc/d56/d67/dbe/dd9/l143 0 2023-12-16T05:56:50.902 INFO:tasks.workunit.client.1.smithi156.stdout:1/802: dwrite d3/d17/fd7 [0,4194304] 0 2023-12-16T05:56:50.906 INFO:tasks.workunit.client.1.smithi156.stdout:1/803: dread d3/d17/f60 [0,4194304] 0 2023-12-16T05:56:50.907 INFO:tasks.workunit.client.1.smithi156.stdout:9/911: dwrite d6/d19/d25/d3a/d80/fce [0,4194304] 0 2023-12-16T05:56:50.908 INFO:tasks.workunit.client.1.smithi156.stdout:9/912: stat d6/d19/d25/d10d 0 2023-12-16T05:56:50.908 INFO:tasks.workunit.client.1.smithi156.stdout:1/804: mknod d3/dd0/c10f 0 2023-12-16T05:56:50.908 INFO:tasks.workunit.client.1.smithi156.stdout:8/840: dwrite d3/d7a/d7d/dae/f19 [0,4194304] 0 2023-12-16T05:56:50.908 INFO:tasks.workunit.client.1.smithi156.stdout:2/896: dwrite d9/dd/d17/fd7 [0,4194304] 0 2023-12-16T05:56:50.909 INFO:tasks.workunit.client.1.smithi156.stdout:2/897: readlink d9/dd/d17/d33/d78/d39/l50 0 2023-12-16T05:56:50.913 INFO:tasks.workunit.client.1.smithi156.stdout:9/913: mknod d6/d19/d25/c130 0 2023-12-16T05:56:50.914 INFO:tasks.workunit.client.1.smithi156.stdout:9/914: read d6/d19/d25/fbf [63037,83437] 0 2023-12-16T05:56:50.915 INFO:tasks.workunit.client.1.smithi156.stdout:3/900: dwrite dc/d10/d1d/fa8 [4194304,4194304] 0 2023-12-16T05:56:50.915 INFO:tasks.workunit.client.1.smithi156.stdout:3/901: fdatasync dc/d56/d67/dbe/dd9/f111 0 2023-12-16T05:56:50.916 INFO:tasks.workunit.client.1.smithi156.stdout:2/898: creat d9/d68/daa/d83/dfd/f11b x:0 0 0 2023-12-16T05:56:50.934 INFO:tasks.workunit.client.1.smithi156.stdout:1/805: dwrite d3/d17/d1c/d22/d57/d61/dc1/f58 [0,4194304] 0 2023-12-16T05:56:50.940 INFO:tasks.workunit.client.1.smithi156.stdout:2/899: mknod d9/d68/daa/d83/da1/d96/c11c 0 2023-12-16T05:56:50.941 INFO:tasks.workunit.client.1.smithi156.stdout:2/900: write d9/f5c [862836,12536] 0 2023-12-16T05:56:50.942 INFO:tasks.workunit.client.1.smithi156.stdout:3/902: mknod dc/d56/c144 0 2023-12-16T05:56:50.942 INFO:tasks.workunit.client.1.smithi156.stdout:3/903: stat dc/d10/d3d/d4e/c123 0 2023-12-16T05:56:50.942 INFO:tasks.workunit.client.1.smithi156.stdout:3/904: chown dc/d10/l35 12813882 1 2023-12-16T05:56:50.942 INFO:tasks.workunit.client.1.smithi156.stdout:3/905: chown dc/d10/d3d/df8/f106 0 1 2023-12-16T05:56:50.952 INFO:tasks.workunit.client.1.smithi156.stdout:3/906: mknod dc/d10/d3d/d4e/d136/d141/c145 0 2023-12-16T05:56:50.953 INFO:tasks.workunit.client.1.smithi156.stdout:3/907: chown dc/d10/d3d/f91 5410 1 2023-12-16T05:56:50.954 INFO:tasks.workunit.client.1.smithi156.stdout:1/806: dwrite d3/d17/f48 [4194304,4194304] 0 2023-12-16T05:56:50.956 INFO:tasks.workunit.client.1.smithi156.stdout:1/807: mkdir d3/d17/d4d/dc2/dd8/d110 0 2023-12-16T05:56:50.956 INFO:tasks.workunit.client.1.smithi156.stdout:1/808: fdatasync d3/d17/d1c/fa0 0 2023-12-16T05:56:50.968 INFO:tasks.workunit.client.1.smithi156.stdout:3/908: dread dc/df/d34/d62/d75/fa9 [0,4194304] 0 2023-12-16T05:56:50.968 INFO:tasks.workunit.client.1.smithi156.stdout:3/909: chown dc/f7c 12 1 2023-12-16T05:56:50.974 INFO:tasks.workunit.client.1.smithi156.stdout:3/910: dread dc/df/d34/f63 [4194304,4194304] 0 2023-12-16T05:56:50.975 INFO:tasks.workunit.client.1.smithi156.stdout:3/911: mkdir dc/d10/d1d/d90/d146 0 2023-12-16T05:56:50.976 INFO:tasks.workunit.client.1.smithi156.stdout:3/912: readlink dc/d10/l35 0 2023-12-16T05:56:50.976 INFO:tasks.workunit.client.1.smithi156.stdout:3/913: mkdir dc/d56/d67/dbe/dd9/d147 0 2023-12-16T05:56:50.977 INFO:tasks.workunit.client.1.smithi156.stdout:3/914: symlink dc/d56/d69/l148 0 2023-12-16T05:56:50.978 INFO:tasks.workunit.client.1.smithi156.stdout:3/915: creat dc/d56/d67/dbe/df9/f149 x:0 0 0 2023-12-16T05:56:50.979 INFO:tasks.workunit.client.1.smithi156.stdout:3/916: creat dc/d10/d1d/d90/d146/f14a x:0 0 0 2023-12-16T05:56:50.981 INFO:tasks.workunit.client.1.smithi156.stdout:3/917: rename dc/d10/d3d/df8/d11c to dc/d56/d67/dbe/df9/d14b 0 2023-12-16T05:56:51.000 INFO:tasks.workunit.client.1.smithi156.stdout:3/918: write dc/d10/d3d/db5/f117 [236832,17096] 0 2023-12-16T05:56:51.002 INFO:tasks.workunit.client.1.smithi156.stdout:3/919: symlink dc/d10/d1d/db2/l14c 0 2023-12-16T05:56:51.004 INFO:tasks.workunit.client.1.smithi156.stdout:3/920: rename dc/d10/d1d/f5d to dc/d10/d1d/d90/f14d 0 2023-12-16T05:56:51.004 INFO:tasks.workunit.client.1.smithi156.stdout:3/921: stat dc/d10/d1d/d4b/fa7 0 2023-12-16T05:56:51.006 INFO:tasks.workunit.client.1.smithi156.stdout:3/922: rmdir dc/df/d34 39 2023-12-16T05:56:51.006 INFO:tasks.workunit.client.1.smithi156.stdout:3/923: chown dc/d10/l46 3386 1 2023-12-16T05:56:51.006 INFO:tasks.workunit.client.1.smithi156.stdout:3/924: truncate dc/d10/d3d/f91 670558 0 2023-12-16T05:56:51.007 INFO:tasks.workunit.client.1.smithi156.stdout:1/809: dwrite d3/d17/d1c/d22/d57/d61/dc1/fff [0,4194304] 0 2023-12-16T05:56:51.007 INFO:tasks.workunit.client.1.smithi156.stdout:1/810: fsync d3/d17/d1c/d22/f6a 0 2023-12-16T05:56:51.009 INFO:tasks.workunit.client.1.smithi156.stdout:1/811: symlink d3/d17/d1c/d22/l111 0 2023-12-16T05:56:51.009 INFO:tasks.workunit.client.1.smithi156.stdout:1/812: write d3/d17/d1c/fa0 [961634,115001] 0 2023-12-16T05:56:51.010 INFO:tasks.workunit.client.1.smithi156.stdout:1/813: readlink d3/d17/d2d/lf2 0 2023-12-16T05:56:51.011 INFO:tasks.workunit.client.1.smithi156.stdout:9/915: dwrite d6/d19/f1b [4194304,4194304] 0 2023-12-16T05:56:51.011 INFO:tasks.workunit.client.1.smithi156.stdout:9/916: chown d6/d19/d30/l6d 115 1 2023-12-16T05:56:51.013 INFO:tasks.workunit.client.1.smithi156.stdout:9/917: mkdir d6/d19/d25/d3a/d5e/da9/d131 0 2023-12-16T05:56:51.016 INFO:tasks.workunit.client.1.smithi156.stdout:9/918: write d6/d2e/d8a/da5/fef [60787,27759] 0 2023-12-16T05:56:51.017 INFO:tasks.workunit.client.1.smithi156.stdout:3/925: dread fb [0,4194304] 0 2023-12-16T05:56:51.018 INFO:tasks.workunit.client.1.smithi156.stdout:9/919: symlink d6/d19/d30/dae/db7/l132 0 2023-12-16T05:56:51.020 INFO:tasks.workunit.client.1.smithi156.stdout:9/920: creat d6/d19/d25/d3a/d88/d8b/dac/f133 x:0 0 0 2023-12-16T05:56:51.021 INFO:tasks.workunit.client.1.smithi156.stdout:9/921: dread - d6/d19/d25/d3a/d5e/f104 zero size 2023-12-16T05:56:51.021 INFO:tasks.workunit.client.1.smithi156.stdout:9/922: read - d6/d19/f12a zero size 2023-12-16T05:56:51.021 INFO:tasks.workunit.client.1.smithi156.stdout:9/923: write d6/da3/db0/f11e [406893,124062] 0 2023-12-16T05:56:51.024 INFO:tasks.workunit.client.1.smithi156.stdout:1/814: dwrite d3/d17/d1c/d22/f6a [0,4194304] 0 2023-12-16T05:56:51.025 INFO:tasks.workunit.client.1.smithi156.stdout:1/815: write d3/d3a/fe1 [978911,68307] 0 2023-12-16T05:56:51.025 INFO:tasks.workunit.client.1.smithi156.stdout:1/816: chown d3/d17/d2d/f86 290861 1 2023-12-16T05:56:51.027 INFO:tasks.workunit.client.1.smithi156.stdout:1/817: creat d3/d17/d4d/dc2/d4f/f112 x:0 0 0 2023-12-16T05:56:51.027 INFO:tasks.workunit.client.1.smithi156.stdout:1/818: stat d3/d17/daa 0 2023-12-16T05:56:51.027 INFO:tasks.workunit.client.1.smithi156.stdout:1/819: chown d3/d17/d1c/d22/d57/d61/dc1/l97 340992131 1 2023-12-16T05:56:51.027 INFO:tasks.workunit.client.1.smithi156.stdout:1/820: write d3/d17/d1c/d22/d57/f68 [710203,28975] 0 2023-12-16T05:56:51.029 INFO:tasks.workunit.client.1.smithi156.stdout:1/821: write d3/d17/f33 [2005483,51120] 0 2023-12-16T05:56:51.029 INFO:tasks.workunit.client.1.smithi156.stdout:1/822: fsync d3/d17/d2d/f74 0 2023-12-16T05:56:51.036 INFO:tasks.workunit.client.1.smithi156.stdout:1/823: dread d3/d3a/f7a [0,4194304] 0 2023-12-16T05:56:51.038 INFO:tasks.workunit.client.1.smithi156.stdout:1/824: creat d3/d3a/da9/f113 x:0 0 0 2023-12-16T05:56:51.038 INFO:tasks.workunit.client.1.smithi156.stdout:1/825: chown d3/d17/d1c/d22/c4a 48618 1 2023-12-16T05:56:51.038 INFO:tasks.workunit.client.1.smithi156.stdout:1/826: chown d3/d17/d1c/l5b 3206138 1 2023-12-16T05:56:51.038 INFO:tasks.workunit.client.1.smithi156.stdout:1/827: symlink d3/d17/d4d/dc2/dd8/d110/l114 0 2023-12-16T05:56:51.039 INFO:tasks.workunit.client.1.smithi156.stdout:1/828: chown d3/d17/d2d/ff6 65 1 2023-12-16T05:56:51.039 INFO:tasks.workunit.client.1.smithi156.stdout:1/829: mknod d3/d3a/c115 0 2023-12-16T05:56:51.042 INFO:tasks.workunit.client.1.smithi156.stdout:9/924: dwrite d6/d19/d25/d3a/d5e/f68 [0,4194304] 0 2023-12-16T05:56:51.042 INFO:tasks.workunit.client.1.smithi156.stdout:9/925: stat d6/d19/d30/d48/d87/d65 0 2023-12-16T05:56:51.042 INFO:tasks.workunit.client.1.smithi156.stdout:1/830: write d3/d17/d2d/fab [28213,90135] 0 2023-12-16T05:56:51.049 INFO:tasks.workunit.client.1.smithi156.stdout:1/831: link d3/d17/d2d/f86 d3/d17/d1c/d22/d57/d61/dc1/f116 0 2023-12-16T05:56:51.051 INFO:tasks.workunit.client.1.smithi156.stdout:1/832: rmdir d3/d1b/d8b 39 2023-12-16T05:56:51.051 INFO:tasks.workunit.client.1.smithi156.stdout:1/833: write d3/d17/d4d/fbf [356036,130597] 0 2023-12-16T05:56:51.052 INFO:tasks.workunit.client.1.smithi156.stdout:1/834: mkdir d3/d17/d1c/d22/d57/d82/d117 0 2023-12-16T05:56:51.060 INFO:tasks.workunit.client.1.smithi156.stdout:4/894: sync 2023-12-16T05:56:51.062 INFO:tasks.workunit.client.1.smithi156.stdout:4/895: creat d9/d2c/dbf/dfa/d7d/d82/f131 x:0 0 0 2023-12-16T05:56:51.062 INFO:tasks.workunit.client.1.smithi156.stdout:9/926: dwrite d6/d19/d25/fa6 [0,4194304] 0 2023-12-16T05:56:51.065 INFO:tasks.workunit.client.1.smithi156.stdout:4/896: truncate d9/d43/f62 50406 0 2023-12-16T05:56:51.066 INFO:tasks.workunit.client.1.smithi156.stdout:9/927: creat d6/d19/d25/d3a/d80/dc0/dd4/f134 x:0 0 0 2023-12-16T05:56:51.068 INFO:tasks.workunit.client.1.smithi156.stdout:4/897: rmdir d9/d2b/d98/d99 39 2023-12-16T05:56:51.070 INFO:tasks.workunit.client.1.smithi156.stdout:1/835: dwrite d3/d17/fd7 [0,4194304] 0 2023-12-16T05:56:51.074 INFO:tasks.workunit.client.1.smithi156.stdout:1/836: unlink d3/d3a/db1/ff5 0 2023-12-16T05:56:51.076 INFO:tasks.workunit.client.1.smithi156.stdout:1/837: link d3/d17/f48 d3/d17/d1c/d22/d57/f118 0 2023-12-16T05:56:51.079 INFO:tasks.workunit.client.1.smithi156.stdout:4/898: dread d9/d2c/d48/dae/f118 [0,4194304] 0 2023-12-16T05:56:51.080 INFO:tasks.workunit.client.1.smithi156.stdout:4/899: creat d9/d2b/d35/f132 x:0 0 0 2023-12-16T05:56:51.080 INFO:tasks.workunit.client.1.smithi156.stdout:4/900: dread - d9/f115 zero size 2023-12-16T05:56:51.081 INFO:tasks.workunit.client.1.smithi156.stdout:4/901: mknod d9/d2b/d98/d99/d11a/c133 0 2023-12-16T05:56:51.082 INFO:tasks.workunit.client.1.smithi156.stdout:4/902: write d9/f27 [6185055,82526] 0 2023-12-16T05:56:51.108 INFO:tasks.workunit.client.1.smithi156.stdout:4/903: dwrite d9/d2b/d98/fe5 [0,4194304] 0 2023-12-16T05:56:51.127 INFO:tasks.workunit.client.1.smithi156.stdout:4/904: dwrite d9/d2c/fbc [0,4194304] 0 2023-12-16T05:56:51.129 INFO:tasks.workunit.client.1.smithi156.stdout:4/905: creat d9/d2c/dbf/dfe/f134 x:0 0 0 2023-12-16T05:56:51.129 INFO:tasks.workunit.client.1.smithi156.stdout:4/906: chown d9/d2b/f8f 26932017 1 2023-12-16T05:56:51.130 INFO:tasks.workunit.client.1.smithi156.stdout:4/907: creat d9/d2c/d48/dae/f135 x:0 0 0 2023-12-16T05:56:51.131 INFO:tasks.workunit.client.1.smithi156.stdout:4/908: mknod d9/d2c/d7a/dc0/c136 0 2023-12-16T05:56:51.135 INFO:tasks.workunit.client.1.smithi156.stdout:4/909: fsync d9/d2c/d48/dae/f135 0 2023-12-16T05:56:51.137 INFO:tasks.workunit.client.1.smithi156.stdout:4/910: mkdir d9/d43/d12f/d137 0 2023-12-16T05:56:51.138 INFO:tasks.workunit.client.1.smithi156.stdout:4/911: unlink d9/d2c/d7a/dc0/f119 0 2023-12-16T05:56:51.140 INFO:tasks.workunit.client.1.smithi156.stdout:4/912: truncate d9/d2c/d48/dae/f118 893569 0 2023-12-16T05:56:51.141 INFO:tasks.workunit.client.1.smithi156.stdout:4/913: creat d9/d43/d12f/d137/f138 x:0 0 0 2023-12-16T05:56:51.143 INFO:tasks.workunit.client.1.smithi156.stdout:4/914: link d9/d2c/dbf/dfa/f60 d9/d2b/d98/f139 0 2023-12-16T05:56:51.161 INFO:tasks.workunit.client.1.smithi156.stdout:8/841: sync 2023-12-16T05:56:51.161 INFO:tasks.workunit.client.1.smithi156.stdout:8/842: chown d3/d7/d62/ced 27737 1 2023-12-16T05:56:51.161 INFO:tasks.workunit.client.1.smithi156.stdout:4/915: dwrite d9/d2c/d7a/fab [4194304,4194304] 0 2023-12-16T05:56:51.163 INFO:tasks.workunit.client.1.smithi156.stdout:8/843: getdents d3/d7/d62 0 2023-12-16T05:56:51.164 INFO:tasks.workunit.client.1.smithi156.stdout:8/844: mknod d3/d7/d27/d46/d6e/d3b/d77/c118 0 2023-12-16T05:56:51.166 INFO:tasks.workunit.client.1.smithi156.stdout:8/845: mknod d3/d7/d62/dc4/c119 0 2023-12-16T05:56:51.166 INFO:tasks.workunit.client.1.smithi156.stdout:8/846: chown d3/d7a/d7d/cbe 2478 1 2023-12-16T05:56:51.166 INFO:tasks.workunit.client.1.smithi156.stdout:8/847: chown d3/d7a/d7d/dae/d94/fdd 39 1 2023-12-16T05:56:51.166 INFO:tasks.workunit.client.1.smithi156.stdout:8/848: chown d3/d7/d27/d46/d84/d85/d9b/fe2 343 1 2023-12-16T05:56:51.167 INFO:tasks.workunit.client.1.smithi156.stdout:8/849: symlink d3/d6/l11a 0 2023-12-16T05:56:51.167 INFO:tasks.workunit.client.1.smithi156.stdout:8/850: fdatasync d3/d7/d27/fb5 0 2023-12-16T05:56:51.168 INFO:tasks.workunit.client.1.smithi156.stdout:8/851: creat d3/d7/d27/d46/d6e/d3c/dec/def/f11b x:0 0 0 2023-12-16T05:56:51.169 INFO:tasks.workunit.client.1.smithi156.stdout:8/852: creat d3/d7/d27/d46/d6e/f11c x:0 0 0 2023-12-16T05:56:51.178 INFO:tasks.workunit.client.1.smithi156.stdout:4/916: dwrite d9/f19 [0,4194304] 0 2023-12-16T05:56:51.182 INFO:tasks.workunit.client.1.smithi156.stdout:8/853: rename d3/d7/d27/d46/d6e/d3c/dec to d3/d7/d27/d46/d84/d85/d9b/d11d 0 2023-12-16T05:56:51.182 INFO:tasks.workunit.client.1.smithi156.stdout:4/917: dread d9/d2c/dbf/dfe/f102 [0,4194304] 0 2023-12-16T05:56:51.182 INFO:tasks.workunit.client.1.smithi156.stdout:4/918: chown d9/d43/f4b 716248 1 2023-12-16T05:56:51.183 INFO:tasks.workunit.client.1.smithi156.stdout:8/854: symlink d3/d7/d27/d46/d6e/d3b/d77/l11e 0 2023-12-16T05:56:51.183 INFO:tasks.workunit.client.1.smithi156.stdout:8/855: chown d3/d12/d74/fe6 1117230613 1 2023-12-16T05:56:51.184 INFO:tasks.workunit.client.1.smithi156.stdout:4/919: mknod d9/d43/c13a 0 2023-12-16T05:56:51.184 INFO:tasks.workunit.client.1.smithi156.stdout:4/920: chown d9/d2b/d98/d99/ca4 14751 1 2023-12-16T05:56:51.185 INFO:tasks.workunit.client.1.smithi156.stdout:4/921: mknod d9/d2c/dbf/c13b 0 2023-12-16T05:56:51.188 INFO:tasks.workunit.client.1.smithi156.stdout:8/856: rename d3/d7/d27/d46/d84/d85/d9b to d3/d7/d62/d106/d11f 0 2023-12-16T05:56:51.194 INFO:tasks.workunit.client.1.smithi156.stdout:4/922: dread d9/d2c/dbf/dcf/fde [0,4194304] 0 2023-12-16T05:56:51.195 INFO:tasks.workunit.client.1.smithi156.stdout:4/923: getdents d9/d2b/d35 0 2023-12-16T05:56:51.195 INFO:tasks.workunit.client.1.smithi156.stdout:4/924: write d9/d2c/d48/f9e [392044,56308] 0 2023-12-16T05:56:51.200 INFO:tasks.workunit.client.1.smithi156.stdout:4/925: dread d9/d43/f62 [0,4194304] 0 2023-12-16T05:56:51.200 INFO:tasks.workunit.client.1.smithi156.stdout:4/926: chown d9/d2c/lad 15797 1 2023-12-16T05:56:51.201 INFO:tasks.workunit.client.1.smithi156.stdout:4/927: symlink d9/d2c/d48/l13c 0 2023-12-16T05:56:51.202 INFO:tasks.workunit.client.1.smithi156.stdout:4/928: mknod d9/d2c/d7a/dc0/c13d 0 2023-12-16T05:56:51.203 INFO:tasks.workunit.client.1.smithi156.stdout:4/929: creat d9/d2c/dbf/dfa/f13e x:0 0 0 2023-12-16T05:56:51.203 INFO:tasks.workunit.client.1.smithi156.stdout:4/930: readlink d9/l8c 0 2023-12-16T05:56:51.204 INFO:tasks.workunit.client.1.smithi156.stdout:4/931: truncate d9/d2b/fe3 418432 0 2023-12-16T05:56:51.204 INFO:tasks.workunit.client.1.smithi156.stdout:4/932: chown d9/d2b/fe0 870 1 2023-12-16T05:56:51.206 INFO:tasks.workunit.client.1.smithi156.stdout:8/857: dwrite d3/d12/d16/d54/f99 [0,4194304] 0 2023-12-16T05:56:51.209 INFO:tasks.workunit.client.1.smithi156.stdout:8/858: creat d3/d7/d62/d106/f120 x:0 0 0 2023-12-16T05:56:51.210 INFO:tasks.workunit.client.1.smithi156.stdout:8/859: creat d3/d7/d62/d106/f121 x:0 0 0 2023-12-16T05:56:51.210 INFO:tasks.workunit.client.1.smithi156.stdout:8/860: getdents d3/d7/d27/d46/d6e/d3c/d100 0 2023-12-16T05:56:51.211 INFO:tasks.workunit.client.1.smithi156.stdout:4/933: write d9/d2c/f2d [90276,77995] 0 2023-12-16T05:56:51.212 INFO:tasks.workunit.client.1.smithi156.stdout:8/861: creat d3/d7/d27/d46/d84/f122 x:0 0 0 2023-12-16T05:56:51.213 INFO:tasks.workunit.client.1.smithi156.stdout:4/934: creat d9/d2c/dbf/dcf/f13f x:0 0 0 2023-12-16T05:56:51.213 INFO:tasks.workunit.client.1.smithi156.stdout:4/935: dread - d9/d2c/dbf/f117 zero size 2023-12-16T05:56:51.213 INFO:tasks.workunit.client.1.smithi156.stdout:4/936: fdatasync d9/d2c/d48/dae/f91 0 2023-12-16T05:56:51.214 INFO:tasks.workunit.client.1.smithi156.stdout:4/937: truncate d9/d2c/f32 739393 0 2023-12-16T05:56:51.220 INFO:tasks.workunit.client.1.smithi156.stdout:8/862: dread d3/d7a/d7d/fc7 [0,4194304] 0 2023-12-16T05:56:51.221 INFO:tasks.workunit.client.1.smithi156.stdout:8/863: creat d3/d12/f123 x:0 0 0 2023-12-16T05:56:51.222 INFO:tasks.workunit.client.1.smithi156.stdout:8/864: link d3/d7/d27/d46/d6e/d3c/f10d d3/d7/d27/d46/f124 0 2023-12-16T05:56:51.224 INFO:tasks.workunit.client.1.smithi156.stdout:8/865: rename d3/d7/d27/d46/d6e/d3b/d77 to d3/d12/d16/d54/d10f/d125 0 2023-12-16T05:56:51.225 INFO:tasks.workunit.client.1.smithi156.stdout:8/866: link d3/d7a/d7d/dae/f64 d3/d7/d27/d46/d6e/d3c/f126 0 2023-12-16T05:56:51.226 INFO:tasks.workunit.client.1.smithi156.stdout:8/867: link d3/d7/d62/f9d d3/d7a/d7d/dae/f127 0 2023-12-16T05:56:51.228 INFO:tasks.workunit.client.1.smithi156.stdout:8/868: link d3/d7a/d7d/dae/d94/ff5 d3/d7/d62/d106/d11f/de5/df9/f128 0 2023-12-16T05:56:51.228 INFO:tasks.workunit.client.1.smithi156.stdout:8/869: chown d3/d7/d27/d46/d6e/d3b/l8d 59 1 2023-12-16T05:56:51.229 INFO:tasks.workunit.client.1.smithi156.stdout:8/870: write d3/d7a/fab [3061856,105412] 0 2023-12-16T05:56:51.229 INFO:tasks.workunit.client.1.smithi156.stdout:8/871: chown d3/d7/d62/d106/d11f/d11d/l102 3 1 2023-12-16T05:56:51.230 INFO:tasks.workunit.client.1.smithi156.stdout:8/872: symlink d3/d7a/d7d/l129 0 2023-12-16T05:56:51.230 INFO:tasks.workunit.client.1.smithi156.stdout:8/873: dread - d3/d7/d27/fb6 zero size 2023-12-16T05:56:51.234 INFO:tasks.workunit.client.1.smithi156.stdout:4/938: dwrite d9/d2b/d98/fe5 [0,4194304] 0 2023-12-16T05:56:51.239 INFO:tasks.workunit.client.1.smithi156.stdout:4/939: write d9/d2b/d35/f71 [1667861,90112] 0 2023-12-16T05:56:51.239 INFO:tasks.workunit.client.1.smithi156.stdout:4/940: truncate d9/d2c/d48/dae/f118 1251594 0 2023-12-16T05:56:51.241 INFO:tasks.workunit.client.1.smithi156.stdout:4/941: creat d9/d43/f140 x:0 0 0 2023-12-16T05:56:51.246 INFO:tasks.workunit.client.1.smithi156.stdout:4/942: dread f5 [0,4194304] 0 2023-12-16T05:56:51.246 INFO:tasks.workunit.client.1.smithi156.stdout:4/943: truncate d9/d2c/d48/dae/fe2 859609 0 2023-12-16T05:56:51.246 INFO:tasks.workunit.client.1.smithi156.stdout:3/926: sync 2023-12-16T05:56:51.246 INFO:tasks.workunit.client.1.smithi156.stdout:2/901: sync 2023-12-16T05:56:51.247 INFO:tasks.workunit.client.1.smithi156.stdout:2/902: write d9/dd/d17/d33/d47/ddd/df5/d109/da6/f107 [1025996,124483] 0 2023-12-16T05:56:51.247 INFO:tasks.workunit.client.1.smithi156.stdout:2/903: write d9/f20 [567649,33335] 0 2023-12-16T05:56:51.248 INFO:tasks.workunit.client.1.smithi156.stdout:2/904: fsync d9/dd/d17/fd7 0 2023-12-16T05:56:51.248 INFO:tasks.workunit.client.1.smithi156.stdout:4/944: truncate d9/d2c/f32 726770 0 2023-12-16T05:56:51.249 INFO:tasks.workunit.client.1.smithi156.stdout:3/927: rename dc/d10/f82 to dc/d56/d67/dbe/dd9/d147/f14e 0 2023-12-16T05:56:51.250 INFO:tasks.workunit.client.1.smithi156.stdout:4/945: rmdir d9/d2c/d7a/dd4 39 2023-12-16T05:56:51.250 INFO:tasks.workunit.client.1.smithi156.stdout:4/946: write d9/d2c/ff8 [282618,43678] 0 2023-12-16T05:56:51.251 INFO:tasks.workunit.client.1.smithi156.stdout:4/947: truncate d9/d2c/d48/dae/f85 2311853 0 2023-12-16T05:56:51.252 INFO:tasks.workunit.client.1.smithi156.stdout:3/928: dread dc/d10/d1d/d4b/d52/fae [0,4194304] 0 2023-12-16T05:56:51.252 INFO:tasks.workunit.client.1.smithi156.stdout:4/948: unlink f4 0 2023-12-16T05:56:51.253 INFO:tasks.workunit.client.1.smithi156.stdout:8/874: dwrite d3/d6/d83/f112 [0,4194304] 0 2023-12-16T05:56:51.254 INFO:tasks.workunit.client.1.smithi156.stdout:3/929: rename dc/d10/d3d/d4e/d128/l12a to dc/d56/d67/d104/d126/l14f 0 2023-12-16T05:56:51.257 INFO:tasks.workunit.client.1.smithi156.stdout:2/905: dread d9/dd/d17/d33/d47/ddd/df5/d109/dad/fb8 [0,4194304] 0 2023-12-16T05:56:51.258 INFO:tasks.workunit.client.1.smithi156.stdout:2/906: write d9/d12/d3d/fe0 [768430,61220] 0 2023-12-16T05:56:51.260 INFO:tasks.workunit.client.1.smithi156.stdout:4/949: dread d9/d2b/f75 [0,4194304] 0 2023-12-16T05:56:51.260 INFO:tasks.workunit.client.1.smithi156.stdout:4/950: dread - d9/d2c/d7a/dd4/f107 zero size 2023-12-16T05:56:51.262 INFO:tasks.workunit.client.1.smithi156.stdout:8/875: link d3/d7/d62/dc4/f101 d3/d7/d66/f12a 0 2023-12-16T05:56:51.263 INFO:tasks.workunit.client.1.smithi156.stdout:3/930: unlink dc/df/dce/fe3 0 2023-12-16T05:56:51.265 INFO:tasks.workunit.client.1.smithi156.stdout:2/907: creat d9/d68/daa/d83/f11d x:0 0 0 2023-12-16T05:56:51.266 INFO:tasks.workunit.client.1.smithi156.stdout:3/931: dread dc/d10/d1d/d90/f14d [0,4194304] 0 2023-12-16T05:56:51.267 INFO:tasks.workunit.client.1.smithi156.stdout:4/951: rmdir d9/d43/d12f 39 2023-12-16T05:56:51.267 INFO:tasks.workunit.client.1.smithi156.stdout:4/952: truncate d9/d2c/dbf/f113 666143 0 2023-12-16T05:56:51.269 INFO:tasks.workunit.client.1.smithi156.stdout:8/876: mkdir d3/d12/d12b 0 2023-12-16T05:56:51.273 INFO:tasks.workunit.client.1.smithi156.stdout:4/953: getdents d9/d2c/dbf/dfa/d7d/d100 0 2023-12-16T05:56:51.273 INFO:tasks.workunit.client.1.smithi156.stdout:4/954: readlink d9/d2b/d35/lf1 0 2023-12-16T05:56:51.275 INFO:tasks.workunit.client.1.smithi156.stdout:8/877: mkdir d3/d12/d16/d54/d10f/d12c 0 2023-12-16T05:56:51.275 INFO:tasks.workunit.client.1.smithi156.stdout:8/878: chown d3/d7/d27/f93 7752903 1 2023-12-16T05:56:51.277 INFO:tasks.workunit.client.1.smithi156.stdout:4/955: link d9/d2c/fbc d9/d2c/d7a/f141 0 2023-12-16T05:56:51.277 INFO:tasks.workunit.client.1.smithi156.stdout:9/928: sync 2023-12-16T05:56:51.278 INFO:tasks.workunit.client.1.smithi156.stdout:1/838: sync 2023-12-16T05:56:51.278 INFO:tasks.workunit.client.1.smithi156.stdout:1/839: fdatasync d3/d17/f1f 0 2023-12-16T05:56:51.281 INFO:tasks.workunit.client.1.smithi156.stdout:3/932: dread dc/df/d34/f68 [0,4194304] 0 2023-12-16T05:56:51.282 INFO:tasks.workunit.client.1.smithi156.stdout:4/956: creat d9/d43/f142 x:0 0 0 2023-12-16T05:56:51.282 INFO:tasks.workunit.client.1.smithi156.stdout:9/929: creat d6/d19/d25/d3a/dc3/f135 x:0 0 0 2023-12-16T05:56:51.282 INFO:tasks.workunit.client.1.smithi156.stdout:9/930: stat d6/da3/fb4 0 2023-12-16T05:56:51.289 INFO:tasks.workunit.client.1.smithi156.stdout:2/908: dwrite d9/d68/f97 [0,4194304] 0 2023-12-16T05:56:51.292 INFO:tasks.workunit.client.1.smithi156.stdout:2/909: creat d9/dd/d17/d33/d47/ddd/df5/d109/da6/d80/f11e x:0 0 0 2023-12-16T05:56:51.292 INFO:tasks.workunit.client.1.smithi156.stdout:2/910: truncate f5 1805928 0 2023-12-16T05:56:51.300 INFO:tasks.workunit.client.1.smithi156.stdout:2/911: dread d9/dd/d17/d33/d47/ddd/df5/d109/da6/d80/f8b [0,4194304] 0 2023-12-16T05:56:51.310 INFO:tasks.workunit.client.1.smithi156.stdout:8/879: dwrite d3/d12/d16/d54/d10f/d125/fd8 [0,4194304] 0 2023-12-16T05:56:51.310 INFO:tasks.workunit.client.1.smithi156.stdout:3/933: dwrite dc/d10/d3d/f87 [0,4194304] 0 2023-12-16T05:56:51.311 INFO:tasks.workunit.client.1.smithi156.stdout:8/880: read d3/d7a/fab [1152528,117615] 0 2023-12-16T05:56:51.312 INFO:tasks.workunit.client.1.smithi156.stdout:9/931: dwrite d6/d19/d25/d3a/d80/f96 [0,4194304] 0 2023-12-16T05:56:51.312 INFO:tasks.workunit.client.1.smithi156.stdout:9/932: fdatasync d6/d19/f1b 0 2023-12-16T05:56:51.313 INFO:tasks.workunit.client.1.smithi156.stdout:3/934: mkdir dc/d10/dc6/d110/d150 0 2023-12-16T05:56:51.313 INFO:tasks.workunit.client.1.smithi156.stdout:9/933: dread d6/d19/d25/fbf [0,4194304] 0 2023-12-16T05:56:51.313 INFO:tasks.workunit.client.1.smithi156.stdout:8/881: creat d3/d12/d16/d54/d10f/d12c/f12d x:0 0 0 2023-12-16T05:56:51.317 INFO:tasks.workunit.client.1.smithi156.stdout:9/934: link d6/da3/db0/fcc d6/d19/d25/d3a/d88/d8b/dac/d116/f136 0 2023-12-16T05:56:51.317 INFO:tasks.workunit.client.1.smithi156.stdout:9/935: dread - d6/d19/d30/d48/d87/fc7 zero size 2023-12-16T05:56:51.318 INFO:tasks.workunit.client.1.smithi156.stdout:8/882: creat d3/d12/d16/f12e x:0 0 0 2023-12-16T05:56:51.320 INFO:tasks.workunit.client.1.smithi156.stdout:2/912: dwrite d9/d12/dc2/fde [0,4194304] 0 2023-12-16T05:56:51.320 INFO:tasks.workunit.client.1.smithi156.stdout:2/913: dread - d9/dd/d17/d33/d47/d9e/fe1 zero size 2023-12-16T05:56:51.324 INFO:tasks.workunit.client.1.smithi156.stdout:2/914: creat d9/d12/d3d/d102/f11f x:0 0 0 2023-12-16T05:56:51.325 INFO:tasks.workunit.client.1.smithi156.stdout:2/915: chown d9/dd/d17/d33/d78/d74/l92 20922 1 2023-12-16T05:56:51.325 INFO:tasks.workunit.client.1.smithi156.stdout:2/916: mknod d9/d12/c120 0 2023-12-16T05:56:51.325 INFO:tasks.workunit.client.1.smithi156.stdout:2/917: fsync d9/d68/daa/f67 0 2023-12-16T05:56:51.326 INFO:tasks.workunit.client.1.smithi156.stdout:2/918: getdents d9/dd/d17/d33/d78/d74/dd0 0 2023-12-16T05:56:51.343 INFO:tasks.workunit.client.1.smithi156.stdout:8/883: dwrite d3/d7/d62/dc4/f101 [0,4194304] 0 2023-12-16T05:56:51.343 INFO:tasks.workunit.client.1.smithi156.stdout:3/935: dwrite dc/d56/d67/d6e/fd1 [8388608,4194304] 0 2023-12-16T05:56:51.345 INFO:tasks.workunit.client.1.smithi156.stdout:8/884: mkdir d3/d7/d62/d106/d11f/de5/d12f 0 2023-12-16T05:56:51.346 INFO:tasks.workunit.client.1.smithi156.stdout:3/936: creat dc/df/d34/d62/d75/f151 x:0 0 0 2023-12-16T05:56:51.347 INFO:tasks.workunit.client.1.smithi156.stdout:8/885: truncate d3/d7/d27/f32 698121 0 2023-12-16T05:56:51.347 INFO:tasks.workunit.client.1.smithi156.stdout:8/886: chown d3/d6/c1e 117430224 1 2023-12-16T05:56:51.348 INFO:tasks.workunit.client.1.smithi156.stdout:3/937: getdents dc/d10/d1d/d4b/d52 0 2023-12-16T05:56:51.349 INFO:tasks.workunit.client.1.smithi156.stdout:8/887: truncate d3/d7a/fa4 1889062 0 2023-12-16T05:56:51.350 INFO:tasks.workunit.client.1.smithi156.stdout:8/888: write d3/d7/d62/d106/f120 [487390,66447] 0 2023-12-16T05:56:51.351 INFO:tasks.workunit.client.1.smithi156.stdout:3/938: creat dc/d10/d3d/d4e/f152 x:0 0 0 2023-12-16T05:56:51.351 INFO:tasks.workunit.client.1.smithi156.stdout:3/939: readlink l6 0 2023-12-16T05:56:51.352 INFO:tasks.workunit.client.1.smithi156.stdout:2/919: dwrite d9/d56/d5f/f9f [0,4194304] 0 2023-12-16T05:56:51.353 INFO:tasks.workunit.client.1.smithi156.stdout:8/889: creat d3/d7/d62/d6b/f130 x:0 0 0 2023-12-16T05:56:51.354 INFO:tasks.workunit.client.1.smithi156.stdout:8/890: truncate d3/d12/d16/d54/d10f/d12c/f12d 918986 0 2023-12-16T05:56:51.386 INFO:tasks.workunit.client.1.smithi156.stdout:3/940: dwrite dc/d56/d69/ff4 [0,4194304] 0 2023-12-16T05:56:51.388 INFO:tasks.workunit.client.1.smithi156.stdout:8/891: dwrite d3/d7/d27/d46/d6e/d3c/f6a [4194304,4194304] 0 2023-12-16T05:56:51.388 INFO:tasks.workunit.client.1.smithi156.stdout:2/920: dwrite d9/dd/d17/d33/d47/ddd/df5/d109/dad/fb8 [4194304,4194304] 0 2023-12-16T05:56:51.389 INFO:tasks.workunit.client.1.smithi156.stdout:8/892: write d3/d12/d16/d54/d10f/d125/f10c [400337,80513] 0 2023-12-16T05:56:51.390 INFO:tasks.workunit.client.1.smithi156.stdout:2/921: creat d9/dd/d17/d33/d78/d39/d60/f121 x:0 0 0 2023-12-16T05:56:51.390 INFO:tasks.workunit.client.1.smithi156.stdout:8/893: getdents d3/d7/d62/dde 0 2023-12-16T05:56:51.391 INFO:tasks.workunit.client.1.smithi156.stdout:2/922: getdents d9/dd/d17/d33/d78 0 2023-12-16T05:56:51.391 INFO:tasks.workunit.client.1.smithi156.stdout:8/894: write d3/d7/d62/f9d [2437271,90380] 0 2023-12-16T05:56:51.392 INFO:tasks.workunit.client.1.smithi156.stdout:3/941: write dc/d10/d3d/f38 [2002327,1990] 0 2023-12-16T05:56:51.396 INFO:tasks.workunit.client.1.smithi156.stdout:8/895: creat d3/d7/d62/dc4/f131 x:0 0 0 2023-12-16T05:56:51.397 INFO:tasks.workunit.client.1.smithi156.stdout:3/942: unlink dc/df/d34/c47 0 2023-12-16T05:56:51.398 INFO:tasks.workunit.client.1.smithi156.stdout:8/896: creat d3/d7/d27/d46/d84/f132 x:0 0 0 2023-12-16T05:56:51.399 INFO:tasks.workunit.client.1.smithi156.stdout:3/943: creat dc/d56/d67/dbe/dd9/f153 x:0 0 0 2023-12-16T05:56:51.403 INFO:tasks.workunit.client.1.smithi156.stdout:2/923: dread d9/dd/f2f [0,4194304] 0 2023-12-16T05:56:51.403 INFO:tasks.workunit.client.1.smithi156.stdout:1/840: sync 2023-12-16T05:56:51.403 INFO:tasks.workunit.client.1.smithi156.stdout:3/944: write dc/d56/fdb [60592,18426] 0 2023-12-16T05:56:51.403 INFO:tasks.workunit.client.1.smithi156.stdout:2/924: mknod d9/d12/dc2/c122 0 2023-12-16T05:56:51.404 INFO:tasks.workunit.client.1.smithi156.stdout:1/841: creat d3/d17/d1c/d22/d57/dbc/dd9/f119 x:0 0 0 2023-12-16T05:56:51.405 INFO:tasks.workunit.client.1.smithi156.stdout:3/945: mknod dc/d10/d1d/d4b/c154 0 2023-12-16T05:56:51.405 INFO:tasks.workunit.client.1.smithi156.stdout:3/946: readlink dc/l2a 0 2023-12-16T05:56:51.406 INFO:tasks.workunit.client.1.smithi156.stdout:2/925: getdents d9/d56/d5f 0 2023-12-16T05:56:51.406 INFO:tasks.workunit.client.1.smithi156.stdout:8/897: dread d3/d12/d16/f2d [0,4194304] 0 2023-12-16T05:56:51.407 INFO:tasks.workunit.client.1.smithi156.stdout:3/947: mkdir dc/d56/d67/d155 0 2023-12-16T05:56:51.408 INFO:tasks.workunit.client.1.smithi156.stdout:2/926: creat d9/d68/daa/d83/da1/d96/dca/d111/f123 x:0 0 0 2023-12-16T05:56:51.409 INFO:tasks.workunit.client.1.smithi156.stdout:8/898: write d3/d12/d74/fe6 [1688647,110639] 0 2023-12-16T05:56:51.409 INFO:tasks.workunit.client.1.smithi156.stdout:8/899: chown d3/d7/d27/d46/d6e/d3b/l8d 8626 1 2023-12-16T05:56:51.409 INFO:tasks.workunit.client.1.smithi156.stdout:8/900: dread - d3/d7/d27/f93 zero size 2023-12-16T05:56:51.409 INFO:tasks.workunit.client.1.smithi156.stdout:8/901: write d3/d7/d27/d46/d84/d85/ff1 [870338,39009] 0 2023-12-16T05:56:51.409 INFO:tasks.workunit.client.1.smithi156.stdout:8/902: chown d3/d7/le4 1235 1 2023-12-16T05:56:51.409 INFO:tasks.workunit.client.1.smithi156.stdout:3/948: symlink dc/d10/d1d/d90/d146/l156 0 2023-12-16T05:56:51.411 INFO:tasks.workunit.client.1.smithi156.stdout:2/927: mkdir d9/dd/d17/d8f/d124 0 2023-12-16T05:56:51.411 INFO:tasks.workunit.client.1.smithi156.stdout:2/928: stat d9/d12/fb9 0 2023-12-16T05:56:51.412 INFO:tasks.workunit.client.1.smithi156.stdout:8/903: mknod d3/d12/d16/db4/de9/c133 0 2023-12-16T05:56:51.416 INFO:tasks.workunit.client.1.smithi156.stdout:3/949: mknod dc/d10/d3d/d4e/c157 0 2023-12-16T05:56:51.417 INFO:tasks.workunit.client.1.smithi156.stdout:2/929: symlink d9/d56/d5f/l125 0 2023-12-16T05:56:51.417 INFO:tasks.workunit.client.1.smithi156.stdout:2/930: chown d9/dd/d17/d33/d78/d39/f108 5603962 1 2023-12-16T05:56:51.417 INFO:tasks.workunit.client.1.smithi156.stdout:2/931: chown d9/d12/d3d/fe0 360940 1 2023-12-16T05:56:51.418 INFO:tasks.workunit.client.1.smithi156.stdout:8/904: creat d3/d12/f134 x:0 0 0 2023-12-16T05:56:51.418 INFO:tasks.workunit.client.1.smithi156.stdout:8/905: stat d3/d7/d27/d46/d6e/d3b/ca9 0 2023-12-16T05:56:51.418 INFO:tasks.workunit.client.1.smithi156.stdout:8/906: chown d3/d7/d62/d6b 3173 1 2023-12-16T05:56:51.418 INFO:tasks.workunit.client.1.smithi156.stdout:8/907: write d3/d7/d62/dde/f109 [1508,47480] 0 2023-12-16T05:56:51.419 INFO:tasks.workunit.client.1.smithi156.stdout:2/932: mkdir d9/d68/daa/d83/d126 0 2023-12-16T05:56:51.419 INFO:tasks.workunit.client.1.smithi156.stdout:2/933: stat d9/dd/d17 0 2023-12-16T05:56:51.420 INFO:tasks.workunit.client.1.smithi156.stdout:8/908: dread d3/d7/d66/d76/fad [0,4194304] 0 2023-12-16T05:56:51.420 INFO:tasks.workunit.client.1.smithi156.stdout:2/934: rmdir d9/d68/daa/d83/da1/d96/dca 39 2023-12-16T05:56:51.421 INFO:tasks.workunit.client.1.smithi156.stdout:8/909: mkdir d3/d135 0 2023-12-16T05:56:51.421 INFO:tasks.workunit.client.1.smithi156.stdout:8/910: write d3/d7/d62/d106/d11f/de5/df9/f128 [884295,47163] 0 2023-12-16T05:56:51.422 INFO:tasks.workunit.client.1.smithi156.stdout:2/935: creat d9/dd/d17/d33/d47/ddd/df5/d109/dad/f127 x:0 0 0 2023-12-16T05:56:51.423 INFO:tasks.workunit.client.1.smithi156.stdout:1/842: dwrite d3/fb4 [0,4194304] 0 2023-12-16T05:56:51.423 INFO:tasks.workunit.client.1.smithi156.stdout:8/911: symlink d3/d135/l136 0 2023-12-16T05:56:51.424 INFO:tasks.workunit.client.1.smithi156.stdout:3/950: write dc/d56/d69/fa5 [1704280,71281] 0 2023-12-16T05:56:51.424 INFO:tasks.workunit.client.1.smithi156.stdout:8/912: write d3/d7/d27/d46/d6e/d3c/f126 [1601096,86188] 0 2023-12-16T05:56:51.424 INFO:tasks.workunit.client.1.smithi156.stdout:8/913: truncate d3/d12/d16/d54/f60 616216 0 2023-12-16T05:56:51.425 INFO:tasks.workunit.client.1.smithi156.stdout:2/936: rename d9/d12/f36 to d9/dd/d17/d33/d47/f128 0 2023-12-16T05:56:51.427 INFO:tasks.workunit.client.1.smithi156.stdout:8/914: write d3/d12/f25 [563560,120791] 0 2023-12-16T05:56:51.427 INFO:tasks.workunit.client.1.smithi156.stdout:1/843: mkdir d3/d17/d4d/dc2/d4f/dca/d11a 0 2023-12-16T05:56:51.427 INFO:tasks.workunit.client.1.smithi156.stdout:1/844: write d3/d3a/fd1 [874087,72542] 0 2023-12-16T05:56:51.427 INFO:tasks.workunit.client.1.smithi156.stdout:1/845: chown d3/d1b/df9/l100 18433650 1 2023-12-16T05:56:51.427 INFO:tasks.workunit.client.1.smithi156.stdout:1/846: write d3/d17/daa/ff0 [703234,85063] 0 2023-12-16T05:56:51.427 INFO:tasks.workunit.client.1.smithi156.stdout:1/847: chown d3/d17/daa/f104 14 1 2023-12-16T05:56:51.427 INFO:tasks.workunit.client.1.smithi156.stdout:1/848: fdatasync f1 0 2023-12-16T05:56:51.427 INFO:tasks.workunit.client.1.smithi156.stdout:8/915: read d3/f5a [3324856,68213] 0 2023-12-16T05:56:51.428 INFO:tasks.workunit.client.1.smithi156.stdout:3/951: mkdir dc/d10/d1d/d4b/dac/d158 0 2023-12-16T05:56:51.430 INFO:tasks.workunit.client.1.smithi156.stdout:2/937: link d9/dd/d17/d33/dae/fbd d9/d68/daa/d83/d126/f129 0 2023-12-16T05:56:51.430 INFO:tasks.workunit.client.1.smithi156.stdout:2/938: readlink d9/d12/dc2/lfb 0 2023-12-16T05:56:51.432 INFO:tasks.workunit.client.1.smithi156.stdout:1/849: getdents d3/d3a/da9 0 2023-12-16T05:56:51.433 INFO:tasks.workunit.client.1.smithi156.stdout:8/916: creat d3/d7/d62/d6b/f137 x:0 0 0 2023-12-16T05:56:51.434 INFO:tasks.workunit.client.1.smithi156.stdout:2/939: creat d9/d68/f12a x:0 0 0 2023-12-16T05:56:51.436 INFO:tasks.workunit.client.1.smithi156.stdout:1/850: rename d3/d17/d1c/d22/da4 to d3/d17/d1c/d22/d57/d61/dc1/dbe/dd2/d11b 0 2023-12-16T05:56:51.438 INFO:tasks.workunit.client.1.smithi156.stdout:8/917: symlink d3/d7/d27/d46/d84/d85/l138 0 2023-12-16T05:56:51.438 INFO:tasks.workunit.client.1.smithi156.stdout:8/918: dread - d3/d7/d27/d46/d6e/f11c zero size 2023-12-16T05:56:51.442 INFO:tasks.workunit.client.1.smithi156.stdout:1/851: dread d3/d17/d2d/fab [0,4194304] 0 2023-12-16T05:56:51.446 INFO:tasks.workunit.client.1.smithi156.stdout:1/852: unlink d3/d17/daa/f104 0 2023-12-16T05:56:51.447 INFO:tasks.workunit.client.1.smithi156.stdout:1/853: write d3/d17/d1c/d22/d57/d61/dc1/f116 [1966705,7423] 0 2023-12-16T05:56:51.447 INFO:tasks.workunit.client.1.smithi156.stdout:1/854: readlink d3/d17/d4d/dc2/d4f/d75/lf3 0 2023-12-16T05:56:51.449 INFO:tasks.workunit.client.1.smithi156.stdout:1/855: creat d3/d17/d1c/d22/d57/f11c x:0 0 0 2023-12-16T05:56:51.450 INFO:tasks.workunit.client.1.smithi156.stdout:1/856: truncate d3/d17/f33 1237896 0 2023-12-16T05:56:51.450 INFO:tasks.workunit.client.1.smithi156.stdout:2/940: dwrite d9/dd/d17/d33/d47/f128 [0,4194304] 0 2023-12-16T05:56:51.451 INFO:tasks.workunit.client.1.smithi156.stdout:2/941: truncate d9/f22 646897 0 2023-12-16T05:56:51.452 INFO:tasks.workunit.client.1.smithi156.stdout:8/919: dread d3/d7a/d7d/dae/f57 [0,4194304] 0 2023-12-16T05:56:51.452 INFO:tasks.workunit.client.1.smithi156.stdout:2/942: mknod d9/d12/d3d/d102/dd4/c12b 0 2023-12-16T05:56:51.453 INFO:tasks.workunit.client.1.smithi156.stdout:1/857: dread d3/d17/d4d/dc2/f67 [0,4194304] 0 2023-12-16T05:56:51.453 INFO:tasks.workunit.client.1.smithi156.stdout:8/920: write d3/d7a/d7d/fa6 [3970729,15128] 0 2023-12-16T05:56:51.453 INFO:tasks.workunit.client.1.smithi156.stdout:2/943: mkdir d9/dd/d17/d33/d47/ddd/df5/d109/da6/d12c 0 2023-12-16T05:56:51.454 INFO:tasks.workunit.client.1.smithi156.stdout:2/944: dread - d9/dd/d17/d33/d78/d39/d60/fb6 zero size 2023-12-16T05:56:51.456 INFO:tasks.workunit.client.1.smithi156.stdout:1/858: rename d3/d17/d2d/ff6 to d3/d17/d1c/d22/d57/d82/f11d 0 2023-12-16T05:56:51.456 INFO:tasks.workunit.client.1.smithi156.stdout:1/859: chown d3/d1b/l1d 44 1 2023-12-16T05:56:51.456 INFO:tasks.workunit.client.1.smithi156.stdout:1/860: write d3/d3a/f7a [2153725,62560] 0 2023-12-16T05:56:51.456 INFO:tasks.workunit.client.1.smithi156.stdout:1/861: chown d3/fae 75 1 2023-12-16T05:56:51.458 INFO:tasks.workunit.client.1.smithi156.stdout:2/945: creat d9/dd/d17/d33/d78/d74/f12d x:0 0 0 2023-12-16T05:56:51.462 INFO:tasks.workunit.client.1.smithi156.stdout:1/862: mknod d3/d17/d4d/dc2/dd8/d110/c11e 0 2023-12-16T05:56:51.462 INFO:tasks.workunit.client.1.smithi156.stdout:1/863: dread - d3/d17/d4d/dc2/d4f/d75/fe7 zero size 2023-12-16T05:56:51.462 INFO:tasks.workunit.client.1.smithi156.stdout:1/864: chown d3/d17/c24 12234247 1 2023-12-16T05:56:51.462 INFO:tasks.workunit.client.1.smithi156.stdout:1/865: creat d3/d103/f11f x:0 0 0 2023-12-16T05:56:51.464 INFO:tasks.workunit.client.1.smithi156.stdout:1/866: link d3/d1b/d8b/f9e d3/d17/d2d/f120 0 2023-12-16T05:56:51.482 INFO:tasks.workunit.client.1.smithi156.stdout:2/946: dwrite d9/d68/daa/f9c [0,4194304] 0 2023-12-16T05:56:51.482 INFO:tasks.workunit.client.1.smithi156.stdout:2/947: write d9/d12/dc2/fe2 [1324819,110907] 0 2023-12-16T05:56:51.489 INFO:tasks.workunit.client.1.smithi156.stdout:1/867: dwrite d3/d17/f52 [4194304,4194304] 0 2023-12-16T05:56:51.490 INFO:tasks.workunit.client.1.smithi156.stdout:1/868: write d3/d3a/f9f [718631,106296] 0 2023-12-16T05:56:51.504 INFO:tasks.workunit.client.1.smithi156.stdout:2/948: dwrite d9/dd/d17/d33/d47/f4d [0,4194304] 0 2023-12-16T05:56:51.504 INFO:tasks.workunit.client.1.smithi156.stdout:2/949: chown d9/d68/daa/f52 441622 1 2023-12-16T05:56:51.507 INFO:tasks.workunit.client.1.smithi156.stdout:2/950: read d9/dd/d17/d33/d78/d39/f3e [1467780,82868] 0 2023-12-16T05:56:51.507 INFO:tasks.workunit.client.1.smithi156.stdout:2/951: fsync d9/dd/d17/d33/d78/d39/d8c/dbe/fe5 0 2023-12-16T05:56:51.507 INFO:tasks.workunit.client.1.smithi156.stdout:1/869: dwrite d3/d17/f52 [0,4194304] 0 2023-12-16T05:56:51.508 INFO:tasks.workunit.client.1.smithi156.stdout:1/870: read d3/d17/d4d/fbf [298412,84511] 0 2023-12-16T05:56:51.514 INFO:tasks.workunit.client.1.smithi156.stdout:1/871: rename d3/d17/d4d/dc2/d4f/d75/lf3 to d3/d17/d4d/dc2/d4f/dca/l121 0 2023-12-16T05:56:51.514 INFO:tasks.workunit.client.1.smithi156.stdout:1/872: readlink d3/d1b/df9/l100 0 2023-12-16T05:56:51.516 INFO:tasks.workunit.client.1.smithi156.stdout:1/873: unlink d3/d17/d1c/d22/d57/dbc/l102 0 2023-12-16T05:56:51.517 INFO:tasks.workunit.client.1.smithi156.stdout:1/874: read d3/d3a/f6c [3268906,76492] 0 2023-12-16T05:56:51.519 INFO:tasks.workunit.client.1.smithi156.stdout:4/957: sync 2023-12-16T05:56:51.519 INFO:tasks.workunit.client.1.smithi156.stdout:4/958: readlink d9/l34 0 2023-12-16T05:56:51.520 INFO:tasks.workunit.client.1.smithi156.stdout:4/959: chown d9/f18 15506 1 2023-12-16T05:56:51.520 INFO:tasks.workunit.client.1.smithi156.stdout:4/960: truncate d9/f21 4640157 0 2023-12-16T05:56:51.520 INFO:tasks.workunit.client.1.smithi156.stdout:4/961: creat d9/d2c/d48/f143 x:0 0 0 2023-12-16T05:56:51.523 INFO:tasks.workunit.client.1.smithi156.stdout:2/952: dwrite d9/d12/f45 [0,4194304] 0 2023-12-16T05:56:51.525 INFO:tasks.workunit.client.1.smithi156.stdout:2/953: rmdir d9/d68/daa/d83/da1/d96/dca 39 2023-12-16T05:56:51.526 INFO:tasks.workunit.client.1.smithi156.stdout:2/954: write d9/d12/dc2/fc7 [523215,37616] 0 2023-12-16T05:56:51.529 INFO:tasks.workunit.client.1.smithi156.stdout:2/955: creat d9/d12/f12e x:0 0 0 2023-12-16T05:56:51.529 INFO:tasks.workunit.client.1.smithi156.stdout:2/956: readlink d9/dd/d17/l82 0 2023-12-16T05:56:51.529 INFO:tasks.workunit.client.1.smithi156.stdout:2/957: unlink d9/dd/d17/d33/d47/ccc 0 2023-12-16T05:56:51.529 INFO:tasks.workunit.client.1.smithi156.stdout:2/958: chown d9/dd/d17/d33/d11a 66922663 1 2023-12-16T05:56:51.529 INFO:tasks.workunit.client.1.smithi156.stdout:2/959: chown d9/f5c 1358008 1 2023-12-16T05:56:51.530 INFO:tasks.workunit.client.1.smithi156.stdout:2/960: dread d9/dd/d17/d33/d78/d39/f79 [0,4194304] 0 2023-12-16T05:56:51.530 INFO:tasks.workunit.client.1.smithi156.stdout:1/875: dread d3/fae [0,4194304] 0 2023-12-16T05:56:51.532 INFO:tasks.workunit.client.1.smithi156.stdout:2/961: dread d9/d12/f5e [0,4194304] 0 2023-12-16T05:56:51.533 INFO:tasks.workunit.client.1.smithi156.stdout:2/962: symlink d9/l12f 0 2023-12-16T05:56:51.535 INFO:tasks.workunit.client.1.smithi156.stdout:2/963: rename d9/d68/daa/d83/da1/d96/cf0 to d9/dd/d17/d33/d47/ddd/df5/d109/da6/d12c/c130 0 2023-12-16T05:56:51.536 INFO:tasks.workunit.client.1.smithi156.stdout:2/964: creat d9/d12/f131 x:0 0 0 2023-12-16T05:56:51.537 INFO:tasks.workunit.client.1.smithi156.stdout:2/965: dread d9/d12/dc2/ffa [0,4194304] 0 2023-12-16T05:56:51.539 INFO:tasks.workunit.client.1.smithi156.stdout:1/876: dread d3/d17/d1c/d22/d57/d61/dc1/f58 [0,4194304] 0 2023-12-16T05:56:51.540 INFO:tasks.workunit.client.1.smithi156.stdout:1/877: unlink d3/d17/d2d/fc5 0 2023-12-16T05:56:51.543 INFO:tasks.workunit.client.1.smithi156.stdout:1/878: dread d3/f5 [0,4194304] 0 2023-12-16T05:56:51.543 INFO:tasks.workunit.client.1.smithi156.stdout:1/879: chown d3/d17/d4d/dc2/d4f/l78 240596196 1 2023-12-16T05:56:51.545 INFO:tasks.workunit.client.1.smithi156.stdout:2/966: write f5 [615787,2706] 0 2023-12-16T05:56:51.545 INFO:tasks.workunit.client.1.smithi156.stdout:2/967: rmdir d9/dd/d17/dee 39 2023-12-16T05:56:51.547 INFO:tasks.workunit.client.1.smithi156.stdout:2/968: dread d9/dd/d17/d33/d78/d39/f108 [0,4194304] 0 2023-12-16T05:56:51.548 INFO:tasks.workunit.client.1.smithi156.stdout:2/969: mkdir d9/dd/d17/d33/dae/d132 0 2023-12-16T05:56:51.548 INFO:tasks.workunit.client.1.smithi156.stdout:2/970: chown d9/d68/daa/d83/d126/f129 166339822 1 2023-12-16T05:56:51.549 INFO:tasks.workunit.client.1.smithi156.stdout:2/971: rename d9/d68/daa/db4/f99 to d9/d68/daa/f133 0 2023-12-16T05:56:51.549 INFO:tasks.workunit.client.1.smithi156.stdout:2/972: chown d9/dd/d17/d33/d78/d74/dd0 9676 1 2023-12-16T05:56:51.550 INFO:tasks.workunit.client.1.smithi156.stdout:2/973: creat d9/dd/d17/d33/d78/d74/d101/f134 x:0 0 0 2023-12-16T05:56:51.550 INFO:tasks.workunit.client.1.smithi156.stdout:2/974: chown d9/dd/d17/d33/d78/d39/f108 1135261273 1 2023-12-16T05:56:51.550 INFO:tasks.workunit.client.1.smithi156.stdout:2/975: write d9/dd/d17/d33/d47/ddd/df5/d109/dad/fdf [627993,102782] 0 2023-12-16T05:56:51.551 INFO:tasks.workunit.client.1.smithi156.stdout:2/976: rmdir d9/dd/d17/d33/d47/d9e 39 2023-12-16T05:56:51.551 INFO:tasks.workunit.client.1.smithi156.stdout:2/977: dread - d9/dd/fba zero size 2023-12-16T05:56:51.551 INFO:tasks.workunit.client.1.smithi156.stdout:2/978: fdatasync d9/dd/d17/d33/d47/f6e 0 2023-12-16T05:56:51.553 INFO:tasks.workunit.client.1.smithi156.stdout:2/979: creat d9/dd/d17/d33/d47/ddd/f135 x:0 0 0 2023-12-16T05:56:51.553 INFO:tasks.workunit.client.1.smithi156.stdout:2/980: readlink d9/dd/d17/d33/d47/ddd/df5/d109/da6/l94 0 2023-12-16T05:56:51.553 INFO:tasks.workunit.client.1.smithi156.stdout:1/880: dread d3/d17/d1c/d22/d57/d61/dc1/f2e [0,4194304] 0 2023-12-16T05:56:51.554 INFO:tasks.workunit.client.1.smithi156.stdout:1/881: rename d3/d3a/f7a to d3/d17/d1c/d22/d57/dbc/dd9/f122 0 2023-12-16T05:56:51.554 INFO:tasks.workunit.client.1.smithi156.stdout:1/882: fdatasync d3/fc 0 2023-12-16T05:56:51.604 INFO:tasks.workunit.client.1.smithi156.stdout:9/936: sync 2023-12-16T05:56:51.606 INFO:tasks.workunit.client.1.smithi156.stdout:9/937: unlink d6/f15 0 2023-12-16T05:56:51.607 INFO:tasks.workunit.client.1.smithi156.stdout:9/938: truncate d6/d19/d25/d3a/d88/d8b/dac/dc9/fec 8036620 0 2023-12-16T05:56:51.623 INFO:tasks.workunit.client.1.smithi156.stdout:9/939: dwrite d6/d19/d25/d3a/f4a [0,4194304] 0 2023-12-16T05:56:51.632 INFO:tasks.workunit.client.1.smithi156.stdout:9/940: dread d6/d19/d25/d3a/faa [0,4194304] 0 2023-12-16T05:56:51.633 INFO:tasks.workunit.client.1.smithi156.stdout:9/941: mkdir d6/d2e/d137 0 2023-12-16T05:56:51.639 INFO:tasks.workunit.client.1.smithi156.stdout:9/942: dread d6/d19/d30/d5b/f82 [0,4194304] 0 2023-12-16T05:56:51.639 INFO:tasks.workunit.client.1.smithi156.stdout:9/943: dread - d6/d19/d25/d3a/d88/f112 zero size 2023-12-16T05:56:51.641 INFO:tasks.workunit.client.1.smithi156.stdout:9/944: dread d6/d19/d25/d3a/d5e/da9/de1/dfc/fa7 [0,4194304] 0 2023-12-16T05:56:51.641 INFO:tasks.workunit.client.1.smithi156.stdout:9/945: chown d6/da3/db0/f11c 15282202 1 2023-12-16T05:56:51.641 INFO:tasks.workunit.client.1.smithi156.stdout:9/946: truncate d6/d2e/dad/ff1 897927 0 2023-12-16T05:56:51.642 INFO:tasks.workunit.client.1.smithi156.stdout:9/947: truncate d6/d19/d25/f31 356474 0 2023-12-16T05:56:51.651 INFO:tasks.workunit.client.1.smithi156.stdout:9/948: dread d6/d19/d25/d10d/f84 [0,4194304] 0 2023-12-16T05:56:51.651 INFO:tasks.workunit.client.1.smithi156.stdout:9/949: chown d6/d19/d25/fc2 14388 1 2023-12-16T05:56:51.651 INFO:tasks.workunit.client.1.smithi156.stdout:9/950: chown d6/d19/d25/d10d/f101 27309664 1 2023-12-16T05:56:51.652 INFO:tasks.workunit.client.1.smithi156.stdout:9/951: rename d6/d19/d30/dae/db7/l132 to d6/d19/d25/d3a/d80/dc0/dd4/l138 0 2023-12-16T05:56:51.653 INFO:tasks.workunit.client.1.smithi156.stdout:9/952: link d6/d2e/f66 d6/d19/d30/d48/f139 0 2023-12-16T05:56:51.654 INFO:tasks.workunit.client.1.smithi156.stdout:9/953: mkdir d6/d19/d25/d3a/d88/d8b/dac/d13a 0 2023-12-16T05:56:51.656 INFO:tasks.workunit.client.1.smithi156.stdout:9/954: mknod d6/da3/db0/c13b 0 2023-12-16T05:56:51.657 INFO:tasks.workunit.client.1.smithi156.stdout:9/955: mknod d6/d19/d25/d3a/d88/d124/c13c 0 2023-12-16T05:56:51.658 INFO:tasks.workunit.client.1.smithi156.stdout:9/956: link d6/d19/d25/d3a/d88/d8b/dac/dc9/lf5 d6/d19/d25/d3a/d88/d8b/l13d 0 2023-12-16T05:56:51.659 INFO:tasks.workunit.client.1.smithi156.stdout:9/957: mkdir d6/d19/d30/d48/d87/d65/d13e 0 2023-12-16T05:56:51.660 INFO:tasks.workunit.client.1.smithi156.stdout:9/958: link d6/d19/d25/l59 d6/d19/d25/d3a/d88/d8b/dac/l13f 0 2023-12-16T05:56:51.660 INFO:tasks.workunit.client.1.smithi156.stdout:9/959: chown d6/d19/d30/d48/d87/d65/c6a 9 1 2023-12-16T05:56:51.660 INFO:tasks.workunit.client.1.smithi156.stdout:9/960: chown d6/d2e/d8a/da5/le3 0 1 2023-12-16T05:56:51.661 INFO:tasks.workunit.client.1.smithi156.stdout:9/961: creat d6/d19/d25/d3a/d80/dc0/f140 x:0 0 0 2023-12-16T05:56:51.678 INFO:tasks.workunit.client.1.smithi156.stdout:9/962: dwrite d6/d19/f1a [0,4194304] 0 2023-12-16T05:56:51.679 INFO:tasks.workunit.client.1.smithi156.stdout:9/963: write d6/d19/f32 [1863282,87147] 0 2023-12-16T05:56:51.679 INFO:tasks.workunit.client.1.smithi156.stdout:9/964: chown d6/da3/db0/c13b 5623991 1 2023-12-16T05:56:51.680 INFO:tasks.workunit.client.1.smithi156.stdout:9/965: creat d6/d19/d25/f141 x:0 0 0 2023-12-16T05:56:51.680 INFO:tasks.workunit.client.1.smithi156.stdout:9/966: stat d6/fd 0 2023-12-16T05:56:51.681 INFO:tasks.workunit.client.1.smithi156.stdout:9/967: truncate d6/d19/d25/f6f 1560890 0 2023-12-16T05:56:51.681 INFO:tasks.workunit.client.1.smithi156.stdout:9/968: chown d6/d19/d30/dae/db7/le8 2 1 2023-12-16T05:56:51.682 INFO:tasks.workunit.client.1.smithi156.stdout:9/969: dread d6/d19/d30/d5b/f82 [4194304,4194304] 0 2023-12-16T05:56:51.682 INFO:tasks.workunit.client.1.smithi156.stdout:9/970: dread - d6/d19/d30/d48/f92 zero size 2023-12-16T05:56:51.702 INFO:tasks.workunit.client.1.smithi156.stdout:9/971: dwrite d6/d19/d25/fbf [0,4194304] 0 2023-12-16T05:56:51.720 INFO:tasks.workunit.client.1.smithi156.stdout:3/952: sync 2023-12-16T05:56:51.720 INFO:tasks.workunit.client.1.smithi156.stdout:3/953: fsync dc/d10/d3d/f57 0 2023-12-16T05:56:51.721 INFO:tasks.workunit.client.1.smithi156.stdout:3/954: symlink dc/df/dce/l159 0 2023-12-16T05:56:51.721 INFO:tasks.workunit.client.1.smithi156.stdout:3/955: write dc/d10/d1d/d4b/f76 [4609971,130689] 0 2023-12-16T05:56:51.723 INFO:tasks.workunit.client.1.smithi156.stdout:3/956: mkdir dc/d56/d67/dbe/d15a 0 2023-12-16T05:56:51.725 INFO:tasks.workunit.client.1.smithi156.stdout:9/972: dwrite d6/d19/d30/f54 [0,4194304] 0 2023-12-16T05:56:51.748 INFO:tasks.workunit.client.1.smithi156.stdout:3/957: dwrite dc/df/d34/f142 [0,4194304] 0 2023-12-16T05:56:51.748 INFO:tasks.workunit.client.1.smithi156.stdout:9/973: dwrite d6/d19/d30/d48/d87/d65/fa8 [4194304,4194304] 0 2023-12-16T05:56:51.761 INFO:tasks.workunit.client.1.smithi156.stdout:4/962: sync 2023-12-16T05:56:51.761 INFO:tasks.workunit.client.1.smithi156.stdout:2/981: sync 2023-12-16T05:56:51.761 INFO:tasks.workunit.client.1.smithi156.stdout:8/921: sync 2023-12-16T05:56:51.761 INFO:tasks.workunit.client.1.smithi156.stdout:1/883: sync 2023-12-16T05:56:51.762 INFO:tasks.workunit.client.1.smithi156.stdout:4/963: getdents d9/d2c/dbf/dfe 0 2023-12-16T05:56:51.764 INFO:tasks.workunit.client.1.smithi156.stdout:1/884: getdents d3/d17/d1c/d22/d57/dbc 0 2023-12-16T05:56:51.766 INFO:tasks.workunit.client.1.smithi156.stdout:8/922: truncate d3/d7/d62/d106/d11f/de5/df9/f128 657375 0 2023-12-16T05:56:51.766 INFO:tasks.workunit.client.1.smithi156.stdout:8/923: fdatasync d3/d12/d16/d54/d10f/d125/f10c 0 2023-12-16T05:56:51.767 INFO:tasks.workunit.client.1.smithi156.stdout:2/982: creat d9/d68/daa/d83/da1/d96/dca/d111/f136 x:0 0 0 2023-12-16T05:56:51.768 INFO:tasks.workunit.client.1.smithi156.stdout:4/964: mknod d9/d2b/d98/dcd/c144 0 2023-12-16T05:56:51.769 INFO:tasks.workunit.client.1.smithi156.stdout:1/885: creat d3/d17/d1c/d22/d57/d82/d117/f123 x:0 0 0 2023-12-16T05:56:51.770 INFO:tasks.workunit.client.1.smithi156.stdout:8/924: creat d3/d7/d62/d6b/f139 x:0 0 0 2023-12-16T05:56:51.770 INFO:tasks.workunit.client.1.smithi156.stdout:8/925: readlink d3/d12/l4b 0 2023-12-16T05:56:51.771 INFO:tasks.workunit.client.1.smithi156.stdout:4/965: getdents d9/d2c/dbf 0 2023-12-16T05:56:51.771 INFO:tasks.workunit.client.1.smithi156.stdout:9/974: dwrite d6/d19/d25/d3a/d5e/f127 [0,4194304] 0 2023-12-16T05:56:51.772 INFO:tasks.workunit.client.1.smithi156.stdout:3/958: dwrite dc/d10/f24 [0,4194304] 0 2023-12-16T05:56:51.776 INFO:tasks.workunit.client.1.smithi156.stdout:8/926: link d3/d12/d16/f73 d3/d7/d62/dde/f13a 0 2023-12-16T05:56:51.776 INFO:tasks.workunit.client.1.smithi156.stdout:4/966: creat d9/f145 x:0 0 0 2023-12-16T05:56:51.776 INFO:tasks.workunit.client.1.smithi156.stdout:8/927: dread - d3/d7/d62/d6b/f137 zero size 2023-12-16T05:56:51.776 INFO:tasks.workunit.client.1.smithi156.stdout:8/928: write d3/d7/d27/d46/d6e/d3c/f55 [4301287,122536] 0 2023-12-16T05:56:51.785 INFO:tasks.workunit.client.1.smithi156.stdout:4/967: write d9/d2b/d35/fee [3858475,128732] 0 2023-12-16T05:56:51.787 INFO:tasks.workunit.client.1.smithi156.stdout:1/886: dwrite d3/d17/d1c/fa0 [0,4194304] 0 2023-12-16T05:56:51.792 INFO:tasks.workunit.client.1.smithi156.stdout:1/887: creat d3/d17/d1c/d22/d57/d61/f124 x:0 0 0 2023-12-16T05:56:51.793 INFO:tasks.workunit.client.1.smithi156.stdout:1/888: mknod d3/d3a/c125 0 2023-12-16T05:56:51.795 INFO:tasks.workunit.client.1.smithi156.stdout:1/889: creat d3/d17/d4d/dc2/d4f/dca/f126 x:0 0 0 2023-12-16T05:56:51.797 INFO:tasks.workunit.client.1.smithi156.stdout:1/890: mkdir d3/d17/d1c/da5/d101/d127 0 2023-12-16T05:56:51.799 INFO:tasks.workunit.client.1.smithi156.stdout:1/891: rename d3/d17/f33 to d3/d17/d1c/d22/d57/d61/dc1/dbe/f128 0 2023-12-16T05:56:51.800 INFO:tasks.workunit.client.1.smithi156.stdout:1/892: mkdir d3/d17/d1c/d22/d57/d82/d129 0 2023-12-16T05:56:51.805 INFO:tasks.workunit.client.1.smithi156.stdout:3/959: dwrite dc/d10/d3d/df8/f103 [0,4194304] 0 2023-12-16T05:56:51.806 INFO:tasks.workunit.client.1.smithi156.stdout:8/929: dwrite d3/d7/d27/fb0 [0,4194304] 0 2023-12-16T05:56:51.806 INFO:tasks.workunit.client.1.smithi156.stdout:4/968: dwrite d9/d2b/f31 [0,4194304] 0 2023-12-16T05:56:51.806 INFO:tasks.workunit.client.1.smithi156.stdout:4/969: truncate d9/d2c/d7a/dd4/df0/f12b 379807 0 2023-12-16T05:56:51.806 INFO:tasks.workunit.client.1.smithi156.stdout:9/975: write d6/d19/d30/f7c [1372513,5657] 0 2023-12-16T05:56:51.807 INFO:tasks.workunit.client.1.smithi156.stdout:8/930: write d3/d7/d66/d76/f105 [250552,38744] 0 2023-12-16T05:56:51.808 INFO:tasks.workunit.client.1.smithi156.stdout:8/931: read d3/d6/f8a [85903,84209] 0 2023-12-16T05:56:51.808 INFO:tasks.workunit.client.1.smithi156.stdout:4/970: symlink d9/d43/d12f/d137/l146 0 2023-12-16T05:56:51.808 INFO:tasks.workunit.client.1.smithi156.stdout:9/976: mkdir d6/d19/d30/d48/d87/d65/d142 0 2023-12-16T05:56:51.812 INFO:tasks.workunit.client.1.smithi156.stdout:3/960: dread dc/df/d34/d62/f9a [0,4194304] 0 2023-12-16T05:56:51.812 INFO:tasks.workunit.client.1.smithi156.stdout:3/961: readlink dc/df/d34/d62/d75/lab 0 2023-12-16T05:56:51.814 INFO:tasks.workunit.client.1.smithi156.stdout:9/977: dread d6/d19/f32 [0,4194304] 0 2023-12-16T05:56:51.815 INFO:tasks.workunit.client.1.smithi156.stdout:8/932: rmdir d3/d7/d62/d106/d11f/d11d 39 2023-12-16T05:56:51.815 INFO:tasks.workunit.client.1.smithi156.stdout:8/933: write d3/d7/d27/d46/f4e [4968113,46866] 0 2023-12-16T05:56:51.816 INFO:tasks.workunit.client.1.smithi156.stdout:9/978: read d6/f1e [6113539,29010] 0 2023-12-16T05:56:51.816 INFO:tasks.workunit.client.1.smithi156.stdout:4/971: mknod d9/d2c/d7a/dd4/df0/c147 0 2023-12-16T05:56:51.817 INFO:tasks.workunit.client.1.smithi156.stdout:8/934: mknod d3/d7/d66/d76/c13b 0 2023-12-16T05:56:51.818 INFO:tasks.workunit.client.1.smithi156.stdout:9/979: mkdir d6/da3/db0/d12f/d143 0 2023-12-16T05:56:51.819 INFO:tasks.workunit.client.1.smithi156.stdout:4/972: mkdir d9/d2c/d7a/dd4/d148 0 2023-12-16T05:56:51.820 INFO:tasks.workunit.client.1.smithi156.stdout:8/935: creat d3/d7/d27/d46/d6e/d3b/f13c x:0 0 0 2023-12-16T05:56:51.822 INFO:tasks.workunit.client.1.smithi156.stdout:4/973: rename d9/d2c/dbf/fc6 to d9/d2c/d48/f149 0 2023-12-16T05:56:51.824 INFO:tasks.workunit.client.1.smithi156.stdout:8/936: creat d3/d12/d16/d54/f13d x:0 0 0 2023-12-16T05:56:51.824 INFO:tasks.workunit.client.1.smithi156.stdout:8/937: dread - d3/d7/d27/d46/d84/fe0 zero size 2023-12-16T05:56:51.828 INFO:tasks.workunit.client.1.smithi156.stdout:8/938: rename d3/d7/d66/l89 to d3/d12/d16/db4/de9/l13e 0 2023-12-16T05:56:51.830 INFO:tasks.workunit.client.1.smithi156.stdout:8/939: symlink d3/d7/d62/dc4/l13f 0 2023-12-16T05:56:51.830 INFO:tasks.workunit.client.1.smithi156.stdout:8/940: fdatasync d3/d7/d27/d46/d6e/d3c/f10d 0 2023-12-16T05:56:51.830 INFO:tasks.workunit.client.1.smithi156.stdout:8/941: chown d3/d7/d27/fb6 531 1 2023-12-16T05:56:51.832 INFO:tasks.workunit.client.1.smithi156.stdout:8/942: mkdir d3/d12/d74/d140 0 2023-12-16T05:56:51.833 INFO:tasks.workunit.client.1.smithi156.stdout:8/943: mkdir d3/d7/d141 0 2023-12-16T05:56:51.834 INFO:tasks.workunit.client.1.smithi156.stdout:8/944: write d3/d7a/d7d/fc7 [2902431,58177] 0 2023-12-16T05:56:51.834 INFO:tasks.workunit.client.1.smithi156.stdout:8/945: truncate d3/d6/f8c 1240578 0 2023-12-16T05:56:51.834 INFO:tasks.workunit.client.1.smithi156.stdout:3/962: dwrite dc/d10/d3d/db5/fcf [0,4194304] 0 2023-12-16T05:56:51.834 INFO:tasks.workunit.client.1.smithi156.stdout:8/946: rmdir d3/d135 39 2023-12-16T05:56:51.834 INFO:tasks.workunit.client.1.smithi156.stdout:8/947: chown d3/d7/d27/d46/d6e/d3c/c92 790384 1 2023-12-16T05:56:51.836 INFO:tasks.workunit.client.1.smithi156.stdout:3/963: unlink l9 0 2023-12-16T05:56:51.837 INFO:tasks.workunit.client.1.smithi156.stdout:9/980: dwrite d6/d19/d30/d5b/d9a/fe2 [0,4194304] 0 2023-12-16T05:56:51.837 INFO:tasks.workunit.client.1.smithi156.stdout:9/981: chown d6/d2e/f52 527157181 1 2023-12-16T05:56:51.840 INFO:tasks.workunit.client.1.smithi156.stdout:8/948: rmdir d3/d7/d66/d76 39 2023-12-16T05:56:51.845 INFO:tasks.workunit.client.1.smithi156.stdout:9/982: unlink d6/d19/d30/d48/f92 0 2023-12-16T05:56:51.846 INFO:tasks.workunit.client.1.smithi156.stdout:8/949: mknod d3/d7/d62/dde/c142 0 2023-12-16T05:56:51.846 INFO:tasks.workunit.client.1.smithi156.stdout:8/950: dread - d3/d7/d27/d46/d6e/d3c/fdb zero size 2023-12-16T05:56:51.849 INFO:tasks.workunit.client.1.smithi156.stdout:9/983: rmdir d6/d19/d25/d3a/d80/dc0/de9/d129 0 2023-12-16T05:56:51.850 INFO:tasks.workunit.client.1.smithi156.stdout:8/951: mknod d3/d12/d74/c143 0 2023-12-16T05:56:51.850 INFO:tasks.workunit.client.1.smithi156.stdout:8/952: write d3/d7/d66/fc3 [488157,108180] 0 2023-12-16T05:56:51.851 INFO:tasks.workunit.client.1.smithi156.stdout:9/984: creat d6/d19/d25/d3a/d5e/da9/d131/f144 x:0 0 0 2023-12-16T05:56:51.851 INFO:tasks.workunit.client.1.smithi156.stdout:9/985: read d6/d2e/f114 [317753,42020] 0 2023-12-16T05:56:51.852 INFO:tasks.workunit.client.1.smithi156.stdout:8/953: rename d3/d7/d66/d76/c116 to d3/d7/d141/c144 0 2023-12-16T05:56:51.854 INFO:tasks.workunit.client.1.smithi156.stdout:9/986: mkdir d6/d19/d25/d3a/dc3/d145 0 2023-12-16T05:56:51.854 INFO:tasks.workunit.client.1.smithi156.stdout:9/987: stat d6/d19/d25/d3a/dc3/ffa 0 2023-12-16T05:56:51.855 INFO:tasks.workunit.client.1.smithi156.stdout:9/988: truncate d6/d19/d25/d3a/dc3/ffa 4053052 0 2023-12-16T05:56:51.858 INFO:tasks.workunit.client.1.smithi156.stdout:9/989: read d6/d19/d30/dae/fc6 [3587663,8044] 0 2023-12-16T05:56:51.860 INFO:tasks.workunit.client.1.smithi156.stdout:3/964: dwrite dc/d56/d67/d6e/fe2 [4194304,4194304] 0 2023-12-16T05:56:51.866 INFO:tasks.workunit.client.1.smithi156.stdout:3/965: creat dc/d10/d1d/d90/d146/f15b x:0 0 0 2023-12-16T05:56:51.868 INFO:tasks.workunit.client.1.smithi156.stdout:3/966: link dc/df/d66/fdd dc/d10/d1d/d4b/f15c 0 2023-12-16T05:56:51.870 INFO:tasks.workunit.client.1.smithi156.stdout:3/967: creat dc/d56/d67/dbe/f15d x:0 0 0 2023-12-16T05:56:51.873 INFO:tasks.workunit.client.1.smithi156.stdout:3/968: unlink dc/d10/d3d/l30 0 2023-12-16T05:56:51.873 INFO:tasks.workunit.client.1.smithi156.stdout:3/969: chown dc/df/f2b 796 1 2023-12-16T05:56:51.873 INFO:tasks.workunit.client.1.smithi156.stdout:3/970: read dc/df/d34/d62/f8d [509029,5866] 0 2023-12-16T05:56:51.873 INFO:tasks.workunit.client.1.smithi156.stdout:3/971: write dc/df/d34/f3f [770328,115760] 0 2023-12-16T05:56:51.874 INFO:tasks.workunit.client.1.smithi156.stdout:3/972: truncate dc/d10/d3d/f91 708310 0 2023-12-16T05:56:51.882 INFO:tasks.workunit.client.1.smithi156.stdout:8/954: dwrite d3/d7a/d7d/fa6 [0,4194304] 0 2023-12-16T05:56:51.885 INFO:tasks.workunit.client.1.smithi156.stdout:8/955: read d3/d7a/d7d/dae/f57 [1121207,12715] 0 2023-12-16T05:56:51.885 INFO:tasks.workunit.client.1.smithi156.stdout:9/990: dwrite d6/ff [0,4194304] 0 2023-12-16T05:56:51.885 INFO:tasks.workunit.client.1.smithi156.stdout:9/991: truncate d6/d19/d30/d48/fa4 182992 0 2023-12-16T05:56:51.886 INFO:tasks.workunit.client.1.smithi156.stdout:8/956: symlink d3/d7/d27/d46/d6e/d3b/l145 0 2023-12-16T05:56:51.888 INFO:tasks.workunit.client.1.smithi156.stdout:9/992: link d6/d2e/d8a/da5/fd9 d6/d2e/d137/f146 0 2023-12-16T05:56:51.888 INFO:tasks.workunit.client.1.smithi156.stdout:8/957: creat d3/d7/d27/d46/d6e/f146 x:0 0 0 2023-12-16T05:56:51.889 INFO:tasks.workunit.client.1.smithi156.stdout:9/993: rename d6/d2e/d8a/ccb to d6/d19/d25/c147 0 2023-12-16T05:56:51.890 INFO:tasks.workunit.client.1.smithi156.stdout:9/994: chown d6/d19/d25/d3a/dc3/cdc 171706250 1 2023-12-16T05:56:51.891 INFO:tasks.workunit.client.1.smithi156.stdout:8/958: rename d3/d12/d16/d54/d10f/d125/fd8 to d3/d7/d62/dc4/f147 0 2023-12-16T05:56:51.893 INFO:tasks.workunit.client.1.smithi156.stdout:8/959: mknod d3/d7/d62/d106/d11f/de5/c148 0 2023-12-16T05:56:51.895 INFO:tasks.workunit.client.1.smithi156.stdout:9/995: unlink d6/cb 0 2023-12-16T05:56:51.897 INFO:tasks.workunit.client.1.smithi156.stdout:3/973: dwrite dc/d56/d67/d104/f108 [0,4194304] 0 2023-12-16T05:56:51.900 INFO:tasks.workunit.client.1.smithi156.stdout:3/974: symlink dc/d10/d3d/df8/l15e 0 2023-12-16T05:56:51.900 INFO:tasks.workunit.client.1.smithi156.stdout:3/975: dread - dc/d56/d67/dbe/df9/f149 zero size 2023-12-16T05:56:51.901 INFO:tasks.workunit.client.1.smithi156.stdout:9/996: dread d6/d19/d25/d3a/d80/dc0/dd0/fdf [0,4194304] 0 2023-12-16T05:56:51.903 INFO:tasks.workunit.client.1.smithi156.stdout:9/997: write d6/d19/d25/d3a/f43 [8952063,31325] 0 2023-12-16T05:56:51.905 INFO:tasks.workunit.client.1.smithi156.stdout:9/998: creat d6/d2e/d8a/da5/d119/f148 x:0 0 0 2023-12-16T05:56:51.906 INFO:tasks.workunit.client.1.smithi156.stdout:9/999: truncate d6/d19/d25/fc2 3999690 0 2023-12-16T05:56:51.910 INFO:tasks.workunit.client.1.smithi156.stdout:3/976: rmdir dc/d10/d1d/d90/d146 39 2023-12-16T05:56:51.910 INFO:tasks.workunit.client.1.smithi156.stdout:3/977: write dc/d56/d67/dbe/df9/d14b/f137 [985554,98401] 0 2023-12-16T05:56:51.912 INFO:tasks.workunit.client.1.smithi156.stdout:3/978: getdents dc/d56/d67/dbe 0 2023-12-16T05:56:51.912 INFO:tasks.workunit.client.1.smithi156.stdout:3/979: chown dc/d10/d1d 6734725 1 2023-12-16T05:56:51.912 INFO:tasks.workunit.client.1.smithi156.stdout:3/980: dread - dc/df/dce/fd2 zero size 2023-12-16T05:56:51.912 INFO:tasks.workunit.client.1.smithi156.stdout:3/981: truncate dc/d56/d67/fdc 592822 0 2023-12-16T05:56:51.914 INFO:tasks.workunit.client.1.smithi156.stdout:3/982: mknod dc/d56/d67/dbe/dc3/ded/d121/c15f 0 2023-12-16T05:56:51.918 INFO:tasks.workunit.client.1.smithi156.stdout:3/983: rename dc/df/d34/d62/d75/f151 to dc/d56/f160 0 2023-12-16T05:56:51.919 INFO:tasks.workunit.client.1.smithi156.stdout:3/984: creat dc/d10/d3d/d4e/f161 x:0 0 0 2023-12-16T05:56:51.922 INFO:tasks.workunit.client.1.smithi156.stdout:3/985: link dc/df/d34/d62/d75/f12f dc/d56/d67/dbe/f162 0 2023-12-16T05:56:51.924 INFO:tasks.workunit.client.1.smithi156.stdout:3/986: symlink dc/df/l163 0 2023-12-16T05:56:51.924 INFO:tasks.workunit.client.1.smithi156.stdout:3/987: readlink dc/d56/d67/dbe/dd9/lde 0 2023-12-16T05:56:51.942 INFO:tasks.workunit.client.1.smithi156.stdout:3/988: dwrite dc/d56/f12c [0,4194304] 0 2023-12-16T05:56:51.946 INFO:tasks.workunit.client.1.smithi156.stdout:3/989: link dc/d10/d3d/df8/l127 dc/d56/d67/dbe/df9/l164 0 2023-12-16T05:56:51.946 INFO:tasks.workunit.client.1.smithi156.stdout:3/990: rmdir dc/d10/d1d/d4b/d52 39 2023-12-16T05:56:51.949 INFO:tasks.workunit.client.1.smithi156.stdout:3/991: mknod dc/df/dce/c165 0 2023-12-16T05:56:51.949 INFO:tasks.workunit.client.1.smithi156.stdout:3/992: write dc/df/d66/fda [567679,2764] 0 2023-12-16T05:56:51.951 INFO:tasks.workunit.client.1.smithi156.stdout:3/993: rename dc/d10/d3d/d4e/d136/d141/c145 to dc/d56/d67/c166 0 2023-12-16T05:56:51.951 INFO:tasks.workunit.client.1.smithi156.stdout:3/994: fdatasync dc/d56/d67/fc9 0 2023-12-16T05:56:51.974 INFO:tasks.workunit.client.1.smithi156.stdout:3/995: dwrite dc/f19 [0,4194304] 0 2023-12-16T05:56:51.977 INFO:tasks.workunit.client.1.smithi156.stdout:3/996: creat dc/d10/d1d/d4b/d52/f167 x:0 0 0 2023-12-16T05:56:51.979 INFO:tasks.workunit.client.1.smithi156.stdout:3/997: write dc/d10/d3d/d4e/d136/faa [191539,125687] 0 2023-12-16T05:56:51.979 INFO:tasks.workunit.client.1.smithi156.stdout:3/998: stat dc/d56/d67/dbe/f15d 0 2023-12-16T05:56:51.981 INFO:tasks.workunit.client.1.smithi156.stdout:3/999: link dc/d10/f18 dc/df/f168 0 2023-12-16T05:56:52.009 INFO:tasks.workunit.client.1.smithi156.stdout:4/974: sync 2023-12-16T05:56:52.010 INFO:tasks.workunit.client.1.smithi156.stdout:1/893: sync 2023-12-16T05:56:52.010 INFO:tasks.workunit.client.1.smithi156.stdout:2/983: sync 2023-12-16T05:56:52.010 INFO:tasks.workunit.client.1.smithi156.stdout:8/960: sync 2023-12-16T05:56:52.010 INFO:tasks.workunit.client.1.smithi156.stdout:4/975: creat d9/d2c/dbf/dfa/d7d/f14a x:0 0 0 2023-12-16T05:56:52.011 INFO:tasks.workunit.client.1.smithi156.stdout:1/894: stat d3/d17/d1c/da5/ce8 0 2023-12-16T05:56:52.011 INFO:tasks.workunit.client.1.smithi156.stdout:1/895: stat d3/d17/d4d/c5f 0 2023-12-16T05:56:52.011 INFO:tasks.workunit.client.1.smithi156.stdout:1/896: fdatasync d3/d17/d4d/dc2/d4f/d75/fe7 0 2023-12-16T05:56:52.012 INFO:tasks.workunit.client.1.smithi156.stdout:8/961: unlink d3/d12/f70 0 2023-12-16T05:56:52.012 INFO:tasks.workunit.client.1.smithi156.stdout:8/962: chown d3/d7/d62/d106/d11f/de5/df9/f10b 1380707 1 2023-12-16T05:56:52.012 INFO:tasks.workunit.client.1.smithi156.stdout:8/963: fdatasync d3/d7a/d7d/dae/fd6 0 2023-12-16T05:56:52.013 INFO:tasks.workunit.client.1.smithi156.stdout:1/897: creat d3/d1b/f12a x:0 0 0 2023-12-16T05:56:52.013 INFO:tasks.workunit.client.1.smithi156.stdout:1/898: chown d3/d17/d1c/d22/d57/d61/dc1/dbe/dd2/d11b 506236 1 2023-12-16T05:56:52.013 INFO:tasks.workunit.client.1.smithi156.stdout:1/899: dread - d3/d17/d2d/f120 zero size 2023-12-16T05:56:52.018 INFO:tasks.workunit.client.1.smithi156.stdout:8/964: dread d3/d7/d27/d46/d84/fa3 [0,4194304] 0 2023-12-16T05:56:52.018 INFO:tasks.workunit.client.1.smithi156.stdout:8/965: chown d3/d7/d62/d6b/ld5 5630 1 2023-12-16T05:56:52.018 INFO:tasks.workunit.client.1.smithi156.stdout:8/966: write d3/d7/d66/f82 [4909422,16324] 0 2023-12-16T05:56:52.018 INFO:tasks.workunit.client.1.smithi156.stdout:8/967: chown d3/d12/f3d 581 1 2023-12-16T05:56:52.021 INFO:tasks.workunit.client.1.smithi156.stdout:8/968: symlink d3/d7/d62/d106/d11f/d11d/def/l149 0 2023-12-16T05:56:52.021 INFO:tasks.workunit.client.1.smithi156.stdout:2/984: dread d9/d12/fb1 [4194304,4194304] 0 2023-12-16T05:56:52.022 INFO:tasks.workunit.client.1.smithi156.stdout:2/985: rmdir d9/d56/d5f 39 2023-12-16T05:56:52.024 INFO:tasks.workunit.client.1.smithi156.stdout:2/986: mknod d9/d68/daa/d83/da1/c137 0 2023-12-16T05:56:52.024 INFO:tasks.workunit.client.1.smithi156.stdout:2/987: write d9/dd/d17/d33/d47/fec [285211,105888] 0 2023-12-16T05:56:52.024 INFO:tasks.workunit.client.1.smithi156.stdout:2/988: chown d9/d12/f5e 3 1 2023-12-16T05:56:52.025 INFO:tasks.workunit.client.1.smithi156.stdout:2/989: creat d9/dd/d17/d8f/d124/f138 x:0 0 0 2023-12-16T05:56:52.025 INFO:tasks.workunit.client.1.smithi156.stdout:2/990: getdents d9/dd/d17/d33/d47/d9e 0 2023-12-16T05:56:52.026 INFO:tasks.workunit.client.1.smithi156.stdout:2/991: creat d9/f139 x:0 0 0 2023-12-16T05:56:52.027 INFO:tasks.workunit.client.1.smithi156.stdout:2/992: creat d9/dd/d17/d33/d47/ddd/d115/f13a x:0 0 0 2023-12-16T05:56:52.030 INFO:tasks.workunit.client.1.smithi156.stdout:8/969: dread d3/d7a/f81 [4194304,4194304] 0 2023-12-16T05:56:52.031 INFO:tasks.workunit.client.1.smithi156.stdout:8/970: chown d3/d12/d16/d54/d10f/d125/c118 1 1 2023-12-16T05:56:52.031 INFO:tasks.workunit.client.1.smithi156.stdout:8/971: fsync d3/d12/d74/ff7 0 2023-12-16T05:56:52.031 INFO:tasks.workunit.client.1.smithi156.stdout:8/972: chown d3/d12 78028 1 2023-12-16T05:56:52.031 INFO:tasks.workunit.client.1.smithi156.stdout:8/973: truncate d3/d12/d74/fe8 405577 0 2023-12-16T05:56:52.031 INFO:tasks.workunit.client.1.smithi156.stdout:8/974: fdatasync d3/d7/d27/d46/d6e/f146 0 2023-12-16T05:56:52.031 INFO:tasks.workunit.client.1.smithi156.stdout:1/900: dwrite d3/d17/d1c/d22/d57/f105 [0,4194304] 0 2023-12-16T05:56:52.032 INFO:tasks.workunit.client.1.smithi156.stdout:8/975: symlink d3/d6/l14a 0 2023-12-16T05:56:52.036 INFO:tasks.workunit.client.1.smithi156.stdout:1/901: getdents d3/d17 0 2023-12-16T05:56:52.036 INFO:tasks.workunit.client.1.smithi156.stdout:1/902: chown d3/d1b/d8b/l99 0 1 2023-12-16T05:56:52.037 INFO:tasks.workunit.client.1.smithi156.stdout:8/976: symlink d3/d12/d16/d54/l14b 0 2023-12-16T05:56:52.039 INFO:tasks.workunit.client.1.smithi156.stdout:1/903: write d3/d17/d1c/d22/d57/d61/dc1/fff [1255469,47084] 0 2023-12-16T05:56:52.039 INFO:tasks.workunit.client.1.smithi156.stdout:8/977: dread d3/f5c [4194304,4194304] 0 2023-12-16T05:56:52.039 INFO:tasks.workunit.client.1.smithi156.stdout:8/978: truncate d3/d7/d27/d46/d6e/f146 596548 0 2023-12-16T05:56:52.039 INFO:tasks.workunit.client.1.smithi156.stdout:8/979: chown d3/d6/l11a 15894637 1 2023-12-16T05:56:52.040 INFO:tasks.workunit.client.1.smithi156.stdout:1/904: getdents d3/d17/d1c/d22/d57/d82 0 2023-12-16T05:56:52.041 INFO:tasks.workunit.client.1.smithi156.stdout:8/980: write d3/d7a/d7d/fa6 [2077041,91782] 0 2023-12-16T05:56:52.041 INFO:tasks.workunit.client.1.smithi156.stdout:8/981: write d3/d12/d16/f12e [722813,96696] 0 2023-12-16T05:56:52.041 INFO:tasks.workunit.client.1.smithi156.stdout:1/905: mknod d3/dd0/c12b 0 2023-12-16T05:56:52.041 INFO:tasks.workunit.client.1.smithi156.stdout:8/982: write d3/d7/d27/d46/d84/fa3 [1065878,42742] 0 2023-12-16T05:56:52.044 INFO:tasks.workunit.client.1.smithi156.stdout:1/906: unlink d3/d17/d1c/d22/d57/d61/dc1/dbe/dd2/d11b/ced 0 2023-12-16T05:56:52.046 INFO:tasks.workunit.client.1.smithi156.stdout:8/983: creat d3/d12/d12b/f14c x:0 0 0 2023-12-16T05:56:52.047 INFO:tasks.workunit.client.1.smithi156.stdout:1/907: creat d3/d17/d4d/dc2/d4f/f12c x:0 0 0 2023-12-16T05:56:52.049 INFO:tasks.workunit.client.1.smithi156.stdout:8/984: rename d3/d7a/f9a to d3/f14d 0 2023-12-16T05:56:52.049 INFO:tasks.workunit.client.1.smithi156.stdout:8/985: readlink d3/d7a/d7d/dae/d94/la1 0 2023-12-16T05:56:52.049 INFO:tasks.workunit.client.1.smithi156.stdout:8/986: write d3/d7/d66/fc3 [1329167,39531] 0 2023-12-16T05:56:52.050 INFO:tasks.workunit.client.1.smithi156.stdout:8/987: mkdir d3/d14e 0 2023-12-16T05:56:52.051 INFO:tasks.workunit.client.1.smithi156.stdout:2/993: dwrite d9/dd/d17/d33/d47/ddd/d115/f13a [0,4194304] 0 2023-12-16T05:56:52.063 INFO:tasks.workunit.client.1.smithi156.stdout:8/988: dwrite d3/d12/f123 [0,4194304] 0 2023-12-16T05:56:52.072 INFO:tasks.workunit.client.1.smithi156.stdout:2/994: creat d9/d68/daa/d83/d126/f13b x:0 0 0 2023-12-16T05:56:52.072 INFO:tasks.workunit.client.1.smithi156.stdout:2/995: chown d9/dd/d17/d33/def/ffc 57628 1 2023-12-16T05:56:52.079 INFO:tasks.workunit.client.1.smithi156.stdout:8/989: unlink d3/d7/d66/f82 0 2023-12-16T05:56:52.079 INFO:tasks.workunit.client.1.smithi156.stdout:8/990: truncate d3/d7a/d7d/dae/ff0 283827 0 2023-12-16T05:56:52.080 INFO:tasks.workunit.client.1.smithi156.stdout:2/996: creat d9/d68/daa/d83/da1/f13c x:0 0 0 2023-12-16T05:56:52.081 INFO:tasks.workunit.client.1.smithi156.stdout:8/991: creat d3/d135/f14f x:0 0 0 2023-12-16T05:56:52.098 INFO:tasks.workunit.client.1.smithi156.stdout:8/992: dwrite d3/d6/f8a [0,4194304] 0 2023-12-16T05:56:52.102 INFO:tasks.workunit.client.1.smithi156.stdout:8/993: rmdir d3/d12 39 2023-12-16T05:56:52.103 INFO:tasks.workunit.client.1.smithi156.stdout:2/997: dwrite d9/dd/d17/d33/d47/ddd/df5/d109/dad/fc3 [0,4194304] 0 2023-12-16T05:56:52.103 INFO:tasks.workunit.client.1.smithi156.stdout:8/994: creat d3/d7/d66/d76/f150 x:0 0 0 2023-12-16T05:56:52.105 INFO:tasks.workunit.client.1.smithi156.stdout:8/995: rename d3/d7/d62/d106/d11f/d11d/l102 to d3/d14e/l151 0 2023-12-16T05:56:52.106 INFO:tasks.workunit.client.1.smithi156.stdout:8/996: creat d3/d7/d27/f152 x:0 0 0 2023-12-16T05:56:52.106 INFO:tasks.workunit.client.1.smithi156.stdout:8/997: dread - d3/d12/d16/db4/fcb zero size 2023-12-16T05:56:52.107 INFO:tasks.workunit.client.1.smithi156.stdout:8/998: creat d3/d7/d62/dca/f153 x:0 0 0 2023-12-16T05:56:52.109 INFO:tasks.workunit.client.1.smithi156.stdout:8/999: truncate d3/d7/d66/d76/fad 349837 0 2023-12-16T05:56:52.113 INFO:tasks.workunit.client.1.smithi156.stdout:2/998: dwrite d9/dd/d17/d33/d78/d74/d101/f134 [0,4194304] 0 2023-12-16T05:56:52.116 INFO:tasks.workunit.client.1.smithi156.stdout:2/999: mkdir d9/dd/d17/d33/d11a/d13d 0 2023-12-16T05:56:52.169 INFO:tasks.workunit.client.1.smithi156.stdout:4/976: sync 2023-12-16T05:56:52.169 INFO:tasks.workunit.client.1.smithi156.stdout:4/977: dread - d9/d43/d12f/d137/f138 zero size 2023-12-16T05:56:52.169 INFO:tasks.workunit.client.1.smithi156.stdout:4/978: symlink d9/d43/d12f/d137/l14b 0 2023-12-16T05:56:52.170 INFO:tasks.workunit.client.1.smithi156.stdout:4/979: getdents d9/d2c/dbf/dfa/d7d/d82 0 2023-12-16T05:56:52.170 INFO:tasks.workunit.client.1.smithi156.stdout:4/980: stat d9/d43/f4b 0 2023-12-16T05:56:52.170 INFO:tasks.workunit.client.1.smithi156.stdout:4/981: write d9/d2b/d35/f132 [611512,45719] 0 2023-12-16T05:56:52.171 INFO:tasks.workunit.client.1.smithi156.stdout:4/982: mknod d9/d2c/dbf/dfa/d95/c14c 0 2023-12-16T05:56:52.172 INFO:tasks.workunit.client.1.smithi156.stdout:4/983: stat d9/d2b/d98/dcd/fe8 0 2023-12-16T05:56:52.172 INFO:tasks.workunit.client.1.smithi156.stdout:4/984: unlink d9/f37 0 2023-12-16T05:56:52.172 INFO:tasks.workunit.client.1.smithi156.stdout:4/985: dread - d9/d2b/d9a/fe4 zero size 2023-12-16T05:56:52.172 INFO:tasks.workunit.client.1.smithi156.stdout:4/986: chown d9/d2c/dbf/dfe/f134 985336588 1 2023-12-16T05:56:52.182 INFO:tasks.workunit.client.1.smithi156.stdout:4/987: dread d9/f1b [0,4194304] 0 2023-12-16T05:56:52.182 INFO:tasks.workunit.client.1.smithi156.stdout:4/988: chown d9/d2c/d7a/dd4 250923 1 2023-12-16T05:56:52.182 INFO:tasks.workunit.client.1.smithi156.stdout:4/989: chown d9/d2c/dbf/dfa/d95/c112 1057 1 2023-12-16T05:56:52.182 INFO:tasks.workunit.client.1.smithi156.stdout:4/990: dread - d9/d2b/d9a/ff2 zero size 2023-12-16T05:56:52.183 INFO:tasks.workunit.client.1.smithi156.stdout:4/991: mkdir d9/d2c/d7a/dd4/d148/d14d 0 2023-12-16T05:56:52.183 INFO:tasks.workunit.client.1.smithi156.stdout:4/992: write d9/f27 [9297529,94107] 0 2023-12-16T05:56:52.183 INFO:tasks.workunit.client.1.smithi156.stdout:4/993: fdatasync d9/d2b/d35/f53 0 2023-12-16T05:56:52.183 INFO:tasks.workunit.client.1.smithi156.stdout:4/994: chown d9/d2c/d7a/dd4/feb 1278304 1 2023-12-16T05:56:52.183 INFO:tasks.workunit.client.1.smithi156.stdout:4/995: fsync d9/d2c/dbf/dfa/d7d/d100/f104 0 2023-12-16T05:56:52.184 INFO:tasks.workunit.client.1.smithi156.stdout:4/996: mkdir d9/d2c/dbf/d14e 0 2023-12-16T05:56:52.184 INFO:tasks.workunit.client.1.smithi156.stdout:4/997: symlink d9/d2c/dbf/l14f 0 2023-12-16T05:56:52.185 INFO:tasks.workunit.client.1.smithi156.stdout:4/998: link f5 d9/d2c/dbf/dfe/f150 0 2023-12-16T05:56:52.187 INFO:tasks.workunit.client.1.smithi156.stdout:4/999: write d9/d2c/d48/fe1 [792963,2950] 0 2023-12-16T05:56:52.214 INFO:tasks.workunit.client.1.smithi156.stdout:1/908: sync 2023-12-16T05:56:52.215 INFO:tasks.workunit.client.1.smithi156.stdout:1/909: rmdir d3/d17/daa 39 2023-12-16T05:56:52.215 INFO:tasks.workunit.client.1.smithi156.stdout:1/910: write d3/d17/d2d/fe0 [323910,17950] 0 2023-12-16T05:56:52.221 INFO:tasks.workunit.client.1.smithi156.stdout:1/911: dread d3/d17/d1c/d22/fa3 [0,4194304] 0 2023-12-16T05:56:52.222 INFO:tasks.workunit.client.1.smithi156.stdout:1/912: symlink d3/d17/d4d/dc2/dd8/d110/l12d 0 2023-12-16T05:56:52.223 INFO:tasks.workunit.client.1.smithi156.stdout:1/913: creat d3/d17/d1c/d22/f12e x:0 0 0 2023-12-16T05:56:52.224 INFO:tasks.workunit.client.1.smithi156.stdout:1/914: getdents d3/d17/d2d 0 2023-12-16T05:56:52.225 INFO:tasks.workunit.client.1.smithi156.stdout:1/915: symlink d3/d17/d1c/d22/d57/d61/dc1/dbe/l12f 0 2023-12-16T05:56:52.228 INFO:tasks.workunit.client.1.smithi156.stdout:1/916: dread d3/d17/d1c/d22/fa3 [0,4194304] 0 2023-12-16T05:56:52.228 INFO:tasks.workunit.client.1.smithi156.stdout:1/917: rmdir d3 39 2023-12-16T05:56:52.245 INFO:tasks.workunit.client.1.smithi156.stdout:1/918: dwrite d3/d3a/f106 [0,4194304] 0 2023-12-16T05:56:52.246 INFO:tasks.workunit.client.1.smithi156.stdout:1/919: write d3/d17/d2d/f4e [259507,112346] 0 2023-12-16T05:56:52.247 INFO:tasks.workunit.client.1.smithi156.stdout:1/920: creat d3/d17/d4d/dc2/d4f/d75/f130 x:0 0 0 2023-12-16T05:56:52.247 INFO:tasks.workunit.client.1.smithi156.stdout:1/921: chown d3/d1b/le5 8040 1 2023-12-16T05:56:52.254 INFO:tasks.workunit.client.1.smithi156.stdout:1/922: write d3/d17/d1c/d22/d57/d61/dc1/f107 [1633123,9488] 0 2023-12-16T05:56:52.254 INFO:tasks.workunit.client.1.smithi156.stdout:1/923: readlink d3/d17/d1c/d22/d57/d61/dc1/l97 0 2023-12-16T05:56:52.254 INFO:tasks.workunit.client.1.smithi156.stdout:1/924: chown d3/fae 4 1 2023-12-16T05:56:52.254 INFO:tasks.workunit.client.1.smithi156.stdout:1/925: stat d3/d17/d1c/c23 0 2023-12-16T05:56:52.254 INFO:tasks.workunit.client.1.smithi156.stdout:1/926: dread - d3/d17/d1c/d22/d57/d61/f124 zero size 2023-12-16T05:56:52.255 INFO:tasks.workunit.client.1.smithi156.stdout:1/927: unlink d3/d3a/c71 0 2023-12-16T05:56:52.256 INFO:tasks.workunit.client.1.smithi156.stdout:1/928: write d3/d1b/d8b/f8e [608147,79801] 0 2023-12-16T05:56:52.256 INFO:tasks.workunit.client.1.smithi156.stdout:1/929: mkdir d3/d17/d1c/d22/d57/d61/d131 0 2023-12-16T05:56:52.258 INFO:tasks.workunit.client.1.smithi156.stdout:1/930: rename d3/d17/d4d/dc2/dd8/d110/c11e to d3/d17/d1c/c132 0 2023-12-16T05:56:52.258 INFO:tasks.workunit.client.1.smithi156.stdout:1/931: fsync d3/d17/d1c/d22/d57/d82/f11d 0 2023-12-16T05:56:52.259 INFO:tasks.workunit.client.1.smithi156.stdout:1/932: rename d3/d3a/da9/fc0 to d3/d17/d1c/d22/d57/d61/dc1/dbe/f133 0 2023-12-16T05:56:52.259 INFO:tasks.workunit.client.1.smithi156.stdout:1/933: readlink d3/d17/daa/l108 0 2023-12-16T05:56:52.260 INFO:tasks.workunit.client.1.smithi156.stdout:1/934: unlink d3/d17/d4d/la1 0 2023-12-16T05:56:52.261 INFO:tasks.workunit.client.1.smithi156.stdout:1/935: link d3/d17/d1c/d22/d57/d61/dc1/fa6 d3/d17/d4d/dc2/f134 0 2023-12-16T05:56:52.261 INFO:tasks.workunit.client.1.smithi156.stdout:1/936: chown d3/d1b/c98 21095 1 2023-12-16T05:56:52.262 INFO:tasks.workunit.client.1.smithi156.stdout:1/937: symlink d3/d17/d4d/dc2/d4f/d75/l135 0 2023-12-16T05:56:52.273 INFO:tasks.workunit.client.1.smithi156.stdout:1/938: dwrite d3/d17/d4d/dc2/d4f/d75/fe7 [0,4194304] 0 2023-12-16T05:56:52.273 INFO:tasks.workunit.client.1.smithi156.stdout:1/939: fsync d3/f18 0 2023-12-16T05:56:52.277 INFO:tasks.workunit.client.1.smithi156.stdout:1/940: mknod d3/d17/d4d/dc2/d4f/dca/c136 0 2023-12-16T05:56:52.278 INFO:tasks.workunit.client.1.smithi156.stdout:1/941: chown d3/d17/c69 422604355 1 2023-12-16T05:56:52.278 INFO:tasks.workunit.client.1.smithi156.stdout:1/942: chown d3/d17/d1c/d22/d57/d61/dc1/dbe/dd2/d11b/fad 58744955 1 2023-12-16T05:56:52.278 INFO:tasks.workunit.client.1.smithi156.stdout:1/943: readlink d3/d17/d4d/dc2/d4f/dca/lda 0 2023-12-16T05:56:52.278 INFO:tasks.workunit.client.1.smithi156.stdout:1/944: getdents d3/d17/daa 0 2023-12-16T05:56:52.278 INFO:tasks.workunit.client.1.smithi156.stdout:1/945: chown d3/d17/d1c/d22/d57/f68 757 1 2023-12-16T05:56:52.278 INFO:tasks.workunit.client.1.smithi156.stdout:1/946: creat d3/d17/d4d/dc2/d109/f137 x:0 0 0 2023-12-16T05:56:52.293 INFO:tasks.workunit.client.1.smithi156.stdout:1/947: dwrite d3/d17/d1c/d22/d57/d61/dc1/fa6 [4194304,4194304] 0 2023-12-16T05:56:52.293 INFO:tasks.workunit.client.1.smithi156.stdout:1/948: stat d3/d17/d1c/d22/d57/d61/dc1/f107 0 2023-12-16T05:56:52.295 INFO:tasks.workunit.client.1.smithi156.stdout:1/949: write d3/d17/d1c/d22/d57/d61/dc1/f107 [877263,10661] 0 2023-12-16T05:56:52.295 INFO:tasks.workunit.client.1.smithi156.stdout:1/950: truncate d3/d17/d2d/fe0 997029 0 2023-12-16T05:56:52.295 INFO:tasks.workunit.client.1.smithi156.stdout:1/951: read d3/d17/d1c/d22/d57/d61/dc1/f107 [1533846,42097] 0 2023-12-16T05:56:52.295 INFO:tasks.workunit.client.1.smithi156.stdout:1/952: fdatasync d3/d3a/f6c 0 2023-12-16T05:56:52.296 INFO:tasks.workunit.client.1.smithi156.stdout:1/953: mkdir d3/d17/d1c/d22/d57/d61/dc1/dbe/dd2/d138 0 2023-12-16T05:56:52.297 INFO:tasks.workunit.client.1.smithi156.stdout:1/954: write d3/d17/d1c/d22/d57/d61/dc1/fff [824087,92008] 0 2023-12-16T05:56:52.299 INFO:tasks.workunit.client.1.smithi156.stdout:1/955: dread d3/d17/d1c/d22/d57/f68 [0,4194304] 0 2023-12-16T05:56:52.299 INFO:tasks.workunit.client.1.smithi156.stdout:1/956: read - d3/d17/d1c/d22/d57/d61/fe4 zero size 2023-12-16T05:56:52.300 INFO:tasks.workunit.client.1.smithi156.stdout:1/957: rename d3/d17/d1c/d22/d57/d61/dc1/cb5 to d3/d17/daa/c139 0 2023-12-16T05:56:52.301 INFO:tasks.workunit.client.1.smithi156.stdout:1/958: truncate d3/d1b/d8b/f8e 996867 0 2023-12-16T05:56:52.301 INFO:tasks.workunit.client.1.smithi156.stdout:1/959: symlink d3/dd0/l13a 0 2023-12-16T05:56:52.315 INFO:tasks.workunit.client.1.smithi156.stdout:1/960: dwrite d3/d17/d2d/f74 [0,4194304] 0 2023-12-16T05:56:52.317 INFO:tasks.workunit.client.1.smithi156.stdout:1/961: symlink d3/d17/d1c/d22/d57/dbc/l13b 0 2023-12-16T05:56:52.318 INFO:tasks.workunit.client.1.smithi156.stdout:1/962: read d3/d17/d4d/dc2/d4f/f90 [2261900,115834] 0 2023-12-16T05:56:52.318 INFO:tasks.workunit.client.1.smithi156.stdout:1/963: chown d3/d3a/da9/f113 161993 1 2023-12-16T05:56:52.319 INFO:tasks.workunit.client.1.smithi156.stdout:1/964: creat d3/d17/d4d/dc2/d4f/d75/f13c x:0 0 0 2023-12-16T05:56:52.338 INFO:tasks.workunit.client.1.smithi156.stdout:1/965: dwrite d3/d17/d1c/d22/d57/d61/dc1/f7b [0,4194304] 0 2023-12-16T05:56:52.340 INFO:tasks.workunit.client.1.smithi156.stdout:1/966: unlink f1 0 2023-12-16T05:56:52.340 INFO:tasks.workunit.client.1.smithi156.stdout:1/967: dread - d3/d17/d4d/dc2/d4f/d75/f13c zero size 2023-12-16T05:56:52.342 INFO:tasks.workunit.client.1.smithi156.stdout:1/968: rename d3/d17/d4d/dc2/dd8 to d3/d17/d1c/d22/d57/d61/dc1/d13d 0 2023-12-16T05:56:52.342 INFO:tasks.workunit.client.1.smithi156.stdout:1/969: chown d3/d17/d1c/d22/d57/d61/dc1/dbe/f133 51087728 1 2023-12-16T05:56:52.342 INFO:tasks.workunit.client.1.smithi156.stdout:1/970: fdatasync d3/d17/d1c/d22/d57/d61/dc1/fa6 0 2023-12-16T05:56:52.342 INFO:tasks.workunit.client.1.smithi156.stdout:1/971: write d3/d1b/f8d [1124256,39590] 0 2023-12-16T05:56:52.342 INFO:tasks.workunit.client.1.smithi156.stdout:1/972: read - d3/d17/d1c/d22/d57/dbc/dd9/f119 zero size 2023-12-16T05:56:52.343 INFO:tasks.workunit.client.1.smithi156.stdout:1/973: rename d3/d17/d1c/d22/d57/d61/dc1/l95 to d3/d17/d1c/d22/l13e 0 2023-12-16T05:56:52.357 INFO:tasks.workunit.client.1.smithi156.stdout:1/974: dwrite d3/d1b/f40 [0,4194304] 0 2023-12-16T05:56:52.358 INFO:tasks.workunit.client.1.smithi156.stdout:1/975: dread d3/d3a/f9f [0,4194304] 0 2023-12-16T05:56:52.358 INFO:tasks.workunit.client.1.smithi156.stdout:1/976: stat d3/d3a/db1/fb2 0 2023-12-16T05:56:52.374 INFO:tasks.workunit.client.1.smithi156.stdout:1/977: dwrite d3/d17/d1c/d22/d57/d61/f124 [0,4194304] 0 2023-12-16T05:56:52.376 INFO:tasks.workunit.client.1.smithi156.stdout:1/978: mkdir d3/d1b/df9/d13f 0 2023-12-16T05:56:52.377 INFO:tasks.workunit.client.1.smithi156.stdout:1/979: write d3/d1b/f8d [285547,65329] 0 2023-12-16T05:56:52.378 INFO:tasks.workunit.client.1.smithi156.stdout:1/980: creat d3/d1b/df9/f140 x:0 0 0 2023-12-16T05:56:52.378 INFO:tasks.workunit.client.1.smithi156.stdout:1/981: chown d3/d17/d4d/dc2/d4f/dca/lda 216 1 2023-12-16T05:56:52.379 INFO:tasks.workunit.client.1.smithi156.stdout:1/982: creat d3/d1b/d8b/f141 x:0 0 0 2023-12-16T05:56:52.379 INFO:tasks.workunit.client.1.smithi156.stdout:1/983: fdatasync d3/d3a/db1/fb8 0 2023-12-16T05:56:52.380 INFO:tasks.workunit.client.1.smithi156.stdout:1/984: creat d3/d17/d2d/f142 x:0 0 0 2023-12-16T05:56:52.380 INFO:tasks.workunit.client.1.smithi156.stdout:1/985: mkdir d3/d17/d1c/d22/d57/d82/d129/d143 0 2023-12-16T05:56:52.384 INFO:tasks.workunit.client.1.smithi156.stdout:1/986: fsync d3/d17/d1c/d22/d57/d61/dc1/f107 0 2023-12-16T05:56:52.385 INFO:tasks.workunit.client.1.smithi156.stdout:1/987: mkdir d3/d17/d1c/d22/d57/d82/d129/d143/d144 0 2023-12-16T05:56:52.386 INFO:tasks.workunit.client.1.smithi156.stdout:1/988: truncate d3/d17/d2d/fab 1569223 0 2023-12-16T05:56:52.387 INFO:tasks.workunit.client.1.smithi156.stdout:1/989: truncate d3/d17/d1c/d22/d57/d61/dc1/dbe/dd2/d11b/fad 4793027 0 2023-12-16T05:56:52.387 INFO:tasks.workunit.client.1.smithi156.stdout:1/990: fdatasync d3/d1b/f12a 0 2023-12-16T05:56:52.387 INFO:tasks.workunit.client.1.smithi156.stdout:1/991: write d3/d1b/f37 [236816,130100] 0 2023-12-16T05:56:52.389 INFO:tasks.workunit.client.1.smithi156.stdout:1/992: creat d3/d17/f145 x:0 0 0 2023-12-16T05:56:52.390 INFO:tasks.workunit.client.1.smithi156.stdout:1/993: mkdir d3/d17/d1c/da5/d101/d146 0 2023-12-16T05:56:52.390 INFO:tasks.workunit.client.1.smithi156.stdout:1/994: dread - d3/d17/d1c/d22/d57/dbc/dd9/f119 zero size 2023-12-16T05:56:52.391 INFO:tasks.workunit.client.1.smithi156.stdout:1/995: mkdir d3/d17/d1c/d22/d57/d82/d129/d147 0 2023-12-16T05:56:52.392 INFO:tasks.workunit.client.1.smithi156.stdout:1/996: creat d3/d1b/d8b/f148 x:0 0 0 2023-12-16T05:56:52.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:52 smithi156 ceph-mon[121001]: pgmap v22: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 183 MiB/s rd, 386 MiB/s wr, 649 op/s 2023-12-16T05:56:52.528 INFO:tasks.workunit.client.1.smithi156.stdout:1/997: sync 2023-12-16T05:56:52.529 INFO:tasks.workunit.client.1.smithi156.stdout:1/998: mknod d3/d17/d1c/d22/d57/d61/c149 0 2023-12-16T05:56:52.530 INFO:tasks.workunit.client.1.smithi156.stdout:1/999: link d3/d17/d4d/f9d d3/d17/d1c/d22/d57/d82/d129/f14a 0 2023-12-16T05:56:52.533 INFO:tasks.workunit.client.1.smithi156.stderr:+ rm -rf -- ./tmp.q7G600Nua7 2023-12-16T05:56:52.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:52 smithi155 ceph-mon[112451]: pgmap v22: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 183 MiB/s rd, 386 MiB/s wr, 649 op/s 2023-12-16T05:56:54.432 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:54 smithi156 ceph-mon[121001]: pgmap v23: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 99 MiB/s rd, 203 MiB/s wr, 381 op/s 2023-12-16T05:56:54.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:54 smithi155 ceph-mon[112451]: pgmap v23: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 99 MiB/s rd, 203 MiB/s wr, 381 op/s 2023-12-16T05:56:56.082 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-16T05:56:56.083 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-16T05:56:56.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:56 smithi156 ceph-mon[121001]: pgmap v24: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 116 MiB/s rd, 242 MiB/s wr, 527 op/s 2023-12-16T05:56:56.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:56 smithi155 ceph-mon[112451]: pgmap v24: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 116 MiB/s rd, 242 MiB/s wr, 527 op/s 2023-12-16T05:56:58.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:58 smithi156 ceph-mon[121001]: pgmap v25: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 34 MiB/s rd, 76 MiB/s wr, 267 op/s 2023-12-16T05:56:58.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:58 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:56:58.569 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:58 smithi155 ceph-mon[112451]: pgmap v25: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 34 MiB/s rd, 76 MiB/s wr, 267 op/s 2023-12-16T05:56:58.569 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:58 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:56:59.561 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:56:59 smithi155 ceph-mon[112451]: pgmap v26: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 34 MiB/s rd, 76 MiB/s wr, 267 op/s 2023-12-16T05:56:59.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:56:59 smithi156 ceph-mon[121001]: pgmap v26: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 34 MiB/s rd, 76 MiB/s wr, 267 op/s 2023-12-16T05:57:01.969 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-16T05:57:01.970 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2023-12-16T05:57:02.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:01 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:02.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:01 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:02.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:01 smithi155 ceph-mon[112451]: Reconfiguring prometheus.smithi155 (dependencies changed)... 2023-12-16T05:57:02.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:01 smithi155 ceph-mon[112451]: pgmap v27: 65 pgs: 65 active+clean; 1.1 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 35 MiB/s rd, 77 MiB/s wr, 423 op/s 2023-12-16T05:57:02.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:01 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:02.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:01 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:02.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:01 smithi156 ceph-mon[121001]: Reconfiguring prometheus.smithi155 (dependencies changed)... 2023-12-16T05:57:02.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:01 smithi156 ceph-mon[121001]: pgmap v27: 65 pgs: 65 active+clean; 1.1 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 35 MiB/s rd, 77 MiB/s wr, 423 op/s 2023-12-16T05:57:03.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:02 smithi155 ceph-mon[112451]: Reconfiguring daemon prometheus.smithi155 on smithi155 2023-12-16T05:57:03.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:02 smithi156 ceph-mon[121001]: Reconfiguring daemon prometheus.smithi155 on smithi155 2023-12-16T05:57:04.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:03 smithi155 ceph-mon[112451]: pgmap v28: 65 pgs: 65 active+clean; 1.1 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 18 MiB/s rd, 40 MiB/s wr, 302 op/s 2023-12-16T05:57:04.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:03 smithi156 ceph-mon[121001]: pgmap v28: 65 pgs: 65 active+clean; 1.1 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 18 MiB/s rd, 40 MiB/s wr, 302 op/s 2023-12-16T05:57:06.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:06 smithi156 ceph-mon[121001]: pgmap v29: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 19 MiB/s rd, 41 MiB/s wr, 511 op/s 2023-12-16T05:57:06.529 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:06 smithi155 ceph-mon[112451]: pgmap v29: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 19 MiB/s rd, 41 MiB/s wr, 511 op/s 2023-12-16T05:57:07.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:07 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:07.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:07 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:07.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:07 smithi156 ceph-mon[121001]: Reconfiguring node-exporter.smithi156 (dependencies changed)... 2023-12-16T05:57:07.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:07 smithi156 ceph-mon[121001]: Reconfiguring daemon node-exporter.smithi156 on smithi156 2023-12-16T05:57:07.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:07 smithi156 ceph-mon[121001]: pgmap v30: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 364 op/s 2023-12-16T05:57:08.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:07 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:08.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:07 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:08.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:07 smithi155 ceph-mon[112451]: Reconfiguring node-exporter.smithi156 (dependencies changed)... 2023-12-16T05:57:08.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:07 smithi155 ceph-mon[112451]: Reconfiguring daemon node-exporter.smithi156 on smithi156 2023-12-16T05:57:08.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:07 smithi155 ceph-mon[112451]: pgmap v30: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 364 op/s 2023-12-16T05:57:08.664 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.659+0000 7f70abecb700 1 -- 172.21.15.155:0/1492664962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70a40fcd00 msgr2=0x7f70a40fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:08.664 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.659+0000 7f70abecb700 1 --2- 172.21.15.155:0/1492664962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70a40fcd00 0x7f70a40fd150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7094004880 tx=0x7f7094009e30 comp rx=0 tx=0).stop 2023-12-16T05:57:08.664 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.660+0000 7f70abecb700 1 -- 172.21.15.155:0/1492664962 shutdown_connections 2023-12-16T05:57:08.664 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.660+0000 7f70abecb700 1 --2- 172.21.15.155:0/1492664962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70a40fcd00 0x7f70a40fd150 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:08.664 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.660+0000 7f70abecb700 1 --2- 172.21.15.155:0/1492664962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70a40fbaf0 0x7f70a40fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:08.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.660+0000 7f70abecb700 1 -- 172.21.15.155:0/1492664962 >> 172.21.15.155:0/1492664962 conn(0x7f70a40f71b0 msgr2=0x7f70a40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:57:08.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.660+0000 7f70abecb700 1 -- 172.21.15.155:0/1492664962 shutdown_connections 2023-12-16T05:57:08.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.660+0000 7f70abecb700 1 -- 172.21.15.155:0/1492664962 wait complete. 2023-12-16T05:57:08.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.660+0000 7f70abecb700 1 Processor -- start 2023-12-16T05:57:08.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.660+0000 7f70abecb700 1 -- start start 2023-12-16T05:57:08.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.660+0000 7f70abecb700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70a40fbaf0 0x7f70a410f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:08.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.660+0000 7f70abecb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70a40fcd00 0x7f70a410fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:08.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.660+0000 7f70abecb700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a4110230 con 0x7f70a40fbaf0 2023-12-16T05:57:08.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.660+0000 7f70abecb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a4110ad0 con 0x7f70a40fcd00 2023-12-16T05:57:08.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.660+0000 7f70a9c67700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70a40fbaf0 0x7f70a410f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:08.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.661+0000 7f70a9c67700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70a40fbaf0 0x7f70a410f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:57110/0 (socket says 172.21.15.155:57110) 2023-12-16T05:57:08.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.661+0000 7f70a9c67700 1 -- 172.21.15.155:0/2126174439 learned_addr learned my addr 172.21.15.155:0/2126174439 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:57:08.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.661+0000 7f70a9466700 1 --2- 172.21.15.155:0/2126174439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70a40fcd00 0x7f70a410fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:08.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.661+0000 7f70a9c67700 1 -- 172.21.15.155:0/2126174439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70a40fcd00 msgr2=0x7f70a410fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:08.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.661+0000 7f70a9c67700 1 --2- 172.21.15.155:0/2126174439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70a40fcd00 0x7f70a410fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:08.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.661+0000 7f70a9c67700 1 -- 172.21.15.155:0/2126174439 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7094005040 con 0x7f70a40fbaf0 2023-12-16T05:57:08.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.661+0000 7f70a9c67700 1 --2- 172.21.15.155:0/2126174439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70a40fbaf0 0x7f70a410f6f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f70a000eb40 tx=0x7f70a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:57:08.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.661+0000 7f709a7fc700 1 -- 172.21.15.155:0/2126174439 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70a0007cc0 con 0x7f70a40fbaf0 2023-12-16T05:57:08.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.661+0000 7f709a7fc700 1 -- 172.21.15.155:0/2126174439 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f70a000f040 con 0x7f70a40fbaf0 2023-12-16T05:57:08.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.661+0000 7f709a7fc700 1 -- 172.21.15.155:0/2126174439 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70a000ca60 con 0x7f70a40fbaf0 2023-12-16T05:57:08.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.661+0000 7f70abecb700 1 -- 172.21.15.155:0/2126174439 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a4110d30 con 0x7f70a40fbaf0 2023-12-16T05:57:08.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.661+0000 7f70abecb700 1 -- 172.21.15.155:0/2126174439 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a4111220 con 0x7f70a40fbaf0 2023-12-16T05:57:08.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.662+0000 7f70abecb700 1 -- 172.21.15.155:0/2126174439 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a404bb80 con 0x7f70a40fbaf0 2023-12-16T05:57:08.667 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.664+0000 7f709a7fc700 1 -- 172.21.15.155:0/2126174439 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 24) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f70a000cbc0 con 0x7f70a40fbaf0 2023-12-16T05:57:08.667 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.665+0000 7f709a7fc700 1 --2- 172.21.15.155:0/2126174439 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f709006ae40 0x7f709006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:08.667 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.665+0000 7f709a7fc700 1 -- 172.21.15.155:0/2126174439 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f70a00892b0 con 0x7f70a40fbaf0 2023-12-16T05:57:08.667 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.665+0000 7f70a9466700 1 --2- 172.21.15.155:0/2126174439 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f709006ae40 0x7f709006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:08.668 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.665+0000 7f70a9466700 1 --2- 172.21.15.155:0/2126174439 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f709006ae40 0x7f709006d2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7094009fd0 tx=0x7f7094009e30 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:57:08.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.670+0000 7f709a7fc700 1 -- 172.21.15.155:0/2126174439 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f70a0057160 con 0x7f70a40fbaf0 2023-12-16T05:57:08.972 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.968+0000 7f70abecb700 1 -- 172.21.15.155:0/2126174439 --> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f70a41010e0 con 0x7f709006ae40 2023-12-16T05:57:08.973 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.970+0000 7f709a7fc700 1 -- 172.21.15.155:0/2126174439 <== mgr.24363 v2:172.21.15.156:6828/1939402353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f70a41010e0 con 0x7f709006ae40 2023-12-16T05:57:08.976 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.973+0000 7f70abecb700 1 -- 172.21.15.155:0/2126174439 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f709006ae40 msgr2=0x7f709006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:08.976 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.973+0000 7f70abecb700 1 --2- 172.21.15.155:0/2126174439 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f709006ae40 0x7f709006d2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7094009fd0 tx=0x7f7094009e30 comp rx=0 tx=0).stop 2023-12-16T05:57:08.976 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.973+0000 7f70abecb700 1 -- 172.21.15.155:0/2126174439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70a40fbaf0 msgr2=0x7f70a410f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:08.976 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.973+0000 7f70abecb700 1 --2- 172.21.15.155:0/2126174439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70a40fbaf0 0x7f70a410f6f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f70a000eb40 tx=0x7f70a000b040 comp rx=0 tx=0).stop 2023-12-16T05:57:08.978 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.975+0000 7f70abecb700 1 -- 172.21.15.155:0/2126174439 shutdown_connections 2023-12-16T05:57:08.978 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.975+0000 7f70abecb700 1 --2- 172.21.15.155:0/2126174439 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f709006ae40 0x7f709006d2f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:08.978 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.975+0000 7f70abecb700 1 --2- 172.21.15.155:0/2126174439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70a40fbaf0 0x7f70a410f6f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:08.978 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.975+0000 7f70abecb700 1 --2- 172.21.15.155:0/2126174439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70a40fcd00 0x7f70a410fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:08.978 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.975+0000 7f70abecb700 1 -- 172.21.15.155:0/2126174439 >> 172.21.15.155:0/2126174439 conn(0x7f70a40f71b0 msgr2=0x7f70a40f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:57:08.978 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.975+0000 7f70abecb700 1 -- 172.21.15.155:0/2126174439 shutdown_connections 2023-12-16T05:57:08.978 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:08.975+0000 7f70abecb700 1 -- 172.21.15.155:0/2126174439 wait complete. 2023-12-16T05:57:08.994 INFO:teuthology.orchestra.run.smithi155.stdout:true 2023-12-16T05:57:09.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.137+0000 7f9893f74700 1 -- 172.21.15.155:0/27438086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f988c0fac40 msgr2=0x7f988c0fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:09.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.137+0000 7f9893f74700 1 --2- 172.21.15.155:0/27438086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f988c0fac40 0x7f988c0fb0b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f987c004940 tx=0x7f987c009e30 comp rx=0 tx=0).stop 2023-12-16T05:57:09.142 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.139+0000 7f9893f74700 1 -- 172.21.15.155:0/27438086 shutdown_connections 2023-12-16T05:57:09.142 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.139+0000 7f9893f74700 1 --2- 172.21.15.155:0/27438086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f988c0fac40 0x7f988c0fb0b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:09.142 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.139+0000 7f9893f74700 1 --2- 172.21.15.155:0/27438086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f988c0fbf80 0x7f988c0fc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:09.142 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.139+0000 7f9893f74700 1 -- 172.21.15.155:0/27438086 >> 172.21.15.155:0/27438086 conn(0x7f988c0f6950 msgr2=0x7f988c0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:57:09.142 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.139+0000 7f9893f74700 1 -- 172.21.15.155:0/27438086 shutdown_connections 2023-12-16T05:57:09.142 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.139+0000 7f9893f74700 1 -- 172.21.15.155:0/27438086 wait complete. 2023-12-16T05:57:09.143 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.140+0000 7f9893f74700 1 Processor -- start 2023-12-16T05:57:09.143 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.140+0000 7f9893f74700 1 -- start start 2023-12-16T05:57:09.143 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.140+0000 7f9893f74700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f988c0fac40 0x7f988c109a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:09.143 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.140+0000 7f9893f74700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f988c0fbf80 0x7f988c109f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:09.143 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.140+0000 7f9893f74700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c10a5c0 con 0x7f988c0fac40 2023-12-16T05:57:09.143 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.140+0000 7f9893f74700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c11d730 con 0x7f988c0fbf80 2023-12-16T05:57:09.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.140+0000 7f989150f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f988c0fbf80 0x7f988c109f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:09.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.140+0000 7f989150f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f988c0fbf80 0x7f988c109f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.155:39950/0 (socket says 172.21.15.155:39950) 2023-12-16T05:57:09.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.140+0000 7f989150f700 1 -- 172.21.15.155:0/4272581592 learned_addr learned my addr 172.21.15.155:0/4272581592 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:57:09.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.141+0000 7f989150f700 1 -- 172.21.15.155:0/4272581592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f988c0fac40 msgr2=0x7f988c109a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:09.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.141+0000 7f989150f700 1 --2- 172.21.15.155:0/4272581592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f988c0fac40 0x7f988c109a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:09.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.141+0000 7f989150f700 1 -- 172.21.15.155:0/4272581592 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c005040 con 0x7f988c0fbf80 2023-12-16T05:57:09.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.141+0000 7f989150f700 1 --2- 172.21.15.155:0/4272581592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f988c0fbf80 0x7f988c109f90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f987c009fd0 tx=0x7f987c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:57:09.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.142+0000 7f98827fc700 1 -- 172.21.15.155:0/4272581592 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f987c021070 con 0x7f988c0fbf80 2023-12-16T05:57:09.147 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.142+0000 7f98827fc700 1 -- 172.21.15.155:0/4272581592 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f987c01c400 con 0x7f988c0fbf80 2023-12-16T05:57:09.147 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.142+0000 7f98827fc700 1 -- 172.21.15.155:0/4272581592 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f987c00e070 con 0x7f988c0fbf80 2023-12-16T05:57:09.147 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.143+0000 7f9893f74700 1 -- 172.21.15.155:0/4272581592 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f988c11d960 con 0x7f988c0fbf80 2023-12-16T05:57:09.147 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.143+0000 7f9893f74700 1 -- 172.21.15.155:0/4272581592 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f988c11de10 con 0x7f988c0fbf80 2023-12-16T05:57:09.148 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.145+0000 7f9893f74700 1 -- 172.21.15.155:0/4272581592 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f988c04bb80 con 0x7f988c0fbf80 2023-12-16T05:57:09.148 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.145+0000 7f98827fc700 1 -- 172.21.15.155:0/4272581592 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 24) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f987c01c570 con 0x7f988c0fbf80 2023-12-16T05:57:09.148 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.146+0000 7f98827fc700 1 --2- 172.21.15.155:0/4272581592 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f987806afe0 0x7f987806d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:09.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.146+0000 7f98827fc700 1 -- 172.21.15.155:0/4272581592 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f987c08a340 con 0x7f988c0fbf80 2023-12-16T05:57:09.150 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.147+0000 7f9891d10700 1 --2- 172.21.15.155:0/4272581592 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f987806afe0 0x7f987806d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:09.150 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.148+0000 7f9891d10700 1 --2- 172.21.15.155:0/4272581592 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f987806afe0 0x7f987806d490 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9888009fd0 tx=0x7f988800b040 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:57:09.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.154+0000 7f98827fc700 1 -- 172.21.15.155:0/4272581592 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f987c0581d0 con 0x7f988c0fbf80 2023-12-16T05:57:09.471 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.468+0000 7f9893f74700 1 -- 172.21.15.155:0/4272581592 --> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f988c11e360 con 0x7f987806afe0 2023-12-16T05:57:09.472 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.469+0000 7f98827fc700 1 -- 172.21.15.155:0/4272581592 <== mgr.24363 v2:172.21.15.156:6828/1939402353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f988c11e360 con 0x7f987806afe0 2023-12-16T05:57:09.475 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.471+0000 7f9893f74700 1 -- 172.21.15.155:0/4272581592 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f987806afe0 msgr2=0x7f987806d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:09.475 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.471+0000 7f9893f74700 1 --2- 172.21.15.155:0/4272581592 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f987806afe0 0x7f987806d490 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9888009fd0 tx=0x7f988800b040 comp rx=0 tx=0).stop 2023-12-16T05:57:09.475 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.471+0000 7f9893f74700 1 -- 172.21.15.155:0/4272581592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f988c0fbf80 msgr2=0x7f988c109f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:09.475 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.471+0000 7f9893f74700 1 --2- 172.21.15.155:0/4272581592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f988c0fbf80 0x7f988c109f90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f987c009fd0 tx=0x7f987c009e30 comp rx=0 tx=0).stop 2023-12-16T05:57:09.475 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.472+0000 7f9893f74700 1 -- 172.21.15.155:0/4272581592 shutdown_connections 2023-12-16T05:57:09.475 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.472+0000 7f9893f74700 1 --2- 172.21.15.155:0/4272581592 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f987806afe0 0x7f987806d490 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:09.475 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.472+0000 7f9893f74700 1 --2- 172.21.15.155:0/4272581592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f988c0fac40 0x7f988c109a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:09.475 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.472+0000 7f9893f74700 1 --2- 172.21.15.155:0/4272581592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f988c0fbf80 0x7f988c109f90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:09.475 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.472+0000 7f9893f74700 1 -- 172.21.15.155:0/4272581592 >> 172.21.15.155:0/4272581592 conn(0x7f988c0f6950 msgr2=0x7f988c0fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:57:09.475 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.472+0000 7f9893f74700 1 -- 172.21.15.155:0/4272581592 shutdown_connections 2023-12-16T05:57:09.475 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.472+0000 7f9893f74700 1 -- 172.21.15.155:0/4272581592 wait complete. 2023-12-16T05:57:09.592 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.589+0000 7fea5f180700 1 -- 172.21.15.155:0/3265911476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea580fcd00 msgr2=0x7fea580fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:09.592 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.589+0000 7fea5f180700 1 --2- 172.21.15.155:0/3265911476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea580fcd00 0x7fea580fd150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fea44004940 tx=0x7fea44009e30 comp rx=0 tx=0).stop 2023-12-16T05:57:09.592 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.589+0000 7fea5f180700 1 -- 172.21.15.155:0/3265911476 shutdown_connections 2023-12-16T05:57:09.592 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.589+0000 7fea5f180700 1 --2- 172.21.15.155:0/3265911476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea580fcd00 0x7fea580fd150 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:09.592 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.589+0000 7fea5f180700 1 --2- 172.21.15.155:0/3265911476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea580fbaf0 0x7fea580fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:09.592 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.589+0000 7fea5f180700 1 -- 172.21.15.155:0/3265911476 >> 172.21.15.155:0/3265911476 conn(0x7fea580f7190 msgr2=0x7fea580f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:57:09.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.590+0000 7fea5f180700 1 -- 172.21.15.155:0/3265911476 shutdown_connections 2023-12-16T05:57:09.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.590+0000 7fea5f180700 1 -- 172.21.15.155:0/3265911476 wait complete. 2023-12-16T05:57:09.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.590+0000 7fea5f180700 1 Processor -- start 2023-12-16T05:57:09.593 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.591+0000 7fea5f180700 1 -- start start 2023-12-16T05:57:09.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.591+0000 7fea5f180700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea580fbaf0 0x7fea5811c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:09.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.591+0000 7fea5f180700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea580fcd00 0x7fea5811ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:09.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.591+0000 7fea5f180700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5811d410 con 0x7fea580fcd00 2023-12-16T05:57:09.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.591+0000 7fea5f180700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5811d6a0 con 0x7fea580fbaf0 2023-12-16T05:57:09.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.591+0000 7fea5cf1c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea580fbaf0 0x7fea5811c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:09.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.591+0000 7fea5cf1c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea580fbaf0 0x7fea5811c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.155:39968/0 (socket says 172.21.15.155:39968) 2023-12-16T05:57:09.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.591+0000 7fea5cf1c700 1 -- 172.21.15.155:0/1228845728 learned_addr learned my addr 172.21.15.155:0/1228845728 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:57:09.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.591+0000 7fea5cf1c700 1 -- 172.21.15.155:0/1228845728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea580fcd00 msgr2=0x7fea5811ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:09.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.591+0000 7fea5cf1c700 1 --2- 172.21.15.155:0/1228845728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea580fcd00 0x7fea5811ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:09.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.591+0000 7fea5cf1c700 1 -- 172.21.15.155:0/1228845728 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea44005040 con 0x7fea580fbaf0 2023-12-16T05:57:09.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.592+0000 7fea5cf1c700 1 --2- 172.21.15.155:0/1228845728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea580fbaf0 0x7fea5811c8d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00eb70 tx=0x7fea4c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:57:09.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.592+0000 7fea557fa700 1 -- 172.21.15.155:0/1228845728 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea4c007cc0 con 0x7fea580fbaf0 2023-12-16T05:57:09.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.592+0000 7fea5f180700 1 -- 172.21.15.155:0/1228845728 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5811d920 con 0x7fea580fbaf0 2023-12-16T05:57:09.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.592+0000 7fea5f180700 1 -- 172.21.15.155:0/1228845728 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5811de60 con 0x7fea580fbaf0 2023-12-16T05:57:09.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.592+0000 7fea557fa700 1 -- 172.21.15.155:0/1228845728 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fea4c00f040 con 0x7fea580fbaf0 2023-12-16T05:57:09.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.592+0000 7fea557fa700 1 -- 172.21.15.155:0/1228845728 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea4c00cad0 con 0x7fea580fbaf0 2023-12-16T05:57:09.596 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.593+0000 7fea557fa700 1 -- 172.21.15.155:0/1228845728 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 24) v1 ==== 88727+0+0 (secure 0 0 0) 0x7fea4c00cc30 con 0x7fea580fbaf0 2023-12-16T05:57:09.596 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.594+0000 7fea557fa700 1 --2- 172.21.15.155:0/1228845728 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7fea4806ae50 0x7fea4806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:09.596 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.594+0000 7fea557fa700 1 -- 172.21.15.155:0/1228845728 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fea4c089210 con 0x7fea580fbaf0 2023-12-16T05:57:09.597 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.594+0000 7fea57fff700 1 --2- 172.21.15.155:0/1228845728 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7fea4806ae50 0x7fea4806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:09.598 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.595+0000 7fea57fff700 1 --2- 172.21.15.155:0/1228845728 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7fea4806ae50 0x7fea4806d300 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fea44009fd0 tx=0x7fea44009e30 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:57:09.598 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.595+0000 7fea5f180700 1 -- 172.21.15.155:0/1228845728 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3c0052e0 con 0x7fea580fbaf0 2023-12-16T05:57:09.604 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.601+0000 7fea557fa700 1 -- 172.21.15.155:0/1228845728 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fea4c04ece0 con 0x7fea580fbaf0 2023-12-16T05:57:09.745 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:09 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:09.746 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:09 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:09.746 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:09 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T05:57:09.746 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:09 smithi155 ceph-mon[112451]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T05:57:09.746 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:09 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T05:57:09.746 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:09 smithi155 ceph-mon[112451]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T05:57:09.746 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:09 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T05:57:09.746 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:09 smithi155 ceph-mon[112451]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T05:57:09.746 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:09 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:57:09.746 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:09 smithi155 ceph-mon[112451]: Upgrade: Need to upgrade myself (mgr.smithi156.pclong) 2023-12-16T05:57:09.746 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:09 smithi155 ceph-mon[112451]: Upgrade: Need to upgrade myself (mgr.smithi156.pclong) 2023-12-16T05:57:09.746 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:09 smithi155 ceph-mon[112451]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:57:09.746 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:09 smithi155 ceph-mon[112451]: pgmap v31: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 364 op/s 2023-12-16T05:57:09.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:09 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:09.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:09 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:09.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:09 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T05:57:09.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:09 smithi156 ceph-mon[121001]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T05:57:09.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:09 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T05:57:09.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:09 smithi156 ceph-mon[121001]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T05:57:09.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:09 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T05:57:09.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:09 smithi156 ceph-mon[121001]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T05:57:09.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:09 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:57:09.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:09 smithi156 ceph-mon[121001]: Upgrade: Need to upgrade myself (mgr.smithi156.pclong) 2023-12-16T05:57:09.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:09 smithi156 ceph-mon[121001]: Upgrade: Need to upgrade myself (mgr.smithi156.pclong) 2023-12-16T05:57:09.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:09 smithi156 ceph-mon[121001]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:57:09.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:09 smithi156 ceph-mon[121001]: pgmap v31: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 364 op/s 2023-12-16T05:57:09.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.938+0000 7fea5f180700 1 -- 172.21.15.155:0/1228845728 --> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fea3c000bf0 con 0x7fea4806ae50 2023-12-16T05:57:09.961 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.958+0000 7fea557fa700 1 -- 172.21.15.155:0/1228845728 <== mgr.24363 v2:172.21.15.156:6828/1939402353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7fea3c000bf0 con 0x7fea4806ae50 2023-12-16T05:57:09.961 INFO:teuthology.orchestra.run.smithi155.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T05:57:09.961 INFO:teuthology.orchestra.run.smithi155.stdout:alertmanager.smithi155 smithi155 *:9093,9094 starting - - - - 2023-12-16T05:57:09.961 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi155 smithi155 running (6m) 38s ago 6m 7444k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 033f79f53811 2023-12-16T05:57:09.961 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi156 smithi156 running (5m) 46s ago 5m 7470k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 c72bd1a1d00a 2023-12-16T05:57:09.961 INFO:teuthology.orchestra.run.smithi155.stdout:grafana.smithi155 smithi155 *:3000 starting - - - - 2023-12-16T05:57:09.961 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.bzsxjw smithi155 running (2m) 38s ago 2m 1638M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6bcabf94a5c3 2023-12-16T05:57:09.961 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.vicpis smithi155 running (2m) 38s ago 2m 222M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 afa64e1ef8da 2023-12-16T05:57:09.961 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.fasing smithi156 running (2m) 46s ago 2m 234M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 7d97160bda7c 2023-12-16T05:57:09.961 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.qvgmfj smithi156 running (2m) 46s ago 2m 1360M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4018b2f2e27e 2023-12-16T05:57:09.962 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi155.maowdn smithi155 *:9283 running (7m) 38s ago 7m 406M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 73b9fc45e71f 2023-12-16T05:57:09.962 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi156.pclong smithi156 *:8443,9283 running (68s) 46s ago 5m 494M - 19.0.0-191-g6d933094 a29c258b5d6f 99f9fc95fc56 2023-12-16T05:57:09.962 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi155 smithi155 running (7m) 38s ago 7m 81.8M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 0d0eecfde53b 2023-12-16T05:57:09.962 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi156 smithi156 running (5m) 46s ago 5m 55.8M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 4575acae9bdb 2023-12-16T05:57:09.962 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi155 smithi155 *:9100 starting - - - - 2023-12-16T05:57:09.962 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi156 smithi156 *:9100 starting - - - - 2023-12-16T05:57:09.962 INFO:teuthology.orchestra.run.smithi155.stdout:osd.0 smithi155 running (5m) 38s ago 5m 312M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 91e650c277f7 2023-12-16T05:57:09.962 INFO:teuthology.orchestra.run.smithi155.stdout:osd.1 smithi155 running (4m) 38s ago 4m 352M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957303cb6598 2023-12-16T05:57:09.962 INFO:teuthology.orchestra.run.smithi155.stdout:osd.2 smithi155 running (4m) 38s ago 4m 276M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957a169c1cac 2023-12-16T05:57:09.962 INFO:teuthology.orchestra.run.smithi155.stdout:osd.3 smithi156 running (4m) 46s ago 4m 375M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c4f6c54afe99 2023-12-16T05:57:09.962 INFO:teuthology.orchestra.run.smithi155.stdout:osd.4 smithi156 running (3m) 46s ago 3m 304M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 6309b12204fd 2023-12-16T05:57:09.962 INFO:teuthology.orchestra.run.smithi155.stdout:osd.5 smithi156 running (3m) 46s ago 3m 334M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 84b2c33eb0e1 2023-12-16T05:57:09.962 INFO:teuthology.orchestra.run.smithi155.stdout:prometheus.smithi155 smithi155 *:9095 starting - - - - 2023-12-16T05:57:09.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.961+0000 7fea5f180700 1 -- 172.21.15.155:0/1228845728 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7fea4806ae50 msgr2=0x7fea4806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:09.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.961+0000 7fea5f180700 1 --2- 172.21.15.155:0/1228845728 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7fea4806ae50 0x7fea4806d300 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fea44009fd0 tx=0x7fea44009e30 comp rx=0 tx=0).stop 2023-12-16T05:57:09.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.961+0000 7fea5f180700 1 -- 172.21.15.155:0/1228845728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea580fbaf0 msgr2=0x7fea5811c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:09.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.961+0000 7fea5f180700 1 --2- 172.21.15.155:0/1228845728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea580fbaf0 0x7fea5811c8d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00eb70 tx=0x7fea4c00b040 comp rx=0 tx=0).stop 2023-12-16T05:57:09.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.961+0000 7fea5f180700 1 -- 172.21.15.155:0/1228845728 shutdown_connections 2023-12-16T05:57:09.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.961+0000 7fea5f180700 1 --2- 172.21.15.155:0/1228845728 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7fea4806ae50 0x7fea4806d300 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:09.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.961+0000 7fea5f180700 1 --2- 172.21.15.155:0/1228845728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea580fbaf0 0x7fea5811c8d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:09.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.961+0000 7fea5f180700 1 --2- 172.21.15.155:0/1228845728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea580fcd00 0x7fea5811ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:09.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.961+0000 7fea5f180700 1 -- 172.21.15.155:0/1228845728 >> 172.21.15.155:0/1228845728 conn(0x7fea580f7190 msgr2=0x7fea580fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:57:09.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.961+0000 7fea5f180700 1 -- 172.21.15.155:0/1228845728 shutdown_connections 2023-12-16T05:57:09.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:09.961+0000 7fea5f180700 1 -- 172.21.15.155:0/1228845728 wait complete. 2023-12-16T05:57:10.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.088+0000 7f0f15f3c700 1 -- 172.21.15.155:0/452756449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f10104c40 msgr2=0x7f0f10107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:10.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.088+0000 7f0f15f3c700 1 --2- 172.21.15.155:0/452756449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f10104c40 0x7f0f10107020 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0f00004940 tx=0x7f0f00009e30 comp rx=0 tx=0).stop 2023-12-16T05:57:10.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.088+0000 7f0f15f3c700 1 -- 172.21.15.155:0/452756449 shutdown_connections 2023-12-16T05:57:10.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.088+0000 7f0f15f3c700 1 --2- 172.21.15.155:0/452756449 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f10107560 0x7f0f10109940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:10.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.088+0000 7f0f15f3c700 1 --2- 172.21.15.155:0/452756449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f10104c40 0x7f0f10107020 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:10.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.088+0000 7f0f15f3c700 1 -- 172.21.15.155:0/452756449 >> 172.21.15.155:0/452756449 conn(0x7f0f10069b20 msgr2=0x7f0f1006bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:57:10.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.088+0000 7f0f15f3c700 1 -- 172.21.15.155:0/452756449 shutdown_connections 2023-12-16T05:57:10.092 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.088+0000 7f0f15f3c700 1 -- 172.21.15.155:0/452756449 wait complete. 2023-12-16T05:57:10.092 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.089+0000 7f0f15f3c700 1 Processor -- start 2023-12-16T05:57:10.092 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.089+0000 7f0f15f3c700 1 -- start start 2023-12-16T05:57:10.092 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.089+0000 7f0f15f3c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f10104c40 0x7f0f10113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:10.092 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.089+0000 7f0f15f3c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f10107560 0x7f0f10113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:10.092 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.089+0000 7f0f15f3c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f10114640 con 0x7f0f10107560 2023-12-16T05:57:10.092 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.089+0000 7f0f15f3c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f10114ee0 con 0x7f0f10104c40 2023-12-16T05:57:10.092 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.089+0000 7f0f0f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f10104c40 0x7f0f10113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:10.093 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.089+0000 7f0f0effd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f10107560 0x7f0f10113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:10.093 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.089+0000 7f0f0f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f10104c40 0x7f0f10113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.155:39980/0 (socket says 172.21.15.155:39980) 2023-12-16T05:57:10.093 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.089+0000 7f0f0f7fe700 1 -- 172.21.15.155:0/2915574699 learned_addr learned my addr 172.21.15.155:0/2915574699 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:57:10.094 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.090+0000 7f0f0f7fe700 1 -- 172.21.15.155:0/2915574699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f10107560 msgr2=0x7f0f10113ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:10.094 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.090+0000 7f0f0f7fe700 1 --2- 172.21.15.155:0/2915574699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f10107560 0x7f0f10113ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:10.094 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.090+0000 7f0f0f7fe700 1 -- 172.21.15.155:0/2915574699 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f00005040 con 0x7f0f10104c40 2023-12-16T05:57:10.094 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.090+0000 7f0f0f7fe700 1 --2- 172.21.15.155:0/2915574699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f10104c40 0x7f0f10113ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000b0d0 tx=0x7f0f00009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:57:10.094 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.090+0000 7f0ef7fff700 1 -- 172.21.15.155:0/2915574699 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f00021070 con 0x7f0f10104c40 2023-12-16T05:57:10.094 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.090+0000 7f0ef7fff700 1 -- 172.21.15.155:0/2915574699 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0f0001c400 con 0x7f0f10104c40 2023-12-16T05:57:10.094 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.090+0000 7f0ef7fff700 1 -- 172.21.15.155:0/2915574699 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f0000e070 con 0x7f0f10104c40 2023-12-16T05:57:10.094 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.091+0000 7f0f15f3c700 1 -- 172.21.15.155:0/2915574699 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f10115160 con 0x7f0f10104c40 2023-12-16T05:57:10.094 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.091+0000 7f0f15f3c700 1 -- 172.21.15.155:0/2915574699 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f101155c0 con 0x7f0f10104c40 2023-12-16T05:57:10.095 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.092+0000 7f0f15f3c700 1 -- 172.21.15.155:0/2915574699 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f1004bb80 con 0x7f0f10104c40 2023-12-16T05:57:10.096 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.093+0000 7f0ef7fff700 1 -- 172.21.15.155:0/2915574699 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 24) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f0f0001c9e0 con 0x7f0f10104c40 2023-12-16T05:57:10.096 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.093+0000 7f0ef7fff700 1 --2- 172.21.15.155:0/2915574699 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f0ef806ae40 0x7f0ef806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:10.096 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.093+0000 7f0ef7fff700 1 -- 172.21.15.155:0/2915574699 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f0f0008a330 con 0x7f0f10104c40 2023-12-16T05:57:10.096 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.093+0000 7f0f0effd700 1 --2- 172.21.15.155:0/2915574699 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f0ef806ae40 0x7f0ef806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:10.097 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.094+0000 7f0f0effd700 1 --2- 172.21.15.155:0/2915574699 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f0ef806ae40 0x7f0ef806d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009b80 tx=0x7f0f0400b040 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:57:10.101 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.098+0000 7f0ef7fff700 1 -- 172.21.15.155:0/2915574699 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0f000547f0 con 0x7f0f10104c40 2023-12-16T05:57:10.519 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.516+0000 7f0f15f3c700 1 -- 172.21.15.155:0/2915574699 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0f1010ddb0 con 0x7f0f10104c40 2023-12-16T05:57:10.519 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.517+0000 7f0ef7fff700 1 -- 172.21.15.155:0/2915574699 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+842 (secure 0 0 0) 0x7f0f00004490 con 0x7f0f10104c40 2023-12-16T05:57:10.520 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T05:57:10.520 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": { 2023-12-16T05:57:10.520 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T05:57:10.520 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:57:10.520 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": { 2023-12-16T05:57:10.520 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 1, 2023-12-16T05:57:10.520 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 1 2023-12-16T05:57:10.520 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:57:10.520 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": { 2023-12-16T05:57:10.520 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T05:57:10.520 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:57:10.521 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2023-12-16T05:57:10.521 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T05:57:10.521 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:57:10.521 INFO:teuthology.orchestra.run.smithi155.stdout: "overall": { 2023-12-16T05:57:10.521 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 13, 2023-12-16T05:57:10.521 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 1 2023-12-16T05:57:10.521 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-12-16T05:57:10.521 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T05:57:10.522 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.519+0000 7f0f15f3c700 1 -- 172.21.15.155:0/2915574699 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f0ef806ae40 msgr2=0x7f0ef806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:10.522 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.519+0000 7f0f15f3c700 1 --2- 172.21.15.155:0/2915574699 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f0ef806ae40 0x7f0ef806d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009b80 tx=0x7f0f0400b040 comp rx=0 tx=0).stop 2023-12-16T05:57:10.522 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.519+0000 7f0f15f3c700 1 -- 172.21.15.155:0/2915574699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f10104c40 msgr2=0x7f0f10113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:10.522 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.519+0000 7f0f15f3c700 1 --2- 172.21.15.155:0/2915574699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f10104c40 0x7f0f10113ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000b0d0 tx=0x7f0f00009e30 comp rx=0 tx=0).stop 2023-12-16T05:57:10.522 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.519+0000 7f0f15f3c700 1 -- 172.21.15.155:0/2915574699 shutdown_connections 2023-12-16T05:57:10.522 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.519+0000 7f0f15f3c700 1 --2- 172.21.15.155:0/2915574699 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f0ef806ae40 0x7f0ef806d2f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:10.522 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.519+0000 7f0f15f3c700 1 --2- 172.21.15.155:0/2915574699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f10104c40 0x7f0f10113ab0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:10.522 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.519+0000 7f0f15f3c700 1 --2- 172.21.15.155:0/2915574699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f10107560 0x7f0f10113ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:10.522 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.519+0000 7f0f15f3c700 1 -- 172.21.15.155:0/2915574699 >> 172.21.15.155:0/2915574699 conn(0x7f0f10069b20 msgr2=0x7f0f1010a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:57:10.522 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.519+0000 7f0f15f3c700 1 -- 172.21.15.155:0/2915574699 shutdown_connections 2023-12-16T05:57:10.522 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.519+0000 7f0f15f3c700 1 -- 172.21.15.155:0/2915574699 wait complete. 2023-12-16T05:57:10.644 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.641+0000 7f08d5509700 1 -- 172.21.15.155:0/1137938922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d00fbb00 msgr2=0x7f08d00fbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:10.644 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.641+0000 7f08d5509700 1 --2- 172.21.15.155:0/1137938922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d00fbb00 0x7f08d00fbf10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f08c0004940 tx=0x7f08c0009e30 comp rx=0 tx=0).stop 2023-12-16T05:57:10.645 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.641+0000 7f08d5509700 1 -- 172.21.15.155:0/1137938922 shutdown_connections 2023-12-16T05:57:10.645 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.641+0000 7f08d5509700 1 --2- 172.21.15.155:0/1137938922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08d00fcd10 0x7f08d00fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:10.645 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.641+0000 7f08d5509700 1 --2- 172.21.15.155:0/1137938922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d00fbb00 0x7f08d00fbf10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:10.645 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.641+0000 7f08d5509700 1 -- 172.21.15.155:0/1137938922 >> 172.21.15.155:0/1137938922 conn(0x7f08d00f71c0 msgr2=0x7f08d00f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:57:10.645 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.641+0000 7f08d5509700 1 -- 172.21.15.155:0/1137938922 shutdown_connections 2023-12-16T05:57:10.645 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.641+0000 7f08d5509700 1 -- 172.21.15.155:0/1137938922 wait complete. 2023-12-16T05:57:10.646 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.642+0000 7f08d5509700 1 Processor -- start 2023-12-16T05:57:10.646 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.642+0000 7f08d5509700 1 -- start start 2023-12-16T05:57:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.642+0000 7f08d5509700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08d00fbb00 0x7f08d00ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.642+0000 7f08d5509700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d00fcd10 0x7f08d00fe050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.642+0000 7f08d5509700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00fe650 con 0x7f08d00fcd10 2023-12-16T05:57:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.642+0000 7f08d5509700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00fe7c0 con 0x7f08d00fbb00 2023-12-16T05:57:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.643+0000 7f08ce7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d00fcd10 0x7f08d00fe050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.643+0000 7f08ce7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d00fcd10 0x7f08d00fe050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:57194/0 (socket says 172.21.15.155:57194) 2023-12-16T05:57:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.643+0000 7f08ceffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08d00fbb00 0x7f08d00ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.643+0000 7f08ce7fc700 1 -- 172.21.15.155:0/3651603825 learned_addr learned my addr 172.21.15.155:0/3651603825 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:57:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.643+0000 7f08ce7fc700 1 -- 172.21.15.155:0/3651603825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08d00fbb00 msgr2=0x7f08d00ffbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.643+0000 7f08ce7fc700 1 --2- 172.21.15.155:0/3651603825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08d00fbb00 0x7f08d00ffbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.643+0000 7f08ce7fc700 1 -- 172.21.15.155:0/3651603825 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c0005040 con 0x7f08d00fcd10 2023-12-16T05:57:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.643+0000 7f08ce7fc700 1 --2- 172.21.15.155:0/3651603825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d00fcd10 0x7f08d00fe050 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f08c400eb40 tx=0x7f08c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:57:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.643+0000 7f08b77fe700 1 -- 172.21.15.155:0/3651603825 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08c4007cc0 con 0x7f08d00fcd10 2023-12-16T05:57:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.643+0000 7f08d5509700 1 -- 172.21.15.155:0/3651603825 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d00fea40 con 0x7f08d00fcd10 2023-12-16T05:57:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.643+0000 7f08b77fe700 1 -- 172.21.15.155:0/3651603825 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f08c400f040 con 0x7f08d00fcd10 2023-12-16T05:57:10.648 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.643+0000 7f08b77fe700 1 -- 172.21.15.155:0/3651603825 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08c400c990 con 0x7f08d00fcd10 2023-12-16T05:57:10.648 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.643+0000 7f08d5509700 1 -- 172.21.15.155:0/3651603825 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d01154f0 con 0x7f08d00fcd10 2023-12-16T05:57:10.648 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.644+0000 7f08d5509700 1 -- 172.21.15.155:0/3651603825 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d004bb80 con 0x7f08d00fcd10 2023-12-16T05:57:10.648 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.645+0000 7f08b77fe700 1 -- 172.21.15.155:0/3651603825 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 24) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f08c400cc00 con 0x7f08d00fcd10 2023-12-16T05:57:10.648 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.645+0000 7f08b77fe700 1 --2- 172.21.15.155:0/3651603825 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f08b806ae40 0x7f08b806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:10.648 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.645+0000 7f08b77fe700 1 -- 172.21.15.155:0/3651603825 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f08c40893e0 con 0x7f08d00fcd10 2023-12-16T05:57:10.649 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.646+0000 7f08ceffd700 1 --2- 172.21.15.155:0/3651603825 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f08b806ae40 0x7f08b806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:10.649 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.646+0000 7f08ceffd700 1 --2- 172.21.15.155:0/3651603825 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f08b806ae40 0x7f08b806d2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f08c0009fd0 tx=0x7f08c0009e30 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:57:10.653 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.651+0000 7f08b77fe700 1 -- 172.21.15.155:0/3651603825 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f08c404ece0 con 0x7f08d00fcd10 2023-12-16T05:57:10.921 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.919+0000 7f08d5509700 1 -- 172.21.15.155:0/3651603825 --> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f08d00662f0 con 0x7f08b806ae40 2023-12-16T05:57:10.923 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.920+0000 7f08b77fe700 1 -- 172.21.15.155:0/3651603825 <== mgr.24363 v2:172.21.15.156:6828/1939402353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f08d00662f0 con 0x7f08b806ae40 2023-12-16T05:57:10.923 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T05:57:10.923 INFO:teuthology.orchestra.run.smithi155.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T05:57:10.923 INFO:teuthology.orchestra.run.smithi155.stdout: "in_progress": true, 2023-12-16T05:57:10.923 INFO:teuthology.orchestra.run.smithi155.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T05:57:10.923 INFO:teuthology.orchestra.run.smithi155.stdout: "services_complete": [], 2023-12-16T05:57:10.923 INFO:teuthology.orchestra.run.smithi155.stdout: "progress": "1/2 daemons upgraded", 2023-12-16T05:57:10.923 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "Currently upgrading mgr daemons", 2023-12-16T05:57:10.923 INFO:teuthology.orchestra.run.smithi155.stdout: "is_paused": false 2023-12-16T05:57:10.924 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T05:57:10.928 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.924+0000 7f08d5509700 1 -- 172.21.15.155:0/3651603825 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f08b806ae40 msgr2=0x7f08b806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:10.928 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.924+0000 7f08d5509700 1 --2- 172.21.15.155:0/3651603825 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f08b806ae40 0x7f08b806d2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f08c0009fd0 tx=0x7f08c0009e30 comp rx=0 tx=0).stop 2023-12-16T05:57:10.928 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.924+0000 7f08d5509700 1 -- 172.21.15.155:0/3651603825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d00fcd10 msgr2=0x7f08d00fe050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:10.928 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.924+0000 7f08d5509700 1 --2- 172.21.15.155:0/3651603825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d00fcd10 0x7f08d00fe050 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f08c400eb40 tx=0x7f08c400b040 comp rx=0 tx=0).stop 2023-12-16T05:57:10.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.926+0000 7f08d5509700 1 -- 172.21.15.155:0/3651603825 shutdown_connections 2023-12-16T05:57:10.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.926+0000 7f08d5509700 1 --2- 172.21.15.155:0/3651603825 >> [v2:172.21.15.156:6828/1939402353,v1:172.21.15.156:6829/1939402353] conn(0x7f08b806ae40 0x7f08b806d2f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:10.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.926+0000 7f08d5509700 1 --2- 172.21.15.155:0/3651603825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08d00fbb00 0x7f08d00ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:10.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.926+0000 7f08d5509700 1 --2- 172.21.15.155:0/3651603825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08d00fcd10 0x7f08d00fe050 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:10.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.926+0000 7f08d5509700 1 -- 172.21.15.155:0/3651603825 >> 172.21.15.155:0/3651603825 conn(0x7f08d00f71c0 msgr2=0x7f08d0065be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:57:10.930 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.928+0000 7f08d5509700 1 -- 172.21.15.155:0/3651603825 shutdown_connections 2023-12-16T05:57:10.931 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:10.928+0000 7f08d5509700 1 -- 172.21.15.155:0/3651603825 wait complete. 2023-12-16T05:57:11.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:10 smithi155 ceph-mon[112451]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:57:11.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:10 smithi155 ceph-mon[112451]: Upgrade: Updating mgr.smithi155.maowdn 2023-12-16T05:57:11.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:10 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:11.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:10 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi155.maowdn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T05:57:11.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:10 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi155.maowdn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T05:57:11.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:10 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T05:57:11.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:10 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:57:11.079 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:10 smithi155 ceph-mon[112451]: Deploying daemon mgr.smithi155.maowdn on smithi155 2023-12-16T05:57:11.079 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:10 smithi155 ceph-mon[112451]: from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:57:11.079 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:10 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2915574699' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:57:11.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:10 smithi156 ceph-mon[121001]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:57:11.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:10 smithi156 ceph-mon[121001]: Upgrade: Updating mgr.smithi155.maowdn 2023-12-16T05:57:11.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:10 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:11.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:10 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi155.maowdn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T05:57:11.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:10 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi155.maowdn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T05:57:11.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:10 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T05:57:11.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:10 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:57:11.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:10 smithi156 ceph-mon[121001]: Deploying daemon mgr.smithi155.maowdn on smithi155 2023-12-16T05:57:11.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:10 smithi156 ceph-mon[121001]: from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:57:11.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:10 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/2915574699' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:57:12.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:11 smithi156 ceph-mon[121001]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:57:12.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:11 smithi156 ceph-mon[121001]: pgmap v32: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 642 op/s 2023-12-16T05:57:12.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:11 smithi155 ceph-mon[112451]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:57:12.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:11 smithi155 ceph-mon[112451]: pgmap v32: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 642 op/s 2023-12-16T05:57:13.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:13 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:13.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:13 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:13.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:57:13.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:13 smithi155 ceph-mon[112451]: pgmap v33: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 486 op/s 2023-12-16T05:57:13.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:13 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:57:14.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:13 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:14.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:13 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:14.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:57:14.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:13 smithi156 ceph-mon[121001]: pgmap v33: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 486 op/s 2023-12-16T05:57:14.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:13 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:57:16.169 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:16 smithi155 ceph-mon[112451]: pgmap v34: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 721 op/s 2023-12-16T05:57:16.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:16 smithi156 ceph-mon[121001]: pgmap v34: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 721 op/s 2023-12-16T05:57:17.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:17 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:17.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:17 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:17.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:17 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:17.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:17 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:17.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:17 smithi156 ceph-mon[121001]: pgmap v35: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 512 op/s 2023-12-16T05:57:17.941 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:17 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:17.941 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:17 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:17.941 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:17 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:17.942 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:17 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:17.942 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:17 smithi155 ceph-mon[112451]: pgmap v35: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 512 op/s 2023-12-16T05:57:18.900 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:18 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:18.900 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:18 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:18.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:18 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:18.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:18 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:19.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:19 smithi156 ceph-mon[121001]: pgmap v36: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 512 op/s 2023-12-16T05:57:19.966 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:19 smithi155 ceph-mon[112451]: pgmap v36: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 512 op/s 2023-12-16T05:57:21.424 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:21.424 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:21.424 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:57:21.424 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:57:21.424 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:21.424 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:57:21.424 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mgr fail", "who": "smithi156.pclong"}]: dispatch 2023-12-16T05:57:21.424 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mgr fail", "who": "smithi156.pclong"}]: dispatch 2023-12-16T05:57:21.424 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: osdmap e45: 6 total, 6 up, 6 in 2023-12-16T05:57:21.424 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd='[{"prefix": "mgr fail", "who": "smithi156.pclong"}]': finished 2023-12-16T05:57:21.425 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: mgrmap e25: smithi155.maowdn(active, starting, since 0.00600606s) 2023-12-16T05:57:21.425 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: Active manager daemon smithi155.maowdn restarted 2023-12-16T05:57:21.425 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: Activating manager daemon smithi155.maowdn 2023-12-16T05:57:21.425 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.maowdn/crt"}]: dispatch 2023-12-16T05:57:21.425 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T05:57:21.425 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: osdmap e46: 6 total, 6 up, 6 in 2023-12-16T05:57:21.425 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: mgrmap e26: smithi155.maowdn(active, starting, since 0.00801339s) 2023-12-16T05:57:21.425 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.maowdn/key"}]: dispatch 2023-12-16T05:57:21.425 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.maowdn/key"}]: dispatch 2023-12-16T05:57:21.425 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:57:21.425 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:57:21.425 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.bzsxjw"}]: dispatch 2023-12-16T05:57:21.425 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.vicpis"}]: dispatch 2023-12-16T05:57:21.425 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.qvgmfj"}]: dispatch 2023-12-16T05:57:21.426 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.fasing"}]: dispatch 2023-12-16T05:57:21.426 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr metadata", "who": "smithi155.maowdn", "id": "smithi155.maowdn"}]: dispatch 2023-12-16T05:57:21.426 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T05:57:21.426 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T05:57:21.426 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T05:57:21.426 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T05:57:21.426 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T05:57:21.426 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T05:57:21.426 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T05:57:21.426 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T05:57:21.539 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:21.539 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:21.539 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:57:21.539 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:57:21.539 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' 2023-12-16T05:57:21.539 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:57:21.539 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.24363 172.21.15.156:0/65588444' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mgr fail", "who": "smithi156.pclong"}]: dispatch 2023-12-16T05:57:21.539 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd=[{"prefix": "mgr fail", "who": "smithi156.pclong"}]: dispatch 2023-12-16T05:57:21.540 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: osdmap e45: 6 total, 6 up, 6 in 2023-12-16T05:57:21.540 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.24363 ' entity='mgr.smithi156.pclong' cmd='[{"prefix": "mgr fail", "who": "smithi156.pclong"}]': finished 2023-12-16T05:57:21.540 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: mgrmap e25: smithi155.maowdn(active, starting, since 0.00600606s) 2023-12-16T05:57:21.540 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: Active manager daemon smithi155.maowdn restarted 2023-12-16T05:57:21.540 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: Activating manager daemon smithi155.maowdn 2023-12-16T05:57:21.540 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.maowdn/crt"}]: dispatch 2023-12-16T05:57:21.540 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T05:57:21.540 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: osdmap e46: 6 total, 6 up, 6 in 2023-12-16T05:57:21.540 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: mgrmap e26: smithi155.maowdn(active, starting, since 0.00801339s) 2023-12-16T05:57:21.540 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.maowdn/key"}]: dispatch 2023-12-16T05:57:21.540 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.maowdn/key"}]: dispatch 2023-12-16T05:57:21.540 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:57:21.541 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:57:21.541 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.bzsxjw"}]: dispatch 2023-12-16T05:57:21.541 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.vicpis"}]: dispatch 2023-12-16T05:57:21.541 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.qvgmfj"}]: dispatch 2023-12-16T05:57:21.541 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.fasing"}]: dispatch 2023-12-16T05:57:21.541 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr metadata", "who": "smithi155.maowdn", "id": "smithi155.maowdn"}]: dispatch 2023-12-16T05:57:21.541 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T05:57:21.541 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T05:57:21.541 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T05:57:21.541 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T05:57:21.541 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T05:57:21.541 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T05:57:21.542 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T05:57:21.542 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T05:57:21.542 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T05:57:21.542 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T05:57:21.542 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: Manager daemon smithi155.maowdn is now available 2023-12-16T05:57:21.542 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:57:21.542 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:57:21.542 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:57:21.542 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.maowdn/mirror_snapshot_schedule"}]: dispatch 2023-12-16T05:57:21.542 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.maowdn/trash_purge_schedule"}]: dispatch 2023-12-16T05:57:21.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T05:57:21.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T05:57:21.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: Manager daemon smithi155.maowdn is now available 2023-12-16T05:57:21.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:57:21.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:57:21.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:57:21.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.maowdn/mirror_snapshot_schedule"}]: dispatch 2023-12-16T05:57:21.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.maowdn/trash_purge_schedule"}]: dispatch 2023-12-16T05:57:23.477 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:23 smithi155 ceph-mon[112451]: [16/Dec/2023:05:57:21] ENGINE Bus STARTING 2023-12-16T05:57:23.477 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:23 smithi155 ceph-mon[112451]: [16/Dec/2023:05:57:21] ENGINE Serving on http://172.21.15.155:8765 2023-12-16T05:57:23.477 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:23 smithi155 ceph-mon[112451]: [16/Dec/2023:05:57:21] ENGINE Serving on https://172.21.15.155:7150 2023-12-16T05:57:23.477 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:23 smithi155 ceph-mon[112451]: [16/Dec/2023:05:57:21] ENGINE Bus STARTED 2023-12-16T05:57:23.477 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:23 smithi155 ceph-mon[112451]: mgrmap e27: smithi155.maowdn(active, since 1.01984s) 2023-12-16T05:57:23.477 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:23 smithi155 ceph-mon[112451]: pgmap v3: 65 pgs: 65 active+clean; 282 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:57:23.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:23 smithi156 ceph-mon[121001]: [16/Dec/2023:05:57:21] ENGINE Bus STARTING 2023-12-16T05:57:23.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:23 smithi156 ceph-mon[121001]: [16/Dec/2023:05:57:21] ENGINE Serving on http://172.21.15.155:8765 2023-12-16T05:57:23.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:23 smithi156 ceph-mon[121001]: [16/Dec/2023:05:57:21] ENGINE Serving on https://172.21.15.155:7150 2023-12-16T05:57:23.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:23 smithi156 ceph-mon[121001]: [16/Dec/2023:05:57:21] ENGINE Bus STARTED 2023-12-16T05:57:23.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:23 smithi156 ceph-mon[121001]: mgrmap e27: smithi155.maowdn(active, since 1.01984s) 2023-12-16T05:57:23.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:23 smithi156 ceph-mon[121001]: pgmap v3: 65 pgs: 65 active+clean; 282 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:57:24.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:24 smithi155 ceph-mon[112451]: pgmap v4: 65 pgs: 65 active+clean; 282 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:57:24.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:24 smithi155 ceph-mon[112451]: mgrmap e28: smithi155.maowdn(active, since 2s) 2023-12-16T05:57:24.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:24 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:24.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:24 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:24.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:24 smithi156 ceph-mon[121001]: pgmap v4: 65 pgs: 65 active+clean; 282 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:57:24.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:24 smithi156 ceph-mon[121001]: mgrmap e28: smithi155.maowdn(active, since 2s) 2023-12-16T05:57:24.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:24 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:24.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:24 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:25.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:25 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:25.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:25 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:25.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:25 smithi156 ceph-mon[121001]: pgmap v5: 65 pgs: 65 active+clean; 282 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:57:26.093 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:25 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:26.093 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:25 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:26.093 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:25 smithi155 ceph-mon[112451]: pgmap v5: 65 pgs: 65 active+clean; 282 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:57:27.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:26 smithi155 ceph-mon[112451]: mgrmap e29: smithi155.maowdn(active, since 4s) 2023-12-16T05:57:27.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:26 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:27.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:26 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:27.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:26 smithi156 ceph-mon[121001]: mgrmap e29: smithi155.maowdn(active, since 4s) 2023-12-16T05:57:27.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:26 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:27.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:26 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:28.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:28 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:28.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:28 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:28.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:28 smithi155 ceph-mon[112451]: pgmap v6: 65 pgs: 65 active+clean; 282 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:57:28.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:28 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:28.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:28 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:28.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:28 smithi156 ceph-mon[121001]: pgmap v6: 65 pgs: 65 active+clean; 282 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:57:29.526 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:29 smithi155 ceph-mon[112451]: Standby manager daemon smithi156.pclong started 2023-12-16T05:57:29.526 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:29 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.156:0/1605967812' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.pclong/crt"}]: dispatch 2023-12-16T05:57:29.526 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:29 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.156:0/1605967812' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T05:57:29.526 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:29 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.156:0/1605967812' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.pclong/key"}]: dispatch 2023-12-16T05:57:29.526 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:29 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.156:0/1605967812' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T05:57:29.670 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:29 smithi156 ceph-mon[121001]: Standby manager daemon smithi156.pclong started 2023-12-16T05:57:29.670 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:29 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.156:0/1605967812' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.pclong/crt"}]: dispatch 2023-12-16T05:57:29.671 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:29 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.156:0/1605967812' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T05:57:29.671 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:29 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.156:0/1605967812' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.pclong/key"}]: dispatch 2023-12-16T05:57:29.671 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:29 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.156:0/1605967812' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T05:57:30.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:30 smithi156 ceph-mon[121001]: pgmap v7: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 240 op/s 2023-12-16T05:57:30.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:30 smithi156 ceph-mon[121001]: mgrmap e30: smithi155.maowdn(active, since 8s), standbys: smithi156.pclong 2023-12-16T05:57:30.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:30 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr metadata", "who": "smithi156.pclong", "id": "smithi156.pclong"}]: dispatch 2023-12-16T05:57:30.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:30 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:30.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:30 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:30.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:30 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:57:30.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:30 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:57:30.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:30 smithi156 ceph-mon[121001]: Updating smithi155:/etc/ceph/ceph.conf 2023-12-16T05:57:30.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:30 smithi156 ceph-mon[121001]: Updating smithi156:/etc/ceph/ceph.conf 2023-12-16T05:57:30.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:30 smithi155 ceph-mon[112451]: pgmap v7: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 240 op/s 2023-12-16T05:57:30.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:30 smithi155 ceph-mon[112451]: mgrmap e30: smithi155.maowdn(active, since 8s), standbys: smithi156.pclong 2023-12-16T05:57:30.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:30 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr metadata", "who": "smithi156.pclong", "id": "smithi156.pclong"}]: dispatch 2023-12-16T05:57:30.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:30 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:30.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:30 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:30.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:30 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:57:30.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:30 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:57:30.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:30 smithi155 ceph-mon[112451]: Updating smithi155:/etc/ceph/ceph.conf 2023-12-16T05:57:30.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:30 smithi155 ceph-mon[112451]: Updating smithi156:/etc/ceph/ceph.conf 2023-12-16T05:57:31.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:31 smithi156 ceph-mon[121001]: Updating smithi156:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:57:31.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:31 smithi156 ceph-mon[121001]: Updating smithi155:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:57:31.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:31 smithi156 ceph-mon[121001]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2023-12-16T05:57:31.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:31 smithi156 ceph-mon[121001]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-12-16T05:57:31.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:31 smithi156 ceph-mon[121001]: Updating smithi155:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T05:57:31.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:31 smithi156 ceph-mon[121001]: Updating smithi156:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T05:57:31.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:31 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:31.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:31 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:31.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:31 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:31.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:31 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:31.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:31 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:31.687 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:31 smithi155 ceph-mon[112451]: Updating smithi156:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:57:31.687 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:31 smithi155 ceph-mon[112451]: Updating smithi155:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:57:31.687 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:31 smithi155 ceph-mon[112451]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2023-12-16T05:57:31.688 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:31 smithi155 ceph-mon[112451]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-12-16T05:57:31.688 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:31 smithi155 ceph-mon[112451]: Updating smithi155:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T05:57:31.688 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:31 smithi155 ceph-mon[112451]: Updating smithi156:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T05:57:31.688 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:31 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:31.688 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:31 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:31.688 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:31 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:31.688 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:31 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:31.688 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:31 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:32.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:32 smithi156 ceph-mon[121001]: Reconfiguring prometheus.smithi155 (dependencies changed)... 2023-12-16T05:57:32.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:32 smithi156 ceph-mon[121001]: Reconfiguring daemon prometheus.smithi155 on smithi155 2023-12-16T05:57:32.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:32 smithi156 ceph-mon[121001]: pgmap v8: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 976 KiB/s rd, 969 KiB/s wr, 187 op/s 2023-12-16T05:57:32.708 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:32 smithi155 ceph-mon[112451]: Reconfiguring prometheus.smithi155 (dependencies changed)... 2023-12-16T05:57:32.708 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:32 smithi155 ceph-mon[112451]: Reconfiguring daemon prometheus.smithi155 on smithi155 2023-12-16T05:57:32.708 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:32 smithi155 ceph-mon[112451]: pgmap v8: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 976 KiB/s rd, 969 KiB/s wr, 187 op/s 2023-12-16T05:57:34.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:34 smithi156 ceph-mon[121001]: pgmap v9: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 284 op/s 2023-12-16T05:57:34.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:34 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:34.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:34 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:34.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:34 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T05:57:34.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:34 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:57:34.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:34 smithi155 ceph-mon[112451]: pgmap v9: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 284 op/s 2023-12-16T05:57:34.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:34 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:34.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:34 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:34.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:34 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T05:57:34.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:34 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:57:35.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:35 smithi156 ceph-mon[121001]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T05:57:35.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:35 smithi155 ceph-mon[112451]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T05:57:36.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:36 smithi156 ceph-mon[121001]: pgmap v10: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 260 op/s 2023-12-16T05:57:36.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:36 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.pclong", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T05:57:36.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:36 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T05:57:36.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:36 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:57:36.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:36 smithi155 ceph-mon[112451]: pgmap v10: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 260 op/s 2023-12-16T05:57:36.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:36 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.pclong", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T05:57:36.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:36 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T05:57:36.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:36 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:57:37.589 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:37 smithi156 ceph-mon[121001]: Upgrade: Updating mgr.smithi156.pclong 2023-12-16T05:57:37.589 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:37 smithi156 ceph-mon[121001]: Deploying daemon mgr.smithi156.pclong on smithi156 2023-12-16T05:57:37.589 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:37 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:57:37.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:37 smithi155 ceph-mon[112451]: Upgrade: Updating mgr.smithi156.pclong 2023-12-16T05:57:37.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:37 smithi155 ceph-mon[112451]: Deploying daemon mgr.smithi156.pclong on smithi156 2023-12-16T05:57:37.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:37 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:57:38.404 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:38 smithi156 ceph-mon[121001]: pgmap v11: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 260 op/s 2023-12-16T05:57:38.404 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:38 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:38.404 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:38 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:38.404 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:38 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:57:38.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:38 smithi155 ceph-mon[112451]: pgmap v11: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 260 op/s 2023-12-16T05:57:38.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:38 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:38.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:38 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:38.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:38 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:57:40.410 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:40 smithi156 ceph-mon[121001]: pgmap v12: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 423 op/s 2023-12-16T05:57:40.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:40 smithi155 ceph-mon[112451]: pgmap v12: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 423 op/s 2023-12-16T05:57:41.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.048+0000 7fbb6d0ce700 1 -- 172.21.15.155:0/3948774004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb68107560 msgr2=0x7fbb68109940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:41.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.048+0000 7fbb6d0ce700 1 --2- 172.21.15.155:0/3948774004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb68107560 0x7fbb68109940 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c004940 tx=0x7fbb5c009e30 comp rx=0 tx=0).stop 2023-12-16T05:57:41.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.048+0000 7fbb6d0ce700 1 -- 172.21.15.155:0/3948774004 shutdown_connections 2023-12-16T05:57:41.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.048+0000 7fbb6d0ce700 1 --2- 172.21.15.155:0/3948774004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb68107560 0x7fbb68109940 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:41.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.048+0000 7fbb6d0ce700 1 --2- 172.21.15.155:0/3948774004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb68104c40 0x7fbb68107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:41.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.048+0000 7fbb6d0ce700 1 -- 172.21.15.155:0/3948774004 >> 172.21.15.155:0/3948774004 conn(0x7fbb68069b20 msgr2=0x7fbb6806bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:57:41.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.048+0000 7fbb6d0ce700 1 -- 172.21.15.155:0/3948774004 shutdown_connections 2023-12-16T05:57:41.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.048+0000 7fbb6d0ce700 1 -- 172.21.15.155:0/3948774004 wait complete. 2023-12-16T05:57:41.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.049+0000 7fbb6d0ce700 1 Processor -- start 2023-12-16T05:57:41.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.049+0000 7fbb6d0ce700 1 -- start start 2023-12-16T05:57:41.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.049+0000 7fbb6d0ce700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb68104c40 0x7fbb681189d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:41.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.049+0000 7fbb6d0ce700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb68107560 0x7fbb6811af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:41.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.049+0000 7fbb6d0ce700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6806f8a0 con 0x7fbb68104c40 2023-12-16T05:57:41.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.049+0000 7fbb6d0ce700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6806f9e0 con 0x7fbb68107560 2023-12-16T05:57:41.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.050+0000 7fbb66d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb68104c40 0x7fbb681189d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:41.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.050+0000 7fbb66d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb68104c40 0x7fbb681189d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33484/0 (socket says 172.21.15.155:33484) 2023-12-16T05:57:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.050+0000 7fbb66d9d700 1 -- 172.21.15.155:0/550041180 learned_addr learned my addr 172.21.15.155:0/550041180 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:57:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.050+0000 7fbb6659c700 1 --2- 172.21.15.155:0/550041180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb68107560 0x7fbb6811af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.050+0000 7fbb66d9d700 1 -- 172.21.15.155:0/550041180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb68107560 msgr2=0x7fbb6811af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.050+0000 7fbb66d9d700 1 --2- 172.21.15.155:0/550041180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb68107560 0x7fbb6811af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.050+0000 7fbb66d9d700 1 -- 172.21.15.155:0/550041180 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5c005040 con 0x7fbb68104c40 2023-12-16T05:57:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.050+0000 7fbb6659c700 1 --2- 172.21.15.155:0/550041180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb68107560 0x7fbb6811af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T05:57:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.050+0000 7fbb66d9d700 1 --2- 172.21.15.155:0/550041180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb68104c40 0x7fbb681189d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800eb70 tx=0x7fbb5800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:57:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.050+0000 7fbb4f7fe700 1 -- 172.21.15.155:0/550041180 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb58007cc0 con 0x7fbb68104c40 2023-12-16T05:57:41.054 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.050+0000 7fbb4f7fe700 1 -- 172.21.15.155:0/550041180 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbb5800f040 con 0x7fbb68104c40 2023-12-16T05:57:41.054 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.050+0000 7fbb6d0ce700 1 -- 172.21.15.155:0/550041180 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb681147b0 con 0x7fbb68104c40 2023-12-16T05:57:41.054 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.051+0000 7fbb4f7fe700 1 -- 172.21.15.155:0/550041180 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb5800c9d0 con 0x7fbb68104c40 2023-12-16T05:57:41.054 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.051+0000 7fbb6d0ce700 1 -- 172.21.15.155:0/550041180 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb68114cf0 con 0x7fbb68104c40 2023-12-16T05:57:41.054 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.052+0000 7fbb6d0ce700 1 -- 172.21.15.155:0/550041180 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb6810ed10 con 0x7fbb68104c40 2023-12-16T05:57:41.054 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.052+0000 7fbb4f7fe700 1 -- 172.21.15.155:0/550041180 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 30) v1 ==== 90903+0+0 (secure 0 0 0) 0x7fbb5800cc40 con 0x7fbb68104c40 2023-12-16T05:57:41.054 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.052+0000 7fbb4f7fe700 1 --2- 172.21.15.155:0/550041180 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fbb5006cc00 0x7fbb5006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:41.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.053+0000 7fbb4f7fe700 1 -- 172.21.15.155:0/550041180 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fbb5808ba80 con 0x7fbb68104c40 2023-12-16T05:57:41.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.053+0000 7fbb6659c700 1 --2- 172.21.15.155:0/550041180 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fbb5006cc00 0x7fbb5006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:41.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.053+0000 7fbb6659c700 1 --2- 172.21.15.155:0/550041180 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fbb5006cc00 0x7fbb5006f0b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c000c00 tx=0x7fbb5c01c040 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:57:41.061 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.059+0000 7fbb4f7fe700 1 -- 172.21.15.155:0/550041180 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fbb58055cc0 con 0x7fbb68104c40 2023-12-16T05:57:41.329 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.327+0000 7fbb6d0ce700 1 -- 172.21.15.155:0/550041180 --> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb6802b250 con 0x7fbb5006cc00 2023-12-16T05:57:41.330 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.329+0000 7fbb4f7fe700 1 -- 172.21.15.155:0/550041180 <== mgr.14646 v2:172.21.15.155:6800/1257988911 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fbb6802b250 con 0x7fbb5006cc00 2023-12-16T05:57:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.331+0000 7fbb6d0ce700 1 -- 172.21.15.155:0/550041180 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fbb5006cc00 msgr2=0x7fbb5006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.331+0000 7fbb6d0ce700 1 --2- 172.21.15.155:0/550041180 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fbb5006cc00 0x7fbb5006f0b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c000c00 tx=0x7fbb5c01c040 comp rx=0 tx=0).stop 2023-12-16T05:57:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.331+0000 7fbb6d0ce700 1 -- 172.21.15.155:0/550041180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb68104c40 msgr2=0x7fbb681189d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.331+0000 7fbb6d0ce700 1 --2- 172.21.15.155:0/550041180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb68104c40 0x7fbb681189d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800eb70 tx=0x7fbb5800b040 comp rx=0 tx=0).stop 2023-12-16T05:57:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.331+0000 7fbb6d0ce700 1 -- 172.21.15.155:0/550041180 shutdown_connections 2023-12-16T05:57:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.331+0000 7fbb6d0ce700 1 --2- 172.21.15.155:0/550041180 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fbb5006cc00 0x7fbb5006f0b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:41.334 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.331+0000 7fbb6d0ce700 1 --2- 172.21.15.155:0/550041180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb68104c40 0x7fbb681189d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:41.334 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.331+0000 7fbb6d0ce700 1 --2- 172.21.15.155:0/550041180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb68107560 0x7fbb6811af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:41.334 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.331+0000 7fbb6d0ce700 1 -- 172.21.15.155:0/550041180 >> 172.21.15.155:0/550041180 conn(0x7fbb68069b20 msgr2=0x7fbb6806bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:57:41.334 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.331+0000 7fbb6d0ce700 1 -- 172.21.15.155:0/550041180 shutdown_connections 2023-12-16T05:57:41.334 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.331+0000 7fbb6d0ce700 1 -- 172.21.15.155:0/550041180 wait complete. 2023-12-16T05:57:41.349 INFO:teuthology.orchestra.run.smithi155.stdout:true 2023-12-16T05:57:41.455 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.453+0000 7f0bbfbf5700 1 -- 172.21.15.155:0/2721831392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb80fbe70 msgr2=0x7f0bb80fc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:41.455 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.453+0000 7f0bbfbf5700 1 --2- 172.21.15.155:0/2721831392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb80fbe70 0x7f0bb80fc2e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4004940 tx=0x7f0bb4009e30 comp rx=0 tx=0).stop 2023-12-16T05:57:41.455 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.453+0000 7f0bbfbf5700 1 -- 172.21.15.155:0/2721831392 shutdown_connections 2023-12-16T05:57:41.455 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.453+0000 7f0bbfbf5700 1 --2- 172.21.15.155:0/2721831392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb80fbe70 0x7f0bb80fc2e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:41.455 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.453+0000 7f0bbfbf5700 1 --2- 172.21.15.155:0/2721831392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bb80fb520 0x7f0bb80fb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:41.456 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.453+0000 7f0bbfbf5700 1 -- 172.21.15.155:0/2721831392 >> 172.21.15.155:0/2721831392 conn(0x7f0bb80f7190 msgr2=0x7f0bb80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:57:41.456 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.453+0000 7f0bbfbf5700 1 -- 172.21.15.155:0/2721831392 shutdown_connections 2023-12-16T05:57:41.456 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.453+0000 7f0bbfbf5700 1 -- 172.21.15.155:0/2721831392 wait complete. 2023-12-16T05:57:41.457 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.454+0000 7f0bbfbf5700 1 Processor -- start 2023-12-16T05:57:41.457 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.454+0000 7f0bbfbf5700 1 -- start start 2023-12-16T05:57:41.457 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.454+0000 7f0bbfbf5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bb80fb520 0x7f0bb810f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:41.457 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.454+0000 7f0bbfbf5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb80fbe70 0x7f0bb810fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:41.457 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.454+0000 7f0bbfbf5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb8110300 con 0x7f0bb80fbe70 2023-12-16T05:57:41.457 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.454+0000 7f0bbfbf5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb8110b40 con 0x7f0bb80fb520 2023-12-16T05:57:41.457 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.454+0000 7f0bbd190700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb80fbe70 0x7f0bb810fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:41.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.454+0000 7f0bbd190700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb80fbe70 0x7f0bb810fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33508/0 (socket says 172.21.15.155:33508) 2023-12-16T05:57:41.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.454+0000 7f0bbd190700 1 -- 172.21.15.155:0/765927023 learned_addr learned my addr 172.21.15.155:0/765927023 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:57:41.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.454+0000 7f0bbd991700 1 --2- 172.21.15.155:0/765927023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bb80fb520 0x7f0bb810f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:41.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.455+0000 7f0bbd190700 1 -- 172.21.15.155:0/765927023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bb80fb520 msgr2=0x7f0bb810f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:41.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.455+0000 7f0bbd190700 1 --2- 172.21.15.155:0/765927023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bb80fb520 0x7f0bb810f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:41.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.455+0000 7f0bbd190700 1 -- 172.21.15.155:0/765927023 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb4005040 con 0x7f0bb80fbe70 2023-12-16T05:57:41.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.455+0000 7f0bbd190700 1 --2- 172.21.15.155:0/765927023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb80fbe70 0x7f0bb810fc70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009380 tx=0x7f0bb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:57:41.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.455+0000 7f0bae7fc700 1 -- 172.21.15.155:0/765927023 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bb400e040 con 0x7f0bb80fbe70 2023-12-16T05:57:41.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.455+0000 7f0bbfbf5700 1 -- 172.21.15.155:0/765927023 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb8110dc0 con 0x7f0bb80fbe70 2023-12-16T05:57:41.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.455+0000 7f0bae7fc700 1 -- 172.21.15.155:0/765927023 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0bb400bd20 con 0x7f0bb80fbe70 2023-12-16T05:57:41.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.455+0000 7f0bae7fc700 1 -- 172.21.15.155:0/765927023 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bb401c630 con 0x7f0bb80fbe70 2023-12-16T05:57:41.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.455+0000 7f0bbfbf5700 1 -- 172.21.15.155:0/765927023 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb8111300 con 0x7f0bb80fbe70 2023-12-16T05:57:41.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.456+0000 7f0bbfbf5700 1 -- 172.21.15.155:0/765927023 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb804bb80 con 0x7f0bb80fbe70 2023-12-16T05:57:41.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.456+0000 7f0bae7fc700 1 -- 172.21.15.155:0/765927023 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 30) v1 ==== 90903+0+0 (secure 0 0 0) 0x7f0bb4013420 con 0x7f0bb80fbe70 2023-12-16T05:57:41.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.457+0000 7f0bae7fc700 1 --2- 172.21.15.155:0/765927023 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f0ba406cc00 0x7f0ba406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:41.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.457+0000 7f0bae7fc700 1 -- 172.21.15.155:0/765927023 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f0bb408d3c0 con 0x7f0bb80fbe70 2023-12-16T05:57:41.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.457+0000 7f0bbd991700 1 --2- 172.21.15.155:0/765927023 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f0ba406cc00 0x7f0ba406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:41.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.457+0000 7f0bbd991700 1 --2- 172.21.15.155:0/765927023 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f0ba406cc00 0x7f0ba406f0b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009bf0 tx=0x7f0ba80091a0 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:57:41.463 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.462+0000 7f0bae7fc700 1 -- 172.21.15.155:0/765927023 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0bb405b060 con 0x7f0bb80fbe70 2023-12-16T05:57:41.705 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.704+0000 7f0bbfbf5700 1 -- 172.21.15.155:0/765927023 --> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bb81117e0 con 0x7f0ba406cc00 2023-12-16T05:57:41.706 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.705+0000 7f0bae7fc700 1 -- 172.21.15.155:0/765927023 <== mgr.14646 v2:172.21.15.155:6800/1257988911 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f0bb81117e0 con 0x7f0ba406cc00 2023-12-16T05:57:41.709 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.707+0000 7f0bbfbf5700 1 -- 172.21.15.155:0/765927023 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f0ba406cc00 msgr2=0x7f0ba406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:41.709 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.707+0000 7f0bbfbf5700 1 --2- 172.21.15.155:0/765927023 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f0ba406cc00 0x7f0ba406f0b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009bf0 tx=0x7f0ba80091a0 comp rx=0 tx=0).stop 2023-12-16T05:57:41.709 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.708+0000 7f0bbfbf5700 1 -- 172.21.15.155:0/765927023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb80fbe70 msgr2=0x7f0bb810fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:41.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.708+0000 7f0bbfbf5700 1 --2- 172.21.15.155:0/765927023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb80fbe70 0x7f0bb810fc70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009380 tx=0x7f0bb4009e30 comp rx=0 tx=0).stop 2023-12-16T05:57:41.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.708+0000 7f0bbfbf5700 1 -- 172.21.15.155:0/765927023 shutdown_connections 2023-12-16T05:57:41.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.708+0000 7f0bbfbf5700 1 --2- 172.21.15.155:0/765927023 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f0ba406cc00 0x7f0ba406f0b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:41.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.708+0000 7f0bbfbf5700 1 --2- 172.21.15.155:0/765927023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bb80fb520 0x7f0bb810f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:41.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.708+0000 7f0bbfbf5700 1 --2- 172.21.15.155:0/765927023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb80fbe70 0x7f0bb810fc70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:41.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.708+0000 7f0bbfbf5700 1 -- 172.21.15.155:0/765927023 >> 172.21.15.155:0/765927023 conn(0x7f0bb80f7190 msgr2=0x7f0bb8103b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:57:41.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.708+0000 7f0bbfbf5700 1 -- 172.21.15.155:0/765927023 shutdown_connections 2023-12-16T05:57:41.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.708+0000 7f0bbfbf5700 1 -- 172.21.15.155:0/765927023 wait complete. 2023-12-16T05:57:41.822 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.820+0000 7f671969b700 1 -- 172.21.15.155:0/1611867892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6714066920 msgr2=0x7f6714101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:41.822 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.820+0000 7f671969b700 1 --2- 172.21.15.155:0/1611867892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6714066920 0x7f6714101ba0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6704004940 tx=0x7f6704009e30 comp rx=0 tx=0).stop 2023-12-16T05:57:41.822 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.820+0000 7f671969b700 1 -- 172.21.15.155:0/1611867892 shutdown_connections 2023-12-16T05:57:41.822 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.820+0000 7f671969b700 1 --2- 172.21.15.155:0/1611867892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67141020e0 0x7f67141044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:41.822 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.820+0000 7f671969b700 1 --2- 172.21.15.155:0/1611867892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6714066920 0x7f6714101ba0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:41.822 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.820+0000 7f671969b700 1 -- 172.21.15.155:0/1611867892 >> 172.21.15.155:0/1611867892 conn(0x7f67140f71b0 msgr2=0x7f67140f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:57:41.822 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.820+0000 7f671969b700 1 -- 172.21.15.155:0/1611867892 shutdown_connections 2023-12-16T05:57:41.823 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.820+0000 7f671969b700 1 -- 172.21.15.155:0/1611867892 wait complete. 2023-12-16T05:57:41.823 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.821+0000 7f671969b700 1 Processor -- start 2023-12-16T05:57:41.823 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.821+0000 7f671969b700 1 -- start start 2023-12-16T05:57:41.823 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.821+0000 7f671969b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6714066920 0x7f671410b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:41.823 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.821+0000 7f671969b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67141020e0 0x7f671410b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:41.823 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.821+0000 7f671969b700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671410be20 con 0x7f67141020e0 2023-12-16T05:57:41.823 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.821+0000 7f671969b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671410f910 con 0x7f6714066920 2023-12-16T05:57:41.823 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.821+0000 7f67127fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67141020e0 0x7f671410b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:41.823 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.821+0000 7f6712ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6714066920 0x7f671410b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:41.824 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.821+0000 7f67127fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67141020e0 0x7f671410b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33526/0 (socket says 172.21.15.155:33526) 2023-12-16T05:57:41.824 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.821+0000 7f67127fc700 1 -- 172.21.15.155:0/1421469954 learned_addr learned my addr 172.21.15.155:0/1421469954 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:57:41.824 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.822+0000 7f67127fc700 1 -- 172.21.15.155:0/1421469954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6714066920 msgr2=0x7f671410b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:41.824 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.822+0000 7f67127fc700 1 --2- 172.21.15.155:0/1421469954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6714066920 0x7f671410b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:41.825 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.822+0000 7f67127fc700 1 -- 172.21.15.155:0/1421469954 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6704005040 con 0x7f67141020e0 2023-12-16T05:57:41.825 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.822+0000 7f67127fc700 1 --2- 172.21.15.155:0/1421469954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67141020e0 0x7f671410b7d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f670800eb40 tx=0x7f670800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:57:41.825 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.822+0000 7f66fb7fe700 1 -- 172.21.15.155:0/1421469954 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6708007cc0 con 0x7f67141020e0 2023-12-16T05:57:41.825 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.822+0000 7f671969b700 1 -- 172.21.15.155:0/1421469954 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671410fb10 con 0x7f67141020e0 2023-12-16T05:57:41.825 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.822+0000 7f66fb7fe700 1 -- 172.21.15.155:0/1421469954 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f670800f040 con 0x7f67141020e0 2023-12-16T05:57:41.825 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.822+0000 7f66fb7fe700 1 -- 172.21.15.155:0/1421469954 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f670800c8f0 con 0x7f67141020e0 2023-12-16T05:57:41.825 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.822+0000 7f671969b700 1 -- 172.21.15.155:0/1421469954 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6714110020 con 0x7f67141020e0 2023-12-16T05:57:41.825 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.823+0000 7f671969b700 1 -- 172.21.15.155:0/1421469954 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671404bb80 con 0x7f67141020e0 2023-12-16T05:57:41.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:41 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:41.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:41 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:41.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:41 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:41.827 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.824+0000 7f66fb7fe700 1 -- 172.21.15.155:0/1421469954 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 30) v1 ==== 90903+0+0 (secure 0 0 0) 0x7f670800cb60 con 0x7f67141020e0 2023-12-16T05:57:41.827 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.825+0000 7f66fb7fe700 1 --2- 172.21.15.155:0/1421469954 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f66fc06cc00 0x7f66fc06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:41.827 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.825+0000 7f66fb7fe700 1 -- 172.21.15.155:0/1421469954 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f670808ba80 con 0x7f67141020e0 2023-12-16T05:57:41.827 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.825+0000 7f6712ffd700 1 --2- 172.21.15.155:0/1421469954 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f66fc06cc00 0x7f66fc06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:41.830 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.828+0000 7f6712ffd700 1 --2- 172.21.15.155:0/1421469954 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f66fc06cc00 0x7f66fc06f0b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f670400b0d0 tx=0x7f6704009e30 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:57:41.833 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:41.832+0000 7f66fb7fe700 1 -- 172.21.15.155:0/1421469954 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f6708055c20 con 0x7f67141020e0 2023-12-16T05:57:41.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:41 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:41.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:41 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:41.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:41 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:42.059 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.057+0000 7f671969b700 1 -- 172.21.15.155:0/1421469954 --> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f67141105f0 con 0x7f66fc06cc00 2023-12-16T05:57:42.069 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.068+0000 7f66fb7fe700 1 -- 172.21.15.155:0/1421469954 <== mgr.14646 v2:172.21.15.155:6800/1257988911 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f67141105f0 con 0x7f66fc06cc00 2023-12-16T05:57:42.073 INFO:teuthology.orchestra.run.smithi155.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T05:57:42.073 INFO:teuthology.orchestra.run.smithi155.stdout:alertmanager.smithi155 smithi155 *:9093,9094 running (55s) 15s ago 6m 17.4M - 0.25.0 c8568f914cd2 bdf6c0de0230 2023-12-16T05:57:42.073 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi155 smithi155 running (7m) 15s ago 7m 7444k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 033f79f53811 2023-12-16T05:57:42.073 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi156 smithi156 running (6m) 1s ago 6m 7470k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 c72bd1a1d00a 2023-12-16T05:57:42.073 INFO:teuthology.orchestra.run.smithi155.stdout:grafana.smithi155 smithi155 *:3000 running (41s) 15s ago 6m 80.6M - 9.4.7 954c08fa6188 b5d3bc9ecf2f 2023-12-16T05:57:42.073 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.bzsxjw smithi155 running (3m) 15s ago 3m 4028M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6bcabf94a5c3 2023-12-16T05:57:42.073 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.vicpis smithi155 running (3m) 15s ago 3m 506M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 afa64e1ef8da 2023-12-16T05:57:42.074 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.fasing smithi156 running (3m) 1s ago 3m 474M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 7d97160bda7c 2023-12-16T05:57:42.074 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.qvgmfj smithi156 running (3m) 1s ago 3m 5175M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4018b2f2e27e 2023-12-16T05:57:42.074 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi155.maowdn smithi155 *:8443,9283,8765 running (29s) 15s ago 7m 479M - 19.0.0-191-g6d933094 a29c258b5d6f ee39089d18d3 2023-12-16T05:57:42.074 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi156.pclong smithi156 *:8443,9283,8765 running (4s) 1s ago 6m 54.9M - 19.0.0-191-g6d933094 a29c258b5d6f 673376e357e8 2023-12-16T05:57:42.074 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi155 smithi155 running (7m) 15s ago 8m 91.5M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 0d0eecfde53b 2023-12-16T05:57:42.074 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi156 smithi156 running (6m) 1s ago 6m 62.8M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 4575acae9bdb 2023-12-16T05:57:42.074 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi155 smithi155 *:9100 running (63s) 15s ago 6m 9651k - 1.5.0 0da6a335fe13 1ed6212250d2 2023-12-16T05:57:42.074 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi156 smithi156 *:9100 running (33s) 1s ago 6m 16.1M - 1.5.0 0da6a335fe13 a845a98ea8ee 2023-12-16T05:57:42.074 INFO:teuthology.orchestra.run.smithi155.stdout:osd.0 smithi155 running (5m) 15s ago 5m 629M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 91e650c277f7 2023-12-16T05:57:42.074 INFO:teuthology.orchestra.run.smithi155.stdout:osd.1 smithi155 running (5m) 15s ago 5m 717M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957303cb6598 2023-12-16T05:57:42.074 INFO:teuthology.orchestra.run.smithi155.stdout:osd.2 smithi155 running (5m) 15s ago 5m 515M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957a169c1cac 2023-12-16T05:57:42.075 INFO:teuthology.orchestra.run.smithi155.stdout:osd.3 smithi156 running (4m) 1s ago 4m 852M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c4f6c54afe99 2023-12-16T05:57:42.075 INFO:teuthology.orchestra.run.smithi155.stdout:osd.4 smithi156 running (4m) 1s ago 4m 640M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 6309b12204fd 2023-12-16T05:57:42.075 INFO:teuthology.orchestra.run.smithi155.stdout:osd.5 smithi156 running (4m) 1s ago 4m 768M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 84b2c33eb0e1 2023-12-16T05:57:42.075 INFO:teuthology.orchestra.run.smithi155.stdout:prometheus.smithi155 smithi155 *:9095 starting - - - - 2023-12-16T05:57:42.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.070+0000 7f671969b700 1 -- 172.21.15.155:0/1421469954 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f66fc06cc00 msgr2=0x7f66fc06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:42.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.070+0000 7f671969b700 1 --2- 172.21.15.155:0/1421469954 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f66fc06cc00 0x7f66fc06f0b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f670400b0d0 tx=0x7f6704009e30 comp rx=0 tx=0).stop 2023-12-16T05:57:42.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.070+0000 7f671969b700 1 -- 172.21.15.155:0/1421469954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67141020e0 msgr2=0x7f671410b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:42.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.070+0000 7f671969b700 1 --2- 172.21.15.155:0/1421469954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67141020e0 0x7f671410b7d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f670800eb40 tx=0x7f670800b040 comp rx=0 tx=0).stop 2023-12-16T05:57:42.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.070+0000 7f671969b700 1 -- 172.21.15.155:0/1421469954 shutdown_connections 2023-12-16T05:57:42.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.070+0000 7f671969b700 1 --2- 172.21.15.155:0/1421469954 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f66fc06cc00 0x7f66fc06f0b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:42.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.070+0000 7f671969b700 1 --2- 172.21.15.155:0/1421469954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6714066920 0x7f671410b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:42.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.070+0000 7f671969b700 1 --2- 172.21.15.155:0/1421469954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67141020e0 0x7f671410b7d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:42.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.070+0000 7f671969b700 1 -- 172.21.15.155:0/1421469954 >> 172.21.15.155:0/1421469954 conn(0x7f67140f71b0 msgr2=0x7f67140f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:57:42.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.070+0000 7f671969b700 1 -- 172.21.15.155:0/1421469954 shutdown_connections 2023-12-16T05:57:42.076 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.070+0000 7f671969b700 1 -- 172.21.15.155:0/1421469954 wait complete. 2023-12-16T05:57:42.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.182+0000 7ff534afd700 1 -- 172.21.15.155:0/2482204118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5300fbaf0 msgr2=0x7ff5300fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:42.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.182+0000 7ff534afd700 1 --2- 172.21.15.155:0/2482204118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5300fbaf0 0x7ff5300fbf00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff520004940 tx=0x7ff520009e30 comp rx=0 tx=0).stop 2023-12-16T05:57:42.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.182+0000 7ff534afd700 1 -- 172.21.15.155:0/2482204118 shutdown_connections 2023-12-16T05:57:42.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.182+0000 7ff534afd700 1 --2- 172.21.15.155:0/2482204118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5300fcd00 0x7ff5300fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:42.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.182+0000 7ff534afd700 1 --2- 172.21.15.155:0/2482204118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5300fbaf0 0x7ff5300fbf00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:42.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.182+0000 7ff534afd700 1 -- 172.21.15.155:0/2482204118 >> 172.21.15.155:0/2482204118 conn(0x7ff5300f71d0 msgr2=0x7ff5300f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:57:42.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.182+0000 7ff534afd700 1 -- 172.21.15.155:0/2482204118 shutdown_connections 2023-12-16T05:57:42.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.182+0000 7ff534afd700 1 -- 172.21.15.155:0/2482204118 wait complete. 2023-12-16T05:57:42.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.183+0000 7ff534afd700 1 Processor -- start 2023-12-16T05:57:42.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.183+0000 7ff534afd700 1 -- start start 2023-12-16T05:57:42.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.183+0000 7ff534afd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5300fbaf0 0x7ff530113ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:42.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.183+0000 7ff534afd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5300fcd00 0x7ff530114020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:42.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.183+0000 7ff534afd700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff530114620 con 0x7ff5300fbaf0 2023-12-16T05:57:42.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.183+0000 7ff534afd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff530114ec0 con 0x7ff5300fcd00 2023-12-16T05:57:42.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.183+0000 7ff52e59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5300fbaf0 0x7ff530113ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:42.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.183+0000 7ff52e59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5300fbaf0 0x7ff530113ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33542/0 (socket says 172.21.15.155:33542) 2023-12-16T05:57:42.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.183+0000 7ff52e59c700 1 -- 172.21.15.155:0/1674028989 learned_addr learned my addr 172.21.15.155:0/1674028989 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:57:42.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.183+0000 7ff52dd9b700 1 --2- 172.21.15.155:0/1674028989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5300fcd00 0x7ff530114020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:42.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.183+0000 7ff52e59c700 1 -- 172.21.15.155:0/1674028989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5300fcd00 msgr2=0x7ff530114020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:42.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.183+0000 7ff52e59c700 1 --2- 172.21.15.155:0/1674028989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5300fcd00 0x7ff530114020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:42.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.183+0000 7ff52e59c700 1 -- 172.21.15.155:0/1674028989 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff520005040 con 0x7ff5300fbaf0 2023-12-16T05:57:42.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.185+0000 7ff52e59c700 1 --2- 172.21.15.155:0/1674028989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5300fbaf0 0x7ff530113ae0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff520008f80 tx=0x7ff520009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:57:42.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.185+0000 7ff51effd700 1 -- 172.21.15.155:0/1674028989 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff520021070 con 0x7ff5300fbaf0 2023-12-16T05:57:42.188 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.185+0000 7ff51effd700 1 -- 172.21.15.155:0/1674028989 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff52001c400 con 0x7ff5300fbaf0 2023-12-16T05:57:42.188 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.185+0000 7ff51effd700 1 -- 172.21.15.155:0/1674028989 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff52000e070 con 0x7ff5300fbaf0 2023-12-16T05:57:42.188 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.186+0000 7ff534afd700 1 -- 172.21.15.155:0/1674028989 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff530115140 con 0x7ff5300fbaf0 2023-12-16T05:57:42.188 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.186+0000 7ff534afd700 1 -- 172.21.15.155:0/1674028989 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff530115620 con 0x7ff5300fbaf0 2023-12-16T05:57:42.189 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.187+0000 7ff534afd700 1 -- 172.21.15.155:0/1674028989 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53004bb80 con 0x7ff5300fbaf0 2023-12-16T05:57:42.190 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.188+0000 7ff51effd700 1 -- 172.21.15.155:0/1674028989 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 30) v1 ==== 90903+0+0 (secure 0 0 0) 0x7ff52001c9c0 con 0x7ff5300fbaf0 2023-12-16T05:57:42.192 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.189+0000 7ff51effd700 1 --2- 172.21.15.155:0/1674028989 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7ff51806ccc0 0x7ff51806f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:42.192 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.189+0000 7ff51effd700 1 -- 172.21.15.155:0/1674028989 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ff52008d3b0 con 0x7ff5300fbaf0 2023-12-16T05:57:42.192 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.190+0000 7ff52dd9b700 1 --2- 172.21.15.155:0/1674028989 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7ff51806ccc0 0x7ff51806f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:42.197 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.195+0000 7ff51effd700 1 -- 172.21.15.155:0/1674028989 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7ff52005b1a0 con 0x7ff5300fbaf0 2023-12-16T05:57:42.198 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.196+0000 7ff52dd9b700 1 --2- 172.21.15.155:0/1674028989 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7ff51806ccc0 0x7ff51806f170 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff524004600 tx=0x7ff52400b040 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:57:42.561 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.560+0000 7ff534afd700 1 -- 172.21.15.155:0/1674028989 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff530115d40 con 0x7ff5300fbaf0 2023-12-16T05:57:42.562 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.560+0000 7ff51effd700 1 -- 172.21.15.155:0/1674028989 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7ff52002b070 con 0x7ff5300fbaf0 2023-12-16T05:57:42.562 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T05:57:42.562 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": { 2023-12-16T05:57:42.563 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T05:57:42.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:57:42.563 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": { 2023-12-16T05:57:42.563 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T05:57:42.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:57:42.563 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": { 2023-12-16T05:57:42.563 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T05:57:42.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:57:42.563 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2023-12-16T05:57:42.563 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T05:57:42.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:57:42.564 INFO:teuthology.orchestra.run.smithi155.stdout: "overall": { 2023-12-16T05:57:42.564 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-16T05:57:42.564 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T05:57:42.564 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-12-16T05:57:42.564 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T05:57:42.564 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.563+0000 7ff534afd700 1 -- 172.21.15.155:0/1674028989 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7ff51806ccc0 msgr2=0x7ff51806f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:42.564 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.563+0000 7ff534afd700 1 --2- 172.21.15.155:0/1674028989 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7ff51806ccc0 0x7ff51806f170 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff524004600 tx=0x7ff52400b040 comp rx=0 tx=0).stop 2023-12-16T05:57:42.564 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.563+0000 7ff534afd700 1 -- 172.21.15.155:0/1674028989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5300fbaf0 msgr2=0x7ff530113ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:42.564 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.563+0000 7ff534afd700 1 --2- 172.21.15.155:0/1674028989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5300fbaf0 0x7ff530113ae0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff520008f80 tx=0x7ff520009e30 comp rx=0 tx=0).stop 2023-12-16T05:57:42.567 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.565+0000 7ff534afd700 1 -- 172.21.15.155:0/1674028989 shutdown_connections 2023-12-16T05:57:42.567 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.565+0000 7ff534afd700 1 --2- 172.21.15.155:0/1674028989 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7ff51806ccc0 0x7ff51806f170 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:42.567 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.565+0000 7ff534afd700 1 --2- 172.21.15.155:0/1674028989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5300fbaf0 0x7ff530113ae0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:42.567 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.565+0000 7ff534afd700 1 --2- 172.21.15.155:0/1674028989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5300fcd00 0x7ff530114020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:42.567 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.565+0000 7ff534afd700 1 -- 172.21.15.155:0/1674028989 >> 172.21.15.155:0/1674028989 conn(0x7ff5300f71d0 msgr2=0x7ff530065c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:57:42.567 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.565+0000 7ff534afd700 1 -- 172.21.15.155:0/1674028989 shutdown_connections 2023-12-16T05:57:42.567 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.565+0000 7ff534afd700 1 -- 172.21.15.155:0/1674028989 wait complete. 2023-12-16T05:57:42.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:42 smithi156 ceph-mon[121001]: pgmap v13: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 283 op/s 2023-12-16T05:57:42.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:42 smithi156 ceph-mon[121001]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:57:42.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:42 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:42.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:42 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/1674028989' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:57:42.684 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.683+0000 7fce636b5700 1 -- 172.21.15.155:0/1200645035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce5c0fd730 msgr2=0x7fce5c0ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:42.685 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.683+0000 7fce636b5700 1 --2- 172.21.15.155:0/1200645035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce5c0fd730 0x7fce5c0ffb10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fce58004940 tx=0x7fce58009e30 comp rx=0 tx=0).stop 2023-12-16T05:57:42.685 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.683+0000 7fce636b5700 1 -- 172.21.15.155:0/1200645035 shutdown_connections 2023-12-16T05:57:42.685 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.683+0000 7fce636b5700 1 --2- 172.21.15.155:0/1200645035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce5c100050 0x7fce5c102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:42.685 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.683+0000 7fce636b5700 1 --2- 172.21.15.155:0/1200645035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce5c0fd730 0x7fce5c0ffb10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:42.685 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.683+0000 7fce636b5700 1 -- 172.21.15.155:0/1200645035 >> 172.21.15.155:0/1200645035 conn(0x7fce5c0f7190 msgr2=0x7fce5c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:57:42.685 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.683+0000 7fce636b5700 1 -- 172.21.15.155:0/1200645035 shutdown_connections 2023-12-16T05:57:42.685 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.683+0000 7fce636b5700 1 -- 172.21.15.155:0/1200645035 wait complete. 2023-12-16T05:57:42.686 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.683+0000 7fce636b5700 1 Processor -- start 2023-12-16T05:57:42.686 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.683+0000 7fce636b5700 1 -- start start 2023-12-16T05:57:42.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.684+0000 7fce636b5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce5c0fd730 0x7fce5c10d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:42.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.684+0000 7fce636b5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce5c100050 0x7fce5c10d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:42.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.684+0000 7fce636b5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c10dfd0 con 0x7fce5c0fd730 2023-12-16T05:57:42.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.684+0000 7fce636b5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c10e870 con 0x7fce5c100050 2023-12-16T05:57:42.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.684+0000 7fce60c50700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce5c100050 0x7fce5c10d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:42.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.684+0000 7fce60c50700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce5c100050 0x7fce5c10d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.155:56856/0 (socket says 172.21.15.155:56856) 2023-12-16T05:57:42.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.684+0000 7fce60c50700 1 -- 172.21.15.155:0/2579951213 learned_addr learned my addr 172.21.15.155:0/2579951213 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:57:42.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.684+0000 7fce60c50700 1 -- 172.21.15.155:0/2579951213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce5c0fd730 msgr2=0x7fce5c10d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:42.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.684+0000 7fce60c50700 1 --2- 172.21.15.155:0/2579951213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce5c0fd730 0x7fce5c10d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:42.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.684+0000 7fce60c50700 1 -- 172.21.15.155:0/2579951213 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce58005040 con 0x7fce5c100050 2023-12-16T05:57:42.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.684+0000 7fce60c50700 1 --2- 172.21.15.155:0/2579951213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce5c100050 0x7fce5c10d9d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00eb40 tx=0x7fce4c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:57:42.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.684+0000 7fce51ffb700 1 -- 172.21.15.155:0/2579951213 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce4c007cc0 con 0x7fce5c100050 2023-12-16T05:57:42.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.685+0000 7fce636b5700 1 -- 172.21.15.155:0/2579951213 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5c10eaf0 con 0x7fce5c100050 2023-12-16T05:57:42.688 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.685+0000 7fce51ffb700 1 -- 172.21.15.155:0/2579951213 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fce4c00f040 con 0x7fce5c100050 2023-12-16T05:57:42.688 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.685+0000 7fce51ffb700 1 -- 172.21.15.155:0/2579951213 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce4c009570 con 0x7fce5c100050 2023-12-16T05:57:42.688 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.685+0000 7fce636b5700 1 -- 172.21.15.155:0/2579951213 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5c10f030 con 0x7fce5c100050 2023-12-16T05:57:42.688 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.686+0000 7fce636b5700 1 -- 172.21.15.155:0/2579951213 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5c04bb80 con 0x7fce5c100050 2023-12-16T05:57:42.688 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.686+0000 7fce51ffb700 1 -- 172.21.15.155:0/2579951213 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 30) v1 ==== 90903+0+0 (secure 0 0 0) 0x7fce4c0096d0 con 0x7fce5c100050 2023-12-16T05:57:42.689 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.687+0000 7fce51ffb700 1 --2- 172.21.15.155:0/2579951213 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fce4806cc00 0x7fce4806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:57:42.689 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.687+0000 7fce51ffb700 1 -- 172.21.15.155:0/2579951213 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fce4c08bcc0 con 0x7fce5c100050 2023-12-16T05:57:42.689 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.687+0000 7fce61451700 1 --2- 172.21.15.155:0/2579951213 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fce4806cc00 0x7fce4806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:57:42.689 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.687+0000 7fce61451700 1 --2- 172.21.15.155:0/2579951213 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fce4806cc00 0x7fce4806f0b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fce58004890 tx=0x7fce58009e30 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:57:42.693 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.691+0000 7fce51ffb700 1 -- 172.21.15.155:0/2579951213 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fce4c059990 con 0x7fce5c100050 2023-12-16T05:57:42.795 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:42 smithi155 ceph-mon[112451]: pgmap v13: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 283 op/s 2023-12-16T05:57:42.795 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:42 smithi155 ceph-mon[112451]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:57:42.795 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:42 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:42.795 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:42 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/1674028989' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:57:42.922 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.920+0000 7fce636b5700 1 -- 172.21.15.155:0/2579951213 --> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fce5c10f4c0 con 0x7fce4806cc00 2023-12-16T05:57:42.923 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.922+0000 7fce51ffb700 1 -- 172.21.15.155:0/2579951213 <== mgr.14646 v2:172.21.15.155:6800/1257988911 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fce5c10f4c0 con 0x7fce4806cc00 2023-12-16T05:57:42.923 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T05:57:42.923 INFO:teuthology.orchestra.run.smithi155.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T05:57:42.924 INFO:teuthology.orchestra.run.smithi155.stdout: "in_progress": true, 2023-12-16T05:57:42.924 INFO:teuthology.orchestra.run.smithi155.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T05:57:42.924 INFO:teuthology.orchestra.run.smithi155.stdout: "services_complete": [ 2023-12-16T05:57:42.924 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr" 2023-12-16T05:57:42.924 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-12-16T05:57:42.924 INFO:teuthology.orchestra.run.smithi155.stdout: "progress": "2/2 daemons upgraded", 2023-12-16T05:57:42.924 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "Currently upgrading mgr daemons", 2023-12-16T05:57:42.924 INFO:teuthology.orchestra.run.smithi155.stdout: "is_paused": false 2023-12-16T05:57:42.924 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T05:57:42.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.924+0000 7fce636b5700 1 -- 172.21.15.155:0/2579951213 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fce4806cc00 msgr2=0x7fce4806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:42.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.924+0000 7fce636b5700 1 --2- 172.21.15.155:0/2579951213 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fce4806cc00 0x7fce4806f0b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fce58004890 tx=0x7fce58009e30 comp rx=0 tx=0).stop 2023-12-16T05:57:42.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.924+0000 7fce636b5700 1 -- 172.21.15.155:0/2579951213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce5c100050 msgr2=0x7fce5c10d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:57:42.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.924+0000 7fce636b5700 1 --2- 172.21.15.155:0/2579951213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce5c100050 0x7fce5c10d9d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00eb40 tx=0x7fce4c00b040 comp rx=0 tx=0).stop 2023-12-16T05:57:42.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.924+0000 7fce636b5700 1 -- 172.21.15.155:0/2579951213 shutdown_connections 2023-12-16T05:57:42.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.924+0000 7fce636b5700 1 --2- 172.21.15.155:0/2579951213 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fce4806cc00 0x7fce4806f0b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:42.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.924+0000 7fce636b5700 1 --2- 172.21.15.155:0/2579951213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce5c0fd730 0x7fce5c10d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:42.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.924+0000 7fce636b5700 1 --2- 172.21.15.155:0/2579951213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce5c100050 0x7fce5c10d9d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:57:42.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.924+0000 7fce636b5700 1 -- 172.21.15.155:0/2579951213 >> 172.21.15.155:0/2579951213 conn(0x7fce5c0f7190 msgr2=0x7fce5c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:57:42.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.924+0000 7fce636b5700 1 -- 172.21.15.155:0/2579951213 shutdown_connections 2023-12-16T05:57:42.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:57:42.924+0000 7fce636b5700 1 -- 172.21.15.155:0/2579951213 wait complete. 2023-12-16T05:57:43.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:43 smithi155 ceph-mon[112451]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:57:43.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:43 smithi155 ceph-mon[112451]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:57:43.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:43 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:43.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:43 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:43.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:43 smithi156 ceph-mon[121001]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:57:43.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:43 smithi156 ceph-mon[121001]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:57:43.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:43 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:43.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:43 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='client.24489 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:57:44.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: pgmap v14: 65 pgs: 65 active+clean; 295 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 422 op/s 2023-12-16T05:57:44.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:57:44.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:57:44.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:57:44.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:57:44.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi155.maowdn"}]: dispatch 2023-12-16T05:57:44.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi155.maowdn"}]': finished 2023-12-16T05:57:44.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi156.pclong"}]: dispatch 2023-12-16T05:57:44.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi156.pclong"}]': finished 2023-12-16T05:57:44.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:57:44.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:57:44.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:57:44.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:57:44.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:57:44.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:57:44.829 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.829 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:57:44.829 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:44 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='client.24489 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:57:44.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: pgmap v14: 65 pgs: 65 active+clean; 295 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 422 op/s 2023-12-16T05:57:44.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:57:44.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:57:44.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:57:44.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:57:44.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi155.maowdn"}]: dispatch 2023-12-16T05:57:44.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi155.maowdn"}]': finished 2023-12-16T05:57:44.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi156.pclong"}]: dispatch 2023-12-16T05:57:44.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi156.pclong"}]': finished 2023-12-16T05:57:44.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:57:44.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:57:44.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:57:44.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:57:44.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:57:44.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:57:44.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:44.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:57:44.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:44 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:45.580 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:45 smithi156 ceph-mon[121001]: Upgrade: Setting container_image for all mgr 2023-12-16T05:57:45.581 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:45 smithi156 ceph-mon[121001]: Upgrade: Setting container_image for all rgw 2023-12-16T05:57:45.581 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:45 smithi156 ceph-mon[121001]: Upgrade: Setting container_image for all rbd-mirror 2023-12-16T05:57:45.581 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:45 smithi156 ceph-mon[121001]: Upgrade: Setting container_image for all cephfs-mirror 2023-12-16T05:57:45.581 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:45 smithi156 ceph-mon[121001]: Upgrade: Setting container_image for all ceph-exporter 2023-12-16T05:57:45.581 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:45 smithi156 ceph-mon[121001]: Upgrade: Setting container_image for all iscsi 2023-12-16T05:57:45.581 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:45 smithi156 ceph-mon[121001]: Upgrade: Setting container_image for all nfs 2023-12-16T05:57:45.581 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:45 smithi156 ceph-mon[121001]: Upgrade: Setting container_image for all nvmeof 2023-12-16T05:57:46.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:45 smithi155 ceph-mon[112451]: Upgrade: Setting container_image for all mgr 2023-12-16T05:57:46.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:45 smithi155 ceph-mon[112451]: Upgrade: Setting container_image for all rgw 2023-12-16T05:57:46.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:45 smithi155 ceph-mon[112451]: Upgrade: Setting container_image for all rbd-mirror 2023-12-16T05:57:46.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:45 smithi155 ceph-mon[112451]: Upgrade: Setting container_image for all cephfs-mirror 2023-12-16T05:57:46.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:45 smithi155 ceph-mon[112451]: Upgrade: Setting container_image for all ceph-exporter 2023-12-16T05:57:46.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:45 smithi155 ceph-mon[112451]: Upgrade: Setting container_image for all iscsi 2023-12-16T05:57:46.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:45 smithi155 ceph-mon[112451]: Upgrade: Setting container_image for all nfs 2023-12-16T05:57:46.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:45 smithi155 ceph-mon[112451]: Upgrade: Setting container_image for all nvmeof 2023-12-16T05:57:46.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:46 smithi156 ceph-mon[121001]: pgmap v15: 65 pgs: 65 active+clean; 295 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 302 op/s 2023-12-16T05:57:47.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:46 smithi155 ceph-mon[112451]: pgmap v15: 65 pgs: 65 active+clean; 295 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 302 op/s 2023-12-16T05:57:47.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:47 smithi155 ceph-mon[112451]: Upgrade: Updating node-exporter.smithi155 (1/2) 2023-12-16T05:57:47.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:47 smithi155 ceph-mon[112451]: Deploying daemon node-exporter.smithi155 on smithi155 2023-12-16T05:57:47.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:47 smithi155 ceph-mon[112451]: Standby manager daemon smithi156.pclong restarted 2023-12-16T05:57:47.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:47 smithi155 ceph-mon[112451]: Standby manager daemon smithi156.pclong started 2023-12-16T05:57:47.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:47 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.156:0/2535242470' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.pclong/crt"}]: dispatch 2023-12-16T05:57:47.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:47 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.156:0/2535242470' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T05:57:47.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:47 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.156:0/2535242470' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.pclong/key"}]: dispatch 2023-12-16T05:57:47.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:47 smithi155 ceph-mon[112451]: from='mgr.? 172.21.15.156:0/2535242470' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T05:57:47.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:47 smithi156 ceph-mon[121001]: Upgrade: Updating node-exporter.smithi155 (1/2) 2023-12-16T05:57:47.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:47 smithi156 ceph-mon[121001]: Deploying daemon node-exporter.smithi155 on smithi155 2023-12-16T05:57:47.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:47 smithi156 ceph-mon[121001]: Standby manager daemon smithi156.pclong restarted 2023-12-16T05:57:47.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:47 smithi156 ceph-mon[121001]: Standby manager daemon smithi156.pclong started 2023-12-16T05:57:47.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:47 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.156:0/2535242470' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.pclong/crt"}]: dispatch 2023-12-16T05:57:47.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:47 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.156:0/2535242470' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T05:57:47.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:47 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.156:0/2535242470' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.pclong/key"}]: dispatch 2023-12-16T05:57:47.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:47 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.156:0/2535242470' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T05:57:48.848 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:48 smithi156 ceph-mon[121001]: pgmap v16: 65 pgs: 65 active+clean; 295 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 302 op/s 2023-12-16T05:57:48.849 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:48 smithi156 ceph-mon[121001]: mgrmap e31: smithi155.maowdn(active, since 26s), standbys: smithi156.pclong 2023-12-16T05:57:48.849 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:48 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:48.849 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:48 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:49.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:48 smithi155 ceph-mon[112451]: pgmap v16: 65 pgs: 65 active+clean; 295 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 302 op/s 2023-12-16T05:57:49.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:48 smithi155 ceph-mon[112451]: mgrmap e31: smithi155.maowdn(active, since 26s), standbys: smithi156.pclong 2023-12-16T05:57:49.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:48 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:49.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:48 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:50.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:50 smithi156 ceph-mon[121001]: pgmap v17: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 516 op/s 2023-12-16T05:57:50.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:50 smithi156 ceph-mon[121001]: Upgrade: Updating node-exporter.smithi156 (2/2) 2023-12-16T05:57:50.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:50 smithi156 ceph-mon[121001]: Deploying daemon node-exporter.smithi156 on smithi156 2023-12-16T05:57:51.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:50 smithi155 ceph-mon[112451]: pgmap v17: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 516 op/s 2023-12-16T05:57:51.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:50 smithi155 ceph-mon[112451]: Upgrade: Updating node-exporter.smithi156 (2/2) 2023-12-16T05:57:51.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:50 smithi155 ceph-mon[112451]: Deploying daemon node-exporter.smithi156 on smithi156 2023-12-16T05:57:51.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:51 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:57:52.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:51 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:57:52.858 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:52 smithi156 ceph-mon[121001]: pgmap v18: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 353 op/s 2023-12-16T05:57:53.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:52 smithi155 ceph-mon[112451]: pgmap v18: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 353 op/s 2023-12-16T05:57:53.642 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2023-12-16T05:57:53.642 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-16T05:57:54.017 DEBUG:teuthology.parallel:result is None 2023-12-16T05:57:54.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:54 smithi156 ceph-mon[121001]: pgmap v19: 65 pgs: 65 active+clean; 291 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 594 op/s 2023-12-16T05:57:54.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:54 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:54.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:54 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:54.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:54 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:57:55.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:54 smithi155 ceph-mon[112451]: pgmap v19: 65 pgs: 65 active+clean; 291 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 594 op/s 2023-12-16T05:57:55.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:54 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:55.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:54 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:55.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:54 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:57:55.845 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2023-12-16T05:57:55.845 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2023-12-16T05:57:56.130 DEBUG:teuthology.parallel:result is None 2023-12-16T05:57:56.131 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-16T05:57:56.175 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-16T05:57:56.175 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2023-12-16T05:57:56.219 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2023-12-16T05:57:56.219 DEBUG:teuthology.parallel:result is None 2023-12-16T05:57:56.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:56 smithi155 ceph-mon[112451]: pgmap v20: 65 pgs: 65 active+clean; 291 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 455 op/s 2023-12-16T05:57:56.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:56 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:56.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:56 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:56.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:56 smithi156 ceph-mon[121001]: pgmap v20: 65 pgs: 65 active+clean; 291 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 455 op/s 2023-12-16T05:57:56.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:56 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:56.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:56 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:58.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:57 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:58.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:57 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:58.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:57 smithi155 ceph-mon[112451]: pgmap v21: 65 pgs: 65 active+clean; 291 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 455 op/s 2023-12-16T05:57:58.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:57 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:58.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:57 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:58.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:57 smithi156 ceph-mon[121001]: pgmap v21: 65 pgs: 65 active+clean; 291 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 455 op/s 2023-12-16T05:57:59.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:59 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:59.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:59 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:59.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:59 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:59.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:57:59 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:59.529 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:59 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:59.529 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:59 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:59.529 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:59 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:57:59.530 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:57:59 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:00.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:00 smithi155 ceph-mon[112451]: pgmap v22: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 627 op/s 2023-12-16T05:58:00.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:00 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:00.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:00 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:00.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:00 smithi156 ceph-mon[121001]: pgmap v22: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 627 op/s 2023-12-16T05:58:00.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:00 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:00.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:00 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:02.487 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:02 smithi155 ceph-mon[112451]: pgmap v23: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 413 op/s 2023-12-16T05:58:02.487 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:02 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:02.487 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:02 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:02.487 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:02 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:58:02.487 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:02 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:58:02.488 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:02 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:02.488 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:02 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:58:02.488 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:02 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:02.488 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:02 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:02.488 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:02 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:02.488 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:02 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:02.488 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:02 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:02.488 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:02 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:02.488 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:02 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:02.488 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:02 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:02.488 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:02 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:02.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:02 smithi156 ceph-mon[121001]: pgmap v23: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 413 op/s 2023-12-16T05:58:02.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:02 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:02.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:02 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:02.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:02 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:58:02.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:02 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:58:02.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:02 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:02.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:02 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:58:02.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:02 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:02.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:02 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:02.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:02 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:02.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:02 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:02.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:02 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:02.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:02 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:02.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:02 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:02.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:02 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:02.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:02 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:04.650 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:04 smithi155 ceph-mon[112451]: Upgrade: Updating prometheus.smithi155 2023-12-16T05:58:04.650 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:04 smithi155 ceph-mon[112451]: Deploying daemon prometheus.smithi155 on smithi155 2023-12-16T05:58:04.650 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:04 smithi155 ceph-mon[112451]: pgmap v24: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 425 op/s 2023-12-16T05:58:04.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:04 smithi156 ceph-mon[121001]: Upgrade: Updating prometheus.smithi155 2023-12-16T05:58:04.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:04 smithi156 ceph-mon[121001]: Deploying daemon prometheus.smithi155 on smithi155 2023-12-16T05:58:04.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:04 smithi156 ceph-mon[121001]: pgmap v24: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 425 op/s 2023-12-16T05:58:06.661 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:06 smithi155 ceph-mon[112451]: pgmap v25: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 705 KiB/s rd, 589 KiB/s wr, 184 op/s 2023-12-16T05:58:06.661 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:06 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:06.662 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:06 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:06.662 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:06 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:58:06.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:06 smithi156 ceph-mon[121001]: pgmap v25: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 705 KiB/s rd, 589 KiB/s wr, 184 op/s 2023-12-16T05:58:06.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:06 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:06.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:06 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:06.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:06 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:58:07.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:07 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:58:07.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:07 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:58:08.661 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:08 smithi155 ceph-mon[112451]: pgmap v26: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 705 KiB/s rd, 589 KiB/s wr, 184 op/s 2023-12-16T05:58:08.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:08 smithi156 ceph-mon[121001]: pgmap v26: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 705 KiB/s rd, 589 KiB/s wr, 184 op/s 2023-12-16T05:58:10.402 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:10 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:10.402 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:10 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:10.402 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:10 smithi155 ceph-mon[112451]: pgmap v27: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 706 KiB/s rd, 590 KiB/s wr, 187 op/s 2023-12-16T05:58:10.402 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:10 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:10.402 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:10 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:10.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:10 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:10.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:10 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:10.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:10 smithi156 ceph-mon[121001]: pgmap v27: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 706 KiB/s rd, 590 KiB/s wr, 187 op/s 2023-12-16T05:58:10.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:10 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:10.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:10 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:12.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:12 smithi155 ceph-mon[112451]: pgmap v28: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 7.5 KiB/s wr, 15 op/s 2023-12-16T05:58:12.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:12 smithi156 ceph-mon[121001]: pgmap v28: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 7.5 KiB/s wr, 15 op/s 2023-12-16T05:58:13.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.030+0000 7fe9dacec700 1 -- 172.21.15.155:0/3493088386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9d4066920 msgr2=0x7fe9d4101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:13.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.030+0000 7fe9dacec700 1 --2- 172.21.15.155:0/3493088386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9d4066920 0x7fe9d4101ba0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8004940 tx=0x7fe9c8009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:13.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.030+0000 7fe9dacec700 1 -- 172.21.15.155:0/3493088386 shutdown_connections 2023-12-16T05:58:13.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.030+0000 7fe9dacec700 1 --2- 172.21.15.155:0/3493088386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9d41020e0 0x7fe9d41044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:13.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.030+0000 7fe9dacec700 1 --2- 172.21.15.155:0/3493088386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9d4066920 0x7fe9d4101ba0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:13.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.030+0000 7fe9dacec700 1 -- 172.21.15.155:0/3493088386 >> 172.21.15.155:0/3493088386 conn(0x7fe9d40f71b0 msgr2=0x7fe9d40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:13.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.031+0000 7fe9dacec700 1 -- 172.21.15.155:0/3493088386 shutdown_connections 2023-12-16T05:58:13.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.031+0000 7fe9dacec700 1 -- 172.21.15.155:0/3493088386 wait complete. 2023-12-16T05:58:13.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.031+0000 7fe9dacec700 1 Processor -- start 2023-12-16T05:58:13.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.031+0000 7fe9dacec700 1 -- start start 2023-12-16T05:58:13.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.031+0000 7fe9dacec700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9d4066920 0x7fe9d410f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:13.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.031+0000 7fe9dacec700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9d41020e0 0x7fe9d410fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:13.035 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.031+0000 7fe9dacec700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d4110220 con 0x7fe9d41020e0 2023-12-16T05:58:13.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.031+0000 7fe9dacec700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d4110ac0 con 0x7fe9d4066920 2023-12-16T05:58:13.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.031+0000 7fe9d3fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9d41020e0 0x7fe9d410fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:13.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.031+0000 7fe9d3fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9d41020e0 0x7fe9d410fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53992/0 (socket says 172.21.15.155:53992) 2023-12-16T05:58:13.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.032+0000 7fe9d3fff700 1 -- 172.21.15.155:0/2346002686 learned_addr learned my addr 172.21.15.155:0/2346002686 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:58:13.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.032+0000 7fe9d8a88700 1 --2- 172.21.15.155:0/2346002686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9d4066920 0x7fe9d410f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:13.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.032+0000 7fe9d3fff700 1 -- 172.21.15.155:0/2346002686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9d4066920 msgr2=0x7fe9d410f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:13.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.032+0000 7fe9d3fff700 1 --2- 172.21.15.155:0/2346002686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9d4066920 0x7fe9d410f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:13.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.032+0000 7fe9d3fff700 1 -- 172.21.15.155:0/2346002686 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c8005040 con 0x7fe9d41020e0 2023-12-16T05:58:13.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.032+0000 7fe9d3fff700 1 --2- 172.21.15.155:0/2346002686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9d41020e0 0x7fe9d410fc20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0002a50 tx=0x7fe9c00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:13.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.032+0000 7fe9d17fa700 1 -- 172.21.15.155:0/2346002686 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9c0007cc0 con 0x7fe9d41020e0 2023-12-16T05:58:13.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.032+0000 7fe9d17fa700 1 -- 172.21.15.155:0/2346002686 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe9c000f040 con 0x7fe9d41020e0 2023-12-16T05:58:13.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.032+0000 7fe9d17fa700 1 -- 172.21.15.155:0/2346002686 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9c00095d0 con 0x7fe9d41020e0 2023-12-16T05:58:13.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.032+0000 7fe9dacec700 1 -- 172.21.15.155:0/2346002686 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d4110da0 con 0x7fe9d41020e0 2023-12-16T05:58:13.036 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.032+0000 7fe9dacec700 1 -- 172.21.15.155:0/2346002686 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d41112e0 con 0x7fe9d41020e0 2023-12-16T05:58:13.037 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.033+0000 7fe9dacec700 1 -- 172.21.15.155:0/2346002686 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d404bb80 con 0x7fe9d41020e0 2023-12-16T05:58:13.037 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.034+0000 7fe9d17fa700 1 -- 172.21.15.155:0/2346002686 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 31) v1 ==== 90903+0+0 (secure 0 0 0) 0x7fe9c0009730 con 0x7fe9d41020e0 2023-12-16T05:58:13.037 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.034+0000 7fe9d17fa700 1 --2- 172.21.15.155:0/2346002686 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fe9c406cc00 0x7fe9c406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:13.037 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.034+0000 7fe9d17fa700 1 -- 172.21.15.155:0/2346002686 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe9c008bc50 con 0x7fe9d41020e0 2023-12-16T05:58:13.038 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.034+0000 7fe9d8a88700 1 --2- 172.21.15.155:0/2346002686 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fe9c406cc00 0x7fe9c406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:13.038 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.035+0000 7fe9d8a88700 1 --2- 172.21.15.155:0/2346002686 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fe9c406cc00 0x7fe9c406f0b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8004560 tx=0x7fe9c8009e30 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:13.041 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.039+0000 7fe9d17fa700 1 -- 172.21.15.155:0/2346002686 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fe9c0059940 con 0x7fe9d41020e0 2023-12-16T05:58:13.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.267+0000 7fe9dacec700 1 -- 172.21.15.155:0/2346002686 --> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9d4102d40 con 0x7fe9c406cc00 2023-12-16T05:58:13.270 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.268+0000 7fe9d17fa700 1 -- 172.21.15.155:0/2346002686 <== mgr.14646 v2:172.21.15.155:6800/1257988911 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fe9d4102d40 con 0x7fe9c406cc00 2023-12-16T05:58:13.273 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.270+0000 7fe9dacec700 1 -- 172.21.15.155:0/2346002686 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fe9c406cc00 msgr2=0x7fe9c406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:13.273 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.270+0000 7fe9dacec700 1 --2- 172.21.15.155:0/2346002686 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fe9c406cc00 0x7fe9c406f0b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8004560 tx=0x7fe9c8009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:13.273 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.270+0000 7fe9dacec700 1 -- 172.21.15.155:0/2346002686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9d41020e0 msgr2=0x7fe9d410fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:13.273 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.270+0000 7fe9dacec700 1 --2- 172.21.15.155:0/2346002686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9d41020e0 0x7fe9d410fc20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0002a50 tx=0x7fe9c00046b0 comp rx=0 tx=0).stop 2023-12-16T05:58:13.273 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.270+0000 7fe9dacec700 1 -- 172.21.15.155:0/2346002686 shutdown_connections 2023-12-16T05:58:13.273 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.270+0000 7fe9dacec700 1 --2- 172.21.15.155:0/2346002686 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fe9c406cc00 0x7fe9c406f0b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:13.273 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.270+0000 7fe9dacec700 1 --2- 172.21.15.155:0/2346002686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9d4066920 0x7fe9d410f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:13.274 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.270+0000 7fe9dacec700 1 --2- 172.21.15.155:0/2346002686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9d41020e0 0x7fe9d410fc20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:13.274 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.270+0000 7fe9dacec700 1 -- 172.21.15.155:0/2346002686 >> 172.21.15.155:0/2346002686 conn(0x7fe9d40f71b0 msgr2=0x7fe9d40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:13.274 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.270+0000 7fe9dacec700 1 -- 172.21.15.155:0/2346002686 shutdown_connections 2023-12-16T05:58:13.274 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.270+0000 7fe9dacec700 1 -- 172.21.15.155:0/2346002686 wait complete. 2023-12-16T05:58:13.283 INFO:teuthology.orchestra.run.smithi155.stdout:true 2023-12-16T05:58:13.383 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.380+0000 7f1db5c1f700 1 -- 172.21.15.155:0/3419206951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1db00fde00 msgr2=0x7f1db00fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:13.383 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.380+0000 7f1db5c1f700 1 --2- 172.21.15.155:0/3419206951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1db00fde00 0x7f1db00fe250 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1da4004940 tx=0x7f1da4009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:13.383 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.380+0000 7f1db5c1f700 1 -- 172.21.15.155:0/3419206951 shutdown_connections 2023-12-16T05:58:13.383 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.380+0000 7f1db5c1f700 1 --2- 172.21.15.155:0/3419206951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1db00fde00 0x7f1db00fe250 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:13.384 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.380+0000 7f1db5c1f700 1 --2- 172.21.15.155:0/3419206951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1db00fcbf0 0x7f1db00fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:13.384 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.380+0000 7f1db5c1f700 1 -- 172.21.15.155:0/3419206951 >> 172.21.15.155:0/3419206951 conn(0x7f1db00f82d0 msgr2=0x7f1db00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:13.384 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.380+0000 7f1db5c1f700 1 -- 172.21.15.155:0/3419206951 shutdown_connections 2023-12-16T05:58:13.384 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.380+0000 7f1db5c1f700 1 -- 172.21.15.155:0/3419206951 wait complete. 2023-12-16T05:58:13.386 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.381+0000 7f1db5c1f700 1 Processor -- start 2023-12-16T05:58:13.386 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.381+0000 7f1db5c1f700 1 -- start start 2023-12-16T05:58:13.386 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.381+0000 7f1db5c1f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1db00fcbf0 0x7f1db010d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:13.386 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.382+0000 7f1db5c1f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1db00fde00 0x7f1db010dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:13.386 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.382+0000 7f1db5c1f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db010e140 con 0x7f1db00fde00 2023-12-16T05:58:13.386 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.382+0000 7f1db5c1f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db010e980 con 0x7f1db00fcbf0 2023-12-16T05:58:13.386 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.382+0000 7f1daeffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1db00fde00 0x7f1db010dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:13.386 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.382+0000 7f1daeffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1db00fde00 0x7f1db010dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54016/0 (socket says 172.21.15.155:54016) 2023-12-16T05:58:13.386 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.382+0000 7f1daeffd700 1 -- 172.21.15.155:0/1133382512 learned_addr learned my addr 172.21.15.155:0/1133382512 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:58:13.386 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.382+0000 7f1daf7fe700 1 --2- 172.21.15.155:0/1133382512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1db00fcbf0 0x7f1db010d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:13.386 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.382+0000 7f1daeffd700 1 -- 172.21.15.155:0/1133382512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1db00fcbf0 msgr2=0x7f1db010d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:13.387 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.382+0000 7f1daeffd700 1 --2- 172.21.15.155:0/1133382512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1db00fcbf0 0x7f1db010d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:13.387 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.382+0000 7f1daeffd700 1 -- 172.21.15.155:0/1133382512 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da4005040 con 0x7f1db00fde00 2023-12-16T05:58:13.387 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.382+0000 7f1daf7fe700 1 --2- 172.21.15.155:0/1133382512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1db00fcbf0 0x7f1db010d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T05:58:13.387 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.382+0000 7f1daeffd700 1 --2- 172.21.15.155:0/1133382512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1db00fde00 0x7f1db010dab0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1da400b3b0 tx=0x7f1da4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:13.387 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.382+0000 7f1d97fff700 1 -- 172.21.15.155:0/1133382512 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1da400e040 con 0x7f1db00fde00 2023-12-16T05:58:13.387 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.382+0000 7f1db5c1f700 1 -- 172.21.15.155:0/1133382512 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db010ec00 con 0x7f1db00fde00 2023-12-16T05:58:13.387 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.382+0000 7f1d97fff700 1 -- 172.21.15.155:0/1133382512 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1da400bcd0 con 0x7f1db00fde00 2023-12-16T05:58:13.387 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.382+0000 7f1d97fff700 1 -- 172.21.15.155:0/1133382512 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1da401c630 con 0x7f1db00fde00 2023-12-16T05:58:13.387 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.382+0000 7f1db5c1f700 1 -- 172.21.15.155:0/1133382512 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db010f140 con 0x7f1db00fde00 2023-12-16T05:58:13.387 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.383+0000 7f1db5c1f700 1 -- 172.21.15.155:0/1133382512 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db004bb80 con 0x7f1db00fde00 2023-12-16T05:58:13.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.384+0000 7f1d97fff700 1 -- 172.21.15.155:0/1133382512 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 31) v1 ==== 90903+0+0 (secure 0 0 0) 0x7f1da4013420 con 0x7f1db00fde00 2023-12-16T05:58:13.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.384+0000 7f1d97fff700 1 --2- 172.21.15.155:0/1133382512 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f1d9806cc50 0x7f1d9806f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:13.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.384+0000 7f1d97fff700 1 -- 172.21.15.155:0/1133382512 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f1da408d560 con 0x7f1db00fde00 2023-12-16T05:58:13.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.384+0000 7f1daf7fe700 1 --2- 172.21.15.155:0/1133382512 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f1d9806cc50 0x7f1d9806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:13.388 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.385+0000 7f1daf7fe700 1 --2- 172.21.15.155:0/1133382512 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f1d9806cc50 0x7f1d9806f100 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1da0006fd0 tx=0x7f1da0008040 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:13.391 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.389+0000 7f1d97fff700 1 -- 172.21.15.155:0/1133382512 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f1da405b0e0 con 0x7f1db00fde00 2023-12-16T05:58:13.494 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:13 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:13.495 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:13 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:13.495 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:13 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:58:13.495 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:13 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:58:13.495 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:13 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:13.495 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:13 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T05:58:13.495 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:13 smithi155 ceph-mon[112451]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T05:58:13.495 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:13 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:58:13.495 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:13 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:13.495 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:13 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:13.495 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:13 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:13.496 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:13 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:13.496 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:13 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:13.496 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:13 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:13.496 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:13 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:13.496 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:13 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:13.496 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:13 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:13.496 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:13 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:13.621 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.618+0000 7f1db5c1f700 1 -- 172.21.15.155:0/1133382512 --> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1db010f5d0 con 0x7f1d9806cc50 2023-12-16T05:58:13.622 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.620+0000 7f1d97fff700 1 -- 172.21.15.155:0/1133382512 <== mgr.14646 v2:172.21.15.155:6800/1257988911 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f1db010f5d0 con 0x7f1d9806cc50 2023-12-16T05:58:13.625 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.622+0000 7f1db5c1f700 1 -- 172.21.15.155:0/1133382512 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f1d9806cc50 msgr2=0x7f1d9806f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:13.625 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.622+0000 7f1db5c1f700 1 --2- 172.21.15.155:0/1133382512 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f1d9806cc50 0x7f1d9806f100 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1da0006fd0 tx=0x7f1da0008040 comp rx=0 tx=0).stop 2023-12-16T05:58:13.625 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.622+0000 7f1db5c1f700 1 -- 172.21.15.155:0/1133382512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1db00fde00 msgr2=0x7f1db010dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:13.625 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.622+0000 7f1db5c1f700 1 --2- 172.21.15.155:0/1133382512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1db00fde00 0x7f1db010dab0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1da400b3b0 tx=0x7f1da4009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:13.625 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.622+0000 7f1db5c1f700 1 -- 172.21.15.155:0/1133382512 shutdown_connections 2023-12-16T05:58:13.625 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.622+0000 7f1db5c1f700 1 --2- 172.21.15.155:0/1133382512 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f1d9806cc50 0x7f1d9806f100 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:13.625 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.622+0000 7f1db5c1f700 1 --2- 172.21.15.155:0/1133382512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1db00fcbf0 0x7f1db010d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:13.625 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.622+0000 7f1db5c1f700 1 --2- 172.21.15.155:0/1133382512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1db00fde00 0x7f1db010dab0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:13.625 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.622+0000 7f1db5c1f700 1 -- 172.21.15.155:0/1133382512 >> 172.21.15.155:0/1133382512 conn(0x7f1db00f82d0 msgr2=0x7f1db0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:13.626 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.622+0000 7f1db5c1f700 1 -- 172.21.15.155:0/1133382512 shutdown_connections 2023-12-16T05:58:13.626 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.622+0000 7f1db5c1f700 1 -- 172.21.15.155:0/1133382512 wait complete. 2023-12-16T05:58:13.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:13 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:13.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:13 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:13.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:13 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:58:13.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:13 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:58:13.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:13 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:13.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:13 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T05:58:13.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:13 smithi156 ceph-mon[121001]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T05:58:13.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:13 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:58:13.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:13 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:13.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:13 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:13.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:13 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:13.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:13 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:13.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:13 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:13.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:13 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:13.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:13 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:13.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:13 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:13.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:13 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:13.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:13 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:13.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.728+0000 7f096ee45700 1 -- 172.21.15.155:0/1665114164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09680fd730 msgr2=0x7f09680ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:13.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.728+0000 7f096ee45700 1 --2- 172.21.15.155:0/1665114164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09680fd730 0x7f09680ffb10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f095c004940 tx=0x7f095c009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:13.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.728+0000 7f096ee45700 1 -- 172.21.15.155:0/1665114164 shutdown_connections 2023-12-16T05:58:13.732 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.728+0000 7f096ee45700 1 --2- 172.21.15.155:0/1665114164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0968100050 0x7f0968102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:13.732 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.728+0000 7f096ee45700 1 --2- 172.21.15.155:0/1665114164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09680fd730 0x7f09680ffb10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:13.732 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.728+0000 7f096ee45700 1 -- 172.21.15.155:0/1665114164 >> 172.21.15.155:0/1665114164 conn(0x7f09680f7190 msgr2=0x7f09680f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:13.732 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.728+0000 7f096ee45700 1 -- 172.21.15.155:0/1665114164 shutdown_connections 2023-12-16T05:58:13.732 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.728+0000 7f096ee45700 1 -- 172.21.15.155:0/1665114164 wait complete. 2023-12-16T05:58:13.732 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.729+0000 7f096ee45700 1 Processor -- start 2023-12-16T05:58:13.732 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.729+0000 7f096ee45700 1 -- start start 2023-12-16T05:58:13.733 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.729+0000 7f096ee45700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09680fd730 0x7f096810f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:13.734 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.729+0000 7f096ee45700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0968100050 0x7f096810fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:13.734 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.729+0000 7f096ee45700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09681102e0 con 0x7f0968100050 2023-12-16T05:58:13.734 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.729+0000 7f096ee45700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0968110b20 con 0x7f09680fd730 2023-12-16T05:58:13.734 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.729+0000 7f0967fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0968100050 0x7f096810fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:13.734 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.729+0000 7f0967fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0968100050 0x7f096810fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54034/0 (socket says 172.21.15.155:54034) 2023-12-16T05:58:13.734 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.729+0000 7f0967fff700 1 -- 172.21.15.155:0/1770987201 learned_addr learned my addr 172.21.15.155:0/1770987201 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:58:13.734 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.729+0000 7f096cbe1700 1 --2- 172.21.15.155:0/1770987201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09680fd730 0x7f096810f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:13.734 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.730+0000 7f0967fff700 1 -- 172.21.15.155:0/1770987201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09680fd730 msgr2=0x7f096810f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:13.734 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.730+0000 7f0967fff700 1 --2- 172.21.15.155:0/1770987201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09680fd730 0x7f096810f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:13.734 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.730+0000 7f0967fff700 1 -- 172.21.15.155:0/1770987201 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095c005040 con 0x7f0968100050 2023-12-16T05:58:13.734 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.730+0000 7f0967fff700 1 --2- 172.21.15.155:0/1770987201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0968100050 0x7f096810fc50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f095400b790 tx=0x7f0954009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:13.734 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.730+0000 7f09657fa700 1 -- 172.21.15.155:0/1770987201 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f095400f6f0 con 0x7f0968100050 2023-12-16T05:58:13.735 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.730+0000 7f09657fa700 1 -- 172.21.15.155:0/1770987201 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f095400fd00 con 0x7f0968100050 2023-12-16T05:58:13.735 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.730+0000 7f096ee45700 1 -- 172.21.15.155:0/1770987201 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0968110e00 con 0x7f0968100050 2023-12-16T05:58:13.735 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.730+0000 7f09657fa700 1 -- 172.21.15.155:0/1770987201 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09540103a0 con 0x7f0968100050 2023-12-16T05:58:13.735 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.730+0000 7f096ee45700 1 -- 172.21.15.155:0/1770987201 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0968111340 con 0x7f0968100050 2023-12-16T05:58:13.735 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.731+0000 7f096ee45700 1 -- 172.21.15.155:0/1770987201 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f096804bb80 con 0x7f0968100050 2023-12-16T05:58:13.736 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.732+0000 7f09657fa700 1 -- 172.21.15.155:0/1770987201 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 31) v1 ==== 90903+0+0 (secure 0 0 0) 0x7f095400f850 con 0x7f0968100050 2023-12-16T05:58:13.736 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.732+0000 7f09657fa700 1 --2- 172.21.15.155:0/1770987201 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f095806cc00 0x7f095806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:13.736 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.732+0000 7f09657fa700 1 -- 172.21.15.155:0/1770987201 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f095408bd70 con 0x7f0968100050 2023-12-16T05:58:13.736 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.732+0000 7f096cbe1700 1 --2- 172.21.15.155:0/1770987201 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f095806cc00 0x7f095806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:13.736 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.732+0000 7f096cbe1700 1 --2- 172.21.15.155:0/1770987201 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f095806cc00 0x7f095806f0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f095c00b3b0 tx=0x7f095c009e30 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:13.739 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.737+0000 7f09657fa700 1 -- 172.21.15.155:0/1770987201 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0954059b20 con 0x7f0968100050 2023-12-16T05:58:13.955 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.953+0000 7f096ee45700 1 -- 172.21.15.155:0/1770987201 --> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f09681117f0 con 0x7f095806cc00 2023-12-16T05:58:13.965 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.963+0000 7f09657fa700 1 -- 172.21.15.155:0/1770987201 <== mgr.14646 v2:172.21.15.155:6800/1257988911 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f09681117f0 con 0x7f095806cc00 2023-12-16T05:58:13.966 INFO:teuthology.orchestra.run.smithi155.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T05:58:13.966 INFO:teuthology.orchestra.run.smithi155.stdout:alertmanager.smithi155 smithi155 *:9093,9094 running (87s) 4s ago 7m 28.8M - 0.25.0 c8568f914cd2 bdf6c0de0230 2023-12-16T05:58:13.966 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi155 smithi155 running (7m) 4s ago 7m 7444k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 033f79f53811 2023-12-16T05:58:13.966 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi156 smithi156 running (6m) 17s ago 6m 7470k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 c72bd1a1d00a 2023-12-16T05:58:13.966 INFO:teuthology.orchestra.run.smithi155.stdout:grafana.smithi155 smithi155 *:3000 running (73s) 4s ago 7m 80.9M - 9.4.7 954c08fa6188 b5d3bc9ecf2f 2023-12-16T05:58:13.966 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.bzsxjw smithi155 running (3m) 4s ago 3m 4743M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6bcabf94a5c3 2023-12-16T05:58:13.966 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.vicpis smithi155 running (3m) 4s ago 3m 668M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 afa64e1ef8da 2023-12-16T05:58:13.966 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.fasing smithi156 running (3m) 17s ago 3m 532M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 7d97160bda7c 2023-12-16T05:58:13.966 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.qvgmfj smithi156 running (3m) 17s ago 3m 5969M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4018b2f2e27e 2023-12-16T05:58:13.966 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi155.maowdn smithi155 *:8443,9283,8765 running (61s) 4s ago 8m 506M - 19.0.0-191-g6d933094 a29c258b5d6f ee39089d18d3 2023-12-16T05:58:13.967 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi156.pclong smithi156 *:8443,9283,8765 running (36s) 17s ago 6m 449M - 19.0.0-191-g6d933094 a29c258b5d6f 673376e357e8 2023-12-16T05:58:13.967 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi155 smithi155 running (8m) 4s ago 8m 95.6M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 0d0eecfde53b 2023-12-16T05:58:13.967 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi156 smithi156 running (6m) 17s ago 6m 65.0M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 4575acae9bdb 2023-12-16T05:58:13.967 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi155 smithi155 *:9100 running (26s) 4s ago 7m 8178k - 1.5.0 0da6a335fe13 6f0f1f68f191 2023-12-16T05:58:13.967 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi156 smithi156 *:9100 running (20s) 17s ago 6m 4072k - 1.5.0 0da6a335fe13 c4595a7b1707 2023-12-16T05:58:13.967 INFO:teuthology.orchestra.run.smithi155.stdout:osd.0 smithi155 running (6m) 4s ago 6m 780M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 91e650c277f7 2023-12-16T05:58:13.967 INFO:teuthology.orchestra.run.smithi155.stdout:osd.1 smithi155 running (5m) 4s ago 5m 856M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957303cb6598 2023-12-16T05:58:13.967 INFO:teuthology.orchestra.run.smithi155.stdout:osd.2 smithi155 running (5m) 4s ago 5m 623M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957a169c1cac 2023-12-16T05:58:13.967 INFO:teuthology.orchestra.run.smithi155.stdout:osd.3 smithi156 running (5m) 17s ago 5m 939M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c4f6c54afe99 2023-12-16T05:58:13.967 INFO:teuthology.orchestra.run.smithi155.stdout:osd.4 smithi156 running (4m) 17s ago 4m 725M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 6309b12204fd 2023-12-16T05:58:13.967 INFO:teuthology.orchestra.run.smithi155.stdout:osd.5 smithi156 running (4m) 17s ago 4m 839M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 84b2c33eb0e1 2023-12-16T05:58:13.967 INFO:teuthology.orchestra.run.smithi155.stdout:prometheus.smithi155 smithi155 *:9095 running (8s) 4s ago 7m 42.7M - 2.43.0 a07b618ecd1d 26bb7cfc1b8b 2023-12-16T05:58:13.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.965+0000 7f096ee45700 1 -- 172.21.15.155:0/1770987201 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f095806cc00 msgr2=0x7f095806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:13.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.965+0000 7f096ee45700 1 --2- 172.21.15.155:0/1770987201 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f095806cc00 0x7f095806f0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f095c00b3b0 tx=0x7f095c009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:13.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.965+0000 7f096ee45700 1 -- 172.21.15.155:0/1770987201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0968100050 msgr2=0x7f096810fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:13.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.965+0000 7f096ee45700 1 --2- 172.21.15.155:0/1770987201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0968100050 0x7f096810fc50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f095400b790 tx=0x7f0954009250 comp rx=0 tx=0).stop 2023-12-16T05:58:13.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.965+0000 7f096ee45700 1 -- 172.21.15.155:0/1770987201 shutdown_connections 2023-12-16T05:58:13.969 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.965+0000 7f096ee45700 1 --2- 172.21.15.155:0/1770987201 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f095806cc00 0x7f095806f0b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:13.969 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.965+0000 7f096ee45700 1 --2- 172.21.15.155:0/1770987201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09680fd730 0x7f096810f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:13.969 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.965+0000 7f096ee45700 1 --2- 172.21.15.155:0/1770987201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0968100050 0x7f096810fc50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:13.969 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.965+0000 7f096ee45700 1 -- 172.21.15.155:0/1770987201 >> 172.21.15.155:0/1770987201 conn(0x7f09680f7190 msgr2=0x7f09680ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:13.969 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.965+0000 7f096ee45700 1 -- 172.21.15.155:0/1770987201 shutdown_connections 2023-12-16T05:58:13.969 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:13.965+0000 7f096ee45700 1 -- 172.21.15.155:0/1770987201 wait complete. 2023-12-16T05:58:14.080 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.077+0000 7febd544b700 1 -- 172.21.15.155:0/1137407130 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febd00fcd00 msgr2=0x7febd00fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:14.080 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.077+0000 7febd544b700 1 --2- 172.21.15.155:0/1137407130 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febd00fcd00 0x7febd00fd150 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7febc4004940 tx=0x7febc4009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:14.080 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.077+0000 7febd544b700 1 -- 172.21.15.155:0/1137407130 shutdown_connections 2023-12-16T05:58:14.080 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.077+0000 7febd544b700 1 --2- 172.21.15.155:0/1137407130 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febd00fcd00 0x7febd00fd150 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:14.080 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.077+0000 7febd544b700 1 --2- 172.21.15.155:0/1137407130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febd00fbaf0 0x7febd00fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:14.080 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.077+0000 7febd544b700 1 -- 172.21.15.155:0/1137407130 >> 172.21.15.155:0/1137407130 conn(0x7febd00f7190 msgr2=0x7febd00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:14.080 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.077+0000 7febd544b700 1 -- 172.21.15.155:0/1137407130 shutdown_connections 2023-12-16T05:58:14.080 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.077+0000 7febd544b700 1 -- 172.21.15.155:0/1137407130 wait complete. 2023-12-16T05:58:14.080 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.077+0000 7febd544b700 1 Processor -- start 2023-12-16T05:58:14.081 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.077+0000 7febd544b700 1 -- start start 2023-12-16T05:58:14.082 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.078+0000 7febd544b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febd00fbaf0 0x7febd010c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:14.082 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.078+0000 7febd544b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febd00fcd00 0x7febd010c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:14.082 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.078+0000 7febd544b700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd010cf10 con 0x7febd00fcd00 2023-12-16T05:58:14.082 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.078+0000 7febd544b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd010d7b0 con 0x7febd00fbaf0 2023-12-16T05:58:14.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.078+0000 7febce7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febd00fcd00 0x7febd010c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:14.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.078+0000 7febce7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febd00fcd00 0x7febd010c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54066/0 (socket says 172.21.15.155:54066) 2023-12-16T05:58:14.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.078+0000 7febce7fc700 1 -- 172.21.15.155:0/2999918930 learned_addr learned my addr 172.21.15.155:0/2999918930 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:58:14.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.078+0000 7febceffd700 1 --2- 172.21.15.155:0/2999918930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febd00fbaf0 0x7febd010c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:14.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.078+0000 7febce7fc700 1 -- 172.21.15.155:0/2999918930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febd00fbaf0 msgr2=0x7febd010c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:14.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.078+0000 7febce7fc700 1 --2- 172.21.15.155:0/2999918930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febd00fbaf0 0x7febd010c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:14.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.078+0000 7febce7fc700 1 -- 172.21.15.155:0/2999918930 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc4005040 con 0x7febd00fcd00 2023-12-16T05:58:14.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.078+0000 7febce7fc700 1 --2- 172.21.15.155:0/2999918930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febd00fcd00 0x7febd010c910 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7febc4000c00 tx=0x7febc4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:14.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.078+0000 7febb77fe700 1 -- 172.21.15.155:0/2999918930 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febc4021070 con 0x7febd00fcd00 2023-12-16T05:58:14.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.078+0000 7febb77fe700 1 -- 172.21.15.155:0/2999918930 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7febc401c400 con 0x7febd00fcd00 2023-12-16T05:58:14.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.078+0000 7febd544b700 1 -- 172.21.15.155:0/2999918930 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd010da30 con 0x7febd00fcd00 2023-12-16T05:58:14.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.078+0000 7febb77fe700 1 -- 172.21.15.155:0/2999918930 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febc400e070 con 0x7febd00fcd00 2023-12-16T05:58:14.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.078+0000 7febd544b700 1 -- 172.21.15.155:0/2999918930 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd010df10 con 0x7febd00fcd00 2023-12-16T05:58:14.084 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.079+0000 7febd544b700 1 -- 172.21.15.155:0/2999918930 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd004bb80 con 0x7febd00fcd00 2023-12-16T05:58:14.084 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.080+0000 7febb77fe700 1 -- 172.21.15.155:0/2999918930 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 31) v1 ==== 90903+0+0 (secure 0 0 0) 0x7febc401c9c0 con 0x7febd00fcd00 2023-12-16T05:58:14.084 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.080+0000 7febb77fe700 1 --2- 172.21.15.155:0/2999918930 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7febb806cc00 0x7febb806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:14.084 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.080+0000 7febb77fe700 1 -- 172.21.15.155:0/2999918930 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7febc408d2f0 con 0x7febd00fcd00 2023-12-16T05:58:14.085 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.080+0000 7febceffd700 1 --2- 172.21.15.155:0/2999918930 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7febb806cc00 0x7febb806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:14.085 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.081+0000 7febceffd700 1 --2- 172.21.15.155:0/2999918930 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7febb806cc00 0x7febb806f0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7febc0009b80 tx=0x7febc000b040 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:14.087 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.085+0000 7febb77fe700 1 -- 172.21.15.155:0/2999918930 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7febc405aef0 con 0x7febd00fcd00 2023-12-16T05:58:14.374 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.371+0000 7febd544b700 1 -- 172.21.15.155:0/2999918930 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7febd0104490 con 0x7febd00fcd00 2023-12-16T05:58:14.374 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.371+0000 7febb77fe700 1 -- 172.21.15.155:0/2999918930 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7febc405aa80 con 0x7febd00fcd00 2023-12-16T05:58:14.374 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T05:58:14.374 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": { 2023-12-16T05:58:14.374 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T05:58:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:58:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": { 2023-12-16T05:58:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T05:58:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:58:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": { 2023-12-16T05:58:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T05:58:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:58:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2023-12-16T05:58:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T05:58:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:58:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: "overall": { 2023-12-16T05:58:14.375 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-16T05:58:14.376 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T05:58:14.376 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-12-16T05:58:14.376 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T05:58:14.377 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.373+0000 7febd544b700 1 -- 172.21.15.155:0/2999918930 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7febb806cc00 msgr2=0x7febb806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:14.377 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.373+0000 7febd544b700 1 --2- 172.21.15.155:0/2999918930 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7febb806cc00 0x7febb806f0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7febc0009b80 tx=0x7febc000b040 comp rx=0 tx=0).stop 2023-12-16T05:58:14.377 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.373+0000 7febd544b700 1 -- 172.21.15.155:0/2999918930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febd00fcd00 msgr2=0x7febd010c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:14.377 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.373+0000 7febd544b700 1 --2- 172.21.15.155:0/2999918930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febd00fcd00 0x7febd010c910 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7febc4000c00 tx=0x7febc4009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:14.377 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.374+0000 7febd544b700 1 -- 172.21.15.155:0/2999918930 shutdown_connections 2023-12-16T05:58:14.377 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.374+0000 7febd544b700 1 --2- 172.21.15.155:0/2999918930 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7febb806cc00 0x7febb806f0b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:14.377 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.374+0000 7febd544b700 1 --2- 172.21.15.155:0/2999918930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febd00fbaf0 0x7febd010c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:14.377 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.374+0000 7febd544b700 1 --2- 172.21.15.155:0/2999918930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febd00fcd00 0x7febd010c910 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:14.378 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.374+0000 7febd544b700 1 -- 172.21.15.155:0/2999918930 >> 172.21.15.155:0/2999918930 conn(0x7febd00f7190 msgr2=0x7febd00fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:14.378 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.374+0000 7febd544b700 1 -- 172.21.15.155:0/2999918930 shutdown_connections 2023-12-16T05:58:14.378 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.374+0000 7febd544b700 1 -- 172.21.15.155:0/2999918930 wait complete. 2023-12-16T05:58:14.481 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.478+0000 7f2f399da700 1 -- 172.21.15.155:0/2686160729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f340fbaf0 msgr2=0x7f2f340fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:14.481 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.478+0000 7f2f399da700 1 --2- 172.21.15.155:0/2686160729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f340fbaf0 0x7f2f340fbf00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2f24004940 tx=0x7f2f24009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:14.481 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.478+0000 7f2f399da700 1 -- 172.21.15.155:0/2686160729 shutdown_connections 2023-12-16T05:58:14.481 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.478+0000 7f2f399da700 1 --2- 172.21.15.155:0/2686160729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f340fcd00 0x7f2f340fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:14.481 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.478+0000 7f2f399da700 1 --2- 172.21.15.155:0/2686160729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f340fbaf0 0x7f2f340fbf00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:14.481 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.478+0000 7f2f399da700 1 -- 172.21.15.155:0/2686160729 >> 172.21.15.155:0/2686160729 conn(0x7f2f340f71d0 msgr2=0x7f2f340f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:14.481 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.478+0000 7f2f399da700 1 -- 172.21.15.155:0/2686160729 shutdown_connections 2023-12-16T05:58:14.481 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.478+0000 7f2f399da700 1 -- 172.21.15.155:0/2686160729 wait complete. 2023-12-16T05:58:14.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.479+0000 7f2f399da700 1 Processor -- start 2023-12-16T05:58:14.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.479+0000 7f2f399da700 1 -- start start 2023-12-16T05:58:14.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.479+0000 7f2f399da700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f340fbaf0 0x7f2f3410d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:14.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.479+0000 7f2f399da700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f340fcd00 0x7f2f3410dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:14.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.479+0000 7f2f399da700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3410e0b0 con 0x7f2f340fbaf0 2023-12-16T05:58:14.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.479+0000 7f2f399da700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3410e950 con 0x7f2f340fcd00 2023-12-16T05:58:14.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.479+0000 7f2f32ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f340fbaf0 0x7f2f3410d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:14.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.479+0000 7f2f32ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f340fbaf0 0x7f2f3410d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54078/0 (socket says 172.21.15.155:54078) 2023-12-16T05:58:14.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.479+0000 7f2f32ffd700 1 -- 172.21.15.155:0/2954179924 learned_addr learned my addr 172.21.15.155:0/2954179924 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:58:14.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.479+0000 7f2f327fc700 1 --2- 172.21.15.155:0/2954179924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f340fcd00 0x7f2f3410dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:14.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.479+0000 7f2f32ffd700 1 -- 172.21.15.155:0/2954179924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f340fcd00 msgr2=0x7f2f3410dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:14.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.479+0000 7f2f32ffd700 1 --2- 172.21.15.155:0/2954179924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f340fcd00 0x7f2f3410dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:14.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.479+0000 7f2f32ffd700 1 -- 172.21.15.155:0/2954179924 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f24005040 con 0x7f2f340fbaf0 2023-12-16T05:58:14.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.479+0000 7f2f327fc700 1 --2- 172.21.15.155:0/2954179924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f340fcd00 0x7f2f3410dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T05:58:14.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.479+0000 7f2f32ffd700 1 --2- 172.21.15.155:0/2954179924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f340fbaf0 0x7f2f3410d570 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2f24000c00 tx=0x7f2f24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:14.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.479+0000 7f2f1b7fe700 1 -- 172.21.15.155:0/2954179924 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f2400e040 con 0x7f2f340fbaf0 2023-12-16T05:58:14.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.480+0000 7f2f1b7fe700 1 -- 172.21.15.155:0/2954179924 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f24009af0 con 0x7f2f340fbaf0 2023-12-16T05:58:14.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.480+0000 7f2f399da700 1 -- 172.21.15.155:0/2954179924 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3410ebd0 con 0x7f2f340fbaf0 2023-12-16T05:58:14.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.480+0000 7f2f1b7fe700 1 -- 172.21.15.155:0/2954179924 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f2401c630 con 0x7f2f340fbaf0 2023-12-16T05:58:14.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.480+0000 7f2f399da700 1 -- 172.21.15.155:0/2954179924 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3410f110 con 0x7f2f340fbaf0 2023-12-16T05:58:14.485 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.481+0000 7f2f399da700 1 -- 172.21.15.155:0/2954179924 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3404bb80 con 0x7f2f340fbaf0 2023-12-16T05:58:14.485 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.482+0000 7f2f1b7fe700 1 -- 172.21.15.155:0/2954179924 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 31) v1 ==== 90903+0+0 (secure 0 0 0) 0x7f2f2400bcd0 con 0x7f2f340fbaf0 2023-12-16T05:58:14.485 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.482+0000 7f2f1b7fe700 1 --2- 172.21.15.155:0/2954179924 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f2f1c06cc00 0x7f2f1c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:14.485 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.482+0000 7f2f1b7fe700 1 -- 172.21.15.155:0/2954179924 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f2f2408ded0 con 0x7f2f340fbaf0 2023-12-16T05:58:14.485 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.482+0000 7f2f327fc700 1 --2- 172.21.15.155:0/2954179924 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f2f1c06cc00 0x7f2f1c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:14.485 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.483+0000 7f2f327fc700 1 --2- 172.21.15.155:0/2954179924 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f2f1c06cc00 0x7f2f1c06f0b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2f28007fd0 tx=0x7f2f28009040 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:14.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.486+0000 7f2f1b7fe700 1 -- 172.21.15.155:0/2954179924 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f2f2405bc10 con 0x7f2f340fbaf0 2023-12-16T05:58:14.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:14 smithi156 ceph-mon[121001]: pgmap v29: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 7.5 KiB/s wr, 17 op/s 2023-12-16T05:58:14.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:14 smithi156 ceph-mon[121001]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:58:14.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:14 smithi156 ceph-mon[121001]: Upgrade: Updating alertmanager.smithi155 2023-12-16T05:58:14.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:14 smithi156 ceph-mon[121001]: Deploying daemon alertmanager.smithi155 on smithi155 2023-12-16T05:58:14.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:14 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/2999918930' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:14.701 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:14 smithi155 ceph-mon[112451]: pgmap v29: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 7.5 KiB/s wr, 17 op/s 2023-12-16T05:58:14.701 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:14 smithi155 ceph-mon[112451]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:58:14.701 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:14 smithi155 ceph-mon[112451]: Upgrade: Updating alertmanager.smithi155 2023-12-16T05:58:14.701 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:14 smithi155 ceph-mon[112451]: Deploying daemon alertmanager.smithi155 on smithi155 2023-12-16T05:58:14.701 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:14 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2999918930' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:14.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.707+0000 7f2f399da700 1 -- 172.21.15.155:0/2954179924 --> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f3410f760 con 0x7f2f1c06cc00 2023-12-16T05:58:14.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.708+0000 7f2f1b7fe700 1 -- 172.21.15.155:0/2954179924 <== mgr.14646 v2:172.21.15.155:6800/1257988911 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f2f3410f760 con 0x7f2f1c06cc00 2023-12-16T05:58:14.711 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T05:58:14.711 INFO:teuthology.orchestra.run.smithi155.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T05:58:14.711 INFO:teuthology.orchestra.run.smithi155.stdout: "in_progress": true, 2023-12-16T05:58:14.711 INFO:teuthology.orchestra.run.smithi155.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T05:58:14.711 INFO:teuthology.orchestra.run.smithi155.stdout: "services_complete": [ 2023-12-16T05:58:14.711 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr" 2023-12-16T05:58:14.711 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-12-16T05:58:14.711 INFO:teuthology.orchestra.run.smithi155.stdout: "progress": "2/2 daemons upgraded", 2023-12-16T05:58:14.711 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "Currently upgrading alertmanager daemons", 2023-12-16T05:58:14.711 INFO:teuthology.orchestra.run.smithi155.stdout: "is_paused": false 2023-12-16T05:58:14.711 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T05:58:14.713 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.710+0000 7f2f399da700 1 -- 172.21.15.155:0/2954179924 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f2f1c06cc00 msgr2=0x7f2f1c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:14.713 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.710+0000 7f2f399da700 1 --2- 172.21.15.155:0/2954179924 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f2f1c06cc00 0x7f2f1c06f0b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2f28007fd0 tx=0x7f2f28009040 comp rx=0 tx=0).stop 2023-12-16T05:58:14.713 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.710+0000 7f2f399da700 1 -- 172.21.15.155:0/2954179924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f340fbaf0 msgr2=0x7f2f3410d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:14.713 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.710+0000 7f2f399da700 1 --2- 172.21.15.155:0/2954179924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f340fbaf0 0x7f2f3410d570 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2f24000c00 tx=0x7f2f24009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:14.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.710+0000 7f2f399da700 1 -- 172.21.15.155:0/2954179924 shutdown_connections 2023-12-16T05:58:14.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.710+0000 7f2f399da700 1 --2- 172.21.15.155:0/2954179924 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f2f1c06cc00 0x7f2f1c06f0b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:14.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.710+0000 7f2f399da700 1 --2- 172.21.15.155:0/2954179924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f340fbaf0 0x7f2f3410d570 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:14.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.710+0000 7f2f399da700 1 --2- 172.21.15.155:0/2954179924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f340fcd00 0x7f2f3410dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:14.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.710+0000 7f2f399da700 1 -- 172.21.15.155:0/2954179924 >> 172.21.15.155:0/2954179924 conn(0x7f2f340f71d0 msgr2=0x7f2f34065c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:14.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.711+0000 7f2f399da700 1 -- 172.21.15.155:0/2954179924 shutdown_connections 2023-12-16T05:58:14.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:14.711+0000 7f2f399da700 1 -- 172.21.15.155:0/2954179924 wait complete. 2023-12-16T05:58:15.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:15 smithi155 ceph-mon[112451]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:58:15.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:15 smithi155 ceph-mon[112451]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:58:15.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:15 smithi156 ceph-mon[121001]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:58:15.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:15 smithi156 ceph-mon[121001]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:58:16.657 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:16 smithi155 ceph-mon[112451]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:58:16.657 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:16 smithi155 ceph-mon[112451]: pgmap v30: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-16T05:58:16.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:16 smithi156 ceph-mon[121001]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:58:16.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:16 smithi156 ceph-mon[121001]: pgmap v30: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-16T05:58:18.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:17 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:18.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:17 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:18.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:17 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:58:18.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:17 smithi155 ceph-mon[112451]: pgmap v31: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-16T05:58:18.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:17 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:18.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:17 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:18.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:17 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:58:18.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:17 smithi156 ceph-mon[121001]: pgmap v31: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-16T05:58:20.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:20 smithi156 ceph-mon[121001]: pgmap v32: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 426 B/s wr, 8 op/s 2023-12-16T05:58:20.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:20 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:20.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:20 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:20.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:20 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:20.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:20 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:20.941 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:20 smithi155 ceph-mon[112451]: pgmap v32: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 426 B/s wr, 8 op/s 2023-12-16T05:58:20.941 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:20 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:20.941 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:20 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:20.941 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:20 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:20.941 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:20 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:21.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:21 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:58:22.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:21 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:58:22.750 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:22 smithi155 ceph-mon[112451]: pgmap v33: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-16T05:58:22.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:22 smithi156 ceph-mon[121001]: pgmap v33: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-16T05:58:23.967 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:23 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:23.967 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:23 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:23.967 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:23 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:58:23.968 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:23 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:58:23.968 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:23 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:23.968 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:23 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T05:58:23.968 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:23 smithi155 ceph-mon[112451]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T05:58:23.968 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:23 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:58:23.968 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:23 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:23.968 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:23 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:23.968 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:23 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:23.968 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:23 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:23.968 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:23 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:23.968 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:23 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:23.968 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:23 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:23.968 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:23 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:23.968 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:23 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:23.968 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:23 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:23.969 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:23 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:23.969 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:23 smithi155 ceph-mon[112451]: pgmap v34: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 341 B/s wr, 7 op/s 2023-12-16T05:58:24.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:23 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:24.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:23 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:24.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:23 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:58:24.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:23 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:58:24.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:23 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:24.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:23 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T05:58:24.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:23 smithi156 ceph-mon[121001]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T05:58:24.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:23 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:58:24.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:23 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:24.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:23 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:24.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:23 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:24.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:23 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:24.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:23 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:24.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:23 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:24.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:23 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:24.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:23 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:24.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:23 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:24.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:23 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:24.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:23 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:24.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:23 smithi156 ceph-mon[121001]: pgmap v34: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 341 B/s wr, 7 op/s 2023-12-16T05:58:24.959 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:24 smithi155 ceph-mon[112451]: Upgrade: Updating grafana.smithi155 2023-12-16T05:58:24.959 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:24 smithi155 ceph-mon[112451]: Deploying daemon grafana.smithi155 on smithi155 2023-12-16T05:58:25.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:24 smithi156 ceph-mon[121001]: Upgrade: Updating grafana.smithi155 2023-12-16T05:58:25.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:24 smithi156 ceph-mon[121001]: Deploying daemon grafana.smithi155 on smithi155 2023-12-16T05:58:26.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:25 smithi155 ceph-mon[112451]: pgmap v35: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2023-12-16T05:58:26.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:25 smithi156 ceph-mon[121001]: pgmap v35: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2023-12-16T05:58:28.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:28 smithi155 ceph-mon[112451]: pgmap v36: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2023-12-16T05:58:28.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:28 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:28.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:28 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:28.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:28 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:58:28.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:28 smithi156 ceph-mon[121001]: pgmap v36: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2023-12-16T05:58:28.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:28 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:28.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:28 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:28.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:28 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:58:30.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:30 smithi156 ceph-mon[121001]: pgmap v37: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2023-12-16T05:58:30.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:30 smithi155 ceph-mon[112451]: pgmap v37: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2023-12-16T05:58:32.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:32 smithi155 ceph-mon[112451]: pgmap v38: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2023-12-16T05:58:32.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:32 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:32.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:32 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:32.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:32 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:32.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:32 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:32.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:32 smithi156 ceph-mon[121001]: pgmap v38: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2023-12-16T05:58:32.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:32 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:32.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:32 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:32.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:32 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:32.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:32 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:34.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:34 smithi156 ceph-mon[121001]: pgmap v39: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-16T05:58:34.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:34 smithi155 ceph-mon[112451]: pgmap v39: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-16T05:58:35.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:35.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:35.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:58:35.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:58:35.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:35.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T05:58:35.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:58:35.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:35.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2023-12-16T05:58:35.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2023-12-16T05:58:35.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T05:58:35.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2023-12-16T05:58:35.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2023-12-16T05:58:35.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2023-12-16T05:58:35.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2023-12-16T05:58:35.829 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2023-12-16T05:58:35.829 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2023-12-16T05:58:35.829 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2023-12-16T05:58:35.829 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2023-12-16T05:58:35.829 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T05:58:35.829 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2023-12-16T05:58:35.829 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2023-12-16T05:58:35.829 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2023-12-16T05:58:35.829 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2023-12-16T05:58:35.829 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2023-12-16T05:58:35.829 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2023-12-16T05:58:35.829 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2023-12-16T05:58:35.829 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2023-12-16T05:58:35.829 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T05:58:35.829 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T05:58:35.830 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T05:58:35.830 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T05:58:35.830 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T05:58:35.830 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T05:58:35.830 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2023-12-16T05:58:35.830 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2023-12-16T05:58:35.830 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:58:35.830 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:58:35.830 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:58:35.830 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:35.830 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:58:35.830 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:58:35.830 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:58:35.830 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:35 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:35.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:35.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:35.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:58:35.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:58:35.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:35.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T05:58:35.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:58:35.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:35.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:35.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2023-12-16T05:58:35.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2023-12-16T05:58:35.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T05:58:35.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2023-12-16T05:58:35.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2023-12-16T05:58:35.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2023-12-16T05:58:35.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2023-12-16T05:58:35.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2023-12-16T05:58:35.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2023-12-16T05:58:35.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2023-12-16T05:58:35.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2023-12-16T05:58:35.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T05:58:35.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2023-12-16T05:58:35.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2023-12-16T05:58:35.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2023-12-16T05:58:35.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2023-12-16T05:58:35.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2023-12-16T05:58:35.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2023-12-16T05:58:35.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2023-12-16T05:58:35.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2023-12-16T05:58:35.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T05:58:35.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T05:58:35.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T05:58:35.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T05:58:35.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T05:58:35.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T05:58:35.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2023-12-16T05:58:35.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2023-12-16T05:58:35.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:58:35.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:58:35.933 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:58:35.934 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:35.934 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:58:35.934 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:58:35.934 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:58:35.934 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:35 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:36.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:36 smithi155 ceph-mon[112451]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T05:58:36.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:36 smithi155 ceph-mon[112451]: Upgrade: Finalizing container_image settings 2023-12-16T05:58:36.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:36 smithi155 ceph-mon[112451]: Upgrade: Complete! 2023-12-16T05:58:36.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:36 smithi155 ceph-mon[112451]: pgmap v40: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:58:36.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:36 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:58:36.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:36 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:36.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:36 smithi156 ceph-mon[121001]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T05:58:36.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:36 smithi156 ceph-mon[121001]: Upgrade: Finalizing container_image settings 2023-12-16T05:58:36.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:36 smithi156 ceph-mon[121001]: Upgrade: Complete! 2023-12-16T05:58:36.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:36 smithi156 ceph-mon[121001]: pgmap v40: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:58:36.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:36 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:58:36.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:36 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:38.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:38 smithi155 ceph-mon[112451]: pgmap v41: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:58:38.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:38 smithi156 ceph-mon[121001]: pgmap v41: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:58:40.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:40 smithi156 ceph-mon[121001]: pgmap v42: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T05:58:41.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:40 smithi155 ceph-mon[112451]: pgmap v42: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T05:58:42.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:42 smithi156 ceph-mon[121001]: pgmap v43: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:58:43.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:42 smithi155 ceph-mon[112451]: pgmap v43: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:58:44.831 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.827+0000 7f82f8f19700 1 -- 172.21.15.155:0/1334927571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82f40fcd00 msgr2=0x7f82f40fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:44.832 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.827+0000 7f82f8f19700 1 --2- 172.21.15.155:0/1334927571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82f40fcd00 0x7f82f40fd150 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f82e8004940 tx=0x7f82e8009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:44.832 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.827+0000 7f82f8f19700 1 -- 172.21.15.155:0/1334927571 shutdown_connections 2023-12-16T05:58:44.832 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.827+0000 7f82f8f19700 1 --2- 172.21.15.155:0/1334927571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82f40fcd00 0x7f82f40fd150 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:44.832 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.827+0000 7f82f8f19700 1 --2- 172.21.15.155:0/1334927571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82f40fbaf0 0x7f82f40fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:44.832 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.827+0000 7f82f8f19700 1 -- 172.21.15.155:0/1334927571 >> 172.21.15.155:0/1334927571 conn(0x7f82f40f71b0 msgr2=0x7f82f40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:44.832 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.827+0000 7f82f8f19700 1 -- 172.21.15.155:0/1334927571 shutdown_connections 2023-12-16T05:58:44.832 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.827+0000 7f82f8f19700 1 -- 172.21.15.155:0/1334927571 wait complete. 2023-12-16T05:58:44.832 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.827+0000 7f82f8f19700 1 Processor -- start 2023-12-16T05:58:44.832 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.827+0000 7f82f8f19700 1 -- start start 2023-12-16T05:58:44.832 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.828+0000 7f82f8f19700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82f40fbaf0 0x7f82f4112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:44.832 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.828+0000 7f82f8f19700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82f40fcd00 0x7f82f4114b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:44.832 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.828+0000 7f82f8f19700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f4066890 con 0x7f82f40fbaf0 2023-12-16T05:58:44.833 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.828+0000 7f82f8f19700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f40669d0 con 0x7f82f40fcd00 2023-12-16T05:58:44.833 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.828+0000 7f82f259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82f40fbaf0 0x7f82f4112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:44.833 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.828+0000 7f82f259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82f40fbaf0 0x7f82f4112610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44718/0 (socket says 172.21.15.155:44718) 2023-12-16T05:58:44.833 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.828+0000 7f82f259c700 1 -- 172.21.15.155:0/1223247287 learned_addr learned my addr 172.21.15.155:0/1223247287 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:58:44.833 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.828+0000 7f82f1d9b700 1 --2- 172.21.15.155:0/1223247287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82f40fcd00 0x7f82f4114b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:44.833 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.828+0000 7f82f259c700 1 -- 172.21.15.155:0/1223247287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82f40fcd00 msgr2=0x7f82f4114b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:44.833 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.828+0000 7f82f259c700 1 --2- 172.21.15.155:0/1223247287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82f40fcd00 0x7f82f4114b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:44.833 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.828+0000 7f82f259c700 1 -- 172.21.15.155:0/1223247287 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e8005040 con 0x7f82f40fbaf0 2023-12-16T05:58:44.833 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.828+0000 7f82f1d9b700 1 --2- 172.21.15.155:0/1223247287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82f40fcd00 0x7f82f4114b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T05:58:44.833 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.828+0000 7f82f259c700 1 --2- 172.21.15.155:0/1223247287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82f40fbaf0 0x7f82f4112610 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f82e4002a80 tx=0x7f82e4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:44.833 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.828+0000 7f82e2ffd700 1 -- 172.21.15.155:0/1223247287 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82e4007cc0 con 0x7f82f40fbaf0 2023-12-16T05:58:44.833 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.828+0000 7f82e2ffd700 1 -- 172.21.15.155:0/1223247287 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f82e400f040 con 0x7f82f40fbaf0 2023-12-16T05:58:44.834 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.828+0000 7f82f8f19700 1 -- 172.21.15.155:0/1223247287 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f41150a0 con 0x7f82f40fbaf0 2023-12-16T05:58:44.834 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.828+0000 7f82e2ffd700 1 -- 172.21.15.155:0/1223247287 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82e400da20 con 0x7f82f40fbaf0 2023-12-16T05:58:44.834 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.828+0000 7f82f8f19700 1 -- 172.21.15.155:0/1223247287 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f41154a0 con 0x7f82f40fbaf0 2023-12-16T05:58:44.834 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.829+0000 7f82f8f19700 1 -- 172.21.15.155:0/1223247287 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f404bb80 con 0x7f82f40fbaf0 2023-12-16T05:58:44.835 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.830+0000 7f82e2ffd700 1 -- 172.21.15.155:0/1223247287 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 31) v1 ==== 90903+0+0 (secure 0 0 0) 0x7f82e400db80 con 0x7f82f40fbaf0 2023-12-16T05:58:44.835 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.830+0000 7f82e2ffd700 1 --2- 172.21.15.155:0/1223247287 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f82dc06cc00 0x7f82dc06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:44.835 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.830+0000 7f82e2ffd700 1 -- 172.21.15.155:0/1223247287 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f82e408bdc0 con 0x7f82f40fbaf0 2023-12-16T05:58:44.835 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.830+0000 7f82f1d9b700 1 --2- 172.21.15.155:0/1223247287 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f82dc06cc00 0x7f82dc06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:44.835 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.831+0000 7f82f1d9b700 1 --2- 172.21.15.155:0/1223247287 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f82dc06cc00 0x7f82dc06f0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f82e8000c00 tx=0x7f82e8009e30 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:44.837 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:44.835+0000 7f82e2ffd700 1 -- 172.21.15.155:0/1223247287 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f82e4055f50 con 0x7f82f40fbaf0 2023-12-16T05:58:44.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:44 smithi156 ceph-mon[121001]: pgmap v44: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T05:58:45.046 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:45.044+0000 7f82f8f19700 1 -- 172.21.15.155:0/1223247287 --> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f82f41156c0 con 0x7f82dc06cc00 2023-12-16T05:58:45.047 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:45.045+0000 7f82e2ffd700 1 -- 172.21.15.155:0/1223247287 <== mgr.14646 v2:172.21.15.155:6800/1257988911 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f82f41156c0 con 0x7f82dc06cc00 2023-12-16T05:58:45.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:45.047+0000 7f82f8f19700 1 -- 172.21.15.155:0/1223247287 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f82dc06cc00 msgr2=0x7f82dc06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:45.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:45.047+0000 7f82f8f19700 1 --2- 172.21.15.155:0/1223247287 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f82dc06cc00 0x7f82dc06f0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f82e8000c00 tx=0x7f82e8009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:45.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:45.047+0000 7f82f8f19700 1 -- 172.21.15.155:0/1223247287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82f40fbaf0 msgr2=0x7f82f4112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:45.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:45.047+0000 7f82f8f19700 1 --2- 172.21.15.155:0/1223247287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82f40fbaf0 0x7f82f4112610 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f82e4002a80 tx=0x7f82e4004600 comp rx=0 tx=0).stop 2023-12-16T05:58:45.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:45.047+0000 7f82f8f19700 1 -- 172.21.15.155:0/1223247287 shutdown_connections 2023-12-16T05:58:45.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:45.047+0000 7f82f8f19700 1 --2- 172.21.15.155:0/1223247287 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f82dc06cc00 0x7f82dc06f0b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:45.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:45.047+0000 7f82f8f19700 1 --2- 172.21.15.155:0/1223247287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82f40fbaf0 0x7f82f4112610 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:45.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:45.047+0000 7f82f8f19700 1 --2- 172.21.15.155:0/1223247287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82f40fcd00 0x7f82f4114b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:45.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:45.047+0000 7f82f8f19700 1 -- 172.21.15.155:0/1223247287 >> 172.21.15.155:0/1223247287 conn(0x7f82f40f71b0 msgr2=0x7f82f40fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:45.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:45.047+0000 7f82f8f19700 1 -- 172.21.15.155:0/1223247287 shutdown_connections 2023-12-16T05:58:45.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:45.047+0000 7f82f8f19700 1 -- 172.21.15.155:0/1223247287 wait complete. 2023-12-16T05:58:45.070 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:44 smithi155 ceph-mon[112451]: pgmap v44: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T05:58:45.424 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2023-12-16T05:58:45.694 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:58:46.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.683+0000 7fc4f87a6700 1 -- 172.21.15.155:0/2206996100 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f0101b00 msgr2=0x7fc4f0101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:46.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.683+0000 7fc4f87a6700 1 --2- 172.21.15.155:0/2206996100 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f0101b00 0x7fc4f0101ed0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0004940 tx=0x7fc4e0009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:46.688 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.683+0000 7fc4f87a6700 1 -- 172.21.15.155:0/2206996100 shutdown_connections 2023-12-16T05:58:46.688 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.683+0000 7fc4f87a6700 1 --2- 172.21.15.155:0/2206996100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4f00fbb40 0x7fc4f00fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:46.688 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.683+0000 7fc4f87a6700 1 --2- 172.21.15.155:0/2206996100 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f0101b00 0x7fc4f0101ed0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:46.688 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.683+0000 7fc4f87a6700 1 -- 172.21.15.155:0/2206996100 >> 172.21.15.155:0/2206996100 conn(0x7fc4f00719b0 msgr2=0x7fc4f0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:46.688 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.683+0000 7fc4f87a6700 1 -- 172.21.15.155:0/2206996100 shutdown_connections 2023-12-16T05:58:46.688 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.683+0000 7fc4f87a6700 1 -- 172.21.15.155:0/2206996100 wait complete. 2023-12-16T05:58:46.688 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.683+0000 7fc4f87a6700 1 Processor -- start 2023-12-16T05:58:46.688 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.683+0000 7fc4f87a6700 1 -- start start 2023-12-16T05:58:46.688 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.684+0000 7fc4f87a6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4f00fbb40 0x7fc4f010e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:46.689 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.684+0000 7fc4f87a6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f0101b00 0x7fc4f010ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:46.689 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.684+0000 7fc4f87a6700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f010f1e0 con 0x7fc4f0101b00 2023-12-16T05:58:46.689 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.684+0000 7fc4f87a6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f010f320 con 0x7fc4f00fbb40 2023-12-16T05:58:46.689 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.684+0000 7fc4f5d41700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f0101b00 0x7fc4f010ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:46.689 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.684+0000 7fc4f5d41700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f0101b00 0x7fc4f010ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:35748/0 (socket says 172.21.15.155:35748) 2023-12-16T05:58:46.689 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.684+0000 7fc4f5d41700 1 -- 172.21.15.155:0/2104164909 learned_addr learned my addr 172.21.15.155:0/2104164909 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:58:46.689 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.684+0000 7fc4f6542700 1 --2- 172.21.15.155:0/2104164909 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4f00fbb40 0x7fc4f010e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:46.689 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.684+0000 7fc4f5d41700 1 -- 172.21.15.155:0/2104164909 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4f00fbb40 msgr2=0x7fc4f010e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:46.689 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.684+0000 7fc4f5d41700 1 --2- 172.21.15.155:0/2104164909 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4f00fbb40 0x7fc4f010e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:46.689 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.684+0000 7fc4f5d41700 1 -- 172.21.15.155:0/2104164909 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e0005040 con 0x7fc4f0101b00 2023-12-16T05:58:46.689 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.684+0000 7fc4f5d41700 1 --2- 172.21.15.155:0/2104164909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f0101b00 0x7fc4f010ec50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00c810 tx=0x7fc4ec004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:46.689 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.684+0000 7fc4e6ffd700 1 -- 172.21.15.155:0/2104164909 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4ec012810 con 0x7fc4f0101b00 2023-12-16T05:58:46.689 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.684+0000 7fc4e6ffd700 1 -- 172.21.15.155:0/2104164909 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc4ec012e20 con 0x7fc4f0101b00 2023-12-16T05:58:46.690 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.684+0000 7fc4e6ffd700 1 -- 172.21.15.155:0/2104164909 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4ec0102e0 con 0x7fc4f0101b00 2023-12-16T05:58:46.690 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.684+0000 7fc4f87a6700 1 -- 172.21.15.155:0/2104164909 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f0117680 con 0x7fc4f0101b00 2023-12-16T05:58:46.690 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.684+0000 7fc4f87a6700 1 -- 172.21.15.155:0/2104164909 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f0117b90 con 0x7fc4f0101b00 2023-12-16T05:58:46.691 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.686+0000 7fc4f87a6700 1 -- 172.21.15.155:0/2104164909 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f0103fb0 con 0x7fc4f0101b00 2023-12-16T05:58:46.691 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.686+0000 7fc4e6ffd700 1 -- 172.21.15.155:0/2104164909 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 31) v1 ==== 90903+0+0 (secure 0 0 0) 0x7fc4ec011380 con 0x7fc4f0101b00 2023-12-16T05:58:46.691 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.686+0000 7fc4e6ffd700 1 --2- 172.21.15.155:0/2104164909 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fc4dc06cc00 0x7fc4dc06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:46.691 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.686+0000 7fc4e6ffd700 1 -- 172.21.15.155:0/2104164909 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fc4ec08c210 con 0x7fc4f0101b00 2023-12-16T05:58:46.691 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.686+0000 7fc4f6542700 1 --2- 172.21.15.155:0/2104164909 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fc4dc06cc00 0x7fc4dc06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:46.691 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.687+0000 7fc4f6542700 1 --2- 172.21.15.155:0/2104164909 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fc4dc06cc00 0x7fc4dc06f0b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00043d0 tx=0x7fc4e0009e30 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:46.693 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.691+0000 7fc4e6ffd700 1 -- 172.21.15.155:0/2104164909 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fc4ec056530 con 0x7fc4f0101b00 2023-12-16T05:58:46.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:46 smithi155 ceph-mon[112451]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:58:46.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:46 smithi155 ceph-mon[112451]: pgmap v45: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:58:46.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:46 smithi156 ceph-mon[121001]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:58:46.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:46 smithi156 ceph-mon[121001]: pgmap v45: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:58:46.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.961+0000 7fc4f87a6700 1 -- 172.21.15.155:0/2104164909 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc4f00734d0 con 0x7fc4f0101b00 2023-12-16T05:58:46.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.962+0000 7fc4e6ffd700 1 -- 172.21.15.155:0/2104164909 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fc4ec059b50 con 0x7fc4f0101b00 2023-12-16T05:58:46.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.964+0000 7fc4f87a6700 1 -- 172.21.15.155:0/2104164909 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fc4dc06cc00 msgr2=0x7fc4dc06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:46.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.964+0000 7fc4f87a6700 1 --2- 172.21.15.155:0/2104164909 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fc4dc06cc00 0x7fc4dc06f0b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00043d0 tx=0x7fc4e0009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:46.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.964+0000 7fc4f87a6700 1 -- 172.21.15.155:0/2104164909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f0101b00 msgr2=0x7fc4f010ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:46.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.964+0000 7fc4f87a6700 1 --2- 172.21.15.155:0/2104164909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f0101b00 0x7fc4f010ec50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00c810 tx=0x7fc4ec004470 comp rx=0 tx=0).stop 2023-12-16T05:58:46.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.964+0000 7fc4f87a6700 1 -- 172.21.15.155:0/2104164909 shutdown_connections 2023-12-16T05:58:46.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.964+0000 7fc4f87a6700 1 --2- 172.21.15.155:0/2104164909 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fc4dc06cc00 0x7fc4dc06f0b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:46.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.964+0000 7fc4f87a6700 1 --2- 172.21.15.155:0/2104164909 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4f00fbb40 0x7fc4f010e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:46.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.964+0000 7fc4f87a6700 1 --2- 172.21.15.155:0/2104164909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4f0101b00 0x7fc4f010ec50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:46.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.964+0000 7fc4f87a6700 1 -- 172.21.15.155:0/2104164909 >> 172.21.15.155:0/2104164909 conn(0x7fc4f00719b0 msgr2=0x7fc4f00fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:46.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.964+0000 7fc4f87a6700 1 -- 172.21.15.155:0/2104164909 shutdown_connections 2023-12-16T05:58:46.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:46.964+0000 7fc4f87a6700 1 -- 172.21.15.155:0/2104164909 wait complete. 2023-12-16T05:58:46.977 INFO:teuthology.orchestra.run.smithi155.stdout:true 2023-12-16T05:58:47.358 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2023-12-16T05:58:47.624 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:58:47.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:47 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/2104164909' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:47.940 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:47 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2104164909' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:48.602 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.598+0000 7fc133b08700 1 -- 172.21.15.155:0/3253835300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc12c0fbb30 msgr2=0x7fc12c0fbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:48.602 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.598+0000 7fc133b08700 1 --2- 172.21.15.155:0/3253835300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc12c0fbb30 0x7fc12c0fbfa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc11c004940 tx=0x7fc11c009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:48.602 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.599+0000 7fc133b08700 1 -- 172.21.15.155:0/3253835300 shutdown_connections 2023-12-16T05:58:48.602 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.599+0000 7fc133b08700 1 --2- 172.21.15.155:0/3253835300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc12c0fbb30 0x7fc12c0fbfa0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:48.602 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.599+0000 7fc133b08700 1 --2- 172.21.15.155:0/3253835300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc12c101af0 0x7fc12c101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:48.602 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.599+0000 7fc133b08700 1 -- 172.21.15.155:0/3253835300 >> 172.21.15.155:0/3253835300 conn(0x7fc12c0f7690 msgr2=0x7fc12c0f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:48.602 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.599+0000 7fc133b08700 1 -- 172.21.15.155:0/3253835300 shutdown_connections 2023-12-16T05:58:48.602 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.599+0000 7fc133b08700 1 -- 172.21.15.155:0/3253835300 wait complete. 2023-12-16T05:58:48.604 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.599+0000 7fc133b08700 1 Processor -- start 2023-12-16T05:58:48.604 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.600+0000 7fc133b08700 1 -- start start 2023-12-16T05:58:48.605 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.600+0000 7fc133b08700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc12c0fbb30 0x7fc12c112520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:48.605 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.600+0000 7fc133b08700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc12c101af0 0x7fc12c112a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:48.605 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.600+0000 7fc133b08700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c1130b0 con 0x7fc12c101af0 2023-12-16T05:58:48.605 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.600+0000 7fc133b08700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c10c3e0 con 0x7fc12c0fbb30 2023-12-16T05:58:48.605 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.600+0000 7fc1310a3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc12c101af0 0x7fc12c112a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:48.605 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.600+0000 7fc1310a3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc12c101af0 0x7fc12c112a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:35768/0 (socket says 172.21.15.155:35768) 2023-12-16T05:58:48.605 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.600+0000 7fc1310a3700 1 -- 172.21.15.155:0/4159322239 learned_addr learned my addr 172.21.15.155:0/4159322239 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:58:48.605 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.600+0000 7fc1318a4700 1 --2- 172.21.15.155:0/4159322239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc12c0fbb30 0x7fc12c112520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:48.605 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.600+0000 7fc1310a3700 1 -- 172.21.15.155:0/4159322239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc12c0fbb30 msgr2=0x7fc12c112520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:48.605 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.600+0000 7fc1310a3700 1 --2- 172.21.15.155:0/4159322239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc12c0fbb30 0x7fc12c112520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:48.605 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.600+0000 7fc1310a3700 1 -- 172.21.15.155:0/4159322239 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c005040 con 0x7fc12c101af0 2023-12-16T05:58:48.606 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.600+0000 7fc1310a3700 1 --2- 172.21.15.155:0/4159322239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc12c101af0 0x7fc12c112a60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009fd0 tx=0x7fc11c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:48.606 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.601+0000 7fc1227fc700 1 -- 172.21.15.155:0/4159322239 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc11c00e040 con 0x7fc12c101af0 2023-12-16T05:58:48.606 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.601+0000 7fc1227fc700 1 -- 172.21.15.155:0/4159322239 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc11c013420 con 0x7fc12c101af0 2023-12-16T05:58:48.606 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.601+0000 7fc133b08700 1 -- 172.21.15.155:0/4159322239 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc12c10c660 con 0x7fc12c101af0 2023-12-16T05:58:48.606 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.601+0000 7fc1227fc700 1 -- 172.21.15.155:0/4159322239 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc11c01c630 con 0x7fc12c101af0 2023-12-16T05:58:48.606 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.601+0000 7fc133b08700 1 -- 172.21.15.155:0/4159322239 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12c10cba0 con 0x7fc12c101af0 2023-12-16T05:58:48.606 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.602+0000 7fc133b08700 1 -- 172.21.15.155:0/4159322239 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12c103fa0 con 0x7fc12c101af0 2023-12-16T05:58:48.606 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.602+0000 7fc1227fc700 1 -- 172.21.15.155:0/4159322239 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 31) v1 ==== 90903+0+0 (secure 0 0 0) 0x7fc11c013590 con 0x7fc12c101af0 2023-12-16T05:58:48.607 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.602+0000 7fc1227fc700 1 --2- 172.21.15.155:0/4159322239 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fc11806cc00 0x7fc11806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:48.607 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.602+0000 7fc1227fc700 1 -- 172.21.15.155:0/4159322239 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fc11c08d1b0 con 0x7fc12c101af0 2023-12-16T05:58:48.607 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.602+0000 7fc1318a4700 1 --2- 172.21.15.155:0/4159322239 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fc11806cc00 0x7fc11806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:48.607 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.603+0000 7fc1318a4700 1 --2- 172.21.15.155:0/4159322239 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fc11806cc00 0x7fc11806f0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc128004f40 tx=0x7fc12800b040 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:48.609 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.607+0000 7fc1227fc700 1 -- 172.21.15.155:0/4159322239 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fc11c05aef0 con 0x7fc12c101af0 2023-12-16T05:58:48.882 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.878+0000 7fc133b08700 1 -- 172.21.15.155:0/4159322239 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc12c108aa0 con 0x7fc12c101af0 2023-12-16T05:58:48.882 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.879+0000 7fc1227fc700 1 -- 172.21.15.155:0/4159322239 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fc11c05aa80 con 0x7fc12c101af0 2023-12-16T05:58:48.884 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.881+0000 7fc133b08700 1 -- 172.21.15.155:0/4159322239 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fc11806cc00 msgr2=0x7fc11806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:48.884 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.881+0000 7fc133b08700 1 --2- 172.21.15.155:0/4159322239 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fc11806cc00 0x7fc11806f0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc128004f40 tx=0x7fc12800b040 comp rx=0 tx=0).stop 2023-12-16T05:58:48.884 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.881+0000 7fc133b08700 1 -- 172.21.15.155:0/4159322239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc12c101af0 msgr2=0x7fc12c112a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:48.884 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.881+0000 7fc133b08700 1 --2- 172.21.15.155:0/4159322239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc12c101af0 0x7fc12c112a60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009fd0 tx=0x7fc11c009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:48.884 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.881+0000 7fc133b08700 1 -- 172.21.15.155:0/4159322239 shutdown_connections 2023-12-16T05:58:48.884 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.881+0000 7fc133b08700 1 --2- 172.21.15.155:0/4159322239 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fc11806cc00 0x7fc11806f0b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:48.884 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.881+0000 7fc133b08700 1 --2- 172.21.15.155:0/4159322239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc12c0fbb30 0x7fc12c112520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:48.885 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.881+0000 7fc133b08700 1 --2- 172.21.15.155:0/4159322239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc12c101af0 0x7fc12c112a60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:48.885 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.881+0000 7fc133b08700 1 -- 172.21.15.155:0/4159322239 >> 172.21.15.155:0/4159322239 conn(0x7fc12c0f7690 msgr2=0x7fc12c0f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:48.885 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.881+0000 7fc133b08700 1 -- 172.21.15.155:0/4159322239 shutdown_connections 2023-12-16T05:58:48.885 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:48.881+0000 7fc133b08700 1 -- 172.21.15.155:0/4159322239 wait complete. 2023-12-16T05:58:48.894 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)" 2023-12-16T05:58:48.908 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:48 smithi155 ceph-mon[112451]: pgmap v46: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:58:48.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:48 smithi156 ceph-mon[121001]: pgmap v46: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:58:49.256 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2023-12-16T05:58:49.522 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:58:49.882 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:49 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/4159322239' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:49.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:49 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/4159322239' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:50.586 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.581+0000 7fbbad240700 1 -- 172.21.15.155:0/1030572795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba80fbb40 msgr2=0x7fbba80fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:50.586 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.581+0000 7fbbad240700 1 --2- 172.21.15.155:0/1030572795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba80fbb40 0x7fbba80fbfb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c004940 tx=0x7fbb9c009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:50.586 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.581+0000 7fbbad240700 1 -- 172.21.15.155:0/1030572795 shutdown_connections 2023-12-16T05:58:50.586 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.581+0000 7fbbad240700 1 --2- 172.21.15.155:0/1030572795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba80fbb40 0x7fbba80fbfb0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:50.586 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.581+0000 7fbbad240700 1 --2- 172.21.15.155:0/1030572795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbba8101b00 0x7fbba8101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:50.586 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.581+0000 7fbbad240700 1 -- 172.21.15.155:0/1030572795 >> 172.21.15.155:0/1030572795 conn(0x7fbba80719b0 msgr2=0x7fbba8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:50.586 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.581+0000 7fbbad240700 1 -- 172.21.15.155:0/1030572795 shutdown_connections 2023-12-16T05:58:50.586 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.581+0000 7fbbad240700 1 -- 172.21.15.155:0/1030572795 wait complete. 2023-12-16T05:58:50.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.582+0000 7fbbad240700 1 Processor -- start 2023-12-16T05:58:50.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.582+0000 7fbbad240700 1 -- start start 2023-12-16T05:58:50.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.582+0000 7fbbad240700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba80fbb40 0x7fbba810e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:50.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.582+0000 7fbbad240700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbba8101b00 0x7fbba810ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:50.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.582+0000 7fbbad240700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba810f290 con 0x7fbba80fbb40 2023-12-16T05:58:50.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.582+0000 7fbbad240700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba810f400 con 0x7fbba8101b00 2023-12-16T05:58:50.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.582+0000 7fbba6d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba80fbb40 0x7fbba810e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:50.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.582+0000 7fbba6d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba80fbb40 0x7fbba810e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:35796/0 (socket says 172.21.15.155:35796) 2023-12-16T05:58:50.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.582+0000 7fbba6d9d700 1 -- 172.21.15.155:0/3220693730 learned_addr learned my addr 172.21.15.155:0/3220693730 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:58:50.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.582+0000 7fbba659c700 1 --2- 172.21.15.155:0/3220693730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbba8101b00 0x7fbba810ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:50.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.582+0000 7fbba6d9d700 1 -- 172.21.15.155:0/3220693730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbba8101b00 msgr2=0x7fbba810ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:50.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.582+0000 7fbba6d9d700 1 --2- 172.21.15.155:0/3220693730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbba8101b00 0x7fbba810ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:50.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.582+0000 7fbba6d9d700 1 -- 172.21.15.155:0/3220693730 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c005040 con 0x7fbba80fbb40 2023-12-16T05:58:50.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.582+0000 7fbba659c700 1 --2- 172.21.15.155:0/3220693730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbba8101b00 0x7fbba810ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T05:58:50.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.582+0000 7fbba6d9d700 1 --2- 172.21.15.155:0/3220693730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba80fbb40 0x7fbba810e7a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbb98002a50 tx=0x7fbb980046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:50.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.583+0000 7fbb8f7fe700 1 -- 172.21.15.155:0/3220693730 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb98007cc0 con 0x7fbba80fbb40 2023-12-16T05:58:50.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.583+0000 7fbbad240700 1 -- 172.21.15.155:0/3220693730 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba8117770 con 0x7fbba80fbb40 2023-12-16T05:58:50.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.583+0000 7fbb8f7fe700 1 -- 172.21.15.155:0/3220693730 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbb9800f040 con 0x7fbba80fbb40 2023-12-16T05:58:50.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.583+0000 7fbb8f7fe700 1 -- 172.21.15.155:0/3220693730 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb98009540 con 0x7fbba80fbb40 2023-12-16T05:58:50.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.583+0000 7fbbad240700 1 -- 172.21.15.155:0/3220693730 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba8117c80 con 0x7fbba80fbb40 2023-12-16T05:58:50.589 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.584+0000 7fbbad240700 1 -- 172.21.15.155:0/3220693730 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba8103fb0 con 0x7fbba80fbb40 2023-12-16T05:58:50.589 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.585+0000 7fbb8f7fe700 1 -- 172.21.15.155:0/3220693730 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 31) v1 ==== 90903+0+0 (secure 0 0 0) 0x7fbb980096a0 con 0x7fbba80fbb40 2023-12-16T05:58:50.589 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.585+0000 7fbb8f7fe700 1 --2- 172.21.15.155:0/3220693730 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fbb9006cc00 0x7fbb9006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:50.589 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.585+0000 7fbb8f7fe700 1 -- 172.21.15.155:0/3220693730 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fbb9808c490 con 0x7fbba80fbb40 2023-12-16T05:58:50.589 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.585+0000 7fbba659c700 1 --2- 172.21.15.155:0/3220693730 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fbb9006cc00 0x7fbb9006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:50.589 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.586+0000 7fbba659c700 1 --2- 172.21.15.155:0/3220693730 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fbb9006cc00 0x7fbb9006f0b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c004560 tx=0x7fbb9c009e30 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:50.591 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.589+0000 7fbb8f7fe700 1 -- 172.21.15.155:0/3220693730 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fbb980566a0 con 0x7fbba80fbb40 2023-12-16T05:58:50.862 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.859+0000 7fbbad240700 1 -- 172.21.15.155:0/3220693730 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbba8065b70 con 0x7fbba80fbb40 2023-12-16T05:58:50.862 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.859+0000 7fbb8f7fe700 1 -- 172.21.15.155:0/3220693730 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fbb98059cc0 con 0x7fbba80fbb40 2023-12-16T05:58:50.864 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.862+0000 7fbbad240700 1 -- 172.21.15.155:0/3220693730 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fbb9006cc00 msgr2=0x7fbb9006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:50.864 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.862+0000 7fbbad240700 1 --2- 172.21.15.155:0/3220693730 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fbb9006cc00 0x7fbb9006f0b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c004560 tx=0x7fbb9c009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:50.864 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.862+0000 7fbbad240700 1 -- 172.21.15.155:0/3220693730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba80fbb40 msgr2=0x7fbba810e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:50.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.862+0000 7fbbad240700 1 --2- 172.21.15.155:0/3220693730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba80fbb40 0x7fbba810e7a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbb98002a50 tx=0x7fbb980046b0 comp rx=0 tx=0).stop 2023-12-16T05:58:50.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.862+0000 7fbbad240700 1 -- 172.21.15.155:0/3220693730 shutdown_connections 2023-12-16T05:58:50.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.862+0000 7fbbad240700 1 --2- 172.21.15.155:0/3220693730 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fbb9006cc00 0x7fbb9006f0b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:50.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.862+0000 7fbbad240700 1 --2- 172.21.15.155:0/3220693730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbba80fbb40 0x7fbba810e7a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:50.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.862+0000 7fbbad240700 1 --2- 172.21.15.155:0/3220693730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbba8101b00 0x7fbba810ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:50.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.862+0000 7fbbad240700 1 -- 172.21.15.155:0/3220693730 >> 172.21.15.155:0/3220693730 conn(0x7fbba80719b0 msgr2=0x7fbba80fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:50.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.862+0000 7fbbad240700 1 -- 172.21.15.155:0/3220693730 shutdown_connections 2023-12-16T05:58:50.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:50.862+0000 7fbbad240700 1 -- 172.21.15.155:0/3220693730 wait complete. 2023-12-16T05:58:50.875 INFO:teuthology.orchestra.run.smithi155.stdout:true 2023-12-16T05:58:50.895 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:50 smithi155 ceph-mon[112451]: pgmap v47: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T05:58:50.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:50 smithi156 ceph-mon[121001]: pgmap v47: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T05:58:51.199 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2023-12-16T05:58:51.465 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:58:51.918 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:51 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/3220693730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:51.918 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:51 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:58:51.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:51 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/3220693730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:58:51.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:51 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:58:52.430 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.426+0000 7f018dfa7700 1 -- 172.21.15.155:0/2726318981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0188101b00 msgr2=0x7f0188101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:52.431 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.426+0000 7f018dfa7700 1 --2- 172.21.15.155:0/2726318981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0188101b00 0x7f0188101ed0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0178004940 tx=0x7f0178009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:52.431 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.426+0000 7f018dfa7700 1 -- 172.21.15.155:0/2726318981 shutdown_connections 2023-12-16T05:58:52.431 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.426+0000 7f018dfa7700 1 --2- 172.21.15.155:0/2726318981 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01880fbb40 0x7f01880fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:52.431 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.426+0000 7f018dfa7700 1 --2- 172.21.15.155:0/2726318981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0188101b00 0x7f0188101ed0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:52.431 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.426+0000 7f018dfa7700 1 -- 172.21.15.155:0/2726318981 >> 172.21.15.155:0/2726318981 conn(0x7f01880719b0 msgr2=0x7f0188071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:52.431 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.427+0000 7f018dfa7700 1 -- 172.21.15.155:0/2726318981 shutdown_connections 2023-12-16T05:58:52.431 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.427+0000 7f018dfa7700 1 -- 172.21.15.155:0/2726318981 wait complete. 2023-12-16T05:58:52.431 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.427+0000 7f018dfa7700 1 Processor -- start 2023-12-16T05:58:52.431 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.427+0000 7f018dfa7700 1 -- start start 2023-12-16T05:58:52.431 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.427+0000 7f018dfa7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01880fbb40 0x7f01881136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:52.431 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.427+0000 7f018dfa7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0188101b00 0x7f0188113be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:52.431 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.427+0000 7f018dfa7700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0188114230 con 0x7f01880fbb40 2023-12-16T05:58:52.431 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.427+0000 7f018dfa7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018810d520 con 0x7f0188101b00 2023-12-16T05:58:52.431 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.428+0000 7f01877fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01880fbb40 0x7f01881136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:52.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.428+0000 7f01877fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01880fbb40 0x7f01881136a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:35818/0 (socket says 172.21.15.155:35818) 2023-12-16T05:58:52.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.428+0000 7f01877fe700 1 -- 172.21.15.155:0/3722192886 learned_addr learned my addr 172.21.15.155:0/3722192886 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:58:52.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.428+0000 7f0186ffd700 1 --2- 172.21.15.155:0/3722192886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0188101b00 0x7f0188113be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:52.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.428+0000 7f01877fe700 1 -- 172.21.15.155:0/3722192886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0188101b00 msgr2=0x7f0188113be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:52.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.428+0000 7f01877fe700 1 --2- 172.21.15.155:0/3722192886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0188101b00 0x7f0188113be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:52.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.428+0000 7f01877fe700 1 -- 172.21.15.155:0/3722192886 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0178005040 con 0x7f01880fbb40 2023-12-16T05:58:52.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.428+0000 7f01877fe700 1 --2- 172.21.15.155:0/3722192886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01880fbb40 0x7f01881136a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f017800b3b0 tx=0x7f0178009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:52.433 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.428+0000 7f016ffff700 1 -- 172.21.15.155:0/3722192886 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f017800e040 con 0x7f01880fbb40 2023-12-16T05:58:52.433 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.428+0000 7f016ffff700 1 -- 172.21.15.155:0/3722192886 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f017800bc50 con 0x7f01880fbb40 2023-12-16T05:58:52.433 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.428+0000 7f018dfa7700 1 -- 172.21.15.155:0/3722192886 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f018810d7a0 con 0x7f01880fbb40 2023-12-16T05:58:52.433 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.428+0000 7f016ffff700 1 -- 172.21.15.155:0/3722192886 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0178013420 con 0x7f01880fbb40 2023-12-16T05:58:52.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.428+0000 7f018dfa7700 1 -- 172.21.15.155:0/3722192886 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f018810dce0 con 0x7f01880fbb40 2023-12-16T05:58:52.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.429+0000 7f018dfa7700 1 -- 172.21.15.155:0/3722192886 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0188113350 con 0x7f01880fbb40 2023-12-16T05:58:52.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.430+0000 7f016ffff700 1 -- 172.21.15.155:0/3722192886 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 31) v1 ==== 90903+0+0 (secure 0 0 0) 0x7f017801c430 con 0x7f01880fbb40 2023-12-16T05:58:52.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.430+0000 7f016ffff700 1 --2- 172.21.15.155:0/3722192886 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f017006cc00 0x7f017006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:52.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.430+0000 7f016ffff700 1 -- 172.21.15.155:0/3722192886 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f017808cd10 con 0x7f01880fbb40 2023-12-16T05:58:52.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.430+0000 7f0186ffd700 1 --2- 172.21.15.155:0/3722192886 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f017006cc00 0x7f017006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:52.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.431+0000 7f0186ffd700 1 --2- 172.21.15.155:0/3722192886 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f017006cc00 0x7f017006f0b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f017c007fd0 tx=0x7f017c009040 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:52.437 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.435+0000 7f016ffff700 1 -- 172.21.15.155:0/3722192886 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f017805ab00 con 0x7f01880fbb40 2023-12-16T05:58:52.617 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.614+0000 7f016ffff700 1 -- 172.21.15.155:0/3722192886 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mgrmap(e 32) v1 ==== 90801+0+0 (secure 0 0 0) 0x7f0178092020 con 0x7f01880fbb40 2023-12-16T05:58:52.648 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:52.646+0000 7f018dfa7700 1 -- 172.21.15.155:0/3722192886 --> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "target": ["mon-mgr", ""]}) v1 -- 0x7f018810ec40 con 0x7f017006cc00 2023-12-16T05:58:52.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:52 smithi156 ceph-mon[121001]: pgmap v48: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:58:53.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:52 smithi155 ceph-mon[112451]: pgmap v48: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:58:53.676 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:53 smithi155 ceph-mon[112451]: mgrmap e32: smithi155.maowdn(active, since 91s), standbys: smithi156.pclong 2023-12-16T05:58:53.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:53 smithi156 ceph-mon[121001]: mgrmap e32: smithi155.maowdn(active, since 91s), standbys: smithi156.pclong 2023-12-16T05:58:54.068 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:54.065+0000 7f016ffff700 1 -- 172.21.15.155:0/3722192886 <== mgr.14646 v2:172.21.15.155:6800/1257988911 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5090 (secure 0 0 0) 0x7f018810ec40 con 0x7f017006cc00 2023-12-16T05:58:54.070 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:54.067+0000 7f018dfa7700 1 -- 172.21.15.155:0/3722192886 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f017006cc00 msgr2=0x7f017006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:54.070 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:54.067+0000 7f018dfa7700 1 --2- 172.21.15.155:0/3722192886 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f017006cc00 0x7f017006f0b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f017c007fd0 tx=0x7f017c009040 comp rx=0 tx=0).stop 2023-12-16T05:58:54.070 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:54.067+0000 7f018dfa7700 1 -- 172.21.15.155:0/3722192886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01880fbb40 msgr2=0x7f01881136a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:54.070 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:54.067+0000 7f018dfa7700 1 --2- 172.21.15.155:0/3722192886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01880fbb40 0x7f01881136a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f017800b3b0 tx=0x7f0178009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:54.070 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:54.067+0000 7f018dfa7700 1 -- 172.21.15.155:0/3722192886 shutdown_connections 2023-12-16T05:58:54.070 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:54.067+0000 7f018dfa7700 1 --2- 172.21.15.155:0/3722192886 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f017006cc00 0x7f017006f0b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:54.070 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:54.067+0000 7f018dfa7700 1 --2- 172.21.15.155:0/3722192886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01880fbb40 0x7f01881136a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:54.070 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:54.067+0000 7f018dfa7700 1 --2- 172.21.15.155:0/3722192886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0188101b00 0x7f0188113be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:54.070 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:54.067+0000 7f018dfa7700 1 -- 172.21.15.155:0/3722192886 >> 172.21.15.155:0/3722192886 conn(0x7f01880719b0 msgr2=0x7f01880654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:54.071 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:54.067+0000 7f018dfa7700 1 -- 172.21.15.155:0/3722192886 shutdown_connections 2023-12-16T05:58:54.071 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:54.067+0000 7f018dfa7700 1 -- 172.21.15.155:0/3722192886 wait complete. 2023-12-16T05:58:54.080 INFO:teuthology.orchestra.run.smithi155.stdout:true 2023-12-16T05:58:54.470 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch ps' 2023-12-16T05:58:54.737 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:58:54.880 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:54 smithi155 ceph-mon[112451]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:58:54.881 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:54 smithi155 ceph-mon[112451]: pgmap v49: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-16T05:58:54.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:54 smithi156 ceph-mon[121001]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:58:54.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:54 smithi156 ceph-mon[121001]: pgmap v49: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-16T05:58:55.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.780+0000 7f1895ba9700 1 -- 172.21.15.155:0/2424045683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1890102bf0 msgr2=0x7f1890102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:55.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.780+0000 7f1895ba9700 1 --2- 172.21.15.155:0/2424045683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1890102bf0 0x7f1890102fc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1878004940 tx=0x7f1878009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:55.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.780+0000 7f1895ba9700 1 -- 172.21.15.155:0/2424045683 shutdown_connections 2023-12-16T05:58:55.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.780+0000 7f1895ba9700 1 --2- 172.21.15.155:0/2424045683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1890103590 0x7f18900fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:55.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.780+0000 7f1895ba9700 1 --2- 172.21.15.155:0/2424045683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1890102bf0 0x7f1890102fc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:55.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.780+0000 7f1895ba9700 1 -- 172.21.15.155:0/2424045683 >> 172.21.15.155:0/2424045683 conn(0x7f18900f87a0 msgr2=0x7f18900fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:55.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.780+0000 7f1895ba9700 1 -- 172.21.15.155:0/2424045683 shutdown_connections 2023-12-16T05:58:55.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.780+0000 7f1895ba9700 1 -- 172.21.15.155:0/2424045683 wait complete. 2023-12-16T05:58:55.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.781+0000 7f1895ba9700 1 Processor -- start 2023-12-16T05:58:55.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.781+0000 7f1895ba9700 1 -- start start 2023-12-16T05:58:55.786 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.781+0000 7f1895ba9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1890102bf0 0x7f1890113650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:55.786 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.781+0000 7f1895ba9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1890103590 0x7f1890113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:55.786 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.781+0000 7f1895ba9700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1890114220 con 0x7f1890102bf0 2023-12-16T05:58:55.786 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.781+0000 7f1895ba9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189010d510 con 0x7f1890103590 2023-12-16T05:58:55.786 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.781+0000 7f188f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1890102bf0 0x7f1890113650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:55.786 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.781+0000 7f188f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1890102bf0 0x7f1890113650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:35832/0 (socket says 172.21.15.155:35832) 2023-12-16T05:58:55.786 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.781+0000 7f188f7fe700 1 -- 172.21.15.155:0/15109348 learned_addr learned my addr 172.21.15.155:0/15109348 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:58:55.786 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.781+0000 7f188effd700 1 --2- 172.21.15.155:0/15109348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1890103590 0x7f1890113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:55.786 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.782+0000 7f188f7fe700 1 -- 172.21.15.155:0/15109348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1890103590 msgr2=0x7f1890113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:55.786 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.782+0000 7f188f7fe700 1 --2- 172.21.15.155:0/15109348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1890103590 0x7f1890113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:55.786 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.782+0000 7f188f7fe700 1 -- 172.21.15.155:0/15109348 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1878005040 con 0x7f1890102bf0 2023-12-16T05:58:55.786 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.782+0000 7f188f7fe700 1 --2- 172.21.15.155:0/15109348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1890102bf0 0x7f1890113650 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f187800b3b0 tx=0x7f1878009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:55.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.782+0000 7f1887fff700 1 -- 172.21.15.155:0/15109348 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f187800e040 con 0x7f1890102bf0 2023-12-16T05:58:55.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.782+0000 7f1895ba9700 1 -- 172.21.15.155:0/15109348 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189010d740 con 0x7f1890102bf0 2023-12-16T05:58:55.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.782+0000 7f1887fff700 1 -- 172.21.15.155:0/15109348 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f187801c430 con 0x7f1890102bf0 2023-12-16T05:58:55.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.782+0000 7f1887fff700 1 -- 172.21.15.155:0/15109348 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1878013640 con 0x7f1890102bf0 2023-12-16T05:58:55.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.782+0000 7f1895ba9700 1 -- 172.21.15.155:0/15109348 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f189010dc80 con 0x7f1890102bf0 2023-12-16T05:58:55.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.783+0000 7f1895ba9700 1 -- 172.21.15.155:0/15109348 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18900fff00 con 0x7f1890102bf0 2023-12-16T05:58:55.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.783+0000 7f1887fff700 1 -- 172.21.15.155:0/15109348 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 32) v1 ==== 90801+0+0 (secure 0 0 0) 0x7f187801c5a0 con 0x7f1890102bf0 2023-12-16T05:58:55.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.784+0000 7f1887fff700 1 --2- 172.21.15.155:0/15109348 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f187c06cae0 0x7f187c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:55.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.784+0000 7f1887fff700 1 -- 172.21.15.155:0/15109348 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f187808c890 con 0x7f1890102bf0 2023-12-16T05:58:55.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.784+0000 7f188effd700 1 --2- 172.21.15.155:0/15109348 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f187c06cae0 0x7f187c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:55.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.784+0000 7f188effd700 1 --2- 172.21.15.155:0/15109348 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f187c06cae0 0x7f187c06ef90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f189010eef0 tx=0x7f188000b040 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:55.791 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.788+0000 7f1887fff700 1 -- 172.21.15.155:0/15109348 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f187805a800 con 0x7f1890102bf0 2023-12-16T05:58:55.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:55 smithi156 ceph-mon[121001]: pgmap v50: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2023-12-16T05:58:55.990 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.988+0000 7f1895ba9700 1 -- 172.21.15.155:0/15109348 --> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f189010ec30 con 0x7f187c06cae0 2023-12-16T05:58:56.000 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.997+0000 7f1887fff700 1 -- 172.21.15.155:0/15109348 <== mgr.14646 v2:172.21.15.155:6800/1257988911 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f189010ec30 con 0x7f187c06cae0 2023-12-16T05:58:56.000 INFO:teuthology.orchestra.run.smithi155.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T05:58:56.000 INFO:teuthology.orchestra.run.smithi155.stdout:alertmanager.smithi155 smithi155 *:9093,9094 running (39s) 24s ago 8m 15.6M - 0.25.0 c8568f914cd2 e1da85d6fc09 2023-12-16T05:58:56.000 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi155 smithi155 running (8m) 24s ago 8m 7444k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 033f79f53811 2023-12-16T05:58:56.000 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi156 smithi156 running (7m) 59s ago 7m 7470k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 c72bd1a1d00a 2023-12-16T05:58:56.000 INFO:teuthology.orchestra.run.smithi155.stdout:grafana.smithi155 smithi155 *:3000 running (29s) 24s ago 7m 49.4M - 9.4.12 a0ea5e3c46d9 a16c84704784 2023-12-16T05:58:56.000 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.bzsxjw smithi155 running (4m) 24s ago 4m 4744M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6bcabf94a5c3 2023-12-16T05:58:56.000 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.vicpis smithi155 running (4m) 24s ago 4m 668M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 afa64e1ef8da 2023-12-16T05:58:56.001 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.fasing smithi156 running (4m) 59s ago 4m 532M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 7d97160bda7c 2023-12-16T05:58:56.001 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.qvgmfj smithi156 running (4m) 59s ago 4m 5969M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4018b2f2e27e 2023-12-16T05:58:56.001 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi155.maowdn smithi155 *:8443,9283,8765 running (103s) 24s ago 9m 508M - 19.0.0-191-g6d933094 a29c258b5d6f ee39089d18d3 2023-12-16T05:58:56.001 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi156.pclong smithi156 *:8443,9283,8765 running (78s) 59s ago 7m 449M - 19.0.0-191-g6d933094 a29c258b5d6f 673376e357e8 2023-12-16T05:58:56.001 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi155 smithi155 running (9m) 24s ago 9m 98.9M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 0d0eecfde53b 2023-12-16T05:58:56.001 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi156 smithi156 running (7m) 59s ago 7m 65.0M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 4575acae9bdb 2023-12-16T05:58:56.001 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi155 smithi155 *:9100 running (68s) 24s ago 8m 7822k - 1.5.0 0da6a335fe13 6f0f1f68f191 2023-12-16T05:58:56.001 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi156 smithi156 *:9100 running (63s) 59s ago 7m 4072k - 1.5.0 0da6a335fe13 c4595a7b1707 2023-12-16T05:58:56.001 INFO:teuthology.orchestra.run.smithi155.stdout:osd.0 smithi155 running (6m) 24s ago 6m 781M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 91e650c277f7 2023-12-16T05:58:56.001 INFO:teuthology.orchestra.run.smithi155.stdout:osd.1 smithi155 running (6m) 24s ago 6m 857M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957303cb6598 2023-12-16T05:58:56.001 INFO:teuthology.orchestra.run.smithi155.stdout:osd.2 smithi155 running (6m) 24s ago 6m 625M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957a169c1cac 2023-12-16T05:58:56.001 INFO:teuthology.orchestra.run.smithi155.stdout:osd.3 smithi156 running (5m) 59s ago 5m 939M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c4f6c54afe99 2023-12-16T05:58:56.001 INFO:teuthology.orchestra.run.smithi155.stdout:osd.4 smithi156 running (5m) 59s ago 5m 725M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 6309b12204fd 2023-12-16T05:58:56.001 INFO:teuthology.orchestra.run.smithi155.stdout:osd.5 smithi156 running (5m) 59s ago 5m 839M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 84b2c33eb0e1 2023-12-16T05:58:56.001 INFO:teuthology.orchestra.run.smithi155.stdout:prometheus.smithi155 smithi155 *:9095 running (50s) 24s ago 7m 48.0M - 2.43.0 a07b618ecd1d 26bb7cfc1b8b 2023-12-16T05:58:56.002 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.999+0000 7f1895ba9700 1 -- 172.21.15.155:0/15109348 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f187c06cae0 msgr2=0x7f187c06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:56.002 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.999+0000 7f1895ba9700 1 --2- 172.21.15.155:0/15109348 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f187c06cae0 0x7f187c06ef90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f189010eef0 tx=0x7f188000b040 comp rx=0 tx=0).stop 2023-12-16T05:58:56.002 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.999+0000 7f1895ba9700 1 -- 172.21.15.155:0/15109348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1890102bf0 msgr2=0x7f1890113650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:56.002 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.999+0000 7f1895ba9700 1 --2- 172.21.15.155:0/15109348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1890102bf0 0x7f1890113650 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f187800b3b0 tx=0x7f1878009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:56.002 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.999+0000 7f1895ba9700 1 -- 172.21.15.155:0/15109348 shutdown_connections 2023-12-16T05:58:56.002 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.999+0000 7f1895ba9700 1 --2- 172.21.15.155:0/15109348 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f187c06cae0 0x7f187c06ef90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:56.002 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.999+0000 7f1895ba9700 1 --2- 172.21.15.155:0/15109348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1890102bf0 0x7f1890113650 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:56.003 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.999+0000 7f1895ba9700 1 --2- 172.21.15.155:0/15109348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1890103590 0x7f1890113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:56.003 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:55.999+0000 7f1895ba9700 1 -- 172.21.15.155:0/15109348 >> 172.21.15.155:0/15109348 conn(0x7f18900f87a0 msgr2=0x7f18900fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:56.003 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:56.000+0000 7f1895ba9700 1 -- 172.21.15.155:0/15109348 shutdown_connections 2023-12-16T05:58:56.003 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:56.000+0000 7f1895ba9700 1 -- 172.21.15.155:0/15109348 wait complete. 2023-12-16T05:58:56.031 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:55 smithi155 ceph-mon[112451]: pgmap v50: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2023-12-16T05:58:56.406 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-16T05:58:56.406 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi155.front.sepia.ceph.com 2023-12-16T05:58:56.407 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2023-12-16T05:58:56.675 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:58:56.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:56 smithi156 ceph-mon[121001]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:58:57.016 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:56 smithi155 ceph-mon[112451]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:58:57.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.783+0000 7fe54d1e8700 1 -- 172.21.15.155:0/4200344725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5480fdc60 msgr2=0x7fe5480fe030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:57.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.783+0000 7fe54d1e8700 1 --2- 172.21.15.155:0/4200344725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5480fdc60 0x7fe5480fe030 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe53c004940 tx=0x7fe53c009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:57.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.783+0000 7fe54d1e8700 1 -- 172.21.15.155:0/4200344725 shutdown_connections 2023-12-16T05:58:57.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.783+0000 7fe54d1e8700 1 --2- 172.21.15.155:0/4200344725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5480fe600 0x7fe548106c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:57.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.783+0000 7fe54d1e8700 1 --2- 172.21.15.155:0/4200344725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5480fdc60 0x7fe5480fe030 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:57.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.783+0000 7fe54d1e8700 1 -- 172.21.15.155:0/4200344725 >> 172.21.15.155:0/4200344725 conn(0x7fe5480f7690 msgr2=0x7fe5480f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:57.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.783+0000 7fe54d1e8700 1 -- 172.21.15.155:0/4200344725 shutdown_connections 2023-12-16T05:58:57.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.783+0000 7fe54d1e8700 1 -- 172.21.15.155:0/4200344725 wait complete. 2023-12-16T05:58:57.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.783+0000 7fe54d1e8700 1 Processor -- start 2023-12-16T05:58:57.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.783+0000 7fe54d1e8700 1 -- start start 2023-12-16T05:58:57.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.784+0000 7fe54d1e8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5480fdc60 0x7fe548113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:57.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.784+0000 7fe54d1e8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5480fe600 0x7fe548113c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:57.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.784+0000 7fe54d1e8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe548114260 con 0x7fe5480fe600 2023-12-16T05:58:57.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.784+0000 7fe54d1e8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54810d550 con 0x7fe5480fdc60 2023-12-16T05:58:57.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.784+0000 7fe54659c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5480fe600 0x7fe548113c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:57.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.784+0000 7fe54659c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5480fe600 0x7fe548113c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42418/0 (socket says 172.21.15.155:42418) 2023-12-16T05:58:57.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.784+0000 7fe54659c700 1 -- 172.21.15.155:0/2230538642 learned_addr learned my addr 172.21.15.155:0/2230538642 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:58:57.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.784+0000 7fe546d9d700 1 --2- 172.21.15.155:0/2230538642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5480fdc60 0x7fe548113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:57.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.784+0000 7fe54659c700 1 -- 172.21.15.155:0/2230538642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5480fdc60 msgr2=0x7fe548113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:57.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.784+0000 7fe54659c700 1 --2- 172.21.15.155:0/2230538642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5480fdc60 0x7fe548113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:57.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.784+0000 7fe54659c700 1 -- 172.21.15.155:0/2230538642 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53c005040 con 0x7fe5480fe600 2023-12-16T05:58:57.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.784+0000 7fe54659c700 1 --2- 172.21.15.155:0/2230538642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5480fe600 0x7fe548113c10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe538002a50 tx=0x7fe5380046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:57.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.784+0000 7fe52f7fe700 1 -- 172.21.15.155:0/2230538642 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe538007cc0 con 0x7fe5480fe600 2023-12-16T05:58:57.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.784+0000 7fe52f7fe700 1 -- 172.21.15.155:0/2230538642 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe53800f040 con 0x7fe5480fe600 2023-12-16T05:58:57.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.784+0000 7fe54d1e8700 1 -- 172.21.15.155:0/2230538642 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe54810d7e0 con 0x7fe5480fe600 2023-12-16T05:58:57.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.784+0000 7fe52f7fe700 1 -- 172.21.15.155:0/2230538642 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe53800d9c0 con 0x7fe5480fe600 2023-12-16T05:58:57.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.784+0000 7fe54d1e8700 1 -- 172.21.15.155:0/2230538642 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54810dd20 con 0x7fe5480fe600 2023-12-16T05:58:57.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.786+0000 7fe54d1e8700 1 -- 172.21.15.155:0/2230538642 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe548104250 con 0x7fe5480fe600 2023-12-16T05:58:57.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.786+0000 7fe52f7fe700 1 -- 172.21.15.155:0/2230538642 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 32) v1 ==== 90801+0+0 (secure 0 0 0) 0x7fe53800db60 con 0x7fe5480fe600 2023-12-16T05:58:57.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.786+0000 7fe52f7fe700 1 --2- 172.21.15.155:0/2230538642 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fe53006cae0 0x7fe53006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:58:57.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.786+0000 7fe52f7fe700 1 -- 172.21.15.155:0/2230538642 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe53808b450 con 0x7fe5480fe600 2023-12-16T05:58:57.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.786+0000 7fe546d9d700 1 --2- 172.21.15.155:0/2230538642 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fe53006cae0 0x7fe53006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:58:57.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.787+0000 7fe546d9d700 1 --2- 172.21.15.155:0/2230538642 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fe53006cae0 0x7fe53006ef90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009fd0 tx=0x7fe53c009e30 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:58:57.793 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.791+0000 7fe52f7fe700 1 -- 172.21.15.155:0/2230538642 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fe538059290 con 0x7fe5480fe600 2023-12-16T05:58:57.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:57 smithi156 ceph-mon[121001]: pgmap v51: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2023-12-16T05:58:57.988 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.986+0000 7fe54d1e8700 1 -- 172.21.15.155:0/2230538642 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7fe54804bb80 con 0x7fe5480fe600 2023-12-16T05:58:57.993 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.990+0000 7fe52f7fe700 1 -- 172.21.15.155:0/2230538642 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v47)=0 v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7fe538058e20 con 0x7fe5480fe600 2023-12-16T05:58:57.995 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.992+0000 7fe54d1e8700 1 -- 172.21.15.155:0/2230538642 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fe53006cae0 msgr2=0x7fe53006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:57.995 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.992+0000 7fe54d1e8700 1 --2- 172.21.15.155:0/2230538642 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fe53006cae0 0x7fe53006ef90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009fd0 tx=0x7fe53c009e30 comp rx=0 tx=0).stop 2023-12-16T05:58:57.995 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.992+0000 7fe54d1e8700 1 -- 172.21.15.155:0/2230538642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5480fe600 msgr2=0x7fe548113c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:58:57.995 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.992+0000 7fe54d1e8700 1 --2- 172.21.15.155:0/2230538642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5480fe600 0x7fe548113c10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe538002a50 tx=0x7fe5380046b0 comp rx=0 tx=0).stop 2023-12-16T05:58:57.995 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.993+0000 7fe54d1e8700 1 -- 172.21.15.155:0/2230538642 shutdown_connections 2023-12-16T05:58:57.995 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.993+0000 7fe54d1e8700 1 --2- 172.21.15.155:0/2230538642 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fe53006cae0 0x7fe53006ef90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:57.996 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.993+0000 7fe54d1e8700 1 --2- 172.21.15.155:0/2230538642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5480fdc60 0x7fe548113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:57.996 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.993+0000 7fe54d1e8700 1 --2- 172.21.15.155:0/2230538642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5480fe600 0x7fe548113c10 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:58:57.996 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.993+0000 7fe54d1e8700 1 -- 172.21.15.155:0/2230538642 >> 172.21.15.155:0/2230538642 conn(0x7fe5480f7690 msgr2=0x7fe5481013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:58:57.996 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.993+0000 7fe54d1e8700 1 -- 172.21.15.155:0/2230538642 shutdown_connections 2023-12-16T05:58:57.996 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:58:57.993+0000 7fe54d1e8700 1 -- 172.21.15.155:0/2230538642 wait complete. 2023-12-16T05:58:57.999 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:57 smithi155 ceph-mon[112451]: pgmap v51: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2023-12-16T05:58:58.381 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-16T05:58:58.382 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi155.front.sepia.ceph.com 2023-12-16T05:58:58.382 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-16T05:58:58.668 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:58:59.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:58 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/2230538642' entity='client.admin' 2023-12-16T05:58:59.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:58 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:58:59.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:58 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:58:59.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:58 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:58:59.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:58 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:58:59.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:58 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/2230538642' entity='client.admin' 2023-12-16T05:58:59.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:58 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:58:59.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:58 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:58:59.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:58 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:58:59.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:58 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:00.258 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:58:59 smithi155 ceph-mon[112451]: pgmap v52: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-16T05:59:00.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:58:59 smithi156 ceph-mon[121001]: pgmap v52: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-16T05:59:00.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.451+0000 7fc781ce2700 1 -- 172.21.15.155:0/2366657865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc77c0fbb40 msgr2=0x7fc77c0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:00.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.451+0000 7fc781ce2700 1 --2- 172.21.15.155:0/2366657865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc77c0fbb40 0x7fc77c0fbfb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc76c004940 tx=0x7fc76c009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:00.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.451+0000 7fc781ce2700 1 -- 172.21.15.155:0/2366657865 shutdown_connections 2023-12-16T05:59:00.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.451+0000 7fc781ce2700 1 --2- 172.21.15.155:0/2366657865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc77c0fbb40 0x7fc77c0fbfb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:00.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.451+0000 7fc781ce2700 1 --2- 172.21.15.155:0/2366657865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc77c101b00 0x7fc77c101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:00.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.451+0000 7fc781ce2700 1 -- 172.21.15.155:0/2366657865 >> 172.21.15.155:0/2366657865 conn(0x7fc77c0719b0 msgr2=0x7fc77c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:00.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.451+0000 7fc781ce2700 1 -- 172.21.15.155:0/2366657865 shutdown_connections 2023-12-16T05:59:00.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.451+0000 7fc781ce2700 1 -- 172.21.15.155:0/2366657865 wait complete. 2023-12-16T05:59:00.456 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.452+0000 7fc781ce2700 1 Processor -- start 2023-12-16T05:59:00.456 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.452+0000 7fc781ce2700 1 -- start start 2023-12-16T05:59:00.456 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.452+0000 7fc781ce2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc77c0fbb40 0x7fc77c10e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:00.456 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.452+0000 7fc781ce2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc77c101b00 0x7fc77c10ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:00.456 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.452+0000 7fc781ce2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c10f290 con 0x7fc77c0fbb40 2023-12-16T05:59:00.456 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.452+0000 7fc781ce2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c10f400 con 0x7fc77c101b00 2023-12-16T05:59:00.456 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.452+0000 7fc77b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc77c0fbb40 0x7fc77c10e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:00.456 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.452+0000 7fc77b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc77c0fbb40 0x7fc77c10e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42438/0 (socket says 172.21.15.155:42438) 2023-12-16T05:59:00.456 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.452+0000 7fc77b7fe700 1 -- 172.21.15.155:0/1946612058 learned_addr learned my addr 172.21.15.155:0/1946612058 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:59:00.456 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.452+0000 7fc77affd700 1 --2- 172.21.15.155:0/1946612058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc77c101b00 0x7fc77c10ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:00.456 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.453+0000 7fc77b7fe700 1 -- 172.21.15.155:0/1946612058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc77c101b00 msgr2=0x7fc77c10ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:00.457 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.453+0000 7fc77b7fe700 1 --2- 172.21.15.155:0/1946612058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc77c101b00 0x7fc77c10ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:00.457 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.453+0000 7fc77b7fe700 1 -- 172.21.15.155:0/1946612058 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c005040 con 0x7fc77c0fbb40 2023-12-16T05:59:00.457 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.453+0000 7fc77b7fe700 1 --2- 172.21.15.155:0/1946612058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc77c0fbb40 0x7fc77c10e7a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc770002a50 tx=0x7fc7700046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:00.457 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.453+0000 7fc763fff700 1 -- 172.21.15.155:0/1946612058 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc770007cc0 con 0x7fc77c0fbb40 2023-12-16T05:59:00.457 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.453+0000 7fc781ce2700 1 -- 172.21.15.155:0/1946612058 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77c117770 con 0x7fc77c0fbb40 2023-12-16T05:59:00.457 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.453+0000 7fc763fff700 1 -- 172.21.15.155:0/1946612058 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc77000f040 con 0x7fc77c0fbb40 2023-12-16T05:59:00.457 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.453+0000 7fc763fff700 1 -- 172.21.15.155:0/1946612058 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc770009540 con 0x7fc77c0fbb40 2023-12-16T05:59:00.457 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.453+0000 7fc781ce2700 1 -- 172.21.15.155:0/1946612058 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77c117c80 con 0x7fc77c0fbb40 2023-12-16T05:59:00.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.454+0000 7fc781ce2700 1 -- 172.21.15.155:0/1946612058 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc77c103fb0 con 0x7fc77c0fbb40 2023-12-16T05:59:00.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.454+0000 7fc763fff700 1 -- 172.21.15.155:0/1946612058 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 32) v1 ==== 90801+0+0 (secure 0 0 0) 0x7fc7700096a0 con 0x7fc77c0fbb40 2023-12-16T05:59:00.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.455+0000 7fc763fff700 1 --2- 172.21.15.155:0/1946612058 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fc76406cae0 0x7fc76406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:00.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.455+0000 7fc763fff700 1 -- 172.21.15.155:0/1946612058 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fc77008baa0 con 0x7fc77c0fbb40 2023-12-16T05:59:00.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.455+0000 7fc77affd700 1 --2- 172.21.15.155:0/1946612058 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fc76406cae0 0x7fc76406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:00.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.455+0000 7fc77affd700 1 --2- 172.21.15.155:0/1946612058 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fc76406cae0 0x7fc76406ef90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc76c004f90 tx=0x7fc76c009e30 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:00.462 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.459+0000 7fc763fff700 1 -- 172.21.15.155:0/1946612058 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fc770055ed0 con 0x7fc77c0fbb40 2023-12-16T05:59:00.653 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.651+0000 7fc781ce2700 1 -- 172.21.15.155:0/1946612058 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fc77c0734d0 con 0x7fc77c0fbb40 2023-12-16T05:59:00.654 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.651+0000 7fc763fff700 1 -- 172.21.15.155:0/1946612058 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v47)=0 v47) v1 ==== 155+0+0 (secure 0 0 0) 0x7fc7700594f0 con 0x7fc77c0fbb40 2023-12-16T05:59:00.656 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.653+0000 7fc781ce2700 1 -- 172.21.15.155:0/1946612058 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fc76406cae0 msgr2=0x7fc76406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:00.656 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.653+0000 7fc781ce2700 1 --2- 172.21.15.155:0/1946612058 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fc76406cae0 0x7fc76406ef90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc76c004f90 tx=0x7fc76c009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:00.656 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.653+0000 7fc781ce2700 1 -- 172.21.15.155:0/1946612058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc77c0fbb40 msgr2=0x7fc77c10e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:00.656 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.653+0000 7fc781ce2700 1 --2- 172.21.15.155:0/1946612058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc77c0fbb40 0x7fc77c10e7a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc770002a50 tx=0x7fc7700046b0 comp rx=0 tx=0).stop 2023-12-16T05:59:00.656 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.653+0000 7fc781ce2700 1 -- 172.21.15.155:0/1946612058 shutdown_connections 2023-12-16T05:59:00.656 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.653+0000 7fc781ce2700 1 --2- 172.21.15.155:0/1946612058 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fc76406cae0 0x7fc76406ef90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:00.656 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.653+0000 7fc781ce2700 1 --2- 172.21.15.155:0/1946612058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc77c0fbb40 0x7fc77c10e7a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:00.656 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.653+0000 7fc781ce2700 1 --2- 172.21.15.155:0/1946612058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc77c101b00 0x7fc77c10ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:00.656 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.653+0000 7fc781ce2700 1 -- 172.21.15.155:0/1946612058 >> 172.21.15.155:0/1946612058 conn(0x7fc77c0719b0 msgr2=0x7fc77c0fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:00.656 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.653+0000 7fc781ce2700 1 -- 172.21.15.155:0/1946612058 shutdown_connections 2023-12-16T05:59:00.656 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:00.653+0000 7fc781ce2700 1 -- 172.21.15.155:0/1946612058 wait complete. 2023-12-16T05:59:01.064 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-16T05:59:01.332 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:59:02.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.427+0000 7f74e2615700 1 -- 172.21.15.155:0/1776344571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74dc102c20 msgr2=0x7f74dc102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:02.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.427+0000 7f74e2615700 1 --2- 172.21.15.155:0/1776344571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74dc102c20 0x7f74dc102ff0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f74cc004940 tx=0x7f74cc009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:02.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.427+0000 7f74e2615700 1 -- 172.21.15.155:0/1776344571 shutdown_connections 2023-12-16T05:59:02.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.427+0000 7f74e2615700 1 --2- 172.21.15.155:0/1776344571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74dc065390 0x7f74dc065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:02.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.427+0000 7f74e2615700 1 --2- 172.21.15.155:0/1776344571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74dc102c20 0x7f74dc102ff0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:02.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.427+0000 7f74e2615700 1 -- 172.21.15.155:0/1776344571 >> 172.21.15.155:0/1776344571 conn(0x7f74dc0719b0 msgr2=0x7f74dc071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:02.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.427+0000 7f74e2615700 1 -- 172.21.15.155:0/1776344571 shutdown_connections 2023-12-16T05:59:02.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.428+0000 7f74e2615700 1 -- 172.21.15.155:0/1776344571 wait complete. 2023-12-16T05:59:02.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.428+0000 7f74e2615700 1 Processor -- start 2023-12-16T05:59:02.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.428+0000 7f74e2615700 1 -- start start 2023-12-16T05:59:02.432 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.428+0000 7f74e2615700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74dc065390 0x7f74dc113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:02.433 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.428+0000 7f74e2615700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74dc102c20 0x7f74dc113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:02.433 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.428+0000 7f74e2615700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc114220 con 0x7f74dc065390 2023-12-16T05:59:02.433 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.428+0000 7f74e2615700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc10d570 con 0x7f74dc102c20 2023-12-16T05:59:02.433 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.428+0000 7f74dbfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74dc065390 0x7f74dc113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:02.433 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.428+0000 7f74dbfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74dc065390 0x7f74dc113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42458/0 (socket says 172.21.15.155:42458) 2023-12-16T05:59:02.433 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.428+0000 7f74dbfff700 1 -- 172.21.15.155:0/3410621797 learned_addr learned my addr 172.21.15.155:0/3410621797 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:59:02.433 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.429+0000 7f74dbfff700 1 -- 172.21.15.155:0/3410621797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74dc102c20 msgr2=0x7f74dc113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:02.433 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.429+0000 7f74dbfff700 1 --2- 172.21.15.155:0/3410621797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74dc102c20 0x7f74dc113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:02.433 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.429+0000 7f74dbfff700 1 -- 172.21.15.155:0/3410621797 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc005040 con 0x7f74dc065390 2023-12-16T05:59:02.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.429+0000 7f74dbfff700 1 --2- 172.21.15.155:0/3410621797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74dc065390 0x7f74dc113690 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f74cc009fd0 tx=0x7f74cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:02.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.429+0000 7f74d8ff9700 1 -- 172.21.15.155:0/3410621797 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74cc00e040 con 0x7f74dc065390 2023-12-16T05:59:02.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.429+0000 7f74d8ff9700 1 -- 172.21.15.155:0/3410621797 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f74cc00bc50 con 0x7f74dc065390 2023-12-16T05:59:02.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.429+0000 7f74e2615700 1 -- 172.21.15.155:0/3410621797 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74dc10d7f0 con 0x7f74dc065390 2023-12-16T05:59:02.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.429+0000 7f74d8ff9700 1 -- 172.21.15.155:0/3410621797 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74cc013ea0 con 0x7f74dc065390 2023-12-16T05:59:02.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.429+0000 7f74e2615700 1 -- 172.21.15.155:0/3410621797 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74dc10dd30 con 0x7f74dc065390 2023-12-16T05:59:02.435 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.430+0000 7f74e2615700 1 -- 172.21.15.155:0/3410621797 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74dc0fff40 con 0x7f74dc065390 2023-12-16T05:59:02.435 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.430+0000 7f74d8ff9700 1 -- 172.21.15.155:0/3410621797 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 32) v1 ==== 90801+0+0 (secure 0 0 0) 0x7f74cc013420 con 0x7f74dc065390 2023-12-16T05:59:02.435 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.431+0000 7f74d8ff9700 1 --2- 172.21.15.155:0/3410621797 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f74c406caf0 0x7f74c406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:02.435 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.431+0000 7f74d8ff9700 1 -- 172.21.15.155:0/3410621797 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f74cc08d260 con 0x7f74dc065390 2023-12-16T05:59:02.435 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.431+0000 7f74db7fe700 1 --2- 172.21.15.155:0/3410621797 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f74c406caf0 0x7f74c406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:02.435 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.431+0000 7f74db7fe700 1 --2- 172.21.15.155:0/3410621797 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f74c406caf0 0x7f74c406efa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f74dc10ef70 tx=0x7f74d0007d40 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:02.438 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.435+0000 7f74d8ff9700 1 -- 172.21.15.155:0/3410621797 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f74cc05b120 con 0x7f74dc065390 2023-12-16T05:59:02.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:02 smithi155 ceph-mon[112451]: pgmap v53: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2023-12-16T05:59:02.630 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.627+0000 7f74e2615700 1 -- 172.21.15.155:0/3410621797 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f74dc04bb80 con 0x7f74dc065390 2023-12-16T05:59:02.630 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.627+0000 7f74d8ff9700 1 -- 172.21.15.155:0/3410621797 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v47)=0 v47) v1 ==== 163+0+0 (secure 0 0 0) 0x7f74cc05acb0 con 0x7f74dc065390 2023-12-16T05:59:02.632 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.629+0000 7f74e2615700 1 -- 172.21.15.155:0/3410621797 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f74c406caf0 msgr2=0x7f74c406efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:02.632 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.629+0000 7f74e2615700 1 --2- 172.21.15.155:0/3410621797 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f74c406caf0 0x7f74c406efa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f74dc10ef70 tx=0x7f74d0007d40 comp rx=0 tx=0).stop 2023-12-16T05:59:02.632 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.629+0000 7f74e2615700 1 -- 172.21.15.155:0/3410621797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74dc065390 msgr2=0x7f74dc113690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:02.632 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.629+0000 7f74e2615700 1 --2- 172.21.15.155:0/3410621797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74dc065390 0x7f74dc113690 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f74cc009fd0 tx=0x7f74cc009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:02.632 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.629+0000 7f74e2615700 1 -- 172.21.15.155:0/3410621797 shutdown_connections 2023-12-16T05:59:02.632 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.629+0000 7f74e2615700 1 --2- 172.21.15.155:0/3410621797 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f74c406caf0 0x7f74c406efa0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:02.632 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.629+0000 7f74e2615700 1 --2- 172.21.15.155:0/3410621797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74dc065390 0x7f74dc113690 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:02.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.629+0000 7f74e2615700 1 --2- 172.21.15.155:0/3410621797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74dc102c20 0x7f74dc113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:02.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.629+0000 7f74e2615700 1 -- 172.21.15.155:0/3410621797 >> 172.21.15.155:0/3410621797 conn(0x7f74dc0719b0 msgr2=0x7f74dc0fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:02.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.629+0000 7f74e2615700 1 -- 172.21.15.155:0/3410621797 shutdown_connections 2023-12-16T05:59:02.633 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:02.629+0000 7f74e2615700 1 -- 172.21.15.155:0/3410621797 wait complete. 2023-12-16T05:59:02.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:02 smithi156 ceph-mon[121001]: pgmap v53: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2023-12-16T05:59:03.004 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-16T05:59:03.271 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:59:04.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.251+0000 7f5248d53700 1 -- 172.21.15.155:0/2338778169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52440fbb40 msgr2=0x7f52440fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:04.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.251+0000 7f5248d53700 1 --2- 172.21.15.155:0/2338778169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52440fbb40 0x7f52440fbfb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5234004940 tx=0x7f5234009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:04.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.251+0000 7f5248d53700 1 -- 172.21.15.155:0/2338778169 shutdown_connections 2023-12-16T05:59:04.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.251+0000 7f5248d53700 1 --2- 172.21.15.155:0/2338778169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52440fbb40 0x7f52440fbfb0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:04.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.251+0000 7f5248d53700 1 --2- 172.21.15.155:0/2338778169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5244101b00 0x7f5244101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:04.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.251+0000 7f5248d53700 1 -- 172.21.15.155:0/2338778169 >> 172.21.15.155:0/2338778169 conn(0x7f52440f76c0 msgr2=0x7f52440f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:04.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.251+0000 7f5248d53700 1 -- 172.21.15.155:0/2338778169 shutdown_connections 2023-12-16T05:59:04.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.251+0000 7f5248d53700 1 -- 172.21.15.155:0/2338778169 wait complete. 2023-12-16T05:59:04.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.252+0000 7f5248d53700 1 Processor -- start 2023-12-16T05:59:04.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.252+0000 7f5248d53700 1 -- start start 2023-12-16T05:59:04.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.252+0000 7f5248d53700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52440fbb40 0x7f5244112500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:04.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.252+0000 7f5248d53700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5244101b00 0x7f5244112a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:04.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.252+0000 7f5248d53700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5244113090 con 0x7f5244101b00 2023-12-16T05:59:04.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.252+0000 7f5248d53700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524410c3c0 con 0x7f52440fbb40 2023-12-16T05:59:04.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.252+0000 7f5241d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5244101b00 0x7f5244112a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:04.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.252+0000 7f5241d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5244101b00 0x7f5244112a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42480/0 (socket says 172.21.15.155:42480) 2023-12-16T05:59:04.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.252+0000 7f5241d9b700 1 -- 172.21.15.155:0/3475264915 learned_addr learned my addr 172.21.15.155:0/3475264915 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:59:04.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.252+0000 7f524259c700 1 --2- 172.21.15.155:0/3475264915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52440fbb40 0x7f5244112500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:04.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.252+0000 7f5241d9b700 1 -- 172.21.15.155:0/3475264915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52440fbb40 msgr2=0x7f5244112500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:04.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.252+0000 7f5241d9b700 1 --2- 172.21.15.155:0/3475264915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52440fbb40 0x7f5244112500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:04.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.252+0000 7f5241d9b700 1 -- 172.21.15.155:0/3475264915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5234005040 con 0x7f5244101b00 2023-12-16T05:59:04.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.252+0000 7f5241d9b700 1 --2- 172.21.15.155:0/3475264915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5244101b00 0x7f5244112a40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5234000c00 tx=0x7f5234009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:04.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.253+0000 7f5232ffd700 1 -- 172.21.15.155:0/3475264915 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5234021070 con 0x7f5244101b00 2023-12-16T05:59:04.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.253+0000 7f5232ffd700 1 -- 172.21.15.155:0/3475264915 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f523401c400 con 0x7f5244101b00 2023-12-16T05:59:04.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.253+0000 7f5248d53700 1 -- 172.21.15.155:0/3475264915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524410c580 con 0x7f5244101b00 2023-12-16T05:59:04.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.253+0000 7f5232ffd700 1 -- 172.21.15.155:0/3475264915 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f523400e070 con 0x7f5244101b00 2023-12-16T05:59:04.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.253+0000 7f5248d53700 1 -- 172.21.15.155:0/3475264915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524410ca90 con 0x7f5244101b00 2023-12-16T05:59:04.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.253+0000 7f5248d53700 1 -- 172.21.15.155:0/3475264915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52440fb2c0 con 0x7f5244101b00 2023-12-16T05:59:04.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.254+0000 7f5232ffd700 1 -- 172.21.15.155:0/3475264915 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 32) v1 ==== 90801+0+0 (secure 0 0 0) 0x7f523401c970 con 0x7f5244101b00 2023-12-16T05:59:04.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.254+0000 7f5232ffd700 1 --2- 172.21.15.155:0/3475264915 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f522c06cae0 0x7f522c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:04.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.254+0000 7f5232ffd700 1 -- 172.21.15.155:0/3475264915 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f523408ce90 con 0x7f5244101b00 2023-12-16T05:59:04.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.254+0000 7f524259c700 1 --2- 172.21.15.155:0/3475264915 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f522c06cae0 0x7f522c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:04.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.255+0000 7f524259c700 1 --2- 172.21.15.155:0/3475264915 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f522c06cae0 0x7f522c06ef90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5238009b80 tx=0x7f523800b040 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:04.261 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.259+0000 7f5232ffd700 1 -- 172.21.15.155:0/3475264915 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f523405ad50 con 0x7f5244101b00 2023-12-16T05:59:04.457 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.454+0000 7f5248d53700 1 -- 172.21.15.155:0/3475264915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f524404bb80 con 0x7f5244101b00 2023-12-16T05:59:04.457 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.454+0000 7f5232ffd700 1 -- 172.21.15.155:0/3475264915 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v47)=0 v47) v1 ==== 135+0+0 (secure 0 0 0) 0x7f523405a8e0 con 0x7f5244101b00 2023-12-16T05:59:04.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.456+0000 7f5248d53700 1 -- 172.21.15.155:0/3475264915 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f522c06cae0 msgr2=0x7f522c06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:04.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.456+0000 7f5248d53700 1 --2- 172.21.15.155:0/3475264915 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f522c06cae0 0x7f522c06ef90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5238009b80 tx=0x7f523800b040 comp rx=0 tx=0).stop 2023-12-16T05:59:04.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.456+0000 7f5248d53700 1 -- 172.21.15.155:0/3475264915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5244101b00 msgr2=0x7f5244112a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:04.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.456+0000 7f5248d53700 1 --2- 172.21.15.155:0/3475264915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5244101b00 0x7f5244112a40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5234000c00 tx=0x7f5234009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:04.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.456+0000 7f5248d53700 1 -- 172.21.15.155:0/3475264915 shutdown_connections 2023-12-16T05:59:04.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.456+0000 7f5248d53700 1 --2- 172.21.15.155:0/3475264915 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f522c06cae0 0x7f522c06ef90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:04.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.456+0000 7f5248d53700 1 --2- 172.21.15.155:0/3475264915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52440fbb40 0x7f5244112500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:04.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.456+0000 7f5248d53700 1 --2- 172.21.15.155:0/3475264915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5244101b00 0x7f5244112a40 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:04.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.456+0000 7f5248d53700 1 -- 172.21.15.155:0/3475264915 >> 172.21.15.155:0/3475264915 conn(0x7f52440f76c0 msgr2=0x7f52440f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:04.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.456+0000 7f5248d53700 1 -- 172.21.15.155:0/3475264915 shutdown_connections 2023-12-16T05:59:04.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:04.457+0000 7f5248d53700 1 -- 172.21.15.155:0/3475264915 wait complete. 2023-12-16T05:59:04.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:04 smithi156 ceph-mon[121001]: pgmap v54: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-16T05:59:04.777 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:04 smithi155 ceph-mon[112451]: pgmap v54: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-16T05:59:04.837 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2023-12-16T05:59:05.104 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:59:06.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.153+0000 7f6f6b59e700 1 -- 172.21.15.155:0/2405265120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f6c102a90 msgr2=0x7f6f6c102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:06.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.153+0000 7f6f6b59e700 1 --2- 172.21.15.155:0/2405265120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f6c102a90 0x7f6f6c102e60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6f60004940 tx=0x7f6f60009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:06.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.153+0000 7f6f6b59e700 1 -- 172.21.15.155:0/2405265120 shutdown_connections 2023-12-16T05:59:06.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.153+0000 7f6f6b59e700 1 --2- 172.21.15.155:0/2405265120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f6c0fca50 0x7f6f6c0fcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:06.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.153+0000 7f6f6b59e700 1 --2- 172.21.15.155:0/2405265120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f6c102a90 0x7f6f6c102e60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:06.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.153+0000 7f6f6b59e700 1 -- 172.21.15.155:0/2405265120 >> 172.21.15.155:0/2405265120 conn(0x7f6f6c0f85f0 msgr2=0x7f6f6c0faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:06.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.153+0000 7f6f6b59e700 1 -- 172.21.15.155:0/2405265120 shutdown_connections 2023-12-16T05:59:06.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.153+0000 7f6f6b59e700 1 -- 172.21.15.155:0/2405265120 wait complete. 2023-12-16T05:59:06.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.153+0000 7f6f6b59e700 1 Processor -- start 2023-12-16T05:59:06.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.153+0000 7f6f6b59e700 1 -- start start 2023-12-16T05:59:06.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.154+0000 7f6f6b59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f6c0fca50 0x7f6f6c1133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:06.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.154+0000 7f6f6b59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f6c102a90 0x7f6f6c113910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:06.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.154+0000 7f6f6b59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c113f60 con 0x7f6f6c0fca50 2023-12-16T05:59:06.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.154+0000 7f6f6b59e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c10d2b0 con 0x7f6f6c102a90 2023-12-16T05:59:06.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.154+0000 7f6f6a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f6c0fca50 0x7f6f6c1133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:06.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.154+0000 7f6f6a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f6c0fca50 0x7f6f6c1133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:42488/0 (socket says 172.21.15.155:42488) 2023-12-16T05:59:06.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.154+0000 7f6f6a59c700 1 -- 172.21.15.155:0/1648211667 learned_addr learned my addr 172.21.15.155:0/1648211667 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:59:06.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.154+0000 7f6f69d9b700 1 --2- 172.21.15.155:0/1648211667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f6c102a90 0x7f6f6c113910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:06.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.154+0000 7f6f6a59c700 1 -- 172.21.15.155:0/1648211667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f6c102a90 msgr2=0x7f6f6c113910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:06.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.154+0000 7f6f6a59c700 1 --2- 172.21.15.155:0/1648211667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f6c102a90 0x7f6f6c113910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:06.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.154+0000 7f6f6a59c700 1 -- 172.21.15.155:0/1648211667 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f60005040 con 0x7f6f6c0fca50 2023-12-16T05:59:06.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.154+0000 7f6f6a59c700 1 --2- 172.21.15.155:0/1648211667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f6c0fca50 0x7f6f6c1133d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000b3b0 tx=0x7f6f60009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:06.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.154+0000 7f6f5affd700 1 -- 172.21.15.155:0/1648211667 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f6000e040 con 0x7f6f6c0fca50 2023-12-16T05:59:06.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.154+0000 7f6f5affd700 1 -- 172.21.15.155:0/1648211667 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6f6000bc50 con 0x7f6f6c0fca50 2023-12-16T05:59:06.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.154+0000 7f6f5affd700 1 -- 172.21.15.155:0/1648211667 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f60013420 con 0x7f6f6c0fca50 2023-12-16T05:59:06.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.154+0000 7f6f6b59e700 1 -- 172.21.15.155:0/1648211667 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6c10d530 con 0x7f6f6c0fca50 2023-12-16T05:59:06.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.155+0000 7f6f6b59e700 1 -- 172.21.15.155:0/1648211667 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6c10daf0 con 0x7f6f6c0fca50 2023-12-16T05:59:06.160 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.156+0000 7f6f6b59e700 1 -- 172.21.15.155:0/1648211667 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f6c104f10 con 0x7f6f6c0fca50 2023-12-16T05:59:06.160 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.156+0000 7f6f5affd700 1 -- 172.21.15.155:0/1648211667 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 32) v1 ==== 90801+0+0 (secure 0 0 0) 0x7f6f6001c430 con 0x7f6f6c0fca50 2023-12-16T05:59:06.160 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.156+0000 7f6f5affd700 1 --2- 172.21.15.155:0/1648211667 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f6f5406cae0 0x7f6f5406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:06.160 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.156+0000 7f6f5affd700 1 -- 172.21.15.155:0/1648211667 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f6f6008ca60 con 0x7f6f6c0fca50 2023-12-16T05:59:06.160 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.156+0000 7f6f69d9b700 1 --2- 172.21.15.155:0/1648211667 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f6f5406cae0 0x7f6f5406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:06.160 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.157+0000 7f6f69d9b700 1 --2- 172.21.15.155:0/1648211667 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f6f5406cae0 0x7f6f5406ef90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c007fd0 tx=0x7f6f5c009040 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:06.163 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.161+0000 7f6f5affd700 1 -- 172.21.15.155:0/1648211667 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f6f60056fe0 con 0x7f6f6c0fca50 2023-12-16T05:59:06.375 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.373+0000 7f6f6b59e700 1 -- 172.21.15.155:0/1648211667 --> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f6c10e9f0 con 0x7f6f5406cae0 2023-12-16T05:59:06.381 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.378+0000 7f6f5affd700 1 -- 172.21.15.155:0/1648211667 <== mgr.14646 v2:172.21.15.155:6800/1257988911 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f6f6c10e9f0 con 0x7f6f5406cae0 2023-12-16T05:59:06.381 INFO:teuthology.orchestra.run.smithi155.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T05:59:06.383 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.381+0000 7f6f6b59e700 1 -- 172.21.15.155:0/1648211667 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f6f5406cae0 msgr2=0x7f6f5406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:06.383 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.381+0000 7f6f6b59e700 1 --2- 172.21.15.155:0/1648211667 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f6f5406cae0 0x7f6f5406ef90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c007fd0 tx=0x7f6f5c009040 comp rx=0 tx=0).stop 2023-12-16T05:59:06.384 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.381+0000 7f6f6b59e700 1 -- 172.21.15.155:0/1648211667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f6c0fca50 msgr2=0x7f6f6c1133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:06.384 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.381+0000 7f6f6b59e700 1 --2- 172.21.15.155:0/1648211667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f6c0fca50 0x7f6f6c1133d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000b3b0 tx=0x7f6f60009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:06.384 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.381+0000 7f6f6b59e700 1 -- 172.21.15.155:0/1648211667 shutdown_connections 2023-12-16T05:59:06.384 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.381+0000 7f6f6b59e700 1 --2- 172.21.15.155:0/1648211667 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f6f5406cae0 0x7f6f5406ef90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:06.384 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.381+0000 7f6f6b59e700 1 --2- 172.21.15.155:0/1648211667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f6c0fca50 0x7f6f6c1133d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:06.384 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.381+0000 7f6f6b59e700 1 --2- 172.21.15.155:0/1648211667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f6c102a90 0x7f6f6c113910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:06.384 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.381+0000 7f6f6b59e700 1 -- 172.21.15.155:0/1648211667 >> 172.21.15.155:0/1648211667 conn(0x7f6f6c0f85f0 msgr2=0x7f6f6c0fa080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:06.384 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.381+0000 7f6f6b59e700 1 -- 172.21.15.155:0/1648211667 shutdown_connections 2023-12-16T05:59:06.384 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:06.381+0000 7f6f6b59e700 1 -- 172.21.15.155:0/1648211667 wait complete. 2023-12-16T05:59:06.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:06 smithi156 ceph-mon[121001]: pgmap v55: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:59:06.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:06 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:06.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:06 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:59:06.711 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:06 smithi155 ceph-mon[112451]: pgmap v55: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:59:06.711 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:06 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:06.711 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:06 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:59:06.755 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-16T05:59:06.756 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi155.front.sepia.ceph.com 2023-12-16T05:59:06.756 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2023-12-16T05:59:07.035 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T05:59:07.529 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:07 smithi155 ceph-mon[112451]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:59:07.529 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:07 smithi155 ceph-mon[112451]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T05:59:07.529 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:07 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:59:07.529 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:07 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:07.529 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:07 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:59:07.529 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:07 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:07.529 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:07 smithi155 ceph-mon[112451]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T05:59:07.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:07 smithi156 ceph-mon[121001]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:59:07.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:07 smithi156 ceph-mon[121001]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T05:59:07.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:07 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:59:07.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:07 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:07.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:07 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:59:07.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:07 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:07.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:07 smithi156 ceph-mon[121001]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T05:59:08.426 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:08 smithi155 ceph-mon[112451]: pgmap v56: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:59:08.426 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:08 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:08.426 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:08 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:59:08.427 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:08 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:59:08.427 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:08 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:08.427 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:08 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-16T05:59:08.532 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.530+0000 7fe4a68a9700 1 -- 172.21.15.155:0/3367109867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a00fe5c0 msgr2=0x7fe4a0106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:08.532 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.530+0000 7fe4a68a9700 1 --2- 172.21.15.155:0/3367109867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a00fe5c0 0x7fe4a0106c90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe494004970 tx=0x7fe494009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:08.533 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.530+0000 7fe4a68a9700 1 -- 172.21.15.155:0/3367109867 shutdown_connections 2023-12-16T05:59:08.533 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.530+0000 7fe4a68a9700 1 --2- 172.21.15.155:0/3367109867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a00fe5c0 0x7fe4a0106c90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:08.533 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.530+0000 7fe4a68a9700 1 --2- 172.21.15.155:0/3367109867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a00fdc20 0x7fe4a00fdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:08.533 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.530+0000 7fe4a68a9700 1 -- 172.21.15.155:0/3367109867 >> 172.21.15.155:0/3367109867 conn(0x7fe4a00f76c0 msgr2=0x7fe4a00f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:08.533 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.530+0000 7fe4a68a9700 1 -- 172.21.15.155:0/3367109867 shutdown_connections 2023-12-16T05:59:08.533 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.530+0000 7fe4a68a9700 1 -- 172.21.15.155:0/3367109867 wait complete. 2023-12-16T05:59:08.534 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.530+0000 7fe4a68a9700 1 Processor -- start 2023-12-16T05:59:08.535 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.531+0000 7fe4a68a9700 1 -- start start 2023-12-16T05:59:08.535 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.531+0000 7fe4a68a9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a00fdc20 0x7fe4a01135a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:08.535 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.531+0000 7fe4a68a9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a00fe5c0 0x7fe4a0113ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:08.535 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.531+0000 7fe4a68a9700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a0114130 con 0x7fe4a00fdc20 2023-12-16T05:59:08.535 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.531+0000 7fe4a68a9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a010d4d0 con 0x7fe4a00fe5c0 2023-12-16T05:59:08.535 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.531+0000 7fe49ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a00fdc20 0x7fe4a01135a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:08.535 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.531+0000 7fe49ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a00fdc20 0x7fe4a01135a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:47648/0 (socket says 172.21.15.155:47648) 2023-12-16T05:59:08.535 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.531+0000 7fe49ffff700 1 -- 172.21.15.155:0/1880697246 learned_addr learned my addr 172.21.15.155:0/1880697246 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:59:08.535 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.531+0000 7fe49ffff700 1 -- 172.21.15.155:0/1880697246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a00fe5c0 msgr2=0x7fe4a0113ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:08.535 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.531+0000 7fe49ffff700 1 --2- 172.21.15.155:0/1880697246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a00fe5c0 0x7fe4a0113ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:08.535 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.531+0000 7fe49ffff700 1 -- 172.21.15.155:0/1880697246 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe494005040 con 0x7fe4a00fdc20 2023-12-16T05:59:08.535 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.531+0000 7fe49ffff700 1 --2- 172.21.15.155:0/1880697246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a00fdc20 0x7fe4a01135a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe49000c8c0 tx=0x7fe4900044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:08.535 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.532+0000 7fe49cff9700 1 -- 172.21.15.155:0/1880697246 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe49000a980 con 0x7fe4a00fdc20 2023-12-16T05:59:08.536 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.532+0000 7fe4a68a9700 1 -- 172.21.15.155:0/1880697246 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a010d7b0 con 0x7fe4a00fdc20 2023-12-16T05:59:08.536 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.532+0000 7fe49cff9700 1 -- 172.21.15.155:0/1880697246 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe49000ce60 con 0x7fe4a00fdc20 2023-12-16T05:59:08.536 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.532+0000 7fe49cff9700 1 -- 172.21.15.155:0/1880697246 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4900113a0 con 0x7fe4a00fdc20 2023-12-16T05:59:08.536 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.532+0000 7fe4a68a9700 1 -- 172.21.15.155:0/1880697246 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a010dcf0 con 0x7fe4a00fdc20 2023-12-16T05:59:08.537 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.533+0000 7fe4a68a9700 1 -- 172.21.15.155:0/1880697246 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a0104350 con 0x7fe4a00fdc20 2023-12-16T05:59:08.537 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.533+0000 7fe49cff9700 1 -- 172.21.15.155:0/1880697246 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 32) v1 ==== 90801+0+0 (secure 0 0 0) 0x7fe490011500 con 0x7fe4a00fdc20 2023-12-16T05:59:08.537 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.534+0000 7fe49cff9700 1 --2- 172.21.15.155:0/1880697246 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fe48806cae0 0x7fe48806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:08.537 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.534+0000 7fe49cff9700 1 -- 172.21.15.155:0/1880697246 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe49008beb0 con 0x7fe4a00fdc20 2023-12-16T05:59:08.537 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.534+0000 7fe49f7fe700 1 --2- 172.21.15.155:0/1880697246 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fe48806cae0 0x7fe48806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:08.537 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.534+0000 7fe49f7fe700 1 --2- 172.21.15.155:0/1880697246 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fe48806cae0 0x7fe48806ef90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe494009fd0 tx=0x7fe494009e30 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:08.541 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.538+0000 7fe49cff9700 1 -- 172.21.15.155:0/1880697246 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fe490059ec0 con 0x7fe4a00fdc20 2023-12-16T05:59:08.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:08 smithi156 ceph-mon[121001]: pgmap v56: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:59:08.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:08 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:08.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:08 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:59:08.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:08 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:59:08.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:08 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:08.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:08 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-16T05:59:08.778 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.775+0000 7fe4a68a9700 1 -- 172.21.15.155:0/1880697246 --> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4a0109bc0 con 0x7fe48806cae0 2023-12-16T05:59:08.779 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.777+0000 7fe49cff9700 1 -- 172.21.15.155:0/1880697246 <== mgr.14646 v2:172.21.15.155:6800/1257988911 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fe4a0109bc0 con 0x7fe48806cae0 2023-12-16T05:59:08.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.779+0000 7fe4a68a9700 1 -- 172.21.15.155:0/1880697246 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fe48806cae0 msgr2=0x7fe48806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:08.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.779+0000 7fe4a68a9700 1 --2- 172.21.15.155:0/1880697246 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fe48806cae0 0x7fe48806ef90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe494009fd0 tx=0x7fe494009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:08.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.779+0000 7fe4a68a9700 1 -- 172.21.15.155:0/1880697246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a00fdc20 msgr2=0x7fe4a01135a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:08.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.779+0000 7fe4a68a9700 1 --2- 172.21.15.155:0/1880697246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a00fdc20 0x7fe4a01135a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe49000c8c0 tx=0x7fe4900044c0 comp rx=0 tx=0).stop 2023-12-16T05:59:08.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.779+0000 7fe4a68a9700 1 -- 172.21.15.155:0/1880697246 shutdown_connections 2023-12-16T05:59:08.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.779+0000 7fe4a68a9700 1 --2- 172.21.15.155:0/1880697246 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7fe48806cae0 0x7fe48806ef90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:08.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.779+0000 7fe4a68a9700 1 --2- 172.21.15.155:0/1880697246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a00fdc20 0x7fe4a01135a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:08.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.779+0000 7fe4a68a9700 1 --2- 172.21.15.155:0/1880697246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a00fe5c0 0x7fe4a0113ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:08.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.779+0000 7fe4a68a9700 1 -- 172.21.15.155:0/1880697246 >> 172.21.15.155:0/1880697246 conn(0x7fe4a00f76c0 msgr2=0x7fe4a01014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:08.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.779+0000 7fe4a68a9700 1 -- 172.21.15.155:0/1880697246 shutdown_connections 2023-12-16T05:59:08.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.779+0000 7fe4a68a9700 1 -- 172.21.15.155:0/1880697246 wait complete. 2023-12-16T05:59:08.796 INFO:teuthology.orchestra.run.smithi155.stdout:true 2023-12-16T05:59:08.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.888+0000 7f5c16521700 1 -- 172.21.15.155:0/2776897443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c10102c70 msgr2=0x7f5c10103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:08.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.888+0000 7f5c16521700 1 --2- 172.21.15.155:0/2776897443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c10102c70 0x7f5c10103040 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5c04004940 tx=0x7f5c04009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:08.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.888+0000 7f5c16521700 1 -- 172.21.15.155:0/2776897443 shutdown_connections 2023-12-16T05:59:08.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.888+0000 7f5c16521700 1 --2- 172.21.15.155:0/2776897443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c100fb1e0 0x7f5c100fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:08.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.888+0000 7f5c16521700 1 --2- 172.21.15.155:0/2776897443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c10102c70 0x7f5c10103040 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:08.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.888+0000 7f5c16521700 1 -- 172.21.15.155:0/2776897443 >> 172.21.15.155:0/2776897443 conn(0x7f5c100711a0 msgr2=0x7f5c100715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:08.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.888+0000 7f5c16521700 1 -- 172.21.15.155:0/2776897443 shutdown_connections 2023-12-16T05:59:08.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.889+0000 7f5c16521700 1 -- 172.21.15.155:0/2776897443 wait complete. 2023-12-16T05:59:08.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.889+0000 7f5c16521700 1 Processor -- start 2023-12-16T05:59:08.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.889+0000 7f5c16521700 1 -- start start 2023-12-16T05:59:08.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.889+0000 7f5c16521700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c100fb1e0 0x7f5c100fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:08.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.889+0000 7f5c16521700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c10102c70 0x7f5c100fc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:08.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.889+0000 7f5c16521700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100fcf00 con 0x7f5c100fb1e0 2023-12-16T05:59:08.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.889+0000 7f5c16521700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100fd070 con 0x7f5c10102c70 2023-12-16T05:59:08.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.890+0000 7f5c0ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c100fb1e0 0x7f5c100fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:08.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.890+0000 7f5c0ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c100fb1e0 0x7f5c100fc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:47668/0 (socket says 172.21.15.155:47668) 2023-12-16T05:59:08.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.890+0000 7f5c0ffff700 1 -- 172.21.15.155:0/3836477578 learned_addr learned my addr 172.21.15.155:0/3836477578 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:59:08.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.890+0000 7f5c0f7fe700 1 --2- 172.21.15.155:0/3836477578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c10102c70 0x7f5c100fc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:08.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.890+0000 7f5c0ffff700 1 -- 172.21.15.155:0/3836477578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c10102c70 msgr2=0x7f5c100fc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:08.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.890+0000 7f5c0ffff700 1 --2- 172.21.15.155:0/3836477578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c10102c70 0x7f5c100fc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:08.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.890+0000 7f5c0ffff700 1 -- 172.21.15.155:0/3836477578 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c04005040 con 0x7f5c100fb1e0 2023-12-16T05:59:08.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.890+0000 7f5c0f7fe700 1 --2- 172.21.15.155:0/3836477578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c10102c70 0x7f5c100fc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T05:59:08.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.890+0000 7f5c0ffff700 1 --2- 172.21.15.155:0/3836477578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c100fb1e0 0x7f5c100fc3c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5c04009180 tx=0x7f5c04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:08.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.890+0000 7f5c0cff9700 1 -- 172.21.15.155:0/3836477578 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c0400e040 con 0x7f5c100fb1e0 2023-12-16T05:59:08.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.890+0000 7f5c0cff9700 1 -- 172.21.15.155:0/3836477578 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5c04013420 con 0x7f5c100fb1e0 2023-12-16T05:59:08.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.890+0000 7f5c16521700 1 -- 172.21.15.155:0/3836477578 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c101197b0 con 0x7f5c100fb1e0 2023-12-16T05:59:08.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.890+0000 7f5c0cff9700 1 -- 172.21.15.155:0/3836477578 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c0401c630 con 0x7f5c100fb1e0 2023-12-16T05:59:08.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.890+0000 7f5c16521700 1 -- 172.21.15.155:0/3836477578 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c10119c10 con 0x7f5c100fb1e0 2023-12-16T05:59:08.895 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.891+0000 7f5c16521700 1 -- 172.21.15.155:0/3836477578 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c10072cc0 con 0x7f5c100fb1e0 2023-12-16T05:59:08.895 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.892+0000 7f5c0cff9700 1 -- 172.21.15.155:0/3836477578 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 32) v1 ==== 90801+0+0 (secure 0 0 0) 0x7f5c040139e0 con 0x7f5c100fb1e0 2023-12-16T05:59:08.895 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.892+0000 7f5c0cff9700 1 --2- 172.21.15.155:0/3836477578 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f5bf806cae0 0x7f5bf806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:08.895 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.892+0000 7f5c0cff9700 1 -- 172.21.15.155:0/3836477578 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f5c0408d0d0 con 0x7f5c100fb1e0 2023-12-16T05:59:08.896 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.892+0000 7f5c0f7fe700 1 --2- 172.21.15.155:0/3836477578 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f5bf806cae0 0x7f5bf806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:08.896 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.893+0000 7f5c0f7fe700 1 --2- 172.21.15.155:0/3836477578 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f5bf806cae0 0x7f5bf806ef90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5c00007fd0 tx=0x7f5c00009f60 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:08.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:08.897+0000 7f5c0cff9700 1 -- 172.21.15.155:0/3836477578 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f5c04057500 con 0x7f5c100fb1e0 2023-12-16T05:59:09.126 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.123+0000 7f5c16521700 1 -- 172.21.15.155:0/3836477578 --> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c100fdbc0 con 0x7f5bf806cae0 2023-12-16T05:59:09.127 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.124+0000 7f5c0cff9700 1 -- 172.21.15.155:0/3836477578 <== mgr.14646 v2:172.21.15.155:6800/1257988911 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f5c100fdbc0 con 0x7f5bf806cae0 2023-12-16T05:59:09.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.127+0000 7f5c16521700 1 -- 172.21.15.155:0/3836477578 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f5bf806cae0 msgr2=0x7f5bf806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:09.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.127+0000 7f5c16521700 1 --2- 172.21.15.155:0/3836477578 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f5bf806cae0 0x7f5bf806ef90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5c00007fd0 tx=0x7f5c00009f60 comp rx=0 tx=0).stop 2023-12-16T05:59:09.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.127+0000 7f5c16521700 1 -- 172.21.15.155:0/3836477578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c100fb1e0 msgr2=0x7f5c100fc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:09.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.127+0000 7f5c16521700 1 --2- 172.21.15.155:0/3836477578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c100fb1e0 0x7f5c100fc3c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5c04009180 tx=0x7f5c04009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:09.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.127+0000 7f5c16521700 1 -- 172.21.15.155:0/3836477578 shutdown_connections 2023-12-16T05:59:09.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.127+0000 7f5c16521700 1 --2- 172.21.15.155:0/3836477578 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f5bf806cae0 0x7f5bf806ef90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:09.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.127+0000 7f5c16521700 1 --2- 172.21.15.155:0/3836477578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c100fb1e0 0x7f5c100fc3c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:09.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.127+0000 7f5c16521700 1 --2- 172.21.15.155:0/3836477578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c10102c70 0x7f5c100fc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:09.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.127+0000 7f5c16521700 1 -- 172.21.15.155:0/3836477578 >> 172.21.15.155:0/3836477578 conn(0x7f5c100711a0 msgr2=0x7f5c100fa0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:09.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.127+0000 7f5c16521700 1 -- 172.21.15.155:0/3836477578 shutdown_connections 2023-12-16T05:59:09.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.127+0000 7f5c16521700 1 -- 172.21.15.155:0/3836477578 wait complete. 2023-12-16T05:59:09.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.237+0000 7f498a457700 1 -- 172.21.15.155:0/3453268989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4984101b00 msgr2=0x7f4984101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:09.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.237+0000 7f498a457700 1 --2- 172.21.15.155:0/3453268989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4984101b00 0x7f4984101ed0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4974004940 tx=0x7f4974009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:09.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.237+0000 7f498a457700 1 -- 172.21.15.155:0/3453268989 shutdown_connections 2023-12-16T05:59:09.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.237+0000 7f498a457700 1 --2- 172.21.15.155:0/3453268989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49840fbb40 0x7f49840fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:09.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.237+0000 7f498a457700 1 --2- 172.21.15.155:0/3453268989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4984101b00 0x7f4984101ed0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:09.241 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.237+0000 7f498a457700 1 -- 172.21.15.155:0/3453268989 >> 172.21.15.155:0/3453268989 conn(0x7f49840719b0 msgr2=0x7f4984071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:09.241 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.237+0000 7f498a457700 1 -- 172.21.15.155:0/3453268989 shutdown_connections 2023-12-16T05:59:09.241 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.237+0000 7f498a457700 1 -- 172.21.15.155:0/3453268989 wait complete. 2023-12-16T05:59:09.241 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.237+0000 7f498a457700 1 Processor -- start 2023-12-16T05:59:09.241 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.238+0000 7f498a457700 1 -- start start 2023-12-16T05:59:09.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.238+0000 7f498a457700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49840fbb40 0x7f49840fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:09.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.238+0000 7f498a457700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4984101b00 0x7f49840fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:09.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.238+0000 7f498a457700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49840fe260 con 0x7f49840fbb40 2023-12-16T05:59:09.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.238+0000 7f498a457700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49840fe3d0 con 0x7f4984101b00 2023-12-16T05:59:09.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.238+0000 7f4983fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49840fbb40 0x7f49840fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:09.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.238+0000 7f4983fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49840fbb40 0x7f49840fd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:47676/0 (socket says 172.21.15.155:47676) 2023-12-16T05:59:09.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.238+0000 7f4983fff700 1 -- 172.21.15.155:0/3849677301 learned_addr learned my addr 172.21.15.155:0/3849677301 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:59:09.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.238+0000 7f49837fe700 1 --2- 172.21.15.155:0/3849677301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4984101b00 0x7f49840fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:09.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.238+0000 7f4983fff700 1 -- 172.21.15.155:0/3849677301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4984101b00 msgr2=0x7f49840fdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:09.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.238+0000 7f4983fff700 1 --2- 172.21.15.155:0/3849677301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4984101b00 0x7f49840fdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:09.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.238+0000 7f4983fff700 1 -- 172.21.15.155:0/3849677301 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4974005040 con 0x7f49840fbb40 2023-12-16T05:59:09.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.238+0000 7f49837fe700 1 --2- 172.21.15.155:0/3849677301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4984101b00 0x7f49840fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T05:59:09.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.238+0000 7f4983fff700 1 --2- 172.21.15.155:0/3849677301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49840fbb40 0x7f49840fd720 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f497400b3b0 tx=0x7f4974009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:09.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.239+0000 7f4980ff9700 1 -- 172.21.15.155:0/3849677301 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f497400e040 con 0x7f49840fbb40 2023-12-16T05:59:09.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.239+0000 7f4980ff9700 1 -- 172.21.15.155:0/3849677301 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f497400bc50 con 0x7f49840fbb40 2023-12-16T05:59:09.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.239+0000 7f498a457700 1 -- 172.21.15.155:0/3849677301 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4984119870 con 0x7f49840fbb40 2023-12-16T05:59:09.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.239+0000 7f4980ff9700 1 -- 172.21.15.155:0/3849677301 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4974013420 con 0x7f49840fbb40 2023-12-16T05:59:09.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.239+0000 7f498a457700 1 -- 172.21.15.155:0/3849677301 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4984119cd0 con 0x7f49840fbb40 2023-12-16T05:59:09.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.240+0000 7f498a457700 1 -- 172.21.15.155:0/3849677301 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49840734d0 con 0x7f49840fbb40 2023-12-16T05:59:09.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.240+0000 7f4980ff9700 1 -- 172.21.15.155:0/3849677301 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 32) v1 ==== 90801+0+0 (secure 0 0 0) 0x7f497401c430 con 0x7f49840fbb40 2023-12-16T05:59:09.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.240+0000 7f4980ff9700 1 --2- 172.21.15.155:0/3849677301 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f496c06cae0 0x7f496c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:09.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.241+0000 7f4980ff9700 1 -- 172.21.15.155:0/3849677301 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f497408ca30 con 0x7f49840fbb40 2023-12-16T05:59:09.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.241+0000 7f49837fe700 1 --2- 172.21.15.155:0/3849677301 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f496c06cae0 0x7f496c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:09.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.241+0000 7f49837fe700 1 --2- 172.21.15.155:0/3849677301 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f496c06cae0 0x7f496c06ef90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4978009fd0 tx=0x7f497800b040 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:09.247 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.245+0000 7f4980ff9700 1 -- 172.21.15.155:0/3849677301 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f4974056fb0 con 0x7f49840fbb40 2023-12-16T05:59:09.455 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.452+0000 7f498a457700 1 -- 172.21.15.155:0/3849677301 --> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4984065ba0 con 0x7f496c06cae0 2023-12-16T05:59:09.468 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.465+0000 7f4980ff9700 1 -- 172.21.15.155:0/3849677301 <== mgr.14646 v2:172.21.15.155:6800/1257988911 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4984065ba0 con 0x7f496c06cae0 2023-12-16T05:59:09.468 INFO:teuthology.orchestra.run.smithi155.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T05:59:09.468 INFO:teuthology.orchestra.run.smithi155.stdout:alertmanager.smithi155 smithi155 *:9093,9094 running (53s) 38s ago 8m 15.6M - 0.25.0 c8568f914cd2 e1da85d6fc09 2023-12-16T05:59:09.468 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi155 smithi155 running (8m) 38s ago 8m 7444k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 033f79f53811 2023-12-16T05:59:09.468 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi156 smithi156 running (7m) 73s ago 7m 7470k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 c72bd1a1d00a 2023-12-16T05:59:09.468 INFO:teuthology.orchestra.run.smithi155.stdout:grafana.smithi155 smithi155 *:3000 running (42s) 38s ago 8m 49.4M - 9.4.12 a0ea5e3c46d9 a16c84704784 2023-12-16T05:59:09.468 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.bzsxjw smithi155 running (4m) 38s ago 4m 4744M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6bcabf94a5c3 2023-12-16T05:59:09.468 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.vicpis smithi155 running (4m) 38s ago 4m 668M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 afa64e1ef8da 2023-12-16T05:59:09.468 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.fasing smithi156 running (4m) 73s ago 4m 532M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 7d97160bda7c 2023-12-16T05:59:09.468 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.qvgmfj smithi156 running (4m) 73s ago 4m 5969M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4018b2f2e27e 2023-12-16T05:59:09.469 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi155.maowdn smithi155 *:8443,9283,8765 running (117s) 38s ago 9m 508M - 19.0.0-191-g6d933094 a29c258b5d6f ee39089d18d3 2023-12-16T05:59:09.469 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi156.pclong smithi156 *:8443,9283,8765 running (91s) 73s ago 7m 449M - 19.0.0-191-g6d933094 a29c258b5d6f 673376e357e8 2023-12-16T05:59:09.469 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi155 smithi155 running (9m) 38s ago 9m 98.9M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 0d0eecfde53b 2023-12-16T05:59:09.469 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi156 smithi156 running (7m) 73s ago 7m 65.0M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 4575acae9bdb 2023-12-16T05:59:09.469 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi155 smithi155 *:9100 running (81s) 38s ago 8m 7822k - 1.5.0 0da6a335fe13 6f0f1f68f191 2023-12-16T05:59:09.469 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi156 smithi156 *:9100 running (76s) 73s ago 7m 4072k - 1.5.0 0da6a335fe13 c4595a7b1707 2023-12-16T05:59:09.469 INFO:teuthology.orchestra.run.smithi155.stdout:osd.0 smithi155 running (7m) 38s ago 7m 781M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 91e650c277f7 2023-12-16T05:59:09.469 INFO:teuthology.orchestra.run.smithi155.stdout:osd.1 smithi155 running (6m) 38s ago 6m 857M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957303cb6598 2023-12-16T05:59:09.469 INFO:teuthology.orchestra.run.smithi155.stdout:osd.2 smithi155 running (6m) 38s ago 6m 625M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957a169c1cac 2023-12-16T05:59:09.469 INFO:teuthology.orchestra.run.smithi155.stdout:osd.3 smithi156 running (6m) 73s ago 6m 939M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c4f6c54afe99 2023-12-16T05:59:09.469 INFO:teuthology.orchestra.run.smithi155.stdout:osd.4 smithi156 running (5m) 73s ago 5m 725M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 6309b12204fd 2023-12-16T05:59:09.469 INFO:teuthology.orchestra.run.smithi155.stdout:osd.5 smithi156 running (5m) 73s ago 5m 839M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 84b2c33eb0e1 2023-12-16T05:59:09.469 INFO:teuthology.orchestra.run.smithi155.stdout:prometheus.smithi155 smithi155 *:9095 running (63s) 38s ago 8m 48.0M - 2.43.0 a07b618ecd1d 26bb7cfc1b8b 2023-12-16T05:59:09.470 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.467+0000 7f498a457700 1 -- 172.21.15.155:0/3849677301 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f496c06cae0 msgr2=0x7f496c06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:09.470 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.467+0000 7f498a457700 1 --2- 172.21.15.155:0/3849677301 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f496c06cae0 0x7f496c06ef90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4978009fd0 tx=0x7f497800b040 comp rx=0 tx=0).stop 2023-12-16T05:59:09.471 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.467+0000 7f498a457700 1 -- 172.21.15.155:0/3849677301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49840fbb40 msgr2=0x7f49840fd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:09.471 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.467+0000 7f498a457700 1 --2- 172.21.15.155:0/3849677301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49840fbb40 0x7f49840fd720 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f497400b3b0 tx=0x7f4974009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:09.471 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.468+0000 7f498a457700 1 -- 172.21.15.155:0/3849677301 shutdown_connections 2023-12-16T05:59:09.471 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.468+0000 7f498a457700 1 --2- 172.21.15.155:0/3849677301 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f496c06cae0 0x7f496c06ef90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:09.471 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.468+0000 7f498a457700 1 --2- 172.21.15.155:0/3849677301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49840fbb40 0x7f49840fd720 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:09.471 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.468+0000 7f498a457700 1 --2- 172.21.15.155:0/3849677301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4984101b00 0x7f49840fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:09.471 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.468+0000 7f498a457700 1 -- 172.21.15.155:0/3849677301 >> 172.21.15.155:0/3849677301 conn(0x7f49840719b0 msgr2=0x7f4984065490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:09.471 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.468+0000 7f498a457700 1 -- 172.21.15.155:0/3849677301 shutdown_connections 2023-12-16T05:59:09.471 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.468+0000 7f498a457700 1 -- 172.21.15.155:0/3849677301 wait complete. 2023-12-16T05:59:09.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.573+0000 7f3011617700 1 -- 172.21.15.155:0/1337118192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f300c0fc5d0 msgr2=0x7f300c0fc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:09.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.573+0000 7f3011617700 1 --2- 172.21.15.155:0/1337118192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f300c0fc5d0 0x7f300c0fc9a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc004940 tx=0x7f2ffc009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:09.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.573+0000 7f3011617700 1 -- 172.21.15.155:0/1337118192 shutdown_connections 2023-12-16T05:59:09.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.573+0000 7f3011617700 1 --2- 172.21.15.155:0/1337118192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f300c0fcee0 0x7f300c109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:09.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.573+0000 7f3011617700 1 --2- 172.21.15.155:0/1337118192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f300c0fc5d0 0x7f300c0fc9a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:09.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.573+0000 7f3011617700 1 -- 172.21.15.155:0/1337118192 >> 172.21.15.155:0/1337118192 conn(0x7f300c0719b0 msgr2=0x7f300c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:09.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.573+0000 7f3011617700 1 -- 172.21.15.155:0/1337118192 shutdown_connections 2023-12-16T05:59:09.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.573+0000 7f3011617700 1 -- 172.21.15.155:0/1337118192 wait complete. 2023-12-16T05:59:09.578 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.574+0000 7f3011617700 1 Processor -- start 2023-12-16T05:59:09.578 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.574+0000 7f3011617700 1 -- start start 2023-12-16T05:59:09.578 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.574+0000 7f3011617700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f300c0fc5d0 0x7f300c1158c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:09.578 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.574+0000 7f3011617700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f300c0fcee0 0x7f300c115e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:09.578 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.574+0000 7f3011617700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300c116450 con 0x7f300c0fc5d0 2023-12-16T05:59:09.578 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.574+0000 7f3011617700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300c10f780 con 0x7f300c0fcee0 2023-12-16T05:59:09.578 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.574+0000 7f300affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f300c0fc5d0 0x7f300c1158c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:09.578 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.574+0000 7f300affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f300c0fc5d0 0x7f300c1158c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:47708/0 (socket says 172.21.15.155:47708) 2023-12-16T05:59:09.578 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.574+0000 7f300affd700 1 -- 172.21.15.155:0/1075832811 learned_addr learned my addr 172.21.15.155:0/1075832811 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:59:09.579 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.574+0000 7f300a7fc700 1 --2- 172.21.15.155:0/1075832811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f300c0fcee0 0x7f300c115e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:09.579 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.575+0000 7f300affd700 1 -- 172.21.15.155:0/1075832811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f300c0fcee0 msgr2=0x7f300c115e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:09.579 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.575+0000 7f300affd700 1 --2- 172.21.15.155:0/1075832811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f300c0fcee0 0x7f300c115e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:09.579 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.575+0000 7f300affd700 1 -- 172.21.15.155:0/1075832811 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc005040 con 0x7f300c0fc5d0 2023-12-16T05:59:09.579 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.575+0000 7f300a7fc700 1 --2- 172.21.15.155:0/1075832811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f300c0fcee0 0x7f300c115e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T05:59:09.579 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.575+0000 7f300affd700 1 --2- 172.21.15.155:0/1075832811 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f300c0fc5d0 0x7f300c1158c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc00b3b0 tx=0x7f2ffc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:09.579 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.575+0000 7f2ff37fe700 1 -- 172.21.15.155:0/1075832811 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ffc00e040 con 0x7f300c0fc5d0 2023-12-16T05:59:09.579 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.575+0000 7f3011617700 1 -- 172.21.15.155:0/1075832811 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300c10fa00 con 0x7f300c0fc5d0 2023-12-16T05:59:09.579 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.575+0000 7f2ff37fe700 1 -- 172.21.15.155:0/1075832811 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ffc00bc50 con 0x7f300c0fc5d0 2023-12-16T05:59:09.579 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.575+0000 7f2ff37fe700 1 -- 172.21.15.155:0/1075832811 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ffc013420 con 0x7f300c0fc5d0 2023-12-16T05:59:09.579 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.575+0000 7f3011617700 1 -- 172.21.15.155:0/1075832811 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300c10ff40 con 0x7f300c0fc5d0 2023-12-16T05:59:09.580 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.576+0000 7f3011617700 1 -- 172.21.15.155:0/1075832811 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300c1068c0 con 0x7f300c0fc5d0 2023-12-16T05:59:09.580 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.577+0000 7f2ff37fe700 1 -- 172.21.15.155:0/1075832811 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 32) v1 ==== 90801+0+0 (secure 0 0 0) 0x7f2ffc01c430 con 0x7f300c0fc5d0 2023-12-16T05:59:09.580 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.577+0000 7f2ff37fe700 1 --2- 172.21.15.155:0/1075832811 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f2ff406cae0 0x7f2ff406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:09.580 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.577+0000 7f2ff37fe700 1 -- 172.21.15.155:0/1075832811 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f2ffc08cb20 con 0x7f300c0fc5d0 2023-12-16T05:59:09.580 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.577+0000 7f300a7fc700 1 --2- 172.21.15.155:0/1075832811 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f2ff406cae0 0x7f2ff406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:09.580 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.578+0000 7f300a7fc700 1 --2- 172.21.15.155:0/1075832811 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f2ff406cae0 0x7f2ff406ef90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3000009fd0 tx=0x7f3000009ee0 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:09.584 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.582+0000 7f2ff37fe700 1 -- 172.21.15.155:0/1075832811 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f2ffc05aa90 con 0x7f300c0fc5d0 2023-12-16T05:59:09.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:09 smithi155 ceph-mon[112451]: Upgrade: Target is version 19.0.0-191-g6d933094 (unknown) 2023-12-16T05:59:09.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:09 smithi155 ceph-mon[112451]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17'] 2023-12-16T05:59:09.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:09 smithi155 ceph-mon[112451]: Upgrade: Setting container_image for all mgr 2023-12-16T05:59:09.879 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.876+0000 7f3011617700 1 -- 172.21.15.155:0/1075832811 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f300c04bb80 con 0x7f300c0fc5d0 2023-12-16T05:59:09.879 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.877+0000 7f2ff37fe700 1 -- 172.21.15.155:0/1075832811 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f2ffc05a620 con 0x7f300c0fc5d0 2023-12-16T05:59:09.879 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T05:59:09.879 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": { 2023-12-16T05:59:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T05:59:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:59:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": { 2023-12-16T05:59:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T05:59:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:59:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": { 2023-12-16T05:59:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T05:59:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:59:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2023-12-16T05:59:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T05:59:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:59:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: "overall": { 2023-12-16T05:59:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-16T05:59:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T05:59:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-12-16T05:59:09.881 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T05:59:09.883 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.880+0000 7f3011617700 1 -- 172.21.15.155:0/1075832811 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f2ff406cae0 msgr2=0x7f2ff406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:09.883 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.880+0000 7f3011617700 1 --2- 172.21.15.155:0/1075832811 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f2ff406cae0 0x7f2ff406ef90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3000009fd0 tx=0x7f3000009ee0 comp rx=0 tx=0).stop 2023-12-16T05:59:09.883 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.880+0000 7f3011617700 1 -- 172.21.15.155:0/1075832811 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f300c0fc5d0 msgr2=0x7f300c1158c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:09.883 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.880+0000 7f3011617700 1 --2- 172.21.15.155:0/1075832811 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f300c0fc5d0 0x7f300c1158c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc00b3b0 tx=0x7f2ffc009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:09.883 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.880+0000 7f3011617700 1 -- 172.21.15.155:0/1075832811 shutdown_connections 2023-12-16T05:59:09.883 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.880+0000 7f3011617700 1 --2- 172.21.15.155:0/1075832811 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f2ff406cae0 0x7f2ff406ef90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:09.883 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.880+0000 7f3011617700 1 --2- 172.21.15.155:0/1075832811 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f300c0fc5d0 0x7f300c1158c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:09.883 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.880+0000 7f3011617700 1 --2- 172.21.15.155:0/1075832811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f300c0fcee0 0x7f300c115e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:09.883 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.880+0000 7f3011617700 1 -- 172.21.15.155:0/1075832811 >> 172.21.15.155:0/1075832811 conn(0x7f300c0719b0 msgr2=0x7f300c0fa8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:09.883 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.880+0000 7f3011617700 1 -- 172.21.15.155:0/1075832811 shutdown_connections 2023-12-16T05:59:09.883 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.880+0000 7f3011617700 1 -- 172.21.15.155:0/1075832811 wait complete. 2023-12-16T05:59:09.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:09 smithi156 ceph-mon[121001]: Upgrade: Target is version 19.0.0-191-g6d933094 (unknown) 2023-12-16T05:59:09.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:09 smithi156 ceph-mon[121001]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17'] 2023-12-16T05:59:09.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:09 smithi156 ceph-mon[121001]: Upgrade: Setting container_image for all mgr 2023-12-16T05:59:09.988 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.985+0000 7f3250ac9700 1 -- 172.21.15.155:0/3645095388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f324c101af0 msgr2=0x7f324c101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:09.989 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.985+0000 7f3250ac9700 1 --2- 172.21.15.155:0/3645095388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f324c101af0 0x7f324c101ec0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f323c004940 tx=0x7f323c009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:09.989 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.986+0000 7f3250ac9700 1 -- 172.21.15.155:0/3645095388 shutdown_connections 2023-12-16T05:59:09.989 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.986+0000 7f3250ac9700 1 --2- 172.21.15.155:0/3645095388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f324c0fbb30 0x7f324c0fbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:09.989 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.986+0000 7f3250ac9700 1 --2- 172.21.15.155:0/3645095388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f324c101af0 0x7f324c101ec0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:09.989 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.986+0000 7f3250ac9700 1 -- 172.21.15.155:0/3645095388 >> 172.21.15.155:0/3645095388 conn(0x7f324c0f7690 msgr2=0x7f324c0f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:09.989 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.986+0000 7f3250ac9700 1 -- 172.21.15.155:0/3645095388 shutdown_connections 2023-12-16T05:59:09.989 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.986+0000 7f3250ac9700 1 -- 172.21.15.155:0/3645095388 wait complete. 2023-12-16T05:59:09.991 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.986+0000 7f3250ac9700 1 Processor -- start 2023-12-16T05:59:09.991 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.986+0000 7f3250ac9700 1 -- start start 2023-12-16T05:59:09.991 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.986+0000 7f3250ac9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f324c0fbb30 0x7f324c10e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:09.991 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.986+0000 7f3250ac9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f324c101af0 0x7f324c10ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:09.991 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.986+0000 7f3250ac9700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c10f1e0 con 0x7f324c101af0 2023-12-16T05:59:09.991 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.987+0000 7f3250ac9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c10f350 con 0x7f324c0fbb30 2023-12-16T05:59:09.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.987+0000 7f3249d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f324c101af0 0x7f324c10ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:09.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.987+0000 7f3249d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f324c101af0 0x7f324c10ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:47722/0 (socket says 172.21.15.155:47722) 2023-12-16T05:59:09.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.987+0000 7f3249d9b700 1 -- 172.21.15.155:0/3946065915 learned_addr learned my addr 172.21.15.155:0/3946065915 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:59:09.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.987+0000 7f3249d9b700 1 -- 172.21.15.155:0/3946065915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f324c0fbb30 msgr2=0x7f324c10e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:09.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.987+0000 7f324a59c700 1 --2- 172.21.15.155:0/3946065915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f324c0fbb30 0x7f324c10e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:09.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.987+0000 7f3249d9b700 1 --2- 172.21.15.155:0/3946065915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f324c0fbb30 0x7f324c10e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:09.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.987+0000 7f3249d9b700 1 -- 172.21.15.155:0/3946065915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c005040 con 0x7f324c101af0 2023-12-16T05:59:09.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.987+0000 7f3249d9b700 1 --2- 172.21.15.155:0/3946065915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f324c101af0 0x7f324c10ec30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f324000c830 tx=0x7f3240004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:09.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.987+0000 7f323affd700 1 -- 172.21.15.155:0/3946065915 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f324000a760 con 0x7f324c101af0 2023-12-16T05:59:09.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.987+0000 7f323affd700 1 -- 172.21.15.155:0/3946065915 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f324000ad70 con 0x7f324c101af0 2023-12-16T05:59:09.993 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.987+0000 7f3250ac9700 1 -- 172.21.15.155:0/3946065915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f324c1176c0 con 0x7f324c101af0 2023-12-16T05:59:09.993 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.987+0000 7f323affd700 1 -- 172.21.15.155:0/3946065915 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32400113a0 con 0x7f324c101af0 2023-12-16T05:59:09.993 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.987+0000 7f3250ac9700 1 -- 172.21.15.155:0/3946065915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f324c117bd0 con 0x7f324c101af0 2023-12-16T05:59:09.993 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.988+0000 7f3250ac9700 1 -- 172.21.15.155:0/3946065915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f322c0052b0 con 0x7f324c101af0 2023-12-16T05:59:09.993 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.989+0000 7f323affd700 1 -- 172.21.15.155:0/3946065915 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 32) v1 ==== 90801+0+0 (secure 0 0 0) 0x7f324000a8c0 con 0x7f324c101af0 2023-12-16T05:59:09.994 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.989+0000 7f323affd700 1 --2- 172.21.15.155:0/3946065915 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f323406caf0 0x7f323406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:09.994 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.989+0000 7f323affd700 1 -- 172.21.15.155:0/3946065915 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f324008bcf0 con 0x7f324c101af0 2023-12-16T05:59:09.994 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.989+0000 7f324a59c700 1 --2- 172.21.15.155:0/3946065915 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f323406caf0 0x7f323406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:09.994 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.990+0000 7f324a59c700 1 --2- 172.21.15.155:0/3946065915 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f323406caf0 0x7f323406efa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f323c00b3b0 tx=0x7f323c009e30 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:09.996 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:09.994+0000 7f323affd700 1 -- 172.21.15.155:0/3946065915 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f3240056120 con 0x7f324c101af0 2023-12-16T05:59:10.232 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.230+0000 7f3250ac9700 1 -- 172.21.15.155:0/3946065915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f322c005d70 con 0x7f324c101af0 2023-12-16T05:59:10.233 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.230+0000 7f323affd700 1 -- 172.21.15.155:0/3946065915 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1869 (secure 0 0 0) 0x7f3240059740 con 0x7f324c101af0 2023-12-16T05:59:10.233 INFO:teuthology.orchestra.run.smithi155.stdout:e16 2023-12-16T05:59:10.233 INFO:teuthology.orchestra.run.smithi155.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T05:59:10.233 INFO:teuthology.orchestra.run.smithi155.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T05:59:10.233 INFO:teuthology.orchestra.run.smithi155.stdout:legacy client fscid: 1 2023-12-16T05:59:10.233 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:59:10.234 INFO:teuthology.orchestra.run.smithi155.stdout:Filesystem 'cephfs' (1) 2023-12-16T05:59:10.234 INFO:teuthology.orchestra.run.smithi155.stdout:fs_name cephfs 2023-12-16T05:59:10.234 INFO:teuthology.orchestra.run.smithi155.stdout:epoch 16 2023-12-16T05:59:10.234 INFO:teuthology.orchestra.run.smithi155.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-16T05:59:10.234 INFO:teuthology.orchestra.run.smithi155.stdout:created 2023-12-16T05:54:25.897091+0000 2023-12-16T05:59:10.234 INFO:teuthology.orchestra.run.smithi155.stdout:modified 2023-12-16T05:56:25.130480+0000 2023-12-16T05:59:10.234 INFO:teuthology.orchestra.run.smithi155.stdout:tableserver 0 2023-12-16T05:59:10.234 INFO:teuthology.orchestra.run.smithi155.stdout:root 0 2023-12-16T05:59:10.234 INFO:teuthology.orchestra.run.smithi155.stdout:session_timeout 60 2023-12-16T05:59:10.234 INFO:teuthology.orchestra.run.smithi155.stdout:session_autoclose 300 2023-12-16T05:59:10.234 INFO:teuthology.orchestra.run.smithi155.stdout:max_file_size 1099511627776 2023-12-16T05:59:10.234 INFO:teuthology.orchestra.run.smithi155.stdout:required_client_features {} 2023-12-16T05:59:10.234 INFO:teuthology.orchestra.run.smithi155.stdout:last_failure 0 2023-12-16T05:59:10.234 INFO:teuthology.orchestra.run.smithi155.stdout:last_failure_osd_epoch 0 2023-12-16T05:59:10.234 INFO:teuthology.orchestra.run.smithi155.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T05:59:10.235 INFO:teuthology.orchestra.run.smithi155.stdout:max_mds 2 2023-12-16T05:59:10.235 INFO:teuthology.orchestra.run.smithi155.stdout:in 0,1 2023-12-16T05:59:10.235 INFO:teuthology.orchestra.run.smithi155.stdout:up {0=14456,1=24281} 2023-12-16T05:59:10.235 INFO:teuthology.orchestra.run.smithi155.stdout:failed 2023-12-16T05:59:10.235 INFO:teuthology.orchestra.run.smithi155.stdout:damaged 2023-12-16T05:59:10.235 INFO:teuthology.orchestra.run.smithi155.stdout:stopped 2023-12-16T05:59:10.235 INFO:teuthology.orchestra.run.smithi155.stdout:data_pools [3] 2023-12-16T05:59:10.235 INFO:teuthology.orchestra.run.smithi155.stdout:metadata_pool 2 2023-12-16T05:59:10.235 INFO:teuthology.orchestra.run.smithi155.stdout:inline_data disabled 2023-12-16T05:59:10.235 INFO:teuthology.orchestra.run.smithi155.stdout:balancer 2023-12-16T05:59:10.235 INFO:teuthology.orchestra.run.smithi155.stdout:standby_count_wanted 1 2023-12-16T05:59:10.235 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi155.bzsxjw{0:14456} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.155:6826/1416140807,v1:172.21.15.155:6827/1416140807] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:59:10.235 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi156.fasing{0:24289} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1763385284,v1:172.21.15.156:6827/1763385284] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:59:10.235 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi156.qvgmfj{1:24281} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.156:6824/2823725296,v1:172.21.15.156:6825/2823725296] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:59:10.235 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi155.vicpis{1:14472} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.155:6828/750006619,v1:172.21.15.155:6829/750006619] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:59:10.236 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:59:10.236 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:59:10.236 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.232+0000 7f3250ac9700 1 -- 172.21.15.155:0/3946065915 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f323406caf0 msgr2=0x7f323406efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:10.236 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.232+0000 7f3250ac9700 1 --2- 172.21.15.155:0/3946065915 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f323406caf0 0x7f323406efa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f323c00b3b0 tx=0x7f323c009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:10.236 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.232+0000 7f3250ac9700 1 -- 172.21.15.155:0/3946065915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f324c101af0 msgr2=0x7f324c10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:10.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.232+0000 7f3250ac9700 1 --2- 172.21.15.155:0/3946065915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f324c101af0 0x7f324c10ec30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f324000c830 tx=0x7f3240004470 comp rx=0 tx=0).stop 2023-12-16T05:59:10.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.232+0000 7f3250ac9700 1 -- 172.21.15.155:0/3946065915 shutdown_connections 2023-12-16T05:59:10.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.232+0000 7f3250ac9700 1 --2- 172.21.15.155:0/3946065915 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f323406caf0 0x7f323406efa0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:10.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.232+0000 7f3250ac9700 1 --2- 172.21.15.155:0/3946065915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f324c0fbb30 0x7f324c10e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:10.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.232+0000 7f3250ac9700 1 --2- 172.21.15.155:0/3946065915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f324c101af0 0x7f324c10ec30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:10.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.232+0000 7f3250ac9700 1 -- 172.21.15.155:0/3946065915 >> 172.21.15.155:0/3946065915 conn(0x7f324c0f7690 msgr2=0x7f324c0f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:10.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.232+0000 7f3250ac9700 1 -- 172.21.15.155:0/3946065915 shutdown_connections 2023-12-16T05:59:10.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.232+0000 7f3250ac9700 1 -- 172.21.15.155:0/3946065915 wait complete. 2023-12-16T05:59:10.237 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 16 2023-12-16T05:59:10.339 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.335+0000 7f287ee8f700 1 -- 172.21.15.155:0/3109946099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28780fbb40 msgr2=0x7f28780fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:10.339 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.335+0000 7f287ee8f700 1 --2- 172.21.15.155:0/3109946099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28780fbb40 0x7f28780fbfb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2864004940 tx=0x7f2864009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:10.339 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.336+0000 7f287ee8f700 1 -- 172.21.15.155:0/3109946099 shutdown_connections 2023-12-16T05:59:10.339 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.336+0000 7f287ee8f700 1 --2- 172.21.15.155:0/3109946099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28780fbb40 0x7f28780fbfb0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:10.339 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.336+0000 7f287ee8f700 1 --2- 172.21.15.155:0/3109946099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2878101b00 0x7f2878101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:10.339 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.336+0000 7f287ee8f700 1 -- 172.21.15.155:0/3109946099 >> 172.21.15.155:0/3109946099 conn(0x7f28780719b0 msgr2=0x7f2878071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:10.339 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.336+0000 7f287ee8f700 1 -- 172.21.15.155:0/3109946099 shutdown_connections 2023-12-16T05:59:10.339 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.336+0000 7f287ee8f700 1 -- 172.21.15.155:0/3109946099 wait complete. 2023-12-16T05:59:10.339 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.336+0000 7f287ee8f700 1 Processor -- start 2023-12-16T05:59:10.339 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.336+0000 7f287ee8f700 1 -- start start 2023-12-16T05:59:10.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.337+0000 7f287ee8f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28780fbb40 0x7f287810e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:10.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.337+0000 7f287ee8f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2878101b00 0x7f287810ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:10.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.337+0000 7f287ee8f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287810f260 con 0x7f28780fbb40 2023-12-16T05:59:10.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.337+0000 7f287ee8f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287810f3a0 con 0x7f2878101b00 2023-12-16T05:59:10.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.337+0000 7f287cc2b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28780fbb40 0x7f287810e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:10.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.337+0000 7f287cc2b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28780fbb40 0x7f287810e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:47746/0 (socket says 172.21.15.155:47746) 2023-12-16T05:59:10.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.337+0000 7f287cc2b700 1 -- 172.21.15.155:0/338663533 learned_addr learned my addr 172.21.15.155:0/338663533 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:59:10.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.337+0000 7f2877fff700 1 --2- 172.21.15.155:0/338663533 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2878101b00 0x7f287810ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:10.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.337+0000 7f287cc2b700 1 -- 172.21.15.155:0/338663533 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2878101b00 msgr2=0x7f287810ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:10.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.337+0000 7f287cc2b700 1 --2- 172.21.15.155:0/338663533 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2878101b00 0x7f287810ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:10.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.337+0000 7f287cc2b700 1 -- 172.21.15.155:0/338663533 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2864005040 con 0x7f28780fbb40 2023-12-16T05:59:10.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.337+0000 7f287cc2b700 1 --2- 172.21.15.155:0/338663533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28780fbb40 0x7f287810e700 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f286c00b7c0 tx=0x7f286c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:10.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.337+0000 7f28757fa700 1 -- 172.21.15.155:0/338663533 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f286c00f6f0 con 0x7f28780fbb40 2023-12-16T05:59:10.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.337+0000 7f28757fa700 1 -- 172.21.15.155:0/338663533 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f286c00fd00 con 0x7f28780fbb40 2023-12-16T05:59:10.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.337+0000 7f287ee8f700 1 -- 172.21.15.155:0/338663533 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28781176d0 con 0x7f28780fbb40 2023-12-16T05:59:10.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.337+0000 7f28757fa700 1 -- 172.21.15.155:0/338663533 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f286c011e90 con 0x7f28780fbb40 2023-12-16T05:59:10.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.337+0000 7f287ee8f700 1 -- 172.21.15.155:0/338663533 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2878117c10 con 0x7f28780fbb40 2023-12-16T05:59:10.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.338+0000 7f287ee8f700 1 -- 172.21.15.155:0/338663533 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2878103fb0 con 0x7f28780fbb40 2023-12-16T05:59:10.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.339+0000 7f28757fa700 1 -- 172.21.15.155:0/338663533 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 32) v1 ==== 90801+0+0 (secure 0 0 0) 0x7f286c00f850 con 0x7f28780fbb40 2023-12-16T05:59:10.343 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.339+0000 7f28757fa700 1 --2- 172.21.15.155:0/338663533 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f286806cae0 0x7f286806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:10.344 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.339+0000 7f28757fa700 1 -- 172.21.15.155:0/338663533 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f286c08bc40 con 0x7f28780fbb40 2023-12-16T05:59:10.344 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.339+0000 7f2877fff700 1 --2- 172.21.15.155:0/338663533 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f286806cae0 0x7f286806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:10.344 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.340+0000 7f2877fff700 1 --2- 172.21.15.155:0/338663533 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f286806cae0 0x7f286806ef90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2864004f90 tx=0x7f2864009e30 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:10.346 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.344+0000 7f28757fa700 1 -- 172.21.15.155:0/338663533 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f286c056070 con 0x7f28780fbb40 2023-12-16T05:59:10.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.563+0000 7f287ee8f700 1 -- 172.21.15.155:0/338663533 --> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2878065b70 con 0x7f286806cae0 2023-12-16T05:59:10.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.564+0000 7f28757fa700 1 -- 172.21.15.155:0/338663533 <== mgr.14646 v2:172.21.15.155:6800/1257988911 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f2878065b70 con 0x7f286806cae0 2023-12-16T05:59:10.567 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T05:59:10.567 INFO:teuthology.orchestra.run.smithi155.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T05:59:10.567 INFO:teuthology.orchestra.run.smithi155.stdout: "in_progress": true, 2023-12-16T05:59:10.567 INFO:teuthology.orchestra.run.smithi155.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T05:59:10.567 INFO:teuthology.orchestra.run.smithi155.stdout: "services_complete": [ 2023-12-16T05:59:10.567 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr" 2023-12-16T05:59:10.567 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-12-16T05:59:10.567 INFO:teuthology.orchestra.run.smithi155.stdout: "progress": "2/21 daemons upgraded", 2023-12-16T05:59:10.567 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "Currently upgrading mon daemons", 2023-12-16T05:59:10.568 INFO:teuthology.orchestra.run.smithi155.stdout: "is_paused": false 2023-12-16T05:59:10.568 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T05:59:10.569 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.566+0000 7f287ee8f700 1 -- 172.21.15.155:0/338663533 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f286806cae0 msgr2=0x7f286806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:10.569 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.566+0000 7f287ee8f700 1 --2- 172.21.15.155:0/338663533 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f286806cae0 0x7f286806ef90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2864004f90 tx=0x7f2864009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:10.569 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.566+0000 7f287ee8f700 1 -- 172.21.15.155:0/338663533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28780fbb40 msgr2=0x7f287810e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:10.569 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.566+0000 7f287ee8f700 1 --2- 172.21.15.155:0/338663533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28780fbb40 0x7f287810e700 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f286c00b7c0 tx=0x7f286c009250 comp rx=0 tx=0).stop 2023-12-16T05:59:10.569 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.566+0000 7f287ee8f700 1 -- 172.21.15.155:0/338663533 shutdown_connections 2023-12-16T05:59:10.569 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.566+0000 7f287ee8f700 1 --2- 172.21.15.155:0/338663533 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f286806cae0 0x7f286806ef90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:10.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.566+0000 7f287ee8f700 1 --2- 172.21.15.155:0/338663533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28780fbb40 0x7f287810e700 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:10.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.566+0000 7f287ee8f700 1 --2- 172.21.15.155:0/338663533 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2878101b00 0x7f287810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:10.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.566+0000 7f287ee8f700 1 -- 172.21.15.155:0/338663533 >> 172.21.15.155:0/338663533 conn(0x7f28780719b0 msgr2=0x7f28780faa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:10.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.566+0000 7f287ee8f700 1 -- 172.21.15.155:0/338663533 shutdown_connections 2023-12-16T05:59:10.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.566+0000 7f287ee8f700 1 -- 172.21.15.155:0/338663533 wait complete. 2023-12-16T05:59:10.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:10 smithi155 ceph-mon[112451]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:59:10.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:10 smithi155 ceph-mon[112451]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:59:10.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:10 smithi155 ceph-mon[112451]: pgmap v57: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-16T05:59:10.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:10 smithi155 ceph-mon[112451]: Upgrade: Updating mon.smithi155 2023-12-16T05:59:10.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:10 smithi155 ceph-mon[112451]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:59:10.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:10 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:10.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:10 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T05:59:10.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:10 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T05:59:10.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:10 smithi155 ceph-mon[112451]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:10.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:10 smithi155 ceph-mon[112451]: Deploying daemon mon.smithi155 on smithi155 2023-12-16T05:59:10.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:10 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/1075832811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:59:10.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:10 smithi155 ceph-mon[112451]: from='client.? 172.21.15.155:0/3946065915' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T05:59:10.672 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.669+0000 7f0969cf1700 1 -- 172.21.15.155:0/2340782428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0964103590 msgr2=0x7f09640fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:10.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.669+0000 7f0969cf1700 1 --2- 172.21.15.155:0/2340782428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0964103590 0x7f09640fcc00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0958004940 tx=0x7f0958009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:10.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.669+0000 7f0969cf1700 1 -- 172.21.15.155:0/2340782428 shutdown_connections 2023-12-16T05:59:10.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.669+0000 7f0969cf1700 1 --2- 172.21.15.155:0/2340782428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0964103590 0x7f09640fcc00 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:10.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.669+0000 7f0969cf1700 1 --2- 172.21.15.155:0/2340782428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0964102bf0 0x7f0964102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:10.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.669+0000 7f0969cf1700 1 -- 172.21.15.155:0/2340782428 >> 172.21.15.155:0/2340782428 conn(0x7f09640f87a0 msgr2=0x7f09640fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:10.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.669+0000 7f0969cf1700 1 -- 172.21.15.155:0/2340782428 shutdown_connections 2023-12-16T05:59:10.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.670+0000 7f0969cf1700 1 -- 172.21.15.155:0/2340782428 wait complete. 2023-12-16T05:59:10.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.670+0000 7f0969cf1700 1 Processor -- start 2023-12-16T05:59:10.675 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.670+0000 7f0969cf1700 1 -- start start 2023-12-16T05:59:10.675 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.670+0000 7f0969cf1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0964102bf0 0x7f0964113640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:10.676 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.670+0000 7f0969cf1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0964103590 0x7f0964113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:10.676 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.670+0000 7f0969cf1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0964114210 con 0x7f0964102bf0 2023-12-16T05:59:10.676 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.670+0000 7f0969cf1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096410d500 con 0x7f0964103590 2023-12-16T05:59:10.676 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.671+0000 7f09637fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0964102bf0 0x7f0964113640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:10.676 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.671+0000 7f09637fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0964102bf0 0x7f0964113640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:47774/0 (socket says 172.21.15.155:47774) 2023-12-16T05:59:10.676 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.671+0000 7f09637fe700 1 -- 172.21.15.155:0/399864726 learned_addr learned my addr 172.21.15.155:0/399864726 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:59:10.676 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.671+0000 7f0962ffd700 1 --2- 172.21.15.155:0/399864726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0964103590 0x7f0964113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:10.676 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.671+0000 7f09637fe700 1 -- 172.21.15.155:0/399864726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0964103590 msgr2=0x7f0964113bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:10.676 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.671+0000 7f09637fe700 1 --2- 172.21.15.155:0/399864726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0964103590 0x7f0964113bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:10.676 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.671+0000 7f09637fe700 1 -- 172.21.15.155:0/399864726 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0958005040 con 0x7f0964102bf0 2023-12-16T05:59:10.676 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.671+0000 7f0962ffd700 1 --2- 172.21.15.155:0/399864726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0964103590 0x7f0964113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T05:59:10.677 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.671+0000 7f09637fe700 1 --2- 172.21.15.155:0/399864726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0964102bf0 0x7f0964113640 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f095400c8c0 tx=0x7f09540044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:10.677 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.671+0000 7f094bfff700 1 -- 172.21.15.155:0/399864726 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f095400a980 con 0x7f0964102bf0 2023-12-16T05:59:10.677 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.671+0000 7f0969cf1700 1 -- 172.21.15.155:0/399864726 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f096410d790 con 0x7f0964102bf0 2023-12-16T05:59:10.677 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.671+0000 7f094bfff700 1 -- 172.21.15.155:0/399864726 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f095400ce60 con 0x7f0964102bf0 2023-12-16T05:59:10.677 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.671+0000 7f094bfff700 1 -- 172.21.15.155:0/399864726 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09540113a0 con 0x7f0964102bf0 2023-12-16T05:59:10.677 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.671+0000 7f0969cf1700 1 -- 172.21.15.155:0/399864726 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f096410dcd0 con 0x7f0964102bf0 2023-12-16T05:59:10.677 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.672+0000 7f0969cf1700 1 -- 172.21.15.155:0/399864726 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09641050c0 con 0x7f0964102bf0 2023-12-16T05:59:10.677 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.673+0000 7f094bfff700 1 -- 172.21.15.155:0/399864726 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 32) v1 ==== 90801+0+0 (secure 0 0 0) 0x7f0954012400 con 0x7f0964102bf0 2023-12-16T05:59:10.678 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.673+0000 7f094bfff700 1 --2- 172.21.15.155:0/399864726 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f094c06cae0 0x7f094c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:10.678 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.673+0000 7f0962ffd700 1 --2- 172.21.15.155:0/399864726 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f094c06cae0 0x7f094c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:10.678 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.673+0000 7f094bfff700 1 -- 172.21.15.155:0/399864726 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f095408be90 con 0x7f0964102bf0 2023-12-16T05:59:10.678 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.674+0000 7f0962ffd700 1 --2- 172.21.15.155:0/399864726 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f094c06cae0 0x7f094c06ef90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0958009fd0 tx=0x7f0958009e30 comp rx=0 tx=0).ready entity=mgr.14646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:10.680 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.678+0000 7f094bfff700 1 -- 172.21.15.155:0/399864726 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0954059d50 con 0x7f0964102bf0 2023-12-16T05:59:10.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:10 smithi156 ceph-mon[121001]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:59:10.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:10 smithi156 ceph-mon[121001]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:59:10.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:10 smithi156 ceph-mon[121001]: pgmap v57: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-16T05:59:10.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:10 smithi156 ceph-mon[121001]: Upgrade: Updating mon.smithi155 2023-12-16T05:59:10.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:10 smithi156 ceph-mon[121001]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:59:10.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:10 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:10.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:10 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T05:59:10.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:10 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T05:59:10.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:10 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:10.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:10 smithi156 ceph-mon[121001]: Deploying daemon mon.smithi155 on smithi155 2023-12-16T05:59:10.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:10 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/1075832811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:59:10.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:10 smithi156 ceph-mon[121001]: from='client.? 172.21.15.155:0/3946065915' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T05:59:10.978 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.974+0000 7f0969cf1700 1 -- 172.21.15.155:0/399864726 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f096404bb80 con 0x7f0964102bf0 2023-12-16T05:59:10.978 INFO:teuthology.orchestra.run.smithi155.stdout:HEALTH_OK 2023-12-16T05:59:10.978 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.975+0000 7f094bfff700 1 -- 172.21.15.155:0/399864726 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f09540598e0 con 0x7f0964102bf0 2023-12-16T05:59:10.979 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.977+0000 7f0969cf1700 1 -- 172.21.15.155:0/399864726 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f094c06cae0 msgr2=0x7f094c06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:10.980 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.977+0000 7f0969cf1700 1 --2- 172.21.15.155:0/399864726 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f094c06cae0 0x7f094c06ef90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0958009fd0 tx=0x7f0958009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:10.980 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.977+0000 7f0969cf1700 1 -- 172.21.15.155:0/399864726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0964102bf0 msgr2=0x7f0964113640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:10.980 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.977+0000 7f0969cf1700 1 --2- 172.21.15.155:0/399864726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0964102bf0 0x7f0964113640 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f095400c8c0 tx=0x7f09540044c0 comp rx=0 tx=0).stop 2023-12-16T05:59:10.980 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.977+0000 7f0969cf1700 1 -- 172.21.15.155:0/399864726 shutdown_connections 2023-12-16T05:59:10.980 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.977+0000 7f0969cf1700 1 --2- 172.21.15.155:0/399864726 >> [v2:172.21.15.155:6800/1257988911,v1:172.21.15.155:6801/1257988911] conn(0x7f094c06cae0 0x7f094c06ef90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:10.980 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.977+0000 7f0969cf1700 1 --2- 172.21.15.155:0/399864726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0964102bf0 0x7f0964113640 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:10.980 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.977+0000 7f0969cf1700 1 --2- 172.21.15.155:0/399864726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0964103590 0x7f0964113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:10.980 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.977+0000 7f0969cf1700 1 -- 172.21.15.155:0/399864726 >> 172.21.15.155:0/399864726 conn(0x7f09640f87a0 msgr2=0x7f09640fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:10.981 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.977+0000 7f0969cf1700 1 -- 172.21.15.155:0/399864726 shutdown_connections 2023-12-16T05:59:10.981 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:10.977+0000 7f0969cf1700 1 -- 172.21.15.155:0/399864726 wait complete. 2023-12-16T05:59:11.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:10 smithi155 systemd[1]: Stopping Ceph mon.smithi155 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T05:59:11.442 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-mon-smithi155[112428]: 2023-12-16T05:59:11.083+0000 7fdaa65a1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi155 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T05:59:11.442 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-mon-smithi155[112428]: 2023-12-16T05:59:11.083+0000 7fdaa65a1700 -1 mon.smithi155@0(leader) e2 *** Got Signal Terminated *** 2023-12-16T05:59:11.442 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 bash[217209]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715-mon-smithi155 2023-12-16T05:59:11.821 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 systemd[1]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715@mon.smithi155.service: Succeeded. 2023-12-16T05:59:11.821 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 systemd[1]: Stopped Ceph mon.smithi155 for d344784e-9bd6-11ee-95a5-87774f69a715. 2023-12-16T05:59:11.821 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 systemd[1]: Starting Ceph mon.smithi155 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T05:59:12.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 bash[217370]: 19eb23d9f064a57b313b763d3f676f486d9d48091a0c95e8e4ce658ff31ca683 2023-12-16T05:59:12.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 systemd[1]: Started Ceph mon.smithi155 for d344784e-9bd6-11ee-95a5-87774f69a715. 2023-12-16T05:59:12.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: set uid:gid to 167:167 (ceph:ceph) 2023-12-16T05:59:12.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev), process ceph-mon, pid 7 2023-12-16T05:59:12.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: pidfile_write: ignore empty --pid-file 2023-12-16T05:59:12.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: load: jerasure load: lrc 2023-12-16T05:59:12.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: RocksDB version: 7.9.2 2023-12-16T05:59:12.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Git sha 0 2023-12-16T05:59:12.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Compile date 2023-12-15 16:32:04 2023-12-16T05:59:12.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: DB SUMMARY 2023-12-16T05:59:12.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: DB Session ID: 1U0RADKW9FVE7UD86ZET 2023-12-16T05:59:12.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: CURRENT file: CURRENT 2023-12-16T05:59:12.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: IDENTITY file: IDENTITY 2023-12-16T05:59:12.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: MANIFEST file: MANIFEST-000015 size: 972 Bytes 2023-12-16T05:59:12.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi155/store.db dir, Total Num: 1, files: 000030.sst 2023-12-16T05:59:12.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi155/store.db: 000028.log size: 26703 ; 2023-12-16T05:59:12.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.error_if_exists: 0 2023-12-16T05:59:12.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.create_if_missing: 0 2023-12-16T05:59:12.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.paranoid_checks: 1 2023-12-16T05:59:12.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-16T05:59:12.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-16T05:59:12.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-16T05:59:12.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.env: 0x555d50b29a60 2023-12-16T05:59:12.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.fs: PosixFileSystem 2023-12-16T05:59:12.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.info_log: 0x555d52559620 2023-12-16T05:59:12.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_file_opening_threads: 16 2023-12-16T05:59:12.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.statistics: (nil) 2023-12-16T05:59:12.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.use_fsync: 0 2023-12-16T05:59:12.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_log_file_size: 0 2023-12-16T05:59:12.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-16T05:59:12.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-16T05:59:12.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.keep_log_file_num: 1000 2023-12-16T05:59:12.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.recycle_log_file_num: 0 2023-12-16T05:59:12.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.allow_fallocate: 1 2023-12-16T05:59:12.330 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.allow_mmap_reads: 0 2023-12-16T05:59:12.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.allow_mmap_writes: 0 2023-12-16T05:59:12.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.use_direct_reads: 0 2023-12-16T05:59:12.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-16T05:59:12.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.create_missing_column_families: 0 2023-12-16T05:59:12.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.db_log_dir: 2023-12-16T05:59:12.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.wal_dir: 2023-12-16T05:59:12.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-16T05:59:12.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-16T05:59:12.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-16T05:59:12.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-16T05:59:12.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-16T05:59:12.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-16T05:59:12.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.advise_random_on_open: 1 2023-12-16T05:59:12.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.db_write_buffer_size: 0 2023-12-16T05:59:12.331 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.write_buffer_manager: 0x555d5250f360 2023-12-16T05:59:12.332 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-16T05:59:12.332 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-16T05:59:12.332 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-16T05:59:12.332 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.rate_limiter: (nil) 2023-12-16T05:59:12.332 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-16T05:59:12.332 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.wal_recovery_mode: 2 2023-12-16T05:59:12.332 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.enable_thread_tracking: 0 2023-12-16T05:59:12.332 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.enable_pipelined_write: 0 2023-12-16T05:59:12.332 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.unordered_write: 0 2023-12-16T05:59:12.332 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-16T05:59:12.332 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-16T05:59:12.332 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-16T05:59:12.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-16T05:59:12.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.row_cache: None 2023-12-16T05:59:12.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.wal_filter: None 2023-12-16T05:59:12.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-16T05:59:12.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.allow_ingest_behind: 0 2023-12-16T05:59:12.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.two_write_queues: 0 2023-12-16T05:59:12.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.manual_wal_flush: 0 2023-12-16T05:59:12.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.wal_compression: 0 2023-12-16T05:59:12.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.atomic_flush: 0 2023-12-16T05:59:12.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-16T05:59:12.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-16T05:59:12.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-16T05:59:12.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.log_readahead_size: 0 2023-12-16T05:59:12.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-16T05:59:12.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.best_efforts_recovery: 0 2023-12-16T05:59:12.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-16T05:59:12.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-16T05:59:12.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.allow_data_in_errors: 0 2023-12-16T05:59:12.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.db_host_id: __hostname__ 2023-12-16T05:59:12.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-16T05:59:12.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_background_jobs: 2 2023-12-16T05:59:12.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_background_compactions: -1 2023-12-16T05:59:12.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_subcompactions: 1 2023-12-16T05:59:12.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-16T05:59:12.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-16T05:59:12.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-16T05:59:12.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_total_wal_size: 0 2023-12-16T05:59:12.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-16T05:59:12.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-16T05:59:12.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-16T05:59:12.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-16T05:59:12.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_open_files: -1 2023-12-16T05:59:12.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.bytes_per_sync: 0 2023-12-16T05:59:12.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-16T05:59:12.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-16T05:59:12.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compaction_readahead_size: 0 2023-12-16T05:59:12.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_background_flushes: -1 2023-12-16T05:59:12.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Compression algorithms supported: 2023-12-16T05:59:12.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-16T05:59:12.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: kZSTD supported: 0 2023-12-16T05:59:12.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: kXpressCompression supported: 0 2023-12-16T05:59:12.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: kLZ4HCCompression supported: 1 2023-12-16T05:59:12.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: kZlibCompression supported: 1 2023-12-16T05:59:12.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: kSnappyCompression supported: 1 2023-12-16T05:59:12.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: kLZ4Compression supported: 1 2023-12-16T05:59:12.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: kBZip2Compression supported: 0 2023-12-16T05:59:12.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-16T05:59:12.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-16T05:59:12.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi155/store.db/MANIFEST-000015 2023-12-16T05:59:12.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-16T05:59:12.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-16T05:59:12.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.merge_operator: 2023-12-16T05:59:12.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compaction_filter: None 2023-12-16T05:59:12.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compaction_filter_factory: None 2023-12-16T05:59:12.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.sst_partitioner_factory: None 2023-12-16T05:59:12.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-16T05:59:12.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-16T05:59:12.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555d52559720) 2023-12-16T05:59:12.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: cache_index_and_filter_blocks: 1 2023-12-16T05:59:12.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-16T05:59:12.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-16T05:59:12.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: pin_top_level_index_and_filter: 1 2023-12-16T05:59:12.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: index_type: 0 2023-12-16T05:59:12.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: data_block_index_type: 0 2023-12-16T05:59:12.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: index_shortening: 1 2023-12-16T05:59:12.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-16T05:59:12.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: checksum: 4 2023-12-16T05:59:12.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: no_block_cache: 0 2023-12-16T05:59:12.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_cache: 0x555d525af090 2023-12-16T05:59:12.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_cache_name: BinnedLRUCache 2023-12-16T05:59:12.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_cache_options: 2023-12-16T05:59:12.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: capacity : 536870912 2023-12-16T05:59:12.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: num_shard_bits : 4 2023-12-16T05:59:12.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: strict_capacity_limit : 0 2023-12-16T05:59:12.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: high_pri_pool_ratio: 0.000 2023-12-16T05:59:12.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_cache_compressed: (nil) 2023-12-16T05:59:12.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: persistent_cache: (nil) 2023-12-16T05:59:12.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_size: 4096 2023-12-16T05:59:12.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_size_deviation: 10 2023-12-16T05:59:12.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_restart_interval: 16 2023-12-16T05:59:12.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: index_block_restart_interval: 1 2023-12-16T05:59:12.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: metadata_block_size: 4096 2023-12-16T05:59:12.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: partition_filters: 0 2023-12-16T05:59:12.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: use_delta_encoding: 1 2023-12-16T05:59:12.339 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: filter_policy: bloomfilter 2023-12-16T05:59:12.339 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: whole_key_filtering: 1 2023-12-16T05:59:12.339 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: verify_compression: 0 2023-12-16T05:59:12.339 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: read_amp_bytes_per_bit: 0 2023-12-16T05:59:12.339 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: format_version: 5 2023-12-16T05:59:12.339 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: enable_index_compression: 1 2023-12-16T05:59:12.339 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_align: 0 2023-12-16T05:59:12.340 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: max_auto_readahead_size: 262144 2023-12-16T05:59:12.340 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: prepopulate_block_cache: 0 2023-12-16T05:59:12.340 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: initial_auto_readahead_size: 8192 2023-12-16T05:59:12.340 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: num_file_reads_for_auto_readahead: 2 2023-12-16T05:59:12.340 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.write_buffer_size: 33554432 2023-12-16T05:59:12.340 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_write_buffer_number: 2 2023-12-16T05:59:12.340 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compression: NoCompression 2023-12-16T05:59:12.340 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.bottommost_compression: Disabled 2023-12-16T05:59:12.340 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.prefix_extractor: nullptr 2023-12-16T05:59:12.340 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-16T05:59:12.341 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.num_levels: 7 2023-12-16T05:59:12.341 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-16T05:59:12.341 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-16T05:59:12.341 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-16T05:59:12.341 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-16T05:59:12.341 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-16T05:59:12.341 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-16T05:59:12.341 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-16T05:59:12.342 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-16T05:59:12.342 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-16T05:59:12.342 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-16T05:59:12.342 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-16T05:59:12.342 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-16T05:59:12.342 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-16T05:59:12.342 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compression_opts.level: 32767 2023-12-16T05:59:12.342 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compression_opts.strategy: 0 2023-12-16T05:59:12.342 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-16T05:59:12.342 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-16T05:59:12.342 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-16T05:59:12.342 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-16T05:59:12.342 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compression_opts.enabled: false 2023-12-16T05:59:12.342 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-16T05:59:12.342 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-16T05:59:12.343 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-16T05:59:12.343 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-16T05:59:12.343 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.target_file_size_base: 67108864 2023-12-16T05:59:12.343 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-16T05:59:12.343 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-16T05:59:12.343 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-16T05:59:12.343 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-16T05:59:12.343 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-16T05:59:12.343 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-16T05:59:12.343 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-16T05:59:12.343 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-16T05:59:12.343 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-16T05:59:12.344 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-16T05:59:12.344 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-16T05:59:12.344 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-16T05:59:12.344 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-16T05:59:12.344 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-16T05:59:12.344 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.arena_block_size: 1048576 2023-12-16T05:59:12.344 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-16T05:59:12.344 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-16T05:59:12.344 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.disable_auto_compactions: 0 2023-12-16T05:59:12.344 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-16T05:59:12.345 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-16T05:59:12.345 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-16T05:59:12.345 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-16T05:59:12.345 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-16T05:59:12.345 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-16T05:59:12.345 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-16T05:59:12.345 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-16T05:59:12.345 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-16T05:59:12.345 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-16T05:59:12.345 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.table_properties_collectors: 2023-12-16T05:59:12.345 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.inplace_update_support: 0 2023-12-16T05:59:12.345 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-16T05:59:12.345 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-16T05:59:12.346 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-16T05:59:12.346 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-16T05:59:12.346 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.bloom_locality: 0 2023-12-16T05:59:12.346 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.max_successive_merges: 0 2023-12-16T05:59:12.346 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-16T05:59:12.346 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.paranoid_file_checks: 0 2023-12-16T05:59:12.346 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.force_consistency_checks: 1 2023-12-16T05:59:12.346 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.report_bg_io_stats: 0 2023-12-16T05:59:12.346 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.ttl: 2592000 2023-12-16T05:59:12.346 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-16T05:59:12.346 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-16T05:59:12.346 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-16T05:59:12.346 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.enable_blob_files: false 2023-12-16T05:59:12.346 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.min_blob_size: 0 2023-12-16T05:59:12.346 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.blob_file_size: 268435456 2023-12-16T05:59:12.347 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-16T05:59:12.347 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-16T05:59:12.347 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-16T05:59:12.347 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-16T05:59:12.347 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-16T05:59:12.347 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.blob_file_starting_level: 0 2023-12-16T05:59:12.347 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-16T05:59:12.347 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 30.sst 2023-12-16T05:59:12.347 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-16T05:59:12.347 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi155/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 32, last_sequence is 12096, log_number is 28,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-16T05:59:12.347 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 28 2023-12-16T05:59:12.348 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f94ff1fa-3b1e-4698-9559-19fb733f8acc 2023-12-16T05:59:12.348 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702706351873468, "job": 1, "event": "recovery_started", "wal_files": [28]} 2023-12-16T05:59:12.348 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #28 mode 2 2023-12-16T05:59:12.348 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702706351874026, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 33, "file_size": 27512, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12097, "largest_seqno": 12140, "table_properties": {"data_size": 26267, "index_size": 106, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 133, "raw_key_size": 933, "raw_average_key_size": 27, "raw_value_size": 25483, "raw_average_value_size": 749, "num_data_blocks": 5, "num_entries": 34, "num_filter_entries": 34, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702706351, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f94ff1fa-3b1e-4698-9559-19fb733f8acc", "db_session_id": "1U0RADKW9FVE7UD86ZET", "orig_file_number": 33, "seqno_to_time_mapping": "N/A"}} 2023-12-16T05:59:12.348 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702706351874129, "job": 1, "event": "recovery_finished"} 2023-12-16T05:59:12.348 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: [db/version_set.cc:5047] Creating manifest 35 2023-12-16T05:59:12.348 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-16T05:59:12.348 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi155/store.db/000028.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-16T05:59:12.348 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555d5264a000 2023-12-16T05:59:12.348 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: DB pointer 0x555d52638000 2023-12-16T05:59:12.348 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-16T05:59:12.348 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-16T05:59:12.348 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ** DB Stats ** 2023-12-16T05:59:12.348 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T05:59:12.349 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-16T05:59:12.349 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T05:59:12.349 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T05:59:12.349 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-16T05:59:12.349 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T05:59:12.349 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T05:59:12.349 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2023-12-16T05:59:12.349 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ** Compaction Stats [default] ** 2023-12-16T05:59:12.349 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-16T05:59:12.349 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-16T05:59:12.349 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: L0 1/0 26.87 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 66.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-12-16T05:59:12.349 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: L6 1/0 7.64 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-16T05:59:12.349 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Sum 2/0 7.67 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 66.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-12-16T05:59:12.350 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 66.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-12-16T05:59:12.350 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2023-12-16T05:59:12.350 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ** Compaction Stats [default] ** 2023-12-16T05:59:12.350 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-16T05:59:12.350 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T05:59:12.350 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 66.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-12-16T05:59:12.350 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2023-12-16T05:59:12.350 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-16T05:59:12.350 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2023-12-16T05:59:12.350 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T05:59:12.350 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-16T05:59:12.350 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T05:59:12.350 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T05:59:12.350 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T05:59:12.351 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T05:59:12.351 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Cumulative compaction: 0.00 GB write, 6.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T05:59:12.351 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Interval compaction: 0.00 GB write, 6.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T05:59:12.351 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T05:59:12.351 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Block cache BinnedLRUCache@0x555d525af090#7 capacity: 512.00 MB usage: 0.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-12-16T05:59:12.351 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.17 KB,3.27826e-05%) IndexBlock(1,0.19 KB,3.57628e-05%) Misc(1,0.00 KB,0%) 2023-12-16T05:59:12.351 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2023-12-16T05:59:12.351 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T05:59:12.351 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: starting mon.smithi155 rank 0 at public addrs [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] at bind addrs [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi155 fsid d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:59:12.351 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: mon.smithi155@-1(???) e2 preinit fsid d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:59:12.351 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: mon.smithi155@-1(???).mds e16 new map 2023-12-16T05:59:12.351 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: mon.smithi155@-1(???).mds e16 print_map 2023-12-16T05:59:12.351 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: e16 2023-12-16T05:59:12.351 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T05:59:12.352 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T05:59:12.352 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: legacy client fscid: 1 2023-12-16T05:59:12.352 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2023-12-16T05:59:12.352 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Filesystem 'cephfs' (1) 2023-12-16T05:59:12.352 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: fs_name cephfs 2023-12-16T05:59:12.352 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: epoch 16 2023-12-16T05:59:12.352 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-16T05:59:12.352 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: created 2023-12-16T05:54:25.897091+0000 2023-12-16T05:59:12.352 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: modified 2023-12-16T05:56:25.130480+0000 2023-12-16T05:59:12.352 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: tableserver 0 2023-12-16T05:59:12.352 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: root 0 2023-12-16T05:59:12.352 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: session_timeout 60 2023-12-16T05:59:12.352 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: session_autoclose 300 2023-12-16T05:59:12.352 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: max_file_size 1099511627776 2023-12-16T05:59:12.352 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: max_xattr_size 65536 2023-12-16T05:59:12.352 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: required_client_features {} 2023-12-16T05:59:12.353 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: last_failure 0 2023-12-16T05:59:12.353 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: last_failure_osd_epoch 0 2023-12-16T05:59:12.353 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T05:59:12.353 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: max_mds 2 2023-12-16T05:59:12.353 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: in 0,1 2023-12-16T05:59:12.353 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: up {0=14456,1=24281} 2023-12-16T05:59:12.353 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: failed 2023-12-16T05:59:12.353 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: damaged 2023-12-16T05:59:12.353 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: stopped 2023-12-16T05:59:12.353 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: data_pools [3] 2023-12-16T05:59:12.353 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: metadata_pool 2 2023-12-16T05:59:12.353 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: inline_data disabled 2023-12-16T05:59:12.354 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: balancer 2023-12-16T05:59:12.354 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: bal_rank_mask -1 2023-12-16T05:59:12.354 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: standby_count_wanted 1 2023-12-16T05:59:12.354 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: [mds.cephfs.smithi155.bzsxjw{0:14456} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.155:6826/1416140807,v1:172.21.15.155:6827/1416140807] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:59:12.354 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: [mds.cephfs.smithi156.fasing{0:24289} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1763385284,v1:172.21.15.156:6827/1763385284] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:59:12.354 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: [mds.cephfs.smithi156.qvgmfj{1:24281} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.156:6824/2823725296,v1:172.21.15.156:6825/2823725296] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:59:12.354 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: [mds.cephfs.smithi155.vicpis{1:14472} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.155:6828/750006619,v1:172.21.15.155:6829/750006619] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:59:12.354 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2023-12-16T05:59:12.354 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2023-12-16T05:59:12.354 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: mon.smithi155@-1(???).osd e46 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-16T05:59:12.354 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: mon.smithi155@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T05:59:12.354 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: mon.smithi155@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T05:59:12.355 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: mon.smithi155@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T05:59:12.355 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:11 smithi155 ceph-mon[217407]: mon.smithi155@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2023-12-16T05:59:13.660 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:13 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:59:13.660 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:13 smithi156 ceph-mon[121001]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:59:13.660 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:13 smithi156 ceph-mon[121001]: pgmap v58: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:59:13.660 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:13 smithi156 ceph-mon[121001]: mon.smithi155 calling monitor election 2023-12-16T05:59:13.661 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:13 smithi156 ceph-mon[121001]: mon.smithi155 is new leader, mons smithi155,smithi156 in quorum (ranks 0,1) 2023-12-16T05:59:13.661 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:13 smithi156 ceph-mon[121001]: monmap e2: 2 mons at {smithi155=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0],smithi156=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T05:59:13.661 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:13 smithi156 ceph-mon[121001]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby-replay 2023-12-16T05:59:13.661 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:13 smithi156 ceph-mon[121001]: osdmap e46: 6 total, 6 up, 6 in 2023-12-16T05:59:13.661 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:13 smithi156 ceph-mon[121001]: mgrmap e32: smithi155.maowdn(active, since 112s), standbys: smithi156.pclong 2023-12-16T05:59:13.661 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:13 smithi156 ceph-mon[121001]: from='mgr.14646 ' entity='' 2023-12-16T05:59:13.661 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:13 smithi156 ceph-mon[121001]: mgrmap e33: smithi155.maowdn(active, since 112s), standbys: smithi156.pclong 2023-12-16T05:59:13.661 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:13 smithi156 ceph-mon[121001]: overall HEALTH_OK 2023-12-16T05:59:13.667 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:13 smithi155 ceph-mon[217407]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:59:13.667 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:13 smithi155 ceph-mon[217407]: from='mgr.14646 172.21.15.155:0/125032623' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:59:13.667 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:13 smithi155 ceph-mon[217407]: pgmap v58: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:59:13.667 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:13 smithi155 ceph-mon[217407]: mon.smithi155 calling monitor election 2023-12-16T05:59:13.667 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:13 smithi155 ceph-mon[217407]: mon.smithi155 is new leader, mons smithi155,smithi156 in quorum (ranks 0,1) 2023-12-16T05:59:13.667 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:13 smithi155 ceph-mon[217407]: monmap e2: 2 mons at {smithi155=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0],smithi156=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T05:59:13.667 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:13 smithi155 ceph-mon[217407]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby-replay 2023-12-16T05:59:13.667 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:13 smithi155 ceph-mon[217407]: osdmap e46: 6 total, 6 up, 6 in 2023-12-16T05:59:13.667 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:13 smithi155 ceph-mon[217407]: mgrmap e32: smithi155.maowdn(active, since 112s), standbys: smithi156.pclong 2023-12-16T05:59:13.667 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:13 smithi155 ceph-mon[217407]: from='mgr.14646 ' entity='' 2023-12-16T05:59:13.667 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:13 smithi155 ceph-mon[217407]: mgrmap e33: smithi155.maowdn(active, since 112s), standbys: smithi156.pclong 2023-12-16T05:59:13.667 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:13 smithi155 ceph-mon[217407]: overall HEALTH_OK 2023-12-16T05:59:20.230 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: Standby manager daemon smithi156.pclong restarted 2023-12-16T05:59:20.230 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: Standby manager daemon smithi156.pclong started 2023-12-16T05:59:20.230 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.? 172.21.15.156:0/522640538' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.pclong/crt"}]: dispatch 2023-12-16T05:59:20.230 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.? 172.21.15.156:0/522640538' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T05:59:20.230 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.? 172.21.15.156:0/522640538' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.pclong/key"}]: dispatch 2023-12-16T05:59:20.231 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.? 172.21.15.156:0/522640538' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T05:59:20.231 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: Active manager daemon smithi155.maowdn restarted 2023-12-16T05:59:20.231 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: Activating manager daemon smithi155.maowdn 2023-12-16T05:59:20.231 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: osdmap e47: 6 total, 6 up, 6 in 2023-12-16T05:59:20.231 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: mgrmap e34: smithi155.maowdn(active, starting, since 0.00531036s), standbys: smithi156.pclong 2023-12-16T05:59:20.231 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:59:20.231 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:59:20.231 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.bzsxjw"}]: dispatch 2023-12-16T05:59:20.231 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.vicpis"}]: dispatch 2023-12-16T05:59:20.231 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.qvgmfj"}]: dispatch 2023-12-16T05:59:20.231 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.fasing"}]: dispatch 2023-12-16T05:59:20.231 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr metadata", "who": "smithi155.maowdn", "id": "smithi155.maowdn"}]: dispatch 2023-12-16T05:59:20.231 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr metadata", "who": "smithi156.pclong", "id": "smithi156.pclong"}]: dispatch 2023-12-16T05:59:20.231 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T05:59:20.232 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T05:59:20.232 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T05:59:20.232 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T05:59:20.232 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T05:59:20.232 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T05:59:20.232 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T05:59:20.232 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T05:59:20.232 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T05:59:20.232 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:20 smithi155 ceph-mon[217407]: Manager daemon smithi155.maowdn is now available 2023-12-16T05:59:20.237 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-mon-smithi156[120978]: 2023-12-16T05:59:20.113+0000 7f6b32f54700 -1 mon.smithi156@1(peon).osd e47 update_from_paxos full map CRC mismatch, resetting to canonical 2023-12-16T05:59:20.237 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: Standby manager daemon smithi156.pclong restarted 2023-12-16T05:59:20.237 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: Standby manager daemon smithi156.pclong started 2023-12-16T05:59:20.237 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.156:0/522640538' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.pclong/crt"}]: dispatch 2023-12-16T05:59:20.237 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.156:0/522640538' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T05:59:20.237 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.156:0/522640538' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.pclong/key"}]: dispatch 2023-12-16T05:59:20.237 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.? 172.21.15.156:0/522640538' entity='mgr.smithi156.pclong' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T05:59:20.237 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: Active manager daemon smithi155.maowdn restarted 2023-12-16T05:59:20.237 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: Activating manager daemon smithi155.maowdn 2023-12-16T05:59:20.237 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: osdmap e47: 6 total, 6 up, 6 in 2023-12-16T05:59:20.237 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: mgrmap e34: smithi155.maowdn(active, starting, since 0.00531036s), standbys: smithi156.pclong 2023-12-16T05:59:20.238 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:59:20.238 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:59:20.238 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.bzsxjw"}]: dispatch 2023-12-16T05:59:20.238 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.vicpis"}]: dispatch 2023-12-16T05:59:20.238 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.qvgmfj"}]: dispatch 2023-12-16T05:59:20.238 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.fasing"}]: dispatch 2023-12-16T05:59:20.238 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr metadata", "who": "smithi155.maowdn", "id": "smithi155.maowdn"}]: dispatch 2023-12-16T05:59:20.238 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr metadata", "who": "smithi156.pclong", "id": "smithi156.pclong"}]: dispatch 2023-12-16T05:59:20.238 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T05:59:20.238 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T05:59:20.238 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T05:59:20.238 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T05:59:20.238 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T05:59:20.238 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T05:59:20.239 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T05:59:20.239 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T05:59:20.239 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T05:59:20.239 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:20 smithi156 ceph-mon[121001]: Manager daemon smithi155.maowdn is now available 2023-12-16T05:59:21.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:21 smithi156 ceph-mon[121001]: failed to encode map e47 with expected crc 2023-12-16T05:59:21.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:21 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:59:21.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:21 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:59:21.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:21 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:59:21.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:21 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.maowdn/mirror_snapshot_schedule"}]: dispatch 2023-12-16T05:59:21.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:21 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.maowdn/trash_purge_schedule"}]: dispatch 2023-12-16T05:59:21.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:21 smithi156 ceph-mon[121001]: failed to encode map e47 with expected crc 2023-12-16T05:59:21.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:21 smithi156 ceph-mon[121001]: failed to encode map e47 with expected crc 2023-12-16T05:59:21.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:21 smithi156 ceph-mon[121001]: failed to encode map e47 with expected crc 2023-12-16T05:59:21.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:21 smithi156 ceph-mon[121001]: mgrmap e35: smithi155.maowdn(active, since 1.00944s), standbys: smithi156.pclong 2023-12-16T05:59:21.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:21 smithi155 ceph-mon[217407]: failed to encode map e47 with expected crc 2023-12-16T05:59:21.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:21 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:59:21.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:21 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:59:21.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:21 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:59:21.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:21 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.maowdn/mirror_snapshot_schedule"}]: dispatch 2023-12-16T05:59:21.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:21 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.maowdn/trash_purge_schedule"}]: dispatch 2023-12-16T05:59:21.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:21 smithi155 ceph-mon[217407]: failed to encode map e47 with expected crc 2023-12-16T05:59:21.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:21 smithi155 ceph-mon[217407]: failed to encode map e47 with expected crc 2023-12-16T05:59:21.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:21 smithi155 ceph-mon[217407]: failed to encode map e47 with expected crc 2023-12-16T05:59:21.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:21 smithi155 ceph-mon[217407]: mgrmap e35: smithi155.maowdn(active, since 1.00944s), standbys: smithi156.pclong 2023-12-16T05:59:22.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:22 smithi156 ceph-mon[121001]: [16/Dec/2023:05:59:20] ENGINE Bus STARTING 2023-12-16T05:59:22.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:22 smithi156 ceph-mon[121001]: [16/Dec/2023:05:59:20] ENGINE Serving on https://172.21.15.155:7150 2023-12-16T05:59:22.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:22 smithi156 ceph-mon[121001]: [16/Dec/2023:05:59:20] ENGINE Serving on http://172.21.15.155:8765 2023-12-16T05:59:22.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:22 smithi156 ceph-mon[121001]: [16/Dec/2023:05:59:20] ENGINE Bus STARTED 2023-12-16T05:59:22.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:22 smithi156 ceph-mon[121001]: pgmap v3: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:59:22.571 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:22 smithi155 ceph-mon[217407]: [16/Dec/2023:05:59:20] ENGINE Bus STARTING 2023-12-16T05:59:22.571 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:22 smithi155 ceph-mon[217407]: [16/Dec/2023:05:59:20] ENGINE Serving on https://172.21.15.155:7150 2023-12-16T05:59:22.571 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:22 smithi155 ceph-mon[217407]: [16/Dec/2023:05:59:20] ENGINE Serving on http://172.21.15.155:8765 2023-12-16T05:59:22.571 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:22 smithi155 ceph-mon[217407]: [16/Dec/2023:05:59:20] ENGINE Bus STARTED 2023-12-16T05:59:22.571 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:22 smithi155 ceph-mon[217407]: pgmap v3: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:59:23.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:23 smithi155 ceph-mon[217407]: pgmap v4: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:59:23.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:23 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:23.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:23 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:23.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:23 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:23.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:23 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:23.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:23 smithi155 ceph-mon[217407]: mgrmap e36: smithi155.maowdn(active, since 3s), standbys: smithi156.pclong 2023-12-16T05:59:23.590 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:23 smithi156 ceph-mon[121001]: pgmap v4: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:59:23.591 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:23 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:23.591 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:23 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:23.591 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:23 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:23.591 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:23 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:23.591 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:23 smithi156 ceph-mon[121001]: mgrmap e36: smithi155.maowdn(active, since 3s), standbys: smithi156.pclong 2023-12-16T05:59:25.267 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:24 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:25.268 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:24 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:25.268 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:24 smithi156 ceph-mon[121001]: pgmap v5: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:59:25.268 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:24 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:25.268 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:24 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:25.323 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:24 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:25.323 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:24 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:25.324 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:24 smithi155 ceph-mon[217407]: pgmap v5: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:59:25.324 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:24 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:25.324 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:24 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:26.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:26 smithi155 ceph-mon[217407]: mgrmap e37: smithi155.maowdn(active, since 4s), standbys: smithi156.pclong 2023-12-16T05:59:26.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:26 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:26.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:26 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:26.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:26 smithi156 ceph-mon[121001]: mgrmap e37: smithi155.maowdn(active, since 4s), standbys: smithi156.pclong 2023-12-16T05:59:26.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:26 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:26.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:26 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:27.274 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:27 smithi155 ceph-mon[217407]: Detected new or changed devices on smithi156 2023-12-16T05:59:27.274 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:27 smithi155 ceph-mon[217407]: pgmap v6: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:59:27.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:27 smithi156 ceph-mon[121001]: Detected new or changed devices on smithi156 2023-12-16T05:59:27.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:27 smithi156 ceph-mon[121001]: pgmap v6: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-16T05:59:28.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:28 smithi155 ceph-mon[217407]: Detected new or changed devices on smithi155 2023-12-16T05:59:28.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:28 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:28.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:28 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:28.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:28 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:28.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:28 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:59:28.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:28 smithi155 ceph-mon[217407]: Updating smithi155:/etc/ceph/ceph.conf 2023-12-16T05:59:28.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:28 smithi155 ceph-mon[217407]: Updating smithi156:/etc/ceph/ceph.conf 2023-12-16T05:59:28.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:28 smithi156 ceph-mon[121001]: Detected new or changed devices on smithi155 2023-12-16T05:59:28.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:28 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:28.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:28 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:28.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:28 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:28.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:28 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:59:28.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:28 smithi156 ceph-mon[121001]: Updating smithi155:/etc/ceph/ceph.conf 2023-12-16T05:59:28.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:28 smithi156 ceph-mon[121001]: Updating smithi156:/etc/ceph/ceph.conf 2023-12-16T05:59:29.493 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:29 smithi156 ceph-mon[121001]: Updating smithi155:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:59:29.494 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:29 smithi156 ceph-mon[121001]: Updating smithi156:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:59:29.494 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:29 smithi156 ceph-mon[121001]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2023-12-16T05:59:29.494 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:29 smithi156 ceph-mon[121001]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-12-16T05:59:29.494 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:29 smithi156 ceph-mon[121001]: Updating smithi156:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T05:59:29.494 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:29 smithi156 ceph-mon[121001]: Updating smithi155:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T05:59:29.494 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:29 smithi156 ceph-mon[121001]: pgmap v7: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2023-12-16T05:59:29.494 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:29 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:29.494 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:29 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:29.494 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:29 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:29.494 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:29 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:29.494 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:29 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:29.495 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:29 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:59:29.495 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:29 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:59:29.495 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:29 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-16T05:59:29.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:29 smithi155 ceph-mon[217407]: Updating smithi155:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:59:29.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:29 smithi155 ceph-mon[217407]: Updating smithi156:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T05:59:29.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:29 smithi155 ceph-mon[217407]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2023-12-16T05:59:29.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:29 smithi155 ceph-mon[217407]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-12-16T05:59:29.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:29 smithi155 ceph-mon[217407]: Updating smithi156:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T05:59:29.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:29 smithi155 ceph-mon[217407]: Updating smithi155:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T05:59:29.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:29 smithi155 ceph-mon[217407]: pgmap v7: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2023-12-16T05:59:29.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:29 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:29.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:29 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:29.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:29 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:29.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:29 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:29.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:29 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:29.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:29 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:59:29.828 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:29 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:59:29.829 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:29 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-16T05:59:30.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:30 smithi156 ceph-mon[121001]: Upgrade: Updating mon.smithi156 2023-12-16T05:59:30.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:30 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:30.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:30 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T05:59:30.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:30 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T05:59:30.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:30 smithi156 ceph-mon[121001]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:30.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:30 smithi156 ceph-mon[121001]: Deploying daemon mon.smithi156 on smithi156 2023-12-16T05:59:30.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:30 smithi156 ceph-mon[121001]: pgmap v8: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2023-12-16T05:59:30.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:30 smithi156 systemd[1]: Stopping Ceph mon.smithi156 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T05:59:30.878 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:30 smithi155 ceph-mon[217407]: Upgrade: Updating mon.smithi156 2023-12-16T05:59:30.878 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:30 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:30.878 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:30 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T05:59:30.878 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:30 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T05:59:30.879 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:30 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:30.879 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:30 smithi155 ceph-mon[217407]: Deploying daemon mon.smithi156 on smithi156 2023-12-16T05:59:30.879 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:30 smithi155 ceph-mon[217407]: pgmap v8: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2023-12-16T05:59:31.138 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:30 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-mon-smithi156[120978]: 2023-12-16T05:59:30.859+0000 7f6b3875f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi156 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T05:59:31.138 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:30 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-mon-smithi156[120978]: 2023-12-16T05:59:30.859+0000 7f6b3875f700 -1 mon.smithi156@1(peon) e2 *** Got Signal Terminated *** 2023-12-16T05:59:31.389 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 bash[181808]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715-mon-smithi156 2023-12-16T05:59:31.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 systemd[1]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715@mon.smithi156.service: Succeeded. 2023-12-16T05:59:31.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 systemd[1]: Stopped Ceph mon.smithi156 for d344784e-9bd6-11ee-95a5-87774f69a715. 2023-12-16T05:59:31.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 systemd[1]: Starting Ceph mon.smithi156 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T05:59:32.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 bash[181962]: 62dacb4d7a1709febe4e798a5842b46a320069388a122799b7b07977be69b87e 2023-12-16T05:59:32.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 systemd[1]: Started Ceph mon.smithi156 for d344784e-9bd6-11ee-95a5-87774f69a715. 2023-12-16T05:59:32.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: set uid:gid to 167:167 (ceph:ceph) 2023-12-16T05:59:32.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev), process ceph-mon, pid 7 2023-12-16T05:59:32.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: pidfile_write: ignore empty --pid-file 2023-12-16T05:59:32.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: load: jerasure load: lrc 2023-12-16T05:59:32.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: RocksDB version: 7.9.2 2023-12-16T05:59:32.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Git sha 0 2023-12-16T05:59:32.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Compile date 2023-12-15 16:32:04 2023-12-16T05:59:32.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: DB SUMMARY 2023-12-16T05:59:32.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: DB Session ID: 9ZG8N5DZMEX5XM586W32 2023-12-16T05:59:32.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: CURRENT file: CURRENT 2023-12-16T05:59:32.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: IDENTITY file: IDENTITY 2023-12-16T05:59:32.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: MANIFEST file: MANIFEST-000009 size: 897 Bytes 2023-12-16T05:59:32.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi156/store.db dir, Total Num: 1, files: 000024.sst 2023-12-16T05:59:32.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi156/store.db: 000022.log size: 2620183 ; 2023-12-16T05:59:32.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.error_if_exists: 0 2023-12-16T05:59:32.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.create_if_missing: 0 2023-12-16T05:59:32.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.paranoid_checks: 1 2023-12-16T05:59:32.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-16T05:59:32.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-16T05:59:32.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-16T05:59:32.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.env: 0x55f28d9f0a60 2023-12-16T05:59:32.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.fs: PosixFileSystem 2023-12-16T05:59:32.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.info_log: 0x55f2901e7620 2023-12-16T05:59:32.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_file_opening_threads: 16 2023-12-16T05:59:32.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.statistics: (nil) 2023-12-16T05:59:32.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.use_fsync: 0 2023-12-16T05:59:32.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_log_file_size: 0 2023-12-16T05:59:32.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-16T05:59:32.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-16T05:59:32.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.keep_log_file_num: 1000 2023-12-16T05:59:32.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.recycle_log_file_num: 0 2023-12-16T05:59:32.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.allow_fallocate: 1 2023-12-16T05:59:32.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.allow_mmap_reads: 0 2023-12-16T05:59:32.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.allow_mmap_writes: 0 2023-12-16T05:59:32.182 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.use_direct_reads: 0 2023-12-16T05:59:32.183 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-16T05:59:32.183 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.create_missing_column_families: 0 2023-12-16T05:59:32.184 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.db_log_dir: 2023-12-16T05:59:32.184 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.wal_dir: 2023-12-16T05:59:32.184 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-16T05:59:32.184 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-16T05:59:32.184 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-16T05:59:32.184 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-16T05:59:32.184 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-16T05:59:32.185 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-16T05:59:32.185 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.advise_random_on_open: 1 2023-12-16T05:59:32.185 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.db_write_buffer_size: 0 2023-12-16T05:59:32.185 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.write_buffer_manager: 0x55f29019d360 2023-12-16T05:59:32.185 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-16T05:59:32.185 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-16T05:59:32.185 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-16T05:59:32.185 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.rate_limiter: (nil) 2023-12-16T05:59:32.186 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-16T05:59:32.186 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.wal_recovery_mode: 2 2023-12-16T05:59:32.186 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.enable_thread_tracking: 0 2023-12-16T05:59:32.186 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.enable_pipelined_write: 0 2023-12-16T05:59:32.186 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.unordered_write: 0 2023-12-16T05:59:32.186 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-16T05:59:32.186 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-16T05:59:32.186 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-16T05:59:32.186 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-16T05:59:32.186 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.row_cache: None 2023-12-16T05:59:32.186 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.wal_filter: None 2023-12-16T05:59:32.186 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-16T05:59:32.186 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.allow_ingest_behind: 0 2023-12-16T05:59:32.187 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.two_write_queues: 0 2023-12-16T05:59:32.187 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.manual_wal_flush: 0 2023-12-16T05:59:32.187 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.wal_compression: 0 2023-12-16T05:59:32.187 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.atomic_flush: 0 2023-12-16T05:59:32.187 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-16T05:59:32.187 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-16T05:59:32.187 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-16T05:59:32.187 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.log_readahead_size: 0 2023-12-16T05:59:32.187 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-16T05:59:32.187 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.best_efforts_recovery: 0 2023-12-16T05:59:32.187 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-16T05:59:32.187 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-16T05:59:32.187 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.allow_data_in_errors: 0 2023-12-16T05:59:32.187 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.db_host_id: __hostname__ 2023-12-16T05:59:32.187 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-16T05:59:32.188 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_background_jobs: 2 2023-12-16T05:59:32.188 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_background_compactions: -1 2023-12-16T05:59:32.188 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_subcompactions: 1 2023-12-16T05:59:32.188 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-16T05:59:32.188 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-16T05:59:32.188 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-16T05:59:32.188 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_total_wal_size: 0 2023-12-16T05:59:32.188 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-16T05:59:32.188 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-16T05:59:32.188 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-16T05:59:32.188 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-16T05:59:32.188 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_open_files: -1 2023-12-16T05:59:32.188 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.bytes_per_sync: 0 2023-12-16T05:59:32.188 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-16T05:59:32.188 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-16T05:59:32.189 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compaction_readahead_size: 0 2023-12-16T05:59:32.189 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_background_flushes: -1 2023-12-16T05:59:32.189 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Compression algorithms supported: 2023-12-16T05:59:32.189 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-16T05:59:32.189 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: kZSTD supported: 0 2023-12-16T05:59:32.189 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: kXpressCompression supported: 0 2023-12-16T05:59:32.189 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: kLZ4HCCompression supported: 1 2023-12-16T05:59:32.189 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: kZlibCompression supported: 1 2023-12-16T05:59:32.189 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: kSnappyCompression supported: 1 2023-12-16T05:59:32.189 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: kLZ4Compression supported: 1 2023-12-16T05:59:32.189 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: kBZip2Compression supported: 0 2023-12-16T05:59:32.189 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-16T05:59:32.189 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-16T05:59:32.189 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi156/store.db/MANIFEST-000009 2023-12-16T05:59:32.189 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-16T05:59:32.190 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-16T05:59:32.190 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.merge_operator: 2023-12-16T05:59:32.190 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compaction_filter: None 2023-12-16T05:59:32.190 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compaction_filter_factory: None 2023-12-16T05:59:32.190 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.sst_partitioner_factory: None 2023-12-16T05:59:32.190 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-16T05:59:32.190 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-16T05:59:32.190 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f2901e7720) 2023-12-16T05:59:32.190 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: cache_index_and_filter_blocks: 1 2023-12-16T05:59:32.190 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-16T05:59:32.190 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-16T05:59:32.190 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: pin_top_level_index_and_filter: 1 2023-12-16T05:59:32.190 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: index_type: 0 2023-12-16T05:59:32.191 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: data_block_index_type: 0 2023-12-16T05:59:32.191 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: index_shortening: 1 2023-12-16T05:59:32.191 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-16T05:59:32.191 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: checksum: 4 2023-12-16T05:59:32.191 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: no_block_cache: 0 2023-12-16T05:59:32.191 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_cache: 0x55f29023d090 2023-12-16T05:59:32.191 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_cache_name: BinnedLRUCache 2023-12-16T05:59:32.191 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_cache_options: 2023-12-16T05:59:32.191 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: capacity : 536870912 2023-12-16T05:59:32.191 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: num_shard_bits : 4 2023-12-16T05:59:32.191 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: strict_capacity_limit : 0 2023-12-16T05:59:32.191 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: high_pri_pool_ratio: 0.000 2023-12-16T05:59:32.191 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_cache_compressed: (nil) 2023-12-16T05:59:32.191 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: persistent_cache: (nil) 2023-12-16T05:59:32.191 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_size: 4096 2023-12-16T05:59:32.192 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_size_deviation: 10 2023-12-16T05:59:32.192 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_restart_interval: 16 2023-12-16T05:59:32.192 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: index_block_restart_interval: 1 2023-12-16T05:59:32.192 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: metadata_block_size: 4096 2023-12-16T05:59:32.192 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: partition_filters: 0 2023-12-16T05:59:32.192 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: use_delta_encoding: 1 2023-12-16T05:59:32.192 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: filter_policy: bloomfilter 2023-12-16T05:59:32.192 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: whole_key_filtering: 1 2023-12-16T05:59:32.192 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: verify_compression: 0 2023-12-16T05:59:32.192 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: read_amp_bytes_per_bit: 0 2023-12-16T05:59:32.192 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: format_version: 5 2023-12-16T05:59:32.192 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: enable_index_compression: 1 2023-12-16T05:59:32.192 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_align: 0 2023-12-16T05:59:32.192 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: max_auto_readahead_size: 262144 2023-12-16T05:59:32.192 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: prepopulate_block_cache: 0 2023-12-16T05:59:32.192 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: initial_auto_readahead_size: 8192 2023-12-16T05:59:32.193 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: num_file_reads_for_auto_readahead: 2 2023-12-16T05:59:32.193 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.write_buffer_size: 33554432 2023-12-16T05:59:32.193 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_write_buffer_number: 2 2023-12-16T05:59:32.193 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compression: NoCompression 2023-12-16T05:59:32.193 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.bottommost_compression: Disabled 2023-12-16T05:59:32.193 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.prefix_extractor: nullptr 2023-12-16T05:59:32.193 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-16T05:59:32.193 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.num_levels: 7 2023-12-16T05:59:32.193 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-16T05:59:32.193 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-16T05:59:32.193 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-16T05:59:32.193 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-16T05:59:32.193 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-16T05:59:32.193 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-16T05:59:32.193 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-16T05:59:32.194 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-16T05:59:32.194 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-16T05:59:32.194 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-16T05:59:32.194 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-16T05:59:32.194 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-16T05:59:32.194 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-16T05:59:32.194 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compression_opts.level: 32767 2023-12-16T05:59:32.194 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compression_opts.strategy: 0 2023-12-16T05:59:32.194 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-16T05:59:32.194 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-16T05:59:32.194 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-16T05:59:32.194 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-16T05:59:32.194 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compression_opts.enabled: false 2023-12-16T05:59:32.194 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-16T05:59:32.194 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-16T05:59:32.195 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-16T05:59:32.195 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-16T05:59:32.195 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.target_file_size_base: 67108864 2023-12-16T05:59:32.195 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-16T05:59:32.195 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-16T05:59:32.195 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-16T05:59:32.195 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-16T05:59:32.195 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-16T05:59:32.195 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-16T05:59:32.195 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-16T05:59:32.195 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-16T05:59:32.195 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-16T05:59:32.195 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-16T05:59:32.195 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-16T05:59:32.195 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-16T05:59:32.195 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-16T05:59:32.196 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-16T05:59:32.196 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.arena_block_size: 1048576 2023-12-16T05:59:32.196 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-16T05:59:32.196 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-16T05:59:32.196 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.disable_auto_compactions: 0 2023-12-16T05:59:32.196 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-16T05:59:32.196 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-16T05:59:32.196 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-16T05:59:32.196 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-16T05:59:32.196 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-16T05:59:32.196 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-16T05:59:32.197 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-16T05:59:32.197 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-16T05:59:32.197 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-16T05:59:32.197 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-16T05:59:32.197 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.table_properties_collectors: 2023-12-16T05:59:32.197 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.inplace_update_support: 0 2023-12-16T05:59:32.197 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-16T05:59:32.197 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-16T05:59:32.197 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-16T05:59:32.197 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-16T05:59:32.197 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.bloom_locality: 0 2023-12-16T05:59:32.197 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.max_successive_merges: 0 2023-12-16T05:59:32.197 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-16T05:59:32.197 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.paranoid_file_checks: 0 2023-12-16T05:59:32.197 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.force_consistency_checks: 1 2023-12-16T05:59:32.198 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.report_bg_io_stats: 0 2023-12-16T05:59:32.198 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.ttl: 2592000 2023-12-16T05:59:32.198 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-16T05:59:32.198 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-16T05:59:32.198 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-16T05:59:32.198 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.enable_blob_files: false 2023-12-16T05:59:32.198 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.min_blob_size: 0 2023-12-16T05:59:32.198 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.blob_file_size: 268435456 2023-12-16T05:59:32.198 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-16T05:59:32.198 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-16T05:59:32.198 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-16T05:59:32.198 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-16T05:59:32.198 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-16T05:59:32.198 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.blob_file_starting_level: 0 2023-12-16T05:59:32.198 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-16T05:59:32.199 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 24.sst 2023-12-16T05:59:32.199 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-16T05:59:32.199 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi156/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 26, last_sequence is 12402, log_number is 22,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-16T05:59:32.199 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 22 2023-12-16T05:59:32.199 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8ad93002-ba1f-479e-961b-50dcf3d53670 2023-12-16T05:59:32.199 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702706371921768, "job": 1, "event": "recovery_started", "wal_files": [22]} 2023-12-16T05:59:32.199 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #22 mode 2 2023-12-16T05:59:32.199 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702706371928403, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 1662113, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12407, "largest_seqno": 12938, "table_properties": {"data_size": 1658923, "index_size": 1536, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 6263, "raw_average_key_size": 24, "raw_value_size": 1653331, "raw_average_value_size": 6509, "num_data_blocks": 69, "num_entries": 254, "num_filter_entries": 254, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702706371, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8ad93002-ba1f-479e-961b-50dcf3d53670", "db_session_id": "9ZG8N5DZMEX5XM586W32", "orig_file_number": 27, "seqno_to_time_mapping": "N/A"}} 2023-12-16T05:59:32.199 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702706371928508, "job": 1, "event": "recovery_finished"} 2023-12-16T05:59:32.199 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: [db/version_set.cc:5047] Creating manifest 29 2023-12-16T05:59:32.199 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-16T05:59:32.199 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi156/store.db/000022.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-16T05:59:32.199 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f2902d8000 2023-12-16T05:59:32.199 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: DB pointer 0x55f2902c6000 2023-12-16T05:59:32.199 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-16T05:59:32.200 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-16T05:59:32.200 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** DB Stats ** 2023-12-16T05:59:32.200 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T05:59:32.200 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-16T05:59:32.200 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T05:59:32.200 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T05:59:32.200 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-16T05:59:32.200 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T05:59:32.200 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T05:59:32.200 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2023-12-16T05:59:32.200 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** Compaction Stats [default] ** 2023-12-16T05:59:32.200 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-16T05:59:32.200 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-16T05:59:32.200 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: L0 1/0 1.59 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 516.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-16T05:59:32.200 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: L6 1/0 7.64 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-16T05:59:32.200 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Sum 2/0 9.23 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 516.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-16T05:59:32.201 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 516.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-16T05:59:32.201 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2023-12-16T05:59:32.201 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** Compaction Stats [default] ** 2023-12-16T05:59:32.201 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-16T05:59:32.201 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T05:59:32.201 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 516.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-16T05:59:32.201 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2023-12-16T05:59:32.201 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-16T05:59:32.201 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2023-12-16T05:59:32.201 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T05:59:32.201 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Flush(GB): cumulative 0.002, interval 0.002 2023-12-16T05:59:32.201 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T05:59:32.201 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T05:59:32.201 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T05:59:32.202 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T05:59:32.202 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Cumulative compaction: 0.00 GB write, 164.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T05:59:32.202 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Interval compaction: 0.00 GB write, 164.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T05:59:32.202 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T05:59:32.202 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Block cache BinnedLRUCache@0x55f29023d090#7 capacity: 512.00 MB usage: 2.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-12-16T05:59:32.202 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.72 KB,0.000137091%) IndexBlock(1,1.58 KB,0.000301003%) Misc(1,0.00 KB,0%) 2023-12-16T05:59:32.202 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2023-12-16T05:59:32.202 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T05:59:32.202 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: starting mon.smithi156 rank 1 at public addrs [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] at bind addrs [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi156 fsid d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:59:32.202 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: mon.smithi156@-1(???) e2 preinit fsid d344784e-9bd6-11ee-95a5-87774f69a715 2023-12-16T05:59:32.202 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: mon.smithi156@-1(???).mds e16 new map 2023-12-16T05:59:32.202 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: mon.smithi156@-1(???).mds e16 print_map 2023-12-16T05:59:32.203 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: e16 2023-12-16T05:59:32.203 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T05:59:32.203 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T05:59:32.203 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: legacy client fscid: 1 2023-12-16T05:59:32.203 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2023-12-16T05:59:32.203 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Filesystem 'cephfs' (1) 2023-12-16T05:59:32.203 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: fs_name cephfs 2023-12-16T05:59:32.203 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: epoch 16 2023-12-16T05:59:32.203 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-16T05:59:32.203 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: created 2023-12-16T05:54:25.897091+0000 2023-12-16T05:59:32.203 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: modified 2023-12-16T05:56:25.130480+0000 2023-12-16T05:59:32.203 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: tableserver 0 2023-12-16T05:59:32.203 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: root 0 2023-12-16T05:59:32.203 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: session_timeout 60 2023-12-16T05:59:32.203 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: session_autoclose 300 2023-12-16T05:59:32.204 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: max_file_size 1099511627776 2023-12-16T05:59:32.204 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: max_xattr_size 65536 2023-12-16T05:59:32.204 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: required_client_features {} 2023-12-16T05:59:32.204 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: last_failure 0 2023-12-16T05:59:32.204 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: last_failure_osd_epoch 0 2023-12-16T05:59:32.204 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T05:59:32.204 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: max_mds 2 2023-12-16T05:59:32.204 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: in 0,1 2023-12-16T05:59:32.204 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: up {0=14456,1=24281} 2023-12-16T05:59:32.204 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: failed 2023-12-16T05:59:32.204 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: damaged 2023-12-16T05:59:32.204 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: stopped 2023-12-16T05:59:32.204 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: data_pools [3] 2023-12-16T05:59:32.204 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: metadata_pool 2 2023-12-16T05:59:32.204 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: inline_data disabled 2023-12-16T05:59:32.205 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: balancer 2023-12-16T05:59:32.205 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: bal_rank_mask -1 2023-12-16T05:59:32.205 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: standby_count_wanted 1 2023-12-16T05:59:32.205 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: [mds.cephfs.smithi155.bzsxjw{0:14456} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.155:6826/1416140807,v1:172.21.15.155:6827/1416140807] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:59:32.205 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: [mds.cephfs.smithi156.fasing{0:24289} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1763385284,v1:172.21.15.156:6827/1763385284] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:59:32.205 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: [mds.cephfs.smithi156.qvgmfj{1:24281} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.156:6824/2823725296,v1:172.21.15.156:6825/2823725296] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:59:32.205 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: [mds.cephfs.smithi155.vicpis{1:14472} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.155:6828/750006619,v1:172.21.15.155:6829/750006619] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:59:32.205 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2023-12-16T05:59:32.205 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2023-12-16T05:59:32.205 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: mon.smithi156@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-16T05:59:32.205 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: mon.smithi156@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T05:59:32.205 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: mon.smithi156@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T05:59:32.205 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: mon.smithi156@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T05:59:32.205 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:31 smithi156 ceph-mon[182000]: mon.smithi156@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2023-12-16T05:59:33.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:33 smithi156 ceph-mon[182000]: overall HEALTH_OK 2023-12-16T05:59:33.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:33 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:59:33.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:33 smithi156 ceph-mon[182000]: mon.smithi156 calling monitor election 2023-12-16T05:59:33.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:33 smithi156 ceph-mon[182000]: mon.smithi155 calling monitor election 2023-12-16T05:59:33.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:33 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:59:33.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:33 smithi156 ceph-mon[182000]: mon.smithi155 is new leader, mons smithi155,smithi156 in quorum (ranks 0,1) 2023-12-16T05:59:33.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:33 smithi156 ceph-mon[182000]: monmap e3: 2 mons at {smithi155=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0],smithi156=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T05:59:33.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:33 smithi156 ceph-mon[182000]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby-replay 2023-12-16T05:59:33.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:33 smithi156 ceph-mon[182000]: osdmap e47: 6 total, 6 up, 6 in 2023-12-16T05:59:33.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:33 smithi156 ceph-mon[182000]: mgrmap e37: smithi155.maowdn(active, since 12s), standbys: smithi156.pclong 2023-12-16T05:59:33.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:33 smithi156 ceph-mon[182000]: overall HEALTH_OK 2023-12-16T05:59:33.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:33 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:33.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:33 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:33.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:33 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:59:34.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:33 smithi155 ceph-mon[217407]: overall HEALTH_OK 2023-12-16T05:59:34.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:33 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2023-12-16T05:59:34.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:33 smithi155 ceph-mon[217407]: mon.smithi156 calling monitor election 2023-12-16T05:59:34.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:33 smithi155 ceph-mon[217407]: mon.smithi155 calling monitor election 2023-12-16T05:59:34.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:33 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2023-12-16T05:59:34.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:33 smithi155 ceph-mon[217407]: mon.smithi155 is new leader, mons smithi155,smithi156 in quorum (ranks 0,1) 2023-12-16T05:59:34.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:33 smithi155 ceph-mon[217407]: monmap e3: 2 mons at {smithi155=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0],smithi156=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T05:59:34.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:33 smithi155 ceph-mon[217407]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby-replay 2023-12-16T05:59:34.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:33 smithi155 ceph-mon[217407]: osdmap e47: 6 total, 6 up, 6 in 2023-12-16T05:59:34.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:33 smithi155 ceph-mon[217407]: mgrmap e37: smithi155.maowdn(active, since 12s), standbys: smithi156.pclong 2023-12-16T05:59:34.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:33 smithi155 ceph-mon[217407]: overall HEALTH_OK 2023-12-16T05:59:34.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:33 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:34.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:33 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:34.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:33 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:59:35.635 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:35 smithi156 ceph-mon[182000]: pgmap v10: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2023-12-16T05:59:35.636 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:35 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:35.636 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:35 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:35.636 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:35 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:35.636 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:35 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:35.636 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:35 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:59:35.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:35 smithi155 ceph-mon[217407]: pgmap v10: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2023-12-16T05:59:35.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:35 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:35.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:35 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:35.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:35 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:35.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:35 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:35.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:35 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:59:37.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:37 smithi156 ceph-mon[182000]: pgmap v11: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2023-12-16T05:59:37.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:37 smithi155 ceph-mon[217407]: pgmap v11: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2023-12-16T05:59:38.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:38 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:38.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:38 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:38.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:38 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:38.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:38 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:59:38.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:38 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:38.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:38 smithi156 ceph-mon[182000]: Reconfiguring mon.smithi155 (monmap changed)... 2023-12-16T05:59:38.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:38 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T05:59:38.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:38 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T05:59:38.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:38 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:38.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:38 smithi156 ceph-mon[182000]: Reconfiguring daemon mon.smithi155 on smithi155 2023-12-16T05:59:38.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:38 smithi156 ceph-mon[182000]: pgmap v12: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2023-12-16T05:59:39.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:38 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:39.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:38 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:39.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:38 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:39.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:38 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T05:59:39.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:38 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:39.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:38 smithi155 ceph-mon[217407]: Reconfiguring mon.smithi155 (monmap changed)... 2023-12-16T05:59:39.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:38 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T05:59:39.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:38 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T05:59:39.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:38 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:39.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:38 smithi155 ceph-mon[217407]: Reconfiguring daemon mon.smithi155 on smithi155 2023-12-16T05:59:39.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:38 smithi155 ceph-mon[217407]: pgmap v12: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2023-12-16T05:59:40.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:39 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:40.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:39 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:40.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:39 smithi155 ceph-mon[217407]: Reconfiguring mgr.smithi155.maowdn (monmap changed)... 2023-12-16T05:59:40.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:39 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi155.maowdn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T05:59:40.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:39 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T05:59:40.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:39 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:40.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:39 smithi155 ceph-mon[217407]: Reconfiguring daemon mgr.smithi155.maowdn on smithi155 2023-12-16T05:59:40.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:39 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:40.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:39 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:40.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:39 smithi156 ceph-mon[182000]: Reconfiguring mgr.smithi155.maowdn (monmap changed)... 2023-12-16T05:59:40.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:39 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi155.maowdn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T05:59:40.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:39 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T05:59:40.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:39 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:40.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:39 smithi156 ceph-mon[182000]: Reconfiguring daemon mgr.smithi155.maowdn on smithi155 2023-12-16T05:59:41.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:40 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:41.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:40 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:41.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:40 smithi155 ceph-mon[217407]: Reconfiguring crash.smithi155 (monmap changed)... 2023-12-16T05:59:41.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:40 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi155", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T05:59:41.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:40 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:41.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:40 smithi155 ceph-mon[217407]: Reconfiguring daemon crash.smithi155 on smithi155 2023-12-16T05:59:41.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:40 smithi155 ceph-mon[217407]: pgmap v13: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:59:41.087 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.085+0000 7f5330926700 1 -- 172.21.15.155:0/3897379717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f532c065390 msgr2=0x7f532c065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:41.088 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.085+0000 7f5330926700 1 --2- 172.21.15.155:0/3897379717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f532c065390 0x7f532c065800 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5320004940 tx=0x7f5320009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:41.088 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.085+0000 7f5330926700 1 -- 172.21.15.155:0/3897379717 shutdown_connections 2023-12-16T05:59:41.088 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.085+0000 7f5330926700 1 --2- 172.21.15.155:0/3897379717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f532c065390 0x7f532c065800 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:41.088 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.085+0000 7f5330926700 1 --2- 172.21.15.155:0/3897379717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f532c102c20 0x7f532c102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:41.088 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.085+0000 7f5330926700 1 -- 172.21.15.155:0/3897379717 >> 172.21.15.155:0/3897379717 conn(0x7f532c0719b0 msgr2=0x7f532c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:41.088 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.085+0000 7f5330926700 1 -- 172.21.15.155:0/3897379717 shutdown_connections 2023-12-16T05:59:41.088 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.085+0000 7f5330926700 1 -- 172.21.15.155:0/3897379717 wait complete. 2023-12-16T05:59:41.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.085+0000 7f5330926700 1 Processor -- start 2023-12-16T05:59:41.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.085+0000 7f5330926700 1 -- start start 2023-12-16T05:59:41.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.086+0000 7f5330926700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f532c065390 0x7f532c113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:41.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.086+0000 7f5330926700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f532c102c20 0x7f532c113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:41.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.086+0000 7f5330926700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c1142c0 con 0x7f532c065390 2023-12-16T05:59:41.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.086+0000 7f5330926700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c10d5f0 con 0x7f532c102c20 2023-12-16T05:59:41.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.086+0000 7f532a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f532c065390 0x7f532c113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:41.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.086+0000 7f532a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f532c065390 0x7f532c113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:55902/0 (socket says 172.21.15.155:55902) 2023-12-16T05:59:41.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.086+0000 7f532a59c700 1 -- 172.21.15.155:0/3774741820 learned_addr learned my addr 172.21.15.155:0/3774741820 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:59:41.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.086+0000 7f5329d9b700 1 --2- 172.21.15.155:0/3774741820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f532c102c20 0x7f532c113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:41.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.086+0000 7f532a59c700 1 -- 172.21.15.155:0/3774741820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f532c102c20 msgr2=0x7f532c113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:41.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.086+0000 7f532a59c700 1 --2- 172.21.15.155:0/3774741820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f532c102c20 0x7f532c113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:41.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.086+0000 7f532a59c700 1 -- 172.21.15.155:0/3774741820 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5320005040 con 0x7f532c065390 2023-12-16T05:59:41.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.086+0000 7f5329d9b700 1 --2- 172.21.15.155:0/3774741820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f532c102c20 0x7f532c113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T05:59:41.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.086+0000 7f532a59c700 1 --2- 172.21.15.155:0/3774741820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f532c065390 0x7f532c113730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f531c00c8c0 tx=0x7f531c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:41.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.086+0000 7f531affd700 1 -- 172.21.15.155:0/3774741820 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f531c00a980 con 0x7f532c065390 2023-12-16T05:59:41.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.086+0000 7f531affd700 1 -- 172.21.15.155:0/3774741820 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f531c00ce60 con 0x7f532c065390 2023-12-16T05:59:41.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.086+0000 7f5330926700 1 -- 172.21.15.155:0/3774741820 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532c10d8d0 con 0x7f532c065390 2023-12-16T05:59:41.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.086+0000 7f531affd700 1 -- 172.21.15.155:0/3774741820 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f531c0113a0 con 0x7f532c065390 2023-12-16T05:59:41.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.086+0000 7f5330926700 1 -- 172.21.15.155:0/3774741820 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f532c10de10 con 0x7f532c065390 2023-12-16T05:59:41.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.087+0000 7f5330926700 1 -- 172.21.15.155:0/3774741820 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532c0fff40 con 0x7f532c065390 2023-12-16T05:59:41.092 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.088+0000 7f531affd700 1 -- 172.21.15.155:0/3774741820 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7f531c012400 con 0x7f532c065390 2023-12-16T05:59:41.092 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.088+0000 7f531affd700 1 --2- 172.21.15.155:0/3774741820 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f531406cf80 0x7f531406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:41.092 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.089+0000 7f531affd700 1 -- 172.21.15.155:0/3774741820 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f531c08cf10 con 0x7f532c065390 2023-12-16T05:59:41.092 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.089+0000 7f5329d9b700 1 --2- 172.21.15.155:0/3774741820 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f531406cf80 0x7f531406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:41.092 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.089+0000 7f5329d9b700 1 --2- 172.21.15.155:0/3774741820 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f531406cf80 0x7f531406f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f532c10e800 tx=0x7f5320009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:41.095 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.093+0000 7f531affd700 1 -- 172.21.15.155:0/3774741820 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f531c05a8e0 con 0x7f532c065390 2023-12-16T05:59:41.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:40 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:41.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:40 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:41.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:40 smithi156 ceph-mon[182000]: Reconfiguring crash.smithi155 (monmap changed)... 2023-12-16T05:59:41.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:40 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi155", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T05:59:41.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:40 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:41.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:40 smithi156 ceph-mon[182000]: Reconfiguring daemon crash.smithi155 on smithi155 2023-12-16T05:59:41.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:40 smithi156 ceph-mon[182000]: pgmap v13: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:59:41.329 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.326+0000 7f5330926700 1 -- 172.21.15.155:0/3774741820 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f532c04bbf0 con 0x7f531406cf80 2023-12-16T05:59:41.330 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.327+0000 7f531affd700 1 -- 172.21.15.155:0/3774741820 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f532c04bbf0 con 0x7f531406cf80 2023-12-16T05:59:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.330+0000 7f5330926700 1 -- 172.21.15.155:0/3774741820 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f531406cf80 msgr2=0x7f531406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.330+0000 7f5330926700 1 --2- 172.21.15.155:0/3774741820 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f531406cf80 0x7f531406f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f532c10e800 tx=0x7f5320009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.330+0000 7f5330926700 1 -- 172.21.15.155:0/3774741820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f532c065390 msgr2=0x7f532c113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.330+0000 7f5330926700 1 --2- 172.21.15.155:0/3774741820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f532c065390 0x7f532c113730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f531c00c8c0 tx=0x7f531c0044c0 comp rx=0 tx=0).stop 2023-12-16T05:59:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.330+0000 7f5330926700 1 -- 172.21.15.155:0/3774741820 shutdown_connections 2023-12-16T05:59:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.330+0000 7f5330926700 1 --2- 172.21.15.155:0/3774741820 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f531406cf80 0x7f531406f430 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.330+0000 7f5330926700 1 --2- 172.21.15.155:0/3774741820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f532c065390 0x7f532c113730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.330+0000 7f5330926700 1 --2- 172.21.15.155:0/3774741820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f532c102c20 0x7f532c113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.330+0000 7f5330926700 1 -- 172.21.15.155:0/3774741820 >> 172.21.15.155:0/3774741820 conn(0x7f532c0719b0 msgr2=0x7f532c0fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.330+0000 7f5330926700 1 -- 172.21.15.155:0/3774741820 shutdown_connections 2023-12-16T05:59:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.330+0000 7f5330926700 1 -- 172.21.15.155:0/3774741820 wait complete. 2023-12-16T05:59:41.343 INFO:teuthology.orchestra.run.smithi155.stdout:true 2023-12-16T05:59:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.438+0000 7f852e290700 1 -- 172.21.15.155:0/1747244504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8528065390 msgr2=0x7f8528065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.438+0000 7f852e290700 1 --2- 172.21.15.155:0/1747244504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8528065390 0x7f8528065800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f851c004940 tx=0x7f851c009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.438+0000 7f852e290700 1 -- 172.21.15.155:0/1747244504 shutdown_connections 2023-12-16T05:59:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.438+0000 7f852e290700 1 --2- 172.21.15.155:0/1747244504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8528065390 0x7f8528065800 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.438+0000 7f852e290700 1 --2- 172.21.15.155:0/1747244504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8528102c20 0x7f8528102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.438+0000 7f852e290700 1 -- 172.21.15.155:0/1747244504 >> 172.21.15.155:0/1747244504 conn(0x7f85280719b0 msgr2=0x7f8528071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.438+0000 7f852e290700 1 -- 172.21.15.155:0/1747244504 shutdown_connections 2023-12-16T05:59:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.438+0000 7f852e290700 1 -- 172.21.15.155:0/1747244504 wait complete. 2023-12-16T05:59:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.439+0000 7f852e290700 1 Processor -- start 2023-12-16T05:59:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.439+0000 7f852e290700 1 -- start start 2023-12-16T05:59:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.439+0000 7f852e290700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8528065390 0x7f8528113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.439+0000 7f852e290700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8528102c20 0x7f8528113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.439+0000 7f852e290700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85281142c0 con 0x7f8528102c20 2023-12-16T05:59:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.439+0000 7f852e290700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852810d5f0 con 0x7f8528065390 2023-12-16T05:59:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.439+0000 7f85277fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8528102c20 0x7f8528113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.439+0000 7f85277fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8528102c20 0x7f8528113c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:55910/0 (socket says 172.21.15.155:55910) 2023-12-16T05:59:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.439+0000 7f85277fe700 1 -- 172.21.15.155:0/1301502645 learned_addr learned my addr 172.21.15.155:0/1301502645 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:59:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.440+0000 7f8527fff700 1 --2- 172.21.15.155:0/1301502645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8528065390 0x7f8528113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.440+0000 7f85277fe700 1 -- 172.21.15.155:0/1301502645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8528065390 msgr2=0x7f8528113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.440+0000 7f85277fe700 1 --2- 172.21.15.155:0/1301502645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8528065390 0x7f8528113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.440+0000 7f85277fe700 1 -- 172.21.15.155:0/1301502645 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c005040 con 0x7f8528102c20 2023-12-16T05:59:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.440+0000 7f8527fff700 1 --2- 172.21.15.155:0/1301502645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8528065390 0x7f8528113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T05:59:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.440+0000 7f85277fe700 1 --2- 172.21.15.155:0/1301502645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8528102c20 0x7f8528113c70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f851c00b3b0 tx=0x7f851c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.440+0000 7f8524ff9700 1 -- 172.21.15.155:0/1301502645 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f851c00e040 con 0x7f8528102c20 2023-12-16T05:59:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.440+0000 7f8524ff9700 1 -- 172.21.15.155:0/1301502645 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f851c00bc50 con 0x7f8528102c20 2023-12-16T05:59:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.440+0000 7f8524ff9700 1 -- 172.21.15.155:0/1301502645 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f851c013420 con 0x7f8528102c20 2023-12-16T05:59:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.440+0000 7f852e290700 1 -- 172.21.15.155:0/1301502645 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852810d870 con 0x7f8528102c20 2023-12-16T05:59:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.440+0000 7f852e290700 1 -- 172.21.15.155:0/1301502645 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852810ddb0 con 0x7f8528102c20 2023-12-16T05:59:41.445 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.441+0000 7f852e290700 1 -- 172.21.15.155:0/1301502645 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85280fff40 con 0x7f8528102c20 2023-12-16T05:59:41.445 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.441+0000 7f8524ff9700 1 -- 172.21.15.155:0/1301502645 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7f851c01c430 con 0x7f8528102c20 2023-12-16T05:59:41.445 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.442+0000 7f8524ff9700 1 --2- 172.21.15.155:0/1301502645 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f851006cf80 0x7f851006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:41.445 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.442+0000 7f8524ff9700 1 -- 172.21.15.155:0/1301502645 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f851c08d2b0 con 0x7f8528102c20 2023-12-16T05:59:41.445 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.442+0000 7f8527fff700 1 --2- 172.21.15.155:0/1301502645 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f851006cf80 0x7f851006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:41.445 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.442+0000 7f8527fff700 1 --2- 172.21.15.155:0/1301502645 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f851006cf80 0x7f851006f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8518007fd0 tx=0x7f8518009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:41.453 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.450+0000 7f8524ff9700 1 -- 172.21.15.155:0/1301502645 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f851c05ab80 con 0x7f8528102c20 2023-12-16T05:59:41.681 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.679+0000 7f852e290700 1 -- 172.21.15.155:0/1301502645 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f852804bb80 con 0x7f851006cf80 2023-12-16T05:59:41.682 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.680+0000 7f8524ff9700 1 -- 172.21.15.155:0/1301502645 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f852804bb80 con 0x7f851006cf80 2023-12-16T05:59:41.684 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.682+0000 7f852e290700 1 -- 172.21.15.155:0/1301502645 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f851006cf80 msgr2=0x7f851006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.682+0000 7f852e290700 1 --2- 172.21.15.155:0/1301502645 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f851006cf80 0x7f851006f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8518007fd0 tx=0x7f8518009040 comp rx=0 tx=0).stop 2023-12-16T05:59:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.682+0000 7f852e290700 1 -- 172.21.15.155:0/1301502645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8528102c20 msgr2=0x7f8528113c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.682+0000 7f852e290700 1 --2- 172.21.15.155:0/1301502645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8528102c20 0x7f8528113c70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f851c00b3b0 tx=0x7f851c009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.682+0000 7f852e290700 1 -- 172.21.15.155:0/1301502645 shutdown_connections 2023-12-16T05:59:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.682+0000 7f852e290700 1 --2- 172.21.15.155:0/1301502645 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f851006cf80 0x7f851006f430 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.682+0000 7f852e290700 1 --2- 172.21.15.155:0/1301502645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8528065390 0x7f8528113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.682+0000 7f852e290700 1 --2- 172.21.15.155:0/1301502645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8528102c20 0x7f8528113c70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.682+0000 7f852e290700 1 -- 172.21.15.155:0/1301502645 >> 172.21.15.155:0/1301502645 conn(0x7f85280719b0 msgr2=0x7f85280fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.682+0000 7f852e290700 1 -- 172.21.15.155:0/1301502645 shutdown_connections 2023-12-16T05:59:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.682+0000 7f852e290700 1 -- 172.21.15.155:0/1301502645 wait complete. 2023-12-16T05:59:41.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.784+0000 7f82732e8700 1 -- 172.21.15.155:0/1629186821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826c065390 msgr2=0x7f826c065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:41.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.784+0000 7f82732e8700 1 --2- 172.21.15.155:0/1629186821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826c065390 0x7f826c065800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f825c004940 tx=0x7f825c009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:41.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.784+0000 7f82732e8700 1 -- 172.21.15.155:0/1629186821 shutdown_connections 2023-12-16T05:59:41.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.784+0000 7f82732e8700 1 --2- 172.21.15.155:0/1629186821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826c065390 0x7f826c065800 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:41.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.784+0000 7f82732e8700 1 --2- 172.21.15.155:0/1629186821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f826c102c20 0x7f826c102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:41.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.784+0000 7f82732e8700 1 -- 172.21.15.155:0/1629186821 >> 172.21.15.155:0/1629186821 conn(0x7f826c0719b0 msgr2=0x7f826c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:41.787 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.784+0000 7f82732e8700 1 -- 172.21.15.155:0/1629186821 shutdown_connections 2023-12-16T05:59:41.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.784+0000 7f82732e8700 1 -- 172.21.15.155:0/1629186821 wait complete. 2023-12-16T05:59:41.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.785+0000 7f82732e8700 1 Processor -- start 2023-12-16T05:59:41.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.785+0000 7f82732e8700 1 -- start start 2023-12-16T05:59:41.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.785+0000 7f82732e8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f826c065390 0x7f826c0fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:41.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.785+0000 7f82732e8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826c102c20 0x7f826c0fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:41.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.785+0000 7f82732e8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c0fc730 con 0x7f826c102c20 2023-12-16T05:59:41.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.785+0000 7f82732e8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c0fc8a0 con 0x7f826c065390 2023-12-16T05:59:41.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.785+0000 7f8270883700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826c102c20 0x7f826c0fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:41.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.785+0000 7f8270883700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826c102c20 0x7f826c0fc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:55918/0 (socket says 172.21.15.155:55918) 2023-12-16T05:59:41.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.785+0000 7f8270883700 1 -- 172.21.15.155:0/518732633 learned_addr learned my addr 172.21.15.155:0/518732633 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:59:41.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.785+0000 7f8271084700 1 --2- 172.21.15.155:0/518732633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f826c065390 0x7f826c0fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:41.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.785+0000 7f8270883700 1 -- 172.21.15.155:0/518732633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f826c065390 msgr2=0x7f826c0fbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:41.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.785+0000 7f8270883700 1 --2- 172.21.15.155:0/518732633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f826c065390 0x7f826c0fbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:41.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.785+0000 7f8270883700 1 -- 172.21.15.155:0/518732633 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c005040 con 0x7f826c102c20 2023-12-16T05:59:41.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.785+0000 7f8270883700 1 --2- 172.21.15.155:0/518732633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826c102c20 0x7f826c0fc130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f825c00b3b0 tx=0x7f825c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:41.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.786+0000 7f8261ffb700 1 -- 172.21.15.155:0/518732633 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f825c00e040 con 0x7f826c102c20 2023-12-16T05:59:41.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.786+0000 7f8261ffb700 1 -- 172.21.15.155:0/518732633 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f825c00bc50 con 0x7f826c102c20 2023-12-16T05:59:41.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.786+0000 7f82732e8700 1 -- 172.21.15.155:0/518732633 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f826c119970 con 0x7f826c102c20 2023-12-16T05:59:41.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.786+0000 7f8261ffb700 1 -- 172.21.15.155:0/518732633 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f825c013420 con 0x7f826c102c20 2023-12-16T05:59:41.791 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.786+0000 7f82732e8700 1 -- 172.21.15.155:0/518732633 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f826c119dd0 con 0x7f826c102c20 2023-12-16T05:59:41.791 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.787+0000 7f82732e8700 1 -- 172.21.15.155:0/518732633 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f826c0fff40 con 0x7f826c102c20 2023-12-16T05:59:41.791 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.787+0000 7f8261ffb700 1 -- 172.21.15.155:0/518732633 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7f825c01c430 con 0x7f826c102c20 2023-12-16T05:59:41.791 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.788+0000 7f8261ffb700 1 --2- 172.21.15.155:0/518732633 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f825806cf80 0x7f825806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:41.791 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.788+0000 7f8271084700 1 --2- 172.21.15.155:0/518732633 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f825806cf80 0x7f825806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:41.791 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.788+0000 7f8261ffb700 1 -- 172.21.15.155:0/518732633 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f825c08d2b0 con 0x7f826c102c20 2023-12-16T05:59:41.791 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.788+0000 7f8271084700 1 --2- 172.21.15.155:0/518732633 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f825806cf80 0x7f825806f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8268007fd0 tx=0x7f8268009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:41.795 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:41.792+0000 7f8261ffb700 1 -- 172.21.15.155:0/518732633 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f825c0570f0 con 0x7f826c102c20 2023-12-16T05:59:42.010 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.007+0000 7f82732e8700 1 -- 172.21.15.155:0/518732633 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f826c04bc20 con 0x7f825806cf80 2023-12-16T05:59:42.020 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.018+0000 7f8261ffb700 1 -- 172.21.15.155:0/518732633 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f8268004db0 con 0x7f825806cf80 2023-12-16T05:59:42.020 INFO:teuthology.orchestra.run.smithi155.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T05:59:42.020 INFO:teuthology.orchestra.run.smithi155.stdout:alertmanager.smithi155 smithi155 *:9093,9094 running (85s) 18s ago 8m 15.7M - 0.25.0 c8568f914cd2 e1da85d6fc09 2023-12-16T05:59:42.021 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi155 smithi155 running (9m) 18s ago 9m 7444k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 033f79f53811 2023-12-16T05:59:42.021 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi156 smithi156 running (8m) 7s ago 8m 7470k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 c72bd1a1d00a 2023-12-16T05:59:42.021 INFO:teuthology.orchestra.run.smithi155.stdout:grafana.smithi155 smithi155 *:3000 running (75s) 18s ago 8m 82.2M - 9.4.12 a0ea5e3c46d9 a16c84704784 2023-12-16T05:59:42.021 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.bzsxjw smithi155 running (5m) 18s ago 5m 4745M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6bcabf94a5c3 2023-12-16T05:59:42.021 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.vicpis smithi155 running (5m) 18s ago 5m 668M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 afa64e1ef8da 2023-12-16T05:59:42.021 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.fasing smithi156 running (5m) 7s ago 5m 538M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 7d97160bda7c 2023-12-16T05:59:42.021 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.qvgmfj smithi156 running (5m) 7s ago 5m 5969M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4018b2f2e27e 2023-12-16T05:59:42.021 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi155.maowdn smithi155 *:8443,9283,8765 running (2m) 18s ago 9m 479M - 19.0.0-191-g6d933094 a29c258b5d6f ee39089d18d3 2023-12-16T05:59:42.021 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi156.pclong smithi156 *:8443,9283,8765 running (2m) 7s ago 8m 447M - 19.0.0-191-g6d933094 a29c258b5d6f 673376e357e8 2023-12-16T05:59:42.021 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi155 smithi155 running (30s) 18s ago 10m 29.0M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 19eb23d9f064 2023-12-16T05:59:42.021 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi156 smithi156 running (10s) 7s ago 8m 23.5M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 62dacb4d7a17 2023-12-16T05:59:42.021 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi155 smithi155 *:9100 running (114s) 18s ago 8m 15.4M - 1.5.0 0da6a335fe13 6f0f1f68f191 2023-12-16T05:59:42.021 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi156 smithi156 *:9100 running (109s) 7s ago 8m 17.9M - 1.5.0 0da6a335fe13 c4595a7b1707 2023-12-16T05:59:42.021 INFO:teuthology.orchestra.run.smithi155.stdout:osd.0 smithi155 running (7m) 18s ago 7m 785M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 91e650c277f7 2023-12-16T05:59:42.022 INFO:teuthology.orchestra.run.smithi155.stdout:osd.1 smithi155 running (7m) 18s ago 7m 861M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957303cb6598 2023-12-16T05:59:42.022 INFO:teuthology.orchestra.run.smithi155.stdout:osd.2 smithi155 running (7m) 18s ago 7m 628M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957a169c1cac 2023-12-16T05:59:42.022 INFO:teuthology.orchestra.run.smithi155.stdout:osd.3 smithi156 running (6m) 7s ago 6m 958M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c4f6c54afe99 2023-12-16T05:59:42.022 INFO:teuthology.orchestra.run.smithi155.stdout:osd.4 smithi156 running (6m) 7s ago 6m 739M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 6309b12204fd 2023-12-16T05:59:42.022 INFO:teuthology.orchestra.run.smithi155.stdout:osd.5 smithi156 running (6m) 7s ago 6m 853M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 84b2c33eb0e1 2023-12-16T05:59:42.022 INFO:teuthology.orchestra.run.smithi155.stdout:prometheus.smithi155 smithi155 *:9095 running (96s) 18s ago 8m 50.7M - 2.43.0 a07b618ecd1d 26bb7cfc1b8b 2023-12-16T05:59:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.020+0000 7f82732e8700 1 -- 172.21.15.155:0/518732633 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f825806cf80 msgr2=0x7f825806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.020+0000 7f82732e8700 1 --2- 172.21.15.155:0/518732633 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f825806cf80 0x7f825806f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8268007fd0 tx=0x7f8268009040 comp rx=0 tx=0).stop 2023-12-16T05:59:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.020+0000 7f82732e8700 1 -- 172.21.15.155:0/518732633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826c102c20 msgr2=0x7f826c0fc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.020+0000 7f82732e8700 1 --2- 172.21.15.155:0/518732633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826c102c20 0x7f826c0fc130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f825c00b3b0 tx=0x7f825c009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.020+0000 7f82732e8700 1 -- 172.21.15.155:0/518732633 shutdown_connections 2023-12-16T05:59:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.020+0000 7f82732e8700 1 --2- 172.21.15.155:0/518732633 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f825806cf80 0x7f825806f430 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.020+0000 7f82732e8700 1 --2- 172.21.15.155:0/518732633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f826c065390 0x7f826c0fbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.020+0000 7f82732e8700 1 --2- 172.21.15.155:0/518732633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826c102c20 0x7f826c0fc130 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.020+0000 7f82732e8700 1 -- 172.21.15.155:0/518732633 >> 172.21.15.155:0/518732633 conn(0x7f826c0719b0 msgr2=0x7f826c0fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.020+0000 7f82732e8700 1 -- 172.21.15.155:0/518732633 shutdown_connections 2023-12-16T05:59:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.020+0000 7f82732e8700 1 -- 172.21.15.155:0/518732633 wait complete. 2023-12-16T05:59:42.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:41 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:42.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:41 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:42.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:41 smithi155 ceph-mon[217407]: Reconfiguring osd.0 (monmap changed)... 2023-12-16T05:59:42.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:41 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T05:59:42.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:41 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:42.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:41 smithi155 ceph-mon[217407]: Reconfiguring daemon osd.0 on smithi155 2023-12-16T05:59:42.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:41 smithi155 ceph-mon[217407]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:59:42.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.125+0000 7feaedd7c700 1 -- 172.21.15.155:0/1957187678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feae8065390 msgr2=0x7feae8065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:42.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.125+0000 7feaedd7c700 1 --2- 172.21.15.155:0/1957187678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feae8065390 0x7feae8065800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feadc004940 tx=0x7feadc009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:42.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.125+0000 7feaedd7c700 1 -- 172.21.15.155:0/1957187678 shutdown_connections 2023-12-16T05:59:42.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.125+0000 7feaedd7c700 1 --2- 172.21.15.155:0/1957187678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feae8065390 0x7feae8065800 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:42.129 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.125+0000 7feaedd7c700 1 --2- 172.21.15.155:0/1957187678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feae8102c20 0x7feae8102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:42.129 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.125+0000 7feaedd7c700 1 -- 172.21.15.155:0/1957187678 >> 172.21.15.155:0/1957187678 conn(0x7feae80719b0 msgr2=0x7feae8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:42.129 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.126+0000 7feaedd7c700 1 -- 172.21.15.155:0/1957187678 shutdown_connections 2023-12-16T05:59:42.129 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.126+0000 7feaedd7c700 1 -- 172.21.15.155:0/1957187678 wait complete. 2023-12-16T05:59:42.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.126+0000 7feaedd7c700 1 Processor -- start 2023-12-16T05:59:42.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.126+0000 7feaedd7c700 1 -- start start 2023-12-16T05:59:42.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.127+0000 7feaedd7c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feae8065390 0x7feae8113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:42.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.127+0000 7feaedd7c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feae8102c20 0x7feae8113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:42.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.127+0000 7feaedd7c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae81142c0 con 0x7feae8102c20 2023-12-16T05:59:42.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.127+0000 7feaedd7c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae810d5f0 con 0x7feae8065390 2023-12-16T05:59:42.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.127+0000 7feae6ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feae8102c20 0x7feae8113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:42.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.127+0000 7feae6ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feae8102c20 0x7feae8113c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:55936/0 (socket says 172.21.15.155:55936) 2023-12-16T05:59:42.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.127+0000 7feae6ffd700 1 -- 172.21.15.155:0/673643395 learned_addr learned my addr 172.21.15.155:0/673643395 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:59:42.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.127+0000 7feae77fe700 1 --2- 172.21.15.155:0/673643395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feae8065390 0x7feae8113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:42.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.127+0000 7feae6ffd700 1 -- 172.21.15.155:0/673643395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feae8065390 msgr2=0x7feae8113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:42.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.127+0000 7feae6ffd700 1 --2- 172.21.15.155:0/673643395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feae8065390 0x7feae8113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:42.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.127+0000 7feae6ffd700 1 -- 172.21.15.155:0/673643395 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc005040 con 0x7feae8102c20 2023-12-16T05:59:42.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.127+0000 7feae6ffd700 1 --2- 172.21.15.155:0/673643395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feae8102c20 0x7feae8113c70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feadc00b3b0 tx=0x7feadc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:42.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.128+0000 7feacffff700 1 -- 172.21.15.155:0/673643395 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feadc00e040 con 0x7feae8102c20 2023-12-16T05:59:42.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.128+0000 7feacffff700 1 -- 172.21.15.155:0/673643395 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feadc01c430 con 0x7feae8102c20 2023-12-16T05:59:42.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.128+0000 7feacffff700 1 -- 172.21.15.155:0/673643395 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feadc013640 con 0x7feae8102c20 2023-12-16T05:59:42.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.128+0000 7feaedd7c700 1 -- 172.21.15.155:0/673643395 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae810d870 con 0x7feae8102c20 2023-12-16T05:59:42.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.128+0000 7feaedd7c700 1 -- 172.21.15.155:0/673643395 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae810ddb0 con 0x7feae8102c20 2023-12-16T05:59:42.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.129+0000 7feaedd7c700 1 -- 172.21.15.155:0/673643395 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae80fff40 con 0x7feae8102c20 2023-12-16T05:59:42.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.129+0000 7feacffff700 1 -- 172.21.15.155:0/673643395 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7feadc01c5a0 con 0x7feae8102c20 2023-12-16T05:59:42.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.130+0000 7feacffff700 1 --2- 172.21.15.155:0/673643395 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fead006cf80 0x7fead006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:42.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.130+0000 7feacffff700 1 -- 172.21.15.155:0/673643395 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6328+0+0 (secure 0 0 0) 0x7feadc08d020 con 0x7feae8102c20 2023-12-16T05:59:42.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.130+0000 7feae77fe700 1 --2- 172.21.15.155:0/673643395 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fead006cf80 0x7fead006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:42.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.130+0000 7feae77fe700 1 --2- 172.21.15.155:0/673643395 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fead006cf80 0x7fead006f430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fead8004f40 tx=0x7fead800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:42.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.134+0000 7feacffff700 1 -- 172.21.15.155:0/673643395 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7feadc05a8f0 con 0x7feae8102c20 2023-12-16T05:59:42.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:41 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:42.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:41 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:42.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:41 smithi156 ceph-mon[182000]: Reconfiguring osd.0 (monmap changed)... 2023-12-16T05:59:42.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:41 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T05:59:42.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:41 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:42.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:41 smithi156 ceph-mon[182000]: Reconfiguring daemon osd.0 on smithi155 2023-12-16T05:59:42.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:41 smithi156 ceph-mon[182000]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:59:42.423 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.420+0000 7feaedd7c700 1 -- 172.21.15.155:0/673643395 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7feae80734d0 con 0x7feae8102c20 2023-12-16T05:59:42.423 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.421+0000 7feacffff700 1 -- 172.21.15.155:0/673643395 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+730 (secure 0 0 0) 0x7feadc05a480 con 0x7feae8102c20 2023-12-16T05:59:42.423 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T05:59:42.424 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": { 2023-12-16T05:59:42.424 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T05:59:42.424 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:59:42.424 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": { 2023-12-16T05:59:42.424 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T05:59:42.424 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:59:42.424 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": { 2023-12-16T05:59:42.424 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T05:59:42.424 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:59:42.424 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2023-12-16T05:59:42.424 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T05:59:42.424 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T05:59:42.424 INFO:teuthology.orchestra.run.smithi155.stdout: "overall": { 2023-12-16T05:59:42.425 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 10, 2023-12-16T05:59:42.425 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 4 2023-12-16T05:59:42.425 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-12-16T05:59:42.425 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T05:59:42.425 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.423+0000 7feaedd7c700 1 -- 172.21.15.155:0/673643395 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fead006cf80 msgr2=0x7fead006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:42.425 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.423+0000 7feaedd7c700 1 --2- 172.21.15.155:0/673643395 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fead006cf80 0x7fead006f430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fead8004f40 tx=0x7fead800b040 comp rx=0 tx=0).stop 2023-12-16T05:59:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.423+0000 7feaedd7c700 1 -- 172.21.15.155:0/673643395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feae8102c20 msgr2=0x7feae8113c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.423+0000 7feaedd7c700 1 --2- 172.21.15.155:0/673643395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feae8102c20 0x7feae8113c70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feadc00b3b0 tx=0x7feadc009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.423+0000 7feaedd7c700 1 -- 172.21.15.155:0/673643395 shutdown_connections 2023-12-16T05:59:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.423+0000 7feaedd7c700 1 --2- 172.21.15.155:0/673643395 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fead006cf80 0x7fead006f430 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.423+0000 7feaedd7c700 1 --2- 172.21.15.155:0/673643395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feae8065390 0x7feae8113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.423+0000 7feaedd7c700 1 --2- 172.21.15.155:0/673643395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feae8102c20 0x7feae8113c70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.423+0000 7feaedd7c700 1 -- 172.21.15.155:0/673643395 >> 172.21.15.155:0/673643395 conn(0x7feae80719b0 msgr2=0x7feae80fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.423+0000 7feaedd7c700 1 -- 172.21.15.155:0/673643395 shutdown_connections 2023-12-16T05:59:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.423+0000 7feaedd7c700 1 -- 172.21.15.155:0/673643395 wait complete. 2023-12-16T05:59:42.534 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.531+0000 7fb643c85700 1 -- 172.21.15.155:0/2411597455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb63c101b00 msgr2=0x7fb63c101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:42.534 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.531+0000 7fb643c85700 1 --2- 172.21.15.155:0/2411597455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb63c101b00 0x7fb63c101ed0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb62c004940 tx=0x7fb62c009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:42.534 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.531+0000 7fb643c85700 1 -- 172.21.15.155:0/2411597455 shutdown_connections 2023-12-16T05:59:42.534 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.531+0000 7fb643c85700 1 --2- 172.21.15.155:0/2411597455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb63c0fbb40 0x7fb63c0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:42.535 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.531+0000 7fb643c85700 1 --2- 172.21.15.155:0/2411597455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb63c101b00 0x7fb63c101ed0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:42.535 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.531+0000 7fb643c85700 1 -- 172.21.15.155:0/2411597455 >> 172.21.15.155:0/2411597455 conn(0x7fb63c0719b0 msgr2=0x7fb63c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:42.535 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.531+0000 7fb643c85700 1 -- 172.21.15.155:0/2411597455 shutdown_connections 2023-12-16T05:59:42.535 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.531+0000 7fb643c85700 1 -- 172.21.15.155:0/2411597455 wait complete. 2023-12-16T05:59:42.536 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.532+0000 7fb643c85700 1 Processor -- start 2023-12-16T05:59:42.536 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.532+0000 7fb643c85700 1 -- start start 2023-12-16T05:59:42.537 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.532+0000 7fb643c85700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb63c0fbb40 0x7fb63c10e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:42.537 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.532+0000 7fb643c85700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb63c101b00 0x7fb63c10ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:42.537 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.532+0000 7fb643c85700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c10f1c0 con 0x7fb63c0fbb40 2023-12-16T05:59:42.537 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.532+0000 7fb643c85700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c10f300 con 0x7fb63c101b00 2023-12-16T05:59:42.537 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.532+0000 7fb641a21700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb63c0fbb40 0x7fb63c10e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:42.537 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.533+0000 7fb641a21700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb63c0fbb40 0x7fb63c10e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:55948/0 (socket says 172.21.15.155:55948) 2023-12-16T05:59:42.537 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.533+0000 7fb641a21700 1 -- 172.21.15.155:0/1456721054 learned_addr learned my addr 172.21.15.155:0/1456721054 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:59:42.537 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.533+0000 7fb641220700 1 --2- 172.21.15.155:0/1456721054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb63c101b00 0x7fb63c10ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:42.537 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.533+0000 7fb641a21700 1 -- 172.21.15.155:0/1456721054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb63c101b00 msgr2=0x7fb63c10ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:42.537 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.533+0000 7fb641a21700 1 --2- 172.21.15.155:0/1456721054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb63c101b00 0x7fb63c10ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:42.537 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.533+0000 7fb641a21700 1 -- 172.21.15.155:0/1456721054 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c005040 con 0x7fb63c0fbb40 2023-12-16T05:59:42.537 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.533+0000 7fb641a21700 1 --2- 172.21.15.155:0/1456721054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb63c0fbb40 0x7fb63c10e6f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00b3b0 tx=0x7fb62c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:42.537 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.533+0000 7fb6327fc700 1 -- 172.21.15.155:0/1456721054 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb62c00e040 con 0x7fb63c0fbb40 2023-12-16T05:59:42.537 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.533+0000 7fb6327fc700 1 -- 172.21.15.155:0/1456721054 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb62c01c430 con 0x7fb63c0fbb40 2023-12-16T05:59:42.538 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.533+0000 7fb643c85700 1 -- 172.21.15.155:0/1456721054 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63c117600 con 0x7fb63c0fbb40 2023-12-16T05:59:42.538 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.533+0000 7fb6327fc700 1 -- 172.21.15.155:0/1456721054 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb62c013640 con 0x7fb63c0fbb40 2023-12-16T05:59:42.538 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.533+0000 7fb643c85700 1 -- 172.21.15.155:0/1456721054 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63c117b10 con 0x7fb63c0fbb40 2023-12-16T05:59:42.538 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.534+0000 7fb643c85700 1 -- 172.21.15.155:0/1456721054 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63c103fb0 con 0x7fb63c0fbb40 2023-12-16T05:59:42.539 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.535+0000 7fb6327fc700 1 -- 172.21.15.155:0/1456721054 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7fb62c01c5a0 con 0x7fb63c0fbb40 2023-12-16T05:59:42.539 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.535+0000 7fb6327fc700 1 --2- 172.21.15.155:0/1456721054 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fb62806cf80 0x7fb62806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:42.539 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.535+0000 7fb6327fc700 1 -- 172.21.15.155:0/1456721054 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb62c08cff0 con 0x7fb63c0fbb40 2023-12-16T05:59:42.539 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.535+0000 7fb641220700 1 --2- 172.21.15.155:0/1456721054 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fb62806cf80 0x7fb62806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:42.539 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.536+0000 7fb641220700 1 --2- 172.21.15.155:0/1456721054 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fb62806cf80 0x7fb62806f430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb63c065e30 tx=0x7fb63800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:42.542 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.540+0000 7fb6327fc700 1 -- 172.21.15.155:0/1456721054 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fb62c056e30 con 0x7fb63c0fbb40 2023-12-16T05:59:42.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.786+0000 7fb643c85700 1 -- 172.21.15.155:0/1456721054 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb63c065b70 con 0x7fb63c0fbb40 2023-12-16T05:59:42.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.787+0000 7fb6327fc700 1 -- 172.21.15.155:0/1456721054 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1907 (secure 0 0 0) 0x7fb62c05a450 con 0x7fb63c0fbb40 2023-12-16T05:59:42.790 INFO:teuthology.orchestra.run.smithi155.stdout:e16 2023-12-16T05:59:42.790 INFO:teuthology.orchestra.run.smithi155.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T05:59:42.790 INFO:teuthology.orchestra.run.smithi155.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T05:59:42.790 INFO:teuthology.orchestra.run.smithi155.stdout:legacy client fscid: 1 2023-12-16T05:59:42.790 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:59:42.790 INFO:teuthology.orchestra.run.smithi155.stdout:Filesystem 'cephfs' (1) 2023-12-16T05:59:42.790 INFO:teuthology.orchestra.run.smithi155.stdout:fs_name cephfs 2023-12-16T05:59:42.790 INFO:teuthology.orchestra.run.smithi155.stdout:epoch 16 2023-12-16T05:59:42.790 INFO:teuthology.orchestra.run.smithi155.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-16T05:59:42.791 INFO:teuthology.orchestra.run.smithi155.stdout:created 2023-12-16T05:54:25.897091+0000 2023-12-16T05:59:42.791 INFO:teuthology.orchestra.run.smithi155.stdout:modified 2023-12-16T05:56:25.130480+0000 2023-12-16T05:59:42.791 INFO:teuthology.orchestra.run.smithi155.stdout:tableserver 0 2023-12-16T05:59:42.791 INFO:teuthology.orchestra.run.smithi155.stdout:root 0 2023-12-16T05:59:42.791 INFO:teuthology.orchestra.run.smithi155.stdout:session_timeout 60 2023-12-16T05:59:42.791 INFO:teuthology.orchestra.run.smithi155.stdout:session_autoclose 300 2023-12-16T05:59:42.791 INFO:teuthology.orchestra.run.smithi155.stdout:max_file_size 1099511627776 2023-12-16T05:59:42.791 INFO:teuthology.orchestra.run.smithi155.stdout:max_xattr_size 65536 2023-12-16T05:59:42.791 INFO:teuthology.orchestra.run.smithi155.stdout:required_client_features {} 2023-12-16T05:59:42.791 INFO:teuthology.orchestra.run.smithi155.stdout:last_failure 0 2023-12-16T05:59:42.791 INFO:teuthology.orchestra.run.smithi155.stdout:last_failure_osd_epoch 0 2023-12-16T05:59:42.791 INFO:teuthology.orchestra.run.smithi155.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T05:59:42.791 INFO:teuthology.orchestra.run.smithi155.stdout:max_mds 2 2023-12-16T05:59:42.791 INFO:teuthology.orchestra.run.smithi155.stdout:in 0,1 2023-12-16T05:59:42.791 INFO:teuthology.orchestra.run.smithi155.stdout:up {0=14456,1=24281} 2023-12-16T05:59:42.792 INFO:teuthology.orchestra.run.smithi155.stdout:failed 2023-12-16T05:59:42.792 INFO:teuthology.orchestra.run.smithi155.stdout:damaged 2023-12-16T05:59:42.792 INFO:teuthology.orchestra.run.smithi155.stdout:stopped 2023-12-16T05:59:42.792 INFO:teuthology.orchestra.run.smithi155.stdout:data_pools [3] 2023-12-16T05:59:42.792 INFO:teuthology.orchestra.run.smithi155.stdout:metadata_pool 2 2023-12-16T05:59:42.792 INFO:teuthology.orchestra.run.smithi155.stdout:inline_data disabled 2023-12-16T05:59:42.792 INFO:teuthology.orchestra.run.smithi155.stdout:balancer 2023-12-16T05:59:42.792 INFO:teuthology.orchestra.run.smithi155.stdout:bal_rank_mask -1 2023-12-16T05:59:42.792 INFO:teuthology.orchestra.run.smithi155.stdout:standby_count_wanted 1 2023-12-16T05:59:42.792 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi155.bzsxjw{0:14456} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.155:6826/1416140807,v1:172.21.15.155:6827/1416140807] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:59:42.792 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi156.fasing{0:24289} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1763385284,v1:172.21.15.156:6827/1763385284] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:59:42.792 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi156.qvgmfj{1:24281} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.156:6824/2823725296,v1:172.21.15.156:6825/2823725296] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:59:42.792 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi155.vicpis{1:14472} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.155:6828/750006619,v1:172.21.15.155:6829/750006619] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T05:59:42.792 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:59:42.792 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T05:59:42.793 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.789+0000 7fb643c85700 1 -- 172.21.15.155:0/1456721054 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fb62806cf80 msgr2=0x7fb62806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:42.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.789+0000 7fb643c85700 1 --2- 172.21.15.155:0/1456721054 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fb62806cf80 0x7fb62806f430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb63c065e30 tx=0x7fb63800b040 comp rx=0 tx=0).stop 2023-12-16T05:59:42.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.789+0000 7fb643c85700 1 -- 172.21.15.155:0/1456721054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb63c0fbb40 msgr2=0x7fb63c10e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:42.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.789+0000 7fb643c85700 1 --2- 172.21.15.155:0/1456721054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb63c0fbb40 0x7fb63c10e6f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00b3b0 tx=0x7fb62c009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:42.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.789+0000 7fb643c85700 1 -- 172.21.15.155:0/1456721054 shutdown_connections 2023-12-16T05:59:42.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.789+0000 7fb643c85700 1 --2- 172.21.15.155:0/1456721054 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fb62806cf80 0x7fb62806f430 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:42.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.789+0000 7fb643c85700 1 --2- 172.21.15.155:0/1456721054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb63c0fbb40 0x7fb63c10e6f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:42.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.789+0000 7fb643c85700 1 --2- 172.21.15.155:0/1456721054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb63c101b00 0x7fb63c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:42.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.789+0000 7fb643c85700 1 -- 172.21.15.155:0/1456721054 >> 172.21.15.155:0/1456721054 conn(0x7fb63c0719b0 msgr2=0x7fb63c0fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:42.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.789+0000 7fb643c85700 1 -- 172.21.15.155:0/1456721054 shutdown_connections 2023-12-16T05:59:42.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.789+0000 7fb643c85700 1 -- 172.21.15.155:0/1456721054 wait complete. 2023-12-16T05:59:42.794 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 16 2023-12-16T05:59:42.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.896+0000 7f9f61922700 1 -- 172.21.15.155:0/855613392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f5c102c20 msgr2=0x7f9f5c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:42.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.896+0000 7f9f61922700 1 --2- 172.21.15.155:0/855613392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f5c102c20 0x7f9f5c102ff0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9f50004940 tx=0x7f9f50009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:42.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.896+0000 7f9f61922700 1 -- 172.21.15.155:0/855613392 shutdown_connections 2023-12-16T05:59:42.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.896+0000 7f9f61922700 1 --2- 172.21.15.155:0/855613392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f5c065390 0x7f9f5c065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:42.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.896+0000 7f9f61922700 1 --2- 172.21.15.155:0/855613392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f5c102c20 0x7f9f5c102ff0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:42.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.896+0000 7f9f61922700 1 -- 172.21.15.155:0/855613392 >> 172.21.15.155:0/855613392 conn(0x7f9f5c0719b0 msgr2=0x7f9f5c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:42.900 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.896+0000 7f9f61922700 1 -- 172.21.15.155:0/855613392 shutdown_connections 2023-12-16T05:59:42.900 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.896+0000 7f9f61922700 1 -- 172.21.15.155:0/855613392 wait complete. 2023-12-16T05:59:42.903 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.896+0000 7f9f61922700 1 Processor -- start 2023-12-16T05:59:42.903 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.897+0000 7f9f61922700 1 -- start start 2023-12-16T05:59:42.903 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.897+0000 7f9f61922700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f5c065390 0x7f9f5c113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:42.903 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.897+0000 7f9f61922700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f5c102c20 0x7f9f5c113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:42.903 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.897+0000 7f9f61922700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c114220 con 0x7f9f5c065390 2023-12-16T05:59:42.903 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.897+0000 7f9f61922700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c10d570 con 0x7f9f5c102c20 2023-12-16T05:59:42.903 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.897+0000 7f9f5affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f5c065390 0x7f9f5c113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:42.903 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.897+0000 7f9f5affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f5c065390 0x7f9f5c113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:55972/0 (socket says 172.21.15.155:55972) 2023-12-16T05:59:42.904 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.897+0000 7f9f5affd700 1 -- 172.21.15.155:0/4192085625 learned_addr learned my addr 172.21.15.155:0/4192085625 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:59:42.904 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.897+0000 7f9f5a7fc700 1 --2- 172.21.15.155:0/4192085625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f5c102c20 0x7f9f5c113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:42.904 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.897+0000 7f9f5affd700 1 -- 172.21.15.155:0/4192085625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f5c102c20 msgr2=0x7f9f5c113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:42.904 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.897+0000 7f9f5affd700 1 --2- 172.21.15.155:0/4192085625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f5c102c20 0x7f9f5c113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:42.904 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.897+0000 7f9f5affd700 1 -- 172.21.15.155:0/4192085625 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f50005040 con 0x7f9f5c065390 2023-12-16T05:59:42.904 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.897+0000 7f9f5affd700 1 --2- 172.21.15.155:0/4192085625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f5c065390 0x7f9f5c113690 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000b3b0 tx=0x7f9f50009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:42.904 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.897+0000 7f9f437fe700 1 -- 172.21.15.155:0/4192085625 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f5000e040 con 0x7f9f5c065390 2023-12-16T05:59:42.904 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.897+0000 7f9f437fe700 1 -- 172.21.15.155:0/4192085625 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9f5001c430 con 0x7f9f5c065390 2023-12-16T05:59:42.904 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.897+0000 7f9f437fe700 1 -- 172.21.15.155:0/4192085625 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f50013640 con 0x7f9f5c065390 2023-12-16T05:59:42.905 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.897+0000 7f9f61922700 1 -- 172.21.15.155:0/4192085625 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5c10d7f0 con 0x7f9f5c065390 2023-12-16T05:59:42.905 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.898+0000 7f9f61922700 1 -- 172.21.15.155:0/4192085625 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5c10dd30 con 0x7f9f5c065390 2023-12-16T05:59:42.905 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.898+0000 7f9f61922700 1 -- 172.21.15.155:0/4192085625 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5c0fff40 con 0x7f9f5c065390 2023-12-16T05:59:42.905 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.899+0000 7f9f437fe700 1 -- 172.21.15.155:0/4192085625 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7f9f5001c5a0 con 0x7f9f5c065390 2023-12-16T05:59:42.905 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.899+0000 7f9f437fe700 1 --2- 172.21.15.155:0/4192085625 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f9f4406cfd0 0x7f9f4406f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:42.905 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.899+0000 7f9f437fe700 1 -- 172.21.15.155:0/4192085625 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f9f5008d0c0 con 0x7f9f5c065390 2023-12-16T05:59:42.905 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.899+0000 7f9f5a7fc700 1 --2- 172.21.15.155:0/4192085625 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f9f4406cfd0 0x7f9f4406f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:42.905 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.900+0000 7f9f5a7fc700 1 --2- 172.21.15.155:0/4192085625 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f9f4406cfd0 0x7f9f4406f480 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c10ef70 tx=0x7f9f4c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:42.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:42.904+0000 7f9f437fe700 1 -- 172.21.15.155:0/4192085625 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f9f5005a8f0 con 0x7f9f5c065390 2023-12-16T05:59:43.136 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.133+0000 7f9f61922700 1 -- 172.21.15.155:0/4192085625 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f5c04bb80 con 0x7f9f4406cfd0 2023-12-16T05:59:43.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.135+0000 7f9f437fe700 1 -- 172.21.15.155:0/4192085625 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f9f5c04bb80 con 0x7f9f4406cfd0 2023-12-16T05:59:43.138 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T05:59:43.138 INFO:teuthology.orchestra.run.smithi155.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T05:59:43.138 INFO:teuthology.orchestra.run.smithi155.stdout: "in_progress": true, 2023-12-16T05:59:43.138 INFO:teuthology.orchestra.run.smithi155.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T05:59:43.138 INFO:teuthology.orchestra.run.smithi155.stdout: "services_complete": [ 2023-12-16T05:59:43.138 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr", 2023-12-16T05:59:43.138 INFO:teuthology.orchestra.run.smithi155.stdout: "mon" 2023-12-16T05:59:43.138 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-12-16T05:59:43.138 INFO:teuthology.orchestra.run.smithi155.stdout: "progress": "4/21 daemons upgraded", 2023-12-16T05:59:43.138 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "Currently upgrading mon daemons", 2023-12-16T05:59:43.138 INFO:teuthology.orchestra.run.smithi155.stdout: "is_paused": false 2023-12-16T05:59:43.138 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T05:59:43.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.137+0000 7f9f61922700 1 -- 172.21.15.155:0/4192085625 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f9f4406cfd0 msgr2=0x7f9f4406f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:43.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.137+0000 7f9f61922700 1 --2- 172.21.15.155:0/4192085625 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f9f4406cfd0 0x7f9f4406f480 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c10ef70 tx=0x7f9f4c00b040 comp rx=0 tx=0).stop 2023-12-16T05:59:43.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.137+0000 7f9f61922700 1 -- 172.21.15.155:0/4192085625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f5c065390 msgr2=0x7f9f5c113690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:43.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.137+0000 7f9f61922700 1 --2- 172.21.15.155:0/4192085625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f5c065390 0x7f9f5c113690 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000b3b0 tx=0x7f9f50009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:43.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.137+0000 7f9f61922700 1 -- 172.21.15.155:0/4192085625 shutdown_connections 2023-12-16T05:59:43.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.137+0000 7f9f61922700 1 --2- 172.21.15.155:0/4192085625 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f9f4406cfd0 0x7f9f4406f480 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:43.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.137+0000 7f9f61922700 1 --2- 172.21.15.155:0/4192085625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f5c065390 0x7f9f5c113690 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:43.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.137+0000 7f9f61922700 1 --2- 172.21.15.155:0/4192085625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f5c102c20 0x7f9f5c113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:43.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.137+0000 7f9f61922700 1 -- 172.21.15.155:0/4192085625 >> 172.21.15.155:0/4192085625 conn(0x7f9f5c0719b0 msgr2=0x7f9f5c0fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:43.141 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.137+0000 7f9f61922700 1 -- 172.21.15.155:0/4192085625 shutdown_connections 2023-12-16T05:59:43.141 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.137+0000 7f9f61922700 1 -- 172.21.15.155:0/4192085625 wait complete. 2023-12-16T05:59:43.249 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.246+0000 7f3500141700 1 -- 172.21.15.155:0/1407769115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f8065390 msgr2=0x7f34f8065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:43.249 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.246+0000 7f3500141700 1 --2- 172.21.15.155:0/1407769115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f8065390 0x7f34f8065800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f34e8004940 tx=0x7f34e8009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:43.249 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.246+0000 7f3500141700 1 -- 172.21.15.155:0/1407769115 shutdown_connections 2023-12-16T05:59:43.249 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.246+0000 7f3500141700 1 --2- 172.21.15.155:0/1407769115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f8065390 0x7f34f8065800 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:43.250 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.246+0000 7f3500141700 1 --2- 172.21.15.155:0/1407769115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34f8102c20 0x7f34f8102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:43.250 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.246+0000 7f3500141700 1 -- 172.21.15.155:0/1407769115 >> 172.21.15.155:0/1407769115 conn(0x7f34f80719b0 msgr2=0x7f34f8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:43.250 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.246+0000 7f3500141700 1 -- 172.21.15.155:0/1407769115 shutdown_connections 2023-12-16T05:59:43.250 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.246+0000 7f3500141700 1 -- 172.21.15.155:0/1407769115 wait complete. 2023-12-16T05:59:43.251 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.247+0000 7f3500141700 1 Processor -- start 2023-12-16T05:59:43.251 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.247+0000 7f3500141700 1 -- start start 2023-12-16T05:59:43.251 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.247+0000 7f3500141700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f8065390 0x7f34f8115890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:43.252 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.247+0000 7f3500141700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34f8102c20 0x7f34f8115dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:43.252 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.247+0000 7f3500141700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f8116420 con 0x7f34f8065390 2023-12-16T05:59:43.252 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.247+0000 7f3500141700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f810f750 con 0x7f34f8102c20 2023-12-16T05:59:43.252 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.247+0000 7f34fdedd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f8065390 0x7f34f8115890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:43.252 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.247+0000 7f34fdedd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f8065390 0x7f34f8115890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:55990/0 (socket says 172.21.15.155:55990) 2023-12-16T05:59:43.252 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.247+0000 7f34fdedd700 1 -- 172.21.15.155:0/4113169680 learned_addr learned my addr 172.21.15.155:0/4113169680 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T05:59:43.252 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.248+0000 7f34fdedd700 1 -- 172.21.15.155:0/4113169680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34f8102c20 msgr2=0x7f34f8115dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:43.252 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.248+0000 7f34fd6dc700 1 --2- 172.21.15.155:0/4113169680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34f8102c20 0x7f34f8115dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:43.252 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.248+0000 7f34fdedd700 1 --2- 172.21.15.155:0/4113169680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34f8102c20 0x7f34f8115dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:43.252 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.248+0000 7f34fdedd700 1 -- 172.21.15.155:0/4113169680 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e8005040 con 0x7f34f8065390 2023-12-16T05:59:43.252 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.248+0000 7f34fd6dc700 1 --2- 172.21.15.155:0/4113169680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34f8102c20 0x7f34f8115dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T05:59:43.252 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.248+0000 7f34fdedd700 1 --2- 172.21.15.155:0/4113169680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f8065390 0x7f34f8115890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f34f400c8c0 tx=0x7f34f40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:43.252 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.248+0000 7f34ee7fc700 1 -- 172.21.15.155:0/4113169680 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34f400a980 con 0x7f34f8065390 2023-12-16T05:59:43.252 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.248+0000 7f34ee7fc700 1 -- 172.21.15.155:0/4113169680 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f34f400ce60 con 0x7f34f8065390 2023-12-16T05:59:43.253 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.248+0000 7f3500141700 1 -- 172.21.15.155:0/4113169680 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f810fa30 con 0x7f34f8065390 2023-12-16T05:59:43.253 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.248+0000 7f34ee7fc700 1 -- 172.21.15.155:0/4113169680 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34f40113a0 con 0x7f34f8065390 2023-12-16T05:59:43.253 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.248+0000 7f3500141700 1 -- 172.21.15.155:0/4113169680 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f810ff70 con 0x7f34f8065390 2023-12-16T05:59:43.253 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.249+0000 7f3500141700 1 -- 172.21.15.155:0/4113169680 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f80734d0 con 0x7f34f8065390 2023-12-16T05:59:43.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.249+0000 7f34ee7fc700 1 -- 172.21.15.155:0/4113169680 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7f34f4012400 con 0x7f34f8065390 2023-12-16T05:59:43.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.250+0000 7f34ee7fc700 1 --2- 172.21.15.155:0/4113169680 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f34e406cf80 0x7f34e406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T05:59:43.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.250+0000 7f34ee7fc700 1 -- 172.21.15.155:0/4113169680 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f34f408c3f0 con 0x7f34f8065390 2023-12-16T05:59:43.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.250+0000 7f34fd6dc700 1 --2- 172.21.15.155:0/4113169680 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f34e406cf80 0x7f34e406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T05:59:43.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.250+0000 7f34fd6dc700 1 --2- 172.21.15.155:0/4113169680 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f34e406cf80 0x7f34e406f430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f34e8000c00 tx=0x7f34e8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T05:59:43.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.254+0000 7f34ee7fc700 1 -- 172.21.15.155:0/4113169680 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f34f4059dc0 con 0x7f34f8065390 2023-12-16T05:59:43.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:42 smithi155 ceph-mon[217407]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:59:43.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:42 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:43.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:42 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:43.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:42 smithi155 ceph-mon[217407]: Reconfiguring osd.1 (monmap changed)... 2023-12-16T05:59:43.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:42 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T05:59:43.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:42 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:43.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:42 smithi155 ceph-mon[217407]: Reconfiguring daemon osd.1 on smithi155 2023-12-16T05:59:43.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:42 smithi155 ceph-mon[217407]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:59:43.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:42 smithi155 ceph-mon[217407]: pgmap v14: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T05:59:43.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:42 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/673643395' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:59:43.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:42 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/1456721054' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T05:59:43.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:42 smithi156 ceph-mon[182000]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:59:43.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:42 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:43.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:42 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:43.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:42 smithi156 ceph-mon[182000]: Reconfiguring osd.1 (monmap changed)... 2023-12-16T05:59:43.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:42 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T05:59:43.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:42 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:43.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:42 smithi156 ceph-mon[182000]: Reconfiguring daemon osd.1 on smithi155 2023-12-16T05:59:43.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:42 smithi156 ceph-mon[182000]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:59:43.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:42 smithi156 ceph-mon[182000]: pgmap v14: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T05:59:43.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:42 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/673643395' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:59:43.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:42 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/1456721054' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T05:59:43.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.568+0000 7f3500141700 1 -- 172.21.15.155:0/4113169680 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f34f8110e70 con 0x7f34f8065390 2023-12-16T05:59:43.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.568+0000 7f34ee7fc700 1 -- 172.21.15.155:0/4113169680 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f34f4059950 con 0x7f34f8065390 2023-12-16T05:59:43.571 INFO:teuthology.orchestra.run.smithi155.stdout:HEALTH_OK 2023-12-16T05:59:43.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.570+0000 7f3500141700 1 -- 172.21.15.155:0/4113169680 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f34e406cf80 msgr2=0x7f34e406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:43.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.570+0000 7f3500141700 1 --2- 172.21.15.155:0/4113169680 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f34e406cf80 0x7f34e406f430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f34e8000c00 tx=0x7f34e8009e30 comp rx=0 tx=0).stop 2023-12-16T05:59:43.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.571+0000 7f3500141700 1 -- 172.21.15.155:0/4113169680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f8065390 msgr2=0x7f34f8115890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T05:59:43.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.571+0000 7f3500141700 1 --2- 172.21.15.155:0/4113169680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f8065390 0x7f34f8115890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f34f400c8c0 tx=0x7f34f40044c0 comp rx=0 tx=0).stop 2023-12-16T05:59:43.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.571+0000 7f3500141700 1 -- 172.21.15.155:0/4113169680 shutdown_connections 2023-12-16T05:59:43.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.571+0000 7f3500141700 1 --2- 172.21.15.155:0/4113169680 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f34e406cf80 0x7f34e406f430 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:43.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.571+0000 7f3500141700 1 --2- 172.21.15.155:0/4113169680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f8065390 0x7f34f8115890 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:43.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.571+0000 7f3500141700 1 --2- 172.21.15.155:0/4113169680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34f8102c20 0x7f34f8115dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T05:59:43.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.571+0000 7f3500141700 1 -- 172.21.15.155:0/4113169680 >> 172.21.15.155:0/4113169680 conn(0x7f34f80719b0 msgr2=0x7f34f80faa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T05:59:43.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.571+0000 7f3500141700 1 -- 172.21.15.155:0/4113169680 shutdown_connections 2023-12-16T05:59:43.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T05:59:43.571+0000 7f3500141700 1 -- 172.21.15.155:0/4113169680 wait complete. 2023-12-16T05:59:44.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:44.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:44.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:44 smithi156 ceph-mon[182000]: Reconfiguring osd.2 (monmap changed)... 2023-12-16T05:59:44.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T05:59:44.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:44.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:44 smithi156 ceph-mon[182000]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:59:44.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:44 smithi156 ceph-mon[182000]: Reconfiguring daemon osd.2 on smithi155 2023-12-16T05:59:44.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:44 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/4113169680' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T05:59:44.564 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:44.564 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:44.565 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:44 smithi155 ceph-mon[217407]: Reconfiguring osd.2 (monmap changed)... 2023-12-16T05:59:44.565 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T05:59:44.565 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:44.565 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:44 smithi155 ceph-mon[217407]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T05:59:44.565 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:44 smithi155 ceph-mon[217407]: Reconfiguring daemon osd.2 on smithi155 2023-12-16T05:59:44.565 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:44 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/4113169680' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T05:59:45.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:45 smithi155 ceph-mon[217407]: pgmap v15: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:59:45.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:45 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:45.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:45 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:45.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:45 smithi155 ceph-mon[217407]: Reconfiguring mds.cephfs.smithi155.bzsxjw (monmap changed)... 2023-12-16T05:59:45.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:45 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.bzsxjw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T05:59:45.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:45 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:45.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:45 smithi155 ceph-mon[217407]: Reconfiguring daemon mds.cephfs.smithi155.bzsxjw on smithi155 2023-12-16T05:59:45.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:45 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:45.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:45 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:45.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:45 smithi156 ceph-mon[182000]: pgmap v15: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:59:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:45 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:45 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:45 smithi156 ceph-mon[182000]: Reconfiguring mds.cephfs.smithi155.bzsxjw (monmap changed)... 2023-12-16T05:59:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:45 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.bzsxjw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T05:59:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:45 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:45 smithi156 ceph-mon[182000]: Reconfiguring daemon mds.cephfs.smithi155.bzsxjw on smithi155 2023-12-16T05:59:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:45 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:45 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:46.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:46 smithi156 ceph-mon[182000]: Reconfiguring mds.cephfs.smithi155.vicpis (monmap changed)... 2023-12-16T05:59:46.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:46 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.vicpis", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T05:59:46.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:46 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:46.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:46 smithi156 ceph-mon[182000]: Reconfiguring daemon mds.cephfs.smithi155.vicpis on smithi155 2023-12-16T05:59:46.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:46 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:46.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:46 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:46.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:46 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi156", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T05:59:46.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:46 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:46.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:46 smithi155 ceph-mon[217407]: Reconfiguring mds.cephfs.smithi155.vicpis (monmap changed)... 2023-12-16T05:59:46.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:46 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.vicpis", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T05:59:46.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:46 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:46.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:46 smithi155 ceph-mon[217407]: Reconfiguring daemon mds.cephfs.smithi155.vicpis on smithi155 2023-12-16T05:59:46.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:46 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:46.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:46 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:46.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:46 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi156", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T05:59:46.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:46 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:47.416 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:47 smithi156 ceph-mon[182000]: pgmap v16: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T05:59:47.416 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:47 smithi156 ceph-mon[182000]: Reconfiguring crash.smithi156 (monmap changed)... 2023-12-16T05:59:47.416 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:47 smithi156 ceph-mon[182000]: Reconfiguring daemon crash.smithi156 on smithi156 2023-12-16T05:59:47.416 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:47 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:47.416 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:47 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:47.416 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:47 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.pclong", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T05:59:47.416 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:47 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T05:59:47.416 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:47 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:47.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:47 smithi155 ceph-mon[217407]: pgmap v16: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T05:59:47.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:47 smithi155 ceph-mon[217407]: Reconfiguring crash.smithi156 (monmap changed)... 2023-12-16T05:59:47.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:47 smithi155 ceph-mon[217407]: Reconfiguring daemon crash.smithi156 on smithi156 2023-12-16T05:59:47.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:47 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:47.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:47 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:47.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:47 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.pclong", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T05:59:47.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:47 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T05:59:47.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:47 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:48.423 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:48 smithi156 ceph-mon[182000]: Reconfiguring mgr.smithi156.pclong (monmap changed)... 2023-12-16T05:59:48.423 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:48 smithi156 ceph-mon[182000]: Reconfiguring daemon mgr.smithi156.pclong on smithi156 2023-12-16T05:59:48.423 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:48 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:48.423 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:48 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:48.423 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:48 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T05:59:48.423 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:48 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T05:59:48.423 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:48 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:48.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:48 smithi155 ceph-mon[217407]: Reconfiguring mgr.smithi156.pclong (monmap changed)... 2023-12-16T05:59:48.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:48 smithi155 ceph-mon[217407]: Reconfiguring daemon mgr.smithi156.pclong on smithi156 2023-12-16T05:59:48.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:48 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:48.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:48 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:48.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:48 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T05:59:48.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:48 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T05:59:48.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:48 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:49.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:49 smithi156 ceph-mon[182000]: Reconfiguring mon.smithi156 (monmap changed)... 2023-12-16T05:59:49.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:49 smithi156 ceph-mon[182000]: Reconfiguring daemon mon.smithi156 on smithi156 2023-12-16T05:59:49.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:49 smithi156 ceph-mon[182000]: pgmap v17: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T05:59:49.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:49 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:49.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:49 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:49.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:49 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T05:59:49.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:49 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:49.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:49 smithi155 ceph-mon[217407]: Reconfiguring mon.smithi156 (monmap changed)... 2023-12-16T05:59:49.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:49 smithi155 ceph-mon[217407]: Reconfiguring daemon mon.smithi156 on smithi156 2023-12-16T05:59:49.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:49 smithi155 ceph-mon[217407]: pgmap v17: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T05:59:49.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:49 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:49.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:49 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:49.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:49 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T05:59:49.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:49 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:50.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:50 smithi156 ceph-mon[182000]: Reconfiguring osd.3 (monmap changed)... 2023-12-16T05:59:50.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:50 smithi156 ceph-mon[182000]: Reconfiguring daemon osd.3 on smithi156 2023-12-16T05:59:50.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:50 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:50.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:50 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:50.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:50 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T05:59:50.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:50 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:50.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:50 smithi155 ceph-mon[217407]: Reconfiguring osd.3 (monmap changed)... 2023-12-16T05:59:50.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:50 smithi155 ceph-mon[217407]: Reconfiguring daemon osd.3 on smithi156 2023-12-16T05:59:50.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:50 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:50.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:50 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:50.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:50 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T05:59:50.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:50 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:51.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:51 smithi156 ceph-mon[182000]: Reconfiguring osd.4 (monmap changed)... 2023-12-16T05:59:51.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:51 smithi156 ceph-mon[182000]: Reconfiguring daemon osd.4 on smithi156 2023-12-16T05:59:51.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:51 smithi156 ceph-mon[182000]: pgmap v18: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:59:51.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:51 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:59:51.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:51 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:51.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:51 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:51.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:51 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T05:59:51.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:51 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:51.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:51 smithi155 ceph-mon[217407]: Reconfiguring osd.4 (monmap changed)... 2023-12-16T05:59:51.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:51 smithi155 ceph-mon[217407]: Reconfiguring daemon osd.4 on smithi156 2023-12-16T05:59:51.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:51 smithi155 ceph-mon[217407]: pgmap v18: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:59:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:51 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T05:59:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:51 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:51 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:51 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T05:59:51.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:51 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:52 smithi156 ceph-mon[182000]: Reconfiguring osd.5 (monmap changed)... 2023-12-16T05:59:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:52 smithi156 ceph-mon[182000]: Reconfiguring daemon osd.5 on smithi156 2023-12-16T05:59:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:52 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:52 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:52 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.qvgmfj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T05:59:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:52 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:52.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:52 smithi155 ceph-mon[217407]: Reconfiguring osd.5 (monmap changed)... 2023-12-16T05:59:52.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:52 smithi155 ceph-mon[217407]: Reconfiguring daemon osd.5 on smithi156 2023-12-16T05:59:52.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:52 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:52.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:52 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:52.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:52 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.qvgmfj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T05:59:52.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:52 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:53.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:53 smithi156 ceph-mon[182000]: Reconfiguring mds.cephfs.smithi156.qvgmfj (monmap changed)... 2023-12-16T05:59:53.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:53 smithi156 ceph-mon[182000]: Reconfiguring daemon mds.cephfs.smithi156.qvgmfj on smithi156 2023-12-16T05:59:53.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:53 smithi156 ceph-mon[182000]: pgmap v19: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T05:59:53.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:53 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:53.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:53 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:53.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:53 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.fasing", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T05:59:53.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:53 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:53.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:53 smithi155 ceph-mon[217407]: Reconfiguring mds.cephfs.smithi156.qvgmfj (monmap changed)... 2023-12-16T05:59:53.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:53 smithi155 ceph-mon[217407]: Reconfiguring daemon mds.cephfs.smithi156.qvgmfj on smithi156 2023-12-16T05:59:53.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:53 smithi155 ceph-mon[217407]: pgmap v19: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T05:59:53.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:53 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:53.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:53 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:53.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:53 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.fasing", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T05:59:53.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:53 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:54 smithi156 ceph-mon[182000]: Reconfiguring mds.cephfs.smithi156.fasing (monmap changed)... 2023-12-16T05:59:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:54 smithi156 ceph-mon[182000]: Reconfiguring daemon mds.cephfs.smithi156.fasing on smithi156 2023-12-16T05:59:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:54 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:54 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:54 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:59:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:54 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:59:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:54 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:59:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:54 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:54 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi155"}]: dispatch 2023-12-16T05:59:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:54 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi155"}]': finished 2023-12-16T05:59:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:54 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi156"}]: dispatch 2023-12-16T05:59:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:54 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi156"}]': finished 2023-12-16T05:59:54.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:54 smithi155 ceph-mon[217407]: Reconfiguring mds.cephfs.smithi156.fasing (monmap changed)... 2023-12-16T05:59:54.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:54 smithi155 ceph-mon[217407]: Reconfiguring daemon mds.cephfs.smithi156.fasing on smithi156 2023-12-16T05:59:54.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:54 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:54.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:54 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:54.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:54 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T05:59:54.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:54 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:59:54.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:54 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T05:59:54.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:54 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:54.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:54 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi155"}]: dispatch 2023-12-16T05:59:54.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:54 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi155"}]': finished 2023-12-16T05:59:54.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:54 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi156"}]: dispatch 2023-12-16T05:59:54.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:54 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi156"}]': finished 2023-12-16T05:59:55.305 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:55 smithi155 ceph-mon[217407]: Upgrade: Setting container_image for all mon 2023-12-16T05:59:55.305 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:55 smithi155 ceph-mon[217407]: pgmap v20: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:59:55.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:55 smithi156 ceph-mon[182000]: Upgrade: Setting container_image for all mon 2023-12-16T05:59:55.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:55 smithi156 ceph-mon[182000]: pgmap v20: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T05:59:56.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:56 smithi155 ceph-mon[217407]: Upgrade: Updating crash.smithi155 (1/2) 2023-12-16T05:59:56.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:56 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:56.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:56 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi155", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T05:59:56.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:56 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:56.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:56 smithi155 ceph-mon[217407]: Deploying daemon crash.smithi155 on smithi155 2023-12-16T05:59:56.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:56 smithi155 ceph-mon[217407]: pgmap v21: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T05:59:57.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:56 smithi156 ceph-mon[182000]: Upgrade: Updating crash.smithi155 (1/2) 2023-12-16T05:59:57.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:56 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:57.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:56 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi155", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T05:59:57.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:56 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T05:59:57.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:56 smithi156 ceph-mon[182000]: Deploying daemon crash.smithi155 on smithi155 2023-12-16T05:59:57.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:56 smithi156 ceph-mon[182000]: pgmap v21: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T05:59:59.389 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:59 smithi155 ceph-mon[217407]: pgmap v22: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T05:59:59.389 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:59 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:59.389 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 05:59:59 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:59.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:59 smithi156 ceph-mon[182000]: pgmap v22: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T05:59:59.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:59 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T05:59:59.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 05:59:59 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:00.424 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:00 smithi156 ceph-mon[182000]: Upgrade: Updating crash.smithi156 (2/2) 2023-12-16T06:00:00.424 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:00 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:00.425 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:00 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi156", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T06:00:00.425 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:00 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:00:00.425 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:00 smithi156 ceph-mon[182000]: Deploying daemon crash.smithi156 on smithi156 2023-12-16T06:00:00.425 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:00 smithi156 ceph-mon[182000]: overall HEALTH_OK 2023-12-16T06:00:00.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:00 smithi155 ceph-mon[217407]: Upgrade: Updating crash.smithi156 (2/2) 2023-12-16T06:00:00.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:00 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:00.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:00 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi156", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T06:00:00.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:00 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:00:00.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:00 smithi155 ceph-mon[217407]: Deploying daemon crash.smithi156 on smithi156 2023-12-16T06:00:00.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:00 smithi155 ceph-mon[217407]: overall HEALTH_OK 2023-12-16T06:00:01.440 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:01 smithi156 ceph-mon[182000]: pgmap v23: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:00:01.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:01 smithi155 ceph-mon[217407]: pgmap v23: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:00:02.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:02 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:02.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:02 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:02.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:02 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:00:02.652 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:02 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:02.652 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:02 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:02.653 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:02 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:00:03.454 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:03 smithi155 ceph-mon[217407]: pgmap v24: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:00:03.454 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:03 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:03.454 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:03 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:03.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:03 smithi156 ceph-mon[182000]: pgmap v24: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:00:03.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:03 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:03.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:03 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:04.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:04 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:04.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:04 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:04.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:04 smithi156 ceph-mon[182000]: pgmap v25: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:00:04.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:04 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:04.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:04 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:05.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:04 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:05.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:04 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:05.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:04 smithi155 ceph-mon[217407]: pgmap v25: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:00:05.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:04 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:05.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:04 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:06.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:06 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:06.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:06 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:06.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:06 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:00:06.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:06 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:06.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:06 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:06.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:06 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:06.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:06 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:06.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:06 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:00:06.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:06 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:06.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:06 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:07.290 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:07 smithi155 ceph-mon[217407]: pgmap v26: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:00:07.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:07 smithi156 ceph-mon[182000]: pgmap v26: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:00:08.661 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:08 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:08.661 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:08 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:08.661 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:08 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:00:08.661 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:08 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T06:00:08.662 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:08 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:08.662 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:08 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:00:08.662 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:08 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:08.662 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:08 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:08.662 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:08 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:08.662 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:08 smithi155 ceph-mon[217407]: Upgrade: Setting container_image for all crash 2023-12-16T06:00:08.662 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:08 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:08.662 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:08 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi155"}]: dispatch 2023-12-16T06:00:08.662 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:08 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi155"}]': finished 2023-12-16T06:00:08.662 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:08 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi156"}]: dispatch 2023-12-16T06:00:08.662 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:08 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi156"}]': finished 2023-12-16T06:00:08.662 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:08 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-16T06:00:08.662 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:08 smithi155 ceph-mon[217407]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-16T06:00:08.662 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:08 smithi155 ceph-mon[217407]: Upgrade: osd.0 is safe to restart 2023-12-16T06:00:08.663 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:08 smithi155 ceph-mon[217407]: pgmap v27: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T06:00:08.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:08 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:08.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:08 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:08.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:08 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:00:08.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:08 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T06:00:08.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:08 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:08.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:08 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:00:08.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:08 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:08.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:08 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:08.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:08 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:08.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:08 smithi156 ceph-mon[182000]: Upgrade: Setting container_image for all crash 2023-12-16T06:00:08.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:08 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:08.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:08 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi155"}]: dispatch 2023-12-16T06:00:08.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:08 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi155"}]': finished 2023-12-16T06:00:08.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:08 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi156"}]: dispatch 2023-12-16T06:00:08.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:08 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi156"}]': finished 2023-12-16T06:00:08.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:08 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-16T06:00:08.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:08 smithi156 ceph-mon[182000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-16T06:00:08.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:08 smithi156 ceph-mon[182000]: Upgrade: osd.0 is safe to restart 2023-12-16T06:00:08.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:08 smithi156 ceph-mon[182000]: pgmap v27: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T06:00:10.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:09 smithi155 ceph-mon[217407]: Upgrade: Updating osd.0 2023-12-16T06:00:10.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:09 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:10.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:09 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T06:00:10.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:09 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:00:10.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:09 smithi155 ceph-mon[217407]: Deploying daemon osd.0 on smithi155 2023-12-16T06:00:10.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:09 smithi156 ceph-mon[182000]: Upgrade: Updating osd.0 2023-12-16T06:00:10.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:09 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:10.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:09 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T06:00:10.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:09 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:00:10.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:09 smithi156 ceph-mon[182000]: Deploying daemon osd.0 on smithi155 2023-12-16T06:00:11.053 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:10 smithi155 ceph-mon[217407]: pgmap v28: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:00:11.053 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:10 smithi155 systemd[1]: Stopping Ceph osd.0 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T06:00:11.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:10 smithi156 ceph-mon[182000]: pgmap v28: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:00:11.326 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:11 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-0[136151]: 2023-12-16T06:00:11.049+0000 7f2fae969700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T06:00:11.326 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:11 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-0[136151]: 2023-12-16T06:00:11.049+0000 7f2fae969700 -1 osd.0 47 *** Got signal Terminated *** 2023-12-16T06:00:11.326 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:11 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-0[136151]: 2023-12-16T06:00:11.049+0000 7f2fae969700 -1 osd.0 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T06:00:12.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:11 smithi155 ceph-mon[217407]: osd.0 marked itself down and dead 2023-12-16T06:00:12.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:11 smithi156 ceph-mon[182000]: osd.0 marked itself down and dead 2023-12-16T06:00:12.799 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:12 smithi155 bash[231121]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-0 2023-12-16T06:00:13.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:12 smithi155 ceph-mon[217407]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T06:00:13.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:12 smithi155 ceph-mon[217407]: failed to encode map e48 with expected crc 2023-12-16T06:00:13.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:12 smithi155 ceph-mon[217407]: osdmap e48: 6 total, 5 up, 6 in 2023-12-16T06:00:13.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:12 smithi155 ceph-mon[217407]: pgmap v30: 65 pgs: 9 stale+active+clean, 56 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-16T06:00:13.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:12 smithi156 ceph-mon[182000]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T06:00:13.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:12 smithi156 ceph-mon[182000]: failed to encode map e48 with expected crc 2023-12-16T06:00:13.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:12 smithi156 ceph-mon[182000]: osdmap e48: 6 total, 5 up, 6 in 2023-12-16T06:00:13.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:12 smithi156 ceph-mon[182000]: pgmap v30: 65 pgs: 9 stale+active+clean, 56 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-16T06:00:13.692 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.688+0000 7f9b635bd700 1 -- 172.21.15.155:0/3700550052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b5c0fbb40 msgr2=0x7f9b5c0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:13.692 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.688+0000 7f9b635bd700 1 --2- 172.21.15.155:0/3700550052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b5c0fbb40 0x7f9b5c0fbfb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c004880 tx=0x7f9b4c009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:13.692 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.689+0000 7f9b635bd700 1 -- 172.21.15.155:0/3700550052 shutdown_connections 2023-12-16T06:00:13.692 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.689+0000 7f9b635bd700 1 --2- 172.21.15.155:0/3700550052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b5c0fbb40 0x7f9b5c0fbfb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:13.692 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.689+0000 7f9b635bd700 1 --2- 172.21.15.155:0/3700550052 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5c101b00 0x7f9b5c101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:13.692 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.689+0000 7f9b635bd700 1 -- 172.21.15.155:0/3700550052 >> 172.21.15.155:0/3700550052 conn(0x7f9b5c0f76c0 msgr2=0x7f9b5c0f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:13.692 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.689+0000 7f9b635bd700 1 -- 172.21.15.155:0/3700550052 shutdown_connections 2023-12-16T06:00:13.692 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.689+0000 7f9b635bd700 1 -- 172.21.15.155:0/3700550052 wait complete. 2023-12-16T06:00:13.693 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.690+0000 7f9b635bd700 1 Processor -- start 2023-12-16T06:00:13.693 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.690+0000 7f9b635bd700 1 -- start start 2023-12-16T06:00:13.693 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.691+0000 7f9b635bd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b5c0fbb40 0x7f9b5c06aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:13.693 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.691+0000 7f9b635bd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5c101b00 0x7f9b5c06afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:13.693 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.691+0000 7f9b635bd700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c06b630 con 0x7f9b5c101b00 2023-12-16T06:00:13.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.691+0000 7f9b635bd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c10b210 con 0x7f9b5c0fbb40 2023-12-16T06:00:13.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.691+0000 7f9b60b58700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5c101b00 0x7f9b5c06afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:13.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.691+0000 7f9b60b58700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5c101b00 0x7f9b5c06afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37328/0 (socket says 172.21.15.155:37328) 2023-12-16T06:00:13.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.691+0000 7f9b60b58700 1 -- 172.21.15.155:0/682654293 learned_addr learned my addr 172.21.15.155:0/682654293 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:00:13.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.691+0000 7f9b61359700 1 --2- 172.21.15.155:0/682654293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b5c0fbb40 0x7f9b5c06aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:13.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.691+0000 7f9b60b58700 1 -- 172.21.15.155:0/682654293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b5c0fbb40 msgr2=0x7f9b5c06aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:13.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.691+0000 7f9b60b58700 1 --2- 172.21.15.155:0/682654293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b5c0fbb40 0x7f9b5c06aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:13.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.691+0000 7f9b60b58700 1 -- 172.21.15.155:0/682654293 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c005040 con 0x7f9b5c101b00 2023-12-16T06:00:13.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.691+0000 7f9b61359700 1 --2- 172.21.15.155:0/682654293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b5c0fbb40 0x7f9b5c06aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T06:00:13.694 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.692+0000 7f9b60b58700 1 --2- 172.21.15.155:0/682654293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5c101b00 0x7f9b5c06afe0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0041d0 tx=0x7f9b4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:13.699 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.694+0000 7f9b51ffb700 1 -- 172.21.15.155:0/682654293 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b4c00e030 con 0x7f9b5c101b00 2023-12-16T06:00:13.699 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.694+0000 7f9b51ffb700 1 -- 172.21.15.155:0/682654293 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9b4c01c400 con 0x7f9b5c101b00 2023-12-16T06:00:13.699 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.694+0000 7f9b51ffb700 1 -- 172.21.15.155:0/682654293 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b4c012600 con 0x7f9b5c101b00 2023-12-16T06:00:13.699 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.696+0000 7f9b635bd700 1 -- 172.21.15.155:0/682654293 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5c10b460 con 0x7f9b5c101b00 2023-12-16T06:00:13.699 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.696+0000 7f9b635bd700 1 -- 172.21.15.155:0/682654293 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c10b920 con 0x7f9b5c101b00 2023-12-16T06:00:13.699 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.697+0000 7f9b635bd700 1 -- 172.21.15.155:0/682654293 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c0fb2c0 con 0x7f9b5c101b00 2023-12-16T06:00:13.700 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.698+0000 7f9b51ffb700 1 -- 172.21.15.155:0/682654293 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7f9b4c01c570 con 0x7f9b5c101b00 2023-12-16T06:00:13.700 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.698+0000 7f9b51ffb700 1 --2- 172.21.15.155:0/682654293 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f9b4806d040 0x7f9b4806f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:13.700 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.698+0000 7f9b51ffb700 1 -- 172.21.15.155:0/682654293 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f9b4c08d0e0 con 0x7f9b5c101b00 2023-12-16T06:00:13.700 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.699+0000 7f9b61359700 1 --2- 172.21.15.155:0/682654293 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f9b4806d040 0x7f9b4806f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:13.701 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.699+0000 7f9b61359700 1 --2- 172.21.15.155:0/682654293 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f9b4806d040 0x7f9b4806f4f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9b58009b80 tx=0x7f9b5800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:13.705 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.703+0000 7f9b51ffb700 1 -- 172.21.15.155:0/682654293 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f9b4c05aa60 con 0x7f9b5c101b00 2023-12-16T06:00:13.936 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.933+0000 7f9b635bd700 1 -- 172.21.15.155:0/682654293 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b5c10ca60 con 0x7f9b4806d040 2023-12-16T06:00:13.936 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.935+0000 7f9b51ffb700 1 -- 172.21.15.155:0/682654293 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9b5c10ca60 con 0x7f9b4806d040 2023-12-16T06:00:13.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.937+0000 7f9b635bd700 1 -- 172.21.15.155:0/682654293 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f9b4806d040 msgr2=0x7f9b4806f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:13.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.937+0000 7f9b635bd700 1 --2- 172.21.15.155:0/682654293 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f9b4806d040 0x7f9b4806f4f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9b58009b80 tx=0x7f9b5800b040 comp rx=0 tx=0).stop 2023-12-16T06:00:13.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.937+0000 7f9b635bd700 1 -- 172.21.15.155:0/682654293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5c101b00 msgr2=0x7f9b5c06afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:13.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.937+0000 7f9b635bd700 1 --2- 172.21.15.155:0/682654293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5c101b00 0x7f9b5c06afe0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0041d0 tx=0x7f9b4c009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:13.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.937+0000 7f9b635bd700 1 -- 172.21.15.155:0/682654293 shutdown_connections 2023-12-16T06:00:13.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.937+0000 7f9b635bd700 1 --2- 172.21.15.155:0/682654293 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f9b4806d040 0x7f9b4806f4f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:13.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.937+0000 7f9b635bd700 1 --2- 172.21.15.155:0/682654293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b5c0fbb40 0x7f9b5c06aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:13.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.937+0000 7f9b635bd700 1 --2- 172.21.15.155:0/682654293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5c101b00 0x7f9b5c06afe0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:13.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.937+0000 7f9b635bd700 1 -- 172.21.15.155:0/682654293 >> 172.21.15.155:0/682654293 conn(0x7f9b5c0f76c0 msgr2=0x7f9b5c0f9190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:13.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.937+0000 7f9b635bd700 1 -- 172.21.15.155:0/682654293 shutdown_connections 2023-12-16T06:00:13.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:13.937+0000 7f9b635bd700 1 -- 172.21.15.155:0/682654293 wait complete. 2023-12-16T06:00:13.949 INFO:teuthology.orchestra.run.smithi155.stdout:true 2023-12-16T06:00:14.027 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:13 smithi155 systemd[1]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.0.service: Succeeded. 2023-12-16T06:00:14.028 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:13 smithi155 systemd[1]: Stopped Ceph osd.0 for d344784e-9bd6-11ee-95a5-87774f69a715. 2023-12-16T06:00:14.028 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:13 smithi155 systemd[1]: Starting Ceph osd.0 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T06:00:14.028 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:13 smithi155 ceph-mon[217407]: failed to encode map e49 with expected crc 2023-12-16T06:00:14.028 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:13 smithi155 ceph-mon[217407]: osdmap e49: 6 total, 5 up, 6 in 2023-12-16T06:00:14.028 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:13 smithi155 ceph-mon[217407]: failed to encode map e49 with expected crc 2023-12-16T06:00:14.029 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:13 smithi155 ceph-mon[217407]: failed to encode map e49 with expected crc 2023-12-16T06:00:14.029 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:13 smithi155 ceph-mon[217407]: failed to encode map e49 with expected crc 2023-12-16T06:00:14.029 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:13 smithi155 ceph-mon[217407]: failed to encode map e49 with expected crc 2023-12-16T06:00:14.029 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:13 smithi155 ceph-mon[217407]: failed to encode map e49 with expected crc 2023-12-16T06:00:14.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.047+0000 7f21df2ee700 1 -- 172.21.15.155:0/2673009795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d8102c20 msgr2=0x7f21d8102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:14.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.047+0000 7f21df2ee700 1 --2- 172.21.15.155:0/2673009795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d8102c20 0x7f21d8102ff0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f21d4004940 tx=0x7f21d4009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:14.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.047+0000 7f21df2ee700 1 -- 172.21.15.155:0/2673009795 shutdown_connections 2023-12-16T06:00:14.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.047+0000 7f21df2ee700 1 --2- 172.21.15.155:0/2673009795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21d8065390 0x7f21d8065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:14.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.047+0000 7f21df2ee700 1 --2- 172.21.15.155:0/2673009795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d8102c20 0x7f21d8102ff0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:14.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.047+0000 7f21df2ee700 1 -- 172.21.15.155:0/2673009795 >> 172.21.15.155:0/2673009795 conn(0x7f21d80719b0 msgr2=0x7f21d8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:14.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.047+0000 7f21df2ee700 1 -- 172.21.15.155:0/2673009795 shutdown_connections 2023-12-16T06:00:14.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.047+0000 7f21df2ee700 1 -- 172.21.15.155:0/2673009795 wait complete. 2023-12-16T06:00:14.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.047+0000 7f21df2ee700 1 Processor -- start 2023-12-16T06:00:14.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.047+0000 7f21df2ee700 1 -- start start 2023-12-16T06:00:14.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.047+0000 7f21df2ee700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d8065390 0x7f21d80fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:14.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.047+0000 7f21df2ee700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21d8102c20 0x7f21d80fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:14.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.048+0000 7f21df2ee700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d80fc730 con 0x7f21d8065390 2023-12-16T06:00:14.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.048+0000 7f21df2ee700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d80fc8a0 con 0x7f21d8102c20 2023-12-16T06:00:14.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.048+0000 7f21dd08a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d8065390 0x7f21d80fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:14.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.048+0000 7f21dd08a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d8065390 0x7f21d80fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37352/0 (socket says 172.21.15.155:37352) 2023-12-16T06:00:14.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.048+0000 7f21dd08a700 1 -- 172.21.15.155:0/246184851 learned_addr learned my addr 172.21.15.155:0/246184851 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:00:14.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.048+0000 7f21dc889700 1 --2- 172.21.15.155:0/246184851 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21d8102c20 0x7f21d80fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:14.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.048+0000 7f21dd08a700 1 -- 172.21.15.155:0/246184851 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21d8102c20 msgr2=0x7f21d80fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:14.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.048+0000 7f21dd08a700 1 --2- 172.21.15.155:0/246184851 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21d8102c20 0x7f21d80fc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:14.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.048+0000 7f21dd08a700 1 -- 172.21.15.155:0/246184851 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d4005040 con 0x7f21d8065390 2023-12-16T06:00:14.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.048+0000 7f21dd08a700 1 --2- 172.21.15.155:0/246184851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d8065390 0x7f21d80fbbf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f21d400b3b0 tx=0x7f21d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:14.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.048+0000 7f21cdffb700 1 -- 172.21.15.155:0/246184851 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21d400e040 con 0x7f21d8065390 2023-12-16T06:00:14.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.048+0000 7f21cdffb700 1 -- 172.21.15.155:0/246184851 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f21d401c430 con 0x7f21d8065390 2023-12-16T06:00:14.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.048+0000 7f21df2ee700 1 -- 172.21.15.155:0/246184851 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d8119850 con 0x7f21d8065390 2023-12-16T06:00:14.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.048+0000 7f21cdffb700 1 -- 172.21.15.155:0/246184851 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21d4013640 con 0x7f21d8065390 2023-12-16T06:00:14.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.048+0000 7f21df2ee700 1 -- 172.21.15.155:0/246184851 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d8119cb0 con 0x7f21d8065390 2023-12-16T06:00:14.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.049+0000 7f21df2ee700 1 -- 172.21.15.155:0/246184851 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d80fff40 con 0x7f21d8065390 2023-12-16T06:00:14.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.050+0000 7f21cdffb700 1 -- 172.21.15.155:0/246184851 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7f21d401c5a0 con 0x7f21d8065390 2023-12-16T06:00:14.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.050+0000 7f21cdffb700 1 --2- 172.21.15.155:0/246184851 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f21c406cf80 0x7f21c406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:14.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.050+0000 7f21cdffb700 1 -- 172.21.15.155:0/246184851 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f21d408d010 con 0x7f21d8065390 2023-12-16T06:00:14.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.050+0000 7f21dc889700 1 --2- 172.21.15.155:0/246184851 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f21c406cf80 0x7f21c406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:14.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.051+0000 7f21dc889700 1 --2- 172.21.15.155:0/246184851 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f21c406cf80 0x7f21c406f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f21d80fd5f0 tx=0x7f21c800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:14.057 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.055+0000 7f21cdffb700 1 -- 172.21.15.155:0/246184851 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f21d4056e50 con 0x7f21d8065390 2023-12-16T06:00:14.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:13 smithi156 ceph-mon[182000]: failed to encode map e49 with expected crc 2023-12-16T06:00:14.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:13 smithi156 ceph-mon[182000]: osdmap e49: 6 total, 5 up, 6 in 2023-12-16T06:00:14.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:13 smithi156 ceph-mon[182000]: failed to encode map e49 with expected crc 2023-12-16T06:00:14.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:13 smithi156 ceph-mon[182000]: failed to encode map e49 with expected crc 2023-12-16T06:00:14.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:13 smithi156 ceph-mon[182000]: failed to encode map e49 with expected crc 2023-12-16T06:00:14.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:13 smithi156 ceph-mon[182000]: failed to encode map e49 with expected crc 2023-12-16T06:00:14.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:13 smithi156 ceph-mon[182000]: failed to encode map e49 with expected crc 2023-12-16T06:00:14.277 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.275+0000 7f21df2ee700 1 -- 172.21.15.155:0/246184851 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f21d80fca60 con 0x7f21c406cf80 2023-12-16T06:00:14.278 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.277+0000 7f21cdffb700 1 -- 172.21.15.155:0/246184851 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f21d80fca60 con 0x7f21c406cf80 2023-12-16T06:00:14.281 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.279+0000 7f21df2ee700 1 -- 172.21.15.155:0/246184851 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f21c406cf80 msgr2=0x7f21c406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:14.281 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.279+0000 7f21df2ee700 1 --2- 172.21.15.155:0/246184851 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f21c406cf80 0x7f21c406f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f21d80fd5f0 tx=0x7f21c800b040 comp rx=0 tx=0).stop 2023-12-16T06:00:14.281 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.279+0000 7f21df2ee700 1 -- 172.21.15.155:0/246184851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d8065390 msgr2=0x7f21d80fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:14.281 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.279+0000 7f21df2ee700 1 --2- 172.21.15.155:0/246184851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d8065390 0x7f21d80fbbf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f21d400b3b0 tx=0x7f21d4009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:14.281 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.279+0000 7f21df2ee700 1 -- 172.21.15.155:0/246184851 shutdown_connections 2023-12-16T06:00:14.281 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.279+0000 7f21df2ee700 1 --2- 172.21.15.155:0/246184851 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f21c406cf80 0x7f21c406f430 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:14.281 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.279+0000 7f21df2ee700 1 --2- 172.21.15.155:0/246184851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d8065390 0x7f21d80fbbf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:14.282 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.279+0000 7f21df2ee700 1 --2- 172.21.15.155:0/246184851 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21d8102c20 0x7f21d80fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:14.282 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.279+0000 7f21df2ee700 1 -- 172.21.15.155:0/246184851 >> 172.21.15.155:0/246184851 conn(0x7f21d80719b0 msgr2=0x7f21d80fab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:14.282 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.280+0000 7f21df2ee700 1 -- 172.21.15.155:0/246184851 shutdown_connections 2023-12-16T06:00:14.282 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.280+0000 7f21df2ee700 1 -- 172.21.15.155:0/246184851 wait complete. 2023-12-16T06:00:14.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.388+0000 7f246a031700 1 -- 172.21.15.155:0/592459949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2464103590 msgr2=0x7f24640fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:14.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.388+0000 7f246a031700 1 --2- 172.21.15.155:0/592459949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2464103590 0x7f24640fcc00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f244c004940 tx=0x7f244c009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:14.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.388+0000 7f246a031700 1 -- 172.21.15.155:0/592459949 shutdown_connections 2023-12-16T06:00:14.391 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.388+0000 7f246a031700 1 --2- 172.21.15.155:0/592459949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2464103590 0x7f24640fcc00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:14.391 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.388+0000 7f246a031700 1 --2- 172.21.15.155:0/592459949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2464102bf0 0x7f2464102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:14.391 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.388+0000 7f246a031700 1 -- 172.21.15.155:0/592459949 >> 172.21.15.155:0/592459949 conn(0x7f24640f87a0 msgr2=0x7f24640fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:14.391 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.388+0000 7f246a031700 1 -- 172.21.15.155:0/592459949 shutdown_connections 2023-12-16T06:00:14.391 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.388+0000 7f246a031700 1 -- 172.21.15.155:0/592459949 wait complete. 2023-12-16T06:00:14.391 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.389+0000 7f246a031700 1 Processor -- start 2023-12-16T06:00:14.391 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.389+0000 7f246a031700 1 -- start start 2023-12-16T06:00:14.392 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.389+0000 7f246a031700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2464102bf0 0x7f24641135c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:14.392 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.389+0000 7f246a031700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2464103590 0x7f2464113b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:14.392 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.389+0000 7f246a031700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2464114150 con 0x7f2464102bf0 2023-12-16T06:00:14.392 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.389+0000 7f246a031700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246410d480 con 0x7f2464103590 2023-12-16T06:00:14.392 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.389+0000 7f24637fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2464102bf0 0x7f24641135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:14.393 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.389+0000 7f24637fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2464102bf0 0x7f24641135c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37362/0 (socket says 172.21.15.155:37362) 2023-12-16T06:00:14.393 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.389+0000 7f24637fe700 1 -- 172.21.15.155:0/1876409685 learned_addr learned my addr 172.21.15.155:0/1876409685 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:00:14.393 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.390+0000 7f2462ffd700 1 --2- 172.21.15.155:0/1876409685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2464103590 0x7f2464113b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:14.393 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.390+0000 7f24637fe700 1 -- 172.21.15.155:0/1876409685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2464103590 msgr2=0x7f2464113b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:14.393 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.390+0000 7f24637fe700 1 --2- 172.21.15.155:0/1876409685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2464103590 0x7f2464113b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:14.393 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.390+0000 7f24637fe700 1 -- 172.21.15.155:0/1876409685 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c005040 con 0x7f2464102bf0 2023-12-16T06:00:14.393 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.390+0000 7f24637fe700 1 --2- 172.21.15.155:0/1876409685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2464102bf0 0x7f24641135c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2454001db0 tx=0x7f2454009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:14.393 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.390+0000 7f245bfff700 1 -- 172.21.15.155:0/1876409685 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f245400ed50 con 0x7f2464102bf0 2023-12-16T06:00:14.393 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.390+0000 7f245bfff700 1 -- 172.21.15.155:0/1876409685 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2454007dd0 con 0x7f2464102bf0 2023-12-16T06:00:14.393 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.390+0000 7f245bfff700 1 -- 172.21.15.155:0/1876409685 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2454014640 con 0x7f2464102bf0 2023-12-16T06:00:14.393 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.390+0000 7f246a031700 1 -- 172.21.15.155:0/1876409685 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f246410d760 con 0x7f2464102bf0 2023-12-16T06:00:14.393 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.390+0000 7f246a031700 1 -- 172.21.15.155:0/1876409685 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246410dc70 con 0x7f2464102bf0 2023-12-16T06:00:14.394 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.391+0000 7f246a031700 1 -- 172.21.15.155:0/1876409685 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24641050c0 con 0x7f2464102bf0 2023-12-16T06:00:14.394 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.392+0000 7f245bfff700 1 -- 172.21.15.155:0/1876409685 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7f2454007920 con 0x7f2464102bf0 2023-12-16T06:00:14.394 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.392+0000 7f245bfff700 1 --2- 172.21.15.155:0/1876409685 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f245006cf80 0x7f245006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:14.394 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.392+0000 7f245bfff700 1 -- 172.21.15.155:0/1876409685 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f245408c110 con 0x7f2464102bf0 2023-12-16T06:00:14.394 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.392+0000 7f2462ffd700 1 --2- 172.21.15.155:0/1876409685 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f245006cf80 0x7f245006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:14.395 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.393+0000 7f2462ffd700 1 --2- 172.21.15.155:0/1876409685 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f245006cf80 0x7f245006f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f244c00b3b0 tx=0x7f244c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:14.398 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.397+0000 7f245bfff700 1 -- 172.21.15.155:0/1876409685 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f2454059af0 con 0x7f2464102bf0 2023-12-16T06:00:14.613 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.611+0000 7f246a031700 1 -- 172.21.15.155:0/1876409685 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f246404bbf0 con 0x7f245006cf80 2023-12-16T06:00:14.623 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.621+0000 7f245bfff700 1 -- 172.21.15.155:0/1876409685 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f246404bbf0 con 0x7f245006cf80 2023-12-16T06:00:14.623 INFO:teuthology.orchestra.run.smithi155.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T06:00:14.623 INFO:teuthology.orchestra.run.smithi155.stdout:alertmanager.smithi155 smithi155 *:9093,9094 running (118s) 10s ago 9m 17.8M - 0.25.0 c8568f914cd2 e1da85d6fc09 2023-12-16T06:00:14.623 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi155 smithi155 running (16s) 10s ago 9m 7470k - 19.0.0-191-g6d933094 a29c258b5d6f 6599d6adc8fa 2023-12-16T06:00:14.623 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi156 smithi156 running (13s) 11s ago 8m 7448k - 19.0.0-191-g6d933094 a29c258b5d6f 8129878ae56e 2023-12-16T06:00:14.624 INFO:teuthology.orchestra.run.smithi155.stdout:grafana.smithi155 smithi155 *:3000 running (107s) 10s ago 9m 82.2M - 9.4.12 a0ea5e3c46d9 a16c84704784 2023-12-16T06:00:14.624 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.bzsxjw smithi155 running (5m) 10s ago 5m 4745M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6bcabf94a5c3 2023-12-16T06:00:14.624 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.vicpis smithi155 running (5m) 10s ago 5m 668M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 afa64e1ef8da 2023-12-16T06:00:14.624 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.fasing smithi156 running (5m) 11s ago 5m 538M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 7d97160bda7c 2023-12-16T06:00:14.624 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.qvgmfj smithi156 running (5m) 11s ago 5m 5969M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4018b2f2e27e 2023-12-16T06:00:14.624 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi155.maowdn smithi155 *:8443,9283,8765 running (3m) 10s ago 10m 506M - 19.0.0-191-g6d933094 a29c258b5d6f ee39089d18d3 2023-12-16T06:00:14.624 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi156.pclong smithi156 *:8443,9283,8765 running (2m) 11s ago 8m 447M - 19.0.0-191-g6d933094 a29c258b5d6f 673376e357e8 2023-12-16T06:00:14.624 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi155 smithi155 running (62s) 10s ago 10m 57.7M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 19eb23d9f064 2023-12-16T06:00:14.624 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi156 smithi156 running (42s) 11s ago 8m 46.4M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 62dacb4d7a17 2023-12-16T06:00:14.624 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi155 smithi155 *:9100 running (2m) 10s ago 9m 15.9M - 1.5.0 0da6a335fe13 6f0f1f68f191 2023-12-16T06:00:14.624 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi156 smithi156 *:9100 running (2m) 11s ago 8m 18.8M - 1.5.0 0da6a335fe13 c4595a7b1707 2023-12-16T06:00:14.624 INFO:teuthology.orchestra.run.smithi155.stdout:osd.0 smithi155 running (8m) 10s ago 8m 787M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 91e650c277f7 2023-12-16T06:00:14.624 INFO:teuthology.orchestra.run.smithi155.stdout:osd.1 smithi155 running (7m) 10s ago 7m 864M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957303cb6598 2023-12-16T06:00:14.624 INFO:teuthology.orchestra.run.smithi155.stdout:osd.2 smithi155 running (7m) 10s ago 7m 630M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957a169c1cac 2023-12-16T06:00:14.624 INFO:teuthology.orchestra.run.smithi155.stdout:osd.3 smithi156 running (7m) 11s ago 7m 960M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c4f6c54afe99 2023-12-16T06:00:14.625 INFO:teuthology.orchestra.run.smithi155.stdout:osd.4 smithi156 running (6m) 11s ago 6m 741M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 6309b12204fd 2023-12-16T06:00:14.625 INFO:teuthology.orchestra.run.smithi155.stdout:osd.5 smithi156 running (6m) 11s ago 6m 854M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 84b2c33eb0e1 2023-12-16T06:00:14.625 INFO:teuthology.orchestra.run.smithi155.stdout:prometheus.smithi155 smithi155 *:9095 running (2m) 10s ago 9m 60.0M - 2.43.0 a07b618ecd1d 26bb7cfc1b8b 2023-12-16T06:00:14.625 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.624+0000 7f246a031700 1 -- 172.21.15.155:0/1876409685 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f245006cf80 msgr2=0x7f245006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:14.626 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.624+0000 7f246a031700 1 --2- 172.21.15.155:0/1876409685 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f245006cf80 0x7f245006f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f244c00b3b0 tx=0x7f244c009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:14.626 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.624+0000 7f246a031700 1 -- 172.21.15.155:0/1876409685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2464102bf0 msgr2=0x7f24641135c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:14.626 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.624+0000 7f246a031700 1 --2- 172.21.15.155:0/1876409685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2464102bf0 0x7f24641135c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2454001db0 tx=0x7f2454009ee0 comp rx=0 tx=0).stop 2023-12-16T06:00:14.626 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.624+0000 7f246a031700 1 -- 172.21.15.155:0/1876409685 shutdown_connections 2023-12-16T06:00:14.626 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.624+0000 7f246a031700 1 --2- 172.21.15.155:0/1876409685 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f245006cf80 0x7f245006f430 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:14.626 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.624+0000 7f246a031700 1 --2- 172.21.15.155:0/1876409685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2464102bf0 0x7f24641135c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:14.626 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.624+0000 7f246a031700 1 --2- 172.21.15.155:0/1876409685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2464103590 0x7f2464113b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:14.626 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.624+0000 7f246a031700 1 -- 172.21.15.155:0/1876409685 >> 172.21.15.155:0/1876409685 conn(0x7f24640f87a0 msgr2=0x7f24640fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:14.626 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.624+0000 7f246a031700 1 -- 172.21.15.155:0/1876409685 shutdown_connections 2023-12-16T06:00:14.626 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.624+0000 7f246a031700 1 -- 172.21.15.155:0/1876409685 wait complete. 2023-12-16T06:00:14.729 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.727+0000 7f632e985700 1 -- 172.21.15.155:0/618444636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6328101b00 msgr2=0x7f6328101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:14.729 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.727+0000 7f632e985700 1 --2- 172.21.15.155:0/618444636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6328101b00 0x7f6328101ed0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6318004940 tx=0x7f6318009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:14.729 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.727+0000 7f632e985700 1 -- 172.21.15.155:0/618444636 shutdown_connections 2023-12-16T06:00:14.729 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.727+0000 7f632e985700 1 --2- 172.21.15.155:0/618444636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63280fbb40 0x7f63280fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:14.730 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.727+0000 7f632e985700 1 --2- 172.21.15.155:0/618444636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6328101b00 0x7f6328101ed0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:14.730 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.727+0000 7f632e985700 1 -- 172.21.15.155:0/618444636 >> 172.21.15.155:0/618444636 conn(0x7f63280719b0 msgr2=0x7f6328071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:14.730 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.727+0000 7f632e985700 1 -- 172.21.15.155:0/618444636 shutdown_connections 2023-12-16T06:00:14.730 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.727+0000 7f632e985700 1 -- 172.21.15.155:0/618444636 wait complete. 2023-12-16T06:00:14.730 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.728+0000 7f632e985700 1 Processor -- start 2023-12-16T06:00:14.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.728+0000 7f632e985700 1 -- start start 2023-12-16T06:00:14.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.728+0000 7f632e985700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63280fbb40 0x7f632810e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:14.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.728+0000 7f632e985700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6328101b00 0x7f632810eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:14.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.728+0000 7f632e985700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632810f120 con 0x7f6328101b00 2023-12-16T06:00:14.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.728+0000 7f632e985700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632810f290 con 0x7f63280fbb40 2023-12-16T06:00:14.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.728+0000 7f63277fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6328101b00 0x7f632810eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:14.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.728+0000 7f63277fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6328101b00 0x7f632810eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37384/0 (socket says 172.21.15.155:37384) 2023-12-16T06:00:14.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.729+0000 7f63277fe700 1 -- 172.21.15.155:0/1956224710 learned_addr learned my addr 172.21.15.155:0/1956224710 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:00:14.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.729+0000 7f63277fe700 1 -- 172.21.15.155:0/1956224710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63280fbb40 msgr2=0x7f632810e5e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-16T06:00:14.732 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.729+0000 7f63277fe700 1 --2- 172.21.15.155:0/1956224710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63280fbb40 0x7f632810e5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:14.732 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.729+0000 7f63277fe700 1 -- 172.21.15.155:0/1956224710 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6318005040 con 0x7f6328101b00 2023-12-16T06:00:14.732 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.729+0000 7f63277fe700 1 --2- 172.21.15.155:0/1956224710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6328101b00 0x7f632810eb20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f631c00eb40 tx=0x7f631c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:14.732 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.729+0000 7f6324ff9700 1 -- 172.21.15.155:0/1956224710 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f631c007cc0 con 0x7f6328101b00 2023-12-16T06:00:14.732 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.729+0000 7f632e985700 1 -- 172.21.15.155:0/1956224710 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6328117580 con 0x7f6328101b00 2023-12-16T06:00:14.732 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.729+0000 7f6324ff9700 1 -- 172.21.15.155:0/1956224710 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f631c00f040 con 0x7f6328101b00 2023-12-16T06:00:14.732 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.729+0000 7f6324ff9700 1 -- 172.21.15.155:0/1956224710 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f631c0094d0 con 0x7f6328101b00 2023-12-16T06:00:14.732 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.729+0000 7f632e985700 1 -- 172.21.15.155:0/1956224710 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6328117ac0 con 0x7f6328101b00 2023-12-16T06:00:14.733 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.730+0000 7f632e985700 1 -- 172.21.15.155:0/1956224710 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6328103fb0 con 0x7f6328101b00 2023-12-16T06:00:14.733 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.731+0000 7f6324ff9700 1 -- 172.21.15.155:0/1956224710 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7f631c009790 con 0x7f6328101b00 2023-12-16T06:00:14.733 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.731+0000 7f6324ff9700 1 --2- 172.21.15.155:0/1956224710 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f631006cf80 0x7f631006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:14.733 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.731+0000 7f6324ff9700 1 -- 172.21.15.155:0/1956224710 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f631c08c120 con 0x7f6328101b00 2023-12-16T06:00:14.733 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.731+0000 7f6327fff700 1 --2- 172.21.15.155:0/1956224710 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f631006cf80 0x7f631006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:14.733 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.732+0000 7f6327fff700 1 --2- 172.21.15.155:0/1956224710 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f631006cf80 0x7f631006f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f631800b0d0 tx=0x7f6318009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:14.737 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:14.736+0000 7f6324ff9700 1 -- 172.21.15.155:0/1956224710 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f631c055ee0 con 0x7f6328101b00 2023-12-16T06:00:14.809 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:14 smithi155 bash[231409]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-16T06:00:14.809 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:14 smithi155 bash[231409]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-16T06:00:14.809 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:14 smithi155 bash[231409]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-16T06:00:14.809 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:14 smithi155 bash[231409]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-16T06:00:14.809 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:14 smithi155 bash[231409]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2023-12-16T06:00:14.809 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:14 smithi155 bash[231409]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-16T06:00:14.809 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:14 smithi155 bash[231409]: --> ceph-volume raw activate successful for osd ID: 0 2023-12-16T06:00:15.040 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.038+0000 7f632e985700 1 -- 172.21.15.155:0/1956224710 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f63280734d0 con 0x7f6328101b00 2023-12-16T06:00:15.041 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.039+0000 7f6324ff9700 1 -- 172.21.15.155:0/1956224710 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+729 (secure 0 0 0) 0x7f631c059500 con 0x7f6328101b00 2023-12-16T06:00:15.041 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T06:00:15.041 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": { 2023-12-16T06:00:15.041 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T06:00:15.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:00:15.041 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": { 2023-12-16T06:00:15.041 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T06:00:15.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:00:15.041 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": { 2023-12-16T06:00:15.041 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 5 2023-12-16T06:00:15.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:00:15.042 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2023-12-16T06:00:15.042 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T06:00:15.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:00:15.042 INFO:teuthology.orchestra.run.smithi155.stdout: "overall": { 2023-12-16T06:00:15.042 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 9, 2023-12-16T06:00:15.042 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 4 2023-12-16T06:00:15.042 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-12-16T06:00:15.042 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T06:00:15.043 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.041+0000 7f632e985700 1 -- 172.21.15.155:0/1956224710 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f631006cf80 msgr2=0x7f631006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:15.043 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.041+0000 7f632e985700 1 --2- 172.21.15.155:0/1956224710 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f631006cf80 0x7f631006f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f631800b0d0 tx=0x7f6318009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:15.043 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.041+0000 7f632e985700 1 -- 172.21.15.155:0/1956224710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6328101b00 msgr2=0x7f632810eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:15.043 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.041+0000 7f632e985700 1 --2- 172.21.15.155:0/1956224710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6328101b00 0x7f632810eb20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f631c00eb40 tx=0x7f631c00b040 comp rx=0 tx=0).stop 2023-12-16T06:00:15.043 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.041+0000 7f632e985700 1 -- 172.21.15.155:0/1956224710 shutdown_connections 2023-12-16T06:00:15.043 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.041+0000 7f632e985700 1 --2- 172.21.15.155:0/1956224710 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f631006cf80 0x7f631006f430 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:15.043 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.041+0000 7f632e985700 1 --2- 172.21.15.155:0/1956224710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63280fbb40 0x7f632810e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:15.044 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.041+0000 7f632e985700 1 --2- 172.21.15.155:0/1956224710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6328101b00 0x7f632810eb20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:15.044 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.041+0000 7f632e985700 1 -- 172.21.15.155:0/1956224710 >> 172.21.15.155:0/1956224710 conn(0x7f63280719b0 msgr2=0x7f63280faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:15.044 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.041+0000 7f632e985700 1 -- 172.21.15.155:0/1956224710 shutdown_connections 2023-12-16T06:00:15.044 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.041+0000 7f632e985700 1 -- 172.21.15.155:0/1956224710 wait complete. 2023-12-16T06:00:15.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:14 smithi155 ceph-mon[217407]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:00:15.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:14 smithi155 ceph-mon[217407]: pgmap v32: 65 pgs: 9 stale+active+clean, 56 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-12-16T06:00:15.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:14 smithi155 ceph-mon[217407]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:00:15.150 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.148+0000 7fe75d7ae700 1 -- 172.21.15.155:0/54709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7580fdc00 msgr2=0x7fe7580fdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:15.150 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.148+0000 7fe75d7ae700 1 --2- 172.21.15.155:0/54709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7580fdc00 0x7fe7580fdfd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe748004940 tx=0x7fe748009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:15.151 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.148+0000 7fe75d7ae700 1 -- 172.21.15.155:0/54709 shutdown_connections 2023-12-16T06:00:15.151 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.148+0000 7fe75d7ae700 1 --2- 172.21.15.155:0/54709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7580fe5a0 0x7fe758106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:15.151 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.148+0000 7fe75d7ae700 1 --2- 172.21.15.155:0/54709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7580fdc00 0x7fe7580fdfd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:15.151 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.148+0000 7fe75d7ae700 1 -- 172.21.15.155:0/54709 >> 172.21.15.155:0/54709 conn(0x7fe7580f7690 msgr2=0x7fe7580f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:15.151 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.148+0000 7fe75d7ae700 1 -- 172.21.15.155:0/54709 shutdown_connections 2023-12-16T06:00:15.151 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.148+0000 7fe75d7ae700 1 -- 172.21.15.155:0/54709 wait complete. 2023-12-16T06:00:15.151 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.149+0000 7fe75d7ae700 1 Processor -- start 2023-12-16T06:00:15.151 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.149+0000 7fe75d7ae700 1 -- start start 2023-12-16T06:00:15.151 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.149+0000 7fe75d7ae700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7580fdc00 0x7fe7581135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:15.151 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.149+0000 7fe75d7ae700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7580fe5a0 0x7fe758113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:15.151 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.149+0000 7fe75d7ae700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe758114140 con 0x7fe7580fe5a0 2023-12-16T06:00:15.151 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.149+0000 7fe75d7ae700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75810d470 con 0x7fe7580fdc00 2023-12-16T06:00:15.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.149+0000 7fe7567fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7580fe5a0 0x7fe758113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:15.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.149+0000 7fe7567fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7580fe5a0 0x7fe758113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37410/0 (socket says 172.21.15.155:37410) 2023-12-16T06:00:15.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.149+0000 7fe7567fc700 1 -- 172.21.15.155:0/4080994869 learned_addr learned my addr 172.21.15.155:0/4080994869 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:00:15.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.149+0000 7fe756ffd700 1 --2- 172.21.15.155:0/4080994869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7580fdc00 0x7fe7581135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:15.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.149+0000 7fe7567fc700 1 -- 172.21.15.155:0/4080994869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7580fdc00 msgr2=0x7fe7581135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:15.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.149+0000 7fe7567fc700 1 --2- 172.21.15.155:0/4080994869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7580fdc00 0x7fe7581135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:15.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.149+0000 7fe7567fc700 1 -- 172.21.15.155:0/4080994869 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe748005040 con 0x7fe7580fe5a0 2023-12-16T06:00:15.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.150+0000 7fe7567fc700 1 --2- 172.21.15.155:0/4080994869 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7580fe5a0 0x7fe758113af0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe74c002a80 tx=0x7fe74c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:15.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.150+0000 7fe73f7fe700 1 -- 172.21.15.155:0/4080994869 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe74c007cc0 con 0x7fe7580fe5a0 2023-12-16T06:00:15.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.150+0000 7fe75d7ae700 1 -- 172.21.15.155:0/4080994869 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75810d750 con 0x7fe7580fe5a0 2023-12-16T06:00:15.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.150+0000 7fe73f7fe700 1 -- 172.21.15.155:0/4080994869 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe74c00f040 con 0x7fe7580fe5a0 2023-12-16T06:00:15.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.150+0000 7fe73f7fe700 1 -- 172.21.15.155:0/4080994869 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe74c009640 con 0x7fe7580fe5a0 2023-12-16T06:00:15.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.150+0000 7fe75d7ae700 1 -- 172.21.15.155:0/4080994869 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75810dc90 con 0x7fe7580fe5a0 2023-12-16T06:00:15.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.151+0000 7fe75d7ae700 1 -- 172.21.15.155:0/4080994869 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7581041f0 con 0x7fe7580fe5a0 2023-12-16T06:00:15.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.151+0000 7fe73f7fe700 1 -- 172.21.15.155:0/4080994869 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7fe74c0097a0 con 0x7fe7580fe5a0 2023-12-16T06:00:15.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.152+0000 7fe73f7fe700 1 --2- 172.21.15.155:0/4080994869 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fe74006cf80 0x7fe74006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:15.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.152+0000 7fe73f7fe700 1 -- 172.21.15.155:0/4080994869 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fe74c08bcf0 con 0x7fe7580fe5a0 2023-12-16T06:00:15.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.152+0000 7fe756ffd700 1 --2- 172.21.15.155:0/4080994869 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fe74006cf80 0x7fe74006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:15.154 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.152+0000 7fe756ffd700 1 --2- 172.21.15.155:0/4080994869 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fe74006cf80 0x7fe74006f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe748004f90 tx=0x7fe748009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:15.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.156+0000 7fe73f7fe700 1 -- 172.21.15.155:0/4080994869 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fe74c059490 con 0x7fe7580fe5a0 2023-12-16T06:00:15.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:14 smithi156 ceph-mon[182000]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:00:15.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:14 smithi156 ceph-mon[182000]: pgmap v32: 65 pgs: 9 stale+active+clean, 56 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-12-16T06:00:15.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:14 smithi156 ceph-mon[182000]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:00:15.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.407+0000 7fe75d7ae700 1 -- 172.21.15.155:0/4080994869 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe75804bbd0 con 0x7fe7580fe5a0 2023-12-16T06:00:15.409 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.407+0000 7fe73f7fe700 1 -- 172.21.15.155:0/4080994869 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1907 (secure 0 0 0) 0x7fe74c059020 con 0x7fe7580fe5a0 2023-12-16T06:00:15.409 INFO:teuthology.orchestra.run.smithi155.stdout:e16 2023-12-16T06:00:15.409 INFO:teuthology.orchestra.run.smithi155.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T06:00:15.409 INFO:teuthology.orchestra.run.smithi155.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T06:00:15.409 INFO:teuthology.orchestra.run.smithi155.stdout:legacy client fscid: 1 2023-12-16T06:00:15.409 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T06:00:15.409 INFO:teuthology.orchestra.run.smithi155.stdout:Filesystem 'cephfs' (1) 2023-12-16T06:00:15.410 INFO:teuthology.orchestra.run.smithi155.stdout:fs_name cephfs 2023-12-16T06:00:15.410 INFO:teuthology.orchestra.run.smithi155.stdout:epoch 16 2023-12-16T06:00:15.410 INFO:teuthology.orchestra.run.smithi155.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-16T06:00:15.410 INFO:teuthology.orchestra.run.smithi155.stdout:created 2023-12-16T05:54:25.897091+0000 2023-12-16T06:00:15.410 INFO:teuthology.orchestra.run.smithi155.stdout:modified 2023-12-16T05:56:25.130480+0000 2023-12-16T06:00:15.410 INFO:teuthology.orchestra.run.smithi155.stdout:tableserver 0 2023-12-16T06:00:15.410 INFO:teuthology.orchestra.run.smithi155.stdout:root 0 2023-12-16T06:00:15.410 INFO:teuthology.orchestra.run.smithi155.stdout:session_timeout 60 2023-12-16T06:00:15.410 INFO:teuthology.orchestra.run.smithi155.stdout:session_autoclose 300 2023-12-16T06:00:15.410 INFO:teuthology.orchestra.run.smithi155.stdout:max_file_size 1099511627776 2023-12-16T06:00:15.410 INFO:teuthology.orchestra.run.smithi155.stdout:max_xattr_size 65536 2023-12-16T06:00:15.411 INFO:teuthology.orchestra.run.smithi155.stdout:required_client_features {} 2023-12-16T06:00:15.411 INFO:teuthology.orchestra.run.smithi155.stdout:last_failure 0 2023-12-16T06:00:15.411 INFO:teuthology.orchestra.run.smithi155.stdout:last_failure_osd_epoch 0 2023-12-16T06:00:15.411 INFO:teuthology.orchestra.run.smithi155.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T06:00:15.411 INFO:teuthology.orchestra.run.smithi155.stdout:max_mds 2 2023-12-16T06:00:15.411 INFO:teuthology.orchestra.run.smithi155.stdout:in 0,1 2023-12-16T06:00:15.411 INFO:teuthology.orchestra.run.smithi155.stdout:up {0=14456,1=24281} 2023-12-16T06:00:15.411 INFO:teuthology.orchestra.run.smithi155.stdout:failed 2023-12-16T06:00:15.411 INFO:teuthology.orchestra.run.smithi155.stdout:damaged 2023-12-16T06:00:15.411 INFO:teuthology.orchestra.run.smithi155.stdout:stopped 2023-12-16T06:00:15.411 INFO:teuthology.orchestra.run.smithi155.stdout:data_pools [3] 2023-12-16T06:00:15.411 INFO:teuthology.orchestra.run.smithi155.stdout:metadata_pool 2 2023-12-16T06:00:15.411 INFO:teuthology.orchestra.run.smithi155.stdout:inline_data disabled 2023-12-16T06:00:15.411 INFO:teuthology.orchestra.run.smithi155.stdout:balancer 2023-12-16T06:00:15.411 INFO:teuthology.orchestra.run.smithi155.stdout:bal_rank_mask -1 2023-12-16T06:00:15.412 INFO:teuthology.orchestra.run.smithi155.stdout:standby_count_wanted 1 2023-12-16T06:00:15.412 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi155.bzsxjw{0:14456} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.155:6826/1416140807,v1:172.21.15.155:6827/1416140807] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T06:00:15.412 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi156.fasing{0:24289} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1763385284,v1:172.21.15.156:6827/1763385284] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T06:00:15.412 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi156.qvgmfj{1:24281} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.156:6824/2823725296,v1:172.21.15.156:6825/2823725296] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T06:00:15.412 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi155.vicpis{1:14472} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.155:6828/750006619,v1:172.21.15.155:6829/750006619] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T06:00:15.412 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T06:00:15.412 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T06:00:15.413 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.409+0000 7fe75d7ae700 1 -- 172.21.15.155:0/4080994869 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fe74006cf80 msgr2=0x7fe74006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:15.413 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.409+0000 7fe75d7ae700 1 --2- 172.21.15.155:0/4080994869 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fe74006cf80 0x7fe74006f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe748004f90 tx=0x7fe748009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:15.413 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.409+0000 7fe75d7ae700 1 -- 172.21.15.155:0/4080994869 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7580fe5a0 msgr2=0x7fe758113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:15.413 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.409+0000 7fe75d7ae700 1 --2- 172.21.15.155:0/4080994869 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7580fe5a0 0x7fe758113af0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe74c002a80 tx=0x7fe74c0046b0 comp rx=0 tx=0).stop 2023-12-16T06:00:15.413 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.409+0000 7fe75d7ae700 1 -- 172.21.15.155:0/4080994869 shutdown_connections 2023-12-16T06:00:15.413 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.409+0000 7fe75d7ae700 1 --2- 172.21.15.155:0/4080994869 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fe74006cf80 0x7fe74006f430 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:15.414 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.409+0000 7fe75d7ae700 1 --2- 172.21.15.155:0/4080994869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7580fdc00 0x7fe7581135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:15.414 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.409+0000 7fe75d7ae700 1 --2- 172.21.15.155:0/4080994869 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7580fe5a0 0x7fe758113af0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:15.414 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.409+0000 7fe75d7ae700 1 -- 172.21.15.155:0/4080994869 >> 172.21.15.155:0/4080994869 conn(0x7fe7580f7690 msgr2=0x7fe758101370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:15.414 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.409+0000 7fe75d7ae700 1 -- 172.21.15.155:0/4080994869 shutdown_connections 2023-12-16T06:00:15.414 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.409+0000 7fe75d7ae700 1 -- 172.21.15.155:0/4080994869 wait complete. 2023-12-16T06:00:15.414 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 16 2023-12-16T06:00:15.521 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.519+0000 7fa9c32a5700 1 -- 172.21.15.155:0/201226432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9bc103590 msgr2=0x7fa9bc0fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:15.521 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.519+0000 7fa9c32a5700 1 --2- 172.21.15.155:0/201226432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9bc103590 0x7fa9bc0fcc00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac004940 tx=0x7fa9ac009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:15.521 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.519+0000 7fa9c32a5700 1 -- 172.21.15.155:0/201226432 shutdown_connections 2023-12-16T06:00:15.521 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.519+0000 7fa9c32a5700 1 --2- 172.21.15.155:0/201226432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9bc103590 0x7fa9bc0fcc00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:15.521 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.519+0000 7fa9c32a5700 1 --2- 172.21.15.155:0/201226432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9bc102bf0 0x7fa9bc102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:15.522 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.519+0000 7fa9c32a5700 1 -- 172.21.15.155:0/201226432 >> 172.21.15.155:0/201226432 conn(0x7fa9bc0f87a0 msgr2=0x7fa9bc0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:15.522 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.519+0000 7fa9c32a5700 1 -- 172.21.15.155:0/201226432 shutdown_connections 2023-12-16T06:00:15.522 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.519+0000 7fa9c32a5700 1 -- 172.21.15.155:0/201226432 wait complete. 2023-12-16T06:00:15.523 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.520+0000 7fa9c32a5700 1 Processor -- start 2023-12-16T06:00:15.523 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.520+0000 7fa9c32a5700 1 -- start start 2023-12-16T06:00:15.523 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.520+0000 7fa9c32a5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9bc102bf0 0x7fa9bc1135c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:15.524 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.520+0000 7fa9c32a5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9bc103590 0x7fa9bc113b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:15.524 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.520+0000 7fa9c32a5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc114150 con 0x7fa9bc103590 2023-12-16T06:00:15.524 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.520+0000 7fa9c32a5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc10d480 con 0x7fa9bc102bf0 2023-12-16T06:00:15.524 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.520+0000 7fa9c0840700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9bc103590 0x7fa9bc113b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:15.524 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.520+0000 7fa9c0840700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9bc103590 0x7fa9bc113b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37446/0 (socket says 172.21.15.155:37446) 2023-12-16T06:00:15.524 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.520+0000 7fa9c0840700 1 -- 172.21.15.155:0/493731464 learned_addr learned my addr 172.21.15.155:0/493731464 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:00:15.524 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.520+0000 7fa9c1041700 1 --2- 172.21.15.155:0/493731464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9bc102bf0 0x7fa9bc1135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:15.524 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.521+0000 7fa9c0840700 1 -- 172.21.15.155:0/493731464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9bc102bf0 msgr2=0x7fa9bc1135c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:15.524 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.521+0000 7fa9c0840700 1 --2- 172.21.15.155:0/493731464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9bc102bf0 0x7fa9bc1135c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:15.524 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.521+0000 7fa9c0840700 1 -- 172.21.15.155:0/493731464 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ac005040 con 0x7fa9bc103590 2023-12-16T06:00:15.524 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.521+0000 7fa9c1041700 1 --2- 172.21.15.155:0/493731464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9bc102bf0 0x7fa9bc1135c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T06:00:15.524 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.521+0000 7fa9c0840700 1 --2- 172.21.15.155:0/493731464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9bc103590 0x7fa9bc113b00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009360 tx=0x7fa9ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:15.525 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.521+0000 7fa9b1ffb700 1 -- 172.21.15.155:0/493731464 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9ac00e040 con 0x7fa9bc103590 2023-12-16T06:00:15.525 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.521+0000 7fa9b1ffb700 1 -- 172.21.15.155:0/493731464 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa9ac013420 con 0x7fa9bc103590 2023-12-16T06:00:15.525 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.521+0000 7fa9b1ffb700 1 -- 172.21.15.155:0/493731464 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9ac01c610 con 0x7fa9bc103590 2023-12-16T06:00:15.525 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.521+0000 7fa9c32a5700 1 -- 172.21.15.155:0/493731464 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9bc10d620 con 0x7fa9bc103590 2023-12-16T06:00:15.525 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.521+0000 7fa9c32a5700 1 -- 172.21.15.155:0/493731464 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9bc10db10 con 0x7fa9bc103590 2023-12-16T06:00:15.526 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.523+0000 7fa9c32a5700 1 -- 172.21.15.155:0/493731464 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9bc1050c0 con 0x7fa9bc103590 2023-12-16T06:00:15.526 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.523+0000 7fa9b1ffb700 1 -- 172.21.15.155:0/493731464 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7fa9ac013590 con 0x7fa9bc103590 2023-12-16T06:00:15.526 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.523+0000 7fa9b1ffb700 1 --2- 172.21.15.155:0/493731464 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fa9a806cf80 0x7fa9a806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:15.526 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.523+0000 7fa9b1ffb700 1 -- 172.21.15.155:0/493731464 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa9ac08d7b0 con 0x7fa9bc103590 2023-12-16T06:00:15.526 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.523+0000 7fa9c1041700 1 --2- 172.21.15.155:0/493731464 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fa9a806cf80 0x7fa9a806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:15.526 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.524+0000 7fa9c1041700 1 --2- 172.21.15.155:0/493731464 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fa9a806cf80 0x7fa9a806f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8009fd0 tx=0x7fa9b800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:15.530 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.528+0000 7fa9b1ffb700 1 -- 172.21.15.155:0/493731464 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fa9ac05aef0 con 0x7fa9bc103590 2023-12-16T06:00:15.576 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:15 smithi155 ceph-osd[231821]: -- 172.21.15.155:0/2914677162 <== mon.0 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bdaf8bb6c0 con 0x55bdaf88ac00 2023-12-16T06:00:15.576 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:15 smithi155 bash[231760]: f5b1d720ac4f66e8599c1146fd7784e28640bdb88b8fee39ba3f4e9bf04b690a 2023-12-16T06:00:15.576 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:15 smithi155 systemd[1]: Started Ceph osd.0 for d344784e-9bd6-11ee-95a5-87774f69a715. 2023-12-16T06:00:15.755 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.753+0000 7fa9c32a5700 1 -- 172.21.15.155:0/493731464 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9bc10eba0 con 0x7fa9a806cf80 2023-12-16T06:00:15.756 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.754+0000 7fa9b1ffb700 1 -- 172.21.15.155:0/493731464 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa9bc10eba0 con 0x7fa9a806cf80 2023-12-16T06:00:15.756 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T06:00:15.756 INFO:teuthology.orchestra.run.smithi155.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T06:00:15.756 INFO:teuthology.orchestra.run.smithi155.stdout: "in_progress": true, 2023-12-16T06:00:15.756 INFO:teuthology.orchestra.run.smithi155.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T06:00:15.756 INFO:teuthology.orchestra.run.smithi155.stdout: "services_complete": [ 2023-12-16T06:00:15.756 INFO:teuthology.orchestra.run.smithi155.stdout: "crash", 2023-12-16T06:00:15.756 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr", 2023-12-16T06:00:15.756 INFO:teuthology.orchestra.run.smithi155.stdout: "mon" 2023-12-16T06:00:15.756 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-12-16T06:00:15.756 INFO:teuthology.orchestra.run.smithi155.stdout: "progress": "6/21 daemons upgraded", 2023-12-16T06:00:15.757 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "Currently upgrading osd daemons", 2023-12-16T06:00:15.757 INFO:teuthology.orchestra.run.smithi155.stdout: "is_paused": false 2023-12-16T06:00:15.757 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T06:00:15.758 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.757+0000 7fa9c32a5700 1 -- 172.21.15.155:0/493731464 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fa9a806cf80 msgr2=0x7fa9a806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:15.759 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.757+0000 7fa9c32a5700 1 --2- 172.21.15.155:0/493731464 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fa9a806cf80 0x7fa9a806f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8009fd0 tx=0x7fa9b800b040 comp rx=0 tx=0).stop 2023-12-16T06:00:15.759 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.757+0000 7fa9c32a5700 1 -- 172.21.15.155:0/493731464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9bc103590 msgr2=0x7fa9bc113b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:15.759 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.757+0000 7fa9c32a5700 1 --2- 172.21.15.155:0/493731464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9bc103590 0x7fa9bc113b00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009360 tx=0x7fa9ac009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:15.759 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.757+0000 7fa9c32a5700 1 -- 172.21.15.155:0/493731464 shutdown_connections 2023-12-16T06:00:15.759 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.757+0000 7fa9c32a5700 1 --2- 172.21.15.155:0/493731464 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fa9a806cf80 0x7fa9a806f430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:15.759 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.757+0000 7fa9c32a5700 1 --2- 172.21.15.155:0/493731464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9bc102bf0 0x7fa9bc1135c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:15.759 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.757+0000 7fa9c32a5700 1 --2- 172.21.15.155:0/493731464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9bc103590 0x7fa9bc113b00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:15.759 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.757+0000 7fa9c32a5700 1 -- 172.21.15.155:0/493731464 >> 172.21.15.155:0/493731464 conn(0x7fa9bc0f87a0 msgr2=0x7fa9bc0fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:15.759 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.757+0000 7fa9c32a5700 1 -- 172.21.15.155:0/493731464 shutdown_connections 2023-12-16T06:00:15.759 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.757+0000 7fa9c32a5700 1 -- 172.21.15.155:0/493731464 wait complete. 2023-12-16T06:00:15.875 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.872+0000 7f229afb3700 1 -- 172.21.15.155:0/1217338998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2294065390 msgr2=0x7f2294065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:15.875 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.872+0000 7f229afb3700 1 --2- 172.21.15.155:0/1217338998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2294065390 0x7f2294065800 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2280004940 tx=0x7f2280009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:15.875 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.872+0000 7f229afb3700 1 -- 172.21.15.155:0/1217338998 shutdown_connections 2023-12-16T06:00:15.875 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.872+0000 7f229afb3700 1 --2- 172.21.15.155:0/1217338998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2294065390 0x7f2294065800 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:15.875 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.872+0000 7f229afb3700 1 --2- 172.21.15.155:0/1217338998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2294102c20 0x7f2294102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:15.876 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.872+0000 7f229afb3700 1 -- 172.21.15.155:0/1217338998 >> 172.21.15.155:0/1217338998 conn(0x7f22940719b0 msgr2=0x7f2294071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:15.876 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.873+0000 7f229afb3700 1 -- 172.21.15.155:0/1217338998 shutdown_connections 2023-12-16T06:00:15.876 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.873+0000 7f229afb3700 1 -- 172.21.15.155:0/1217338998 wait complete. 2023-12-16T06:00:15.879 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.873+0000 7f229afb3700 1 Processor -- start 2023-12-16T06:00:15.879 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.873+0000 7f229afb3700 1 -- start start 2023-12-16T06:00:15.879 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.874+0000 7f229afb3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2294065390 0x7f22941135e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:15.879 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.874+0000 7f229afb3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2294102c20 0x7f2294113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:15.879 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.874+0000 7f229afb3700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2294114170 con 0x7f2294102c20 2023-12-16T06:00:15.879 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.874+0000 7f229afb3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229410d4a0 con 0x7f2294065390 2023-12-16T06:00:15.879 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.874+0000 7f2293fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2294102c20 0x7f2294113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:15.879 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.874+0000 7f2293fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2294102c20 0x7f2294113b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37472/0 (socket says 172.21.15.155:37472) 2023-12-16T06:00:15.879 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.874+0000 7f2293fff700 1 -- 172.21.15.155:0/2802922431 learned_addr learned my addr 172.21.15.155:0/2802922431 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:00:15.879 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.874+0000 7f2298d4f700 1 --2- 172.21.15.155:0/2802922431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2294065390 0x7f22941135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:15.879 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.874+0000 7f2293fff700 1 -- 172.21.15.155:0/2802922431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2294065390 msgr2=0x7f22941135e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:15.879 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.874+0000 7f2293fff700 1 --2- 172.21.15.155:0/2802922431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2294065390 0x7f22941135e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:15.879 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.874+0000 7f2293fff700 1 -- 172.21.15.155:0/2802922431 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2280005040 con 0x7f2294102c20 2023-12-16T06:00:15.880 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.874+0000 7f2293fff700 1 --2- 172.21.15.155:0/2802922431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2294102c20 0x7f2294113b20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2280000c00 tx=0x7f2280009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:15.880 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.875+0000 7f22917fa700 1 -- 172.21.15.155:0/2802922431 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2280021070 con 0x7f2294102c20 2023-12-16T06:00:15.880 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.875+0000 7f22917fa700 1 -- 172.21.15.155:0/2802922431 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f228001c400 con 0x7f2294102c20 2023-12-16T06:00:15.880 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.875+0000 7f22917fa700 1 -- 172.21.15.155:0/2802922431 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f228000e070 con 0x7f2294102c20 2023-12-16T06:00:15.880 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.875+0000 7f229afb3700 1 -- 172.21.15.155:0/2802922431 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f229410d720 con 0x7f2294102c20 2023-12-16T06:00:15.880 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.875+0000 7f229afb3700 1 -- 172.21.15.155:0/2802922431 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f229410dc00 con 0x7f2294102c20 2023-12-16T06:00:15.880 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.876+0000 7f229afb3700 1 -- 172.21.15.155:0/2802922431 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22940fff40 con 0x7f2294102c20 2023-12-16T06:00:15.880 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.876+0000 7f22917fa700 1 -- 172.21.15.155:0/2802922431 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7f228001c970 con 0x7f2294102c20 2023-12-16T06:00:15.880 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.877+0000 7f22917fa700 1 --2- 172.21.15.155:0/2802922431 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f228406cf80 0x7f228406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:15.880 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.877+0000 7f22917fa700 1 -- 172.21.15.155:0/2802922431 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f228008d550 con 0x7f2294102c20 2023-12-16T06:00:15.880 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.877+0000 7f2298d4f700 1 --2- 172.21.15.155:0/2802922431 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f228406cf80 0x7f228406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:15.880 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.877+0000 7f2298d4f700 1 --2- 172.21.15.155:0/2802922431 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f228406cf80 0x7f228406f430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2288009b80 tx=0x7f228800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:15.883 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:15.881+0000 7f22917fa700 1 -- 172.21.15.155:0/2802922431 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f228005ae10 con 0x7f2294102c20 2023-12-16T06:00:16.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:15 smithi155 ceph-mon[217407]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:00:16.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:15 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/1956224710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:16.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:15 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:16.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:15 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:16.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:15 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:00:16.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:15 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/4080994869' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T06:00:16.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:15 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:16.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:15 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:16.077 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:15 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-0[231777]: 2023-12-16T06:00:15.717+0000 7f1f2328d640 -1 Falling back to public interface 2023-12-16T06:00:16.173 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:16.171+0000 7f229afb3700 1 -- 172.21.15.155:0/2802922431 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f229404bb80 con 0x7f2294102c20 2023-12-16T06:00:16.173 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:16.172+0000 7f22917fa700 1 -- 172.21.15.155:0/2802922431 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+100 (secure 0 0 0) 0x7f228005a9a0 con 0x7f2294102c20 2023-12-16T06:00:16.174 INFO:teuthology.orchestra.run.smithi155.stdout:HEALTH_WARN 1 osds down 2023-12-16T06:00:16.174 INFO:teuthology.orchestra.run.smithi155.stdout:[WRN] OSD_DOWN: 1 osds down 2023-12-16T06:00:16.174 INFO:teuthology.orchestra.run.smithi155.stdout: osd.0 (root=default,host=smithi155) is down 2023-12-16T06:00:16.176 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:16.174+0000 7f229afb3700 1 -- 172.21.15.155:0/2802922431 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f228406cf80 msgr2=0x7f228406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:16.176 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:16.174+0000 7f229afb3700 1 --2- 172.21.15.155:0/2802922431 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f228406cf80 0x7f228406f430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2288009b80 tx=0x7f228800b040 comp rx=0 tx=0).stop 2023-12-16T06:00:16.176 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:16.174+0000 7f229afb3700 1 -- 172.21.15.155:0/2802922431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2294102c20 msgr2=0x7f2294113b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:16.176 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:16.174+0000 7f229afb3700 1 --2- 172.21.15.155:0/2802922431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2294102c20 0x7f2294113b20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2280000c00 tx=0x7f2280009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:16.176 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:16.174+0000 7f229afb3700 1 -- 172.21.15.155:0/2802922431 shutdown_connections 2023-12-16T06:00:16.176 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:16.174+0000 7f229afb3700 1 --2- 172.21.15.155:0/2802922431 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f228406cf80 0x7f228406f430 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:16.177 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:16.174+0000 7f229afb3700 1 --2- 172.21.15.155:0/2802922431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2294065390 0x7f22941135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:16.177 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:16.174+0000 7f229afb3700 1 --2- 172.21.15.155:0/2802922431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2294102c20 0x7f2294113b20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:16.177 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:16.174+0000 7f229afb3700 1 -- 172.21.15.155:0/2802922431 >> 172.21.15.155:0/2802922431 conn(0x7f22940719b0 msgr2=0x7f22940fab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:16.177 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:16.174+0000 7f229afb3700 1 -- 172.21.15.155:0/2802922431 shutdown_connections 2023-12-16T06:00:16.177 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:16.174+0000 7f229afb3700 1 -- 172.21.15.155:0/2802922431 wait complete. 2023-12-16T06:00:16.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:15 smithi156 ceph-mon[182000]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:00:16.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:15 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/1956224710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:16.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:15 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:16.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:15 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:16.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:15 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:00:16.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:15 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/4080994869' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T06:00:16.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:15 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:16.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:15 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:16.978 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:16 smithi155 ceph-mon[217407]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:00:16.979 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:16 smithi155 ceph-mon[217407]: pgmap v33: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 66/342 objects degraded (19.298%) 2023-12-16T06:00:16.979 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:16 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/2802922431' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T06:00:17.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:16 smithi156 ceph-mon[182000]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:00:17.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:16 smithi156 ceph-mon[182000]: pgmap v33: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 66/342 objects degraded (19.298%) 2023-12-16T06:00:17.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:16 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/2802922431' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T06:00:18.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:17 smithi155 ceph-mon[217407]: Health check failed: Degraded data redundancy: 66/342 objects degraded (19.298%), 19 pgs degraded (PG_DEGRADED) 2023-12-16T06:00:18.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:17 smithi156 ceph-mon[182000]: Health check failed: Degraded data redundancy: 66/342 objects degraded (19.298%), 19 pgs degraded (PG_DEGRADED) 2023-12-16T06:00:19.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:18 smithi155 ceph-mon[217407]: pgmap v34: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 66/342 objects degraded (19.298%) 2023-12-16T06:00:19.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:18 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:19.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:18 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:19.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:18 smithi156 ceph-mon[182000]: pgmap v34: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 66/342 objects degraded (19.298%) 2023-12-16T06:00:19.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:18 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:19.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:18 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:20.499 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:20 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-0[231777]: 2023-12-16T06:00:20.178+0000 7f1f2328d640 -1 osd.0 0 read_superblock omap replica is missing. 2023-12-16T06:00:20.499 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:20.499 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:20.499 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:20.499 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:00:20.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:20 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:20.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:20 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:20.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:20 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:20.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:20 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:00:20.826 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:20 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-0[231777]: 2023-12-16T06:00:20.670+0000 7f1f2328d640 -1 osd.0 47 log_to_monitors true 2023-12-16T06:00:21.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:21 smithi155 ceph-mon[217407]: pgmap v35: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 66/342 objects degraded (19.298%) 2023-12-16T06:00:21.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:21 smithi155 ceph-mon[217407]: from='osd.0 [v2:172.21.15.155:6802/3240639912,v1:172.21.15.155:6803/3240639912]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-16T06:00:21.577 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:00:21 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-0[231777]: 2023-12-16T06:00:21.330+0000 7f1f11ef9700 -1 osd.0 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T06:00:21.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:21 smithi156 ceph-mon[182000]: pgmap v35: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 66/342 objects degraded (19.298%) 2023-12-16T06:00:21.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:21 smithi156 ceph-mon[182000]: from='osd.0 [v2:172.21.15.155:6802/3240639912,v1:172.21.15.155:6803/3240639912]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-16T06:00:22.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:22 smithi156 ceph-mon[182000]: from='osd.0 [v2:172.21.15.155:6802/3240639912,v1:172.21.15.155:6803/3240639912]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-16T06:00:22.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:22 smithi156 ceph-mon[182000]: failed to encode map e50 with expected crc 2023-12-16T06:00:22.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:22 smithi156 ceph-mon[182000]: osdmap e50: 6 total, 5 up, 6 in 2023-12-16T06:00:22.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:22 smithi156 ceph-mon[182000]: from='osd.0 [v2:172.21.15.155:6802/3240639912,v1:172.21.15.155:6803/3240639912]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-12-16T06:00:22.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:22 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:22.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:22 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:22.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:22 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:00:22.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:22 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T06:00:22.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:22 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:22.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:22 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:00:22.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:22 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:22.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:22 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:22.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:22 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:22.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:22 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T06:00:22.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:22 smithi155 ceph-mon[217407]: from='osd.0 [v2:172.21.15.155:6802/3240639912,v1:172.21.15.155:6803/3240639912]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-16T06:00:22.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:22 smithi155 ceph-mon[217407]: failed to encode map e50 with expected crc 2023-12-16T06:00:22.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:22 smithi155 ceph-mon[217407]: osdmap e50: 6 total, 5 up, 6 in 2023-12-16T06:00:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:22 smithi155 ceph-mon[217407]: from='osd.0 [v2:172.21.15.155:6802/3240639912,v1:172.21.15.155:6803/3240639912]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-12-16T06:00:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:22 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:22 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:22 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:00:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:22 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T06:00:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:22 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:22 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:00:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:22 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:22 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:22 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:22.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:22 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T06:00:23.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:23 smithi156 ceph-mon[182000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T06:00:23.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:23 smithi156 ceph-mon[182000]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-16T06:00:23.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:23 smithi156 ceph-mon[182000]: pgmap v37: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 66/342 objects degraded (19.298%) 2023-12-16T06:00:23.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:23 smithi156 ceph-mon[182000]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T06:00:23.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:23 smithi156 ceph-mon[182000]: failed to encode map e51 with expected crc 2023-12-16T06:00:23.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:23 smithi156 ceph-mon[182000]: osd.0 [v2:172.21.15.155:6802/3240639912,v1:172.21.15.155:6803/3240639912] boot 2023-12-16T06:00:23.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:23 smithi156 ceph-mon[182000]: osdmap e51: 6 total, 6 up, 6 in 2023-12-16T06:00:23.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:23 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T06:00:23.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:23 smithi155 ceph-mon[217407]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T06:00:23.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:23 smithi155 ceph-mon[217407]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-16T06:00:23.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:23 smithi155 ceph-mon[217407]: pgmap v37: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 66/342 objects degraded (19.298%) 2023-12-16T06:00:23.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:23 smithi155 ceph-mon[217407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T06:00:23.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:23 smithi155 ceph-mon[217407]: failed to encode map e51 with expected crc 2023-12-16T06:00:23.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:23 smithi155 ceph-mon[217407]: osd.0 [v2:172.21.15.155:6802/3240639912,v1:172.21.15.155:6803/3240639912] boot 2023-12-16T06:00:23.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:23 smithi155 ceph-mon[217407]: osdmap e51: 6 total, 6 up, 6 in 2023-12-16T06:00:23.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:23 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T06:00:24.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:24 smithi156 ceph-mon[182000]: failed to encode map e52 with expected crc 2023-12-16T06:00:24.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:24 smithi156 ceph-mon[182000]: osdmap e52: 6 total, 6 up, 6 in 2023-12-16T06:00:24.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:24 smithi156 ceph-mon[182000]: failed to encode map e52 with expected crc 2023-12-16T06:00:24.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:24 smithi156 ceph-mon[182000]: failed to encode map e52 with expected crc 2023-12-16T06:00:24.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:24 smithi156 ceph-mon[182000]: failed to encode map e52 with expected crc 2023-12-16T06:00:24.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:24 smithi156 ceph-mon[182000]: failed to encode map e52 with expected crc 2023-12-16T06:00:24.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:24 smithi156 ceph-mon[182000]: failed to encode map e52 with expected crc 2023-12-16T06:00:24.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:24 smithi155 ceph-mon[217407]: failed to encode map e52 with expected crc 2023-12-16T06:00:24.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:24 smithi155 ceph-mon[217407]: osdmap e52: 6 total, 6 up, 6 in 2023-12-16T06:00:24.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:24 smithi155 ceph-mon[217407]: failed to encode map e52 with expected crc 2023-12-16T06:00:24.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:24 smithi155 ceph-mon[217407]: failed to encode map e52 with expected crc 2023-12-16T06:00:24.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:24 smithi155 ceph-mon[217407]: failed to encode map e52 with expected crc 2023-12-16T06:00:24.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:24 smithi155 ceph-mon[217407]: failed to encode map e52 with expected crc 2023-12-16T06:00:24.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:24 smithi155 ceph-mon[217407]: failed to encode map e52 with expected crc 2023-12-16T06:00:25.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:25 smithi156 ceph-mon[182000]: pgmap v40: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 66/342 objects degraded (19.298%) 2023-12-16T06:00:25.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:25 smithi155 ceph-mon[217407]: pgmap v40: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 66/342 objects degraded (19.298%) 2023-12-16T06:00:26.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:26 smithi156 ceph-mon[182000]: pgmap v41: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.0 KiB/s rd, 5 op/s; 13/342 objects degraded (3.801%) 2023-12-16T06:00:26.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:26 smithi156 ceph-mon[182000]: Health check update: Degraded data redundancy: 13/342 objects degraded (3.801%), 3 pgs degraded (PG_DEGRADED) 2023-12-16T06:00:26.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:26 smithi155 ceph-mon[217407]: pgmap v41: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.0 KiB/s rd, 5 op/s; 13/342 objects degraded (3.801%) 2023-12-16T06:00:26.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:26 smithi155 ceph-mon[217407]: Health check update: Degraded data redundancy: 13/342 objects degraded (3.801%), 3 pgs degraded (PG_DEGRADED) 2023-12-16T06:00:28.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:28 smithi155 ceph-mon[217407]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/342 objects degraded (3.801%), 3 pgs degraded) 2023-12-16T06:00:28.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:28 smithi155 ceph-mon[217407]: Cluster is now healthy 2023-12-16T06:00:28.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:28 smithi156 ceph-mon[182000]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/342 objects degraded (3.801%), 3 pgs degraded) 2023-12-16T06:00:28.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:28 smithi156 ceph-mon[182000]: Cluster is now healthy 2023-12-16T06:00:29.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:29 smithi155 ceph-mon[217407]: pgmap v42: 65 pgs: 65 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-12-16T06:00:29.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:29 smithi156 ceph-mon[182000]: pgmap v42: 65 pgs: 65 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-12-16T06:00:31.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:31 smithi155 ceph-mon[217407]: pgmap v43: 65 pgs: 65 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2023-12-16T06:00:31.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:31 smithi156 ceph-mon[182000]: pgmap v43: 65 pgs: 65 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2023-12-16T06:00:33.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:32 smithi156 ceph-mon[182000]: pgmap v44: 65 pgs: 65 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2023-12-16T06:00:33.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:32 smithi155 ceph-mon[217407]: pgmap v44: 65 pgs: 65 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2023-12-16T06:00:35.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:35 smithi155 ceph-mon[217407]: pgmap v45: 65 pgs: 65 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:00:35.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:35 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:35.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:35 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:00:35.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:35 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:35.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:35 smithi156 ceph-mon[182000]: pgmap v45: 65 pgs: 65 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:00:35.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:35 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:35.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:35 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:00:35.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:35 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:37.473 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:37 smithi155 ceph-mon[217407]: pgmap v46: 65 pgs: 65 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2023-12-16T06:00:37.473 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:37 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T06:00:37.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:37 smithi156 ceph-mon[182000]: pgmap v46: 65 pgs: 65 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2023-12-16T06:00:37.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:37 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T06:00:38.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:38 smithi155 ceph-mon[217407]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T06:00:38.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:38 smithi155 ceph-mon[217407]: Upgrade: osd.1 is safe to restart 2023-12-16T06:00:38.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:38 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:38.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:38 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T06:00:38.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:38 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:00:38.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:38 smithi156 ceph-mon[182000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T06:00:38.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:38 smithi156 ceph-mon[182000]: Upgrade: osd.1 is safe to restart 2023-12-16T06:00:38.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:38 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:38.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:38 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T06:00:38.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:38 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:00:39.554 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:39 smithi155 ceph-mon[217407]: Upgrade: Updating osd.1 2023-12-16T06:00:39.554 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:39 smithi155 ceph-mon[217407]: Deploying daemon osd.1 on smithi155 2023-12-16T06:00:39.554 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:39 smithi155 ceph-mon[217407]: pgmap v47: 65 pgs: 65 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:00:39.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:39 smithi156 ceph-mon[182000]: Upgrade: Updating osd.1 2023-12-16T06:00:39.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:39 smithi156 ceph-mon[182000]: Deploying daemon osd.1 on smithi155 2023-12-16T06:00:39.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:39 smithi156 ceph-mon[182000]: pgmap v47: 65 pgs: 65 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:00:40.327 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:40 smithi155 systemd[1]: Stopping Ceph osd.1 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T06:00:40.826 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:40 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-1[146098]: 2023-12-16T06:00:40.380+0000 7f0eb4f1e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T06:00:40.827 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:40 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-1[146098]: 2023-12-16T06:00:40.380+0000 7f0eb4f1e700 -1 osd.1 52 *** Got signal Terminated *** 2023-12-16T06:00:40.827 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:40 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-1[146098]: 2023-12-16T06:00:40.380+0000 7f0eb4f1e700 -1 osd.1 52 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T06:00:41.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:41 smithi155 ceph-mon[217407]: pgmap v48: 65 pgs: 65 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:00:41.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:41 smithi155 ceph-mon[217407]: osd.1 marked itself down and dead 2023-12-16T06:00:41.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:41 smithi156 ceph-mon[182000]: pgmap v48: 65 pgs: 65 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:00:41.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:41 smithi156 ceph-mon[182000]: osd.1 marked itself down and dead 2023-12-16T06:00:42.076 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:41 smithi155 bash[238019]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-1 2023-12-16T06:00:42.506 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:42 smithi155 ceph-mon[217407]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T06:00:42.506 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:42 smithi155 ceph-mon[217407]: osdmap e53: 6 total, 5 up, 6 in 2023-12-16T06:00:42.506 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:42 smithi155 ceph-mon[217407]: failed to encode map e53 with expected crc 2023-12-16T06:00:42.506 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:42 smithi155 ceph-mon[217407]: failed to encode map e53 with expected crc 2023-12-16T06:00:42.506 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:42 smithi155 ceph-mon[217407]: failed to encode map e53 with expected crc 2023-12-16T06:00:42.506 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:42 smithi155 ceph-mon[217407]: failed to encode map e53 with expected crc 2023-12-16T06:00:42.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:42 smithi156 ceph-mon[182000]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T06:00:42.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:42 smithi156 ceph-mon[182000]: osdmap e53: 6 total, 5 up, 6 in 2023-12-16T06:00:42.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:42 smithi156 ceph-mon[182000]: failed to encode map e53 with expected crc 2023-12-16T06:00:42.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:42 smithi156 ceph-mon[182000]: failed to encode map e53 with expected crc 2023-12-16T06:00:42.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:42 smithi156 ceph-mon[182000]: failed to encode map e53 with expected crc 2023-12-16T06:00:42.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:42 smithi156 ceph-mon[182000]: failed to encode map e53 with expected crc 2023-12-16T06:00:43.182 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:42 smithi155 systemd[1]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.1.service: Succeeded. 2023-12-16T06:00:43.182 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:42 smithi155 systemd[1]: Stopped Ceph osd.1 for d344784e-9bd6-11ee-95a5-87774f69a715. 2023-12-16T06:00:43.182 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:42 smithi155 systemd[1]: Starting Ceph osd.1 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T06:00:43.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:43 smithi155 ceph-mon[217407]: pgmap v50: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2023-12-16T06:00:43.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:43 smithi155 ceph-mon[217407]: failed to encode map e54 with expected crc 2023-12-16T06:00:43.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:43 smithi155 ceph-mon[217407]: osdmap e54: 6 total, 5 up, 6 in 2023-12-16T06:00:43.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:43 smithi155 ceph-mon[217407]: failed to encode map e54 with expected crc 2023-12-16T06:00:43.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:43 smithi155 ceph-mon[217407]: failed to encode map e54 with expected crc 2023-12-16T06:00:43.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:43 smithi155 ceph-mon[217407]: failed to encode map e54 with expected crc 2023-12-16T06:00:43.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:43 smithi155 ceph-mon[217407]: failed to encode map e54 with expected crc 2023-12-16T06:00:43.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:43 smithi155 ceph-mon[217407]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2023-12-16T06:00:43.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:43 smithi156 ceph-mon[182000]: pgmap v50: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2023-12-16T06:00:43.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:43 smithi156 ceph-mon[182000]: failed to encode map e54 with expected crc 2023-12-16T06:00:43.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:43 smithi156 ceph-mon[182000]: osdmap e54: 6 total, 5 up, 6 in 2023-12-16T06:00:43.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:43 smithi156 ceph-mon[182000]: failed to encode map e54 with expected crc 2023-12-16T06:00:43.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:43 smithi156 ceph-mon[182000]: failed to encode map e54 with expected crc 2023-12-16T06:00:43.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:43 smithi156 ceph-mon[182000]: failed to encode map e54 with expected crc 2023-12-16T06:00:43.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:43 smithi156 ceph-mon[182000]: failed to encode map e54 with expected crc 2023-12-16T06:00:43.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:43 smithi156 ceph-mon[182000]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2023-12-16T06:00:44.076 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:43 smithi155 bash[238288]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-16T06:00:44.076 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:43 smithi155 bash[238288]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-16T06:00:44.076 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:43 smithi155 bash[238288]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-16T06:00:44.076 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:43 smithi155 bash[238288]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-16T06:00:44.076 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:43 smithi155 bash[238288]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2023-12-16T06:00:44.076 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:43 smithi155 bash[238288]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-16T06:00:44.076 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:43 smithi155 bash[238288]: --> ceph-volume raw activate successful for osd ID: 1 2023-12-16T06:00:44.826 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:44 smithi155 ceph-osd[238584]: -- 172.21.15.155:0/7399922 <== mon.0 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56124a3596c0 con 0x56124a328c00 2023-12-16T06:00:44.826 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:44 smithi155 bash[238544]: badaf737af870e0005663652ee628ce571b483f7f48ef3490cac64121ec54842 2023-12-16T06:00:44.826 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:44 smithi155 systemd[1]: Started Ceph osd.1 for d344784e-9bd6-11ee-95a5-87774f69a715. 2023-12-16T06:00:45.326 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:44 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-1[238558]: 2023-12-16T06:00:44.849+0000 7f01ed4b8640 -1 Falling back to public interface 2023-12-16T06:00:45.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:45 smithi156 ceph-mon[182000]: pgmap v52: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T06:00:45.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:45 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:45.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:45 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:45.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:45 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:00:45.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:45 smithi155 ceph-mon[217407]: pgmap v52: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T06:00:45.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:45 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:45.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:45 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:45.827 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:45 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:00:46.288 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.285+0000 7faa8c003700 1 -- 172.21.15.155:0/4029070430 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa84101b00 msgr2=0x7faa84101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:46.288 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.285+0000 7faa8c003700 1 --2- 172.21.15.155:0/4029070430 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa84101b00 0x7faa84101ed0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faa7c004940 tx=0x7faa7c009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:46.288 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.285+0000 7faa8c003700 1 -- 172.21.15.155:0/4029070430 shutdown_connections 2023-12-16T06:00:46.288 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.285+0000 7faa8c003700 1 --2- 172.21.15.155:0/4029070430 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa840fbb40 0x7faa840fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:46.289 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.285+0000 7faa8c003700 1 --2- 172.21.15.155:0/4029070430 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa84101b00 0x7faa84101ed0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:46.289 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.285+0000 7faa8c003700 1 -- 172.21.15.155:0/4029070430 >> 172.21.15.155:0/4029070430 conn(0x7faa840f76c0 msgr2=0x7faa840f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:46.289 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.285+0000 7faa8c003700 1 -- 172.21.15.155:0/4029070430 shutdown_connections 2023-12-16T06:00:46.289 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.285+0000 7faa8c003700 1 -- 172.21.15.155:0/4029070430 wait complete. 2023-12-16T06:00:46.289 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.286+0000 7faa8c003700 1 Processor -- start 2023-12-16T06:00:46.289 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.286+0000 7faa8c003700 1 -- start start 2023-12-16T06:00:46.291 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.286+0000 7faa8c003700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa840fbb40 0x7faa8410e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:46.291 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.286+0000 7faa8c003700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa84101b00 0x7faa8410ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:46.291 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.286+0000 7faa8c003700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8410f1e0 con 0x7faa840fbb40 2023-12-16T06:00:46.291 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.286+0000 7faa8c003700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8410f320 con 0x7faa84101b00 2023-12-16T06:00:46.291 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.286+0000 7faa89d9f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa840fbb40 0x7faa8410e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:46.291 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.286+0000 7faa89d9f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa840fbb40 0x7faa8410e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:51934/0 (socket says 172.21.15.155:51934) 2023-12-16T06:00:46.291 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.286+0000 7faa89d9f700 1 -- 172.21.15.155:0/1871358924 learned_addr learned my addr 172.21.15.155:0/1871358924 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:00:46.291 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.286+0000 7faa8959e700 1 --2- 172.21.15.155:0/1871358924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa84101b00 0x7faa8410ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:46.291 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.286+0000 7faa89d9f700 1 -- 172.21.15.155:0/1871358924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa84101b00 msgr2=0x7faa8410ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:46.291 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.286+0000 7faa89d9f700 1 --2- 172.21.15.155:0/1871358924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa84101b00 0x7faa8410ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:46.291 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.286+0000 7faa89d9f700 1 -- 172.21.15.155:0/1871358924 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c005040 con 0x7faa840fbb40 2023-12-16T06:00:46.291 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.287+0000 7faa89d9f700 1 --2- 172.21.15.155:0/1871358924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa840fbb40 0x7faa8410e710 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00b3b0 tx=0x7faa7c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:46.291 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.287+0000 7faa827fc700 1 -- 172.21.15.155:0/1871358924 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa7c00e040 con 0x7faa840fbb40 2023-12-16T06:00:46.291 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.287+0000 7faa827fc700 1 -- 172.21.15.155:0/1871358924 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faa7c00bc50 con 0x7faa840fbb40 2023-12-16T06:00:46.291 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.287+0000 7faa8c003700 1 -- 172.21.15.155:0/1871358924 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa84117620 con 0x7faa840fbb40 2023-12-16T06:00:46.292 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.287+0000 7faa827fc700 1 -- 172.21.15.155:0/1871358924 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa7c013420 con 0x7faa840fbb40 2023-12-16T06:00:46.292 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.287+0000 7faa8c003700 1 -- 172.21.15.155:0/1871358924 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa84117b30 con 0x7faa840fbb40 2023-12-16T06:00:46.292 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.288+0000 7faa8c003700 1 -- 172.21.15.155:0/1871358924 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa84103fb0 con 0x7faa840fbb40 2023-12-16T06:00:46.292 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.288+0000 7faa827fc700 1 -- 172.21.15.155:0/1871358924 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7faa7c01c430 con 0x7faa840fbb40 2023-12-16T06:00:46.292 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.289+0000 7faa827fc700 1 --2- 172.21.15.155:0/1871358924 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7faa6c06cf80 0x7faa6c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:46.292 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.289+0000 7faa8959e700 1 --2- 172.21.15.155:0/1871358924 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7faa6c06cf80 0x7faa6c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:46.292 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.289+0000 7faa827fc700 1 -- 172.21.15.155:0/1871358924 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6328+0+0 (secure 0 0 0) 0x7faa7c08d2b0 con 0x7faa840fbb40 2023-12-16T06:00:46.292 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.289+0000 7faa8959e700 1 --2- 172.21.15.155:0/1871358924 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7faa6c06cf80 0x7faa6c06f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faa840666c0 tx=0x7faa78009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:46.296 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.294+0000 7faa827fc700 1 -- 172.21.15.155:0/1871358924 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7faa7c0570f0 con 0x7faa840fbb40 2023-12-16T06:00:46.526 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.524+0000 7faa8c003700 1 -- 172.21.15.155:0/1871358924 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faa84066400 con 0x7faa6c06cf80 2023-12-16T06:00:46.527 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.525+0000 7faa827fc700 1 -- 172.21.15.155:0/1871358924 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7faa84066400 con 0x7faa6c06cf80 2023-12-16T06:00:46.530 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.527+0000 7faa8c003700 1 -- 172.21.15.155:0/1871358924 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7faa6c06cf80 msgr2=0x7faa6c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:46.530 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.527+0000 7faa8c003700 1 --2- 172.21.15.155:0/1871358924 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7faa6c06cf80 0x7faa6c06f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faa840666c0 tx=0x7faa78009040 comp rx=0 tx=0).stop 2023-12-16T06:00:46.530 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.527+0000 7faa8c003700 1 -- 172.21.15.155:0/1871358924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa840fbb40 msgr2=0x7faa8410e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:46.530 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.527+0000 7faa8c003700 1 --2- 172.21.15.155:0/1871358924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa840fbb40 0x7faa8410e710 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00b3b0 tx=0x7faa7c009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:46.530 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.527+0000 7faa8c003700 1 -- 172.21.15.155:0/1871358924 shutdown_connections 2023-12-16T06:00:46.530 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.527+0000 7faa8c003700 1 --2- 172.21.15.155:0/1871358924 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7faa6c06cf80 0x7faa6c06f430 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:46.530 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.527+0000 7faa8c003700 1 --2- 172.21.15.155:0/1871358924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa840fbb40 0x7faa8410e710 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:46.530 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.527+0000 7faa8c003700 1 --2- 172.21.15.155:0/1871358924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa84101b00 0x7faa8410ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:46.531 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.527+0000 7faa8c003700 1 -- 172.21.15.155:0/1871358924 >> 172.21.15.155:0/1871358924 conn(0x7faa840f76c0 msgr2=0x7faa840f9330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:46.531 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.527+0000 7faa8c003700 1 -- 172.21.15.155:0/1871358924 shutdown_connections 2023-12-16T06:00:46.531 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.527+0000 7faa8c003700 1 -- 172.21.15.155:0/1871358924 wait complete. 2023-12-16T06:00:46.541 INFO:teuthology.orchestra.run.smithi155.stdout:true 2023-12-16T06:00:46.636 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.633+0000 7f99f834e700 1 -- 172.21.15.155:0/3057470361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99f0102c20 msgr2=0x7f99f0102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:46.636 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.633+0000 7f99f834e700 1 --2- 172.21.15.155:0/3057470361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99f0102c20 0x7f99f0102ff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f99ec004940 tx=0x7f99ec009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:46.636 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.633+0000 7f99f834e700 1 -- 172.21.15.155:0/3057470361 shutdown_connections 2023-12-16T06:00:46.636 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.633+0000 7f99f834e700 1 --2- 172.21.15.155:0/3057470361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99f0065390 0x7f99f0065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:46.636 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.633+0000 7f99f834e700 1 --2- 172.21.15.155:0/3057470361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99f0102c20 0x7f99f0102ff0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:46.636 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.633+0000 7f99f834e700 1 -- 172.21.15.155:0/3057470361 >> 172.21.15.155:0/3057470361 conn(0x7f99f00719b0 msgr2=0x7f99f0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:46.636 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.633+0000 7f99f834e700 1 -- 172.21.15.155:0/3057470361 shutdown_connections 2023-12-16T06:00:46.636 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.633+0000 7f99f834e700 1 -- 172.21.15.155:0/3057470361 wait complete. 2023-12-16T06:00:46.638 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.634+0000 7f99f834e700 1 Processor -- start 2023-12-16T06:00:46.638 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.634+0000 7f99f834e700 1 -- start start 2023-12-16T06:00:46.638 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.634+0000 7f99f834e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99f0065390 0x7f99f0113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:46.638 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.634+0000 7f99f834e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99f0102c20 0x7f99f0113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:46.638 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.634+0000 7f99f834e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f0114220 con 0x7f99f0102c20 2023-12-16T06:00:46.638 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.634+0000 7f99f834e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f010d570 con 0x7f99f0065390 2023-12-16T06:00:46.638 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.635+0000 7f99f58e9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99f0102c20 0x7f99f0113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:46.638 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.635+0000 7f99f58e9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99f0102c20 0x7f99f0113bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:51940/0 (socket says 172.21.15.155:51940) 2023-12-16T06:00:46.638 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.635+0000 7f99f58e9700 1 -- 172.21.15.155:0/3536250678 learned_addr learned my addr 172.21.15.155:0/3536250678 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:00:46.638 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.635+0000 7f99f60ea700 1 --2- 172.21.15.155:0/3536250678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99f0065390 0x7f99f0113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:46.638 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.635+0000 7f99f58e9700 1 -- 172.21.15.155:0/3536250678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99f0065390 msgr2=0x7f99f0113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:46.638 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.635+0000 7f99f58e9700 1 --2- 172.21.15.155:0/3536250678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99f0065390 0x7f99f0113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:46.639 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.635+0000 7f99f58e9700 1 -- 172.21.15.155:0/3536250678 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec005040 con 0x7f99f0102c20 2023-12-16T06:00:46.639 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.635+0000 7f99f58e9700 1 --2- 172.21.15.155:0/3536250678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99f0102c20 0x7f99f0113bd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f99e0002a50 tx=0x7f99e00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:46.639 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.635+0000 7f99e6ffd700 1 -- 172.21.15.155:0/3536250678 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99e0007cc0 con 0x7f99f0102c20 2023-12-16T06:00:46.639 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.635+0000 7f99e6ffd700 1 -- 172.21.15.155:0/3536250678 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f99e000f040 con 0x7f99f0102c20 2023-12-16T06:00:46.639 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.635+0000 7f99f834e700 1 -- 172.21.15.155:0/3536250678 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f010d850 con 0x7f99f0102c20 2023-12-16T06:00:46.639 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.635+0000 7f99e6ffd700 1 -- 172.21.15.155:0/3536250678 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99e0009540 con 0x7f99f0102c20 2023-12-16T06:00:46.640 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.635+0000 7f99f834e700 1 -- 172.21.15.155:0/3536250678 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f010dd90 con 0x7f99f0102c20 2023-12-16T06:00:46.640 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.637+0000 7f99f834e700 1 -- 172.21.15.155:0/3536250678 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f00fff40 con 0x7f99f0102c20 2023-12-16T06:00:46.640 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.637+0000 7f99e6ffd700 1 -- 172.21.15.155:0/3536250678 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7f99e00096c0 con 0x7f99f0102c20 2023-12-16T06:00:46.640 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.638+0000 7f99e6ffd700 1 --2- 172.21.15.155:0/3536250678 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f99dc06cf80 0x7f99dc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:46.640 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.638+0000 7f99e6ffd700 1 -- 172.21.15.155:0/3536250678 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f99e008c2e0 con 0x7f99f0102c20 2023-12-16T06:00:46.641 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.638+0000 7f99f60ea700 1 --2- 172.21.15.155:0/3536250678 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f99dc06cf80 0x7f99dc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:46.641 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.639+0000 7f99f60ea700 1 --2- 172.21.15.155:0/3536250678 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f99dc06cf80 0x7f99dc06f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f99ec004f90 tx=0x7f99ec009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:46.646 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.643+0000 7f99e6ffd700 1 -- 172.21.15.155:0/3536250678 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f99e0059b30 con 0x7f99f0102c20 2023-12-16T06:00:46.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:46 smithi155 ceph-mon[217407]: pgmap v53: 65 pgs: 14 active+undersized+degraded, 5 peering, 15 active+undersized, 31 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/342 objects degraded (12.573%) 2023-12-16T06:00:46.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:46 smithi155 ceph-mon[217407]: Health check failed: Degraded data redundancy: 43/342 objects degraded (12.573%), 14 pgs degraded (PG_DEGRADED) 2023-12-16T06:00:46.882 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.879+0000 7f99f834e700 1 -- 172.21.15.155:0/3536250678 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f99f004bb80 con 0x7f99dc06cf80 2023-12-16T06:00:46.883 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.881+0000 7f99e6ffd700 1 -- 172.21.15.155:0/3536250678 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f99f004bb80 con 0x7f99dc06cf80 2023-12-16T06:00:46.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.883+0000 7f99f834e700 1 -- 172.21.15.155:0/3536250678 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f99dc06cf80 msgr2=0x7f99dc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:46.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.883+0000 7f99f834e700 1 --2- 172.21.15.155:0/3536250678 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f99dc06cf80 0x7f99dc06f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f99ec004f90 tx=0x7f99ec009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:46.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.883+0000 7f99f834e700 1 -- 172.21.15.155:0/3536250678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99f0102c20 msgr2=0x7f99f0113bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:46.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.883+0000 7f99f834e700 1 --2- 172.21.15.155:0/3536250678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99f0102c20 0x7f99f0113bd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f99e0002a50 tx=0x7f99e00046b0 comp rx=0 tx=0).stop 2023-12-16T06:00:46.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.883+0000 7f99f834e700 1 -- 172.21.15.155:0/3536250678 shutdown_connections 2023-12-16T06:00:46.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.883+0000 7f99f834e700 1 --2- 172.21.15.155:0/3536250678 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f99dc06cf80 0x7f99dc06f430 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:46.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.883+0000 7f99f834e700 1 --2- 172.21.15.155:0/3536250678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99f0065390 0x7f99f0113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:46.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.883+0000 7f99f834e700 1 --2- 172.21.15.155:0/3536250678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99f0102c20 0x7f99f0113bd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:46.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.883+0000 7f99f834e700 1 -- 172.21.15.155:0/3536250678 >> 172.21.15.155:0/3536250678 conn(0x7f99f00719b0 msgr2=0x7f99f00fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:46.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.883+0000 7f99f834e700 1 -- 172.21.15.155:0/3536250678 shutdown_connections 2023-12-16T06:00:46.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.883+0000 7f99f834e700 1 -- 172.21.15.155:0/3536250678 wait complete. 2023-12-16T06:00:46.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:46 smithi156 ceph-mon[182000]: pgmap v53: 65 pgs: 14 active+undersized+degraded, 5 peering, 15 active+undersized, 31 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/342 objects degraded (12.573%) 2023-12-16T06:00:46.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:46 smithi156 ceph-mon[182000]: Health check failed: Degraded data redundancy: 43/342 objects degraded (12.573%), 14 pgs degraded (PG_DEGRADED) 2023-12-16T06:00:46.990 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.987+0000 7fd87b4ce700 1 -- 172.21.15.155:0/3654298293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8740fbb40 msgr2=0x7fd8740fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:46.990 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.987+0000 7fd87b4ce700 1 --2- 172.21.15.155:0/3654298293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8740fbb40 0x7fd8740fbfb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd870004940 tx=0x7fd870009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:46.990 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.987+0000 7fd87b4ce700 1 -- 172.21.15.155:0/3654298293 shutdown_connections 2023-12-16T06:00:46.990 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.987+0000 7fd87b4ce700 1 --2- 172.21.15.155:0/3654298293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8740fbb40 0x7fd8740fbfb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:46.990 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.987+0000 7fd87b4ce700 1 --2- 172.21.15.155:0/3654298293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd874101b00 0x7fd874101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:46.990 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.987+0000 7fd87b4ce700 1 -- 172.21.15.155:0/3654298293 >> 172.21.15.155:0/3654298293 conn(0x7fd8740719b0 msgr2=0x7fd874071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:46.990 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.987+0000 7fd87b4ce700 1 -- 172.21.15.155:0/3654298293 shutdown_connections 2023-12-16T06:00:46.990 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.987+0000 7fd87b4ce700 1 -- 172.21.15.155:0/3654298293 wait complete. 2023-12-16T06:00:46.991 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.988+0000 7fd87b4ce700 1 Processor -- start 2023-12-16T06:00:46.991 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.988+0000 7fd87b4ce700 1 -- start start 2023-12-16T06:00:46.991 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.988+0000 7fd87b4ce700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8740fbb40 0x7fd87410e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:46.991 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.988+0000 7fd87b4ce700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd874101b00 0x7fd87410ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:46.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.988+0000 7fd87b4ce700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87410f290 con 0x7fd8740fbb40 2023-12-16T06:00:46.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.988+0000 7fd87b4ce700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87410f400 con 0x7fd874101b00 2023-12-16T06:00:46.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.988+0000 7fd87926a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8740fbb40 0x7fd87410e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:46.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.988+0000 7fd87926a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8740fbb40 0x7fd87410e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:51962/0 (socket says 172.21.15.155:51962) 2023-12-16T06:00:46.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.988+0000 7fd87926a700 1 -- 172.21.15.155:0/1744205493 learned_addr learned my addr 172.21.15.155:0/1744205493 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:00:46.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.988+0000 7fd878a69700 1 --2- 172.21.15.155:0/1744205493 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd874101b00 0x7fd87410ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:46.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.988+0000 7fd87926a700 1 -- 172.21.15.155:0/1744205493 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd874101b00 msgr2=0x7fd87410ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:46.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.988+0000 7fd87926a700 1 --2- 172.21.15.155:0/1744205493 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd874101b00 0x7fd87410ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:46.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.988+0000 7fd87926a700 1 -- 172.21.15.155:0/1744205493 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd870005040 con 0x7fd8740fbb40 2023-12-16T06:00:46.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.989+0000 7fd87926a700 1 --2- 172.21.15.155:0/1744205493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8740fbb40 0x7fd87410e7a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd864002a50 tx=0x7fd8640046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:46.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.989+0000 7fd869ffb700 1 -- 172.21.15.155:0/1744205493 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd864007cc0 con 0x7fd8740fbb40 2023-12-16T06:00:46.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.989+0000 7fd869ffb700 1 -- 172.21.15.155:0/1744205493 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd86400f040 con 0x7fd8740fbb40 2023-12-16T06:00:46.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.989+0000 7fd87b4ce700 1 -- 172.21.15.155:0/1744205493 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd874117770 con 0x7fd8740fbb40 2023-12-16T06:00:46.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.989+0000 7fd869ffb700 1 -- 172.21.15.155:0/1744205493 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd864009540 con 0x7fd8740fbb40 2023-12-16T06:00:46.993 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.989+0000 7fd87b4ce700 1 -- 172.21.15.155:0/1744205493 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd874117c80 con 0x7fd8740fbb40 2023-12-16T06:00:46.993 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.990+0000 7fd87b4ce700 1 -- 172.21.15.155:0/1744205493 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd874103fb0 con 0x7fd8740fbb40 2023-12-16T06:00:46.993 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.990+0000 7fd869ffb700 1 -- 172.21.15.155:0/1744205493 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7fd8640096a0 con 0x7fd8740fbb40 2023-12-16T06:00:46.993 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.991+0000 7fd869ffb700 1 --2- 172.21.15.155:0/1744205493 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fd86006cf80 0x7fd86006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:46.993 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.991+0000 7fd869ffb700 1 -- 172.21.15.155:0/1744205493 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd86408c330 con 0x7fd8740fbb40 2023-12-16T06:00:46.993 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.991+0000 7fd878a69700 1 --2- 172.21.15.155:0/1744205493 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fd86006cf80 0x7fd86006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:46.994 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.991+0000 7fd878a69700 1 --2- 172.21.15.155:0/1744205493 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fd86006cf80 0x7fd86006f430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd870004f90 tx=0x7fd870009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:46.998 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:46.995+0000 7fd869ffb700 1 -- 172.21.15.155:0/1744205493 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fd864056040 con 0x7fd8740fbb40 2023-12-16T06:00:47.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.240+0000 7fd87b4ce700 1 -- 172.21.15.155:0/1744205493 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd874065b70 con 0x7fd86006cf80 2023-12-16T06:00:47.253 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.251+0000 7fd869ffb700 1 -- 172.21.15.155:0/1744205493 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fd874065b70 con 0x7fd86006cf80 2023-12-16T06:00:47.253 INFO:teuthology.orchestra.run.smithi155.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T06:00:47.254 INFO:teuthology.orchestra.run.smithi155.stdout:alertmanager.smithi155 smithi155 *:9093,9094 running (2m) 28s ago 9m 27.4M - 0.25.0 c8568f914cd2 e1da85d6fc09 2023-12-16T06:00:47.254 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi155 smithi155 running (49s) 28s ago 10m 7470k - 19.0.0-191-g6d933094 a29c258b5d6f 6599d6adc8fa 2023-12-16T06:00:47.254 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi156 smithi156 running (46s) 44s ago 9m 7448k - 19.0.0-191-g6d933094 a29c258b5d6f 8129878ae56e 2023-12-16T06:00:47.254 INFO:teuthology.orchestra.run.smithi155.stdout:grafana.smithi155 smithi155 *:3000 running (2m) 28s ago 9m 82.2M - 9.4.12 a0ea5e3c46d9 a16c84704784 2023-12-16T06:00:47.254 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.bzsxjw smithi155 running (6m) 28s ago 6m 4746M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6bcabf94a5c3 2023-12-16T06:00:47.254 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.vicpis smithi155 running (6m) 28s ago 6m 668M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 afa64e1ef8da 2023-12-16T06:00:47.254 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.fasing smithi156 running (6m) 44s ago 6m 538M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 7d97160bda7c 2023-12-16T06:00:47.254 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.qvgmfj smithi156 running (6m) 44s ago 6m 5969M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4018b2f2e27e 2023-12-16T06:00:47.254 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi155.maowdn smithi155 *:8443,9283,8765 running (3m) 28s ago 11m 509M - 19.0.0-191-g6d933094 a29c258b5d6f ee39089d18d3 2023-12-16T06:00:47.254 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi156.pclong smithi156 *:8443,9283,8765 running (3m) 44s ago 9m 447M - 19.0.0-191-g6d933094 a29c258b5d6f 673376e357e8 2023-12-16T06:00:47.254 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi155 smithi155 running (95s) 28s ago 11m 59.8M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 19eb23d9f064 2023-12-16T06:00:47.254 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi156 smithi156 running (75s) 44s ago 9m 46.4M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 62dacb4d7a17 2023-12-16T06:00:47.254 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi155 smithi155 *:9100 running (2m) 28s ago 10m 16.1M - 1.5.0 0da6a335fe13 6f0f1f68f191 2023-12-16T06:00:47.254 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi156 smithi156 *:9100 running (2m) 44s ago 9m 18.8M - 1.5.0 0da6a335fe13 c4595a7b1707 2023-12-16T06:00:47.254 INFO:teuthology.orchestra.run.smithi155.stdout:osd.0 smithi155 running (32s) 28s ago 8m 13.3M 1568M 19.0.0-191-g6d933094 a29c258b5d6f f5b1d720ac4f 2023-12-16T06:00:47.255 INFO:teuthology.orchestra.run.smithi155.stdout:osd.1 smithi155 starting - - - 1568M 2023-12-16T06:00:47.255 INFO:teuthology.orchestra.run.smithi155.stdout:osd.2 smithi155 running (8m) 28s ago 8m 632M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 957a169c1cac 2023-12-16T06:00:47.255 INFO:teuthology.orchestra.run.smithi155.stdout:osd.3 smithi156 running (7m) 44s ago 7m 960M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c4f6c54afe99 2023-12-16T06:00:47.255 INFO:teuthology.orchestra.run.smithi155.stdout:osd.4 smithi156 running (7m) 44s ago 7m 741M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 6309b12204fd 2023-12-16T06:00:47.255 INFO:teuthology.orchestra.run.smithi155.stdout:osd.5 smithi156 running (7m) 44s ago 7m 854M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 84b2c33eb0e1 2023-12-16T06:00:47.255 INFO:teuthology.orchestra.run.smithi155.stdout:prometheus.smithi155 smithi155 *:9095 running (2m) 28s ago 9m 60.1M - 2.43.0 a07b618ecd1d 26bb7cfc1b8b 2023-12-16T06:00:47.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.253+0000 7fd87b4ce700 1 -- 172.21.15.155:0/1744205493 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fd86006cf80 msgr2=0x7fd86006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:47.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.253+0000 7fd87b4ce700 1 --2- 172.21.15.155:0/1744205493 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fd86006cf80 0x7fd86006f430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd870004f90 tx=0x7fd870009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:47.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.253+0000 7fd87b4ce700 1 -- 172.21.15.155:0/1744205493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8740fbb40 msgr2=0x7fd87410e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:47.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.253+0000 7fd87b4ce700 1 --2- 172.21.15.155:0/1744205493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8740fbb40 0x7fd87410e7a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd864002a50 tx=0x7fd8640046b0 comp rx=0 tx=0).stop 2023-12-16T06:00:47.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.253+0000 7fd87b4ce700 1 -- 172.21.15.155:0/1744205493 shutdown_connections 2023-12-16T06:00:47.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.253+0000 7fd87b4ce700 1 --2- 172.21.15.155:0/1744205493 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fd86006cf80 0x7fd86006f430 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:47.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.253+0000 7fd87b4ce700 1 --2- 172.21.15.155:0/1744205493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8740fbb40 0x7fd87410e7a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:47.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.253+0000 7fd87b4ce700 1 --2- 172.21.15.155:0/1744205493 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd874101b00 0x7fd87410ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:47.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.253+0000 7fd87b4ce700 1 -- 172.21.15.155:0/1744205493 >> 172.21.15.155:0/1744205493 conn(0x7fd8740719b0 msgr2=0x7fd8740fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:47.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.253+0000 7fd87b4ce700 1 -- 172.21.15.155:0/1744205493 shutdown_connections 2023-12-16T06:00:47.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.253+0000 7fd87b4ce700 1 -- 172.21.15.155:0/1744205493 wait complete. 2023-12-16T06:00:47.367 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.365+0000 7f626c99e700 1 -- 172.21.15.155:0/3321707785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62680fb900 msgr2=0x7f62680fbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:47.368 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.365+0000 7f626c99e700 1 --2- 172.21.15.155:0/3321707785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62680fb900 0x7f62680fbd70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f625c004940 tx=0x7f625c009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:47.368 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.365+0000 7f626c99e700 1 -- 172.21.15.155:0/3321707785 shutdown_connections 2023-12-16T06:00:47.368 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.365+0000 7f626c99e700 1 --2- 172.21.15.155:0/3321707785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62680fb900 0x7f62680fbd70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:47.368 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.365+0000 7f626c99e700 1 --2- 172.21.15.155:0/3321707785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6268101940 0x7f6268101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:47.368 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.365+0000 7f626c99e700 1 -- 172.21.15.155:0/3321707785 >> 172.21.15.155:0/3321707785 conn(0x7f62680755d0 msgr2=0x7f62680f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:47.368 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.365+0000 7f626c99e700 1 -- 172.21.15.155:0/3321707785 shutdown_connections 2023-12-16T06:00:47.368 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.365+0000 7f626c99e700 1 -- 172.21.15.155:0/3321707785 wait complete. 2023-12-16T06:00:47.369 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.365+0000 7f626c99e700 1 Processor -- start 2023-12-16T06:00:47.370 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.366+0000 7f626c99e700 1 -- start start 2023-12-16T06:00:47.370 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.366+0000 7f626c99e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62680fb900 0x7f6268115690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:47.370 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.366+0000 7f626c99e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6268101940 0x7f6268115c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:47.370 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.366+0000 7f626c99e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6268116260 con 0x7f62680fb900 2023-12-16T06:00:47.370 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.366+0000 7f626c99e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626810f550 con 0x7f6268101940 2023-12-16T06:00:47.370 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.366+0000 7f62677fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62680fb900 0x7f6268115690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:47.370 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.366+0000 7f62677fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62680fb900 0x7f6268115690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:51972/0 (socket says 172.21.15.155:51972) 2023-12-16T06:00:47.370 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.366+0000 7f62677fe700 1 -- 172.21.15.155:0/3840979217 learned_addr learned my addr 172.21.15.155:0/3840979217 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:00:47.370 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.366+0000 7f6266ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6268101940 0x7f6268115c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:47.370 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.366+0000 7f62677fe700 1 -- 172.21.15.155:0/3840979217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6268101940 msgr2=0x7f6268115c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:47.370 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.366+0000 7f62677fe700 1 --2- 172.21.15.155:0/3840979217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6268101940 0x7f6268115c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:47.370 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.366+0000 7f62677fe700 1 -- 172.21.15.155:0/3840979217 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c005040 con 0x7f62680fb900 2023-12-16T06:00:47.370 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.366+0000 7f62677fe700 1 --2- 172.21.15.155:0/3840979217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62680fb900 0x7f6268115690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6258002a50 tx=0x7f62580046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:47.370 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.367+0000 7f624ffff700 1 -- 172.21.15.155:0/3840979217 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6258007cc0 con 0x7f62680fb900 2023-12-16T06:00:47.371 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.367+0000 7f626c99e700 1 -- 172.21.15.155:0/3840979217 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626810f7e0 con 0x7f62680fb900 2023-12-16T06:00:47.371 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.367+0000 7f624ffff700 1 -- 172.21.15.155:0/3840979217 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f625800f040 con 0x7f62680fb900 2023-12-16T06:00:47.371 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.367+0000 7f624ffff700 1 -- 172.21.15.155:0/3840979217 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f625800d9c0 con 0x7f62680fb900 2023-12-16T06:00:47.371 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.367+0000 7f626c99e700 1 -- 172.21.15.155:0/3840979217 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626810fd20 con 0x7f62680fb900 2023-12-16T06:00:47.371 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.368+0000 7f626c99e700 1 -- 172.21.15.155:0/3840979217 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626805f270 con 0x7f62680fb900 2023-12-16T06:00:47.371 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.369+0000 7f624ffff700 1 -- 172.21.15.155:0/3840979217 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7f625800db20 con 0x7f62680fb900 2023-12-16T06:00:47.372 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.370+0000 7f624ffff700 1 --2- 172.21.15.155:0/3840979217 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f625006cf80 0x7f625006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:47.372 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.370+0000 7f624ffff700 1 -- 172.21.15.155:0/3840979217 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f625808c920 con 0x7f62680fb900 2023-12-16T06:00:47.372 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.370+0000 7f6266ffd700 1 --2- 172.21.15.155:0/3840979217 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f625006cf80 0x7f625006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:47.373 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.370+0000 7f6266ffd700 1 --2- 172.21.15.155:0/3840979217 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f625006cf80 0x7f625006f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f625c004f90 tx=0x7f625c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:47.376 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.374+0000 7f624ffff700 1 -- 172.21.15.155:0/3840979217 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f625805a150 con 0x7f62680fb900 2023-12-16T06:00:47.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.684+0000 7f626c99e700 1 -- 172.21.15.155:0/3840979217 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6268110d10 con 0x7f62680fb900 2023-12-16T06:00:47.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.685+0000 7f624ffff700 1 -- 172.21.15.155:0/3840979217 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7f6258059ce0 con 0x7f62680fb900 2023-12-16T06:00:47.687 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T06:00:47.688 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": { 2023-12-16T06:00:47.688 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T06:00:47.688 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:00:47.688 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": { 2023-12-16T06:00:47.688 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T06:00:47.688 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:00:47.688 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": { 2023-12-16T06:00:47.688 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4, 2023-12-16T06:00:47.688 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 1 2023-12-16T06:00:47.688 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:00:47.688 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2023-12-16T06:00:47.688 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T06:00:47.688 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:00:47.688 INFO:teuthology.orchestra.run.smithi155.stdout: "overall": { 2023-12-16T06:00:47.689 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 8, 2023-12-16T06:00:47.689 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 5 2023-12-16T06:00:47.689 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-12-16T06:00:47.689 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T06:00:47.690 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.687+0000 7f626c99e700 1 -- 172.21.15.155:0/3840979217 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f625006cf80 msgr2=0x7f625006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:47.690 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.687+0000 7f626c99e700 1 --2- 172.21.15.155:0/3840979217 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f625006cf80 0x7f625006f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f625c004f90 tx=0x7f625c009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:47.690 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.687+0000 7f626c99e700 1 -- 172.21.15.155:0/3840979217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62680fb900 msgr2=0x7f6268115690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:47.690 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.687+0000 7f626c99e700 1 --2- 172.21.15.155:0/3840979217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62680fb900 0x7f6268115690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6258002a50 tx=0x7f62580046b0 comp rx=0 tx=0).stop 2023-12-16T06:00:47.690 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.687+0000 7f626c99e700 1 -- 172.21.15.155:0/3840979217 shutdown_connections 2023-12-16T06:00:47.690 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.687+0000 7f626c99e700 1 --2- 172.21.15.155:0/3840979217 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f625006cf80 0x7f625006f430 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:47.690 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.687+0000 7f626c99e700 1 --2- 172.21.15.155:0/3840979217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62680fb900 0x7f6268115690 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:47.690 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.687+0000 7f626c99e700 1 --2- 172.21.15.155:0/3840979217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6268101940 0x7f6268115c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:47.690 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.687+0000 7f626c99e700 1 -- 172.21.15.155:0/3840979217 >> 172.21.15.155:0/3840979217 conn(0x7f62680755d0 msgr2=0x7f6268072990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:47.690 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.687+0000 7f626c99e700 1 -- 172.21.15.155:0/3840979217 shutdown_connections 2023-12-16T06:00:47.691 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.687+0000 7f626c99e700 1 -- 172.21.15.155:0/3840979217 wait complete. 2023-12-16T06:00:47.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.795+0000 7f6d07e66700 1 -- 172.21.15.155:0/2159999951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d00101b00 msgr2=0x7f6d00101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:47.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.795+0000 7f6d07e66700 1 --2- 172.21.15.155:0/2159999951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d00101b00 0x7f6d00101ed0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc004940 tx=0x7f6cfc009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:47.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.795+0000 7f6d07e66700 1 -- 172.21.15.155:0/2159999951 shutdown_connections 2023-12-16T06:00:47.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.795+0000 7f6d07e66700 1 --2- 172.21.15.155:0/2159999951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d000fbb40 0x7f6d000fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:47.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.795+0000 7f6d07e66700 1 --2- 172.21.15.155:0/2159999951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d00101b00 0x7f6d00101ed0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:47.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.795+0000 7f6d07e66700 1 -- 172.21.15.155:0/2159999951 >> 172.21.15.155:0/2159999951 conn(0x7f6d000719b0 msgr2=0x7f6d00071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:47.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.795+0000 7f6d07e66700 1 -- 172.21.15.155:0/2159999951 shutdown_connections 2023-12-16T06:00:47.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.795+0000 7f6d07e66700 1 -- 172.21.15.155:0/2159999951 wait complete. 2023-12-16T06:00:47.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.796+0000 7f6d07e66700 1 Processor -- start 2023-12-16T06:00:47.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.796+0000 7f6d07e66700 1 -- start start 2023-12-16T06:00:47.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.796+0000 7f6d07e66700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d000fbb40 0x7f6d0010e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:47.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.796+0000 7f6d07e66700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d00101b00 0x7f6d0010eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:47.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.796+0000 7f6d07e66700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0010f1b0 con 0x7f6d000fbb40 2023-12-16T06:00:47.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.796+0000 7f6d07e66700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0010f320 con 0x7f6d00101b00 2023-12-16T06:00:47.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.796+0000 7f6d05c02700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d000fbb40 0x7f6d0010e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:47.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.796+0000 7f6d05c02700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d000fbb40 0x7f6d0010e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:51982/0 (socket says 172.21.15.155:51982) 2023-12-16T06:00:47.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.796+0000 7f6d05c02700 1 -- 172.21.15.155:0/2921775549 learned_addr learned my addr 172.21.15.155:0/2921775549 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:00:47.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.796+0000 7f6d05401700 1 --2- 172.21.15.155:0/2921775549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d00101b00 0x7f6d0010eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:47.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.797+0000 7f6d05c02700 1 -- 172.21.15.155:0/2921775549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d00101b00 msgr2=0x7f6d0010eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:47.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.797+0000 7f6d05c02700 1 --2- 172.21.15.155:0/2921775549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d00101b00 0x7f6d0010eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:47.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.797+0000 7f6d05c02700 1 -- 172.21.15.155:0/2921775549 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc005040 con 0x7f6d000fbb40 2023-12-16T06:00:47.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.797+0000 7f6d05c02700 1 --2- 172.21.15.155:0/2921775549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d000fbb40 0x7f6d0010e620 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc009390 tx=0x7f6cfc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:47.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.797+0000 7f6cf67fc700 1 -- 172.21.15.155:0/2921775549 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cfc00e040 con 0x7f6d000fbb40 2023-12-16T06:00:47.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.797+0000 7f6cf67fc700 1 -- 172.21.15.155:0/2921775549 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6cfc00bc50 con 0x7f6d000fbb40 2023-12-16T06:00:47.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.797+0000 7f6d07e66700 1 -- 172.21.15.155:0/2921775549 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d00117590 con 0x7f6d000fbb40 2023-12-16T06:00:47.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.797+0000 7f6cf67fc700 1 -- 172.21.15.155:0/2921775549 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cfc01c630 con 0x7f6d000fbb40 2023-12-16T06:00:47.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.797+0000 7f6d07e66700 1 -- 172.21.15.155:0/2921775549 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d00117ad0 con 0x7f6d000fbb40 2023-12-16T06:00:47.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.798+0000 7f6d07e66700 1 -- 172.21.15.155:0/2921775549 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d00103fb0 con 0x7f6d000fbb40 2023-12-16T06:00:47.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.798+0000 7f6cf67fc700 1 -- 172.21.15.155:0/2921775549 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7f6cfc01c8f0 con 0x7f6d000fbb40 2023-12-16T06:00:47.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.799+0000 7f6cf67fc700 1 --2- 172.21.15.155:0/2921775549 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f6cec06cf80 0x7f6cec06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:47.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.799+0000 7f6cf67fc700 1 -- 172.21.15.155:0/2921775549 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f6cfc08d9b0 con 0x7f6d000fbb40 2023-12-16T06:00:47.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.799+0000 7f6d05401700 1 --2- 172.21.15.155:0/2921775549 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f6cec06cf80 0x7f6cec06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:47.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.799+0000 7f6d05401700 1 --2- 172.21.15.155:0/2921775549 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f6cec06cf80 0x7f6cec06f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d00065e50 tx=0x7f6cf000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:47.806 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:47.803+0000 7f6cf67fc700 1 -- 172.21.15.155:0/2921775549 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f6cfc0577b0 con 0x7f6d000fbb40 2023-12-16T06:00:48.064 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.061+0000 7f6d07e66700 1 -- 172.21.15.155:0/2921775549 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6d00065b90 con 0x7f6d000fbb40 2023-12-16T06:00:48.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.062+0000 7f6cf67fc700 1 -- 172.21.15.155:0/2921775549 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1907 (secure 0 0 0) 0x7f6cfc05add0 con 0x7f6d000fbb40 2023-12-16T06:00:48.065 INFO:teuthology.orchestra.run.smithi155.stdout:e16 2023-12-16T06:00:48.065 INFO:teuthology.orchestra.run.smithi155.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T06:00:48.065 INFO:teuthology.orchestra.run.smithi155.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T06:00:48.065 INFO:teuthology.orchestra.run.smithi155.stdout:legacy client fscid: 1 2023-12-16T06:00:48.065 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T06:00:48.065 INFO:teuthology.orchestra.run.smithi155.stdout:Filesystem 'cephfs' (1) 2023-12-16T06:00:48.065 INFO:teuthology.orchestra.run.smithi155.stdout:fs_name cephfs 2023-12-16T06:00:48.065 INFO:teuthology.orchestra.run.smithi155.stdout:epoch 16 2023-12-16T06:00:48.065 INFO:teuthology.orchestra.run.smithi155.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-16T06:00:48.065 INFO:teuthology.orchestra.run.smithi155.stdout:created 2023-12-16T05:54:25.897091+0000 2023-12-16T06:00:48.065 INFO:teuthology.orchestra.run.smithi155.stdout:modified 2023-12-16T05:56:25.130480+0000 2023-12-16T06:00:48.066 INFO:teuthology.orchestra.run.smithi155.stdout:tableserver 0 2023-12-16T06:00:48.066 INFO:teuthology.orchestra.run.smithi155.stdout:root 0 2023-12-16T06:00:48.066 INFO:teuthology.orchestra.run.smithi155.stdout:session_timeout 60 2023-12-16T06:00:48.066 INFO:teuthology.orchestra.run.smithi155.stdout:session_autoclose 300 2023-12-16T06:00:48.066 INFO:teuthology.orchestra.run.smithi155.stdout:max_file_size 1099511627776 2023-12-16T06:00:48.066 INFO:teuthology.orchestra.run.smithi155.stdout:max_xattr_size 65536 2023-12-16T06:00:48.066 INFO:teuthology.orchestra.run.smithi155.stdout:required_client_features {} 2023-12-16T06:00:48.066 INFO:teuthology.orchestra.run.smithi155.stdout:last_failure 0 2023-12-16T06:00:48.066 INFO:teuthology.orchestra.run.smithi155.stdout:last_failure_osd_epoch 0 2023-12-16T06:00:48.066 INFO:teuthology.orchestra.run.smithi155.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T06:00:48.066 INFO:teuthology.orchestra.run.smithi155.stdout:max_mds 2 2023-12-16T06:00:48.066 INFO:teuthology.orchestra.run.smithi155.stdout:in 0,1 2023-12-16T06:00:48.066 INFO:teuthology.orchestra.run.smithi155.stdout:up {0=14456,1=24281} 2023-12-16T06:00:48.066 INFO:teuthology.orchestra.run.smithi155.stdout:failed 2023-12-16T06:00:48.066 INFO:teuthology.orchestra.run.smithi155.stdout:damaged 2023-12-16T06:00:48.066 INFO:teuthology.orchestra.run.smithi155.stdout:stopped 2023-12-16T06:00:48.067 INFO:teuthology.orchestra.run.smithi155.stdout:data_pools [3] 2023-12-16T06:00:48.067 INFO:teuthology.orchestra.run.smithi155.stdout:metadata_pool 2 2023-12-16T06:00:48.067 INFO:teuthology.orchestra.run.smithi155.stdout:inline_data disabled 2023-12-16T06:00:48.067 INFO:teuthology.orchestra.run.smithi155.stdout:balancer 2023-12-16T06:00:48.067 INFO:teuthology.orchestra.run.smithi155.stdout:bal_rank_mask -1 2023-12-16T06:00:48.067 INFO:teuthology.orchestra.run.smithi155.stdout:standby_count_wanted 1 2023-12-16T06:00:48.067 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi155.bzsxjw{0:14456} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.155:6826/1416140807,v1:172.21.15.155:6827/1416140807] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T06:00:48.067 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi156.fasing{0:24289} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1763385284,v1:172.21.15.156:6827/1763385284] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T06:00:48.067 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi156.qvgmfj{1:24281} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.156:6824/2823725296,v1:172.21.15.156:6825/2823725296] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T06:00:48.067 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi155.vicpis{1:14472} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.155:6828/750006619,v1:172.21.15.155:6829/750006619] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T06:00:48.067 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T06:00:48.067 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T06:00:48.068 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.064+0000 7f6d07e66700 1 -- 172.21.15.155:0/2921775549 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f6cec06cf80 msgr2=0x7f6cec06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:48.068 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.064+0000 7f6d07e66700 1 --2- 172.21.15.155:0/2921775549 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f6cec06cf80 0x7f6cec06f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d00065e50 tx=0x7f6cf000b040 comp rx=0 tx=0).stop 2023-12-16T06:00:48.068 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.064+0000 7f6d07e66700 1 -- 172.21.15.155:0/2921775549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d000fbb40 msgr2=0x7f6d0010e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:48.068 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.064+0000 7f6d07e66700 1 --2- 172.21.15.155:0/2921775549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d000fbb40 0x7f6d0010e620 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc009390 tx=0x7f6cfc009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:48.068 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.064+0000 7f6d07e66700 1 -- 172.21.15.155:0/2921775549 shutdown_connections 2023-12-16T06:00:48.068 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.064+0000 7f6d07e66700 1 --2- 172.21.15.155:0/2921775549 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f6cec06cf80 0x7f6cec06f430 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:48.068 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.064+0000 7f6d07e66700 1 --2- 172.21.15.155:0/2921775549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d000fbb40 0x7f6d0010e620 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:48.068 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.064+0000 7f6d07e66700 1 --2- 172.21.15.155:0/2921775549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d00101b00 0x7f6d0010eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:48.068 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.064+0000 7f6d07e66700 1 -- 172.21.15.155:0/2921775549 >> 172.21.15.155:0/2921775549 conn(0x7f6d000719b0 msgr2=0x7f6d000faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:48.069 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.064+0000 7f6d07e66700 1 -- 172.21.15.155:0/2921775549 shutdown_connections 2023-12-16T06:00:48.069 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.064+0000 7f6d07e66700 1 -- 172.21.15.155:0/2921775549 wait complete. 2023-12-16T06:00:48.069 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 16 2023-12-16T06:00:48.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:47 smithi156 ceph-mon[182000]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:00:48.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:47 smithi156 ceph-mon[182000]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:00:48.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:47 smithi156 ceph-mon[182000]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:00:48.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:47 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:48.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:47 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/3840979217' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:48.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:47 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:48.195 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.192+0000 7f1427fae700 1 -- 172.21.15.155:0/4285655716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f142006a6a0 msgr2=0x7f142006aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:48.195 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.192+0000 7f1427fae700 1 --2- 172.21.15.155:0/4285655716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f142006a6a0 0x7f142006aa70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f141c004940 tx=0x7f141c009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:48.195 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.193+0000 7f1427fae700 1 -- 172.21.15.155:0/4285655716 shutdown_connections 2023-12-16T06:00:48.195 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.193+0000 7f1427fae700 1 --2- 172.21.15.155:0/4285655716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1420104c40 0x7f14201050b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:48.196 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.193+0000 7f1427fae700 1 --2- 172.21.15.155:0/4285655716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f142006a6a0 0x7f142006aa70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:48.196 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.193+0000 7f1427fae700 1 -- 172.21.15.155:0/4285655716 >> 172.21.15.155:0/4285655716 conn(0x7f1420068fd0 msgr2=0x7f142006e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:48.196 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.193+0000 7f1427fae700 1 -- 172.21.15.155:0/4285655716 shutdown_connections 2023-12-16T06:00:48.196 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.193+0000 7f1427fae700 1 -- 172.21.15.155:0/4285655716 wait complete. 2023-12-16T06:00:48.196 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.193+0000 7f1427fae700 1 Processor -- start 2023-12-16T06:00:48.197 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.194+0000 7f1427fae700 1 -- start start 2023-12-16T06:00:48.197 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.194+0000 7f1427fae700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f142006a6a0 0x7f142011bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:48.197 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.194+0000 7f1427fae700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1420104c40 0x7f142011c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:48.197 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.194+0000 7f1427fae700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142011c910 con 0x7f1420104c40 2023-12-16T06:00:48.197 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.194+0000 7f1427fae700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1420115c20 con 0x7f142006a6a0 2023-12-16T06:00:48.197 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.194+0000 7f1425549700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1420104c40 0x7f142011c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:48.197 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.194+0000 7f1425d4a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f142006a6a0 0x7f142011bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:48.197 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.194+0000 7f1425d4a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f142006a6a0 0x7f142011bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.155:42568/0 (socket says 172.21.15.155:42568) 2023-12-16T06:00:48.197 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.194+0000 7f1425d4a700 1 -- 172.21.15.155:0/2180728118 learned_addr learned my addr 172.21.15.155:0/2180728118 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:00:48.198 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.194+0000 7f1425549700 1 -- 172.21.15.155:0/2180728118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f142006a6a0 msgr2=0x7f142011bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:48.198 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.194+0000 7f1425549700 1 --2- 172.21.15.155:0/2180728118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f142006a6a0 0x7f142011bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:48.198 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.194+0000 7f1425549700 1 -- 172.21.15.155:0/2180728118 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c005040 con 0x7f1420104c40 2023-12-16T06:00:48.198 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.194+0000 7f1425d4a700 1 --2- 172.21.15.155:0/2180728118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f142006a6a0 0x7f142011bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T06:00:48.198 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.194+0000 7f1425549700 1 --2- 172.21.15.155:0/2180728118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1420104c40 0x7f142011c2c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1410009fd0 tx=0x7f141000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:48.198 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.195+0000 7f14167fc700 1 -- 172.21.15.155:0/2180728118 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1410004e90 con 0x7f1420104c40 2023-12-16T06:00:48.198 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.195+0000 7f14167fc700 1 -- 172.21.15.155:0/2180728118 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f141000f040 con 0x7f1420104c40 2023-12-16T06:00:48.198 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.195+0000 7f1427fae700 1 -- 172.21.15.155:0/2180728118 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1420115ea0 con 0x7f1420104c40 2023-12-16T06:00:48.199 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.195+0000 7f14167fc700 1 -- 172.21.15.155:0/2180728118 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f141000c9b0 con 0x7f1420104c40 2023-12-16T06:00:48.199 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.195+0000 7f1427fae700 1 -- 172.21.15.155:0/2180728118 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14201163e0 con 0x7f1420104c40 2023-12-16T06:00:48.199 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.196+0000 7f1427fae700 1 -- 172.21.15.155:0/2180728118 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14201099d0 con 0x7f1420104c40 2023-12-16T06:00:48.199 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.196+0000 7f14167fc700 1 -- 172.21.15.155:0/2180728118 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7f141000cb10 con 0x7f1420104c40 2023-12-16T06:00:48.200 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.197+0000 7f14167fc700 1 --2- 172.21.15.155:0/2180728118 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f140c06cf80 0x7f140c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:48.200 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.197+0000 7f14167fc700 1 -- 172.21.15.155:0/2180728118 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f141008bef0 con 0x7f1420104c40 2023-12-16T06:00:48.200 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.197+0000 7f1425d4a700 1 --2- 172.21.15.155:0/2180728118 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f140c06cf80 0x7f140c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:48.200 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.198+0000 7f1425d4a700 1 --2- 172.21.15.155:0/2180728118 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f140c06cf80 0x7f140c06f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f141c004890 tx=0x7f141c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:48.205 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.202+0000 7f14167fc700 1 -- 172.21.15.155:0/2180728118 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f14100597c0 con 0x7f1420104c40 2023-12-16T06:00:48.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:47 smithi155 ceph-mon[217407]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:00:48.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:47 smithi155 ceph-mon[217407]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:00:48.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:47 smithi155 ceph-mon[217407]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:00:48.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:47 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:48.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:47 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/3840979217' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:48.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:47 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:48.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.431+0000 7f1427fae700 1 -- 172.21.15.155:0/2180728118 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f142004bbf0 con 0x7f140c06cf80 2023-12-16T06:00:48.435 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.432+0000 7f14167fc700 1 -- 172.21.15.155:0/2180728118 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f142004bbf0 con 0x7f140c06cf80 2023-12-16T06:00:48.435 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T06:00:48.435 INFO:teuthology.orchestra.run.smithi155.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T06:00:48.435 INFO:teuthology.orchestra.run.smithi155.stdout: "in_progress": true, 2023-12-16T06:00:48.435 INFO:teuthology.orchestra.run.smithi155.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T06:00:48.435 INFO:teuthology.orchestra.run.smithi155.stdout: "services_complete": [ 2023-12-16T06:00:48.435 INFO:teuthology.orchestra.run.smithi155.stdout: "crash", 2023-12-16T06:00:48.435 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr", 2023-12-16T06:00:48.436 INFO:teuthology.orchestra.run.smithi155.stdout: "mon" 2023-12-16T06:00:48.436 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-12-16T06:00:48.436 INFO:teuthology.orchestra.run.smithi155.stdout: "progress": "8/21 daemons upgraded", 2023-12-16T06:00:48.436 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "Currently upgrading osd daemons", 2023-12-16T06:00:48.436 INFO:teuthology.orchestra.run.smithi155.stdout: "is_paused": false 2023-12-16T06:00:48.436 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T06:00:48.437 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.435+0000 7f1427fae700 1 -- 172.21.15.155:0/2180728118 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f140c06cf80 msgr2=0x7f140c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:48.438 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.435+0000 7f1427fae700 1 --2- 172.21.15.155:0/2180728118 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f140c06cf80 0x7f140c06f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f141c004890 tx=0x7f141c009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:48.438 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.435+0000 7f1427fae700 1 -- 172.21.15.155:0/2180728118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1420104c40 msgr2=0x7f142011c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:48.438 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.435+0000 7f1427fae700 1 --2- 172.21.15.155:0/2180728118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1420104c40 0x7f142011c2c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1410009fd0 tx=0x7f141000b040 comp rx=0 tx=0).stop 2023-12-16T06:00:48.438 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.435+0000 7f1427fae700 1 -- 172.21.15.155:0/2180728118 shutdown_connections 2023-12-16T06:00:48.438 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.435+0000 7f1427fae700 1 --2- 172.21.15.155:0/2180728118 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f140c06cf80 0x7f140c06f430 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:48.438 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.435+0000 7f1427fae700 1 --2- 172.21.15.155:0/2180728118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f142006a6a0 0x7f142011bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:48.438 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.435+0000 7f1427fae700 1 --2- 172.21.15.155:0/2180728118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1420104c40 0x7f142011c2c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:48.438 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.435+0000 7f1427fae700 1 -- 172.21.15.155:0/2180728118 >> 172.21.15.155:0/2180728118 conn(0x7f1420068fd0 msgr2=0x7f142010f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:48.438 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.435+0000 7f1427fae700 1 -- 172.21.15.155:0/2180728118 shutdown_connections 2023-12-16T06:00:48.438 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.435+0000 7f1427fae700 1 -- 172.21.15.155:0/2180728118 wait complete. 2023-12-16T06:00:48.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.543+0000 7fe1f6d1e700 1 -- 172.21.15.155:0/1483406315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1f0101b00 msgr2=0x7fe1f0101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:48.547 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.543+0000 7fe1f6d1e700 1 --2- 172.21.15.155:0/1483406315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1f0101b00 0x7fe1f0101ed0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4004940 tx=0x7fe1e4009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:48.547 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.543+0000 7fe1f6d1e700 1 -- 172.21.15.155:0/1483406315 shutdown_connections 2023-12-16T06:00:48.547 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.543+0000 7fe1f6d1e700 1 --2- 172.21.15.155:0/1483406315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1f00fbb40 0x7fe1f00fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:48.547 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.543+0000 7fe1f6d1e700 1 --2- 172.21.15.155:0/1483406315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1f0101b00 0x7fe1f0101ed0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:48.547 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.543+0000 7fe1f6d1e700 1 -- 172.21.15.155:0/1483406315 >> 172.21.15.155:0/1483406315 conn(0x7fe1f00719b0 msgr2=0x7fe1f0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:48.547 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.543+0000 7fe1f6d1e700 1 -- 172.21.15.155:0/1483406315 shutdown_connections 2023-12-16T06:00:48.547 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.543+0000 7fe1f6d1e700 1 -- 172.21.15.155:0/1483406315 wait complete. 2023-12-16T06:00:48.547 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.544+0000 7fe1f6d1e700 1 Processor -- start 2023-12-16T06:00:48.547 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.544+0000 7fe1f6d1e700 1 -- start start 2023-12-16T06:00:48.549 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.544+0000 7fe1f6d1e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1f00fbb40 0x7fe1f010e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:48.549 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.544+0000 7fe1f6d1e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1f0101b00 0x7fe1f010ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:48.549 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.544+0000 7fe1f6d1e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f010f160 con 0x7fe1f00fbb40 2023-12-16T06:00:48.549 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.544+0000 7fe1f6d1e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f010f2d0 con 0x7fe1f0101b00 2023-12-16T06:00:48.549 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.544+0000 7fe1f4aba700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1f00fbb40 0x7fe1f010e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:48.549 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.545+0000 7fe1f4aba700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1f00fbb40 0x7fe1f010e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52020/0 (socket says 172.21.15.155:52020) 2023-12-16T06:00:48.549 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.545+0000 7fe1f4aba700 1 -- 172.21.15.155:0/553282248 learned_addr learned my addr 172.21.15.155:0/553282248 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:00:48.549 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.545+0000 7fe1effff700 1 --2- 172.21.15.155:0/553282248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1f0101b00 0x7fe1f010ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:48.549 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.545+0000 7fe1f4aba700 1 -- 172.21.15.155:0/553282248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1f0101b00 msgr2=0x7fe1f010ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:48.549 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.545+0000 7fe1f4aba700 1 --2- 172.21.15.155:0/553282248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1f0101b00 0x7fe1f010ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:48.549 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.545+0000 7fe1f4aba700 1 -- 172.21.15.155:0/553282248 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e4005040 con 0x7fe1f00fbb40 2023-12-16T06:00:48.549 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.545+0000 7fe1f4aba700 1 --2- 172.21.15.155:0/553282248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1f00fbb40 0x7fe1f010e690 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009180 tx=0x7fe1e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:48.550 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.545+0000 7fe1ed7fa700 1 -- 172.21.15.155:0/553282248 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1e400e040 con 0x7fe1f00fbb40 2023-12-16T06:00:48.550 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.545+0000 7fe1ed7fa700 1 -- 172.21.15.155:0/553282248 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe1e4004290 con 0x7fe1f00fbb40 2023-12-16T06:00:48.550 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.545+0000 7fe1ed7fa700 1 -- 172.21.15.155:0/553282248 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1e401c3f0 con 0x7fe1f00fbb40 2023-12-16T06:00:48.550 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.545+0000 7fe1f6d1e700 1 -- 172.21.15.155:0/553282248 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f0117600 con 0x7fe1f00fbb40 2023-12-16T06:00:48.550 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.545+0000 7fe1f6d1e700 1 -- 172.21.15.155:0/553282248 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f0117ac0 con 0x7fe1f00fbb40 2023-12-16T06:00:48.550 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.546+0000 7fe1f6d1e700 1 -- 172.21.15.155:0/553282248 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f0103fb0 con 0x7fe1f00fbb40 2023-12-16T06:00:48.551 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.547+0000 7fe1ed7fa700 1 -- 172.21.15.155:0/553282248 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 37) v1 ==== 91042+0+0 (secure 0 0 0) 0x7fe1e4013420 con 0x7fe1f00fbb40 2023-12-16T06:00:48.551 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.547+0000 7fe1ed7fa700 1 --2- 172.21.15.155:0/553282248 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fe1e006cf80 0x7fe1e006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:00:48.551 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.547+0000 7fe1ed7fa700 1 -- 172.21.15.155:0/553282248 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fe1e408d7e0 con 0x7fe1f00fbb40 2023-12-16T06:00:48.551 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.547+0000 7fe1effff700 1 --2- 172.21.15.155:0/553282248 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fe1e006cf80 0x7fe1e006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:00:48.551 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.548+0000 7fe1effff700 1 --2- 172.21.15.155:0/553282248 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fe1e006cf80 0x7fe1e006f430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0065e90 tx=0x7fe1dc009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:00:48.559 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.556+0000 7fe1ed7fa700 1 -- 172.21.15.155:0/553282248 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fe1e4057620 con 0x7fe1f00fbb40 2023-12-16T06:00:48.869 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.866+0000 7fe1f6d1e700 1 -- 172.21.15.155:0/553282248 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe1f0065bd0 con 0x7fe1f00fbb40 2023-12-16T06:00:48.869 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.866+0000 7fe1ed7fa700 1 -- 172.21.15.155:0/553282248 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1387 (secure 0 0 0) 0x7fe1e405ac40 con 0x7fe1f00fbb40 2023-12-16T06:00:48.869 INFO:teuthology.orchestra.run.smithi155.stdout:HEALTH_WARN 1 osds down; Reduced data availability: 3 pgs peering; Degraded data redundancy: 43/342 objects degraded (12.573%), 14 pgs degraded 2023-12-16T06:00:48.869 INFO:teuthology.orchestra.run.smithi155.stdout:[WRN] OSD_DOWN: 1 osds down 2023-12-16T06:00:48.869 INFO:teuthology.orchestra.run.smithi155.stdout: osd.1 (root=default,host=smithi155) is down 2023-12-16T06:00:48.869 INFO:teuthology.orchestra.run.smithi155.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 3 pgs peering 2023-12-16T06:00:48.869 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.4 is stuck peering for 2m, current state peering, last acting [0,4] 2023-12-16T06:00:48.869 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.1b is stuck peering for 4m, current state peering, last acting [0,5] 2023-12-16T06:00:48.869 INFO:teuthology.orchestra.run.smithi155.stdout: pg 3.b is stuck peering for 2m, current state peering, last acting [0,4] 2023-12-16T06:00:48.870 INFO:teuthology.orchestra.run.smithi155.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 43/342 objects degraded (12.573%), 14 pgs degraded 2023-12-16T06:00:48.870 INFO:teuthology.orchestra.run.smithi155.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2023-12-16T06:00:48.870 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2023-12-16T06:00:48.870 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2023-12-16T06:00:48.870 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2023-12-16T06:00:48.870 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2023-12-16T06:00:48.870 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2023-12-16T06:00:48.870 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2023-12-16T06:00:48.870 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2023-12-16T06:00:48.870 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2023-12-16T06:00:48.870 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2023-12-16T06:00:48.870 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.11 is active+undersized+degraded, acting [4,3] 2023-12-16T06:00:48.870 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2023-12-16T06:00:48.870 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2023-12-16T06:00:48.870 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2023-12-16T06:00:48.871 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.868+0000 7fe1f6d1e700 1 -- 172.21.15.155:0/553282248 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fe1e006cf80 msgr2=0x7fe1e006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:48.871 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.868+0000 7fe1f6d1e700 1 --2- 172.21.15.155:0/553282248 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fe1e006cf80 0x7fe1e006f430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0065e90 tx=0x7fe1dc009040 comp rx=0 tx=0).stop 2023-12-16T06:00:48.871 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.868+0000 7fe1f6d1e700 1 -- 172.21.15.155:0/553282248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1f00fbb40 msgr2=0x7fe1f010e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:00:48.871 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.868+0000 7fe1f6d1e700 1 --2- 172.21.15.155:0/553282248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1f00fbb40 0x7fe1f010e690 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009180 tx=0x7fe1e4009e30 comp rx=0 tx=0).stop 2023-12-16T06:00:48.871 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.868+0000 7fe1f6d1e700 1 -- 172.21.15.155:0/553282248 shutdown_connections 2023-12-16T06:00:48.871 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.869+0000 7fe1f6d1e700 1 --2- 172.21.15.155:0/553282248 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fe1e006cf80 0x7fe1e006f430 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:48.871 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.869+0000 7fe1f6d1e700 1 --2- 172.21.15.155:0/553282248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1f00fbb40 0x7fe1f010e690 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:48.872 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.869+0000 7fe1f6d1e700 1 --2- 172.21.15.155:0/553282248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1f0101b00 0x7fe1f010ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:00:48.872 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.869+0000 7fe1f6d1e700 1 -- 172.21.15.155:0/553282248 >> 172.21.15.155:0/553282248 conn(0x7fe1f00719b0 msgr2=0x7fe1f00fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:00:48.872 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.869+0000 7fe1f6d1e700 1 -- 172.21.15.155:0/553282248 shutdown_connections 2023-12-16T06:00:48.872 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:00:48.869+0000 7fe1f6d1e700 1 -- 172.21.15.155:0/553282248 wait complete. 2023-12-16T06:00:49.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:48 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/2921775549' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T06:00:49.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:48 smithi156 ceph-mon[182000]: pgmap v54: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 51/342 objects degraded (14.912%) 2023-12-16T06:00:49.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:48 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:49.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:48 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:49.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:48 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/553282248' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T06:00:49.292 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:48 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/2921775549' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T06:00:49.292 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:48 smithi155 ceph-mon[217407]: pgmap v54: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 51/342 objects degraded (14.912%) 2023-12-16T06:00:49.292 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:48 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:49.292 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:48 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:49.292 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:48 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/553282248' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T06:00:49.576 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:49 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-1[238558]: 2023-12-16T06:00:49.398+0000 7f01ed4b8640 -1 osd.1 0 read_superblock omap replica is missing. 2023-12-16T06:00:50.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:49 smithi156 ceph-mon[182000]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:00:50.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:49 smithi156 ceph-mon[182000]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2023-12-16T06:00:50.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:49 smithi156 ceph-mon[182000]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby-replay 2023-12-16T06:00:50.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:49 smithi155 ceph-mon[217407]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:00:50.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:49 smithi155 ceph-mon[217407]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2023-12-16T06:00:50.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:49 smithi155 ceph-mon[217407]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby-replay 2023-12-16T06:00:50.327 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:49 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-1[238558]: 2023-12-16T06:00:49.942+0000 7f01ed4b8640 -1 osd.1 52 log_to_monitors true 2023-12-16T06:00:51.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:50 smithi156 ceph-mon[182000]: from='osd.1 [v2:172.21.15.155:6810/4157136377,v1:172.21.15.155:6811/4157136377]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-16T06:00:51.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:50 smithi156 ceph-mon[182000]: pgmap v55: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 51/342 objects degraded (14.912%) 2023-12-16T06:00:51.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:50 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:51.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:50 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:00:51.326 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:00:50 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-1[238558]: 2023-12-16T06:00:50.938+0000 7f01da921700 -1 osd.1 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T06:00:51.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:50 smithi155 ceph-mon[217407]: from='osd.1 [v2:172.21.15.155:6810/4157136377,v1:172.21.15.155:6811/4157136377]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-16T06:00:51.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:50 smithi155 ceph-mon[217407]: pgmap v55: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 284 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 51/342 objects degraded (14.912%) 2023-12-16T06:00:51.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:50 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:51.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:50 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:00:52.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: from='osd.1 [v2:172.21.15.155:6810/4157136377,v1:172.21.15.155:6811/4157136377]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-16T06:00:52.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: osdmap e55: 6 total, 5 up, 6 in 2023-12-16T06:00:52.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: from='osd.1 [v2:172.21.15.155:6810/4157136377,v1:172.21.15.155:6811/4157136377]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-12-16T06:00:52.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: failed to encode map e55 with expected crc 2023-12-16T06:00:52.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: failed to encode map e55 with expected crc 2023-12-16T06:00:52.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: failed to encode map e55 with expected crc 2023-12-16T06:00:52.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: failed to encode map e55 with expected crc 2023-12-16T06:00:52.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:52.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:52.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:00:52.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T06:00:52.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:52.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:00:52.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:52.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:52.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:52.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T06:00:52.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T06:00:52.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-16T06:00:52.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: mgrmap e38: smithi155.maowdn(active, since 91s), standbys: smithi156.pclong 2023-12-16T06:00:52.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:51 smithi155 ceph-mon[217407]: Health check update: Degraded data redundancy: 51/342 objects degraded (14.912%), 16 pgs degraded (PG_DEGRADED) 2023-12-16T06:00:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: from='osd.1 [v2:172.21.15.155:6810/4157136377,v1:172.21.15.155:6811/4157136377]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-16T06:00:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: osdmap e55: 6 total, 5 up, 6 in 2023-12-16T06:00:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: from='osd.1 [v2:172.21.15.155:6810/4157136377,v1:172.21.15.155:6811/4157136377]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-12-16T06:00:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: failed to encode map e55 with expected crc 2023-12-16T06:00:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: failed to encode map e55 with expected crc 2023-12-16T06:00:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: failed to encode map e55 with expected crc 2023-12-16T06:00:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: failed to encode map e55 with expected crc 2023-12-16T06:00:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:00:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T06:00:52.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:00:52.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:00:52.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:52.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:52.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:00:52.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T06:00:52.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T06:00:52.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-16T06:00:52.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: mgrmap e38: smithi155.maowdn(active, since 91s), standbys: smithi156.pclong 2023-12-16T06:00:52.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:51 smithi156 ceph-mon[182000]: Health check update: Degraded data redundancy: 51/342 objects degraded (14.912%), 16 pgs degraded (PG_DEGRADED) 2023-12-16T06:00:53.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:52 smithi155 ceph-mon[217407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T06:00:53.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:52 smithi155 ceph-mon[217407]: failed to encode map e56 with expected crc 2023-12-16T06:00:53.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:52 smithi155 ceph-mon[217407]: osd.1 [v2:172.21.15.155:6810/4157136377,v1:172.21.15.155:6811/4157136377] boot 2023-12-16T06:00:53.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:52 smithi155 ceph-mon[217407]: osdmap e56: 6 total, 6 up, 6 in 2023-12-16T06:00:53.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:52 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T06:00:53.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:52 smithi155 ceph-mon[217407]: pgmap v58: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 2 op/s; 51/342 objects degraded (14.912%) 2023-12-16T06:00:53.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:52 smithi156 ceph-mon[182000]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T06:00:53.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:52 smithi156 ceph-mon[182000]: failed to encode map e56 with expected crc 2023-12-16T06:00:53.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:52 smithi156 ceph-mon[182000]: osd.1 [v2:172.21.15.155:6810/4157136377,v1:172.21.15.155:6811/4157136377] boot 2023-12-16T06:00:53.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:52 smithi156 ceph-mon[182000]: osdmap e56: 6 total, 6 up, 6 in 2023-12-16T06:00:53.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:52 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T06:00:53.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:52 smithi156 ceph-mon[182000]: pgmap v58: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 2 op/s; 51/342 objects degraded (14.912%) 2023-12-16T06:00:54.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:53 smithi155 ceph-mon[217407]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:53 smithi155 ceph-mon[217407]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:53 smithi155 ceph-mon[217407]: osdmap e57: 6 total, 6 up, 6 in 2023-12-16T06:00:54.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:53 smithi155 ceph-mon[217407]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:53 smithi155 ceph-mon[217407]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:53 smithi155 ceph-mon[217407]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:53 smithi155 ceph-mon[217407]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:53 smithi155 ceph-mon[217407]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:53 smithi155 ceph-mon[217407]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:53 smithi155 ceph-mon[217407]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:53 smithi155 ceph-mon[217407]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:53 smithi155 ceph-mon[217407]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:53 smithi156 ceph-mon[182000]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:53 smithi156 ceph-mon[182000]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:53 smithi156 ceph-mon[182000]: osdmap e57: 6 total, 6 up, 6 in 2023-12-16T06:00:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:53 smithi156 ceph-mon[182000]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:53 smithi156 ceph-mon[182000]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:53 smithi156 ceph-mon[182000]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:53 smithi156 ceph-mon[182000]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:53 smithi156 ceph-mon[182000]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:53 smithi156 ceph-mon[182000]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:53 smithi156 ceph-mon[182000]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:53 smithi156 ceph-mon[182000]: failed to encode map e57 with expected crc 2023-12-16T06:00:54.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:53 smithi156 ceph-mon[182000]: failed to encode map e57 with expected crc 2023-12-16T06:00:55.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:54 smithi155 ceph-mon[217407]: pgmap v60: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 1023 B/s wr, 4 op/s; 51/342 objects degraded (14.912%) 2023-12-16T06:00:55.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:54 smithi156 ceph-mon[182000]: pgmap v60: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 1023 B/s wr, 4 op/s; 51/342 objects degraded (14.912%) 2023-12-16T06:00:56.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:56 smithi155 ceph-mon[217407]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 51/342 objects degraded (14.912%), 16 pgs degraded) 2023-12-16T06:00:56.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:56 smithi155 ceph-mon[217407]: Cluster is now healthy 2023-12-16T06:00:56.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:56 smithi156 ceph-mon[182000]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 51/342 objects degraded (14.912%), 16 pgs degraded) 2023-12-16T06:00:56.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:56 smithi156 ceph-mon[182000]: Cluster is now healthy 2023-12-16T06:00:57.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:57 smithi155 ceph-mon[217407]: pgmap v61: 65 pgs: 2 active+undersized, 63 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.5 KiB/s rd, 1023 B/s wr, 7 op/s; 14 B/s, 0 objects/s recovering 2023-12-16T06:00:57.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:57 smithi156 ceph-mon[182000]: pgmap v61: 65 pgs: 2 active+undersized, 63 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.5 KiB/s rd, 1023 B/s wr, 7 op/s; 14 B/s, 0 objects/s recovering 2023-12-16T06:00:59.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:00:59 smithi155 ceph-mon[217407]: pgmap v62: 65 pgs: 65 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.9 KiB/s rd, 851 B/s wr, 6 op/s; 12 B/s, 0 objects/s recovering 2023-12-16T06:00:59.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:00:59 smithi156 ceph-mon[182000]: pgmap v62: 65 pgs: 65 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.9 KiB/s rd, 851 B/s wr, 6 op/s; 12 B/s, 0 objects/s recovering 2023-12-16T06:01:01.564 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:01 smithi155 ceph-mon[217407]: pgmap v63: 65 pgs: 65 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 10 B/s, 0 objects/s recovering 2023-12-16T06:01:01.565 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:01 smithi155 ceph-mon[217407]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby-replay 2023-12-16T06:01:01.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:01 smithi156 ceph-mon[182000]: pgmap v63: 65 pgs: 65 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 10 B/s, 0 objects/s recovering 2023-12-16T06:01:01.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:01 smithi156 ceph-mon[182000]: fsmap cephfs:2 {0=cephfs.smithi155.bzsxjw=up:active,1=cephfs.smithi156.qvgmfj=up:active} 2 up:standby-replay 2023-12-16T06:01:03.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:02 smithi156 ceph-mon[182000]: pgmap v64: 65 pgs: 65 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 8 B/s, 0 objects/s recovering 2023-12-16T06:01:03.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:02 smithi155 ceph-mon[217407]: pgmap v64: 65 pgs: 65 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 8 B/s, 0 objects/s recovering 2023-12-16T06:01:05.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:05 smithi155 ceph-mon[217407]: pgmap v65: 65 pgs: 65 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 8 B/s, 0 objects/s recovering 2023-12-16T06:01:05.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:05 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:05.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:05 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:01:05.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:05 smithi156 ceph-mon[182000]: pgmap v65: 65 pgs: 65 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 8 B/s, 0 objects/s recovering 2023-12-16T06:01:05.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:05 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:05.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:05 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:01:06.562 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:06 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:06.562 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:06 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T06:01:06.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:06 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:06.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:06 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T06:01:07.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:07 smithi155 ceph-mon[217407]: pgmap v66: 65 pgs: 65 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 7 B/s, 0 objects/s recovering 2023-12-16T06:01:07.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:07 smithi155 ceph-mon[217407]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T06:01:07.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:07 smithi155 ceph-mon[217407]: Upgrade: osd.2 is safe to restart 2023-12-16T06:01:07.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:07 smithi156 ceph-mon[182000]: pgmap v66: 65 pgs: 65 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 7 B/s, 0 objects/s recovering 2023-12-16T06:01:07.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:07 smithi156 ceph-mon[182000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T06:01:07.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:07 smithi156 ceph-mon[182000]: Upgrade: osd.2 is safe to restart 2023-12-16T06:01:08.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:08 smithi155 ceph-mon[217407]: Upgrade: Updating osd.2 2023-12-16T06:01:08.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:08 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:08.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:08 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T06:01:08.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:08 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:01:08.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:08 smithi155 ceph-mon[217407]: Deploying daemon osd.2 on smithi155 2023-12-16T06:01:08.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:08 smithi156 ceph-mon[182000]: Upgrade: Updating osd.2 2023-12-16T06:01:08.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:08 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:08.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:08 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T06:01:08.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:08 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:01:08.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:08 smithi156 ceph-mon[182000]: Deploying daemon osd.2 on smithi155 2023-12-16T06:01:09.379 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:09 smithi155 ceph-mon[217407]: pgmap v67: 65 pgs: 65 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:01:09.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:09 smithi156 ceph-mon[182000]: pgmap v67: 65 pgs: 65 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:01:09.826 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:09 smithi155 systemd[1]: Stopping Ceph osd.2 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T06:01:09.826 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:09 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-2[155134]: 2023-12-16T06:01:09.556+0000 7f7a97580700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T06:01:09.826 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:09 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-2[155134]: 2023-12-16T06:01:09.556+0000 7f7a97580700 -1 osd.2 57 *** Got signal Terminated *** 2023-12-16T06:01:09.826 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:09 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-2[155134]: 2023-12-16T06:01:09.556+0000 7f7a97580700 -1 osd.2 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T06:01:10.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:10 smithi155 ceph-mon[217407]: osd.2 marked itself down and dead 2023-12-16T06:01:10.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:10 smithi156 ceph-mon[182000]: osd.2 marked itself down and dead 2023-12-16T06:01:11.076 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:10 smithi155 bash[244674]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-2 2023-12-16T06:01:11.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:11 smithi155 ceph-mon[217407]: pgmap v68: 65 pgs: 65 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:01:11.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:11 smithi155 ceph-mon[217407]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T06:01:11.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:11 smithi155 ceph-mon[217407]: failed to encode map e58 with expected crc 2023-12-16T06:01:11.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:11 smithi155 ceph-mon[217407]: failed to encode map e58 with expected crc 2023-12-16T06:01:11.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:11 smithi155 ceph-mon[217407]: failed to encode map e58 with expected crc 2023-12-16T06:01:11.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:11 smithi155 ceph-mon[217407]: osdmap e58: 6 total, 5 up, 6 in 2023-12-16T06:01:11.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:11 smithi155 ceph-mon[217407]: failed to encode map e58 with expected crc 2023-12-16T06:01:11.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:11 smithi156 ceph-mon[182000]: pgmap v68: 65 pgs: 65 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:01:11.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:11 smithi156 ceph-mon[182000]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T06:01:11.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:11 smithi156 ceph-mon[182000]: failed to encode map e58 with expected crc 2023-12-16T06:01:11.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:11 smithi156 ceph-mon[182000]: failed to encode map e58 with expected crc 2023-12-16T06:01:11.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:11 smithi156 ceph-mon[182000]: failed to encode map e58 with expected crc 2023-12-16T06:01:11.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:11 smithi156 ceph-mon[182000]: osdmap e58: 6 total, 5 up, 6 in 2023-12-16T06:01:11.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:11 smithi156 ceph-mon[182000]: failed to encode map e58 with expected crc 2023-12-16T06:01:12.261 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:11 smithi155 systemd[1]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.2.service: Succeeded. 2023-12-16T06:01:12.261 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:11 smithi155 systemd[1]: Stopped Ceph osd.2 for d344784e-9bd6-11ee-95a5-87774f69a715. 2023-12-16T06:01:12.261 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:12 smithi155 systemd[1]: Starting Ceph osd.2 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T06:01:12.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:12 smithi155 ceph-mon[217407]: failed to encode map e59 with expected crc 2023-12-16T06:01:12.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:12 smithi155 ceph-mon[217407]: osdmap e59: 6 total, 5 up, 6 in 2023-12-16T06:01:12.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:12 smithi155 ceph-mon[217407]: failed to encode map e59 with expected crc 2023-12-16T06:01:12.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:12 smithi155 ceph-mon[217407]: failed to encode map e59 with expected crc 2023-12-16T06:01:12.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:12 smithi155 ceph-mon[217407]: failed to encode map e59 with expected crc 2023-12-16T06:01:12.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:12 smithi155 ceph-mon[217407]: failed to encode map e59 with expected crc 2023-12-16T06:01:12.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:12 smithi155 ceph-mon[217407]: failed to encode map e59 with expected crc 2023-12-16T06:01:12.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:12 smithi156 ceph-mon[182000]: failed to encode map e59 with expected crc 2023-12-16T06:01:12.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:12 smithi156 ceph-mon[182000]: osdmap e59: 6 total, 5 up, 6 in 2023-12-16T06:01:12.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:12 smithi156 ceph-mon[182000]: failed to encode map e59 with expected crc 2023-12-16T06:01:12.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:12 smithi156 ceph-mon[182000]: failed to encode map e59 with expected crc 2023-12-16T06:01:12.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:12 smithi156 ceph-mon[182000]: failed to encode map e59 with expected crc 2023-12-16T06:01:12.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:12 smithi156 ceph-mon[182000]: failed to encode map e59 with expected crc 2023-12-16T06:01:12.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:12 smithi156 ceph-mon[182000]: failed to encode map e59 with expected crc 2023-12-16T06:01:13.263 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:12 smithi155 bash[244944]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-16T06:01:13.264 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:12 smithi155 bash[244944]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-16T06:01:13.264 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:12 smithi155 bash[244944]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-16T06:01:13.264 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:12 smithi155 bash[244944]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-16T06:01:13.264 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:12 smithi155 bash[244944]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2023-12-16T06:01:13.264 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:12 smithi155 bash[244944]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-16T06:01:13.264 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:12 smithi155 bash[244944]: --> ceph-volume raw activate successful for osd ID: 2 2023-12-16T06:01:13.557 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:13 smithi155 ceph-mon[217407]: pgmap v71: 65 pgs: 4 active+undersized+degraded, 19 peering, 4 active+undersized, 38 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3 op/s; 15/342 objects degraded (4.386%) 2023-12-16T06:01:13.557 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:13 smithi155 ceph-mon[217407]: Health check failed: Reduced data availability: 1 pg inactive, 6 pgs peering (PG_AVAILABILITY) 2023-12-16T06:01:13.557 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:13 smithi155 ceph-mon[217407]: Health check failed: Degraded data redundancy: 15/342 objects degraded (4.386%), 4 pgs degraded (PG_DEGRADED) 2023-12-16T06:01:13.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:13 smithi156 ceph-mon[182000]: pgmap v71: 65 pgs: 4 active+undersized+degraded, 19 peering, 4 active+undersized, 38 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3 op/s; 15/342 objects degraded (4.386%) 2023-12-16T06:01:13.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:13 smithi156 ceph-mon[182000]: Health check failed: Reduced data availability: 1 pg inactive, 6 pgs peering (PG_AVAILABILITY) 2023-12-16T06:01:13.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:13 smithi156 ceph-mon[182000]: Health check failed: Degraded data redundancy: 15/342 objects degraded (4.386%), 4 pgs degraded (PG_DEGRADED) 2023-12-16T06:01:13.826 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:13 smithi155 ceph-osd[245265]: -- 172.21.15.155:0/2900498518 <== mon.0 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d31fb5d6c0 con 0x55d31fb2d000 2023-12-16T06:01:13.826 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:13 smithi155 bash[245227]: 9a08b6ae1253af0a5625a3343a9f4bb663f5a1d17c92956039564dfa3b26f263 2023-12-16T06:01:13.826 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:13 smithi155 systemd[1]: Started Ceph osd.2 for d344784e-9bd6-11ee-95a5-87774f69a715. 2023-12-16T06:01:14.576 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:14 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-2[245242]: 2023-12-16T06:01:14.081+0000 7f72d50cd640 -1 Falling back to public interface 2023-12-16T06:01:14.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:14 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:14.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:14 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:14.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:14 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:01:14.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:14 smithi156 ceph-mon[182000]: pgmap v72: 65 pgs: 4 active+undersized+degraded, 19 peering, 4 active+undersized, 38 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 15/342 objects degraded (4.386%) 2023-12-16T06:01:15.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:14 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:15.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:14 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:15.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:14 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:01:15.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:14 smithi155 ceph-mon[217407]: pgmap v72: 65 pgs: 4 active+undersized+degraded, 19 peering, 4 active+undersized, 38 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 15/342 objects degraded (4.386%) 2023-12-16T06:01:16.510 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:16 smithi155 ceph-mon[217407]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 6 pgs peering) 2023-12-16T06:01:16.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:16 smithi156 ceph-mon[182000]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 6 pgs peering) 2023-12-16T06:01:17.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:17 smithi155 ceph-mon[217407]: pgmap v73: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3 op/s; 41/342 objects degraded (11.988%) 2023-12-16T06:01:17.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:17 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:17.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:17 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:17.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:17 smithi156 ceph-mon[182000]: pgmap v73: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3 op/s; 41/342 objects degraded (11.988%) 2023-12-16T06:01:17.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:17 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:17.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:17 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:18.326 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:18 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-2[245242]: 2023-12-16T06:01:18.016+0000 7f72d50cd640 -1 osd.2 0 read_superblock omap replica is missing. 2023-12-16T06:01:18.661 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:18 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-2[245242]: 2023-12-16T06:01:18.418+0000 7f72d50cd640 -1 osd.2 57 log_to_monitors true 2023-12-16T06:01:18.661 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:01:18 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-2[245242]: 2023-12-16T06:01:18.580+0000 7f72c553c700 -1 osd.2 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T06:01:18.661 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:18 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:18.661 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:18 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:18.661 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:18 smithi155 ceph-mon[217407]: pgmap v74: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3 op/s; 41/342 objects degraded (11.988%) 2023-12-16T06:01:18.662 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:18 smithi155 ceph-mon[217407]: from='osd.2 [v2:172.21.15.155:6818/2046101839,v1:172.21.15.155:6819/2046101839]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-16T06:01:18.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:18 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:18.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:18 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:18.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:18 smithi156 ceph-mon[182000]: pgmap v74: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 284 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3 op/s; 41/342 objects degraded (11.988%) 2023-12-16T06:01:18.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:18 smithi156 ceph-mon[182000]: from='osd.2 [v2:172.21.15.155:6818/2046101839,v1:172.21.15.155:6819/2046101839]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-16T06:01:18.982 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.979+0000 7fa86aa67700 1 -- 172.21.15.155:0/4183539294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8641035a0 msgr2=0x7fa8640fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:18.982 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.979+0000 7fa86aa67700 1 --2- 172.21.15.155:0/4183539294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8641035a0 0x7fa8640fcc10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa850004940 tx=0x7fa850009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:18.983 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.979+0000 7fa86aa67700 1 -- 172.21.15.155:0/4183539294 shutdown_connections 2023-12-16T06:01:18.983 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.979+0000 7fa86aa67700 1 --2- 172.21.15.155:0/4183539294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8641035a0 0x7fa8640fcc10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:18.983 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.979+0000 7fa86aa67700 1 --2- 172.21.15.155:0/4183539294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa864102c00 0x7fa864102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:18.983 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.979+0000 7fa86aa67700 1 -- 172.21.15.155:0/4183539294 >> 172.21.15.155:0/4183539294 conn(0x7fa8640f8790 msgr2=0x7fa8640faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:18.983 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.979+0000 7fa86aa67700 1 -- 172.21.15.155:0/4183539294 shutdown_connections 2023-12-16T06:01:18.983 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.979+0000 7fa86aa67700 1 -- 172.21.15.155:0/4183539294 wait complete. 2023-12-16T06:01:18.983 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.980+0000 7fa86aa67700 1 Processor -- start 2023-12-16T06:01:18.983 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.980+0000 7fa86aa67700 1 -- start start 2023-12-16T06:01:18.984 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.980+0000 7fa86aa67700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa864102c00 0x7fa8641136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:18.984 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.980+0000 7fa86aa67700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8641035a0 0x7fa864113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:18.985 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.980+0000 7fa86aa67700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa864114280 con 0x7fa864102c00 2023-12-16T06:01:18.985 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.980+0000 7fa86aa67700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86410d570 con 0x7fa8641035a0 2023-12-16T06:01:18.985 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.981+0000 7fa868803700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa864102c00 0x7fa8641136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:18.985 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.981+0000 7fa868803700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa864102c00 0x7fa8641136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:60100/0 (socket says 172.21.15.155:60100) 2023-12-16T06:01:18.985 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.981+0000 7fa868803700 1 -- 172.21.15.155:0/2343308327 learned_addr learned my addr 172.21.15.155:0/2343308327 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:01:18.985 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.981+0000 7fa863fff700 1 --2- 172.21.15.155:0/2343308327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8641035a0 0x7fa864113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:18.985 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.981+0000 7fa868803700 1 -- 172.21.15.155:0/2343308327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8641035a0 msgr2=0x7fa864113c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:18.985 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.981+0000 7fa868803700 1 --2- 172.21.15.155:0/2343308327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8641035a0 0x7fa864113c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:18.985 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.981+0000 7fa868803700 1 -- 172.21.15.155:0/2343308327 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa850005040 con 0x7fa864102c00 2023-12-16T06:01:18.985 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.981+0000 7fa863fff700 1 --2- 172.21.15.155:0/2343308327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8641035a0 0x7fa864113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T06:01:18.985 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.981+0000 7fa868803700 1 --2- 172.21.15.155:0/2343308327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa864102c00 0x7fa8641136f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa858011ee0 tx=0x7fa8580046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:18.985 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.981+0000 7fa8617fa700 1 -- 172.21.15.155:0/2343308327 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa858007ea0 con 0x7fa864102c00 2023-12-16T06:01:18.986 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.981+0000 7fa86aa67700 1 -- 172.21.15.155:0/2343308327 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa86410d7f0 con 0x7fa864102c00 2023-12-16T06:01:18.986 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.981+0000 7fa8617fa700 1 -- 172.21.15.155:0/2343308327 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa8580090d0 con 0x7fa864102c00 2023-12-16T06:01:18.986 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.981+0000 7fa8617fa700 1 -- 172.21.15.155:0/2343308327 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8580185d0 con 0x7fa864102c00 2023-12-16T06:01:18.986 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.981+0000 7fa86aa67700 1 -- 172.21.15.155:0/2343308327 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa86410dd30 con 0x7fa864102c00 2023-12-16T06:01:18.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.982+0000 7fa86aa67700 1 -- 172.21.15.155:0/2343308327 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8641133a0 con 0x7fa864102c00 2023-12-16T06:01:18.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.983+0000 7fa8617fa700 1 -- 172.21.15.155:0/2343308327 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7fa858009240 con 0x7fa864102c00 2023-12-16T06:01:18.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.983+0000 7fa8617fa700 1 --2- 172.21.15.155:0/2343308327 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fa85406ce60 0x7fa85406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:18.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.983+0000 7fa8617fa700 1 -- 172.21.15.155:0/2343308327 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa8580903f0 con 0x7fa864102c00 2023-12-16T06:01:18.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.983+0000 7fa863fff700 1 --2- 172.21.15.155:0/2343308327 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fa85406ce60 0x7fa85406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:18.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.984+0000 7fa863fff700 1 --2- 172.21.15.155:0/2343308327 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fa85406ce60 0x7fa85406f310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa850009fd0 tx=0x7fa850009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:18.990 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:18.988+0000 7fa8617fa700 1 -- 172.21.15.155:0/2343308327 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fa85805ddb0 con 0x7fa864102c00 2023-12-16T06:01:19.212 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.209+0000 7fa86aa67700 1 -- 172.21.15.155:0/2343308327 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa86410ec90 con 0x7fa85406ce60 2023-12-16T06:01:19.213 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.211+0000 7fa8617fa700 1 -- 172.21.15.155:0/2343308327 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa86410ec90 con 0x7fa85406ce60 2023-12-16T06:01:19.216 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.213+0000 7fa86aa67700 1 -- 172.21.15.155:0/2343308327 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fa85406ce60 msgr2=0x7fa85406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:19.216 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.213+0000 7fa86aa67700 1 --2- 172.21.15.155:0/2343308327 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fa85406ce60 0x7fa85406f310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa850009fd0 tx=0x7fa850009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:19.216 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.213+0000 7fa86aa67700 1 -- 172.21.15.155:0/2343308327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa864102c00 msgr2=0x7fa8641136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:19.216 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.213+0000 7fa86aa67700 1 --2- 172.21.15.155:0/2343308327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa864102c00 0x7fa8641136f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa858011ee0 tx=0x7fa8580046b0 comp rx=0 tx=0).stop 2023-12-16T06:01:19.216 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.213+0000 7fa86aa67700 1 -- 172.21.15.155:0/2343308327 shutdown_connections 2023-12-16T06:01:19.216 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.213+0000 7fa86aa67700 1 --2- 172.21.15.155:0/2343308327 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fa85406ce60 0x7fa85406f310 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:19.216 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.213+0000 7fa86aa67700 1 --2- 172.21.15.155:0/2343308327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa864102c00 0x7fa8641136f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:19.216 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.213+0000 7fa86aa67700 1 --2- 172.21.15.155:0/2343308327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8641035a0 0x7fa864113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:19.216 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.213+0000 7fa86aa67700 1 -- 172.21.15.155:0/2343308327 >> 172.21.15.155:0/2343308327 conn(0x7fa8640f8790 msgr2=0x7fa8640fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:19.216 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.213+0000 7fa86aa67700 1 -- 172.21.15.155:0/2343308327 shutdown_connections 2023-12-16T06:01:19.216 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.213+0000 7fa86aa67700 1 -- 172.21.15.155:0/2343308327 wait complete. 2023-12-16T06:01:19.227 INFO:teuthology.orchestra.run.smithi155.stdout:true 2023-12-16T06:01:19.326 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.323+0000 7f55781a9700 1 -- 172.21.15.155:0/3110481213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55700fbb40 msgr2=0x7f55700fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:19.326 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.323+0000 7f55781a9700 1 --2- 172.21.15.155:0/3110481213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55700fbb40 0x7f55700fbfb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5564004940 tx=0x7f5564009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:19.326 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.323+0000 7f55781a9700 1 -- 172.21.15.155:0/3110481213 shutdown_connections 2023-12-16T06:01:19.326 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.323+0000 7f55781a9700 1 --2- 172.21.15.155:0/3110481213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55700fbb40 0x7f55700fbfb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:19.326 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.323+0000 7f55781a9700 1 --2- 172.21.15.155:0/3110481213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5570101b00 0x7f5570101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:19.326 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.323+0000 7f55781a9700 1 -- 172.21.15.155:0/3110481213 >> 172.21.15.155:0/3110481213 conn(0x7f55700719b0 msgr2=0x7f5570071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:19.326 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.323+0000 7f55781a9700 1 -- 172.21.15.155:0/3110481213 shutdown_connections 2023-12-16T06:01:19.326 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.323+0000 7f55781a9700 1 -- 172.21.15.155:0/3110481213 wait complete. 2023-12-16T06:01:19.328 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.324+0000 7f55781a9700 1 Processor -- start 2023-12-16T06:01:19.328 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.324+0000 7f55781a9700 1 -- start start 2023-12-16T06:01:19.328 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.324+0000 7f55781a9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55700fbb40 0x7f557010e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:19.328 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.324+0000 7f55781a9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5570101b00 0x7f557010ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:19.328 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.324+0000 7f55781a9700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557010f290 con 0x7f55700fbb40 2023-12-16T06:01:19.328 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.324+0000 7f55781a9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557010f400 con 0x7f5570101b00 2023-12-16T06:01:19.328 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.324+0000 7f5575f45700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55700fbb40 0x7f557010e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:19.328 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.324+0000 7f5575f45700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55700fbb40 0x7f557010e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:60122/0 (socket says 172.21.15.155:60122) 2023-12-16T06:01:19.328 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.324+0000 7f5575f45700 1 -- 172.21.15.155:0/2985997624 learned_addr learned my addr 172.21.15.155:0/2985997624 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:01:19.328 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.324+0000 7f5575744700 1 --2- 172.21.15.155:0/2985997624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5570101b00 0x7f557010ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:19.329 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.324+0000 7f5575f45700 1 -- 172.21.15.155:0/2985997624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5570101b00 msgr2=0x7f557010ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:19.329 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.324+0000 7f5575f45700 1 --2- 172.21.15.155:0/2985997624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5570101b00 0x7f557010ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:19.329 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.324+0000 7f5575f45700 1 -- 172.21.15.155:0/2985997624 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5564005040 con 0x7f55700fbb40 2023-12-16T06:01:19.329 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.324+0000 7f5575f45700 1 --2- 172.21.15.155:0/2985997624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55700fbb40 0x7f557010e7a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f556c002a50 tx=0x7f556c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:19.329 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.324+0000 7f55627fc700 1 -- 172.21.15.155:0/2985997624 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f556c007cc0 con 0x7f55700fbb40 2023-12-16T06:01:19.329 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.325+0000 7f55627fc700 1 -- 172.21.15.155:0/2985997624 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f556c00f040 con 0x7f55700fbb40 2023-12-16T06:01:19.329 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.325+0000 7f55781a9700 1 -- 172.21.15.155:0/2985997624 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5570117770 con 0x7f55700fbb40 2023-12-16T06:01:19.329 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.325+0000 7f55627fc700 1 -- 172.21.15.155:0/2985997624 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f556c00d9c0 con 0x7f55700fbb40 2023-12-16T06:01:19.329 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.325+0000 7f55781a9700 1 -- 172.21.15.155:0/2985997624 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5570117c80 con 0x7f55700fbb40 2023-12-16T06:01:19.329 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.325+0000 7f55781a9700 1 -- 172.21.15.155:0/2985997624 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5570103fb0 con 0x7f55700fbb40 2023-12-16T06:01:19.330 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.326+0000 7f55627fc700 1 -- 172.21.15.155:0/2985997624 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f556c00db20 con 0x7f55700fbb40 2023-12-16T06:01:19.330 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.326+0000 7f55627fc700 1 --2- 172.21.15.155:0/2985997624 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f555c06ce60 0x7f555c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:19.330 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.326+0000 7f55627fc700 1 -- 172.21.15.155:0/2985997624 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f556c08bfb0 con 0x7f55700fbb40 2023-12-16T06:01:19.330 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.326+0000 7f5575744700 1 --2- 172.21.15.155:0/2985997624 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f555c06ce60 0x7f555c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:19.330 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.327+0000 7f5575744700 1 --2- 172.21.15.155:0/2985997624 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f555c06ce60 0x7f555c06f310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5570065e30 tx=0x7f5564009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:19.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.331+0000 7f55627fc700 1 -- 172.21.15.155:0/2985997624 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f556c055ee0 con 0x7f55700fbb40 2023-12-16T06:01:19.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.592+0000 7f55781a9700 1 -- 172.21.15.155:0/2985997624 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f557004bc20 con 0x7f555c06ce60 2023-12-16T06:01:19.596 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.594+0000 7f55627fc700 1 -- 172.21.15.155:0/2985997624 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f55640096f0 con 0x7f555c06ce60 2023-12-16T06:01:19.598 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.596+0000 7f55781a9700 1 -- 172.21.15.155:0/2985997624 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f555c06ce60 msgr2=0x7f555c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:19.598 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.596+0000 7f55781a9700 1 --2- 172.21.15.155:0/2985997624 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f555c06ce60 0x7f555c06f310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5570065e30 tx=0x7f5564009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:19.598 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.596+0000 7f55781a9700 1 -- 172.21.15.155:0/2985997624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55700fbb40 msgr2=0x7f557010e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:19.598 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.596+0000 7f55781a9700 1 --2- 172.21.15.155:0/2985997624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55700fbb40 0x7f557010e7a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f556c002a50 tx=0x7f556c0046b0 comp rx=0 tx=0).stop 2023-12-16T06:01:19.598 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.596+0000 7f55781a9700 1 -- 172.21.15.155:0/2985997624 shutdown_connections 2023-12-16T06:01:19.599 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.596+0000 7f55781a9700 1 --2- 172.21.15.155:0/2985997624 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f555c06ce60 0x7f555c06f310 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:19.599 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.596+0000 7f55781a9700 1 --2- 172.21.15.155:0/2985997624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55700fbb40 0x7f557010e7a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:19.599 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.596+0000 7f55781a9700 1 --2- 172.21.15.155:0/2985997624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5570101b00 0x7f557010ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:19.599 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.596+0000 7f55781a9700 1 -- 172.21.15.155:0/2985997624 >> 172.21.15.155:0/2985997624 conn(0x7f55700719b0 msgr2=0x7f55700fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:19.599 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.596+0000 7f55781a9700 1 -- 172.21.15.155:0/2985997624 shutdown_connections 2023-12-16T06:01:19.599 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.596+0000 7f55781a9700 1 -- 172.21.15.155:0/2985997624 wait complete. 2023-12-16T06:01:19.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.712+0000 7efe5dde7700 1 -- 172.21.15.155:0/972787414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe580fbb40 msgr2=0x7efe580fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:19.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.712+0000 7efe5dde7700 1 --2- 172.21.15.155:0/972787414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe580fbb40 0x7efe580fbfb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efe40004940 tx=0x7efe40009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:19.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.712+0000 7efe5dde7700 1 -- 172.21.15.155:0/972787414 shutdown_connections 2023-12-16T06:01:19.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.712+0000 7efe5dde7700 1 --2- 172.21.15.155:0/972787414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe580fbb40 0x7efe580fbfb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:19.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.712+0000 7efe5dde7700 1 --2- 172.21.15.155:0/972787414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe58101b00 0x7efe58101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:19.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.712+0000 7efe5dde7700 1 -- 172.21.15.155:0/972787414 >> 172.21.15.155:0/972787414 conn(0x7efe580719b0 msgr2=0x7efe58071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:19.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.712+0000 7efe5dde7700 1 -- 172.21.15.155:0/972787414 shutdown_connections 2023-12-16T06:01:19.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.712+0000 7efe5dde7700 1 -- 172.21.15.155:0/972787414 wait complete. 2023-12-16T06:01:19.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.712+0000 7efe5dde7700 1 Processor -- start 2023-12-16T06:01:19.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.712+0000 7efe5dde7700 1 -- start start 2023-12-16T06:01:19.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.713+0000 7efe5dde7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe580fbb40 0x7efe58113620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:19.717 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.713+0000 7efe5dde7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe58101b00 0x7efe58113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:19.717 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.713+0000 7efe5dde7700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe581141f0 con 0x7efe580fbb40 2023-12-16T06:01:19.717 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.713+0000 7efe5dde7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5810d4e0 con 0x7efe58101b00 2023-12-16T06:01:19.717 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.713+0000 7efe577fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe580fbb40 0x7efe58113620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:19.717 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.713+0000 7efe577fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe580fbb40 0x7efe58113620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:60136/0 (socket says 172.21.15.155:60136) 2023-12-16T06:01:19.717 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.713+0000 7efe577fe700 1 -- 172.21.15.155:0/1346768290 learned_addr learned my addr 172.21.15.155:0/1346768290 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:01:19.717 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.713+0000 7efe4effd700 1 --2- 172.21.15.155:0/1346768290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe58101b00 0x7efe58113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:19.717 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.713+0000 7efe577fe700 1 -- 172.21.15.155:0/1346768290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe58101b00 msgr2=0x7efe58113ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:19.717 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.713+0000 7efe577fe700 1 --2- 172.21.15.155:0/1346768290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe58101b00 0x7efe58113ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:19.717 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.713+0000 7efe577fe700 1 -- 172.21.15.155:0/1346768290 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe40005040 con 0x7efe580fbb40 2023-12-16T06:01:19.717 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.713+0000 7efe577fe700 1 --2- 172.21.15.155:0/1346768290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe580fbb40 0x7efe58113620 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efe48002a80 tx=0x7efe480046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:19.717 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.713+0000 7efe54ff9700 1 -- 172.21.15.155:0/1346768290 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe48007cc0 con 0x7efe580fbb40 2023-12-16T06:01:19.717 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.714+0000 7efe54ff9700 1 -- 172.21.15.155:0/1346768290 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efe4800f040 con 0x7efe580fbb40 2023-12-16T06:01:19.717 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.714+0000 7efe54ff9700 1 -- 172.21.15.155:0/1346768290 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe4800da60 con 0x7efe580fbb40 2023-12-16T06:01:19.718 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.714+0000 7efe5dde7700 1 -- 172.21.15.155:0/1346768290 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5810d770 con 0x7efe580fbb40 2023-12-16T06:01:19.718 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.714+0000 7efe5dde7700 1 -- 172.21.15.155:0/1346768290 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5810dcb0 con 0x7efe580fbb40 2023-12-16T06:01:19.718 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.715+0000 7efe5dde7700 1 -- 172.21.15.155:0/1346768290 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe580734d0 con 0x7efe580fbb40 2023-12-16T06:01:19.718 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.715+0000 7efe54ff9700 1 -- 172.21.15.155:0/1346768290 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7efe4800dbc0 con 0x7efe580fbb40 2023-12-16T06:01:19.718 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.715+0000 7efe54ff9700 1 --2- 172.21.15.155:0/1346768290 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7efe4406ce60 0x7efe4406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:19.719 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.716+0000 7efe54ff9700 1 -- 172.21.15.155:0/1346768290 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6328+0+0 (secure 0 0 0) 0x7efe4808be10 con 0x7efe580fbb40 2023-12-16T06:01:19.719 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.716+0000 7efe4effd700 1 --2- 172.21.15.155:0/1346768290 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7efe4406ce60 0x7efe4406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:19.719 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.716+0000 7efe4effd700 1 --2- 172.21.15.155:0/1346768290 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7efe4406ce60 0x7efe4406f310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efe40004f90 tx=0x7efe40009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:19.722 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:19.720+0000 7efe54ff9700 1 -- 172.21.15.155:0/1346768290 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7efe48059850 con 0x7efe580fbb40 2023-12-16T06:01:19.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:19 smithi155 ceph-mon[217407]: from='osd.2 [v2:172.21.15.155:6818/2046101839,v1:172.21.15.155:6819/2046101839]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-16T06:01:19.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:19 smithi155 ceph-mon[217407]: osdmap e60: 6 total, 5 up, 6 in 2023-12-16T06:01:19.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:19 smithi155 ceph-mon[217407]: from='osd.2 [v2:172.21.15.155:6818/2046101839,v1:172.21.15.155:6819/2046101839]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-12-16T06:01:19.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:19 smithi155 ceph-mon[217407]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:01:19.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:19 smithi155 ceph-mon[217407]: failed to encode map e60 with expected crc 2023-12-16T06:01:19.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:19 smithi155 ceph-mon[217407]: failed to encode map e60 with expected crc 2023-12-16T06:01:19.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:19 smithi156 ceph-mon[182000]: from='osd.2 [v2:172.21.15.155:6818/2046101839,v1:172.21.15.155:6819/2046101839]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-16T06:01:19.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:19 smithi156 ceph-mon[182000]: osdmap e60: 6 total, 5 up, 6 in 2023-12-16T06:01:19.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:19 smithi156 ceph-mon[182000]: from='osd.2 [v2:172.21.15.155:6818/2046101839,v1:172.21.15.155:6819/2046101839]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-12-16T06:01:19.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:19 smithi156 ceph-mon[182000]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:01:19.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:19 smithi156 ceph-mon[182000]: failed to encode map e60 with expected crc 2023-12-16T06:01:19.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:19 smithi156 ceph-mon[182000]: failed to encode map e60 with expected crc 2023-12-16T06:01:20.010 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.005+0000 7efe5dde7700 1 -- 172.21.15.155:0/1346768290 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efe5810eca0 con 0x7efe4406ce60 2023-12-16T06:01:20.019 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.016+0000 7efe54ff9700 1 -- 172.21.15.155:0/1346768290 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7efe5810eca0 con 0x7efe4406ce60 2023-12-16T06:01:20.019 INFO:teuthology.orchestra.run.smithi155.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T06:01:20.019 INFO:teuthology.orchestra.run.smithi155.stdout:alertmanager.smithi155 smithi155 *:9093,9094 running (3m) 3s ago 10m 29.5M - 0.25.0 c8568f914cd2 e1da85d6fc09 2023-12-16T06:01:20.019 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi155 smithi155 running (82s) 3s ago 10m 7470k - 19.0.0-191-g6d933094 a29c258b5d6f 6599d6adc8fa 2023-12-16T06:01:20.019 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi156 smithi156 running (78s) 77s ago 9m 7448k - 19.0.0-191-g6d933094 a29c258b5d6f 8129878ae56e 2023-12-16T06:01:20.019 INFO:teuthology.orchestra.run.smithi155.stdout:grafana.smithi155 smithi155 *:3000 running (2m) 3s ago 10m 83.3M - 9.4.12 a0ea5e3c46d9 a16c84704784 2023-12-16T06:01:20.019 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.bzsxjw smithi155 running (6m) 3s ago 6m 4746M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6bcabf94a5c3 2023-12-16T06:01:20.019 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.vicpis smithi155 running (6m) 3s ago 6m 669M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 afa64e1ef8da 2023-12-16T06:01:20.019 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.fasing smithi156 running (6m) 77s ago 6m 538M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 7d97160bda7c 2023-12-16T06:01:20.019 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.qvgmfj smithi156 running (6m) 77s ago 6m 5969M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4018b2f2e27e 2023-12-16T06:01:20.019 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi155.maowdn smithi155 *:8443,9283,8765 running (4m) 3s ago 11m 513M - 19.0.0-191-g6d933094 a29c258b5d6f ee39089d18d3 2023-12-16T06:01:20.020 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi156.pclong smithi156 *:8443,9283,8765 running (3m) 77s ago 9m 447M - 19.0.0-191-g6d933094 a29c258b5d6f 673376e357e8 2023-12-16T06:01:20.020 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi155 smithi155 running (2m) 3s ago 11m 67.4M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 19eb23d9f064 2023-12-16T06:01:20.020 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi156 smithi156 running (108s) 77s ago 9m 46.4M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 62dacb4d7a17 2023-12-16T06:01:20.020 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi155 smithi155 *:9100 running (3m) 3s ago 10m 15.7M - 1.5.0 0da6a335fe13 6f0f1f68f191 2023-12-16T06:01:20.020 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi156 smithi156 *:9100 running (3m) 77s ago 9m 18.8M - 1.5.0 0da6a335fe13 c4595a7b1707 2023-12-16T06:01:20.020 INFO:teuthology.orchestra.run.smithi155.stdout:osd.0 smithi155 running (65s) 3s ago 9m 122M 1568M 19.0.0-191-g6d933094 a29c258b5d6f f5b1d720ac4f 2023-12-16T06:01:20.020 INFO:teuthology.orchestra.run.smithi155.stdout:osd.1 smithi155 running (35s) 3s ago 8m 125M 1568M 19.0.0-191-g6d933094 a29c258b5d6f badaf737af87 2023-12-16T06:01:20.020 INFO:teuthology.orchestra.run.smithi155.stdout:osd.2 smithi155 running (6s) 3s ago 8m 12.6M 1568M 19.0.0-191-g6d933094 a29c258b5d6f 9a08b6ae1253 2023-12-16T06:01:20.020 INFO:teuthology.orchestra.run.smithi155.stdout:osd.3 smithi156 running (8m) 77s ago 8m 960M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c4f6c54afe99 2023-12-16T06:01:20.020 INFO:teuthology.orchestra.run.smithi155.stdout:osd.4 smithi156 running (8m) 77s ago 8m 741M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 6309b12204fd 2023-12-16T06:01:20.020 INFO:teuthology.orchestra.run.smithi155.stdout:osd.5 smithi156 running (7m) 77s ago 7m 854M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 84b2c33eb0e1 2023-12-16T06:01:20.020 INFO:teuthology.orchestra.run.smithi155.stdout:prometheus.smithi155 smithi155 *:9095 running (3m) 3s ago 10m 66.6M - 2.43.0 a07b618ecd1d 26bb7cfc1b8b 2023-12-16T06:01:20.021 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.019+0000 7efe5dde7700 1 -- 172.21.15.155:0/1346768290 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7efe4406ce60 msgr2=0x7efe4406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:20.021 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.019+0000 7efe5dde7700 1 --2- 172.21.15.155:0/1346768290 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7efe4406ce60 0x7efe4406f310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efe40004f90 tx=0x7efe40009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:20.022 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.019+0000 7efe5dde7700 1 -- 172.21.15.155:0/1346768290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe580fbb40 msgr2=0x7efe58113620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:20.022 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.019+0000 7efe5dde7700 1 --2- 172.21.15.155:0/1346768290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe580fbb40 0x7efe58113620 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efe48002a80 tx=0x7efe480046b0 comp rx=0 tx=0).stop 2023-12-16T06:01:20.022 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.019+0000 7efe5dde7700 1 -- 172.21.15.155:0/1346768290 shutdown_connections 2023-12-16T06:01:20.022 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.019+0000 7efe5dde7700 1 --2- 172.21.15.155:0/1346768290 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7efe4406ce60 0x7efe4406f310 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:20.022 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.019+0000 7efe5dde7700 1 --2- 172.21.15.155:0/1346768290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe580fbb40 0x7efe58113620 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:20.022 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.019+0000 7efe5dde7700 1 --2- 172.21.15.155:0/1346768290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe58101b00 0x7efe58113ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:20.022 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.019+0000 7efe5dde7700 1 -- 172.21.15.155:0/1346768290 >> 172.21.15.155:0/1346768290 conn(0x7efe580719b0 msgr2=0x7efe580653b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:20.022 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.019+0000 7efe5dde7700 1 -- 172.21.15.155:0/1346768290 shutdown_connections 2023-12-16T06:01:20.022 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.019+0000 7efe5dde7700 1 -- 172.21.15.155:0/1346768290 wait complete. 2023-12-16T06:01:20.127 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.123+0000 7f779d394700 1 -- 172.21.15.155:0/3227370779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7798102c00 msgr2=0x7f7798102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:20.127 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.123+0000 7f779d394700 1 --2- 172.21.15.155:0/3227370779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7798102c00 0x7f7798102fd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7788009ce0 tx=0x7f7788004d10 comp rx=0 tx=0).stop 2023-12-16T06:01:20.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.123+0000 7f779d394700 1 -- 172.21.15.155:0/3227370779 shutdown_connections 2023-12-16T06:01:20.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.123+0000 7f779d394700 1 --2- 172.21.15.155:0/3227370779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77981035a0 0x7f77980fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:20.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.123+0000 7f779d394700 1 --2- 172.21.15.155:0/3227370779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7798102c00 0x7f7798102fd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:20.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.123+0000 7f779d394700 1 -- 172.21.15.155:0/3227370779 >> 172.21.15.155:0/3227370779 conn(0x7f77980f8770 msgr2=0x7f77980fab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:20.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.123+0000 7f779d394700 1 -- 172.21.15.155:0/3227370779 shutdown_connections 2023-12-16T06:01:20.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.123+0000 7f779d394700 1 -- 172.21.15.155:0/3227370779 wait complete. 2023-12-16T06:01:20.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.124+0000 7f779d394700 1 Processor -- start 2023-12-16T06:01:20.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.124+0000 7f779d394700 1 -- start start 2023-12-16T06:01:20.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.124+0000 7f779d394700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77981035a0 0x7f779806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:20.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.124+0000 7f779d394700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7798070480 0x7f77980708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:20.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.124+0000 7f779d394700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7798119b80 con 0x7f7798070480 2023-12-16T06:01:20.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.124+0000 7f779d394700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7798119cc0 con 0x7f77981035a0 2023-12-16T06:01:20.128 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.124+0000 7f77967fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7798070480 0x7f77980708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:20.129 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.124+0000 7f77967fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7798070480 0x7f77980708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:60156/0 (socket says 172.21.15.155:60156) 2023-12-16T06:01:20.129 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.124+0000 7f77967fc700 1 -- 172.21.15.155:0/2093905103 learned_addr learned my addr 172.21.15.155:0/2093905103 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:01:20.129 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.124+0000 7f7796ffd700 1 --2- 172.21.15.155:0/2093905103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77981035a0 0x7f779806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:20.129 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.124+0000 7f77967fc700 1 -- 172.21.15.155:0/2093905103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77981035a0 msgr2=0x7f779806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:20.129 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.124+0000 7f77967fc700 1 --2- 172.21.15.155:0/2093905103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77981035a0 0x7f779806ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:20.129 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.124+0000 7f77967fc700 1 -- 172.21.15.155:0/2093905103 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7788009940 con 0x7f7798070480 2023-12-16T06:01:20.129 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.125+0000 7f77967fc700 1 --2- 172.21.15.155:0/2093905103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7798070480 0x7f77980708f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f778000c800 tx=0x7f7780004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:20.129 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.125+0000 7f778f7fe700 1 -- 172.21.15.155:0/2093905103 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77800106f0 con 0x7f7798070480 2023-12-16T06:01:20.129 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.125+0000 7f779d394700 1 -- 172.21.15.155:0/2093905103 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7798119f20 con 0x7f7798070480 2023-12-16T06:01:20.129 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.125+0000 7f778f7fe700 1 -- 172.21.15.155:0/2093905103 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7780010d00 con 0x7f7798070480 2023-12-16T06:01:20.129 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.125+0000 7f778f7fe700 1 -- 172.21.15.155:0/2093905103 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77800113a0 con 0x7f7798070480 2023-12-16T06:01:20.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.125+0000 7f779d394700 1 -- 172.21.15.155:0/2093905103 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779811a430 con 0x7f7798070480 2023-12-16T06:01:20.130 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.126+0000 7f779d394700 1 -- 172.21.15.155:0/2093905103 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77980fff10 con 0x7f7798070480 2023-12-16T06:01:20.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.126+0000 7f778f7fe700 1 -- 172.21.15.155:0/2093905103 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f7780012400 con 0x7f7798070480 2023-12-16T06:01:20.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.127+0000 7f778f7fe700 1 --2- 172.21.15.155:0/2093905103 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f778406ce60 0x7f778406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:20.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.127+0000 7f778f7fe700 1 -- 172.21.15.155:0/2093905103 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f778008c220 con 0x7f7798070480 2023-12-16T06:01:20.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.127+0000 7f7796ffd700 1 --2- 172.21.15.155:0/2093905103 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f778406ce60 0x7f778406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:20.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.127+0000 7f7796ffd700 1 --2- 172.21.15.155:0/2093905103 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f778406ce60 0x7f778406f310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7788000f80 tx=0x7f7788004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:20.134 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.131+0000 7f778f7fe700 1 -- 172.21.15.155:0/2093905103 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f77800561d0 con 0x7f7798070480 2023-12-16T06:01:20.442 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.439+0000 7f779d394700 1 -- 172.21.15.155:0/2093905103 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f77980fc390 con 0x7f7798070480 2023-12-16T06:01:20.442 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.439+0000 7f778f7fe700 1 -- 172.21.15.155:0/2093905103 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7f77800597f0 con 0x7f7798070480 2023-12-16T06:01:20.442 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T06:01:20.443 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": { 2023-12-16T06:01:20.443 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T06:01:20.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:01:20.443 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": { 2023-12-16T06:01:20.443 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T06:01:20.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:01:20.443 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": { 2023-12-16T06:01:20.443 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 3, 2023-12-16T06:01:20.443 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 3 2023-12-16T06:01:20.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:01:20.443 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2023-12-16T06:01:20.443 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T06:01:20.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:01:20.444 INFO:teuthology.orchestra.run.smithi155.stdout: "overall": { 2023-12-16T06:01:20.444 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 7, 2023-12-16T06:01:20.444 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 7 2023-12-16T06:01:20.444 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-12-16T06:01:20.444 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T06:01:20.444 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.441+0000 7f779d394700 1 -- 172.21.15.155:0/2093905103 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f778406ce60 msgr2=0x7f778406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:20.445 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.441+0000 7f779d394700 1 --2- 172.21.15.155:0/2093905103 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f778406ce60 0x7f778406f310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7788000f80 tx=0x7f7788004d10 comp rx=0 tx=0).stop 2023-12-16T06:01:20.445 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.441+0000 7f779d394700 1 -- 172.21.15.155:0/2093905103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7798070480 msgr2=0x7f77980708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:20.445 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.441+0000 7f779d394700 1 --2- 172.21.15.155:0/2093905103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7798070480 0x7f77980708f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f778000c800 tx=0x7f7780004470 comp rx=0 tx=0).stop 2023-12-16T06:01:20.445 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.442+0000 7f779d394700 1 -- 172.21.15.155:0/2093905103 shutdown_connections 2023-12-16T06:01:20.445 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.442+0000 7f779d394700 1 --2- 172.21.15.155:0/2093905103 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f778406ce60 0x7f778406f310 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:20.445 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.442+0000 7f779d394700 1 --2- 172.21.15.155:0/2093905103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77981035a0 0x7f779806ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:20.445 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.442+0000 7f779d394700 1 --2- 172.21.15.155:0/2093905103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7798070480 0x7f77980708f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:20.445 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.442+0000 7f779d394700 1 -- 172.21.15.155:0/2093905103 >> 172.21.15.155:0/2093905103 conn(0x7f77980f8770 msgr2=0x7f7798106230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:20.445 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.442+0000 7f779d394700 1 -- 172.21.15.155:0/2093905103 shutdown_connections 2023-12-16T06:01:20.445 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.442+0000 7f779d394700 1 -- 172.21.15.155:0/2093905103 wait complete. 2023-12-16T06:01:20.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.543+0000 7f8e65c38700 1 -- 172.21.15.155:0/3174527780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e60101b00 msgr2=0x7f8e60101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:20.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.543+0000 7f8e65c38700 1 --2- 172.21.15.155:0/3174527780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e60101b00 0x7f8e60101ed0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8e50004940 tx=0x7f8e50009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:20.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.543+0000 7f8e65c38700 1 -- 172.21.15.155:0/3174527780 shutdown_connections 2023-12-16T06:01:20.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.543+0000 7f8e65c38700 1 --2- 172.21.15.155:0/3174527780 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e60102410 0x7f8e600fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:20.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.543+0000 7f8e65c38700 1 --2- 172.21.15.155:0/3174527780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e60101b00 0x7f8e60101ed0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:20.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.543+0000 7f8e65c38700 1 -- 172.21.15.155:0/3174527780 >> 172.21.15.155:0/3174527780 conn(0x7f8e600711a0 msgr2=0x7f8e600715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:20.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.543+0000 7f8e65c38700 1 -- 172.21.15.155:0/3174527780 shutdown_connections 2023-12-16T06:01:20.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.543+0000 7f8e65c38700 1 -- 172.21.15.155:0/3174527780 wait complete. 2023-12-16T06:01:20.546 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.544+0000 7f8e65c38700 1 Processor -- start 2023-12-16T06:01:20.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.544+0000 7f8e65c38700 1 -- start start 2023-12-16T06:01:20.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.544+0000 7f8e65c38700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e60101b00 0x7f8e60112540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:20.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.544+0000 7f8e65c38700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e60102410 0x7f8e60112a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:20.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.544+0000 7f8e65c38700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e601130d0 con 0x7f8e60101b00 2023-12-16T06:01:20.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.544+0000 7f8e65c38700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6010c400 con 0x7f8e60102410 2023-12-16T06:01:20.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.544+0000 7f8e5f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e60101b00 0x7f8e60112540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:20.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.544+0000 7f8e5f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e60101b00 0x7f8e60112540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:60168/0 (socket says 172.21.15.155:60168) 2023-12-16T06:01:20.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.544+0000 7f8e5f7fe700 1 -- 172.21.15.155:0/3677189976 learned_addr learned my addr 172.21.15.155:0/3677189976 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:01:20.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.544+0000 7f8e5effd700 1 --2- 172.21.15.155:0/3677189976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e60102410 0x7f8e60112a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:20.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.544+0000 7f8e5f7fe700 1 -- 172.21.15.155:0/3677189976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e60102410 msgr2=0x7f8e60112a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:20.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.544+0000 7f8e5f7fe700 1 --2- 172.21.15.155:0/3677189976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e60102410 0x7f8e60112a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:20.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.544+0000 7f8e5f7fe700 1 -- 172.21.15.155:0/3677189976 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e50005040 con 0x7f8e60101b00 2023-12-16T06:01:20.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.545+0000 7f8e5f7fe700 1 --2- 172.21.15.155:0/3677189976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e60101b00 0x7f8e60112540 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000b3b0 tx=0x7f8e50009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:20.549 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.545+0000 7f8e57fff700 1 -- 172.21.15.155:0/3677189976 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e5000e040 con 0x7f8e60101b00 2023-12-16T06:01:20.549 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.545+0000 7f8e57fff700 1 -- 172.21.15.155:0/3677189976 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e5000bc50 con 0x7f8e60101b00 2023-12-16T06:01:20.549 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.545+0000 7f8e65c38700 1 -- 172.21.15.155:0/3677189976 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6010c680 con 0x7f8e60101b00 2023-12-16T06:01:20.549 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.545+0000 7f8e57fff700 1 -- 172.21.15.155:0/3677189976 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e5001c3f0 con 0x7f8e60101b00 2023-12-16T06:01:20.549 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.545+0000 7f8e65c38700 1 -- 172.21.15.155:0/3677189976 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6010cbc0 con 0x7f8e60101b00 2023-12-16T06:01:20.550 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.546+0000 7f8e65c38700 1 -- 172.21.15.155:0/3677189976 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e600fee60 con 0x7f8e60101b00 2023-12-16T06:01:20.550 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.546+0000 7f8e57fff700 1 -- 172.21.15.155:0/3677189976 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f8e50013420 con 0x7f8e60101b00 2023-12-16T06:01:20.550 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.547+0000 7f8e57fff700 1 --2- 172.21.15.155:0/3677189976 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f8e4c06ce60 0x7f8e4c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:20.550 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.547+0000 7f8e57fff700 1 -- 172.21.15.155:0/3677189976 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f8e5008d840 con 0x7f8e60101b00 2023-12-16T06:01:20.550 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.547+0000 7f8e5effd700 1 --2- 172.21.15.155:0/3677189976 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f8e4c06ce60 0x7f8e4c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:20.550 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.547+0000 7f8e5effd700 1 --2- 172.21.15.155:0/3677189976 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f8e4c06ce60 0x7f8e4c06f310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8e6010dde0 tx=0x7f8e4800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:20.554 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.551+0000 7f8e57fff700 1 -- 172.21.15.155:0/3677189976 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f8e5005b1e0 con 0x7f8e60101b00 2023-12-16T06:01:20.810 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.807+0000 7f8e65c38700 1 -- 172.21.15.155:0/3677189976 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8e60072d10 con 0x7f8e60101b00 2023-12-16T06:01:20.810 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.808+0000 7f8e57fff700 1 -- 172.21.15.155:0/3677189976 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1873 (secure 0 0 0) 0x7f8e5005ad70 con 0x7f8e60101b00 2023-12-16T06:01:20.811 INFO:teuthology.orchestra.run.smithi155.stdout:e18 2023-12-16T06:01:20.811 INFO:teuthology.orchestra.run.smithi155.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T06:01:20.811 INFO:teuthology.orchestra.run.smithi155.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T06:01:20.811 INFO:teuthology.orchestra.run.smithi155.stdout:legacy client fscid: 1 2023-12-16T06:01:20.811 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T06:01:20.811 INFO:teuthology.orchestra.run.smithi155.stdout:Filesystem 'cephfs' (1) 2023-12-16T06:01:20.811 INFO:teuthology.orchestra.run.smithi155.stdout:fs_name cephfs 2023-12-16T06:01:20.811 INFO:teuthology.orchestra.run.smithi155.stdout:epoch 18 2023-12-16T06:01:20.811 INFO:teuthology.orchestra.run.smithi155.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-16T06:01:20.811 INFO:teuthology.orchestra.run.smithi155.stdout:created 2023-12-16T05:54:25.897091+0000 2023-12-16T06:01:20.811 INFO:teuthology.orchestra.run.smithi155.stdout:modified 2023-12-16T06:00:59.697972+0000 2023-12-16T06:01:20.811 INFO:teuthology.orchestra.run.smithi155.stdout:tableserver 0 2023-12-16T06:01:20.811 INFO:teuthology.orchestra.run.smithi155.stdout:root 0 2023-12-16T06:01:20.811 INFO:teuthology.orchestra.run.smithi155.stdout:session_timeout 60 2023-12-16T06:01:20.811 INFO:teuthology.orchestra.run.smithi155.stdout:session_autoclose 300 2023-12-16T06:01:20.812 INFO:teuthology.orchestra.run.smithi155.stdout:max_file_size 1099511627776 2023-12-16T06:01:20.812 INFO:teuthology.orchestra.run.smithi155.stdout:max_xattr_size 65536 2023-12-16T06:01:20.812 INFO:teuthology.orchestra.run.smithi155.stdout:required_client_features {} 2023-12-16T06:01:20.812 INFO:teuthology.orchestra.run.smithi155.stdout:last_failure 0 2023-12-16T06:01:20.812 INFO:teuthology.orchestra.run.smithi155.stdout:last_failure_osd_epoch 0 2023-12-16T06:01:20.812 INFO:teuthology.orchestra.run.smithi155.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T06:01:20.812 INFO:teuthology.orchestra.run.smithi155.stdout:max_mds 2 2023-12-16T06:01:20.812 INFO:teuthology.orchestra.run.smithi155.stdout:in 0,1 2023-12-16T06:01:20.812 INFO:teuthology.orchestra.run.smithi155.stdout:up {0=14456,1=24281} 2023-12-16T06:01:20.812 INFO:teuthology.orchestra.run.smithi155.stdout:failed 2023-12-16T06:01:20.812 INFO:teuthology.orchestra.run.smithi155.stdout:damaged 2023-12-16T06:01:20.812 INFO:teuthology.orchestra.run.smithi155.stdout:stopped 2023-12-16T06:01:20.812 INFO:teuthology.orchestra.run.smithi155.stdout:data_pools [3] 2023-12-16T06:01:20.812 INFO:teuthology.orchestra.run.smithi155.stdout:metadata_pool 2 2023-12-16T06:01:20.813 INFO:teuthology.orchestra.run.smithi155.stdout:inline_data disabled 2023-12-16T06:01:20.813 INFO:teuthology.orchestra.run.smithi155.stdout:balancer 2023-12-16T06:01:20.813 INFO:teuthology.orchestra.run.smithi155.stdout:bal_rank_mask -1 2023-12-16T06:01:20.813 INFO:teuthology.orchestra.run.smithi155.stdout:standby_count_wanted 1 2023-12-16T06:01:20.813 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi155.bzsxjw{0:14456} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.155:6826/1416140807,v1:172.21.15.155:6827/1416140807] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T06:01:20.813 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi156.fasing{0:24289} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1763385284,v1:172.21.15.156:6827/1763385284] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T06:01:20.813 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi156.qvgmfj{1:24281} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.156:6824/2823725296,v1:172.21.15.156:6825/2823725296] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T06:01:20.813 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi155.vicpis{1:14472} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.155:6828/750006619,v1:172.21.15.155:6829/750006619] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T06:01:20.813 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T06:01:20.813 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T06:01:20.814 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.810+0000 7f8e65c38700 1 -- 172.21.15.155:0/3677189976 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f8e4c06ce60 msgr2=0x7f8e4c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:20.814 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.810+0000 7f8e65c38700 1 --2- 172.21.15.155:0/3677189976 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f8e4c06ce60 0x7f8e4c06f310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8e6010dde0 tx=0x7f8e4800b040 comp rx=0 tx=0).stop 2023-12-16T06:01:20.814 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.810+0000 7f8e65c38700 1 -- 172.21.15.155:0/3677189976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e60101b00 msgr2=0x7f8e60112540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:20.814 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.810+0000 7f8e65c38700 1 --2- 172.21.15.155:0/3677189976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e60101b00 0x7f8e60112540 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000b3b0 tx=0x7f8e50009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:20.814 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.810+0000 7f8e65c38700 1 -- 172.21.15.155:0/3677189976 shutdown_connections 2023-12-16T06:01:20.814 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.810+0000 7f8e65c38700 1 --2- 172.21.15.155:0/3677189976 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f8e4c06ce60 0x7f8e4c06f310 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:20.814 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.810+0000 7f8e65c38700 1 --2- 172.21.15.155:0/3677189976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e60101b00 0x7f8e60112540 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:20.815 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.810+0000 7f8e65c38700 1 --2- 172.21.15.155:0/3677189976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e60102410 0x7f8e60112a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:20.815 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.810+0000 7f8e65c38700 1 -- 172.21.15.155:0/3677189976 >> 172.21.15.155:0/3677189976 conn(0x7f8e600711a0 msgr2=0x7f8e600fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:20.815 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.810+0000 7f8e65c38700 1 -- 172.21.15.155:0/3677189976 shutdown_connections 2023-12-16T06:01:20.815 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.810+0000 7f8e65c38700 1 -- 172.21.15.155:0/3677189976 wait complete. 2023-12-16T06:01:20.815 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 18 2023-12-16T06:01:20.916 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.912+0000 7f19e7703700 1 -- 172.21.15.155:0/708383962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e0101b00 msgr2=0x7f19e0101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:20.916 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.912+0000 7f19e7703700 1 --2- 172.21.15.155:0/708383962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e0101b00 0x7f19e0101ed0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f19d0004940 tx=0x7f19d0009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:20.917 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.912+0000 7f19e7703700 1 -- 172.21.15.155:0/708383962 shutdown_connections 2023-12-16T06:01:20.917 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.912+0000 7f19e7703700 1 --2- 172.21.15.155:0/708383962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19e00fbb40 0x7f19e00fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:20.917 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.912+0000 7f19e7703700 1 --2- 172.21.15.155:0/708383962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e0101b00 0x7f19e0101ed0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:20.917 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.912+0000 7f19e7703700 1 -- 172.21.15.155:0/708383962 >> 172.21.15.155:0/708383962 conn(0x7f19e00719b0 msgr2=0x7f19e0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:20.917 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.912+0000 7f19e7703700 1 -- 172.21.15.155:0/708383962 shutdown_connections 2023-12-16T06:01:20.917 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.912+0000 7f19e7703700 1 -- 172.21.15.155:0/708383962 wait complete. 2023-12-16T06:01:20.917 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.913+0000 7f19e7703700 1 Processor -- start 2023-12-16T06:01:20.917 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.913+0000 7f19e7703700 1 -- start start 2023-12-16T06:01:20.917 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.913+0000 7f19e7703700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19e00fbb40 0x7f19e010e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:20.917 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.913+0000 7f19e7703700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e0101b00 0x7f19e010ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:20.917 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.913+0000 7f19e7703700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e010f1a0 con 0x7f19e0101b00 2023-12-16T06:01:20.917 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.913+0000 7f19e7703700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e010f310 con 0x7f19e00fbb40 2023-12-16T06:01:20.917 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.913+0000 7f19e4c9e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e0101b00 0x7f19e010ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:20.918 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.913+0000 7f19e4c9e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e0101b00 0x7f19e010ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:60186/0 (socket says 172.21.15.155:60186) 2023-12-16T06:01:20.918 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.913+0000 7f19e4c9e700 1 -- 172.21.15.155:0/2767571603 learned_addr learned my addr 172.21.15.155:0/2767571603 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:01:20.918 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.913+0000 7f19e549f700 1 --2- 172.21.15.155:0/2767571603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19e00fbb40 0x7f19e010e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:20.918 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.913+0000 7f19e4c9e700 1 -- 172.21.15.155:0/2767571603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19e00fbb40 msgr2=0x7f19e010e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:20.918 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.913+0000 7f19e4c9e700 1 --2- 172.21.15.155:0/2767571603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19e00fbb40 0x7f19e010e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:20.918 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.913+0000 7f19e4c9e700 1 -- 172.21.15.155:0/2767571603 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d0005040 con 0x7f19e0101b00 2023-12-16T06:01:20.918 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.913+0000 7f19e549f700 1 --2- 172.21.15.155:0/2767571603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19e00fbb40 0x7f19e010e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T06:01:20.918 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.913+0000 7f19e4c9e700 1 --2- 172.21.15.155:0/2767571603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e0101b00 0x7f19e010ec10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f19dc002a50 tx=0x7f19dc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:20.918 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.913+0000 7f19d5ffb700 1 -- 172.21.15.155:0/2767571603 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19dc007cc0 con 0x7f19e0101b00 2023-12-16T06:01:20.918 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.914+0000 7f19d5ffb700 1 -- 172.21.15.155:0/2767571603 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f19dc00f040 con 0x7f19e0101b00 2023-12-16T06:01:20.918 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.914+0000 7f19e7703700 1 -- 172.21.15.155:0/2767571603 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e01176a0 con 0x7f19e0101b00 2023-12-16T06:01:20.918 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.914+0000 7f19d5ffb700 1 -- 172.21.15.155:0/2767571603 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19dc009540 con 0x7f19e0101b00 2023-12-16T06:01:20.918 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.914+0000 7f19e7703700 1 -- 172.21.15.155:0/2767571603 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e0117b60 con 0x7f19e0101b00 2023-12-16T06:01:20.919 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.915+0000 7f19e7703700 1 -- 172.21.15.155:0/2767571603 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e0103fb0 con 0x7f19e0101b00 2023-12-16T06:01:20.919 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.915+0000 7f19d5ffb700 1 -- 172.21.15.155:0/2767571603 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f19dc0096a0 con 0x7f19e0101b00 2023-12-16T06:01:20.919 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.915+0000 7f19d5ffb700 1 --2- 172.21.15.155:0/2767571603 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f19cc06ce60 0x7f19cc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:20.919 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.915+0000 7f19d5ffb700 1 -- 172.21.15.155:0/2767571603 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f19dc08c060 con 0x7f19e0101b00 2023-12-16T06:01:20.919 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.915+0000 7f19e549f700 1 --2- 172.21.15.155:0/2767571603 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f19cc06ce60 0x7f19cc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:20.919 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.916+0000 7f19e549f700 1 --2- 172.21.15.155:0/2767571603 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f19cc06ce60 0x7f19cc06f310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f19d0004f90 tx=0x7f19d0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:20.922 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:20.920+0000 7f19d5ffb700 1 -- 172.21.15.155:0/2767571603 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f19dc055f90 con 0x7f19e0101b00 2023-12-16T06:01:20.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: failed to encode map e60 with expected crc 2023-12-16T06:01:20.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T06:01:20.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: osd.2 [v2:172.21.15.155:6818/2046101839,v1:172.21.15.155:6819/2046101839] boot 2023-12-16T06:01:20.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: osdmap e61: 6 total, 6 up, 6 in 2023-12-16T06:01:20.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: failed to encode map e61 with expected crc 2023-12-16T06:01:20.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: failed to encode map e61 with expected crc 2023-12-16T06:01:20.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: failed to encode map e61 with expected crc 2023-12-16T06:01:20.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T06:01:20.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:01:20.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:01:20.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: pgmap v77: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 41/342 objects degraded (11.988%) 2023-12-16T06:01:20.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:20.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:01:20.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:20.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:20.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:01:20.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T06:01:20.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:20.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:01:20.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:01:20.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:01:20.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:01:20.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T06:01:20.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T06:01:20.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-16T06:01:20.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/2093905103' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:01:20.932 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:20 smithi156 ceph-mon[182000]: osdmap e62: 6 total, 6 up, 6 in 2023-12-16T06:01:21.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: failed to encode map e60 with expected crc 2023-12-16T06:01:21.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T06:01:21.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: osd.2 [v2:172.21.15.155:6818/2046101839,v1:172.21.15.155:6819/2046101839] boot 2023-12-16T06:01:21.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: osdmap e61: 6 total, 6 up, 6 in 2023-12-16T06:01:21.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: failed to encode map e61 with expected crc 2023-12-16T06:01:21.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: failed to encode map e61 with expected crc 2023-12-16T06:01:21.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: failed to encode map e61 with expected crc 2023-12-16T06:01:21.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T06:01:21.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:01:21.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:01:21.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: pgmap v77: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 41/342 objects degraded (11.988%) 2023-12-16T06:01:21.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:21.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:01:21.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:21.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:21.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:01:21.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T06:01:21.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:21.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:01:21.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:01:21.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:01:21.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:01:21.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T06:01:21.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T06:01:21.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-16T06:01:21.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/2093905103' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:01:21.078 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:20 smithi155 ceph-mon[217407]: osdmap e62: 6 total, 6 up, 6 in 2023-12-16T06:01:21.136 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.134+0000 7f19e7703700 1 -- 172.21.15.155:0/2767571603 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f19e0065b90 con 0x7f19cc06ce60 2023-12-16T06:01:21.137 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.135+0000 7f19d5ffb700 1 -- 172.21.15.155:0/2767571603 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f19e0065b90 con 0x7f19cc06ce60 2023-12-16T06:01:21.138 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T06:01:21.138 INFO:teuthology.orchestra.run.smithi155.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T06:01:21.138 INFO:teuthology.orchestra.run.smithi155.stdout: "in_progress": true, 2023-12-16T06:01:21.138 INFO:teuthology.orchestra.run.smithi155.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T06:01:21.138 INFO:teuthology.orchestra.run.smithi155.stdout: "services_complete": [ 2023-12-16T06:01:21.138 INFO:teuthology.orchestra.run.smithi155.stdout: "crash", 2023-12-16T06:01:21.138 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr", 2023-12-16T06:01:21.138 INFO:teuthology.orchestra.run.smithi155.stdout: "mon" 2023-12-16T06:01:21.138 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-12-16T06:01:21.138 INFO:teuthology.orchestra.run.smithi155.stdout: "progress": "9/21 daemons upgraded", 2023-12-16T06:01:21.138 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "Currently upgrading osd daemons", 2023-12-16T06:01:21.138 INFO:teuthology.orchestra.run.smithi155.stdout: "is_paused": false 2023-12-16T06:01:21.138 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T06:01:21.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.137+0000 7f19e7703700 1 -- 172.21.15.155:0/2767571603 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f19cc06ce60 msgr2=0x7f19cc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:21.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.137+0000 7f19e7703700 1 --2- 172.21.15.155:0/2767571603 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f19cc06ce60 0x7f19cc06f310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f19d0004f90 tx=0x7f19d0009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:21.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.137+0000 7f19e7703700 1 -- 172.21.15.155:0/2767571603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e0101b00 msgr2=0x7f19e010ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:21.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.137+0000 7f19e7703700 1 --2- 172.21.15.155:0/2767571603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e0101b00 0x7f19e010ec10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f19dc002a50 tx=0x7f19dc0046b0 comp rx=0 tx=0).stop 2023-12-16T06:01:21.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.137+0000 7f19e7703700 1 -- 172.21.15.155:0/2767571603 shutdown_connections 2023-12-16T06:01:21.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.137+0000 7f19e7703700 1 --2- 172.21.15.155:0/2767571603 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f19cc06ce60 0x7f19cc06f310 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:21.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.137+0000 7f19e7703700 1 --2- 172.21.15.155:0/2767571603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19e00fbb40 0x7f19e010e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:21.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.137+0000 7f19e7703700 1 --2- 172.21.15.155:0/2767571603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e0101b00 0x7f19e010ec10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:21.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.137+0000 7f19e7703700 1 -- 172.21.15.155:0/2767571603 >> 172.21.15.155:0/2767571603 conn(0x7f19e00719b0 msgr2=0x7f19e00fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:21.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.137+0000 7f19e7703700 1 -- 172.21.15.155:0/2767571603 shutdown_connections 2023-12-16T06:01:21.141 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.137+0000 7f19e7703700 1 -- 172.21.15.155:0/2767571603 wait complete. 2023-12-16T06:01:21.241 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.238+0000 7faa79947700 1 -- 172.21.15.155:0/2976470696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa74101b00 msgr2=0x7faa74101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:21.241 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.238+0000 7faa79947700 1 --2- 172.21.15.155:0/2976470696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa74101b00 0x7faa74101ed0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faa64004940 tx=0x7faa64009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:21.241 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.238+0000 7faa79947700 1 -- 172.21.15.155:0/2976470696 shutdown_connections 2023-12-16T06:01:21.241 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.238+0000 7faa79947700 1 --2- 172.21.15.155:0/2976470696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa740fbb40 0x7faa740fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:21.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.238+0000 7faa79947700 1 --2- 172.21.15.155:0/2976470696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa74101b00 0x7faa74101ed0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:21.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.238+0000 7faa79947700 1 -- 172.21.15.155:0/2976470696 >> 172.21.15.155:0/2976470696 conn(0x7faa740f76c0 msgr2=0x7faa740f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:21.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.238+0000 7faa79947700 1 -- 172.21.15.155:0/2976470696 shutdown_connections 2023-12-16T06:01:21.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.238+0000 7faa79947700 1 -- 172.21.15.155:0/2976470696 wait complete. 2023-12-16T06:01:21.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.239+0000 7faa79947700 1 Processor -- start 2023-12-16T06:01:21.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.239+0000 7faa79947700 1 -- start start 2023-12-16T06:01:21.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.239+0000 7faa79947700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa740fbb40 0x7faa740fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:21.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.239+0000 7faa79947700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa74101b00 0x7faa740fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:21.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.239+0000 7faa79947700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa740fe260 con 0x7faa74101b00 2023-12-16T06:01:21.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.239+0000 7faa79947700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa740fe3d0 con 0x7faa740fbb40 2023-12-16T06:01:21.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.239+0000 7faa727fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa74101b00 0x7faa740fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:21.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.239+0000 7faa727fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa74101b00 0x7faa740fdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:60198/0 (socket says 172.21.15.155:60198) 2023-12-16T06:01:21.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.239+0000 7faa727fc700 1 -- 172.21.15.155:0/1453159852 learned_addr learned my addr 172.21.15.155:0/1453159852 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:01:21.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.239+0000 7faa72ffd700 1 --2- 172.21.15.155:0/1453159852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa740fbb40 0x7faa740fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:21.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.240+0000 7faa727fc700 1 -- 172.21.15.155:0/1453159852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa740fbb40 msgr2=0x7faa740fd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:21.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.240+0000 7faa727fc700 1 --2- 172.21.15.155:0/1453159852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa740fbb40 0x7faa740fd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:21.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.240+0000 7faa727fc700 1 -- 172.21.15.155:0/1453159852 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa64005040 con 0x7faa74101b00 2023-12-16T06:01:21.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.240+0000 7faa727fc700 1 --2- 172.21.15.155:0/1453159852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa74101b00 0x7faa740fdc60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa68002a50 tx=0x7faa680046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:21.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.240+0000 7faa5b7fe700 1 -- 172.21.15.155:0/1453159852 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa68007cc0 con 0x7faa74101b00 2023-12-16T06:01:21.245 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.240+0000 7faa5b7fe700 1 -- 172.21.15.155:0/1453159852 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faa6800f040 con 0x7faa74101b00 2023-12-16T06:01:21.245 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.240+0000 7faa79947700 1 -- 172.21.15.155:0/1453159852 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa741198b0 con 0x7faa74101b00 2023-12-16T06:01:21.245 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.240+0000 7faa5b7fe700 1 -- 172.21.15.155:0/1453159852 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa68009540 con 0x7faa74101b00 2023-12-16T06:01:21.245 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.240+0000 7faa79947700 1 -- 172.21.15.155:0/1453159852 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa74119d90 con 0x7faa74101b00 2023-12-16T06:01:21.245 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.241+0000 7faa79947700 1 -- 172.21.15.155:0/1453159852 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa740fb2c0 con 0x7faa74101b00 2023-12-16T06:01:21.246 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.241+0000 7faa5b7fe700 1 -- 172.21.15.155:0/1453159852 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7faa680096c0 con 0x7faa74101b00 2023-12-16T06:01:21.246 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.242+0000 7faa5b7fe700 1 --2- 172.21.15.155:0/1453159852 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7faa5c06ce70 0x7faa5c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:21.246 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.242+0000 7faa5b7fe700 1 -- 172.21.15.155:0/1453159852 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6328+0+0 (secure 0 0 0) 0x7faa6808c0a0 con 0x7faa74101b00 2023-12-16T06:01:21.246 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.242+0000 7faa72ffd700 1 --2- 172.21.15.155:0/1453159852 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7faa5c06ce70 0x7faa5c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:21.246 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.242+0000 7faa72ffd700 1 --2- 172.21.15.155:0/1453159852 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7faa5c06ce70 0x7faa5c06f320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faa64000c00 tx=0x7faa64009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:21.249 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.246+0000 7faa5b7fe700 1 -- 172.21.15.155:0/1453159852 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7faa68055fd0 con 0x7faa74101b00 2023-12-16T06:01:21.523 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.520+0000 7faa79947700 1 -- 172.21.15.155:0/1453159852 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7faa74108ab0 con 0x7faa74101b00 2023-12-16T06:01:21.523 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.520+0000 7faa5b7fe700 1 -- 172.21.15.155:0/1453159852 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+852 (secure 0 0 0) 0x7faa68009970 con 0x7faa74101b00 2023-12-16T06:01:21.523 INFO:teuthology.orchestra.run.smithi155.stdout:HEALTH_WARN Degraded data redundancy: 41/342 objects degraded (11.988%), 12 pgs degraded 2023-12-16T06:01:21.523 INFO:teuthology.orchestra.run.smithi155.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 41/342 objects degraded (11.988%), 12 pgs degraded 2023-12-16T06:01:21.523 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2023-12-16T06:01:21.523 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2023-12-16T06:01:21.523 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2023-12-16T06:01:21.524 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2023-12-16T06:01:21.524 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2023-12-16T06:01:21.524 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2023-12-16T06:01:21.524 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2023-12-16T06:01:21.524 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2023-12-16T06:01:21.524 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.17 is active+undersized+degraded, acting [5,1] 2023-12-16T06:01:21.524 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2023-12-16T06:01:21.524 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2023-12-16T06:01:21.524 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2023-12-16T06:01:21.525 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.522+0000 7faa79947700 1 -- 172.21.15.155:0/1453159852 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7faa5c06ce70 msgr2=0x7faa5c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:21.525 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.522+0000 7faa79947700 1 --2- 172.21.15.155:0/1453159852 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7faa5c06ce70 0x7faa5c06f320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faa64000c00 tx=0x7faa64009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:21.525 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.522+0000 7faa79947700 1 -- 172.21.15.155:0/1453159852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa74101b00 msgr2=0x7faa740fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:21.525 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.522+0000 7faa79947700 1 --2- 172.21.15.155:0/1453159852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa74101b00 0x7faa740fdc60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa68002a50 tx=0x7faa680046b0 comp rx=0 tx=0).stop 2023-12-16T06:01:21.526 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.522+0000 7faa79947700 1 -- 172.21.15.155:0/1453159852 shutdown_connections 2023-12-16T06:01:21.526 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.522+0000 7faa79947700 1 --2- 172.21.15.155:0/1453159852 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7faa5c06ce70 0x7faa5c06f320 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:21.526 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.522+0000 7faa79947700 1 --2- 172.21.15.155:0/1453159852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa740fbb40 0x7faa740fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:21.526 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.522+0000 7faa79947700 1 --2- 172.21.15.155:0/1453159852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa74101b00 0x7faa740fdc60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:21.526 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.523+0000 7faa79947700 1 -- 172.21.15.155:0/1453159852 >> 172.21.15.155:0/1453159852 conn(0x7faa740f76c0 msgr2=0x7faa74065d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:21.526 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.523+0000 7faa79947700 1 -- 172.21.15.155:0/1453159852 shutdown_connections 2023-12-16T06:01:21.526 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:21.523+0000 7faa79947700 1 -- 172.21.15.155:0/1453159852 wait complete. 2023-12-16T06:01:21.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:21 smithi156 ceph-mon[182000]: failed to encode map e62 with expected crc 2023-12-16T06:01:21.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:21 smithi156 ceph-mon[182000]: failed to encode map e62 with expected crc 2023-12-16T06:01:21.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:21 smithi156 ceph-mon[182000]: failed to encode map e62 with expected crc 2023-12-16T06:01:21.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:21 smithi156 ceph-mon[182000]: failed to encode map e62 with expected crc 2023-12-16T06:01:21.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:21 smithi156 ceph-mon[182000]: failed to encode map e62 with expected crc 2023-12-16T06:01:21.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:21 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/3677189976' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T06:01:21.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:21 smithi156 ceph-mon[182000]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:01:21.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:21 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/1453159852' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T06:01:22.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:21 smithi155 ceph-mon[217407]: failed to encode map e62 with expected crc 2023-12-16T06:01:22.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:21 smithi155 ceph-mon[217407]: failed to encode map e62 with expected crc 2023-12-16T06:01:22.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:21 smithi155 ceph-mon[217407]: failed to encode map e62 with expected crc 2023-12-16T06:01:22.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:21 smithi155 ceph-mon[217407]: failed to encode map e62 with expected crc 2023-12-16T06:01:22.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:21 smithi155 ceph-mon[217407]: failed to encode map e62 with expected crc 2023-12-16T06:01:22.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:21 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/3677189976' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T06:01:22.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:21 smithi155 ceph-mon[217407]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:01:22.077 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:21 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/1453159852' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T06:01:22.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:22 smithi156 ceph-mon[182000]: Health check update: Degraded data redundancy: 41/342 objects degraded (11.988%), 12 pgs degraded (PG_DEGRADED) 2023-12-16T06:01:22.930 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:22 smithi156 ceph-mon[182000]: pgmap v79: 65 pgs: 4 active+undersized+degraded, 5 active+undersized, 56 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 13/342 objects degraded (3.801%) 2023-12-16T06:01:23.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:22 smithi155 ceph-mon[217407]: Health check update: Degraded data redundancy: 41/342 objects degraded (11.988%), 12 pgs degraded (PG_DEGRADED) 2023-12-16T06:01:23.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:22 smithi155 ceph-mon[217407]: pgmap v79: 65 pgs: 4 active+undersized+degraded, 5 active+undersized, 56 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 13/342 objects degraded (3.801%) 2023-12-16T06:01:24.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:24 smithi155 ceph-mon[217407]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/342 objects degraded (3.801%), 4 pgs degraded) 2023-12-16T06:01:24.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:24 smithi155 ceph-mon[217407]: Cluster is now healthy 2023-12-16T06:01:24.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:24 smithi156 ceph-mon[182000]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/342 objects degraded (3.801%), 4 pgs degraded) 2023-12-16T06:01:24.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:24 smithi156 ceph-mon[182000]: Cluster is now healthy 2023-12-16T06:01:25.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:25 smithi155 ceph-mon[217407]: pgmap v80: 65 pgs: 65 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:01:25.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:25 smithi156 ceph-mon[182000]: pgmap v80: 65 pgs: 65 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:01:27.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:27 smithi155 ceph-mon[217407]: pgmap v81: 65 pgs: 65 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-16T06:01:27.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:27 smithi156 ceph-mon[182000]: pgmap v81: 65 pgs: 65 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-16T06:01:29.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:29 smithi155 ceph-mon[217407]: pgmap v82: 65 pgs: 65 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2023-12-16T06:01:29.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:29 smithi156 ceph-mon[182000]: pgmap v82: 65 pgs: 65 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2023-12-16T06:01:31.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:31 smithi155 ceph-mon[217407]: pgmap v83: 65 pgs: 65 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-16T06:01:31.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:31 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:31.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:31 smithi156 ceph-mon[182000]: pgmap v83: 65 pgs: 65 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-16T06:01:31.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:31 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:33.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:32 smithi156 ceph-mon[182000]: pgmap v84: 65 pgs: 65 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-16T06:01:33.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:32 smithi155 ceph-mon[217407]: pgmap v84: 65 pgs: 65 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-16T06:01:35.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:35 smithi155 ceph-mon[217407]: pgmap v85: 65 pgs: 65 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:01:35.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:35 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:35.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:35 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:01:35.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:35 smithi156 ceph-mon[182000]: pgmap v85: 65 pgs: 65 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:01:35.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:35 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:35.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:35 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:01:36.346 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:36 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T06:01:36.346 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:36 smithi156 ceph-mon[182000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T06:01:36.346 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:36 smithi156 ceph-mon[182000]: Upgrade: osd.3 is safe to restart 2023-12-16T06:01:36.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:36 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T06:01:36.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:36 smithi155 ceph-mon[217407]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T06:01:36.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:36 smithi155 ceph-mon[217407]: Upgrade: osd.3 is safe to restart 2023-12-16T06:01:37.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:37 smithi155 ceph-mon[217407]: pgmap v86: 65 pgs: 65 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:01:37.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:37 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:37.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:37 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T06:01:37.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:37 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:01:37.585 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:37 smithi156 ceph-mon[182000]: pgmap v86: 65 pgs: 65 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:01:37.585 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:37 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:37.585 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:37 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T06:01:37.585 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:37 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:01:38.559 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:38 smithi156 ceph-mon[182000]: Upgrade: Updating osd.3 2023-12-16T06:01:38.560 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:38 smithi156 ceph-mon[182000]: Deploying daemon osd.3 on smithi156 2023-12-16T06:01:38.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:38 smithi155 ceph-mon[217407]: Upgrade: Updating osd.3 2023-12-16T06:01:38.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:38 smithi155 ceph-mon[217407]: Deploying daemon osd.3 on smithi156 2023-12-16T06:01:38.930 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:38 smithi156 systemd[1]: Stopping Ceph osd.3 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T06:01:38.930 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:38 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-3[127418]: 2023-12-16T06:01:38.747+0000 7ff0d07a6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T06:01:38.930 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:38 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-3[127418]: 2023-12-16T06:01:38.747+0000 7ff0d07a6700 -1 osd.3 62 *** Got signal Terminated *** 2023-12-16T06:01:38.930 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:38 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-3[127418]: 2023-12-16T06:01:38.747+0000 7ff0d07a6700 -1 osd.3 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T06:01:39.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:39 smithi155 ceph-mon[217407]: pgmap v87: 65 pgs: 65 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:01:39.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:39 smithi155 ceph-mon[217407]: osd.3 marked itself down and dead 2023-12-16T06:01:39.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:39 smithi156 ceph-mon[182000]: pgmap v87: 65 pgs: 65 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:01:39.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:39 smithi156 ceph-mon[182000]: osd.3 marked itself down and dead 2023-12-16T06:01:40.179 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:39 smithi156 bash[193169]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-3 2023-12-16T06:01:40.565 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:40 smithi156 ceph-mon[182000]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T06:01:40.566 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:40 smithi156 ceph-mon[182000]: failed to encode map e63 with expected crc 2023-12-16T06:01:40.566 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:40 smithi156 ceph-mon[182000]: osdmap e63: 6 total, 5 up, 6 in 2023-12-16T06:01:40.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:40 smithi155 ceph-mon[217407]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T06:01:40.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:40 smithi155 ceph-mon[217407]: failed to encode map e63 with expected crc 2023-12-16T06:01:40.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:40 smithi155 ceph-mon[217407]: osdmap e63: 6 total, 5 up, 6 in 2023-12-16T06:01:41.180 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:40 smithi156 systemd[1]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.3.service: Succeeded. 2023-12-16T06:01:41.180 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:40 smithi156 systemd[1]: Stopped Ceph osd.3 for d344784e-9bd6-11ee-95a5-87774f69a715. 2023-12-16T06:01:41.180 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:41 smithi156 systemd[1]: Starting Ceph osd.3 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T06:01:41.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:41 smithi155 ceph-mon[217407]: pgmap v89: 65 pgs: 16 stale+active+clean, 49 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-16T06:01:41.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:41 smithi155 ceph-mon[217407]: osdmap e64: 6 total, 5 up, 6 in 2023-12-16T06:01:41.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:41 smithi155 ceph-mon[217407]: failed to encode map e64 with expected crc 2023-12-16T06:01:41.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:41 smithi155 ceph-mon[217407]: failed to encode map e64 with expected crc 2023-12-16T06:01:41.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:41 smithi155 ceph-mon[217407]: failed to encode map e64 with expected crc 2023-12-16T06:01:41.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:41 smithi155 ceph-mon[217407]: failed to encode map e64 with expected crc 2023-12-16T06:01:41.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:41 smithi156 ceph-mon[182000]: pgmap v89: 65 pgs: 16 stale+active+clean, 49 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-16T06:01:41.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:41 smithi156 ceph-mon[182000]: osdmap e64: 6 total, 5 up, 6 in 2023-12-16T06:01:41.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:41 smithi156 ceph-mon[182000]: failed to encode map e64 with expected crc 2023-12-16T06:01:41.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:41 smithi156 ceph-mon[182000]: failed to encode map e64 with expected crc 2023-12-16T06:01:41.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:41 smithi156 ceph-mon[182000]: failed to encode map e64 with expected crc 2023-12-16T06:01:41.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:41 smithi156 ceph-mon[182000]: failed to encode map e64 with expected crc 2023-12-16T06:01:42.180 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:41 smithi156 bash[193435]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-16T06:01:42.180 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:41 smithi156 bash[193435]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-16T06:01:42.180 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:41 smithi156 bash[193435]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-16T06:01:42.180 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:41 smithi156 bash[193435]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-16T06:01:42.180 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:41 smithi156 bash[193435]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2023-12-16T06:01:42.180 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:41 smithi156 bash[193435]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-16T06:01:42.180 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:41 smithi156 bash[193435]: --> ceph-volume raw activate successful for osd ID: 3 2023-12-16T06:01:42.932 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:42 smithi156 ceph-osd[193725]: -- 172.21.15.156:0/2266901984 <== mon.1 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557dbc4676c0 con 0x557dbc437000 2023-12-16T06:01:42.933 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:42 smithi156 bash[193687]: 3a04979138d3b86654f699ed30b4522573499f440057a257852f7ec4f10c307e 2023-12-16T06:01:42.933 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:42 smithi156 systemd[1]: Started Ceph osd.3 for d344784e-9bd6-11ee-95a5-87774f69a715. 2023-12-16T06:01:43.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:42 smithi155 ceph-mon[217407]: pgmap v91: 65 pgs: 18 active+undersized+degraded, 1 stale+active+clean, 16 active+undersized, 30 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 66/342 objects degraded (19.298%) 2023-12-16T06:01:43.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:42 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:43.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:42 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:43.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:42 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:01:43.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:42 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:43.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:42 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:43.429 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:42 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-3[193702]: 2023-12-16T06:01:42.965+0000 7f3b29ad8640 -1 Falling back to public interface 2023-12-16T06:01:43.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:42 smithi156 ceph-mon[182000]: pgmap v91: 65 pgs: 18 active+undersized+degraded, 1 stale+active+clean, 16 active+undersized, 30 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 66/342 objects degraded (19.298%) 2023-12-16T06:01:43.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:42 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:43.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:42 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:43.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:42 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:01:43.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:42 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:43.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:42 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:44.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:43 smithi156 ceph-mon[182000]: Health check failed: Degraded data redundancy: 66/342 objects degraded (19.298%), 18 pgs degraded (PG_DEGRADED) 2023-12-16T06:01:44.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:43 smithi155 ceph-mon[217407]: Health check failed: Degraded data redundancy: 66/342 objects degraded (19.298%), 18 pgs degraded (PG_DEGRADED) 2023-12-16T06:01:45.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:44 smithi155 ceph-mon[217407]: pgmap v92: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 69/342 objects degraded (20.175%) 2023-12-16T06:01:45.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:45.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:45.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:44 smithi156 ceph-mon[182000]: pgmap v92: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 69/342 objects degraded (20.175%) 2023-12-16T06:01:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:46.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:46 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:46.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:46 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:46.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:46 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:46.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:46 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:47.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:47 smithi156 ceph-mon[182000]: pgmap v93: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 69/342 objects degraded (20.175%) 2023-12-16T06:01:47.680 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:47 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-3[193702]: 2023-12-16T06:01:47.577+0000 7f3b29ad8640 -1 osd.3 0 read_superblock omap replica is missing. 2023-12-16T06:01:47.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:47 smithi155 ceph-mon[217407]: pgmap v93: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 69/342 objects degraded (20.175%) 2023-12-16T06:01:48.429 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:48 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-3[193702]: 2023-12-16T06:01:48.149+0000 7f3b29ad8640 -1 osd.3 62 log_to_monitors true 2023-12-16T06:01:49.180 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:01:48 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-3[193702]: 2023-12-16T06:01:48.955+0000 7f3b19f47700 -1 osd.3 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T06:01:49.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:48 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:49.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:48 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:49.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:48 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:01:49.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:48 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T06:01:49.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:48 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:49.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:48 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:01:49.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:48 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:01:49.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:48 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:01:49.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:48 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:01:49.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:48 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T06:01:49.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:48 smithi156 ceph-mon[182000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T06:01:49.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:48 smithi156 ceph-mon[182000]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-12-16T06:01:49.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:48 smithi156 ceph-mon[182000]: from='osd.3 [v2:172.21.15.156:6800/915698953,v1:172.21.15.156:6801/915698953]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T06:01:49.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:48 smithi156 ceph-mon[182000]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T06:01:49.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:48 smithi156 ceph-mon[182000]: pgmap v94: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 69/342 objects degraded (20.175%) 2023-12-16T06:01:49.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:48 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:49.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:48 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:49.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:48 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:01:49.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:48 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T06:01:49.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:48 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:49.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:48 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:01:49.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:48 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:01:49.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:48 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:01:49.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:48 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:01:49.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:48 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T06:01:49.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:48 smithi155 ceph-mon[217407]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T06:01:49.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:48 smithi155 ceph-mon[217407]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-12-16T06:01:49.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:48 smithi155 ceph-mon[217407]: from='osd.3 [v2:172.21.15.156:6800/915698953,v1:172.21.15.156:6801/915698953]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T06:01:49.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:48 smithi155 ceph-mon[217407]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T06:01:49.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:48 smithi155 ceph-mon[217407]: pgmap v94: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 284 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 69/342 objects degraded (20.175%) 2023-12-16T06:01:50.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:49 smithi155 ceph-mon[217407]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-16T06:01:50.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:49 smithi155 ceph-mon[217407]: from='osd.3 [v2:172.21.15.156:6800/915698953,v1:172.21.15.156:6801/915698953]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T06:01:50.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:49 smithi155 ceph-mon[217407]: osdmap e65: 6 total, 5 up, 6 in 2023-12-16T06:01:50.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:49 smithi155 ceph-mon[217407]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T06:01:50.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:49 smithi155 ceph-mon[217407]: failed to encode map e65 with expected crc 2023-12-16T06:01:50.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:49 smithi156 ceph-mon[182000]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-16T06:01:50.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:49 smithi156 ceph-mon[182000]: from='osd.3 [v2:172.21.15.156:6800/915698953,v1:172.21.15.156:6801/915698953]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T06:01:50.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:49 smithi156 ceph-mon[182000]: osdmap e65: 6 total, 5 up, 6 in 2023-12-16T06:01:50.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:49 smithi156 ceph-mon[182000]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T06:01:50.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:49 smithi156 ceph-mon[182000]: failed to encode map e65 with expected crc 2023-12-16T06:01:51.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:50 smithi155 ceph-mon[217407]: failed to encode map e65 with expected crc 2023-12-16T06:01:51.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:50 smithi155 ceph-mon[217407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T06:01:51.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:50 smithi155 ceph-mon[217407]: failed to encode map e66 with expected crc 2023-12-16T06:01:51.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:50 smithi155 ceph-mon[217407]: osd.3 [v2:172.21.15.156:6800/915698953,v1:172.21.15.156:6801/915698953] boot 2023-12-16T06:01:51.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:50 smithi155 ceph-mon[217407]: osdmap e66: 6 total, 6 up, 6 in 2023-12-16T06:01:51.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:50 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T06:01:51.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:50 smithi155 ceph-mon[217407]: pgmap v97: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 69/342 objects degraded (20.175%) 2023-12-16T06:01:51.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:50 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:51.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:50 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:01:51.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:50 smithi156 ceph-mon[182000]: failed to encode map e65 with expected crc 2023-12-16T06:01:51.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:50 smithi156 ceph-mon[182000]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T06:01:51.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:50 smithi156 ceph-mon[182000]: failed to encode map e66 with expected crc 2023-12-16T06:01:51.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:50 smithi156 ceph-mon[182000]: osd.3 [v2:172.21.15.156:6800/915698953,v1:172.21.15.156:6801/915698953] boot 2023-12-16T06:01:51.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:50 smithi156 ceph-mon[182000]: osdmap e66: 6 total, 6 up, 6 in 2023-12-16T06:01:51.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:50 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T06:01:51.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:50 smithi156 ceph-mon[182000]: pgmap v97: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 69/342 objects degraded (20.175%) 2023-12-16T06:01:51.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:50 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:01:51.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:50 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:01:51.641 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.636+0000 7f9e13575700 1 -- 172.21.15.155:0/219954273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e0c0fbb40 msgr2=0x7f9e0c0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:51.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.636+0000 7f9e13575700 1 --2- 172.21.15.155:0/219954273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e0c0fbb40 0x7f9e0c0fbfb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9e08004940 tx=0x7f9e08009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:51.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.636+0000 7f9e13575700 1 -- 172.21.15.155:0/219954273 shutdown_connections 2023-12-16T06:01:51.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.636+0000 7f9e13575700 1 --2- 172.21.15.155:0/219954273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e0c0fbb40 0x7f9e0c0fbfb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:51.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.636+0000 7f9e13575700 1 --2- 172.21.15.155:0/219954273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e0c101b00 0x7f9e0c101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:51.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.636+0000 7f9e13575700 1 -- 172.21.15.155:0/219954273 >> 172.21.15.155:0/219954273 conn(0x7f9e0c0719b0 msgr2=0x7f9e0c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:51.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.636+0000 7f9e13575700 1 -- 172.21.15.155:0/219954273 shutdown_connections 2023-12-16T06:01:51.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.636+0000 7f9e13575700 1 -- 172.21.15.155:0/219954273 wait complete. 2023-12-16T06:01:51.642 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.637+0000 7f9e13575700 1 Processor -- start 2023-12-16T06:01:51.643 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.637+0000 7f9e13575700 1 -- start start 2023-12-16T06:01:51.643 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.637+0000 7f9e13575700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e0c0fbb40 0x7f9e0c112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:51.643 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.637+0000 7f9e13575700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e0c101b00 0x7f9e0c112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:51.643 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.637+0000 7f9e13575700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c1131d0 con 0x7f9e0c101b00 2023-12-16T06:01:51.643 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.637+0000 7f9e13575700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c10c4c0 con 0x7f9e0c0fbb40 2023-12-16T06:01:51.643 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.638+0000 7f9e10b10700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e0c101b00 0x7f9e0c112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:51.643 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.638+0000 7f9e10b10700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e0c101b00 0x7f9e0c112b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:47894/0 (socket says 172.21.15.155:47894) 2023-12-16T06:01:51.643 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.638+0000 7f9e10b10700 1 -- 172.21.15.155:0/1588847537 learned_addr learned my addr 172.21.15.155:0/1588847537 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:01:51.643 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.638+0000 7f9e11311700 1 --2- 172.21.15.155:0/1588847537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e0c0fbb40 0x7f9e0c112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:51.643 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.638+0000 7f9e10b10700 1 -- 172.21.15.155:0/1588847537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e0c0fbb40 msgr2=0x7f9e0c112640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:51.644 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.638+0000 7f9e10b10700 1 --2- 172.21.15.155:0/1588847537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e0c0fbb40 0x7f9e0c112640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:51.644 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.638+0000 7f9e10b10700 1 -- 172.21.15.155:0/1588847537 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e08005040 con 0x7f9e0c101b00 2023-12-16T06:01:51.644 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.638+0000 7f9e10b10700 1 --2- 172.21.15.155:0/1588847537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e0c101b00 0x7f9e0c112b80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9e0800b3b0 tx=0x7f9e08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:51.644 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.638+0000 7f9e01ffb700 1 -- 172.21.15.155:0/1588847537 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e0800e040 con 0x7f9e0c101b00 2023-12-16T06:01:51.644 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.638+0000 7f9e01ffb700 1 -- 172.21.15.155:0/1588847537 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9e0800bc50 con 0x7f9e0c101b00 2023-12-16T06:01:51.644 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.638+0000 7f9e13575700 1 -- 172.21.15.155:0/1588847537 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0c10c740 con 0x7f9e0c101b00 2023-12-16T06:01:51.644 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.638+0000 7f9e01ffb700 1 -- 172.21.15.155:0/1588847537 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e08013420 con 0x7f9e0c101b00 2023-12-16T06:01:51.645 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.638+0000 7f9e13575700 1 -- 172.21.15.155:0/1588847537 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0c10cc80 con 0x7f9e0c101b00 2023-12-16T06:01:51.646 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.639+0000 7f9e13575700 1 -- 172.21.15.155:0/1588847537 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0c1122d0 con 0x7f9e0c101b00 2023-12-16T06:01:51.646 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.640+0000 7f9e01ffb700 1 -- 172.21.15.155:0/1588847537 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f9e0801c430 con 0x7f9e0c101b00 2023-12-16T06:01:51.646 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.640+0000 7f9e01ffb700 1 --2- 172.21.15.155:0/1588847537 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f9df806ce60 0x7f9df806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:51.646 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.640+0000 7f9e01ffb700 1 -- 172.21.15.155:0/1588847537 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f9e0808d0c0 con 0x7f9e0c101b00 2023-12-16T06:01:51.646 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.640+0000 7f9e11311700 1 --2- 172.21.15.155:0/1588847537 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f9df806ce60 0x7f9df806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:51.646 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.641+0000 7f9e11311700 1 --2- 172.21.15.155:0/1588847537 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f9df806ce60 0x7f9df806f310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc007fd0 tx=0x7f9dfc009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:51.647 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.645+0000 7f9e01ffb700 1 -- 172.21.15.155:0/1588847537 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f9e0805ab10 con 0x7f9e0c101b00 2023-12-16T06:01:51.857 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.855+0000 7f9e13575700 1 -- 172.21.15.155:0/1588847537 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e0c04bb80 con 0x7f9df806ce60 2023-12-16T06:01:51.858 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.856+0000 7f9e01ffb700 1 -- 172.21.15.155:0/1588847537 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f9e0c04bb80 con 0x7f9df806ce60 2023-12-16T06:01:51.861 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.858+0000 7f9e13575700 1 -- 172.21.15.155:0/1588847537 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f9df806ce60 msgr2=0x7f9df806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:51.861 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.858+0000 7f9e13575700 1 --2- 172.21.15.155:0/1588847537 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f9df806ce60 0x7f9df806f310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc007fd0 tx=0x7f9dfc009040 comp rx=0 tx=0).stop 2023-12-16T06:01:51.861 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.858+0000 7f9e13575700 1 -- 172.21.15.155:0/1588847537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e0c101b00 msgr2=0x7f9e0c112b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:51.861 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.858+0000 7f9e13575700 1 --2- 172.21.15.155:0/1588847537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e0c101b00 0x7f9e0c112b80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9e0800b3b0 tx=0x7f9e08009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:51.861 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.858+0000 7f9e13575700 1 -- 172.21.15.155:0/1588847537 shutdown_connections 2023-12-16T06:01:51.861 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.858+0000 7f9e13575700 1 --2- 172.21.15.155:0/1588847537 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f9df806ce60 0x7f9df806f310 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:51.861 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.858+0000 7f9e13575700 1 --2- 172.21.15.155:0/1588847537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e0c0fbb40 0x7f9e0c112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:51.861 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.858+0000 7f9e13575700 1 --2- 172.21.15.155:0/1588847537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e0c101b00 0x7f9e0c112b80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:51.861 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.858+0000 7f9e13575700 1 -- 172.21.15.155:0/1588847537 >> 172.21.15.155:0/1588847537 conn(0x7f9e0c0719b0 msgr2=0x7f9e0c0fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:51.861 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.858+0000 7f9e13575700 1 -- 172.21.15.155:0/1588847537 shutdown_connections 2023-12-16T06:01:51.861 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.858+0000 7f9e13575700 1 -- 172.21.15.155:0/1588847537 wait complete. 2023-12-16T06:01:51.871 INFO:teuthology.orchestra.run.smithi155.stdout:true 2023-12-16T06:01:51.963 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.961+0000 7f3b5b842700 1 -- 172.21.15.155:0/2874817758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b54065390 msgr2=0x7f3b54065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:51.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.961+0000 7f3b5b842700 1 --2- 172.21.15.155:0/2874817758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b54065390 0x7f3b54065800 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3b44004940 tx=0x7f3b44009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:51.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.961+0000 7f3b5b842700 1 -- 172.21.15.155:0/2874817758 shutdown_connections 2023-12-16T06:01:51.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.961+0000 7f3b5b842700 1 --2- 172.21.15.155:0/2874817758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b54065390 0x7f3b54065800 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:51.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.961+0000 7f3b5b842700 1 --2- 172.21.15.155:0/2874817758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b54102c20 0x7f3b54102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:51.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.961+0000 7f3b5b842700 1 -- 172.21.15.155:0/2874817758 >> 172.21.15.155:0/2874817758 conn(0x7f3b540719b0 msgr2=0x7f3b54071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:51.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.961+0000 7f3b5b842700 1 -- 172.21.15.155:0/2874817758 shutdown_connections 2023-12-16T06:01:51.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.961+0000 7f3b5b842700 1 -- 172.21.15.155:0/2874817758 wait complete. 2023-12-16T06:01:51.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.961+0000 7f3b5b842700 1 Processor -- start 2023-12-16T06:01:51.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.961+0000 7f3b5b842700 1 -- start start 2023-12-16T06:01:51.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.962+0000 7f3b5b842700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b54065390 0x7f3b54113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:51.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.962+0000 7f3b5b842700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b54102c20 0x7f3b54113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:51.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.962+0000 7f3b5b842700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b541142c0 con 0x7f3b54065390 2023-12-16T06:01:51.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.962+0000 7f3b5b842700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5410d5f0 con 0x7f3b54102c20 2023-12-16T06:01:51.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.962+0000 7f3b595de700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b54065390 0x7f3b54113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:51.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.962+0000 7f3b595de700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b54065390 0x7f3b54113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:47916/0 (socket says 172.21.15.155:47916) 2023-12-16T06:01:51.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.962+0000 7f3b595de700 1 -- 172.21.15.155:0/2084273772 learned_addr learned my addr 172.21.15.155:0/2084273772 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:01:51.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.962+0000 7f3b58ddd700 1 --2- 172.21.15.155:0/2084273772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b54102c20 0x7f3b54113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:51.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.962+0000 7f3b595de700 1 -- 172.21.15.155:0/2084273772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b54102c20 msgr2=0x7f3b54113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:51.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.962+0000 7f3b595de700 1 --2- 172.21.15.155:0/2084273772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b54102c20 0x7f3b54113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:51.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.962+0000 7f3b595de700 1 -- 172.21.15.155:0/2084273772 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b44005040 con 0x7f3b54065390 2023-12-16T06:01:51.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.962+0000 7f3b595de700 1 --2- 172.21.15.155:0/2084273772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b54065390 0x7f3b54113730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3b50002a50 tx=0x7f3b500046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:51.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.963+0000 7f3b49ffb700 1 -- 172.21.15.155:0/2084273772 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b50007cc0 con 0x7f3b54065390 2023-12-16T06:01:51.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.963+0000 7f3b5b842700 1 -- 172.21.15.155:0/2084273772 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5410d8d0 con 0x7f3b54065390 2023-12-16T06:01:51.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.963+0000 7f3b49ffb700 1 -- 172.21.15.155:0/2084273772 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3b5000f040 con 0x7f3b54065390 2023-12-16T06:01:51.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.963+0000 7f3b49ffb700 1 -- 172.21.15.155:0/2084273772 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b5000d9c0 con 0x7f3b54065390 2023-12-16T06:01:51.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.963+0000 7f3b5b842700 1 -- 172.21.15.155:0/2084273772 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5410dde0 con 0x7f3b54065390 2023-12-16T06:01:51.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.964+0000 7f3b5b842700 1 -- 172.21.15.155:0/2084273772 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b540fff40 con 0x7f3b54065390 2023-12-16T06:01:51.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.965+0000 7f3b49ffb700 1 -- 172.21.15.155:0/2084273772 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f3b5000db20 con 0x7f3b54065390 2023-12-16T06:01:51.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.965+0000 7f3b49ffb700 1 --2- 172.21.15.155:0/2084273772 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f3b4006ce60 0x7f3b4006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:51.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.965+0000 7f3b49ffb700 1 -- 172.21.15.155:0/2084273772 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f3b5008c5f0 con 0x7f3b54065390 2023-12-16T06:01:51.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.965+0000 7f3b58ddd700 1 --2- 172.21.15.155:0/2084273772 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f3b4006ce60 0x7f3b4006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:51.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.965+0000 7f3b58ddd700 1 --2- 172.21.15.155:0/2084273772 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f3b4006ce60 0x7f3b4006f310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3b5410e920 tx=0x7f3b44009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:51.971 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:51.969+0000 7f3b49ffb700 1 -- 172.21.15.155:0/2084273772 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f3b5005a0e0 con 0x7f3b54065390 2023-12-16T06:01:52.182 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.179+0000 7f3b5b842700 1 -- 172.21.15.155:0/2084273772 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b5404bc20 con 0x7f3b4006ce60 2023-12-16T06:01:52.182 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.180+0000 7f3b49ffb700 1 -- 172.21.15.155:0/2084273772 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f3b440096f0 con 0x7f3b4006ce60 2023-12-16T06:01:52.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.182+0000 7f3b5b842700 1 -- 172.21.15.155:0/2084273772 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f3b4006ce60 msgr2=0x7f3b4006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:52.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.182+0000 7f3b5b842700 1 --2- 172.21.15.155:0/2084273772 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f3b4006ce60 0x7f3b4006f310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3b5410e920 tx=0x7f3b44009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:52.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.182+0000 7f3b5b842700 1 -- 172.21.15.155:0/2084273772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b54065390 msgr2=0x7f3b54113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:52.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.182+0000 7f3b5b842700 1 --2- 172.21.15.155:0/2084273772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b54065390 0x7f3b54113730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3b50002a50 tx=0x7f3b500046b0 comp rx=0 tx=0).stop 2023-12-16T06:01:52.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.182+0000 7f3b5b842700 1 -- 172.21.15.155:0/2084273772 shutdown_connections 2023-12-16T06:01:52.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.182+0000 7f3b5b842700 1 --2- 172.21.15.155:0/2084273772 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f3b4006ce60 0x7f3b4006f310 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:52.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.182+0000 7f3b5b842700 1 --2- 172.21.15.155:0/2084273772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b54065390 0x7f3b54113730 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:52.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.182+0000 7f3b5b842700 1 --2- 172.21.15.155:0/2084273772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b54102c20 0x7f3b54113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:52.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.182+0000 7f3b5b842700 1 -- 172.21.15.155:0/2084273772 >> 172.21.15.155:0/2084273772 conn(0x7f3b540719b0 msgr2=0x7f3b540fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:52.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.182+0000 7f3b5b842700 1 -- 172.21.15.155:0/2084273772 shutdown_connections 2023-12-16T06:01:52.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.182+0000 7f3b5b842700 1 -- 172.21.15.155:0/2084273772 wait complete. 2023-12-16T06:01:52.287 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.284+0000 7efd66beb700 1 -- 172.21.15.155:0/4258081934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd60103590 msgr2=0x7efd600fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:52.287 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.284+0000 7efd66beb700 1 --2- 172.21.15.155:0/4258081934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd60103590 0x7efd600fcc00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efd4c004940 tx=0x7efd4c009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:52.287 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.284+0000 7efd66beb700 1 -- 172.21.15.155:0/4258081934 shutdown_connections 2023-12-16T06:01:52.287 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.284+0000 7efd66beb700 1 --2- 172.21.15.155:0/4258081934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd60103590 0x7efd600fcc00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:52.287 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.284+0000 7efd66beb700 1 --2- 172.21.15.155:0/4258081934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd60102bf0 0x7efd60102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:52.287 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.284+0000 7efd66beb700 1 -- 172.21.15.155:0/4258081934 >> 172.21.15.155:0/4258081934 conn(0x7efd600f87a0 msgr2=0x7efd600fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:52.287 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.284+0000 7efd66beb700 1 -- 172.21.15.155:0/4258081934 shutdown_connections 2023-12-16T06:01:52.287 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.284+0000 7efd66beb700 1 -- 172.21.15.155:0/4258081934 wait complete. 2023-12-16T06:01:52.287 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.284+0000 7efd66beb700 1 Processor -- start 2023-12-16T06:01:52.288 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.284+0000 7efd66beb700 1 -- start start 2023-12-16T06:01:52.289 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.285+0000 7efd66beb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd60102bf0 0x7efd6006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:52.289 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.285+0000 7efd66beb700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd60103590 0x7efd60070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:52.289 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.285+0000 7efd66beb700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd60070a80 con 0x7efd60103590 2023-12-16T06:01:52.289 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.285+0000 7efd66beb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd60070bf0 con 0x7efd60102bf0 2023-12-16T06:01:52.289 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.285+0000 7efd5ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd60103590 0x7efd60070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:52.289 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.285+0000 7efd5ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd60103590 0x7efd60070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:47936/0 (socket says 172.21.15.155:47936) 2023-12-16T06:01:52.289 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.285+0000 7efd5ffff700 1 -- 172.21.15.155:0/1396935795 learned_addr learned my addr 172.21.15.155:0/1396935795 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:01:52.289 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.285+0000 7efd64987700 1 --2- 172.21.15.155:0/1396935795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd60102bf0 0x7efd6006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:52.290 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.285+0000 7efd5ffff700 1 -- 172.21.15.155:0/1396935795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd60102bf0 msgr2=0x7efd6006ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:52.290 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.285+0000 7efd5ffff700 1 --2- 172.21.15.155:0/1396935795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd60102bf0 0x7efd6006ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:52.290 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.285+0000 7efd5ffff700 1 -- 172.21.15.155:0/1396935795 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c005040 con 0x7efd60103590 2023-12-16T06:01:52.290 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.285+0000 7efd5ffff700 1 --2- 172.21.15.155:0/1396935795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd60103590 0x7efd60070480 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efd4c009180 tx=0x7efd4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:52.290 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.285+0000 7efd5d7fa700 1 -- 172.21.15.155:0/1396935795 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd4c00e040 con 0x7efd60103590 2023-12-16T06:01:52.290 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.286+0000 7efd5d7fa700 1 -- 172.21.15.155:0/1396935795 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efd4c004290 con 0x7efd60103590 2023-12-16T06:01:52.290 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.286+0000 7efd66beb700 1 -- 172.21.15.155:0/1396935795 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd60119860 con 0x7efd60103590 2023-12-16T06:01:52.290 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.286+0000 7efd5d7fa700 1 -- 172.21.15.155:0/1396935795 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd4c01c3f0 con 0x7efd60103590 2023-12-16T06:01:52.290 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.286+0000 7efd66beb700 1 -- 172.21.15.155:0/1396935795 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd60119cc0 con 0x7efd60103590 2023-12-16T06:01:52.290 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.287+0000 7efd66beb700 1 -- 172.21.15.155:0/1396935795 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd601050c0 con 0x7efd60103590 2023-12-16T06:01:52.291 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.287+0000 7efd5d7fa700 1 -- 172.21.15.155:0/1396935795 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7efd4c013770 con 0x7efd60103590 2023-12-16T06:01:52.291 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.287+0000 7efd5d7fa700 1 --2- 172.21.15.155:0/1396935795 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7efd5006ce70 0x7efd5006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:52.291 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.287+0000 7efd5d7fa700 1 -- 172.21.15.155:0/1396935795 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6328+0+0 (secure 0 0 0) 0x7efd4c08d530 con 0x7efd60103590 2023-12-16T06:01:52.291 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.288+0000 7efd64987700 1 --2- 172.21.15.155:0/1396935795 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7efd5006ce70 0x7efd5006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:52.291 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.288+0000 7efd64987700 1 --2- 172.21.15.155:0/1396935795 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7efd5006ce70 0x7efd5006f320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd54004f40 tx=0x7efd5400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:52.294 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.293+0000 7efd5d7fa700 1 -- 172.21.15.155:0/1396935795 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7efd4c057590 con 0x7efd60103590 2023-12-16T06:01:52.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:51 smithi155 ceph-mon[217407]: failed to encode map e67 with expected crc 2023-12-16T06:01:52.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:51 smithi155 ceph-mon[217407]: osdmap e67: 6 total, 6 up, 6 in 2023-12-16T06:01:52.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:51 smithi155 ceph-mon[217407]: failed to encode map e67 with expected crc 2023-12-16T06:01:52.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:51 smithi155 ceph-mon[217407]: failed to encode map e67 with expected crc 2023-12-16T06:01:52.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:51 smithi155 ceph-mon[217407]: failed to encode map e67 with expected crc 2023-12-16T06:01:52.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:51 smithi155 ceph-mon[217407]: failed to encode map e67 with expected crc 2023-12-16T06:01:52.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:51 smithi155 ceph-mon[217407]: failed to encode map e67 with expected crc 2023-12-16T06:01:52.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:51 smithi155 ceph-mon[217407]: Health check update: Degraded data redundancy: 69/342 objects degraded (20.175%), 19 pgs degraded (PG_DEGRADED) 2023-12-16T06:01:52.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:51 smithi156 ceph-mon[182000]: failed to encode map e67 with expected crc 2023-12-16T06:01:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:51 smithi156 ceph-mon[182000]: osdmap e67: 6 total, 6 up, 6 in 2023-12-16T06:01:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:51 smithi156 ceph-mon[182000]: failed to encode map e67 with expected crc 2023-12-16T06:01:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:51 smithi156 ceph-mon[182000]: failed to encode map e67 with expected crc 2023-12-16T06:01:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:51 smithi156 ceph-mon[182000]: failed to encode map e67 with expected crc 2023-12-16T06:01:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:51 smithi156 ceph-mon[182000]: failed to encode map e67 with expected crc 2023-12-16T06:01:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:51 smithi156 ceph-mon[182000]: failed to encode map e67 with expected crc 2023-12-16T06:01:52.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:51 smithi156 ceph-mon[182000]: Health check update: Degraded data redundancy: 69/342 objects degraded (20.175%), 19 pgs degraded (PG_DEGRADED) 2023-12-16T06:01:52.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.495+0000 7efd66beb700 1 -- 172.21.15.155:0/1396935795 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efd60071680 con 0x7efd5006ce70 2023-12-16T06:01:52.507 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.504+0000 7efd5d7fa700 1 -- 172.21.15.155:0/1396935795 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7efd60071680 con 0x7efd5006ce70 2023-12-16T06:01:52.507 INFO:teuthology.orchestra.run.smithi155.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T06:01:52.507 INFO:teuthology.orchestra.run.smithi155.stdout:alertmanager.smithi155 smithi155 *:9093,9094 running (3m) 35s ago 11m 29.5M - 0.25.0 c8568f914cd2 e1da85d6fc09 2023-12-16T06:01:52.507 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi155 smithi155 running (114s) 35s ago 11m 7470k - 19.0.0-191-g6d933094 a29c258b5d6f 6599d6adc8fa 2023-12-16T06:01:52.507 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi156 smithi156 running (111s) 7s ago 10m 7448k - 19.0.0-191-g6d933094 a29c258b5d6f 8129878ae56e 2023-12-16T06:01:52.507 INFO:teuthology.orchestra.run.smithi155.stdout:grafana.smithi155 smithi155 *:3000 running (3m) 35s ago 10m 83.3M - 9.4.12 a0ea5e3c46d9 a16c84704784 2023-12-16T06:01:52.508 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.bzsxjw smithi155 running (7m) 35s ago 7m 4746M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6bcabf94a5c3 2023-12-16T06:01:52.508 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.vicpis smithi155 running (7m) 35s ago 7m 669M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 afa64e1ef8da 2023-12-16T06:01:52.508 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.fasing smithi156 running (7m) 7s ago 7m 539M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 7d97160bda7c 2023-12-16T06:01:52.508 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.qvgmfj smithi156 running (7m) 7s ago 7m 5969M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4018b2f2e27e 2023-12-16T06:01:52.508 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi155.maowdn smithi155 *:8443,9283,8765 running (4m) 35s ago 12m 513M - 19.0.0-191-g6d933094 a29c258b5d6f ee39089d18d3 2023-12-16T06:01:52.508 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi156.pclong smithi156 *:8443,9283,8765 running (4m) 7s ago 10m 448M - 19.0.0-191-g6d933094 a29c258b5d6f 673376e357e8 2023-12-16T06:01:52.508 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi155 smithi155 running (2m) 35s ago 12m 67.4M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 19eb23d9f064 2023-12-16T06:01:52.508 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi156 smithi156 running (2m) 7s ago 10m 55.9M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 62dacb4d7a17 2023-12-16T06:01:52.508 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi155 smithi155 *:9100 running (4m) 35s ago 11m 15.7M - 1.5.0 0da6a335fe13 6f0f1f68f191 2023-12-16T06:01:52.508 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi156 smithi156 *:9100 running (3m) 7s ago 10m 18.6M - 1.5.0 0da6a335fe13 c4595a7b1707 2023-12-16T06:01:52.508 INFO:teuthology.orchestra.run.smithi155.stdout:osd.0 smithi155 running (97s) 35s ago 9m 122M 1568M 19.0.0-191-g6d933094 a29c258b5d6f f5b1d720ac4f 2023-12-16T06:01:52.508 INFO:teuthology.orchestra.run.smithi155.stdout:osd.1 smithi155 running (68s) 35s ago 9m 125M 1568M 19.0.0-191-g6d933094 a29c258b5d6f badaf737af87 2023-12-16T06:01:52.508 INFO:teuthology.orchestra.run.smithi155.stdout:osd.2 smithi155 running (39s) 35s ago 9m 12.6M 1568M 19.0.0-191-g6d933094 a29c258b5d6f 9a08b6ae1253 2023-12-16T06:01:52.508 INFO:teuthology.orchestra.run.smithi155.stdout:osd.3 smithi156 running (10s) 7s ago 8m 13.6M 2592M 19.0.0-191-g6d933094 a29c258b5d6f 3a04979138d3 2023-12-16T06:01:52.509 INFO:teuthology.orchestra.run.smithi155.stdout:osd.4 smithi156 running (8m) 7s ago 8m 762M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 6309b12204fd 2023-12-16T06:01:52.509 INFO:teuthology.orchestra.run.smithi155.stdout:osd.5 smithi156 running (8m) 7s ago 8m 876M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 84b2c33eb0e1 2023-12-16T06:01:52.509 INFO:teuthology.orchestra.run.smithi155.stdout:prometheus.smithi155 smithi155 *:9095 running (3m) 35s ago 10m 66.6M - 2.43.0 a07b618ecd1d 26bb7cfc1b8b 2023-12-16T06:01:52.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.507+0000 7efd66beb700 1 -- 172.21.15.155:0/1396935795 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7efd5006ce70 msgr2=0x7efd5006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:52.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.507+0000 7efd66beb700 1 --2- 172.21.15.155:0/1396935795 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7efd5006ce70 0x7efd5006f320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd54004f40 tx=0x7efd5400b040 comp rx=0 tx=0).stop 2023-12-16T06:01:52.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.507+0000 7efd66beb700 1 -- 172.21.15.155:0/1396935795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd60103590 msgr2=0x7efd60070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:52.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.507+0000 7efd66beb700 1 --2- 172.21.15.155:0/1396935795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd60103590 0x7efd60070480 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efd4c009180 tx=0x7efd4c009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:52.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.507+0000 7efd66beb700 1 -- 172.21.15.155:0/1396935795 shutdown_connections 2023-12-16T06:01:52.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.507+0000 7efd66beb700 1 --2- 172.21.15.155:0/1396935795 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7efd5006ce70 0x7efd5006f320 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:52.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.507+0000 7efd66beb700 1 --2- 172.21.15.155:0/1396935795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd60102bf0 0x7efd6006ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:52.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.507+0000 7efd66beb700 1 --2- 172.21.15.155:0/1396935795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd60103590 0x7efd60070480 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:52.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.507+0000 7efd66beb700 1 -- 172.21.15.155:0/1396935795 >> 172.21.15.155:0/1396935795 conn(0x7efd600f87a0 msgr2=0x7efd600fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:52.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.507+0000 7efd66beb700 1 -- 172.21.15.155:0/1396935795 shutdown_connections 2023-12-16T06:01:52.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.507+0000 7efd66beb700 1 -- 172.21.15.155:0/1396935795 wait complete. 2023-12-16T06:01:52.611 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.608+0000 7f73bb435700 1 -- 172.21.15.155:0/235303407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73b40fbb40 msgr2=0x7f73b40fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:52.611 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.608+0000 7f73bb435700 1 --2- 172.21.15.155:0/235303407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73b40fbb40 0x7f73b40fbfb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f73a4004940 tx=0x7f73a4009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:52.611 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.608+0000 7f73bb435700 1 -- 172.21.15.155:0/235303407 shutdown_connections 2023-12-16T06:01:52.611 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.608+0000 7f73bb435700 1 --2- 172.21.15.155:0/235303407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73b40fbb40 0x7f73b40fbfb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:52.611 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.608+0000 7f73bb435700 1 --2- 172.21.15.155:0/235303407 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73b4101b00 0x7f73b4101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:52.612 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.608+0000 7f73bb435700 1 -- 172.21.15.155:0/235303407 >> 172.21.15.155:0/235303407 conn(0x7f73b40719b0 msgr2=0x7f73b4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:52.612 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.609+0000 7f73bb435700 1 -- 172.21.15.155:0/235303407 shutdown_connections 2023-12-16T06:01:52.612 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.609+0000 7f73bb435700 1 -- 172.21.15.155:0/235303407 wait complete. 2023-12-16T06:01:52.613 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.609+0000 7f73bb435700 1 Processor -- start 2023-12-16T06:01:52.613 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.609+0000 7f73bb435700 1 -- start start 2023-12-16T06:01:52.613 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.609+0000 7f73bb435700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73b40fbb40 0x7f73b41136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:52.613 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.609+0000 7f73bb435700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73b4101b00 0x7f73b4113c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:52.613 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.609+0000 7f73bb435700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b4114290 con 0x7f73b40fbb40 2023-12-16T06:01:52.614 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.609+0000 7f73bb435700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b410d580 con 0x7f73b4101b00 2023-12-16T06:01:52.614 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.610+0000 7f73b91d1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73b40fbb40 0x7f73b41136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:52.614 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.610+0000 7f73b91d1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73b40fbb40 0x7f73b41136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:47948/0 (socket says 172.21.15.155:47948) 2023-12-16T06:01:52.614 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.610+0000 7f73b91d1700 1 -- 172.21.15.155:0/2895163364 learned_addr learned my addr 172.21.15.155:0/2895163364 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:01:52.614 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.610+0000 7f73b91d1700 1 -- 172.21.15.155:0/2895163364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73b4101b00 msgr2=0x7f73b4113c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:52.614 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.610+0000 7f73b91d1700 1 --2- 172.21.15.155:0/2895163364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73b4101b00 0x7f73b4113c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:52.614 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.610+0000 7f73b91d1700 1 -- 172.21.15.155:0/2895163364 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a4005040 con 0x7f73b40fbb40 2023-12-16T06:01:52.614 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.610+0000 7f73b91d1700 1 --2- 172.21.15.155:0/2895163364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73b40fbb40 0x7f73b41136c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f73b000c8c0 tx=0x7f73b00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:52.614 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.610+0000 7f73a9ffb700 1 -- 172.21.15.155:0/2895163364 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73b000a980 con 0x7f73b40fbb40 2023-12-16T06:01:52.614 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.610+0000 7f73a9ffb700 1 -- 172.21.15.155:0/2895163364 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f73b000ce60 con 0x7f73b40fbb40 2023-12-16T06:01:52.614 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.610+0000 7f73bb435700 1 -- 172.21.15.155:0/2895163364 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b410d810 con 0x7f73b40fbb40 2023-12-16T06:01:52.614 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.610+0000 7f73a9ffb700 1 -- 172.21.15.155:0/2895163364 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73b00113a0 con 0x7f73b40fbb40 2023-12-16T06:01:52.614 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.610+0000 7f73bb435700 1 -- 172.21.15.155:0/2895163364 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b410dd50 con 0x7f73b40fbb40 2023-12-16T06:01:52.615 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.611+0000 7f73bb435700 1 -- 172.21.15.155:0/2895163364 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b40734d0 con 0x7f73b40fbb40 2023-12-16T06:01:52.615 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.612+0000 7f73a9ffb700 1 -- 172.21.15.155:0/2895163364 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f73b0012400 con 0x7f73b40fbb40 2023-12-16T06:01:52.615 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.612+0000 7f73a9ffb700 1 --2- 172.21.15.155:0/2895163364 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f73a006ce60 0x7f73a006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:52.615 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.612+0000 7f73a9ffb700 1 -- 172.21.15.155:0/2895163364 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f73b008c390 con 0x7f73b40fbb40 2023-12-16T06:01:52.615 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.612+0000 7f73b89d0700 1 --2- 172.21.15.155:0/2895163364 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f73a006ce60 0x7f73a006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:52.616 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.613+0000 7f73b89d0700 1 --2- 172.21.15.155:0/2895163364 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f73a006ce60 0x7f73a006f310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f73a4004f90 tx=0x7f73a4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:52.619 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.617+0000 7f73a9ffb700 1 -- 172.21.15.155:0/2895163364 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f73b0059dd0 con 0x7f73b40fbb40 2023-12-16T06:01:52.895 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.892+0000 7f73bb435700 1 -- 172.21.15.155:0/2895163364 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f73b410ed40 con 0x7f73b40fbb40 2023-12-16T06:01:52.895 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.893+0000 7f73a9ffb700 1 -- 172.21.15.155:0/2895163364 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7f73b0059960 con 0x7f73b40fbb40 2023-12-16T06:01:52.895 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T06:01:52.896 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": { 2023-12-16T06:01:52.896 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T06:01:52.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:01:52.896 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": { 2023-12-16T06:01:52.896 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T06:01:52.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:01:52.896 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": { 2023-12-16T06:01:52.896 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2, 2023-12-16T06:01:52.896 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 4 2023-12-16T06:01:52.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:01:52.896 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2023-12-16T06:01:52.896 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T06:01:52.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:01:52.896 INFO:teuthology.orchestra.run.smithi155.stdout: "overall": { 2023-12-16T06:01:52.897 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6, 2023-12-16T06:01:52.897 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 8 2023-12-16T06:01:52.897 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-12-16T06:01:52.897 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T06:01:52.897 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.895+0000 7f73bb435700 1 -- 172.21.15.155:0/2895163364 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f73a006ce60 msgr2=0x7f73a006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:52.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.895+0000 7f73bb435700 1 --2- 172.21.15.155:0/2895163364 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f73a006ce60 0x7f73a006f310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f73a4004f90 tx=0x7f73a4009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:52.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.895+0000 7f73bb435700 1 -- 172.21.15.155:0/2895163364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73b40fbb40 msgr2=0x7f73b41136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:52.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.895+0000 7f73bb435700 1 --2- 172.21.15.155:0/2895163364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73b40fbb40 0x7f73b41136c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f73b000c8c0 tx=0x7f73b00044c0 comp rx=0 tx=0).stop 2023-12-16T06:01:52.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.895+0000 7f73bb435700 1 -- 172.21.15.155:0/2895163364 shutdown_connections 2023-12-16T06:01:52.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.895+0000 7f73bb435700 1 --2- 172.21.15.155:0/2895163364 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f73a006ce60 0x7f73a006f310 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:52.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.895+0000 7f73bb435700 1 --2- 172.21.15.155:0/2895163364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73b40fbb40 0x7f73b41136c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:52.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.895+0000 7f73bb435700 1 --2- 172.21.15.155:0/2895163364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73b4101b00 0x7f73b4113c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:52.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.895+0000 7f73bb435700 1 -- 172.21.15.155:0/2895163364 >> 172.21.15.155:0/2895163364 conn(0x7f73b40719b0 msgr2=0x7f73b40654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:52.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.895+0000 7f73bb435700 1 -- 172.21.15.155:0/2895163364 shutdown_connections 2023-12-16T06:01:52.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.895+0000 7f73bb435700 1 -- 172.21.15.155:0/2895163364 wait complete. 2023-12-16T06:01:53.001 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.997+0000 7f8ea13d4700 1 -- 172.21.15.155:0/1684821775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e9c102c00 msgr2=0x7f8e9c102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:53.001 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.997+0000 7f8ea13d4700 1 --2- 172.21.15.155:0/1684821775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e9c102c00 0x7f8e9c102fd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8e90004940 tx=0x7f8e90009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:53.001 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.997+0000 7f8ea13d4700 1 -- 172.21.15.155:0/1684821775 shutdown_connections 2023-12-16T06:01:53.001 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.998+0000 7f8ea13d4700 1 --2- 172.21.15.155:0/1684821775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e9c1035a0 0x7f8e9c0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:53.001 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.998+0000 7f8ea13d4700 1 --2- 172.21.15.155:0/1684821775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e9c102c00 0x7f8e9c102fd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:53.001 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.998+0000 7f8ea13d4700 1 -- 172.21.15.155:0/1684821775 >> 172.21.15.155:0/1684821775 conn(0x7f8e9c0f8770 msgr2=0x7f8e9c0fab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:53.001 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.998+0000 7f8ea13d4700 1 -- 172.21.15.155:0/1684821775 shutdown_connections 2023-12-16T06:01:53.001 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.998+0000 7f8ea13d4700 1 -- 172.21.15.155:0/1684821775 wait complete. 2023-12-16T06:01:53.001 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.998+0000 7f8ea13d4700 1 Processor -- start 2023-12-16T06:01:53.001 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.998+0000 7f8ea13d4700 1 -- start start 2023-12-16T06:01:53.003 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.998+0000 7f8ea13d4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e9c102c00 0x7f8e9c1136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:53.003 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.998+0000 7f8ea13d4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e9c1035a0 0x7f8e9c113c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:53.003 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.998+0000 7f8ea13d4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c1142f0 con 0x7f8e9c102c00 2023-12-16T06:01:53.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.998+0000 7f8ea13d4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c10d5b0 con 0x7f8e9c1035a0 2023-12-16T06:01:53.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.999+0000 7f8e9affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e9c102c00 0x7f8e9c1136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:53.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.999+0000 7f8e9affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e9c102c00 0x7f8e9c1136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:47976/0 (socket says 172.21.15.155:47976) 2023-12-16T06:01:53.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.999+0000 7f8e9affd700 1 -- 172.21.15.155:0/3878361806 learned_addr learned my addr 172.21.15.155:0/3878361806 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:01:53.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.999+0000 7f8e9a7fc700 1 --2- 172.21.15.155:0/3878361806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e9c1035a0 0x7f8e9c113c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:53.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.999+0000 7f8e9affd700 1 -- 172.21.15.155:0/3878361806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e9c1035a0 msgr2=0x7f8e9c113c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:53.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.999+0000 7f8e9affd700 1 --2- 172.21.15.155:0/3878361806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e9c1035a0 0x7f8e9c113c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:53.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.999+0000 7f8e9affd700 1 -- 172.21.15.155:0/3878361806 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e90005040 con 0x7f8e9c102c00 2023-12-16T06:01:53.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.999+0000 7f8e9affd700 1 --2- 172.21.15.155:0/3878361806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e9c102c00 0x7f8e9c1136d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009fd0 tx=0x7f8e90009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:53.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.999+0000 7f8e837fe700 1 -- 172.21.15.155:0/3878361806 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e9000e040 con 0x7f8e9c102c00 2023-12-16T06:01:53.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.999+0000 7f8e837fe700 1 -- 172.21.15.155:0/3878361806 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e90013420 con 0x7f8e9c102c00 2023-12-16T06:01:53.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.999+0000 7f8ea13d4700 1 -- 172.21.15.155:0/3878361806 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9c10d830 con 0x7f8e9c102c00 2023-12-16T06:01:53.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.999+0000 7f8e837fe700 1 -- 172.21.15.155:0/3878361806 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e9001c630 con 0x7f8e9c102c00 2023-12-16T06:01:53.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:52.999+0000 7f8ea13d4700 1 -- 172.21.15.155:0/3878361806 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9c10dd70 con 0x7f8e9c102c00 2023-12-16T06:01:53.005 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.000+0000 7f8ea13d4700 1 -- 172.21.15.155:0/3878361806 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9c0fff10 con 0x7f8e9c102c00 2023-12-16T06:01:53.005 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.001+0000 7f8e837fe700 1 -- 172.21.15.155:0/3878361806 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f8e9000bb80 con 0x7f8e9c102c00 2023-12-16T06:01:53.005 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.001+0000 7f8e837fe700 1 --2- 172.21.15.155:0/3878361806 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f8e8406ce70 0x7f8e8406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:53.005 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.001+0000 7f8e837fe700 1 -- 172.21.15.155:0/3878361806 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f8e9008d510 con 0x7f8e9c102c00 2023-12-16T06:01:53.005 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.001+0000 7f8e9a7fc700 1 --2- 172.21.15.155:0/3878361806 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f8e8406ce70 0x7f8e8406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:53.005 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.002+0000 7f8e9a7fc700 1 --2- 172.21.15.155:0/3878361806 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f8e8406ce70 0x7f8e8406f320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c10efb0 tx=0x7f8e8c0091a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:53.008 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.007+0000 7f8e837fe700 1 -- 172.21.15.155:0/3878361806 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f8e9005af50 con 0x7f8e9c102c00 2023-12-16T06:01:53.245 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.242+0000 7f8ea13d4700 1 -- 172.21.15.155:0/3878361806 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8e9c0fc390 con 0x7f8e9c102c00 2023-12-16T06:01:53.245 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.243+0000 7f8e837fe700 1 -- 172.21.15.155:0/3878361806 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1873 (secure 0 0 0) 0x7f8e9005aae0 con 0x7f8e9c102c00 2023-12-16T06:01:53.246 INFO:teuthology.orchestra.run.smithi155.stdout:e18 2023-12-16T06:01:53.246 INFO:teuthology.orchestra.run.smithi155.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T06:01:53.246 INFO:teuthology.orchestra.run.smithi155.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T06:01:53.246 INFO:teuthology.orchestra.run.smithi155.stdout:legacy client fscid: 1 2023-12-16T06:01:53.246 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T06:01:53.246 INFO:teuthology.orchestra.run.smithi155.stdout:Filesystem 'cephfs' (1) 2023-12-16T06:01:53.246 INFO:teuthology.orchestra.run.smithi155.stdout:fs_name cephfs 2023-12-16T06:01:53.246 INFO:teuthology.orchestra.run.smithi155.stdout:epoch 18 2023-12-16T06:01:53.246 INFO:teuthology.orchestra.run.smithi155.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-16T06:01:53.246 INFO:teuthology.orchestra.run.smithi155.stdout:created 2023-12-16T05:54:25.897091+0000 2023-12-16T06:01:53.246 INFO:teuthology.orchestra.run.smithi155.stdout:modified 2023-12-16T06:00:59.697972+0000 2023-12-16T06:01:53.246 INFO:teuthology.orchestra.run.smithi155.stdout:tableserver 0 2023-12-16T06:01:53.246 INFO:teuthology.orchestra.run.smithi155.stdout:root 0 2023-12-16T06:01:53.246 INFO:teuthology.orchestra.run.smithi155.stdout:session_timeout 60 2023-12-16T06:01:53.247 INFO:teuthology.orchestra.run.smithi155.stdout:session_autoclose 300 2023-12-16T06:01:53.247 INFO:teuthology.orchestra.run.smithi155.stdout:max_file_size 1099511627776 2023-12-16T06:01:53.247 INFO:teuthology.orchestra.run.smithi155.stdout:max_xattr_size 65536 2023-12-16T06:01:53.247 INFO:teuthology.orchestra.run.smithi155.stdout:required_client_features {} 2023-12-16T06:01:53.247 INFO:teuthology.orchestra.run.smithi155.stdout:last_failure 0 2023-12-16T06:01:53.247 INFO:teuthology.orchestra.run.smithi155.stdout:last_failure_osd_epoch 0 2023-12-16T06:01:53.247 INFO:teuthology.orchestra.run.smithi155.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T06:01:53.247 INFO:teuthology.orchestra.run.smithi155.stdout:max_mds 2 2023-12-16T06:01:53.247 INFO:teuthology.orchestra.run.smithi155.stdout:in 0,1 2023-12-16T06:01:53.247 INFO:teuthology.orchestra.run.smithi155.stdout:up {0=14456,1=24281} 2023-12-16T06:01:53.247 INFO:teuthology.orchestra.run.smithi155.stdout:failed 2023-12-16T06:01:53.247 INFO:teuthology.orchestra.run.smithi155.stdout:damaged 2023-12-16T06:01:53.247 INFO:teuthology.orchestra.run.smithi155.stdout:stopped 2023-12-16T06:01:53.247 INFO:teuthology.orchestra.run.smithi155.stdout:data_pools [3] 2023-12-16T06:01:53.247 INFO:teuthology.orchestra.run.smithi155.stdout:metadata_pool 2 2023-12-16T06:01:53.248 INFO:teuthology.orchestra.run.smithi155.stdout:inline_data disabled 2023-12-16T06:01:53.248 INFO:teuthology.orchestra.run.smithi155.stdout:balancer 2023-12-16T06:01:53.248 INFO:teuthology.orchestra.run.smithi155.stdout:bal_rank_mask -1 2023-12-16T06:01:53.248 INFO:teuthology.orchestra.run.smithi155.stdout:standby_count_wanted 1 2023-12-16T06:01:53.248 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi155.bzsxjw{0:14456} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.155:6826/1416140807,v1:172.21.15.155:6827/1416140807] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T06:01:53.248 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi156.fasing{0:24289} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1763385284,v1:172.21.15.156:6827/1763385284] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T06:01:53.248 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi156.qvgmfj{1:24281} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.156:6824/2823725296,v1:172.21.15.156:6825/2823725296] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T06:01:53.248 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi155.vicpis{1:14472} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.155:6828/750006619,v1:172.21.15.155:6829/750006619] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T06:01:53.248 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T06:01:53.248 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T06:01:53.249 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.245+0000 7f8ea13d4700 1 -- 172.21.15.155:0/3878361806 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f8e8406ce70 msgr2=0x7f8e8406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:53.249 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.245+0000 7f8ea13d4700 1 --2- 172.21.15.155:0/3878361806 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f8e8406ce70 0x7f8e8406f320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c10efb0 tx=0x7f8e8c0091a0 comp rx=0 tx=0).stop 2023-12-16T06:01:53.249 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.245+0000 7f8ea13d4700 1 -- 172.21.15.155:0/3878361806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e9c102c00 msgr2=0x7f8e9c1136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:53.249 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.245+0000 7f8ea13d4700 1 --2- 172.21.15.155:0/3878361806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e9c102c00 0x7f8e9c1136d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009fd0 tx=0x7f8e90009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:53.249 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.245+0000 7f8ea13d4700 1 -- 172.21.15.155:0/3878361806 shutdown_connections 2023-12-16T06:01:53.249 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.245+0000 7f8ea13d4700 1 --2- 172.21.15.155:0/3878361806 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f8e8406ce70 0x7f8e8406f320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:53.249 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.245+0000 7f8ea13d4700 1 --2- 172.21.15.155:0/3878361806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e9c102c00 0x7f8e9c1136d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:53.249 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.245+0000 7f8ea13d4700 1 --2- 172.21.15.155:0/3878361806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e9c1035a0 0x7f8e9c113c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:53.250 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.245+0000 7f8ea13d4700 1 -- 172.21.15.155:0/3878361806 >> 172.21.15.155:0/3878361806 conn(0x7f8e9c0f8770 msgr2=0x7f8e9c0fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:53.250 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.245+0000 7f8ea13d4700 1 -- 172.21.15.155:0/3878361806 shutdown_connections 2023-12-16T06:01:53.250 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.245+0000 7f8ea13d4700 1 -- 172.21.15.155:0/3878361806 wait complete. 2023-12-16T06:01:53.250 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 18 2023-12-16T06:01:53.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:52 smithi155 ceph-mon[217407]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:01:53.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:52 smithi155 ceph-mon[217407]: pgmap v99: 65 pgs: 7 peering, 11 active+undersized+degraded, 8 active+undersized, 39 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 45/342 objects degraded (13.158%) 2023-12-16T06:01:53.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:52 smithi155 ceph-mon[217407]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:01:53.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:52 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/2895163364' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:01:53.350 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.347+0000 7f66d7b35700 1 -- 172.21.15.155:0/382102332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66d00fbb40 msgr2=0x7f66d00fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:53.350 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.347+0000 7f66d7b35700 1 --2- 172.21.15.155:0/382102332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66d00fbb40 0x7f66d00fbfb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f66c0004940 tx=0x7f66c0009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:53.350 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.347+0000 7f66d7b35700 1 -- 172.21.15.155:0/382102332 shutdown_connections 2023-12-16T06:01:53.350 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.347+0000 7f66d7b35700 1 --2- 172.21.15.155:0/382102332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66d00fbb40 0x7f66d00fbfb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:53.350 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.347+0000 7f66d7b35700 1 --2- 172.21.15.155:0/382102332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66d0101b00 0x7f66d0101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:53.350 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.347+0000 7f66d7b35700 1 -- 172.21.15.155:0/382102332 >> 172.21.15.155:0/382102332 conn(0x7f66d00719b0 msgr2=0x7f66d0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:53.351 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.348+0000 7f66d7b35700 1 -- 172.21.15.155:0/382102332 shutdown_connections 2023-12-16T06:01:53.351 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.348+0000 7f66d7b35700 1 -- 172.21.15.155:0/382102332 wait complete. 2023-12-16T06:01:53.352 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.348+0000 7f66d7b35700 1 Processor -- start 2023-12-16T06:01:53.352 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.348+0000 7f66d7b35700 1 -- start start 2023-12-16T06:01:53.352 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.349+0000 7f66d7b35700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66d00fbb40 0x7f66d0112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:53.352 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.349+0000 7f66d7b35700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66d0101b00 0x7f66d0112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:53.352 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.349+0000 7f66d7b35700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d01131d0 con 0x7f66d0101b00 2023-12-16T06:01:53.352 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.349+0000 7f66d7b35700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d010c4c0 con 0x7f66d00fbb40 2023-12-16T06:01:53.352 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.349+0000 7f66d50d0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66d0101b00 0x7f66d0112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:53.353 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.349+0000 7f66d50d0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66d0101b00 0x7f66d0112b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:47982/0 (socket says 172.21.15.155:47982) 2023-12-16T06:01:53.353 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.349+0000 7f66d50d0700 1 -- 172.21.15.155:0/1356745982 learned_addr learned my addr 172.21.15.155:0/1356745982 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:01:53.353 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.349+0000 7f66d58d1700 1 --2- 172.21.15.155:0/1356745982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66d00fbb40 0x7f66d0112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:53.353 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.349+0000 7f66d50d0700 1 -- 172.21.15.155:0/1356745982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66d00fbb40 msgr2=0x7f66d0112640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:53.353 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.349+0000 7f66d50d0700 1 --2- 172.21.15.155:0/1356745982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66d00fbb40 0x7f66d0112640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:53.353 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.349+0000 7f66d50d0700 1 -- 172.21.15.155:0/1356745982 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c0005040 con 0x7f66d0101b00 2023-12-16T06:01:53.353 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.349+0000 7f66d58d1700 1 --2- 172.21.15.155:0/1356745982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66d00fbb40 0x7f66d0112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T06:01:53.353 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.349+0000 7f66d50d0700 1 --2- 172.21.15.155:0/1356745982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66d0101b00 0x7f66d0112b80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009180 tx=0x7f66c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:53.353 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.349+0000 7f66c67fc700 1 -- 172.21.15.155:0/1356745982 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66c000e040 con 0x7f66d0101b00 2023-12-16T06:01:53.353 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.349+0000 7f66d7b35700 1 -- 172.21.15.155:0/1356745982 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d010c740 con 0x7f66d0101b00 2023-12-16T06:01:53.353 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.349+0000 7f66c67fc700 1 -- 172.21.15.155:0/1356745982 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f66c0013420 con 0x7f66d0101b00 2023-12-16T06:01:53.353 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.349+0000 7f66c67fc700 1 -- 172.21.15.155:0/1356745982 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66c001c630 con 0x7f66d0101b00 2023-12-16T06:01:53.353 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.349+0000 7f66d7b35700 1 -- 172.21.15.155:0/1356745982 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d010cc80 con 0x7f66d0101b00 2023-12-16T06:01:53.354 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.350+0000 7f66d7b35700 1 -- 172.21.15.155:0/1356745982 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d01122d0 con 0x7f66d0101b00 2023-12-16T06:01:53.354 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.351+0000 7f66c67fc700 1 -- 172.21.15.155:0/1356745982 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f66c00139e0 con 0x7f66d0101b00 2023-12-16T06:01:53.354 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.351+0000 7f66c67fc700 1 --2- 172.21.15.155:0/1356745982 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f66bc06ce60 0x7f66bc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:53.354 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.351+0000 7f66c67fc700 1 -- 172.21.15.155:0/1356745982 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f66c008d5b0 con 0x7f66d0101b00 2023-12-16T06:01:53.355 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.351+0000 7f66d58d1700 1 --2- 172.21.15.155:0/1356745982 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f66bc06ce60 0x7f66bc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:53.355 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.352+0000 7f66d58d1700 1 --2- 172.21.15.155:0/1356745982 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f66bc06ce60 0x7f66bc06f310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f66cc007fd0 tx=0x7f66cc009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:53.358 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.356+0000 7f66c67fc700 1 -- 172.21.15.155:0/1356745982 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f66c005aff0 con 0x7f66d0101b00 2023-12-16T06:01:53.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:52 smithi156 ceph-mon[182000]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:01:53.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:52 smithi156 ceph-mon[182000]: pgmap v99: 65 pgs: 7 peering, 11 active+undersized+degraded, 8 active+undersized, 39 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 45/342 objects degraded (13.158%) 2023-12-16T06:01:53.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:52 smithi156 ceph-mon[182000]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:01:53.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:52 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/2895163364' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:01:53.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.570+0000 7f66d7b35700 1 -- 172.21.15.155:0/1356745982 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f66d004bb80 con 0x7f66bc06ce60 2023-12-16T06:01:53.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.572+0000 7f66c67fc700 1 -- 172.21.15.155:0/1356745982 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f66d004bb80 con 0x7f66bc06ce60 2023-12-16T06:01:53.574 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T06:01:53.574 INFO:teuthology.orchestra.run.smithi155.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T06:01:53.574 INFO:teuthology.orchestra.run.smithi155.stdout: "in_progress": true, 2023-12-16T06:01:53.574 INFO:teuthology.orchestra.run.smithi155.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T06:01:53.574 INFO:teuthology.orchestra.run.smithi155.stdout: "services_complete": [ 2023-12-16T06:01:53.574 INFO:teuthology.orchestra.run.smithi155.stdout: "crash", 2023-12-16T06:01:53.574 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr", 2023-12-16T06:01:53.574 INFO:teuthology.orchestra.run.smithi155.stdout: "mon" 2023-12-16T06:01:53.574 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-12-16T06:01:53.574 INFO:teuthology.orchestra.run.smithi155.stdout: "progress": "10/21 daemons upgraded", 2023-12-16T06:01:53.574 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "Currently upgrading osd daemons", 2023-12-16T06:01:53.574 INFO:teuthology.orchestra.run.smithi155.stdout: "is_paused": false 2023-12-16T06:01:53.574 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T06:01:53.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.574+0000 7f66d7b35700 1 -- 172.21.15.155:0/1356745982 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f66bc06ce60 msgr2=0x7f66bc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:53.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.574+0000 7f66d7b35700 1 --2- 172.21.15.155:0/1356745982 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f66bc06ce60 0x7f66bc06f310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f66cc007fd0 tx=0x7f66cc009040 comp rx=0 tx=0).stop 2023-12-16T06:01:53.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.574+0000 7f66d7b35700 1 -- 172.21.15.155:0/1356745982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66d0101b00 msgr2=0x7f66d0112b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:53.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.574+0000 7f66d7b35700 1 --2- 172.21.15.155:0/1356745982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66d0101b00 0x7f66d0112b80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009180 tx=0x7f66c0009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:53.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.574+0000 7f66d7b35700 1 -- 172.21.15.155:0/1356745982 shutdown_connections 2023-12-16T06:01:53.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.574+0000 7f66d7b35700 1 --2- 172.21.15.155:0/1356745982 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f66bc06ce60 0x7f66bc06f310 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:53.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.574+0000 7f66d7b35700 1 --2- 172.21.15.155:0/1356745982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66d00fbb40 0x7f66d0112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:53.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.574+0000 7f66d7b35700 1 --2- 172.21.15.155:0/1356745982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66d0101b00 0x7f66d0112b80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:53.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.574+0000 7f66d7b35700 1 -- 172.21.15.155:0/1356745982 >> 172.21.15.155:0/1356745982 conn(0x7f66d00719b0 msgr2=0x7f66d00fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:53.576 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.574+0000 7f66d7b35700 1 -- 172.21.15.155:0/1356745982 shutdown_connections 2023-12-16T06:01:53.577 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.574+0000 7f66d7b35700 1 -- 172.21.15.155:0/1356745982 wait complete. 2023-12-16T06:01:53.678 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.675+0000 7fd444a9f700 1 -- 172.21.15.155:0/2515453288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4400fbb40 msgr2=0x7fd4400fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:53.678 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.675+0000 7fd444a9f700 1 --2- 172.21.15.155:0/2515453288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4400fbb40 0x7fd4400fbfb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd434004940 tx=0x7fd434009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:53.678 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.675+0000 7fd444a9f700 1 -- 172.21.15.155:0/2515453288 shutdown_connections 2023-12-16T06:01:53.678 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.675+0000 7fd444a9f700 1 --2- 172.21.15.155:0/2515453288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4400fbb40 0x7fd4400fbfb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:53.678 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.675+0000 7fd444a9f700 1 --2- 172.21.15.155:0/2515453288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd440101b00 0x7fd440101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:53.678 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.675+0000 7fd444a9f700 1 -- 172.21.15.155:0/2515453288 >> 172.21.15.155:0/2515453288 conn(0x7fd4400719b0 msgr2=0x7fd440071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:53.678 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.675+0000 7fd444a9f700 1 -- 172.21.15.155:0/2515453288 shutdown_connections 2023-12-16T06:01:53.678 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.675+0000 7fd444a9f700 1 -- 172.21.15.155:0/2515453288 wait complete. 2023-12-16T06:01:53.678 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.675+0000 7fd444a9f700 1 Processor -- start 2023-12-16T06:01:53.678 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.675+0000 7fd444a9f700 1 -- start start 2023-12-16T06:01:53.678 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.675+0000 7fd444a9f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4400fbb40 0x7fd440112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:53.678 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.675+0000 7fd444a9f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd440101b00 0x7fd440112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:53.678 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.675+0000 7fd444a9f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4401131d0 con 0x7fd440101b00 2023-12-16T06:01:53.679 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.675+0000 7fd444a9f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44010c4c0 con 0x7fd4400fbb40 2023-12-16T06:01:53.679 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.676+0000 7fd43dd9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd440101b00 0x7fd440112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:53.679 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.676+0000 7fd43dd9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd440101b00 0x7fd440112b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48002/0 (socket says 172.21.15.155:48002) 2023-12-16T06:01:53.679 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.676+0000 7fd43dd9b700 1 -- 172.21.15.155:0/4035078280 learned_addr learned my addr 172.21.15.155:0/4035078280 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:01:53.679 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.676+0000 7fd43e59c700 1 --2- 172.21.15.155:0/4035078280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4400fbb40 0x7fd440112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:53.679 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.676+0000 7fd43dd9b700 1 -- 172.21.15.155:0/4035078280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4400fbb40 msgr2=0x7fd440112640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:53.679 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.676+0000 7fd43dd9b700 1 --2- 172.21.15.155:0/4035078280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4400fbb40 0x7fd440112640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:53.679 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.676+0000 7fd43dd9b700 1 -- 172.21.15.155:0/4035078280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd434005040 con 0x7fd440101b00 2023-12-16T06:01:53.679 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.676+0000 7fd43dd9b700 1 --2- 172.21.15.155:0/4035078280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd440101b00 0x7fd440112b80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd434009180 tx=0x7fd434009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:53.679 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.676+0000 7fd42effd700 1 -- 172.21.15.155:0/4035078280 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd43400e040 con 0x7fd440101b00 2023-12-16T06:01:53.679 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.676+0000 7fd42effd700 1 -- 172.21.15.155:0/4035078280 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd434004290 con 0x7fd440101b00 2023-12-16T06:01:53.679 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.676+0000 7fd444a9f700 1 -- 172.21.15.155:0/4035078280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44010c740 con 0x7fd440101b00 2023-12-16T06:01:53.679 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.676+0000 7fd42effd700 1 -- 172.21.15.155:0/4035078280 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd43401c3f0 con 0x7fd440101b00 2023-12-16T06:01:53.679 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.676+0000 7fd444a9f700 1 -- 172.21.15.155:0/4035078280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44010cc80 con 0x7fd440101b00 2023-12-16T06:01:53.680 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.677+0000 7fd444a9f700 1 -- 172.21.15.155:0/4035078280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4401122d0 con 0x7fd440101b00 2023-12-16T06:01:53.680 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.678+0000 7fd42effd700 1 -- 172.21.15.155:0/4035078280 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7fd434013420 con 0x7fd440101b00 2023-12-16T06:01:53.681 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.678+0000 7fd42effd700 1 --2- 172.21.15.155:0/4035078280 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fd42806ce60 0x7fd42806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:01:53.681 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.678+0000 7fd42effd700 1 -- 172.21.15.155:0/4035078280 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd43408d590 con 0x7fd440101b00 2023-12-16T06:01:53.681 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.678+0000 7fd43e59c700 1 --2- 172.21.15.155:0/4035078280 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fd42806ce60 0x7fd42806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:01:53.681 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.679+0000 7fd43e59c700 1 --2- 172.21.15.155:0/4035078280 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fd42806ce60 0x7fd42806f310 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd430004f40 tx=0x7fd43000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:01:53.684 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.683+0000 7fd42effd700 1 -- 172.21.15.155:0/4035078280 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fd43405afd0 con 0x7fd440101b00 2023-12-16T06:01:53.961 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.959+0000 7fd444a9f700 1 -- 172.21.15.155:0/4035078280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd440103fb0 con 0x7fd440101b00 2023-12-16T06:01:53.961 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.960+0000 7fd42effd700 1 -- 172.21.15.155:0/4035078280 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+794 (secure 0 0 0) 0x7fd43405ab60 con 0x7fd440101b00 2023-12-16T06:01:53.961 INFO:teuthology.orchestra.run.smithi155.stdout:HEALTH_WARN Degraded data redundancy: 45/342 objects degraded (13.158%), 11 pgs degraded 2023-12-16T06:01:53.962 INFO:teuthology.orchestra.run.smithi155.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 45/342 objects degraded (13.158%), 11 pgs degraded 2023-12-16T06:01:53.962 INFO:teuthology.orchestra.run.smithi155.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2023-12-16T06:01:53.962 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2023-12-16T06:01:53.962 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2023-12-16T06:01:53.962 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2023-12-16T06:01:53.962 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2023-12-16T06:01:53.962 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2023-12-16T06:01:53.962 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2023-12-16T06:01:53.962 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.12 is active+undersized+degraded, acting [1,0] 2023-12-16T06:01:53.962 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2023-12-16T06:01:53.962 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2023-12-16T06:01:53.962 INFO:teuthology.orchestra.run.smithi155.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2023-12-16T06:01:53.963 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.962+0000 7fd444a9f700 1 -- 172.21.15.155:0/4035078280 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fd42806ce60 msgr2=0x7fd42806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:53.963 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.962+0000 7fd444a9f700 1 --2- 172.21.15.155:0/4035078280 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fd42806ce60 0x7fd42806f310 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd430004f40 tx=0x7fd43000b040 comp rx=0 tx=0).stop 2023-12-16T06:01:53.963 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.962+0000 7fd444a9f700 1 -- 172.21.15.155:0/4035078280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd440101b00 msgr2=0x7fd440112b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:01:53.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.962+0000 7fd444a9f700 1 --2- 172.21.15.155:0/4035078280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd440101b00 0x7fd440112b80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd434009180 tx=0x7fd434009e30 comp rx=0 tx=0).stop 2023-12-16T06:01:53.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.962+0000 7fd444a9f700 1 -- 172.21.15.155:0/4035078280 shutdown_connections 2023-12-16T06:01:53.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.962+0000 7fd444a9f700 1 --2- 172.21.15.155:0/4035078280 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fd42806ce60 0x7fd42806f310 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:53.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.962+0000 7fd444a9f700 1 --2- 172.21.15.155:0/4035078280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4400fbb40 0x7fd440112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:53.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.962+0000 7fd444a9f700 1 --2- 172.21.15.155:0/4035078280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd440101b00 0x7fd440112b80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:01:53.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.962+0000 7fd444a9f700 1 -- 172.21.15.155:0/4035078280 >> 172.21.15.155:0/4035078280 conn(0x7fd4400719b0 msgr2=0x7fd4400fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:01:53.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.962+0000 7fd444a9f700 1 -- 172.21.15.155:0/4035078280 shutdown_connections 2023-12-16T06:01:53.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:01:53.962+0000 7fd444a9f700 1 -- 172.21.15.155:0/4035078280 wait complete. 2023-12-16T06:01:54.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:53 smithi155 ceph-mon[217407]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:01:54.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:53 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/3878361806' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T06:01:54.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:53 smithi156 ceph-mon[182000]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:01:54.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:53 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/3878361806' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T06:01:55.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:54 smithi155 ceph-mon[217407]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:01:55.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:54 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/4035078280' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T06:01:55.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:54 smithi155 ceph-mon[217407]: pgmap v100: 65 pgs: 7 peering, 58 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2023-12-16T06:01:55.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:54 smithi156 ceph-mon[182000]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:01:55.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:54 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/4035078280' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T06:01:55.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:54 smithi156 ceph-mon[182000]: pgmap v100: 65 pgs: 7 peering, 58 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2023-12-16T06:01:56.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:55 smithi155 ceph-mon[217407]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 45/342 objects degraded (13.158%), 11 pgs degraded) 2023-12-16T06:01:56.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:55 smithi155 ceph-mon[217407]: Cluster is now healthy 2023-12-16T06:01:56.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:55 smithi156 ceph-mon[182000]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 45/342 objects degraded (13.158%), 11 pgs degraded) 2023-12-16T06:01:56.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:55 smithi156 ceph-mon[182000]: Cluster is now healthy 2023-12-16T06:01:57.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:56 smithi155 ceph-mon[217407]: pgmap v101: 65 pgs: 65 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2023-12-16T06:01:57.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:56 smithi156 ceph-mon[182000]: pgmap v101: 65 pgs: 65 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2023-12-16T06:01:59.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:01:59 smithi155 ceph-mon[217407]: pgmap v102: 65 pgs: 65 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2023-12-16T06:01:59.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:01:59 smithi156 ceph-mon[182000]: pgmap v102: 65 pgs: 65 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2023-12-16T06:02:01.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:01 smithi155 ceph-mon[217407]: pgmap v103: 65 pgs: 65 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T06:02:01.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:01 smithi156 ceph-mon[182000]: pgmap v103: 65 pgs: 65 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T06:02:03.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:02 smithi155 ceph-mon[217407]: pgmap v104: 65 pgs: 65 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2023-12-16T06:02:03.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:02 smithi156 ceph-mon[182000]: pgmap v104: 65 pgs: 65 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2023-12-16T06:02:04.016 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:03 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T06:02:04.017 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:03 smithi156 ceph-mon[182000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T06:02:04.017 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:03 smithi156 ceph-mon[182000]: Upgrade: osd.4 is safe to restart 2023-12-16T06:02:04.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:03 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T06:02:04.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:03 smithi155 ceph-mon[217407]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T06:02:04.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:03 smithi155 ceph-mon[217407]: Upgrade: osd.4 is safe to restart 2023-12-16T06:02:05.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:05 smithi156 ceph-mon[182000]: Upgrade: Updating osd.4 2023-12-16T06:02:05.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:05 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:05.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:05 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T06:02:05.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:05 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:02:05.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:05 smithi156 ceph-mon[182000]: pgmap v105: 65 pgs: 65 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2023-12-16T06:02:05.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:05 smithi156 ceph-mon[182000]: Deploying daemon osd.4 on smithi156 2023-12-16T06:02:05.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:05 smithi155 ceph-mon[217407]: Upgrade: Updating osd.4 2023-12-16T06:02:05.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:05 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:05.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:05 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T06:02:05.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:05 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:02:05.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:05 smithi155 ceph-mon[217407]: pgmap v105: 65 pgs: 65 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2023-12-16T06:02:05.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:05 smithi155 ceph-mon[217407]: Deploying daemon osd.4 on smithi156 2023-12-16T06:02:06.334 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:06 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:06.334 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:06 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:02:06.334 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:06 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:06.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:06 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:06.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:06 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:02:06.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:06 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:06.680 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:06 smithi156 systemd[1]: Stopping Ceph osd.4 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T06:02:06.680 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:06 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[135364]: 2023-12-16T06:02:06.507+0000 7fa4706fa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T06:02:06.680 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:06 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[135364]: 2023-12-16T06:02:06.507+0000 7fa4706fa700 -1 osd.4 67 *** Got signal Terminated *** 2023-12-16T06:02:06.680 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:06 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[135364]: 2023-12-16T06:02:06.507+0000 7fa4706fa700 -1 osd.4 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T06:02:07.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:07 smithi155 ceph-mon[217407]: pgmap v106: 65 pgs: 65 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T06:02:07.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:07 smithi155 ceph-mon[217407]: osd.4 marked itself down and dead 2023-12-16T06:02:07.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:07 smithi156 ceph-mon[182000]: pgmap v106: 65 pgs: 65 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-16T06:02:07.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:07 smithi156 ceph-mon[182000]: osd.4 marked itself down and dead 2023-12-16T06:02:08.231 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:08 smithi156 bash[200123]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4 2023-12-16T06:02:08.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:08 smithi156 ceph-mon[182000]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T06:02:08.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:08 smithi156 ceph-mon[182000]: failed to encode map e68 with expected crc 2023-12-16T06:02:08.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:08 smithi156 ceph-mon[182000]: osdmap e68: 6 total, 5 up, 6 in 2023-12-16T06:02:08.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:08 smithi155 ceph-mon[217407]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T06:02:08.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:08 smithi155 ceph-mon[217407]: failed to encode map e68 with expected crc 2023-12-16T06:02:08.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:08 smithi155 ceph-mon[217407]: osdmap e68: 6 total, 5 up, 6 in 2023-12-16T06:02:09.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:09 smithi155 ceph-mon[217407]: pgmap v108: 65 pgs: 6 stale+active+clean, 59 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-16T06:02:09.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:09 smithi155 ceph-mon[217407]: osdmap e69: 6 total, 5 up, 6 in 2023-12-16T06:02:09.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:09 smithi155 ceph-mon[217407]: failed to encode map e69 with expected crc 2023-12-16T06:02:09.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:09 smithi155 ceph-mon[217407]: failed to encode map e69 with expected crc 2023-12-16T06:02:09.608 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:09 smithi156 systemd[1]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.4.service: Succeeded. 2023-12-16T06:02:09.608 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:09 smithi156 systemd[1]: Stopped Ceph osd.4 for d344784e-9bd6-11ee-95a5-87774f69a715. 2023-12-16T06:02:09.608 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:09 smithi156 systemd[1]: Starting Ceph osd.4 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T06:02:09.608 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:09 smithi156 ceph-mon[182000]: pgmap v108: 65 pgs: 6 stale+active+clean, 59 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-16T06:02:09.608 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:09 smithi156 ceph-mon[182000]: osdmap e69: 6 total, 5 up, 6 in 2023-12-16T06:02:09.608 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:09 smithi156 ceph-mon[182000]: failed to encode map e69 with expected crc 2023-12-16T06:02:09.608 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:09 smithi156 ceph-mon[182000]: failed to encode map e69 with expected crc 2023-12-16T06:02:10.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:10 smithi156 ceph-mon[182000]: Health check failed: Degraded data redundancy: 27/342 objects degraded (7.895%), 6 pgs degraded (PG_DEGRADED) 2023-12-16T06:02:10.430 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:10 smithi156 bash[200387]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-16T06:02:10.430 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:10 smithi156 bash[200387]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-16T06:02:10.430 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:10 smithi156 bash[200387]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-16T06:02:10.430 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:10 smithi156 bash[200387]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-16T06:02:10.430 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:10 smithi156 bash[200387]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2023-12-16T06:02:10.430 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:10 smithi156 bash[200387]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-16T06:02:10.431 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:10 smithi156 bash[200387]: --> ceph-volume raw activate successful for osd ID: 4 2023-12-16T06:02:10.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:10 smithi155 ceph-mon[217407]: Health check failed: Degraded data redundancy: 27/342 objects degraded (7.895%), 6 pgs degraded (PG_DEGRADED) 2023-12-16T06:02:11.180 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:10 smithi156 ceph-osd[200683]: -- 172.21.15.156:0/3006861587 <== mon.1 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560766a516c0 con 0x560766a20c00 2023-12-16T06:02:11.180 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:10 smithi156 bash[200646]: a4a0224a1f37d5caa70e1a155a242ee0ae5e9135d63bccc3b2b99a82acb87a82 2023-12-16T06:02:11.180 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:10 smithi156 systemd[1]: Started Ceph osd.4 for d344784e-9bd6-11ee-95a5-87774f69a715. 2023-12-16T06:02:11.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:11 smithi155 ceph-mon[217407]: pgmap v110: 65 pgs: 6 active+undersized+degraded, 4 stale+active+clean, 7 active+undersized, 48 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 27/342 objects degraded (7.895%) 2023-12-16T06:02:11.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:11 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:11.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:11 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:11.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:11 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:02:11.679 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:11 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[200660]: 2023-12-16T06:02:11.305+0000 7faa1816b640 -1 Falling back to public interface 2023-12-16T06:02:11.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:11 smithi156 ceph-mon[182000]: pgmap v110: 65 pgs: 6 active+undersized+degraded, 4 stale+active+clean, 7 active+undersized, 48 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 27/342 objects degraded (7.895%) 2023-12-16T06:02:11.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:11 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:11.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:11 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:11.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:11 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:02:13.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:12 smithi155 ceph-mon[217407]: pgmap v111: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 60/342 objects degraded (17.544%) 2023-12-16T06:02:13.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:12 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:13.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:12 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:13.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:12 smithi156 ceph-mon[182000]: pgmap v111: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 60/342 objects degraded (17.544%) 2023-12-16T06:02:13.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:12 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:13.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:12 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:14.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:14 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:14.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:14 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:14.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:14 smithi156 ceph-mon[182000]: pgmap v112: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 60/342 objects degraded (17.544%) 2023-12-16T06:02:14.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:14 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:14.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:14 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:14.826 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:14 smithi155 ceph-mon[217407]: pgmap v112: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 60/342 objects degraded (17.544%) 2023-12-16T06:02:16.179 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:15 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[200660]: 2023-12-16T06:02:15.891+0000 7faa1816b640 -1 osd.4 0 read_superblock omap replica is missing. 2023-12-16T06:02:16.893 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:16 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[200660]: 2023-12-16T06:02:16.481+0000 7faa1816b640 -1 osd.4 67 log_to_monitors true 2023-12-16T06:02:17.180 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:02:16 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[200660]: 2023-12-16T06:02:16.923+0000 7faa08ddb700 -1 osd.4 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T06:02:17.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:16 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:17.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:16 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:17.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:16 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:02:17.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:16 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T06:02:17.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:16 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:17.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:16 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:02:17.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:16 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:02:17.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:16 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:02:17.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:16 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:02:17.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:16 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T06:02:17.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:16 smithi156 ceph-mon[182000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T06:02:17.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:16 smithi156 ceph-mon[182000]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-16T06:02:17.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:16 smithi156 ceph-mon[182000]: pgmap v113: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 60/342 objects degraded (17.544%) 2023-12-16T06:02:17.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:16 smithi156 ceph-mon[182000]: from='osd.4 [v2:172.21.15.156:6808/373103962,v1:172.21.15.156:6809/373103962]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T06:02:17.181 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:16 smithi156 ceph-mon[182000]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T06:02:17.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:16 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:17.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:16 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:17.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:16 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:02:17.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:16 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T06:02:17.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:16 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:17.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:16 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:02:17.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:16 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:02:17.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:16 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:02:17.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:16 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:02:17.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:16 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T06:02:17.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:16 smithi155 ceph-mon[217407]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T06:02:17.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:16 smithi155 ceph-mon[217407]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-16T06:02:17.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:16 smithi155 ceph-mon[217407]: pgmap v113: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 60/342 objects degraded (17.544%) 2023-12-16T06:02:17.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:16 smithi155 ceph-mon[217407]: from='osd.4 [v2:172.21.15.156:6808/373103962,v1:172.21.15.156:6809/373103962]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T06:02:17.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:16 smithi155 ceph-mon[217407]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T06:02:18.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:17 smithi156 ceph-mon[182000]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-16T06:02:18.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:17 smithi156 ceph-mon[182000]: failed to encode map e70 with expected crc 2023-12-16T06:02:18.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:17 smithi156 ceph-mon[182000]: osdmap e70: 6 total, 5 up, 6 in 2023-12-16T06:02:18.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:17 smithi156 ceph-mon[182000]: from='osd.4 [v2:172.21.15.156:6808/373103962,v1:172.21.15.156:6809/373103962]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T06:02:18.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:17 smithi156 ceph-mon[182000]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T06:02:18.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:17 smithi156 ceph-mon[182000]: Health check update: Degraded data redundancy: 60/342 objects degraded (17.544%), 16 pgs degraded (PG_DEGRADED) 2023-12-16T06:02:18.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:17 smithi155 ceph-mon[217407]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-16T06:02:18.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:17 smithi155 ceph-mon[217407]: failed to encode map e70 with expected crc 2023-12-16T06:02:18.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:17 smithi155 ceph-mon[217407]: osdmap e70: 6 total, 5 up, 6 in 2023-12-16T06:02:18.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:17 smithi155 ceph-mon[217407]: from='osd.4 [v2:172.21.15.156:6808/373103962,v1:172.21.15.156:6809/373103962]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T06:02:18.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:17 smithi155 ceph-mon[217407]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T06:02:18.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:17 smithi155 ceph-mon[217407]: Health check update: Degraded data redundancy: 60/342 objects degraded (17.544%), 16 pgs degraded (PG_DEGRADED) 2023-12-16T06:02:19.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:18 smithi156 ceph-mon[182000]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T06:02:19.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:18 smithi156 ceph-mon[182000]: failed to encode map e71 with expected crc 2023-12-16T06:02:19.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:18 smithi156 ceph-mon[182000]: osd.4 [v2:172.21.15.156:6808/373103962,v1:172.21.15.156:6809/373103962] boot 2023-12-16T06:02:19.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:18 smithi156 ceph-mon[182000]: osdmap e71: 6 total, 6 up, 6 in 2023-12-16T06:02:19.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:18 smithi156 ceph-mon[182000]: failed to encode map e71 with expected crc 2023-12-16T06:02:19.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:18 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T06:02:19.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:18 smithi156 ceph-mon[182000]: pgmap v116: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 60/342 objects degraded (17.544%) 2023-12-16T06:02:19.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:18 smithi155 ceph-mon[217407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T06:02:19.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:18 smithi155 ceph-mon[217407]: failed to encode map e71 with expected crc 2023-12-16T06:02:19.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:18 smithi155 ceph-mon[217407]: osd.4 [v2:172.21.15.156:6808/373103962,v1:172.21.15.156:6809/373103962] boot 2023-12-16T06:02:19.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:18 smithi155 ceph-mon[217407]: osdmap e71: 6 total, 6 up, 6 in 2023-12-16T06:02:19.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:18 smithi155 ceph-mon[217407]: failed to encode map e71 with expected crc 2023-12-16T06:02:19.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:18 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T06:02:19.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:18 smithi155 ceph-mon[217407]: pgmap v116: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 60/342 objects degraded (17.544%) 2023-12-16T06:02:20.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:19 smithi155 ceph-mon[217407]: osdmap e72: 6 total, 6 up, 6 in 2023-12-16T06:02:20.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:19 smithi155 ceph-mon[217407]: failed to encode map e72 with expected crc 2023-12-16T06:02:20.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:19 smithi155 ceph-mon[217407]: failed to encode map e72 with expected crc 2023-12-16T06:02:20.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:19 smithi156 ceph-mon[182000]: osdmap e72: 6 total, 6 up, 6 in 2023-12-16T06:02:20.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:19 smithi156 ceph-mon[182000]: failed to encode map e72 with expected crc 2023-12-16T06:02:20.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:19 smithi156 ceph-mon[182000]: failed to encode map e72 with expected crc 2023-12-16T06:02:21.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:21 smithi155 ceph-mon[217407]: pgmap v118: 65 pgs: 1 active, 1 peering, 11 active+undersized+degraded, 12 active+undersized, 40 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 36/342 objects degraded (10.526%) 2023-12-16T06:02:21.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:21 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:21.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:21 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:02:21.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:21 smithi156 ceph-mon[182000]: pgmap v118: 65 pgs: 1 active, 1 peering, 11 active+undersized+degraded, 12 active+undersized, 40 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 36/342 objects degraded (10.526%) 2023-12-16T06:02:21.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:21 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:21.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:21 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:02:22.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:22 smithi155 ceph-mon[217407]: Health check update: Degraded data redundancy: 36/342 objects degraded (10.526%), 11 pgs degraded (PG_DEGRADED) 2023-12-16T06:02:22.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:22 smithi156 ceph-mon[182000]: Health check update: Degraded data redundancy: 36/342 objects degraded (10.526%), 11 pgs degraded (PG_DEGRADED) 2023-12-16T06:02:23.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:23 smithi155 ceph-mon[217407]: pgmap v119: 65 pgs: 1 active, 1 peering, 63 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2023-12-16T06:02:23.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:23 smithi155 ceph-mon[217407]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 36/342 objects degraded (10.526%), 11 pgs degraded) 2023-12-16T06:02:23.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:23 smithi155 ceph-mon[217407]: Cluster is now healthy 2023-12-16T06:02:23.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:23 smithi156 ceph-mon[182000]: pgmap v119: 65 pgs: 1 active, 1 peering, 63 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2023-12-16T06:02:23.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:23 smithi156 ceph-mon[182000]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 36/342 objects degraded (10.526%), 11 pgs degraded) 2023-12-16T06:02:23.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:23 smithi156 ceph-mon[182000]: Cluster is now healthy 2023-12-16T06:02:24.080 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.075+0000 7f797401b700 1 -- 172.21.15.155:0/3084657799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796c0fbb30 msgr2=0x7f796c0fbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:24.080 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.075+0000 7f797401b700 1 --2- 172.21.15.155:0/3084657799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796c0fbb30 0x7f796c0fbfa0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7960004940 tx=0x7f7960009e30 comp rx=0 tx=0).stop 2023-12-16T06:02:24.080 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.075+0000 7f797401b700 1 -- 172.21.15.155:0/3084657799 shutdown_connections 2023-12-16T06:02:24.080 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.075+0000 7f797401b700 1 --2- 172.21.15.155:0/3084657799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796c0fbb30 0x7f796c0fbfa0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:24.080 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.075+0000 7f797401b700 1 --2- 172.21.15.155:0/3084657799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f796c101af0 0x7f796c101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:24.080 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.075+0000 7f797401b700 1 -- 172.21.15.155:0/3084657799 >> 172.21.15.155:0/3084657799 conn(0x7f796c0f7690 msgr2=0x7f796c0f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:02:24.080 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.075+0000 7f797401b700 1 -- 172.21.15.155:0/3084657799 shutdown_connections 2023-12-16T06:02:24.080 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.075+0000 7f797401b700 1 -- 172.21.15.155:0/3084657799 wait complete. 2023-12-16T06:02:24.080 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.076+0000 7f797401b700 1 Processor -- start 2023-12-16T06:02:24.080 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.076+0000 7f797401b700 1 -- start start 2023-12-16T06:02:24.080 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.076+0000 7f797401b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f796c0fbb30 0x7f796c0fd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:24.081 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.076+0000 7f797401b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796c101af0 0x7f796c0fdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:24.081 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.076+0000 7f797401b700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0fe250 con 0x7f796c101af0 2023-12-16T06:02:24.081 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.076+0000 7f797401b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0fe3c0 con 0x7f796c0fbb30 2023-12-16T06:02:24.081 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.076+0000 7f79715b6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796c101af0 0x7f796c0fdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:24.081 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.076+0000 7f79715b6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796c101af0 0x7f796c0fdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44758/0 (socket says 172.21.15.155:44758) 2023-12-16T06:02:24.081 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.076+0000 7f79715b6700 1 -- 172.21.15.155:0/1114036836 learned_addr learned my addr 172.21.15.155:0/1114036836 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:02:24.081 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.076+0000 7f7971db7700 1 --2- 172.21.15.155:0/1114036836 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f796c0fbb30 0x7f796c0fd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:24.081 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.076+0000 7f79715b6700 1 -- 172.21.15.155:0/1114036836 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f796c0fbb30 msgr2=0x7f796c0fd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:24.081 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.076+0000 7f79715b6700 1 --2- 172.21.15.155:0/1114036836 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f796c0fbb30 0x7f796c0fd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:24.081 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.076+0000 7f79715b6700 1 -- 172.21.15.155:0/1114036836 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7960005040 con 0x7f796c101af0 2023-12-16T06:02:24.081 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.077+0000 7f79715b6700 1 --2- 172.21.15.155:0/1114036836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796c101af0 0x7f796c0fdc50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f796000b3b0 tx=0x7f7960009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:02:24.081 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.077+0000 7f795e7fc700 1 -- 172.21.15.155:0/1114036836 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f796000e040 con 0x7f796c101af0 2023-12-16T06:02:24.081 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.077+0000 7f795e7fc700 1 -- 172.21.15.155:0/1114036836 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f796001c430 con 0x7f796c101af0 2023-12-16T06:02:24.081 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.077+0000 7f797401b700 1 -- 172.21.15.155:0/1114036836 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c119880 con 0x7f796c101af0 2023-12-16T06:02:24.082 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.077+0000 7f795e7fc700 1 -- 172.21.15.155:0/1114036836 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7960013640 con 0x7f796c101af0 2023-12-16T06:02:24.082 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.077+0000 7f797401b700 1 -- 172.21.15.155:0/1114036836 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c119ce0 con 0x7f796c101af0 2023-12-16T06:02:24.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.078+0000 7f797401b700 1 -- 172.21.15.155:0/1114036836 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796c0fb290 con 0x7f796c101af0 2023-12-16T06:02:24.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.078+0000 7f795e7fc700 1 -- 172.21.15.155:0/1114036836 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f796001c5a0 con 0x7f796c101af0 2023-12-16T06:02:24.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.079+0000 7f795e7fc700 1 --2- 172.21.15.155:0/1114036836 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f795806ce60 0x7f795806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:24.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.079+0000 7f795e7fc700 1 -- 172.21.15.155:0/1114036836 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f796008cce0 con 0x7f796c101af0 2023-12-16T06:02:24.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.079+0000 7f7971db7700 1 --2- 172.21.15.155:0/1114036836 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f795806ce60 0x7f795806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:24.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.079+0000 7f7971db7700 1 --2- 172.21.15.155:0/1114036836 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f795806ce60 0x7f795806f310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7968004f40 tx=0x7f796800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:02:24.086 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.083+0000 7f795e7fc700 1 -- 172.21.15.155:0/1114036836 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f7960056de0 con 0x7f796c101af0 2023-12-16T06:02:24.299 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.296+0000 7f797401b700 1 -- 172.21.15.155:0/1114036836 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f796c0fef60 con 0x7f795806ce60 2023-12-16T06:02:24.300 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.298+0000 7f795e7fc700 1 -- 172.21.15.155:0/1114036836 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f796c0fef60 con 0x7f795806ce60 2023-12-16T06:02:24.302 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.300+0000 7f797401b700 1 -- 172.21.15.155:0/1114036836 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f795806ce60 msgr2=0x7f795806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:24.302 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.300+0000 7f797401b700 1 --2- 172.21.15.155:0/1114036836 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f795806ce60 0x7f795806f310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7968004f40 tx=0x7f796800b040 comp rx=0 tx=0).stop 2023-12-16T06:02:24.303 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.300+0000 7f797401b700 1 -- 172.21.15.155:0/1114036836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796c101af0 msgr2=0x7f796c0fdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:24.303 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.300+0000 7f797401b700 1 --2- 172.21.15.155:0/1114036836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796c101af0 0x7f796c0fdc50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f796000b3b0 tx=0x7f7960009e30 comp rx=0 tx=0).stop 2023-12-16T06:02:24.303 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.300+0000 7f797401b700 1 -- 172.21.15.155:0/1114036836 shutdown_connections 2023-12-16T06:02:24.303 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.300+0000 7f797401b700 1 --2- 172.21.15.155:0/1114036836 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f795806ce60 0x7f795806f310 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:24.303 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.300+0000 7f797401b700 1 --2- 172.21.15.155:0/1114036836 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f796c0fbb30 0x7f796c0fd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:24.303 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.300+0000 7f797401b700 1 --2- 172.21.15.155:0/1114036836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796c101af0 0x7f796c0fdc50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:24.303 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.300+0000 7f797401b700 1 -- 172.21.15.155:0/1114036836 >> 172.21.15.155:0/1114036836 conn(0x7f796c0f7690 msgr2=0x7f796c065cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:02:24.303 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.300+0000 7f797401b700 1 -- 172.21.15.155:0/1114036836 shutdown_connections 2023-12-16T06:02:24.303 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.300+0000 7f797401b700 1 -- 172.21.15.155:0/1114036836 wait complete. 2023-12-16T06:02:24.313 INFO:teuthology.orchestra.run.smithi155.stdout:true 2023-12-16T06:02:24.405 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.402+0000 7f05152bd700 1 -- 172.21.15.155:0/478267690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05100fe5a0 msgr2=0x7f0510106c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:24.405 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.402+0000 7f05152bd700 1 --2- 172.21.15.155:0/478267690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05100fe5a0 0x7f0510106c70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0504004940 tx=0x7f0504009e30 comp rx=0 tx=0).stop 2023-12-16T06:02:24.405 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.402+0000 7f05152bd700 1 -- 172.21.15.155:0/478267690 shutdown_connections 2023-12-16T06:02:24.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.402+0000 7f05152bd700 1 --2- 172.21.15.155:0/478267690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05100fe5a0 0x7f0510106c70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:24.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.402+0000 7f05152bd700 1 --2- 172.21.15.155:0/478267690 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05100fdc00 0x7f05100fdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:24.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.402+0000 7f05152bd700 1 -- 172.21.15.155:0/478267690 >> 172.21.15.155:0/478267690 conn(0x7f05100f76c0 msgr2=0x7f05100f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:02:24.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.402+0000 7f05152bd700 1 -- 172.21.15.155:0/478267690 shutdown_connections 2023-12-16T06:02:24.406 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.403+0000 7f05152bd700 1 -- 172.21.15.155:0/478267690 wait complete. 2023-12-16T06:02:24.407 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.403+0000 7f05152bd700 1 Processor -- start 2023-12-16T06:02:24.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.403+0000 7f05152bd700 1 -- start start 2023-12-16T06:02:24.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.403+0000 7f05152bd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05100fdc00 0x7f0510113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:24.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.403+0000 7f05152bd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05100fe5a0 0x7f0510113c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:24.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.403+0000 7f05152bd700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05101142d0 con 0x7f05100fdc00 2023-12-16T06:02:24.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.403+0000 7f05152bd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051010d600 con 0x7f05100fe5a0 2023-12-16T06:02:24.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.403+0000 7f050effd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05100fdc00 0x7f0510113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:24.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.404+0000 7f050effd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05100fdc00 0x7f0510113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44770/0 (socket says 172.21.15.155:44770) 2023-12-16T06:02:24.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.404+0000 7f050effd700 1 -- 172.21.15.155:0/997060217 learned_addr learned my addr 172.21.15.155:0/997060217 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:02:24.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.404+0000 7f050e7fc700 1 --2- 172.21.15.155:0/997060217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05100fe5a0 0x7f0510113c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:24.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.404+0000 7f050effd700 1 -- 172.21.15.155:0/997060217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05100fe5a0 msgr2=0x7f0510113c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:24.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.404+0000 7f050effd700 1 --2- 172.21.15.155:0/997060217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05100fe5a0 0x7f0510113c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:24.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.404+0000 7f050effd700 1 -- 172.21.15.155:0/997060217 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0504005040 con 0x7f05100fdc00 2023-12-16T06:02:24.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.404+0000 7f050effd700 1 --2- 172.21.15.155:0/997060217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05100fdc00 0x7f0510113740 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f050000c830 tx=0x7f0500004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:02:24.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.404+0000 7f04f77fe700 1 -- 172.21.15.155:0/997060217 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f050000a760 con 0x7f05100fdc00 2023-12-16T06:02:24.408 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.404+0000 7f04f77fe700 1 -- 172.21.15.155:0/997060217 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f050000ad70 con 0x7f05100fdc00 2023-12-16T06:02:24.409 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.404+0000 7f05152bd700 1 -- 172.21.15.155:0/997060217 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f051010d8e0 con 0x7f05100fdc00 2023-12-16T06:02:24.409 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.404+0000 7f04f77fe700 1 -- 172.21.15.155:0/997060217 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05000113a0 con 0x7f05100fdc00 2023-12-16T06:02:24.409 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.404+0000 7f05152bd700 1 -- 172.21.15.155:0/997060217 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f051010de20 con 0x7f05100fdc00 2023-12-16T06:02:24.409 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.405+0000 7f05152bd700 1 -- 172.21.15.155:0/997060217 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05101042d0 con 0x7f05100fdc00 2023-12-16T06:02:24.410 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.406+0000 7f04f77fe700 1 -- 172.21.15.155:0/997060217 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f0500012400 con 0x7f05100fdc00 2023-12-16T06:02:24.410 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.406+0000 7f04f77fe700 1 --2- 172.21.15.155:0/997060217 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f04f806ce60 0x7f04f806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:24.410 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.406+0000 7f050e7fc700 1 --2- 172.21.15.155:0/997060217 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f04f806ce60 0x7f04f806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:24.410 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.406+0000 7f04f77fe700 1 -- 172.21.15.155:0/997060217 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f050008c2c0 con 0x7f05100fdc00 2023-12-16T06:02:24.410 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.407+0000 7f050e7fc700 1 --2- 172.21.15.155:0/997060217 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f04f806ce60 0x7f04f806f310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f051010e810 tx=0x7f0504009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:02:24.413 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.411+0000 7f04f77fe700 1 -- 172.21.15.155:0/997060217 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f0500059d00 con 0x7f05100fdc00 2023-12-16T06:02:24.624 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.621+0000 7f05152bd700 1 -- 172.21.15.155:0/997060217 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f051004bb80 con 0x7f04f806ce60 2023-12-16T06:02:24.625 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.622+0000 7f04f77fe700 1 -- 172.21.15.155:0/997060217 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f051004bb80 con 0x7f04f806ce60 2023-12-16T06:02:24.627 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.625+0000 7f05152bd700 1 -- 172.21.15.155:0/997060217 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f04f806ce60 msgr2=0x7f04f806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:24.627 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.625+0000 7f05152bd700 1 --2- 172.21.15.155:0/997060217 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f04f806ce60 0x7f04f806f310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f051010e810 tx=0x7f0504009e30 comp rx=0 tx=0).stop 2023-12-16T06:02:24.627 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.625+0000 7f05152bd700 1 -- 172.21.15.155:0/997060217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05100fdc00 msgr2=0x7f0510113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:24.628 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.625+0000 7f05152bd700 1 --2- 172.21.15.155:0/997060217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05100fdc00 0x7f0510113740 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f050000c830 tx=0x7f0500004470 comp rx=0 tx=0).stop 2023-12-16T06:02:24.628 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.625+0000 7f05152bd700 1 -- 172.21.15.155:0/997060217 shutdown_connections 2023-12-16T06:02:24.628 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.625+0000 7f05152bd700 1 --2- 172.21.15.155:0/997060217 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f04f806ce60 0x7f04f806f310 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:24.628 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.625+0000 7f05152bd700 1 --2- 172.21.15.155:0/997060217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05100fdc00 0x7f0510113740 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:24.628 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.625+0000 7f05152bd700 1 --2- 172.21.15.155:0/997060217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05100fe5a0 0x7f0510113c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:24.628 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.625+0000 7f05152bd700 1 -- 172.21.15.155:0/997060217 >> 172.21.15.155:0/997060217 conn(0x7f05100f76c0 msgr2=0x7f0510101450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:02:24.628 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.625+0000 7f05152bd700 1 -- 172.21.15.155:0/997060217 shutdown_connections 2023-12-16T06:02:24.628 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.625+0000 7f05152bd700 1 -- 172.21.15.155:0/997060217 wait complete. 2023-12-16T06:02:24.728 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.726+0000 7f0a3ae69700 1 -- 172.21.15.155:0/311404508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a34101af0 msgr2=0x7f0a34101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:24.728 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.726+0000 7f0a3ae69700 1 --2- 172.21.15.155:0/311404508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a34101af0 0x7f0a34101ec0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0a28004940 tx=0x7f0a28009e30 comp rx=0 tx=0).stop 2023-12-16T06:02:24.729 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.726+0000 7f0a3ae69700 1 -- 172.21.15.155:0/311404508 shutdown_connections 2023-12-16T06:02:24.729 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.726+0000 7f0a3ae69700 1 --2- 172.21.15.155:0/311404508 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a340fbb30 0x7f0a340fbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:24.729 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.726+0000 7f0a3ae69700 1 --2- 172.21.15.155:0/311404508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a34101af0 0x7f0a34101ec0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:24.729 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.726+0000 7f0a3ae69700 1 -- 172.21.15.155:0/311404508 >> 172.21.15.155:0/311404508 conn(0x7f0a340f7690 msgr2=0x7f0a340f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:02:24.729 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.726+0000 7f0a3ae69700 1 -- 172.21.15.155:0/311404508 shutdown_connections 2023-12-16T06:02:24.729 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.726+0000 7f0a3ae69700 1 -- 172.21.15.155:0/311404508 wait complete. 2023-12-16T06:02:24.730 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.726+0000 7f0a3ae69700 1 Processor -- start 2023-12-16T06:02:24.730 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.726+0000 7f0a3ae69700 1 -- start start 2023-12-16T06:02:24.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.727+0000 7f0a3ae69700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a340fbb30 0x7f0a34112550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:24.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.727+0000 7f0a3ae69700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a34101af0 0x7f0a34112a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:24.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.727+0000 7f0a3ae69700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a341130e0 con 0x7f0a34101af0 2023-12-16T06:02:24.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.727+0000 7f0a3ae69700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3410c410 con 0x7f0a340fbb30 2023-12-16T06:02:24.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.727+0000 7f0a33fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a34101af0 0x7f0a34112a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:24.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.727+0000 7f0a33fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a34101af0 0x7f0a34112a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44786/0 (socket says 172.21.15.155:44786) 2023-12-16T06:02:24.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.727+0000 7f0a33fff700 1 -- 172.21.15.155:0/95074647 learned_addr learned my addr 172.21.15.155:0/95074647 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:02:24.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.727+0000 7f0a38c05700 1 --2- 172.21.15.155:0/95074647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a340fbb30 0x7f0a34112550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:24.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.727+0000 7f0a33fff700 1 -- 172.21.15.155:0/95074647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a340fbb30 msgr2=0x7f0a34112550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:24.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.727+0000 7f0a33fff700 1 --2- 172.21.15.155:0/95074647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a340fbb30 0x7f0a34112550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:24.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.727+0000 7f0a33fff700 1 -- 172.21.15.155:0/95074647 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a28005040 con 0x7f0a34101af0 2023-12-16T06:02:24.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.727+0000 7f0a33fff700 1 --2- 172.21.15.155:0/95074647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a34101af0 0x7f0a34112a90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000c830 tx=0x7f0a20004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:02:24.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.728+0000 7f0a317fa700 1 -- 172.21.15.155:0/95074647 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a200106f0 con 0x7f0a34101af0 2023-12-16T06:02:24.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.728+0000 7f0a317fa700 1 -- 172.21.15.155:0/95074647 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0a20010d00 con 0x7f0a34101af0 2023-12-16T06:02:24.731 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.728+0000 7f0a3ae69700 1 -- 172.21.15.155:0/95074647 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3410c6f0 con 0x7f0a34101af0 2023-12-16T06:02:24.732 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.728+0000 7f0a317fa700 1 -- 172.21.15.155:0/95074647 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a20012e90 con 0x7f0a34101af0 2023-12-16T06:02:24.732 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.728+0000 7f0a3ae69700 1 -- 172.21.15.155:0/95074647 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3410cc30 con 0x7f0a34101af0 2023-12-16T06:02:24.732 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.729+0000 7f0a3ae69700 1 -- 172.21.15.155:0/95074647 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a34103fa0 con 0x7f0a34101af0 2023-12-16T06:02:24.732 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.729+0000 7f0a317fa700 1 -- 172.21.15.155:0/95074647 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f0a20010850 con 0x7f0a34101af0 2023-12-16T06:02:24.732 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.730+0000 7f0a317fa700 1 --2- 172.21.15.155:0/95074647 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f0a2406ce60 0x7f0a2406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:24.733 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.730+0000 7f0a317fa700 1 -- 172.21.15.155:0/95074647 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f0a2008cd70 con 0x7f0a34101af0 2023-12-16T06:02:24.733 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.730+0000 7f0a38c05700 1 --2- 172.21.15.155:0/95074647 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f0a2406ce60 0x7f0a2406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:24.733 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.730+0000 7f0a38c05700 1 --2- 172.21.15.155:0/95074647 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f0a2406ce60 0x7f0a2406f310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0a28004f90 tx=0x7f0a28009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:02:24.736 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.734+0000 7f0a317fa700 1 -- 172.21.15.155:0/95074647 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f0a2005a790 con 0x7f0a34101af0 2023-12-16T06:02:24.936 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.934+0000 7f0a3ae69700 1 -- 172.21.15.155:0/95074647 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a3404bc20 con 0x7f0a2406ce60 2023-12-16T06:02:24.946 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.944+0000 7f0a317fa700 1 -- 172.21.15.155:0/95074647 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0a280096f0 con 0x7f0a2406ce60 2023-12-16T06:02:24.946 INFO:teuthology.orchestra.run.smithi155.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T06:02:24.947 INFO:teuthology.orchestra.run.smithi155.stdout:alertmanager.smithi155 smithi155 *:9093,9094 running (4m) 68s ago 11m 29.5M - 0.25.0 c8568f914cd2 e1da85d6fc09 2023-12-16T06:02:24.947 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi155 smithi155 running (2m) 68s ago 11m 7470k - 19.0.0-191-g6d933094 a29c258b5d6f 6599d6adc8fa 2023-12-16T06:02:24.947 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi156 smithi156 running (2m) 12s ago 11m 7448k - 19.0.0-191-g6d933094 a29c258b5d6f 8129878ae56e 2023-12-16T06:02:24.947 INFO:teuthology.orchestra.run.smithi155.stdout:grafana.smithi155 smithi155 *:3000 running (3m) 68s ago 11m 83.3M - 9.4.12 a0ea5e3c46d9 a16c84704784 2023-12-16T06:02:24.947 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.bzsxjw smithi155 running (7m) 68s ago 7m 4746M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6bcabf94a5c3 2023-12-16T06:02:24.947 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.vicpis smithi155 running (7m) 68s ago 7m 669M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 afa64e1ef8da 2023-12-16T06:02:24.947 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.fasing smithi156 running (7m) 12s ago 7m 539M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 7d97160bda7c 2023-12-16T06:02:24.947 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.qvgmfj smithi156 running (7m) 12s ago 7m 5969M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4018b2f2e27e 2023-12-16T06:02:24.947 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi155.maowdn smithi155 *:8443,9283,8765 running (5m) 68s ago 12m 513M - 19.0.0-191-g6d933094 a29c258b5d6f ee39089d18d3 2023-12-16T06:02:24.947 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi156.pclong smithi156 *:8443,9283,8765 running (4m) 12s ago 10m 449M - 19.0.0-191-g6d933094 a29c258b5d6f 673376e357e8 2023-12-16T06:02:24.947 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi155 smithi155 running (3m) 68s ago 12m 67.4M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 19eb23d9f064 2023-12-16T06:02:24.947 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi156 smithi156 running (2m) 12s ago 10m 58.4M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 62dacb4d7a17 2023-12-16T06:02:24.947 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi155 smithi155 *:9100 running (4m) 68s ago 11m 15.7M - 1.5.0 0da6a335fe13 6f0f1f68f191 2023-12-16T06:02:24.947 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi156 smithi156 *:9100 running (4m) 12s ago 10m 18.9M - 1.5.0 0da6a335fe13 c4595a7b1707 2023-12-16T06:02:24.947 INFO:teuthology.orchestra.run.smithi155.stdout:osd.0 smithi155 running (2m) 68s ago 10m 122M 1568M 19.0.0-191-g6d933094 a29c258b5d6f f5b1d720ac4f 2023-12-16T06:02:24.948 INFO:teuthology.orchestra.run.smithi155.stdout:osd.1 smithi155 running (100s) 68s ago 10m 125M 1568M 19.0.0-191-g6d933094 a29c258b5d6f badaf737af87 2023-12-16T06:02:24.948 INFO:teuthology.orchestra.run.smithi155.stdout:osd.2 smithi155 running (71s) 68s ago 9m 12.6M 1568M 19.0.0-191-g6d933094 a29c258b5d6f 9a08b6ae1253 2023-12-16T06:02:24.948 INFO:teuthology.orchestra.run.smithi155.stdout:osd.3 smithi156 running (42s) 12s ago 9m 130M 2592M 19.0.0-191-g6d933094 a29c258b5d6f 3a04979138d3 2023-12-16T06:02:24.948 INFO:teuthology.orchestra.run.smithi155.stdout:osd.4 smithi156 running (14s) 12s ago 9m 12.4M 2592M 19.0.0-191-g6d933094 a29c258b5d6f a4a0224a1f37 2023-12-16T06:02:24.948 INFO:teuthology.orchestra.run.smithi155.stdout:osd.5 smithi156 running (8m) 12s ago 8m 883M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 84b2c33eb0e1 2023-12-16T06:02:24.948 INFO:teuthology.orchestra.run.smithi155.stdout:prometheus.smithi155 smithi155 *:9095 running (4m) 68s ago 11m 66.6M - 2.43.0 a07b618ecd1d 26bb7cfc1b8b 2023-12-16T06:02:24.949 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.946+0000 7f0a3ae69700 1 -- 172.21.15.155:0/95074647 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f0a2406ce60 msgr2=0x7f0a2406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:24.949 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.946+0000 7f0a3ae69700 1 --2- 172.21.15.155:0/95074647 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f0a2406ce60 0x7f0a2406f310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0a28004f90 tx=0x7f0a28009e30 comp rx=0 tx=0).stop 2023-12-16T06:02:24.949 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.946+0000 7f0a3ae69700 1 -- 172.21.15.155:0/95074647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a34101af0 msgr2=0x7f0a34112a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:24.949 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.946+0000 7f0a3ae69700 1 --2- 172.21.15.155:0/95074647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a34101af0 0x7f0a34112a90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000c830 tx=0x7f0a20004470 comp rx=0 tx=0).stop 2023-12-16T06:02:24.949 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.946+0000 7f0a3ae69700 1 -- 172.21.15.155:0/95074647 shutdown_connections 2023-12-16T06:02:24.949 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.946+0000 7f0a3ae69700 1 --2- 172.21.15.155:0/95074647 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f0a2406ce60 0x7f0a2406f310 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:24.949 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.946+0000 7f0a3ae69700 1 --2- 172.21.15.155:0/95074647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a340fbb30 0x7f0a34112550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:24.949 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.946+0000 7f0a3ae69700 1 --2- 172.21.15.155:0/95074647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a34101af0 0x7f0a34112a90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:24.949 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.946+0000 7f0a3ae69700 1 -- 172.21.15.155:0/95074647 >> 172.21.15.155:0/95074647 conn(0x7f0a340f7690 msgr2=0x7f0a340f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:02:24.949 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.946+0000 7f0a3ae69700 1 -- 172.21.15.155:0/95074647 shutdown_connections 2023-12-16T06:02:24.949 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:24.946+0000 7f0a3ae69700 1 -- 172.21.15.155:0/95074647 wait complete. 2023-12-16T06:02:25.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.046+0000 7f10f4c5d700 1 -- 172.21.15.155:0/3575832455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10f0101b00 msgr2=0x7f10f0101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:25.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.046+0000 7f10f4c5d700 1 --2- 172.21.15.155:0/3575832455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10f0101b00 0x7f10f0101ed0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f10e0004940 tx=0x7f10e0009e30 comp rx=0 tx=0).stop 2023-12-16T06:02:25.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.046+0000 7f10f4c5d700 1 -- 172.21.15.155:0/3575832455 shutdown_connections 2023-12-16T06:02:25.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.046+0000 7f10f4c5d700 1 --2- 172.21.15.155:0/3575832455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10f0102410 0x7f10f00fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:25.050 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.046+0000 7f10f4c5d700 1 --2- 172.21.15.155:0/3575832455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10f0101b00 0x7f10f0101ed0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:25.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.046+0000 7f10f4c5d700 1 -- 172.21.15.155:0/3575832455 >> 172.21.15.155:0/3575832455 conn(0x7f10f00711a0 msgr2=0x7f10f00715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:02:25.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.046+0000 7f10f4c5d700 1 -- 172.21.15.155:0/3575832455 shutdown_connections 2023-12-16T06:02:25.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.046+0000 7f10f4c5d700 1 -- 172.21.15.155:0/3575832455 wait complete. 2023-12-16T06:02:25.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.047+0000 7f10f4c5d700 1 Processor -- start 2023-12-16T06:02:25.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.047+0000 7f10f4c5d700 1 -- start start 2023-12-16T06:02:25.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.047+0000 7f10f4c5d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10f0101b00 0x7f10f010e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:25.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.047+0000 7f10f4c5d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10f0102410 0x7f10f010ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:25.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.047+0000 7f10f4c5d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f010f170 con 0x7f10f0102410 2023-12-16T06:02:25.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.047+0000 7f10f4c5d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f010f2b0 con 0x7f10f0101b00 2023-12-16T06:02:25.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.047+0000 7f10edd9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10f0102410 0x7f10f010ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:25.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.047+0000 7f10edd9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10f0102410 0x7f10f010ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44796/0 (socket says 172.21.15.155:44796) 2023-12-16T06:02:25.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.047+0000 7f10edd9b700 1 -- 172.21.15.155:0/19146302 learned_addr learned my addr 172.21.15.155:0/19146302 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:02:25.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.047+0000 7f10ee59c700 1 --2- 172.21.15.155:0/19146302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10f0101b00 0x7f10f010e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:25.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.047+0000 7f10edd9b700 1 -- 172.21.15.155:0/19146302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10f0101b00 msgr2=0x7f10f010e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:25.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.047+0000 7f10edd9b700 1 --2- 172.21.15.155:0/19146302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10f0101b00 0x7f10f010e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:25.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.047+0000 7f10edd9b700 1 -- 172.21.15.155:0/19146302 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e0005040 con 0x7f10f0102410 2023-12-16T06:02:25.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.047+0000 7f10edd9b700 1 --2- 172.21.15.155:0/19146302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10f0102410 0x7f10f010ebe0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f10e4002a50 tx=0x7f10e4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:02:25.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.047+0000 7f10deffd700 1 -- 172.21.15.155:0/19146302 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10e4007cc0 con 0x7f10f0102410 2023-12-16T06:02:25.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.047+0000 7f10deffd700 1 -- 172.21.15.155:0/19146302 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f10e400f040 con 0x7f10f0102410 2023-12-16T06:02:25.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.047+0000 7f10f4c5d700 1 -- 172.21.15.155:0/19146302 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f0117610 con 0x7f10f0102410 2023-12-16T06:02:25.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.048+0000 7f10deffd700 1 -- 172.21.15.155:0/19146302 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10e400d920 con 0x7f10f0102410 2023-12-16T06:02:25.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.048+0000 7f10f4c5d700 1 -- 172.21.15.155:0/19146302 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f0117b20 con 0x7f10f0102410 2023-12-16T06:02:25.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.048+0000 7f10f4c5d700 1 -- 172.21.15.155:0/19146302 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f00fee60 con 0x7f10f0102410 2023-12-16T06:02:25.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.049+0000 7f10deffd700 1 -- 172.21.15.155:0/19146302 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f10e4009680 con 0x7f10f0102410 2023-12-16T06:02:25.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.049+0000 7f10deffd700 1 --2- 172.21.15.155:0/19146302 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f10d806ce60 0x7f10d806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:25.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.049+0000 7f10deffd700 1 -- 172.21.15.155:0/19146302 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f10e408bfb0 con 0x7f10f0102410 2023-12-16T06:02:25.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.049+0000 7f10ee59c700 1 --2- 172.21.15.155:0/19146302 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f10d806ce60 0x7f10d806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:25.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.050+0000 7f10ee59c700 1 --2- 172.21.15.155:0/19146302 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f10d806ce60 0x7f10d806f310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f10e0004560 tx=0x7f10e0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:02:25.056 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.054+0000 7f10deffd700 1 -- 172.21.15.155:0/19146302 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f10e4055ec0 con 0x7f10f0102410 2023-12-16T06:02:25.330 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.327+0000 7f10f4c5d700 1 -- 172.21.15.155:0/19146302 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f10f0072cc0 con 0x7f10f0102410 2023-12-16T06:02:25.330 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.328+0000 7f10deffd700 1 -- 172.21.15.155:0/19146302 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7f10e40594e0 con 0x7f10f0102410 2023-12-16T06:02:25.331 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T06:02:25.331 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": { 2023-12-16T06:02:25.331 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T06:02:25.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:02:25.331 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": { 2023-12-16T06:02:25.331 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T06:02:25.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:02:25.331 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": { 2023-12-16T06:02:25.331 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 1, 2023-12-16T06:02:25.331 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 5 2023-12-16T06:02:25.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:02:25.331 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2023-12-16T06:02:25.331 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T06:02:25.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:02:25.332 INFO:teuthology.orchestra.run.smithi155.stdout: "overall": { 2023-12-16T06:02:25.332 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 5, 2023-12-16T06:02:25.332 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 9 2023-12-16T06:02:25.332 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-12-16T06:02:25.332 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T06:02:25.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.330+0000 7f10f4c5d700 1 -- 172.21.15.155:0/19146302 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f10d806ce60 msgr2=0x7f10d806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:25.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.330+0000 7f10f4c5d700 1 --2- 172.21.15.155:0/19146302 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f10d806ce60 0x7f10d806f310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f10e0004560 tx=0x7f10e0009e30 comp rx=0 tx=0).stop 2023-12-16T06:02:25.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.330+0000 7f10f4c5d700 1 -- 172.21.15.155:0/19146302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10f0102410 msgr2=0x7f10f010ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:25.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.330+0000 7f10f4c5d700 1 --2- 172.21.15.155:0/19146302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10f0102410 0x7f10f010ebe0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f10e4002a50 tx=0x7f10e4004600 comp rx=0 tx=0).stop 2023-12-16T06:02:25.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.330+0000 7f10f4c5d700 1 -- 172.21.15.155:0/19146302 shutdown_connections 2023-12-16T06:02:25.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.330+0000 7f10f4c5d700 1 --2- 172.21.15.155:0/19146302 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f10d806ce60 0x7f10d806f310 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:25.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.330+0000 7f10f4c5d700 1 --2- 172.21.15.155:0/19146302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10f0101b00 0x7f10f010e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:25.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.330+0000 7f10f4c5d700 1 --2- 172.21.15.155:0/19146302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10f0102410 0x7f10f010ebe0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:25.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.330+0000 7f10f4c5d700 1 -- 172.21.15.155:0/19146302 >> 172.21.15.155:0/19146302 conn(0x7f10f00711a0 msgr2=0x7f10f00fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:02:25.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.330+0000 7f10f4c5d700 1 -- 172.21.15.155:0/19146302 shutdown_connections 2023-12-16T06:02:25.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.330+0000 7f10f4c5d700 1 -- 172.21.15.155:0/19146302 wait complete. 2023-12-16T06:02:25.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.431+0000 7fb02728c700 1 -- 172.21.15.155:0/3271849343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb020101af0 msgr2=0x7fb020101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:25.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.431+0000 7fb02728c700 1 --2- 172.21.15.155:0/3271849343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb020101af0 0x7fb020101ec0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb010004940 tx=0x7fb010009e30 comp rx=0 tx=0).stop 2023-12-16T06:02:25.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.431+0000 7fb02728c700 1 -- 172.21.15.155:0/3271849343 shutdown_connections 2023-12-16T06:02:25.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.431+0000 7fb02728c700 1 --2- 172.21.15.155:0/3271849343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0200fbb30 0x7fb0200fbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:25.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.431+0000 7fb02728c700 1 --2- 172.21.15.155:0/3271849343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb020101af0 0x7fb020101ec0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:25.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.431+0000 7fb02728c700 1 -- 172.21.15.155:0/3271849343 >> 172.21.15.155:0/3271849343 conn(0x7fb0200f7690 msgr2=0x7fb0200f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:02:25.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.431+0000 7fb02728c700 1 -- 172.21.15.155:0/3271849343 shutdown_connections 2023-12-16T06:02:25.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.431+0000 7fb02728c700 1 -- 172.21.15.155:0/3271849343 wait complete. 2023-12-16T06:02:25.436 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.432+0000 7fb02728c700 1 Processor -- start 2023-12-16T06:02:25.436 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.432+0000 7fb02728c700 1 -- start start 2023-12-16T06:02:25.436 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.432+0000 7fb02728c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0200fbb30 0x7fb02010e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:25.436 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.432+0000 7fb02728c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb020101af0 0x7fb02010ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:25.436 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.432+0000 7fb02728c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02010f260 con 0x7fb020101af0 2023-12-16T06:02:25.436 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.432+0000 7fb02728c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02010f3d0 con 0x7fb0200fbb30 2023-12-16T06:02:25.436 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.432+0000 7fb024827700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb020101af0 0x7fb02010ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:25.436 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.432+0000 7fb024827700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb020101af0 0x7fb02010ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44822/0 (socket says 172.21.15.155:44822) 2023-12-16T06:02:25.437 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.432+0000 7fb024827700 1 -- 172.21.15.155:0/216099516 learned_addr learned my addr 172.21.15.155:0/216099516 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:02:25.437 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.432+0000 7fb025028700 1 --2- 172.21.15.155:0/216099516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0200fbb30 0x7fb02010e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:25.437 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.432+0000 7fb024827700 1 -- 172.21.15.155:0/216099516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0200fbb30 msgr2=0x7fb02010e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:25.437 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.433+0000 7fb024827700 1 --2- 172.21.15.155:0/216099516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0200fbb30 0x7fb02010e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:25.437 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.433+0000 7fb024827700 1 -- 172.21.15.155:0/216099516 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb010005040 con 0x7fb020101af0 2023-12-16T06:02:25.437 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.433+0000 7fb024827700 1 --2- 172.21.15.155:0/216099516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb020101af0 0x7fb02010ec10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00c860 tx=0x7fb01c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:02:25.437 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.433+0000 7fb015ffb700 1 -- 172.21.15.155:0/216099516 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb01c00a760 con 0x7fb020101af0 2023-12-16T06:02:25.437 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.433+0000 7fb015ffb700 1 -- 172.21.15.155:0/216099516 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb01c00ad70 con 0x7fb020101af0 2023-12-16T06:02:25.437 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.433+0000 7fb02728c700 1 -- 172.21.15.155:0/216099516 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0201176a0 con 0x7fb020101af0 2023-12-16T06:02:25.437 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.433+0000 7fb015ffb700 1 -- 172.21.15.155:0/216099516 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb01c0113a0 con 0x7fb020101af0 2023-12-16T06:02:25.437 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.433+0000 7fb02728c700 1 -- 172.21.15.155:0/216099516 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb020117be0 con 0x7fb020101af0 2023-12-16T06:02:25.438 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.434+0000 7fb02728c700 1 -- 172.21.15.155:0/216099516 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb020103fa0 con 0x7fb020101af0 2023-12-16T06:02:25.438 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.434+0000 7fb015ffb700 1 -- 172.21.15.155:0/216099516 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7fb01c012400 con 0x7fb020101af0 2023-12-16T06:02:25.438 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.435+0000 7fb015ffb700 1 --2- 172.21.15.155:0/216099516 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fb00c06ce60 0x7fb00c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:25.438 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.435+0000 7fb015ffb700 1 -- 172.21.15.155:0/216099516 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb01c08c220 con 0x7fb020101af0 2023-12-16T06:02:25.438 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.435+0000 7fb025028700 1 --2- 172.21.15.155:0/216099516 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fb00c06ce60 0x7fb00c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:25.439 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.435+0000 7fb025028700 1 --2- 172.21.15.155:0/216099516 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fb00c06ce60 0x7fb00c06f310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb010004f90 tx=0x7fb010009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:02:25.442 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.439+0000 7fb015ffb700 1 -- 172.21.15.155:0/216099516 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fb01c056270 con 0x7fb020101af0 2023-12-16T06:02:25.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:25 smithi155 ceph-mon[217407]: pgmap v120: 65 pgs: 65 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2023-12-16T06:02:25.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:25 smithi155 ceph-mon[217407]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:02:25.677 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.674+0000 7fb02728c700 1 -- 172.21.15.155:0/216099516 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb02004bbb0 con 0x7fb020101af0 2023-12-16T06:02:25.677 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.675+0000 7fb015ffb700 1 -- 172.21.15.155:0/216099516 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1873 (secure 0 0 0) 0x7fb01c059890 con 0x7fb020101af0 2023-12-16T06:02:25.677 INFO:teuthology.orchestra.run.smithi155.stdout:e18 2023-12-16T06:02:25.677 INFO:teuthology.orchestra.run.smithi155.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T06:02:25.677 INFO:teuthology.orchestra.run.smithi155.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T06:02:25.678 INFO:teuthology.orchestra.run.smithi155.stdout:legacy client fscid: 1 2023-12-16T06:02:25.678 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T06:02:25.678 INFO:teuthology.orchestra.run.smithi155.stdout:Filesystem 'cephfs' (1) 2023-12-16T06:02:25.678 INFO:teuthology.orchestra.run.smithi155.stdout:fs_name cephfs 2023-12-16T06:02:25.678 INFO:teuthology.orchestra.run.smithi155.stdout:epoch 18 2023-12-16T06:02:25.678 INFO:teuthology.orchestra.run.smithi155.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-16T06:02:25.678 INFO:teuthology.orchestra.run.smithi155.stdout:created 2023-12-16T05:54:25.897091+0000 2023-12-16T06:02:25.678 INFO:teuthology.orchestra.run.smithi155.stdout:modified 2023-12-16T06:00:59.697972+0000 2023-12-16T06:02:25.678 INFO:teuthology.orchestra.run.smithi155.stdout:tableserver 0 2023-12-16T06:02:25.678 INFO:teuthology.orchestra.run.smithi155.stdout:root 0 2023-12-16T06:02:25.678 INFO:teuthology.orchestra.run.smithi155.stdout:session_timeout 60 2023-12-16T06:02:25.678 INFO:teuthology.orchestra.run.smithi155.stdout:session_autoclose 300 2023-12-16T06:02:25.678 INFO:teuthology.orchestra.run.smithi155.stdout:max_file_size 1099511627776 2023-12-16T06:02:25.678 INFO:teuthology.orchestra.run.smithi155.stdout:max_xattr_size 65536 2023-12-16T06:02:25.678 INFO:teuthology.orchestra.run.smithi155.stdout:required_client_features {} 2023-12-16T06:02:25.679 INFO:teuthology.orchestra.run.smithi155.stdout:last_failure 0 2023-12-16T06:02:25.679 INFO:teuthology.orchestra.run.smithi155.stdout:last_failure_osd_epoch 0 2023-12-16T06:02:25.679 INFO:teuthology.orchestra.run.smithi155.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T06:02:25.679 INFO:teuthology.orchestra.run.smithi155.stdout:max_mds 2 2023-12-16T06:02:25.679 INFO:teuthology.orchestra.run.smithi155.stdout:in 0,1 2023-12-16T06:02:25.679 INFO:teuthology.orchestra.run.smithi155.stdout:up {0=14456,1=24281} 2023-12-16T06:02:25.679 INFO:teuthology.orchestra.run.smithi155.stdout:failed 2023-12-16T06:02:25.679 INFO:teuthology.orchestra.run.smithi155.stdout:damaged 2023-12-16T06:02:25.679 INFO:teuthology.orchestra.run.smithi155.stdout:stopped 2023-12-16T06:02:25.679 INFO:teuthology.orchestra.run.smithi155.stdout:data_pools [3] 2023-12-16T06:02:25.679 INFO:teuthology.orchestra.run.smithi155.stdout:metadata_pool 2 2023-12-16T06:02:25.679 INFO:teuthology.orchestra.run.smithi155.stdout:inline_data disabled 2023-12-16T06:02:25.679 INFO:teuthology.orchestra.run.smithi155.stdout:balancer 2023-12-16T06:02:25.679 INFO:teuthology.orchestra.run.smithi155.stdout:bal_rank_mask -1 2023-12-16T06:02:25.679 INFO:teuthology.orchestra.run.smithi155.stdout:standby_count_wanted 1 2023-12-16T06:02:25.680 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi155.bzsxjw{0:14456} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.155:6826/1416140807,v1:172.21.15.155:6827/1416140807] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T06:02:25.680 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi156.fasing{0:24289} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1763385284,v1:172.21.15.156:6827/1763385284] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T06:02:25.680 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi156.qvgmfj{1:24281} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.156:6824/2823725296,v1:172.21.15.156:6825/2823725296] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T06:02:25.680 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.cephfs.smithi155.vicpis{1:14472} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.155:6828/750006619,v1:172.21.15.155:6829/750006619] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T06:02:25.680 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T06:02:25.680 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T06:02:25.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:25 smithi156 ceph-mon[182000]: pgmap v120: 65 pgs: 65 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2023-12-16T06:02:25.681 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:25 smithi156 ceph-mon[182000]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:02:25.681 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.677+0000 7fb02728c700 1 -- 172.21.15.155:0/216099516 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fb00c06ce60 msgr2=0x7fb00c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:25.681 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.677+0000 7fb02728c700 1 --2- 172.21.15.155:0/216099516 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fb00c06ce60 0x7fb00c06f310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb010004f90 tx=0x7fb010009e30 comp rx=0 tx=0).stop 2023-12-16T06:02:25.681 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.677+0000 7fb02728c700 1 -- 172.21.15.155:0/216099516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb020101af0 msgr2=0x7fb02010ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:25.681 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.677+0000 7fb02728c700 1 --2- 172.21.15.155:0/216099516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb020101af0 0x7fb02010ec10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00c860 tx=0x7fb01c004470 comp rx=0 tx=0).stop 2023-12-16T06:02:25.681 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.677+0000 7fb02728c700 1 -- 172.21.15.155:0/216099516 shutdown_connections 2023-12-16T06:02:25.681 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.677+0000 7fb02728c700 1 --2- 172.21.15.155:0/216099516 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fb00c06ce60 0x7fb00c06f310 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:25.681 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.677+0000 7fb02728c700 1 --2- 172.21.15.155:0/216099516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0200fbb30 0x7fb02010e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:25.682 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.677+0000 7fb02728c700 1 --2- 172.21.15.155:0/216099516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb020101af0 0x7fb02010ec10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:25.682 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.677+0000 7fb02728c700 1 -- 172.21.15.155:0/216099516 >> 172.21.15.155:0/216099516 conn(0x7fb0200f7690 msgr2=0x7fb0200f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:02:25.682 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.677+0000 7fb02728c700 1 -- 172.21.15.155:0/216099516 shutdown_connections 2023-12-16T06:02:25.682 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.677+0000 7fb02728c700 1 -- 172.21.15.155:0/216099516 wait complete. 2023-12-16T06:02:25.682 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 18 2023-12-16T06:02:25.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.778+0000 7f2f4ee2c700 1 -- 172.21.15.155:0/1027168444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f48102410 msgr2=0x7f2f480fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:25.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.778+0000 7f2f4ee2c700 1 --2- 172.21.15.155:0/1027168444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f48102410 0x7f2f480fc2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2f34004940 tx=0x7f2f34009e30 comp rx=0 tx=0).stop 2023-12-16T06:02:25.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.778+0000 7f2f4ee2c700 1 -- 172.21.15.155:0/1027168444 shutdown_connections 2023-12-16T06:02:25.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.778+0000 7f2f4ee2c700 1 --2- 172.21.15.155:0/1027168444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f48102410 0x7f2f480fc2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:25.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.778+0000 7f2f4ee2c700 1 --2- 172.21.15.155:0/1027168444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f48101b00 0x7f2f48101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:25.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.778+0000 7f2f4ee2c700 1 -- 172.21.15.155:0/1027168444 >> 172.21.15.155:0/1027168444 conn(0x7f2f480711a0 msgr2=0x7f2f480715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:02:25.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.778+0000 7f2f4ee2c700 1 -- 172.21.15.155:0/1027168444 shutdown_connections 2023-12-16T06:02:25.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.778+0000 7f2f4ee2c700 1 -- 172.21.15.155:0/1027168444 wait complete. 2023-12-16T06:02:25.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.779+0000 7f2f4ee2c700 1 Processor -- start 2023-12-16T06:02:25.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.779+0000 7f2f4ee2c700 1 -- start start 2023-12-16T06:02:25.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.780+0000 7f2f4ee2c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f48101b00 0x7f2f4810e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:25.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.780+0000 7f2f4ee2c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f48102410 0x7f2f4810ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:25.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.780+0000 7f2f4ee2c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4810f140 con 0x7f2f48102410 2023-12-16T06:02:25.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.780+0000 7f2f4ee2c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4810f280 con 0x7f2f48101b00 2023-12-16T06:02:25.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.780+0000 7f2f47fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f48102410 0x7f2f4810ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:25.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.780+0000 7f2f47fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f48102410 0x7f2f4810ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44844/0 (socket says 172.21.15.155:44844) 2023-12-16T06:02:25.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.780+0000 7f2f47fff700 1 -- 172.21.15.155:0/1167284103 learned_addr learned my addr 172.21.15.155:0/1167284103 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:02:25.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.780+0000 7f2f4cbc8700 1 --2- 172.21.15.155:0/1167284103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f48101b00 0x7f2f4810e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:25.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.780+0000 7f2f47fff700 1 -- 172.21.15.155:0/1167284103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f48101b00 msgr2=0x7f2f4810e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:25.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.780+0000 7f2f47fff700 1 --2- 172.21.15.155:0/1167284103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f48101b00 0x7f2f4810e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:25.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.780+0000 7f2f47fff700 1 -- 172.21.15.155:0/1167284103 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f34005040 con 0x7f2f48102410 2023-12-16T06:02:25.785 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.780+0000 7f2f47fff700 1 --2- 172.21.15.155:0/1167284103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f48102410 0x7f2f4810ebb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2f34000c00 tx=0x7f2f34009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:02:25.785 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.780+0000 7f2f457fa700 1 -- 172.21.15.155:0/1167284103 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f34021070 con 0x7f2f48102410 2023-12-16T06:02:25.785 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.780+0000 7f2f4ee2c700 1 -- 172.21.15.155:0/1167284103 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f48117580 con 0x7f2f48102410 2023-12-16T06:02:25.785 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.780+0000 7f2f457fa700 1 -- 172.21.15.155:0/1167284103 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f3401c400 con 0x7f2f48102410 2023-12-16T06:02:25.785 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.780+0000 7f2f457fa700 1 -- 172.21.15.155:0/1167284103 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f3400e070 con 0x7f2f48102410 2023-12-16T06:02:25.785 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.780+0000 7f2f4ee2c700 1 -- 172.21.15.155:0/1167284103 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f48117a30 con 0x7f2f48102410 2023-12-16T06:02:25.785 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.781+0000 7f2f4ee2c700 1 -- 172.21.15.155:0/1167284103 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f480fee60 con 0x7f2f48102410 2023-12-16T06:02:25.785 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.782+0000 7f2f457fa700 1 -- 172.21.15.155:0/1167284103 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f2f3401c9e0 con 0x7f2f48102410 2023-12-16T06:02:25.786 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.782+0000 7f2f457fa700 1 --2- 172.21.15.155:0/1167284103 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f2f3806ce60 0x7f2f3806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:25.786 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.782+0000 7f2f457fa700 1 -- 172.21.15.155:0/1167284103 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f2f3408d490 con 0x7f2f48102410 2023-12-16T06:02:25.786 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.782+0000 7f2f4cbc8700 1 --2- 172.21.15.155:0/1167284103 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f2f3806ce60 0x7f2f3806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:25.786 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.783+0000 7f2f4cbc8700 1 --2- 172.21.15.155:0/1167284103 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f2f3806ce60 0x7f2f3806f310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c004600 tx=0x7f2f3c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:02:25.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.786+0000 7f2f457fa700 1 -- 172.21.15.155:0/1167284103 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f2f34057440 con 0x7f2f48102410 2023-12-16T06:02:26.002 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:25.999+0000 7f2f4ee2c700 1 -- 172.21.15.155:0/1167284103 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f480fb9e0 con 0x7f2f3806ce60 2023-12-16T06:02:26.003 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.001+0000 7f2f457fa700 1 -- 172.21.15.155:0/1167284103 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f2f480fb9e0 con 0x7f2f3806ce60 2023-12-16T06:02:26.003 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T06:02:26.003 INFO:teuthology.orchestra.run.smithi155.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T06:02:26.004 INFO:teuthology.orchestra.run.smithi155.stdout: "in_progress": true, 2023-12-16T06:02:26.004 INFO:teuthology.orchestra.run.smithi155.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T06:02:26.004 INFO:teuthology.orchestra.run.smithi155.stdout: "services_complete": [ 2023-12-16T06:02:26.004 INFO:teuthology.orchestra.run.smithi155.stdout: "crash", 2023-12-16T06:02:26.004 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr", 2023-12-16T06:02:26.004 INFO:teuthology.orchestra.run.smithi155.stdout: "mon" 2023-12-16T06:02:26.004 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-12-16T06:02:26.004 INFO:teuthology.orchestra.run.smithi155.stdout: "progress": "11/21 daemons upgraded", 2023-12-16T06:02:26.004 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "Currently upgrading osd daemons", 2023-12-16T06:02:26.004 INFO:teuthology.orchestra.run.smithi155.stdout: "is_paused": false 2023-12-16T06:02:26.004 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T06:02:26.006 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.003+0000 7f2f4ee2c700 1 -- 172.21.15.155:0/1167284103 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f2f3806ce60 msgr2=0x7f2f3806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:26.006 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.003+0000 7f2f4ee2c700 1 --2- 172.21.15.155:0/1167284103 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f2f3806ce60 0x7f2f3806f310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c004600 tx=0x7f2f3c00b040 comp rx=0 tx=0).stop 2023-12-16T06:02:26.006 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.003+0000 7f2f4ee2c700 1 -- 172.21.15.155:0/1167284103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f48102410 msgr2=0x7f2f4810ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:26.006 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.003+0000 7f2f4ee2c700 1 --2- 172.21.15.155:0/1167284103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f48102410 0x7f2f4810ebb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2f34000c00 tx=0x7f2f34009e30 comp rx=0 tx=0).stop 2023-12-16T06:02:26.006 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.003+0000 7f2f4ee2c700 1 -- 172.21.15.155:0/1167284103 shutdown_connections 2023-12-16T06:02:26.006 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.003+0000 7f2f4ee2c700 1 --2- 172.21.15.155:0/1167284103 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f2f3806ce60 0x7f2f3806f310 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:26.007 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.003+0000 7f2f4ee2c700 1 --2- 172.21.15.155:0/1167284103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f48101b00 0x7f2f4810e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:26.007 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.003+0000 7f2f4ee2c700 1 --2- 172.21.15.155:0/1167284103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f48102410 0x7f2f4810ebb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:26.007 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.003+0000 7f2f4ee2c700 1 -- 172.21.15.155:0/1167284103 >> 172.21.15.155:0/1167284103 conn(0x7f2f480711a0 msgr2=0x7f2f480fa1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:02:26.007 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.003+0000 7f2f4ee2c700 1 -- 172.21.15.155:0/1167284103 shutdown_connections 2023-12-16T06:02:26.007 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.003+0000 7f2f4ee2c700 1 -- 172.21.15.155:0/1167284103 wait complete. 2023-12-16T06:02:26.107 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.104+0000 7f476a84b700 1 -- 172.21.15.155:0/473410273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4764101af0 msgr2=0x7f4764101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:26.107 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.104+0000 7f476a84b700 1 --2- 172.21.15.155:0/473410273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4764101af0 0x7f4764101ec0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4754004940 tx=0x7f4754009e30 comp rx=0 tx=0).stop 2023-12-16T06:02:26.107 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.104+0000 7f476a84b700 1 -- 172.21.15.155:0/473410273 shutdown_connections 2023-12-16T06:02:26.107 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.104+0000 7f476a84b700 1 --2- 172.21.15.155:0/473410273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47640fbb30 0x7f47640fbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:26.107 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.104+0000 7f476a84b700 1 --2- 172.21.15.155:0/473410273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4764101af0 0x7f4764101ec0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:26.107 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.104+0000 7f476a84b700 1 -- 172.21.15.155:0/473410273 >> 172.21.15.155:0/473410273 conn(0x7f47640f7690 msgr2=0x7f47640f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:02:26.107 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.104+0000 7f476a84b700 1 -- 172.21.15.155:0/473410273 shutdown_connections 2023-12-16T06:02:26.107 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.104+0000 7f476a84b700 1 -- 172.21.15.155:0/473410273 wait complete. 2023-12-16T06:02:26.109 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.105+0000 7f476a84b700 1 Processor -- start 2023-12-16T06:02:26.109 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.105+0000 7f476a84b700 1 -- start start 2023-12-16T06:02:26.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.105+0000 7f476a84b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47640fbb30 0x7f47641124e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:26.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.105+0000 7f476a84b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4764101af0 0x7f4764112a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:26.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.105+0000 7f476a84b700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4764113070 con 0x7f4764101af0 2023-12-16T06:02:26.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.105+0000 7f476a84b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476410c3a0 con 0x7f47640fbb30 2023-12-16T06:02:26.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.105+0000 7f47637fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4764101af0 0x7f4764112a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:26.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.105+0000 7f47637fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4764101af0 0x7f4764112a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44864/0 (socket says 172.21.15.155:44864) 2023-12-16T06:02:26.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.105+0000 7f47637fe700 1 -- 172.21.15.155:0/225482178 learned_addr learned my addr 172.21.15.155:0/225482178 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:02:26.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.106+0000 7f4763fff700 1 --2- 172.21.15.155:0/225482178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47640fbb30 0x7f47641124e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:26.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.106+0000 7f47637fe700 1 -- 172.21.15.155:0/225482178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47640fbb30 msgr2=0x7f47641124e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:26.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.106+0000 7f47637fe700 1 --2- 172.21.15.155:0/225482178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47640fbb30 0x7f47641124e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:26.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.106+0000 7f47637fe700 1 -- 172.21.15.155:0/225482178 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4754005040 con 0x7f4764101af0 2023-12-16T06:02:26.111 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.106+0000 7f47637fe700 1 --2- 172.21.15.155:0/225482178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4764101af0 0x7f4764112a20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4758002a80 tx=0x7f47580046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:02:26.111 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.106+0000 7f4760ff9700 1 -- 172.21.15.155:0/225482178 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4758007cc0 con 0x7f4764101af0 2023-12-16T06:02:26.111 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.106+0000 7f4760ff9700 1 -- 172.21.15.155:0/225482178 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f475800f040 con 0x7f4764101af0 2023-12-16T06:02:26.111 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.106+0000 7f476a84b700 1 -- 172.21.15.155:0/225482178 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476410c680 con 0x7f4764101af0 2023-12-16T06:02:26.111 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.106+0000 7f4760ff9700 1 -- 172.21.15.155:0/225482178 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4758009640 con 0x7f4764101af0 2023-12-16T06:02:26.111 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.106+0000 7f476a84b700 1 -- 172.21.15.155:0/225482178 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476410cbc0 con 0x7f4764101af0 2023-12-16T06:02:26.111 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.107+0000 7f476a84b700 1 -- 172.21.15.155:0/225482178 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4764103fa0 con 0x7f4764101af0 2023-12-16T06:02:26.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.107+0000 7f4760ff9700 1 -- 172.21.15.155:0/225482178 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f47580097a0 con 0x7f4764101af0 2023-12-16T06:02:26.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.108+0000 7f4760ff9700 1 --2- 172.21.15.155:0/225482178 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f474c06ce60 0x7f474c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:26.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.108+0000 7f4763fff700 1 --2- 172.21.15.155:0/225482178 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f474c06ce60 0x7f474c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:26.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.108+0000 7f4760ff9700 1 -- 172.21.15.155:0/225482178 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f475808ba60 con 0x7f4764101af0 2023-12-16T06:02:26.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.108+0000 7f4763fff700 1 --2- 172.21.15.155:0/225482178 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f474c06ce60 0x7f474c06f310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4754004f90 tx=0x7f4754009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:02:26.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.113+0000 7f4760ff9700 1 -- 172.21.15.155:0/225482178 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f4758059420 con 0x7f4764101af0 2023-12-16T06:02:26.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.387+0000 7f476a84b700 1 -- 172.21.15.155:0/225482178 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f476404bb80 con 0x7f4764101af0 2023-12-16T06:02:26.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.387+0000 7f4760ff9700 1 -- 172.21.15.155:0/225482178 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f4758058fb0 con 0x7f4764101af0 2023-12-16T06:02:26.390 INFO:teuthology.orchestra.run.smithi155.stdout:HEALTH_OK 2023-12-16T06:02:26.392 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.389+0000 7f476a84b700 1 -- 172.21.15.155:0/225482178 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f474c06ce60 msgr2=0x7f474c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:26.392 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.389+0000 7f476a84b700 1 --2- 172.21.15.155:0/225482178 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f474c06ce60 0x7f474c06f310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4754004f90 tx=0x7f4754009e30 comp rx=0 tx=0).stop 2023-12-16T06:02:26.392 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.389+0000 7f476a84b700 1 -- 172.21.15.155:0/225482178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4764101af0 msgr2=0x7f4764112a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:26.392 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.389+0000 7f476a84b700 1 --2- 172.21.15.155:0/225482178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4764101af0 0x7f4764112a20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4758002a80 tx=0x7f47580046b0 comp rx=0 tx=0).stop 2023-12-16T06:02:26.392 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.389+0000 7f476a84b700 1 -- 172.21.15.155:0/225482178 shutdown_connections 2023-12-16T06:02:26.392 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.389+0000 7f476a84b700 1 --2- 172.21.15.155:0/225482178 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f474c06ce60 0x7f474c06f310 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:26.392 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.389+0000 7f476a84b700 1 --2- 172.21.15.155:0/225482178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47640fbb30 0x7f47641124e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:26.393 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.389+0000 7f476a84b700 1 --2- 172.21.15.155:0/225482178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4764101af0 0x7f4764112a20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:26.393 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.389+0000 7f476a84b700 1 -- 172.21.15.155:0/225482178 >> 172.21.15.155:0/225482178 conn(0x7f47640f7690 msgr2=0x7f47640f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:02:26.393 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.390+0000 7f476a84b700 1 -- 172.21.15.155:0/225482178 shutdown_connections 2023-12-16T06:02:26.393 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:26.390+0000 7f476a84b700 1 -- 172.21.15.155:0/225482178 wait complete. 2023-12-16T06:02:26.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:26 smithi155 ceph-mon[217407]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:02:26.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:26 smithi155 ceph-mon[217407]: from='client.34296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:02:26.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:26 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/19146302' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:02:26.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:26 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/216099516' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T06:02:26.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:26 smithi156 ceph-mon[182000]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:02:26.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:26 smithi156 ceph-mon[182000]: from='client.34296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:02:26.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:26 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/19146302' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:02:26.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:26 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/216099516' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T06:02:27.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:27 smithi155 ceph-mon[217407]: from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:02:27.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:27 smithi155 ceph-mon[217407]: pgmap v121: 65 pgs: 65 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2023-12-16T06:02:27.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:27 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/225482178' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T06:02:27.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:27 smithi156 ceph-mon[182000]: from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:02:27.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:27 smithi156 ceph-mon[182000]: pgmap v121: 65 pgs: 65 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2023-12-16T06:02:27.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:27 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/225482178' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T06:02:29.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:29 smithi155 ceph-mon[217407]: pgmap v122: 65 pgs: 65 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2023-12-16T06:02:29.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:29 smithi156 ceph-mon[182000]: pgmap v122: 65 pgs: 65 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2023-12-16T06:02:31.532 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:31 smithi156 ceph-mon[182000]: pgmap v123: 65 pgs: 65 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-16T06:02:31.532 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:31 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:31.532 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:31 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T06:02:31.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:31 smithi155 ceph-mon[217407]: pgmap v123: 65 pgs: 65 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-16T06:02:31.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:31 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:31.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:31 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T06:02:32.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:32 smithi156 ceph-mon[182000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T06:02:32.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:32 smithi156 ceph-mon[182000]: Upgrade: osd.5 is safe to restart 2023-12-16T06:02:32.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:32 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:32.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:32 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T06:02:32.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:32 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:02:32.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:32 smithi155 ceph-mon[217407]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T06:02:32.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:32 smithi155 ceph-mon[217407]: Upgrade: osd.5 is safe to restart 2023-12-16T06:02:32.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:32 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:32.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:32 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T06:02:32.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:32 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:02:33.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:33 smithi155 ceph-mon[217407]: pgmap v124: 65 pgs: 65 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-16T06:02:33.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:33 smithi155 ceph-mon[217407]: Upgrade: Updating osd.5 2023-12-16T06:02:33.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:33 smithi155 ceph-mon[217407]: Deploying daemon osd.5 on smithi156 2023-12-16T06:02:33.669 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:33 smithi156 ceph-mon[182000]: pgmap v124: 65 pgs: 65 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-16T06:02:33.670 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:33 smithi156 ceph-mon[182000]: Upgrade: Updating osd.5 2023-12-16T06:02:33.670 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:33 smithi156 ceph-mon[182000]: Deploying daemon osd.5 on smithi156 2023-12-16T06:02:34.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:34 smithi156 systemd[1]: Stopping Ceph osd.5 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T06:02:34.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:34 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[143375]: 2023-12-16T06:02:34.451+0000 7f0b6d3be700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T06:02:34.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:34 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[143375]: 2023-12-16T06:02:34.451+0000 7f0b6d3be700 -1 osd.5 72 *** Got signal Terminated *** 2023-12-16T06:02:34.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:34 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[143375]: 2023-12-16T06:02:34.451+0000 7f0b6d3be700 -1 osd.5 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T06:02:35.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:35 smithi155 ceph-mon[217407]: pgmap v125: 65 pgs: 65 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-16T06:02:35.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:35 smithi155 ceph-mon[217407]: osd.5 marked itself down and dead 2023-12-16T06:02:35.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:35 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:35.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:35 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:02:35.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:35 smithi156 ceph-mon[182000]: pgmap v125: 65 pgs: 65 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-16T06:02:35.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:35 smithi156 ceph-mon[182000]: osd.5 marked itself down and dead 2023-12-16T06:02:35.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:35 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:35.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:35 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:02:36.181 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:35 smithi156 bash[206335]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5 2023-12-16T06:02:36.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:36 smithi155 ceph-mon[217407]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T06:02:36.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:36 smithi155 ceph-mon[217407]: osdmap e73: 6 total, 5 up, 6 in 2023-12-16T06:02:36.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:36 smithi156 ceph-mon[182000]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T06:02:36.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:36 smithi156 ceph-mon[182000]: osdmap e73: 6 total, 5 up, 6 in 2023-12-16T06:02:37.361 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:37 smithi156 ceph-mon[182000]: pgmap v127: 65 pgs: 3 peering, 12 stale+active+clean, 50 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s 2023-12-16T06:02:37.362 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:37 smithi156 ceph-mon[182000]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-16T06:02:37.362 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:37 smithi156 ceph-mon[182000]: osdmap e74: 6 total, 5 up, 6 in 2023-12-16T06:02:37.362 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:37 smithi156 systemd[1]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.5.service: Succeeded. 2023-12-16T06:02:37.362 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:37 smithi156 systemd[1]: Stopped Ceph osd.5 for d344784e-9bd6-11ee-95a5-87774f69a715. 2023-12-16T06:02:37.362 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:37 smithi156 systemd[1]: Starting Ceph osd.5 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T06:02:37.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:37 smithi155 ceph-mon[217407]: pgmap v127: 65 pgs: 3 peering, 12 stale+active+clean, 50 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s 2023-12-16T06:02:37.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:37 smithi155 ceph-mon[217407]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-16T06:02:37.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:37 smithi155 ceph-mon[217407]: osdmap e74: 6 total, 5 up, 6 in 2023-12-16T06:02:38.179 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:37 smithi156 bash[206600]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-16T06:02:38.180 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:37 smithi156 bash[206600]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-16T06:02:38.180 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:37 smithi156 bash[206600]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-16T06:02:38.180 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:37 smithi156 bash[206600]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-16T06:02:38.180 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:37 smithi156 bash[206600]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2023-12-16T06:02:38.180 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:37 smithi156 bash[206600]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-16T06:02:38.180 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:37 smithi156 bash[206600]: --> ceph-volume raw activate successful for osd ID: 5 2023-12-16T06:02:38.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:38 smithi155 ceph-mon[217407]: Health check failed: Degraded data redundancy: 8/342 objects degraded (2.339%), 3 pgs degraded (PG_DEGRADED) 2023-12-16T06:02:38.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:38 smithi156 ceph-mon[182000]: Health check failed: Degraded data redundancy: 8/342 objects degraded (2.339%), 3 pgs degraded (PG_DEGRADED) 2023-12-16T06:02:38.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:38 smithi156 ceph-osd[206888]: -- 172.21.15.156:0/2353896173 <== mon.1 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5586f1ec16c0 con 0x5586f1e91000 2023-12-16T06:02:38.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:38 smithi156 bash[206851]: 8687b2c8910767a95eac1bec2a501fd98b4908ca1de5c475e2ca26780333fad8 2023-12-16T06:02:38.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:38 smithi156 systemd[1]: Started Ceph osd.5 for d344784e-9bd6-11ee-95a5-87774f69a715. 2023-12-16T06:02:39.305 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:39 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:02:39.037+0000 7f08e17e4640 -1 Falling back to public interface 2023-12-16T06:02:39.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:39 smithi155 ceph-mon[217407]: pgmap v129: 65 pgs: 3 active+undersized+degraded, 3 peering, 6 stale+active+clean, 7 active+undersized, 46 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 8/342 objects degraded (2.339%) 2023-12-16T06:02:39.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:39 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:39.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:39 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:39.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:39 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:02:39.615 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:39 smithi156 ceph-mon[182000]: pgmap v129: 65 pgs: 3 active+undersized+degraded, 3 peering, 6 stale+active+clean, 7 active+undersized, 46 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 8/342 objects degraded (2.339%) 2023-12-16T06:02:39.615 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:39 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:39.615 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:39 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:39.615 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:39 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:02:41.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:41 smithi155 ceph-mon[217407]: pgmap v130: 65 pgs: 12 active+undersized+degraded, 3 peering, 13 active+undersized, 37 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 48/342 objects degraded (14.035%) 2023-12-16T06:02:41.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:41 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:41.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:41 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:41.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:41 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:41.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:41 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:41.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:41 smithi156 ceph-mon[182000]: pgmap v130: 65 pgs: 12 active+undersized+degraded, 3 peering, 13 active+undersized, 37 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 48/342 objects degraded (14.035%) 2023-12-16T06:02:41.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:41 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:41.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:41 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:41.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:41 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:41.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:41 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:43.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:42 smithi155 ceph-mon[217407]: pgmap v131: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 55/342 objects degraded (16.082%) 2023-12-16T06:02:43.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:42 smithi156 ceph-mon[182000]: pgmap v131: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 55/342 objects degraded (16.082%) 2023-12-16T06:02:43.430 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:43 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:02:43.016+0000 7f08e17e4640 -1 osd.5 0 read_superblock omap replica is missing. 2023-12-16T06:02:43.710 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:43 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:02:43.562+0000 7f08e17e4640 -1 osd.5 72 log_to_monitors true 2023-12-16T06:02:43.973 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:43 smithi156 ceph-mon[182000]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-16T06:02:43.974 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:43 smithi156 ceph-mon[182000]: from='osd.5 [v2:172.21.15.156:6816/3510805402,v1:172.21.15.156:6817/3510805402]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T06:02:43.974 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:43 smithi156 ceph-mon[182000]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T06:02:43.974 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:43 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:43.974 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:43 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:43.974 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:43 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:02:43.974 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:43 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T06:02:43.974 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:43 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:44.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:43 smithi155 ceph-mon[217407]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-16T06:02:44.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:43 smithi155 ceph-mon[217407]: from='osd.5 [v2:172.21.15.156:6816/3510805402,v1:172.21.15.156:6817/3510805402]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T06:02:44.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:43 smithi155 ceph-mon[217407]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T06:02:44.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:43 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:44.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:43 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:44.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:43 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:02:44.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:43 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T06:02:44.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:43 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:44.429 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:02:43 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:02:43.970+0000 7f08cfc4f700 -1 osd.5 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T06:02:45.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-16T06:02:45.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='osd.5 [v2:172.21.15.156:6816/3510805402,v1:172.21.15.156:6817/3510805402]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T06:02:45.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: osdmap e75: 6 total, 5 up, 6 in 2023-12-16T06:02:45.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T06:02:45.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:02:45.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:02:45.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:02:45.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:02:45.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:02:45.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: Upgrade: Setting container_image for all osd 2023-12-16T06:02:45.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:45.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-16T06:02:45.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-16T06:02:45.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-16T06:02:45.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-16T06:02:45.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-16T06:02:45.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-16T06:02:45.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-16T06:02:45.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-16T06:02:45.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-16T06:02:45.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-16T06:02:45.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-16T06:02:45.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-16T06:02:45.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-16T06:02:45.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-16T06:02:45.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-16T06:02:45.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:45.328 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: pgmap v133: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 55/342 objects degraded (16.082%) 2023-12-16T06:02:45.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:02:45.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:02:45.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T06:02:45.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:44 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:45.329 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:45 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-mon-smithi155[217384]: 2023-12-16T06:02:45.036+0000 7ff53f85b700 -1 log_channel(cluster) log [ERR] : Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-16T06:02:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-16T06:02:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='osd.5 [v2:172.21.15.156:6816/3510805402,v1:172.21.15.156:6817/3510805402]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T06:02:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: osdmap e75: 6 total, 5 up, 6 in 2023-12-16T06:02:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-12-16T06:02:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:02:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:02:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:02:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:02:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:02:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: Upgrade: Setting container_image for all osd 2023-12-16T06:02:45.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:45.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-16T06:02:45.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-16T06:02:45.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-16T06:02:45.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-16T06:02:45.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-16T06:02:45.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-16T06:02:45.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-16T06:02:45.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-16T06:02:45.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-16T06:02:45.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-16T06:02:45.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-16T06:02:45.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-16T06:02:45.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-16T06:02:45.431 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-16T06:02:45.432 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-16T06:02:45.432 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:45.432 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: pgmap v133: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 55/342 objects degraded (16.082%) 2023-12-16T06:02:45.432 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:02:45.432 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:02:45.432 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T06:02:45.432 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:44 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:46.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:45 smithi155 ceph-mon[217407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T06:02:46.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:45 smithi155 ceph-mon[217407]: osd.5 [v2:172.21.15.156:6816/3510805402,v1:172.21.15.156:6817/3510805402] boot 2023-12-16T06:02:46.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:45 smithi155 ceph-mon[217407]: osdmap e76: 6 total, 6 up, 6 in 2023-12-16T06:02:46.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:45 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T06:02:46.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:45 smithi155 ceph-mon[217407]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-16T06:02:46.327 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:45 smithi155 ceph-mon[217407]: osdmap e77: 6 total, 6 up, 6 in 2023-12-16T06:02:46.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:45 smithi156 ceph-mon[182000]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T06:02:46.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:45 smithi156 ceph-mon[182000]: osd.5 [v2:172.21.15.156:6816/3510805402,v1:172.21.15.156:6817/3510805402] boot 2023-12-16T06:02:46.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:45 smithi156 ceph-mon[182000]: osdmap e76: 6 total, 6 up, 6 in 2023-12-16T06:02:46.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:45 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T06:02:46.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:45 smithi156 ceph-mon[182000]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-16T06:02:46.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:45 smithi156 ceph-mon[182000]: osdmap e77: 6 total, 6 up, 6 in 2023-12-16T06:02:47.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:46 smithi155 ceph-mon[217407]: pgmap v136: 65 pgs: 2 peering, 13 active+undersized+degraded, 13 active+undersized, 37 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 51/342 objects degraded (14.912%) 2023-12-16T06:02:47.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:46 smithi155 ceph-mon[217407]: Health check update: Degraded data redundancy: 55/342 objects degraded (16.082%), 14 pgs degraded (PG_DEGRADED) 2023-12-16T06:02:47.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:46 smithi156 ceph-mon[182000]: pgmap v136: 65 pgs: 2 peering, 13 active+undersized+degraded, 13 active+undersized, 37 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 51/342 objects degraded (14.912%) 2023-12-16T06:02:47.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:46 smithi156 ceph-mon[182000]: Health check update: Degraded data redundancy: 55/342 objects degraded (16.082%), 14 pgs degraded (PG_DEGRADED) 2023-12-16T06:02:49.389 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:49 smithi155 ceph-mon[217407]: pgmap v137: 65 pgs: 2 peering, 11 active+undersized+degraded, 11 active+undersized, 41 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 46/342 objects degraded (13.450%) 2023-12-16T06:02:49.432 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:49 smithi156 ceph-mon[182000]: pgmap v137: 65 pgs: 2 peering, 11 active+undersized+degraded, 11 active+undersized, 41 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 46/342 objects degraded (13.450%) 2023-12-16T06:02:50.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:50 smithi156 ceph-mon[182000]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 46/342 objects degraded (13.450%), 11 pgs degraded) 2023-12-16T06:02:50.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:50 smithi155 ceph-mon[217407]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 46/342 objects degraded (13.450%), 11 pgs degraded) 2023-12-16T06:02:51.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:51 smithi155 ceph-mon[217407]: pgmap v138: 65 pgs: 2 peering, 63 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2023-12-16T06:02:51.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:51 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:51.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:51 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:02:51.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:51 smithi156 ceph-mon[182000]: pgmap v138: 65 pgs: 2 peering, 63 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2023-12-16T06:02:51.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:51 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:02:51.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:51 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:02:53.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:52 smithi155 ceph-mon[217407]: pgmap v139: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 2 op/s 2023-12-16T06:02:53.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:52 smithi156 ceph-mon[182000]: pgmap v139: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 2 op/s 2023-12-16T06:02:55.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:55 smithi156 ceph-mon[182000]: pgmap v140: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2023-12-16T06:02:55.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:55 smithi155 ceph-mon[217407]: pgmap v140: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2023-12-16T06:02:56.509 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.504+0000 7f75349c1700 1 -- 172.21.15.155:0/3290140147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7530102c20 msgr2=0x7f7530102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:56.509 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.505+0000 7f75349c1700 1 --2- 172.21.15.155:0/3290140147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7530102c20 0x7f7530102ff0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7520009ce0 tx=0x7f7520004d10 comp rx=0 tx=0).stop 2023-12-16T06:02:56.509 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.505+0000 7f75349c1700 1 -- 172.21.15.155:0/3290140147 shutdown_connections 2023-12-16T06:02:56.509 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.505+0000 7f75349c1700 1 --2- 172.21.15.155:0/3290140147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7530065390 0x7f7530065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:56.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.505+0000 7f75349c1700 1 --2- 172.21.15.155:0/3290140147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7530102c20 0x7f7530102ff0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:56.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.505+0000 7f75349c1700 1 -- 172.21.15.155:0/3290140147 >> 172.21.15.155:0/3290140147 conn(0x7f75300719b0 msgr2=0x7f7530071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:02:56.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.505+0000 7f75349c1700 1 -- 172.21.15.155:0/3290140147 shutdown_connections 2023-12-16T06:02:56.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.505+0000 7f75349c1700 1 -- 172.21.15.155:0/3290140147 wait complete. 2023-12-16T06:02:56.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.505+0000 7f75349c1700 1 Processor -- start 2023-12-16T06:02:56.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.505+0000 7f75349c1700 1 -- start start 2023-12-16T06:02:56.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.505+0000 7f75349c1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7530065390 0x7f75300fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:56.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.505+0000 7f75349c1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7530102c20 0x7f75300fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:56.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.505+0000 7f75349c1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75300fc6c0 con 0x7f7530102c20 2023-12-16T06:02:56.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.505+0000 7f75349c1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75300fc830 con 0x7f7530065390 2023-12-16T06:02:56.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.506+0000 7f752dd9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7530102c20 0x7f75300fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:56.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.506+0000 7f752dd9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7530102c20 0x7f75300fc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33490/0 (socket says 172.21.15.155:33490) 2023-12-16T06:02:56.511 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.506+0000 7f752dd9b700 1 -- 172.21.15.155:0/1184362425 learned_addr learned my addr 172.21.15.155:0/1184362425 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:02:56.511 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.506+0000 7f752e59c700 1 --2- 172.21.15.155:0/1184362425 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7530065390 0x7f75300fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:56.511 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.506+0000 7f752dd9b700 1 -- 172.21.15.155:0/1184362425 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7530065390 msgr2=0x7f75300fbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:56.511 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.506+0000 7f752dd9b700 1 --2- 172.21.15.155:0/1184362425 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7530065390 0x7f75300fbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:56.511 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.506+0000 7f752dd9b700 1 -- 172.21.15.155:0/1184362425 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7520009940 con 0x7f7530102c20 2023-12-16T06:02:56.511 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.506+0000 7f752dd9b700 1 --2- 172.21.15.155:0/1184362425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7530102c20 0x7f75300fc130 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f751800eb40 tx=0x7f751800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:02:56.511 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.506+0000 7f7526ffd700 1 -- 172.21.15.155:0/1184362425 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7518007cc0 con 0x7f7530102c20 2023-12-16T06:02:56.511 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.506+0000 7f7526ffd700 1 -- 172.21.15.155:0/1184362425 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f751800f040 con 0x7f7530102c20 2023-12-16T06:02:56.512 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.506+0000 7f75349c1700 1 -- 172.21.15.155:0/1184362425 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7530119910 con 0x7f7530102c20 2023-12-16T06:02:56.512 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.506+0000 7f7526ffd700 1 -- 172.21.15.155:0/1184362425 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7518009570 con 0x7f7530102c20 2023-12-16T06:02:56.513 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.506+0000 7f75349c1700 1 -- 172.21.15.155:0/1184362425 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7530119d10 con 0x7f7530102c20 2023-12-16T06:02:56.513 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.507+0000 7f75349c1700 1 -- 172.21.15.155:0/1184362425 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75300fff40 con 0x7f7530102c20 2023-12-16T06:02:56.513 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.508+0000 7f7526ffd700 1 -- 172.21.15.155:0/1184362425 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f75180096d0 con 0x7f7530102c20 2023-12-16T06:02:56.513 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.508+0000 7f7526ffd700 1 --2- 172.21.15.155:0/1184362425 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f751c06ce60 0x7f751c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:56.513 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.508+0000 7f7526ffd700 1 -- 172.21.15.155:0/1184362425 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f751808be30 con 0x7f7530102c20 2023-12-16T06:02:56.513 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.508+0000 7f752e59c700 1 --2- 172.21.15.155:0/1184362425 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f751c06ce60 0x7f751c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:56.513 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.509+0000 7f752e59c700 1 --2- 172.21.15.155:0/1184362425 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f751c06ce60 0x7f751c06f310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7520003400 tx=0x7f7520004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:02:56.515 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.513+0000 7f7526ffd700 1 -- 172.21.15.155:0/1184362425 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f7518055e90 con 0x7f7530102c20 2023-12-16T06:02:56.726 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.723+0000 7f75349c1700 1 -- 172.21.15.155:0/1184362425 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f753004bb80 con 0x7f751c06ce60 2023-12-16T06:02:56.727 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.725+0000 7f7526ffd700 1 -- 172.21.15.155:0/1184362425 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f753004bb80 con 0x7f751c06ce60 2023-12-16T06:02:56.729 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.727+0000 7f75349c1700 1 -- 172.21.15.155:0/1184362425 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f751c06ce60 msgr2=0x7f751c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:56.729 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.727+0000 7f75349c1700 1 --2- 172.21.15.155:0/1184362425 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f751c06ce60 0x7f751c06f310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7520003400 tx=0x7f7520004d10 comp rx=0 tx=0).stop 2023-12-16T06:02:56.729 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.727+0000 7f75349c1700 1 -- 172.21.15.155:0/1184362425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7530102c20 msgr2=0x7f75300fc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:56.730 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.727+0000 7f75349c1700 1 --2- 172.21.15.155:0/1184362425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7530102c20 0x7f75300fc130 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f751800eb40 tx=0x7f751800b040 comp rx=0 tx=0).stop 2023-12-16T06:02:56.730 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.727+0000 7f75349c1700 1 -- 172.21.15.155:0/1184362425 shutdown_connections 2023-12-16T06:02:56.730 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.727+0000 7f75349c1700 1 --2- 172.21.15.155:0/1184362425 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f751c06ce60 0x7f751c06f310 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:56.730 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.727+0000 7f75349c1700 1 --2- 172.21.15.155:0/1184362425 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7530065390 0x7f75300fbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:56.730 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.727+0000 7f75349c1700 1 --2- 172.21.15.155:0/1184362425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7530102c20 0x7f75300fc130 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:56.730 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.727+0000 7f75349c1700 1 -- 172.21.15.155:0/1184362425 >> 172.21.15.155:0/1184362425 conn(0x7f75300719b0 msgr2=0x7f75300fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:02:56.730 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.727+0000 7f75349c1700 1 -- 172.21.15.155:0/1184362425 shutdown_connections 2023-12-16T06:02:56.730 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.727+0000 7f75349c1700 1 -- 172.21.15.155:0/1184362425 wait complete. 2023-12-16T06:02:56.740 INFO:teuthology.orchestra.run.smithi155.stdout:true 2023-12-16T06:02:56.833 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.829+0000 7fd054832700 1 -- 172.21.15.155:0/2953357280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd050101b00 msgr2=0x7fd050101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:56.834 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.829+0000 7fd054832700 1 --2- 172.21.15.155:0/2953357280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd050101b00 0x7fd050101ed0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd044004940 tx=0x7fd044009e30 comp rx=0 tx=0).stop 2023-12-16T06:02:56.834 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.829+0000 7fd054832700 1 -- 172.21.15.155:0/2953357280 shutdown_connections 2023-12-16T06:02:56.834 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.829+0000 7fd054832700 1 --2- 172.21.15.155:0/2953357280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0500fbb40 0x7fd0500fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:56.834 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.829+0000 7fd054832700 1 --2- 172.21.15.155:0/2953357280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd050101b00 0x7fd050101ed0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:56.834 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.829+0000 7fd054832700 1 -- 172.21.15.155:0/2953357280 >> 172.21.15.155:0/2953357280 conn(0x7fd0500719b0 msgr2=0x7fd050071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:02:56.834 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.829+0000 7fd054832700 1 -- 172.21.15.155:0/2953357280 shutdown_connections 2023-12-16T06:02:56.834 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.829+0000 7fd054832700 1 -- 172.21.15.155:0/2953357280 wait complete. 2023-12-16T06:02:56.834 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.830+0000 7fd054832700 1 Processor -- start 2023-12-16T06:02:56.834 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.830+0000 7fd054832700 1 -- start start 2023-12-16T06:02:56.834 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.830+0000 7fd054832700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0500fbb40 0x7fd050113620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:56.834 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.830+0000 7fd054832700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd050101b00 0x7fd050113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:56.834 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.830+0000 7fd054832700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0501141f0 con 0x7fd0500fbb40 2023-12-16T06:02:56.835 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.830+0000 7fd054832700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05010d4e0 con 0x7fd050101b00 2023-12-16T06:02:56.835 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.830+0000 7fd04e59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0500fbb40 0x7fd050113620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:56.835 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.830+0000 7fd04e59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0500fbb40 0x7fd050113620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33508/0 (socket says 172.21.15.155:33508) 2023-12-16T06:02:56.835 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.830+0000 7fd04e59c700 1 -- 172.21.15.155:0/636253700 learned_addr learned my addr 172.21.15.155:0/636253700 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:02:56.835 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.830+0000 7fd04dd9b700 1 --2- 172.21.15.155:0/636253700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd050101b00 0x7fd050113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:56.835 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.830+0000 7fd04e59c700 1 -- 172.21.15.155:0/636253700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd050101b00 msgr2=0x7fd050113ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:56.835 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.830+0000 7fd04e59c700 1 --2- 172.21.15.155:0/636253700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd050101b00 0x7fd050113ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:56.835 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.830+0000 7fd04e59c700 1 -- 172.21.15.155:0/636253700 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd044005040 con 0x7fd0500fbb40 2023-12-16T06:02:56.835 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.830+0000 7fd04dd9b700 1 --2- 172.21.15.155:0/636253700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd050101b00 0x7fd050113ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T06:02:56.835 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.831+0000 7fd04e59c700 1 --2- 172.21.15.155:0/636253700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0500fbb40 0x7fd050113620 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd04400b3b0 tx=0x7fd044009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:02:56.835 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.831+0000 7fd03effd700 1 -- 172.21.15.155:0/636253700 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd04400e040 con 0x7fd0500fbb40 2023-12-16T06:02:56.835 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.831+0000 7fd03effd700 1 -- 172.21.15.155:0/636253700 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd04400bc50 con 0x7fd0500fbb40 2023-12-16T06:02:56.835 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.831+0000 7fd054832700 1 -- 172.21.15.155:0/636253700 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05010d710 con 0x7fd0500fbb40 2023-12-16T06:02:56.835 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.831+0000 7fd03effd700 1 -- 172.21.15.155:0/636253700 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd044013420 con 0x7fd0500fbb40 2023-12-16T06:02:56.836 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.831+0000 7fd054832700 1 -- 172.21.15.155:0/636253700 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05010dc50 con 0x7fd0500fbb40 2023-12-16T06:02:56.836 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.832+0000 7fd054832700 1 -- 172.21.15.155:0/636253700 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0500734d0 con 0x7fd0500fbb40 2023-12-16T06:02:56.836 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.832+0000 7fd03effd700 1 -- 172.21.15.155:0/636253700 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7fd04401c430 con 0x7fd0500fbb40 2023-12-16T06:02:56.836 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.833+0000 7fd03effd700 1 --2- 172.21.15.155:0/636253700 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fd03806ce60 0x7fd03806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:56.837 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.833+0000 7fd04dd9b700 1 --2- 172.21.15.155:0/636253700 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fd03806ce60 0x7fd03806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:56.837 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.833+0000 7fd03effd700 1 -- 172.21.15.155:0/636253700 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd04408cf30 con 0x7fd0500fbb40 2023-12-16T06:02:56.837 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.833+0000 7fd04dd9b700 1 --2- 172.21.15.155:0/636253700 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fd03806ce60 0x7fd03806f310 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd040007fd0 tx=0x7fd040009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:02:56.840 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:56.837+0000 7fd03effd700 1 -- 172.21.15.155:0/636253700 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fd0440c0300 con 0x7fd0500fbb40 2023-12-16T06:02:57.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:57.049+0000 7fd054832700 1 -- 172.21.15.155:0/636253700 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd05010ed10 con 0x7fd03806ce60 2023-12-16T06:02:57.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:57.050+0000 7fd03effd700 1 -- 172.21.15.155:0/636253700 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7fd05010ed10 con 0x7fd03806ce60 2023-12-16T06:02:57.054 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:57.052+0000 7fd054832700 1 -- 172.21.15.155:0/636253700 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fd03806ce60 msgr2=0x7fd03806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:57.054 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:57.052+0000 7fd054832700 1 --2- 172.21.15.155:0/636253700 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fd03806ce60 0x7fd03806f310 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd040007fd0 tx=0x7fd040009040 comp rx=0 tx=0).stop 2023-12-16T06:02:57.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:57.052+0000 7fd054832700 1 -- 172.21.15.155:0/636253700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0500fbb40 msgr2=0x7fd050113620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:57.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:57.052+0000 7fd054832700 1 --2- 172.21.15.155:0/636253700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0500fbb40 0x7fd050113620 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd04400b3b0 tx=0x7fd044009e30 comp rx=0 tx=0).stop 2023-12-16T06:02:57.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:57.052+0000 7fd054832700 1 -- 172.21.15.155:0/636253700 shutdown_connections 2023-12-16T06:02:57.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:57.052+0000 7fd054832700 1 --2- 172.21.15.155:0/636253700 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fd03806ce60 0x7fd03806f310 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:57.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:57.052+0000 7fd054832700 1 --2- 172.21.15.155:0/636253700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0500fbb40 0x7fd050113620 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:57.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:57.052+0000 7fd054832700 1 --2- 172.21.15.155:0/636253700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd050101b00 0x7fd050113ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:57.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:57.052+0000 7fd054832700 1 -- 172.21.15.155:0/636253700 >> 172.21.15.155:0/636253700 conn(0x7fd0500719b0 msgr2=0x7fd0500ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:02:57.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:57.052+0000 7fd054832700 1 -- 172.21.15.155:0/636253700 shutdown_connections 2023-12-16T06:02:57.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:57.052+0000 7fd054832700 1 -- 172.21.15.155:0/636253700 wait complete. 2023-12-16T06:02:57.065 INFO:teuthology.orchestra.run.smithi155.stdout:"Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception" 2023-12-16T06:02:57.380 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:57 smithi155 ceph-mon[217407]: pgmap v141: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2023-12-16T06:02:57.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:57 smithi156 ceph-mon[182000]: pgmap v141: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2023-12-16T06:02:57.433 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch ps' 2023-12-16T06:02:57.698 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T06:02:58.433 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:58 smithi156 ceph-mon[182000]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:02:58.433 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:58 smithi156 ceph-mon[182000]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:02:58.489 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:58 smithi155 ceph-mon[217407]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:02:58.489 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:58 smithi155 ceph-mon[217407]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:02:58.664 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.660+0000 7f04934d4700 1 -- 172.21.15.155:0/215433850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f048c101b00 msgr2=0x7f048c101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:58.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.660+0000 7f04934d4700 1 --2- 172.21.15.155:0/215433850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f048c101b00 0x7f048c101ed0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0488004940 tx=0x7f0488009e30 comp rx=0 tx=0).stop 2023-12-16T06:02:58.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.660+0000 7f04934d4700 1 -- 172.21.15.155:0/215433850 shutdown_connections 2023-12-16T06:02:58.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.660+0000 7f04934d4700 1 --2- 172.21.15.155:0/215433850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f048c0fbb40 0x7f048c0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:58.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.660+0000 7f04934d4700 1 --2- 172.21.15.155:0/215433850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f048c101b00 0x7f048c101ed0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:58.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.660+0000 7f04934d4700 1 -- 172.21.15.155:0/215433850 >> 172.21.15.155:0/215433850 conn(0x7f048c0719b0 msgr2=0x7f048c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:02:58.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.660+0000 7f04934d4700 1 -- 172.21.15.155:0/215433850 shutdown_connections 2023-12-16T06:02:58.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.660+0000 7f04934d4700 1 -- 172.21.15.155:0/215433850 wait complete. 2023-12-16T06:02:58.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.661+0000 7f04934d4700 1 Processor -- start 2023-12-16T06:02:58.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.661+0000 7f04934d4700 1 -- start start 2023-12-16T06:02:58.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.661+0000 7f04934d4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f048c0fbb40 0x7f048c10e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:58.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.661+0000 7f04934d4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f048c101b00 0x7f048c10ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:58.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.661+0000 7f04934d4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048c10f1c0 con 0x7f048c101b00 2023-12-16T06:02:58.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.661+0000 7f04934d4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048c10f300 con 0x7f048c0fbb40 2023-12-16T06:02:58.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.661+0000 7f0490a6f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f048c101b00 0x7f048c10ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:58.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.661+0000 7f0490a6f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f048c101b00 0x7f048c10ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33528/0 (socket says 172.21.15.155:33528) 2023-12-16T06:02:58.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.661+0000 7f0490a6f700 1 -- 172.21.15.155:0/230499153 learned_addr learned my addr 172.21.15.155:0/230499153 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:02:58.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.661+0000 7f0491270700 1 --2- 172.21.15.155:0/230499153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f048c0fbb40 0x7f048c10e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:58.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.661+0000 7f0490a6f700 1 -- 172.21.15.155:0/230499153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f048c0fbb40 msgr2=0x7f048c10e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:58.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.661+0000 7f0490a6f700 1 --2- 172.21.15.155:0/230499153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f048c0fbb40 0x7f048c10e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:58.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.661+0000 7f0490a6f700 1 -- 172.21.15.155:0/230499153 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0488005040 con 0x7f048c101b00 2023-12-16T06:02:58.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.662+0000 7f0490a6f700 1 --2- 172.21.15.155:0/230499153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f048c101b00 0x7f048c10ec30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f047c002a50 tx=0x7f047c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:02:58.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.662+0000 7f0481ffb700 1 -- 172.21.15.155:0/230499153 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f047c007cc0 con 0x7f048c101b00 2023-12-16T06:02:58.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.662+0000 7f0481ffb700 1 -- 172.21.15.155:0/230499153 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f047c00f040 con 0x7f048c101b00 2023-12-16T06:02:58.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.662+0000 7f04934d4700 1 -- 172.21.15.155:0/230499153 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f048c117660 con 0x7f048c101b00 2023-12-16T06:02:58.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.662+0000 7f0481ffb700 1 -- 172.21.15.155:0/230499153 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f047c00d9c0 con 0x7f048c101b00 2023-12-16T06:02:58.667 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.662+0000 7f04934d4700 1 -- 172.21.15.155:0/230499153 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f048c117b70 con 0x7f048c101b00 2023-12-16T06:02:58.667 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.663+0000 7f04934d4700 1 -- 172.21.15.155:0/230499153 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f048c103fb0 con 0x7f048c101b00 2023-12-16T06:02:58.667 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.663+0000 7f0481ffb700 1 -- 172.21.15.155:0/230499153 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f047c00db20 con 0x7f048c101b00 2023-12-16T06:02:58.668 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.664+0000 7f0481ffb700 1 --2- 172.21.15.155:0/230499153 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f047806ce70 0x7f047806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:02:58.668 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.664+0000 7f0481ffb700 1 -- 172.21.15.155:0/230499153 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f047c08bf90 con 0x7f048c101b00 2023-12-16T06:02:58.668 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.664+0000 7f0491270700 1 --2- 172.21.15.155:0/230499153 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f047806ce70 0x7f047806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:02:58.668 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.664+0000 7f0491270700 1 --2- 172.21.15.155:0/230499153 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f047806ce70 0x7f047806f320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f048800b3b0 tx=0x7f0488009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:02:58.671 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.668+0000 7f0481ffb700 1 -- 172.21.15.155:0/230499153 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f047c055ec0 con 0x7f048c101b00 2023-12-16T06:02:58.873 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.870+0000 7f04934d4700 1 -- 172.21.15.155:0/230499153 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f048c065b70 con 0x7f047806ce70 2023-12-16T06:02:58.883 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.880+0000 7f0481ffb700 1 -- 172.21.15.155:0/230499153 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f048c065b70 con 0x7f047806ce70 2023-12-16T06:02:58.883 INFO:teuthology.orchestra.run.smithi155.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T06:02:58.883 INFO:teuthology.orchestra.run.smithi155.stdout:alertmanager.smithi155 smithi155 *:9093,9094 running (4m) 102s ago 12m 29.5M - 0.25.0 c8568f914cd2 e1da85d6fc09 2023-12-16T06:02:58.883 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi155 smithi155 running (3m) 102s ago 12m 7470k - 19.0.0-191-g6d933094 a29c258b5d6f 6599d6adc8fa 2023-12-16T06:02:58.883 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi156 smithi156 running (2m) 18s ago 11m 7448k - 19.0.0-191-g6d933094 a29c258b5d6f 8129878ae56e 2023-12-16T06:02:58.883 INFO:teuthology.orchestra.run.smithi155.stdout:grafana.smithi155 smithi155 *:3000 running (4m) 102s ago 11m 83.3M - 9.4.12 a0ea5e3c46d9 a16c84704784 2023-12-16T06:02:58.883 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.bzsxjw smithi155 running (8m) 102s ago 8m 4746M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6bcabf94a5c3 2023-12-16T06:02:58.884 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.vicpis smithi155 running (8m) 102s ago 8m 669M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 afa64e1ef8da 2023-12-16T06:02:58.884 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.fasing smithi156 running (8m) 18s ago 8m 539M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 7d97160bda7c 2023-12-16T06:02:58.884 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.qvgmfj smithi156 running (8m) 18s ago 8m 5969M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4018b2f2e27e 2023-12-16T06:02:58.884 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi155.maowdn smithi155 *:8443,9283,8765 running (5m) 102s ago 13m 513M - 19.0.0-191-g6d933094 a29c258b5d6f ee39089d18d3 2023-12-16T06:02:58.884 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi156.pclong smithi156 *:8443,9283,8765 running (5m) 18s ago 11m 449M - 19.0.0-191-g6d933094 a29c258b5d6f 673376e357e8 2023-12-16T06:02:58.884 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi155 smithi155 running (3m) 102s ago 13m 67.4M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 19eb23d9f064 2023-12-16T06:02:58.884 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi156 smithi156 running (3m) 18s ago 11m 51.0M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 62dacb4d7a17 2023-12-16T06:02:58.884 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi155 smithi155 *:9100 running (5m) 102s ago 12m 15.7M - 1.5.0 0da6a335fe13 6f0f1f68f191 2023-12-16T06:02:58.884 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi156 smithi156 *:9100 running (5m) 18s ago 11m 19.0M - 1.5.0 0da6a335fe13 c4595a7b1707 2023-12-16T06:02:58.884 INFO:teuthology.orchestra.run.smithi155.stdout:osd.0 smithi155 running (2m) 102s ago 10m 122M 1568M 19.0.0-191-g6d933094 a29c258b5d6f f5b1d720ac4f 2023-12-16T06:02:58.884 INFO:teuthology.orchestra.run.smithi155.stdout:osd.1 smithi155 running (2m) 102s ago 10m 125M 1568M 19.0.0-191-g6d933094 a29c258b5d6f badaf737af87 2023-12-16T06:02:58.884 INFO:teuthology.orchestra.run.smithi155.stdout:osd.2 smithi155 running (105s) 102s ago 10m 12.6M 1568M 19.0.0-191-g6d933094 a29c258b5d6f 9a08b6ae1253 2023-12-16T06:02:58.884 INFO:teuthology.orchestra.run.smithi155.stdout:osd.3 smithi156 running (76s) 18s ago 9m 139M 2592M 19.0.0-191-g6d933094 a29c258b5d6f 3a04979138d3 2023-12-16T06:02:58.884 INFO:teuthology.orchestra.run.smithi155.stdout:osd.4 smithi156 running (48s) 18s ago 9m 125M 2592M 19.0.0-191-g6d933094 a29c258b5d6f a4a0224a1f37 2023-12-16T06:02:58.884 INFO:teuthology.orchestra.run.smithi155.stdout:osd.5 smithi156 running (20s) 18s ago 9m 12.0M 2592M 19.0.0-191-g6d933094 a29c258b5d6f 8687b2c89107 2023-12-16T06:02:58.885 INFO:teuthology.orchestra.run.smithi155.stdout:prometheus.smithi155 smithi155 *:9095 running (4m) 102s ago 11m 66.6M - 2.43.0 a07b618ecd1d 26bb7cfc1b8b 2023-12-16T06:02:58.885 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.882+0000 7f04934d4700 1 -- 172.21.15.155:0/230499153 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f047806ce70 msgr2=0x7f047806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:58.885 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.882+0000 7f04934d4700 1 --2- 172.21.15.155:0/230499153 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f047806ce70 0x7f047806f320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f048800b3b0 tx=0x7f0488009e30 comp rx=0 tx=0).stop 2023-12-16T06:02:58.885 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.882+0000 7f04934d4700 1 -- 172.21.15.155:0/230499153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f048c101b00 msgr2=0x7f048c10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:02:58.886 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.882+0000 7f04934d4700 1 --2- 172.21.15.155:0/230499153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f048c101b00 0x7f048c10ec30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f047c002a50 tx=0x7f047c0046b0 comp rx=0 tx=0).stop 2023-12-16T06:02:58.886 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.883+0000 7f04934d4700 1 -- 172.21.15.155:0/230499153 shutdown_connections 2023-12-16T06:02:58.886 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.883+0000 7f04934d4700 1 --2- 172.21.15.155:0/230499153 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f047806ce70 0x7f047806f320 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:58.886 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.883+0000 7f04934d4700 1 --2- 172.21.15.155:0/230499153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f048c0fbb40 0x7f048c10e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:58.886 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.883+0000 7f04934d4700 1 --2- 172.21.15.155:0/230499153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f048c101b00 0x7f048c10ec30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:02:58.886 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.883+0000 7f04934d4700 1 -- 172.21.15.155:0/230499153 >> 172.21.15.155:0/230499153 conn(0x7f048c0719b0 msgr2=0x7f048c0fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:02:58.886 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.883+0000 7f04934d4700 1 -- 172.21.15.155:0/230499153 shutdown_connections 2023-12-16T06:02:58.886 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:02:58.883+0000 7f04934d4700 1 -- 172.21.15.155:0/230499153 wait complete. 2023-12-16T06:02:59.241 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:02:59 smithi155 ceph-mon[217407]: pgmap v142: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 3 op/s 2023-12-16T06:02:59.261 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch upgrade status' 2023-12-16T06:02:59.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:02:59 smithi156 ceph-mon[182000]: pgmap v142: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 3 op/s 2023-12-16T06:02:59.529 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T06:03:00.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:00 smithi155 ceph-mon[217407]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:03:00.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:00 smithi156 ceph-mon[182000]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:03:00.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.589+0000 7fc1eeb70700 1 -- 172.21.15.155:0/2505482788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8101b00 msgr2=0x7fc1e8101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:03:00.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.589+0000 7fc1eeb70700 1 --2- 172.21.15.155:0/2505482788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8101b00 0x7fc1e8101ed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc004940 tx=0x7fc1dc009e30 comp rx=0 tx=0).stop 2023-12-16T06:03:00.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.589+0000 7fc1eeb70700 1 -- 172.21.15.155:0/2505482788 shutdown_connections 2023-12-16T06:03:00.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.589+0000 7fc1eeb70700 1 --2- 172.21.15.155:0/2505482788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1e80fbb40 0x7fc1e80fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:03:00.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.589+0000 7fc1eeb70700 1 --2- 172.21.15.155:0/2505482788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8101b00 0x7fc1e8101ed0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:03:00.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.589+0000 7fc1eeb70700 1 -- 172.21.15.155:0/2505482788 >> 172.21.15.155:0/2505482788 conn(0x7fc1e80719b0 msgr2=0x7fc1e8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:03:00.594 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.589+0000 7fc1eeb70700 1 -- 172.21.15.155:0/2505482788 shutdown_connections 2023-12-16T06:03:00.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.589+0000 7fc1eeb70700 1 -- 172.21.15.155:0/2505482788 wait complete. 2023-12-16T06:03:00.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.590+0000 7fc1eeb70700 1 Processor -- start 2023-12-16T06:03:00.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.590+0000 7fc1eeb70700 1 -- start start 2023-12-16T06:03:00.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.590+0000 7fc1eeb70700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1e80fbb40 0x7fc1e80fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:03:00.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.590+0000 7fc1eeb70700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8101b00 0x7fc1e80fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:03:00.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.590+0000 7fc1eeb70700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e80fe260 con 0x7fc1e8101b00 2023-12-16T06:03:00.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.590+0000 7fc1eeb70700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e80fe3d0 con 0x7fc1e80fbb40 2023-12-16T06:03:00.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.590+0000 7fc1e7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8101b00 0x7fc1e80fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:03:00.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.590+0000 7fc1e7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8101b00 0x7fc1e80fdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33546/0 (socket says 172.21.15.155:33546) 2023-12-16T06:03:00.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.590+0000 7fc1e7fff700 1 -- 172.21.15.155:0/4276956087 learned_addr learned my addr 172.21.15.155:0/4276956087 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:03:00.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.590+0000 7fc1ec90c700 1 --2- 172.21.15.155:0/4276956087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1e80fbb40 0x7fc1e80fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:03:00.595 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.590+0000 7fc1e7fff700 1 -- 172.21.15.155:0/4276956087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1e80fbb40 msgr2=0x7fc1e80fd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:03:00.596 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.590+0000 7fc1e7fff700 1 --2- 172.21.15.155:0/4276956087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1e80fbb40 0x7fc1e80fd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:03:00.596 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.590+0000 7fc1e7fff700 1 -- 172.21.15.155:0/4276956087 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc005040 con 0x7fc1e8101b00 2023-12-16T06:03:00.596 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.590+0000 7fc1ec90c700 1 --2- 172.21.15.155:0/4276956087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1e80fbb40 0x7fc1e80fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T06:03:00.596 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.591+0000 7fc1e7fff700 1 --2- 172.21.15.155:0/4276956087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8101b00 0x7fc1e80fdc60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4002a80 tx=0x7fc1d40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:03:00.596 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.591+0000 7fc1e57fa700 1 -- 172.21.15.155:0/4276956087 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1d4007cc0 con 0x7fc1e8101b00 2023-12-16T06:03:00.596 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.591+0000 7fc1e57fa700 1 -- 172.21.15.155:0/4276956087 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc1d400f040 con 0x7fc1e8101b00 2023-12-16T06:03:00.596 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.591+0000 7fc1eeb70700 1 -- 172.21.15.155:0/4276956087 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e81197d0 con 0x7fc1e8101b00 2023-12-16T06:03:00.596 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.591+0000 7fc1e57fa700 1 -- 172.21.15.155:0/4276956087 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1d4009640 con 0x7fc1e8101b00 2023-12-16T06:03:00.596 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.591+0000 7fc1eeb70700 1 -- 172.21.15.155:0/4276956087 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e8119cb0 con 0x7fc1e8101b00 2023-12-16T06:03:00.597 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.592+0000 7fc1eeb70700 1 -- 172.21.15.155:0/4276956087 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e80734d0 con 0x7fc1e8101b00 2023-12-16T06:03:00.597 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.592+0000 7fc1e57fa700 1 -- 172.21.15.155:0/4276956087 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7fc1d40097a0 con 0x7fc1e8101b00 2023-12-16T06:03:00.597 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.593+0000 7fc1e57fa700 1 --2- 172.21.15.155:0/4276956087 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fc1d806ce60 0x7fc1d806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:03:00.597 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.593+0000 7fc1e57fa700 1 -- 172.21.15.155:0/4276956087 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc1d408ba60 con 0x7fc1e8101b00 2023-12-16T06:03:00.597 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.593+0000 7fc1ec90c700 1 --2- 172.21.15.155:0/4276956087 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fc1d806ce60 0x7fc1d806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:03:00.597 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.593+0000 7fc1ec90c700 1 --2- 172.21.15.155:0/4276956087 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fc1d806ce60 0x7fc1d806f310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc004560 tx=0x7fc1dc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:03:00.600 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.597+0000 7fc1e57fa700 1 -- 172.21.15.155:0/4276956087 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fc1d4055990 con 0x7fc1e8101b00 2023-12-16T06:03:00.810 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.807+0000 7fc1eeb70700 1 -- 172.21.15.155:0/4276956087 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1e80fef70 con 0x7fc1d806ce60 2023-12-16T06:03:00.811 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.809+0000 7fc1e57fa700 1 -- 172.21.15.155:0/4276956087 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7fc1e80fef70 con 0x7fc1d806ce60 2023-12-16T06:03:00.811 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T06:03:00.811 INFO:teuthology.orchestra.run.smithi155.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T06:03:00.812 INFO:teuthology.orchestra.run.smithi155.stdout: "in_progress": true, 2023-12-16T06:03:00.812 INFO:teuthology.orchestra.run.smithi155.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T06:03:00.812 INFO:teuthology.orchestra.run.smithi155.stdout: "services_complete": [ 2023-12-16T06:03:00.812 INFO:teuthology.orchestra.run.smithi155.stdout: "osd", 2023-12-16T06:03:00.812 INFO:teuthology.orchestra.run.smithi155.stdout: "crash", 2023-12-16T06:03:00.812 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr", 2023-12-16T06:03:00.812 INFO:teuthology.orchestra.run.smithi155.stdout: "mon" 2023-12-16T06:03:00.812 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-12-16T06:03:00.812 INFO:teuthology.orchestra.run.smithi155.stdout: "progress": "12/21 daemons upgraded", 2023-12-16T06:03:00.812 INFO:teuthology.orchestra.run.smithi155.stdout: "message": "Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception", 2023-12-16T06:03:00.812 INFO:teuthology.orchestra.run.smithi155.stdout: "is_paused": true 2023-12-16T06:03:00.812 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T06:03:00.813 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.811+0000 7fc1eeb70700 1 -- 172.21.15.155:0/4276956087 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fc1d806ce60 msgr2=0x7fc1d806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:03:00.813 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.811+0000 7fc1eeb70700 1 --2- 172.21.15.155:0/4276956087 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fc1d806ce60 0x7fc1d806f310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc004560 tx=0x7fc1dc009e30 comp rx=0 tx=0).stop 2023-12-16T06:03:00.813 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.811+0000 7fc1eeb70700 1 -- 172.21.15.155:0/4276956087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8101b00 msgr2=0x7fc1e80fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:03:00.813 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.811+0000 7fc1eeb70700 1 --2- 172.21.15.155:0/4276956087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8101b00 0x7fc1e80fdc60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4002a80 tx=0x7fc1d40046b0 comp rx=0 tx=0).stop 2023-12-16T06:03:00.814 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.811+0000 7fc1eeb70700 1 -- 172.21.15.155:0/4276956087 shutdown_connections 2023-12-16T06:03:00.814 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.811+0000 7fc1eeb70700 1 --2- 172.21.15.155:0/4276956087 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fc1d806ce60 0x7fc1d806f310 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:03:00.814 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.811+0000 7fc1eeb70700 1 --2- 172.21.15.155:0/4276956087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1e80fbb40 0x7fc1e80fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:03:00.814 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.811+0000 7fc1eeb70700 1 --2- 172.21.15.155:0/4276956087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e8101b00 0x7fc1e80fdc60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:03:00.814 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.811+0000 7fc1eeb70700 1 -- 172.21.15.155:0/4276956087 >> 172.21.15.155:0/4276956087 conn(0x7fc1e80719b0 msgr2=0x7fc1e8065470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:03:00.814 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.811+0000 7fc1eeb70700 1 -- 172.21.15.155:0/4276956087 shutdown_connections 2023-12-16T06:03:00.814 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:00.811+0000 7fc1eeb70700 1 -- 172.21.15.155:0/4276956087 wait complete. 2023-12-16T06:03:01.206 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph health detail' 2023-12-16T06:03:01.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:01 smithi155 ceph-mon[217407]: pgmap v143: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2023-12-16T06:03:01.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:01 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:03:01.586 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T06:03:01.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:01 smithi156 ceph-mon[182000]: pgmap v143: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2023-12-16T06:03:01.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:01 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:03:02.545 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:02 smithi155 ceph-mon[217407]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:03:02.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:02 smithi156 ceph-mon[182000]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:03:02.747 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.743+0000 7fad67a10700 1 -- 172.21.15.155:0/3111911198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad60065390 msgr2=0x7fad60065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:03:02.747 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.743+0000 7fad67a10700 1 --2- 172.21.15.155:0/3111911198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad60065390 0x7fad60065800 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fad5c004940 tx=0x7fad5c009e30 comp rx=0 tx=0).stop 2023-12-16T06:03:02.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.743+0000 7fad67a10700 1 -- 172.21.15.155:0/3111911198 shutdown_connections 2023-12-16T06:03:02.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.743+0000 7fad67a10700 1 --2- 172.21.15.155:0/3111911198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad60065390 0x7fad60065800 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:03:02.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.743+0000 7fad67a10700 1 --2- 172.21.15.155:0/3111911198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad60102c20 0x7fad60102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:03:02.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.743+0000 7fad67a10700 1 -- 172.21.15.155:0/3111911198 >> 172.21.15.155:0/3111911198 conn(0x7fad600719b0 msgr2=0x7fad60071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:03:02.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.743+0000 7fad67a10700 1 -- 172.21.15.155:0/3111911198 shutdown_connections 2023-12-16T06:03:02.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.743+0000 7fad67a10700 1 -- 172.21.15.155:0/3111911198 wait complete. 2023-12-16T06:03:02.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.744+0000 7fad67a10700 1 Processor -- start 2023-12-16T06:03:02.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.744+0000 7fad67a10700 1 -- start start 2023-12-16T06:03:02.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.744+0000 7fad67a10700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad60065390 0x7fad60113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:03:02.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.744+0000 7fad67a10700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad60102c20 0x7fad60113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:03:02.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.744+0000 7fad67a10700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad601142c0 con 0x7fad60102c20 2023-12-16T06:03:02.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.744+0000 7fad67a10700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6010d5f0 con 0x7fad60065390 2023-12-16T06:03:02.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.744+0000 7fad64fab700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad60102c20 0x7fad60113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:03:02.749 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.744+0000 7fad64fab700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad60102c20 0x7fad60113c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33572/0 (socket says 172.21.15.155:33572) 2023-12-16T06:03:02.749 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.744+0000 7fad64fab700 1 -- 172.21.15.155:0/729839446 learned_addr learned my addr 172.21.15.155:0/729839446 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:03:02.749 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.744+0000 7fad657ac700 1 --2- 172.21.15.155:0/729839446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad60065390 0x7fad60113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:03:02.749 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.744+0000 7fad64fab700 1 -- 172.21.15.155:0/729839446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad60065390 msgr2=0x7fad60113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:03:02.749 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.744+0000 7fad64fab700 1 --2- 172.21.15.155:0/729839446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad60065390 0x7fad60113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:03:02.749 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.744+0000 7fad64fab700 1 -- 172.21.15.155:0/729839446 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c005040 con 0x7fad60102c20 2023-12-16T06:03:02.749 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.745+0000 7fad64fab700 1 --2- 172.21.15.155:0/729839446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad60102c20 0x7fad60113c70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00b3b0 tx=0x7fad5c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:03:02.749 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.745+0000 7fad55ffb700 1 -- 172.21.15.155:0/729839446 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad5c00e040 con 0x7fad60102c20 2023-12-16T06:03:02.749 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.745+0000 7fad67a10700 1 -- 172.21.15.155:0/729839446 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad6010d870 con 0x7fad60102c20 2023-12-16T06:03:02.749 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.745+0000 7fad55ffb700 1 -- 172.21.15.155:0/729839446 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fad5c01c430 con 0x7fad60102c20 2023-12-16T06:03:02.749 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.745+0000 7fad55ffb700 1 -- 172.21.15.155:0/729839446 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad5c013640 con 0x7fad60102c20 2023-12-16T06:03:02.750 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.745+0000 7fad67a10700 1 -- 172.21.15.155:0/729839446 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6010ddb0 con 0x7fad60102c20 2023-12-16T06:03:02.750 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.746+0000 7fad67a10700 1 -- 172.21.15.155:0/729839446 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad600fff40 con 0x7fad60102c20 2023-12-16T06:03:02.750 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.746+0000 7fad55ffb700 1 -- 172.21.15.155:0/729839446 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7fad5c01c5a0 con 0x7fad60102c20 2023-12-16T06:03:02.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.747+0000 7fad55ffb700 1 --2- 172.21.15.155:0/729839446 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fad4c06ce60 0x7fad4c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:03:02.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.747+0000 7fad55ffb700 1 -- 172.21.15.155:0/729839446 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fad5c08cd80 con 0x7fad60102c20 2023-12-16T06:03:02.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.747+0000 7fad657ac700 1 --2- 172.21.15.155:0/729839446 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fad4c06ce60 0x7fad4c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:03:02.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.747+0000 7fad657ac700 1 --2- 172.21.15.155:0/729839446 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fad4c06ce60 0x7fad4c06f310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fad50007fd0 tx=0x7fad50009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:03:02.754 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:02.751+0000 7fad55ffb700 1 -- 172.21.15.155:0/729839446 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fad5c05a870 con 0x7fad60102c20 2023-12-16T06:03:03.029 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:03.026+0000 7fad67a10700 1 -- 172.21.15.155:0/729839446 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fad600734d0 con 0x7fad60102c20 2023-12-16T06:03:03.029 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:03.026+0000 7fad55ffb700 1 -- 172.21.15.155:0/729839446 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+261 (secure 0 0 0) 0x7fad5c05a400 con 0x7fad60102c20 2023-12-16T06:03:03.029 INFO:teuthology.orchestra.run.smithi155.stdout:HEALTH_ERR Upgrade: failed due to an unexpected exception 2023-12-16T06:03:03.029 INFO:teuthology.orchestra.run.smithi155.stdout:[ERR] UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-16T06:03:03.029 INFO:teuthology.orchestra.run.smithi155.stdout: Unexpected exception occurred during upgrade process: osd require-osd-release failed: unrecognized release unknown retval: -22 2023-12-16T06:03:03.031 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:03.028+0000 7fad67a10700 1 -- 172.21.15.155:0/729839446 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fad4c06ce60 msgr2=0x7fad4c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:03:03.031 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:03.028+0000 7fad67a10700 1 --2- 172.21.15.155:0/729839446 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fad4c06ce60 0x7fad4c06f310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fad50007fd0 tx=0x7fad50009040 comp rx=0 tx=0).stop 2023-12-16T06:03:03.031 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:03.028+0000 7fad67a10700 1 -- 172.21.15.155:0/729839446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad60102c20 msgr2=0x7fad60113c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:03:03.031 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:03.028+0000 7fad67a10700 1 --2- 172.21.15.155:0/729839446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad60102c20 0x7fad60113c70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00b3b0 tx=0x7fad5c009e30 comp rx=0 tx=0).stop 2023-12-16T06:03:03.031 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:03.029+0000 7fad67a10700 1 -- 172.21.15.155:0/729839446 shutdown_connections 2023-12-16T06:03:03.031 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:03.029+0000 7fad67a10700 1 --2- 172.21.15.155:0/729839446 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fad4c06ce60 0x7fad4c06f310 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:03:03.031 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:03.029+0000 7fad67a10700 1 --2- 172.21.15.155:0/729839446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad60065390 0x7fad60113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:03:03.032 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:03.029+0000 7fad67a10700 1 --2- 172.21.15.155:0/729839446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad60102c20 0x7fad60113c70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:03:03.032 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:03.029+0000 7fad67a10700 1 -- 172.21.15.155:0/729839446 >> 172.21.15.155:0/729839446 conn(0x7fad600719b0 msgr2=0x7fad600fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:03:03.032 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:03.029+0000 7fad67a10700 1 -- 172.21.15.155:0/729839446 shutdown_connections 2023-12-16T06:03:03.032 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:03.029+0000 7fad67a10700 1 -- 172.21.15.155:0/729839446 wait complete. 2023-12-16T06:03:03.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:03 smithi155 ceph-mon[217407]: pgmap v144: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:03.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:03 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/729839446' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T06:03:03.409 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph versions' 2023-12-16T06:03:03.674 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T06:03:03.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:03 smithi156 ceph-mon[182000]: pgmap v144: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:03.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:03 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/729839446' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T06:03:04.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.784+0000 7f608de9f700 1 -- 172.21.15.155:0/1775986363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60880fbb40 msgr2=0x7f60880fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:03:04.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.784+0000 7f608de9f700 1 --2- 172.21.15.155:0/1775986363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60880fbb40 0x7f60880fbfb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f607c004940 tx=0x7f607c009e30 comp rx=0 tx=0).stop 2023-12-16T06:03:04.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.784+0000 7f608de9f700 1 -- 172.21.15.155:0/1775986363 shutdown_connections 2023-12-16T06:03:04.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.784+0000 7f608de9f700 1 --2- 172.21.15.155:0/1775986363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60880fbb40 0x7f60880fbfb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:03:04.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.784+0000 7f608de9f700 1 --2- 172.21.15.155:0/1775986363 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6088101b00 0x7f6088101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:03:04.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.784+0000 7f608de9f700 1 -- 172.21.15.155:0/1775986363 >> 172.21.15.155:0/1775986363 conn(0x7f60880719b0 msgr2=0x7f6088071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:03:04.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.784+0000 7f608de9f700 1 -- 172.21.15.155:0/1775986363 shutdown_connections 2023-12-16T06:03:04.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.784+0000 7f608de9f700 1 -- 172.21.15.155:0/1775986363 wait complete. 2023-12-16T06:03:04.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.784+0000 7f608de9f700 1 Processor -- start 2023-12-16T06:03:04.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.784+0000 7f608de9f700 1 -- start start 2023-12-16T06:03:04.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.785+0000 7f608de9f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60880fbb40 0x7f60881136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:03:04.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.785+0000 7f608de9f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6088101b00 0x7f6088113c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:03:04.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.785+0000 7f608de9f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6088114290 con 0x7f60880fbb40 2023-12-16T06:03:04.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.785+0000 7f608de9f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608810d580 con 0x7f6088101b00 2023-12-16T06:03:04.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.785+0000 7f60877fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60880fbb40 0x7f60881136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:03:04.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.785+0000 7f60877fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60880fbb40 0x7f60881136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33586/0 (socket says 172.21.15.155:33586) 2023-12-16T06:03:04.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.785+0000 7f60877fe700 1 -- 172.21.15.155:0/4229519666 learned_addr learned my addr 172.21.15.155:0/4229519666 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:03:04.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.785+0000 7f6086ffd700 1 --2- 172.21.15.155:0/4229519666 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6088101b00 0x7f6088113c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:03:04.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.785+0000 7f60877fe700 1 -- 172.21.15.155:0/4229519666 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6088101b00 msgr2=0x7f6088113c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:03:04.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.785+0000 7f60877fe700 1 --2- 172.21.15.155:0/4229519666 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6088101b00 0x7f6088113c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:03:04.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.785+0000 7f60877fe700 1 -- 172.21.15.155:0/4229519666 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c005040 con 0x7f60880fbb40 2023-12-16T06:03:04.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.785+0000 7f6086ffd700 1 --2- 172.21.15.155:0/4229519666 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6088101b00 0x7f6088113c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T06:03:04.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.785+0000 7f60877fe700 1 --2- 172.21.15.155:0/4229519666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60880fbb40 0x7f60881136c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6078002a50 tx=0x7f60780046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:03:04.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.785+0000 7f606ffff700 1 -- 172.21.15.155:0/4229519666 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6078007cc0 con 0x7f60880fbb40 2023-12-16T06:03:04.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.785+0000 7f608de9f700 1 -- 172.21.15.155:0/4229519666 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608810d810 con 0x7f60880fbb40 2023-12-16T06:03:04.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.785+0000 7f606ffff700 1 -- 172.21.15.155:0/4229519666 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f607800f040 con 0x7f60880fbb40 2023-12-16T06:03:04.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.785+0000 7f606ffff700 1 -- 172.21.15.155:0/4229519666 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6078009540 con 0x7f60880fbb40 2023-12-16T06:03:04.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.785+0000 7f608de9f700 1 -- 172.21.15.155:0/4229519666 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608810dd50 con 0x7f60880fbb40 2023-12-16T06:03:04.791 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.786+0000 7f608de9f700 1 -- 172.21.15.155:0/4229519666 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60880734d0 con 0x7f60880fbb40 2023-12-16T06:03:04.791 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.787+0000 7f606ffff700 1 -- 172.21.15.155:0/4229519666 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f60780096a0 con 0x7f60880fbb40 2023-12-16T06:03:04.792 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.787+0000 7f606ffff700 1 --2- 172.21.15.155:0/4229519666 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f607006ce60 0x7f607006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:03:04.792 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.788+0000 7f6086ffd700 1 --2- 172.21.15.155:0/4229519666 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f607006ce60 0x7f607006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:03:04.792 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.788+0000 7f606ffff700 1 -- 172.21.15.155:0/4229519666 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f607808c0a0 con 0x7f60880fbb40 2023-12-16T06:03:04.792 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.788+0000 7f6086ffd700 1 --2- 172.21.15.155:0/4229519666 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f607006ce60 0x7f607006f310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f607c004560 tx=0x7f607c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:03:04.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:04.792+0000 7f606ffff700 1 -- 172.21.15.155:0/4229519666 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f6078059a60 con 0x7f60880fbb40 2023-12-16T06:03:05.068 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:05.066+0000 7f608de9f700 1 -- 172.21.15.155:0/4229519666 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f608810ed40 con 0x7f60880fbb40 2023-12-16T06:03:05.069 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:05.066+0000 7f606ffff700 1 -- 172.21.15.155:0/4229519666 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+725 (secure 0 0 0) 0x7f60780595f0 con 0x7f60880fbb40 2023-12-16T06:03:05.069 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T06:03:05.069 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": { 2023-12-16T06:03:05.069 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T06:03:05.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:03:05.069 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": { 2023-12-16T06:03:05.069 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T06:03:05.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:03:05.069 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": { 2023-12-16T06:03:05.070 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 6 2023-12-16T06:03:05.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:03:05.070 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2023-12-16T06:03:05.070 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T06:03:05.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:03:05.070 INFO:teuthology.orchestra.run.smithi155.stdout: "overall": { 2023-12-16T06:03:05.070 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4, 2023-12-16T06:03:05.070 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 10 2023-12-16T06:03:05.070 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-12-16T06:03:05.070 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T06:03:05.071 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:05.068+0000 7f608de9f700 1 -- 172.21.15.155:0/4229519666 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f607006ce60 msgr2=0x7f607006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:03:05.071 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:05.068+0000 7f608de9f700 1 --2- 172.21.15.155:0/4229519666 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f607006ce60 0x7f607006f310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f607c004560 tx=0x7f607c009e30 comp rx=0 tx=0).stop 2023-12-16T06:03:05.071 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:05.068+0000 7f608de9f700 1 -- 172.21.15.155:0/4229519666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60880fbb40 msgr2=0x7f60881136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:03:05.071 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:05.068+0000 7f608de9f700 1 --2- 172.21.15.155:0/4229519666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60880fbb40 0x7f60881136c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6078002a50 tx=0x7f60780046b0 comp rx=0 tx=0).stop 2023-12-16T06:03:05.071 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:05.068+0000 7f608de9f700 1 -- 172.21.15.155:0/4229519666 shutdown_connections 2023-12-16T06:03:05.071 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:05.068+0000 7f608de9f700 1 --2- 172.21.15.155:0/4229519666 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f607006ce60 0x7f607006f310 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:03:05.071 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:05.068+0000 7f608de9f700 1 --2- 172.21.15.155:0/4229519666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60880fbb40 0x7f60881136c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:03:05.071 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:05.068+0000 7f608de9f700 1 --2- 172.21.15.155:0/4229519666 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6088101b00 0x7f6088113c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:03:05.071 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:05.068+0000 7f608de9f700 1 -- 172.21.15.155:0/4229519666 >> 172.21.15.155:0/4229519666 conn(0x7f60880719b0 msgr2=0x7f6088065550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:03:05.071 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:05.069+0000 7f608de9f700 1 -- 172.21.15.155:0/4229519666 shutdown_connections 2023-12-16T06:03:05.071 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:03:05.069+0000 7f608de9f700 1 -- 172.21.15.155:0/4229519666 wait complete. 2023-12-16T06:03:05.440 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:05 smithi155 ceph-mon[217407]: pgmap v145: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:05.440 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:05 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/4229519666' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:03:05.441 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:05 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:03:05.467 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2023-12-16T06:03:05.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:05 smithi156 ceph-mon[182000]: pgmap v145: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:05.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:05 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/4229519666' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:03:05.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:05 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:03:05.733 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T06:03:06.712 INFO:teuthology.orchestra.run.smithi155.stdout:wait for servicemap items w/ changing names to refresh 2023-12-16T06:03:07.058 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'sleep 60' 2023-12-16T06:03:07.326 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T06:03:07.525 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:07 smithi155 ceph-mon[217407]: pgmap v146: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:07.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:07 smithi156 ceph-mon[182000]: pgmap v146: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:09.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:09 smithi155 ceph-mon[217407]: pgmap v147: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:09.679 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:09 smithi156 ceph-mon[182000]: pgmap v147: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:11.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:11 smithi155 ceph-mon[217407]: pgmap v148: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:11.680 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:11 smithi156 ceph-mon[182000]: pgmap v148: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:13.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:12 smithi155 ceph-mon[217407]: pgmap v149: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:13.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:12 smithi156 ceph-mon[182000]: pgmap v149: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:15.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:15 smithi156 ceph-mon[182000]: pgmap v150: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:15.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:15 smithi155 ceph-mon[217407]: pgmap v150: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:17.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:17 smithi156 ceph-mon[182000]: pgmap v151: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:17.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:17 smithi155 ceph-mon[217407]: pgmap v151: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:19.389 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:19 smithi155 ceph-mon[217407]: pgmap v152: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:19.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:19 smithi156 ceph-mon[182000]: pgmap v152: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:21.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:21 smithi156 ceph-mon[182000]: pgmap v153: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:21.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:21 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:03:21.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:21 smithi155 ceph-mon[217407]: pgmap v153: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:21.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:21 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:03:23.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:22 smithi155 ceph-mon[217407]: pgmap v154: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:23.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:22 smithi156 ceph-mon[182000]: pgmap v154: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:25.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:25 smithi156 ceph-mon[182000]: pgmap v155: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:25.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:25 smithi155 ceph-mon[217407]: pgmap v155: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:27.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:27 smithi156 ceph-mon[182000]: pgmap v156: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:27.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:27 smithi155 ceph-mon[217407]: pgmap v156: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:29.389 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:29 smithi155 ceph-mon[217407]: pgmap v157: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:29.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:29 smithi156 ceph-mon[182000]: pgmap v157: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:31.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:31 smithi156 ceph-mon[182000]: pgmap v158: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:31.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:31 smithi155 ceph-mon[217407]: pgmap v158: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:33.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:32 smithi155 ceph-mon[217407]: pgmap v159: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:33.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:32 smithi156 ceph-mon[182000]: pgmap v159: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:35.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:35 smithi156 ceph-mon[182000]: pgmap v160: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:35.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:35 smithi155 ceph-mon[217407]: pgmap v160: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:36.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:36 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:03:36.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:36 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:03:37.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:37 smithi156 ceph-mon[182000]: pgmap v161: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:37.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:37 smithi155 ceph-mon[217407]: pgmap v161: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:39.389 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:39 smithi155 ceph-mon[217407]: pgmap v162: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:39.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:39 smithi156 ceph-mon[182000]: pgmap v162: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:41.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:41 smithi156 ceph-mon[182000]: pgmap v163: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:41.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:41 smithi155 ceph-mon[217407]: pgmap v163: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:43.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:42 smithi155 ceph-mon[217407]: pgmap v164: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:43.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:42 smithi156 ceph-mon[182000]: pgmap v164: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:45 smithi156 ceph-mon[182000]: pgmap v165: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:45 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:03:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:45 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:03:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:45 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T06:03:45.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:45 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:03:45.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:45 smithi155 ceph-mon[217407]: pgmap v165: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:45.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:45 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T06:03:45.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:45 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T06:03:45.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:45 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T06:03:45.577 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:45 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' 2023-12-16T06:03:47.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:47 smithi156 ceph-mon[182000]: pgmap v166: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:47.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:47 smithi155 ceph-mon[217407]: pgmap v166: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:49.388 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:49 smithi155 ceph-mon[217407]: pgmap v167: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:49.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:49 smithi156 ceph-mon[182000]: pgmap v167: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:51.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:51 smithi156 ceph-mon[182000]: pgmap v168: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:51.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:51 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:03:51.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:51 smithi155 ceph-mon[217407]: pgmap v168: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:51.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:51 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:03:53.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:52 smithi155 ceph-mon[217407]: pgmap v169: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:53.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:52 smithi156 ceph-mon[182000]: pgmap v169: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:55.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:55 smithi156 ceph-mon[182000]: pgmap v170: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:55.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:55 smithi155 ceph-mon[217407]: pgmap v170: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:03:57.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:57 smithi156 ceph-mon[182000]: pgmap v171: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:57.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:57 smithi155 ceph-mon[217407]: pgmap v171: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:59.388 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:03:59 smithi155 ceph-mon[217407]: pgmap v172: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:03:59.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:03:59 smithi156 ceph-mon[182000]: pgmap v172: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:04:01.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:01 smithi156 ceph-mon[182000]: pgmap v173: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:04:01.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:01 smithi155 ceph-mon[217407]: pgmap v173: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:04:03.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:02 smithi155 ceph-mon[217407]: pgmap v174: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:04:03.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:02 smithi156 ceph-mon[182000]: pgmap v174: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:04:05.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:05 smithi156 ceph-mon[182000]: pgmap v175: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:04:05.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:05 smithi155 ceph-mon[217407]: pgmap v175: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:04:06.433 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:06 smithi156 ceph-mon[182000]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:04:06.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:06 smithi155 ceph-mon[217407]: from='mgr.34104 172.21.15.155:0/63246897' entity='mgr.smithi155.maowdn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T06:04:07.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:07 smithi156 ceph-mon[182000]: pgmap v176: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:04:07.576 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:07 smithi155 ceph-mon[217407]: pgmap v176: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:04:08.588 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch ps' 2023-12-16T06:04:08.859 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T06:04:09.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:09 smithi155 ceph-mon[217407]: pgmap v177: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:04:09.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:09 smithi156 ceph-mon[182000]: pgmap v177: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:04:09.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.921+0000 7fbd56678700 1 -- 172.21.15.155:0/371868969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd500fbb30 msgr2=0x7fbd500fbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:09.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.921+0000 7fbd56678700 1 --2- 172.21.15.155:0/371868969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd500fbb30 0x7fbd500fbfa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbd44004940 tx=0x7fbd44009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:09.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.921+0000 7fbd56678700 1 -- 172.21.15.155:0/371868969 shutdown_connections 2023-12-16T06:04:09.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.921+0000 7fbd56678700 1 --2- 172.21.15.155:0/371868969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd500fbb30 0x7fbd500fbfa0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:09.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.921+0000 7fbd56678700 1 --2- 172.21.15.155:0/371868969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd50101af0 0x7fbd50101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:09.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.921+0000 7fbd56678700 1 -- 172.21.15.155:0/371868969 >> 172.21.15.155:0/371868969 conn(0x7fbd500f7690 msgr2=0x7fbd500f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:09.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.921+0000 7fbd56678700 1 -- 172.21.15.155:0/371868969 shutdown_connections 2023-12-16T06:04:09.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.921+0000 7fbd56678700 1 -- 172.21.15.155:0/371868969 wait complete. 2023-12-16T06:04:09.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.922+0000 7fbd56678700 1 Processor -- start 2023-12-16T06:04:09.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.922+0000 7fbd56678700 1 -- start start 2023-12-16T06:04:09.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.922+0000 7fbd56678700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd500fbb30 0x7fbd500fd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:09.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.922+0000 7fbd56678700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd50101af0 0x7fbd500fdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:09.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.922+0000 7fbd56678700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd500fe2e0 con 0x7fbd50101af0 2023-12-16T06:04:09.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.922+0000 7fbd56678700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd500fe450 con 0x7fbd500fbb30 2023-12-16T06:04:09.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.922+0000 7fbd4f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd50101af0 0x7fbd500fdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:09.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.922+0000 7fbd4f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd50101af0 0x7fbd500fdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59634/0 (socket says 172.21.15.155:59634) 2023-12-16T06:04:09.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.922+0000 7fbd4f7fe700 1 -- 172.21.15.155:0/2963472677 learned_addr learned my addr 172.21.15.155:0/2963472677 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:04:09.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.922+0000 7fbd4ffff700 1 --2- 172.21.15.155:0/2963472677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd500fbb30 0x7fbd500fd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:09.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.923+0000 7fbd4f7fe700 1 -- 172.21.15.155:0/2963472677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd500fbb30 msgr2=0x7fbd500fd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:09.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.923+0000 7fbd4f7fe700 1 --2- 172.21.15.155:0/2963472677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd500fbb30 0x7fbd500fd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:09.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.923+0000 7fbd4f7fe700 1 -- 172.21.15.155:0/2963472677 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd44005040 con 0x7fbd50101af0 2023-12-16T06:04:09.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.923+0000 7fbd4f7fe700 1 --2- 172.21.15.155:0/2963472677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd50101af0 0x7fbd500fdc50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400b3b0 tx=0x7fbd44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:09.927 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.923+0000 7fbd4cff9700 1 -- 172.21.15.155:0/2963472677 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd4400e040 con 0x7fbd50101af0 2023-12-16T06:04:09.928 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.923+0000 7fbd56678700 1 -- 172.21.15.155:0/2963472677 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd50119870 con 0x7fbd50101af0 2023-12-16T06:04:09.928 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.923+0000 7fbd4cff9700 1 -- 172.21.15.155:0/2963472677 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbd4400bc50 con 0x7fbd50101af0 2023-12-16T06:04:09.928 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.923+0000 7fbd4cff9700 1 -- 172.21.15.155:0/2963472677 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd44013420 con 0x7fbd50101af0 2023-12-16T06:04:09.928 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.923+0000 7fbd56678700 1 -- 172.21.15.155:0/2963472677 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd50119d60 con 0x7fbd50101af0 2023-12-16T06:04:09.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.924+0000 7fbd56678700 1 -- 172.21.15.155:0/2963472677 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd500fb290 con 0x7fbd50101af0 2023-12-16T06:04:09.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.924+0000 7fbd4cff9700 1 -- 172.21.15.155:0/2963472677 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7fbd4401c430 con 0x7fbd50101af0 2023-12-16T06:04:09.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.925+0000 7fbd4cff9700 1 --2- 172.21.15.155:0/2963472677 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fbd3806ce60 0x7fbd3806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:09.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.925+0000 7fbd4cff9700 1 -- 172.21.15.155:0/2963472677 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fbd4408d050 con 0x7fbd50101af0 2023-12-16T06:04:09.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.925+0000 7fbd4ffff700 1 --2- 172.21.15.155:0/2963472677 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fbd3806ce60 0x7fbd3806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:09.929 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.925+0000 7fbd4ffff700 1 --2- 172.21.15.155:0/2963472677 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fbd3806ce60 0x7fbd3806f310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbd40006fd0 tx=0x7fbd40008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:09.932 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:09.929+0000 7fbd4cff9700 1 -- 172.21.15.155:0/2963472677 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fbd440570b0 con 0x7fbd50101af0 2023-12-16T06:04:10.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:10.130+0000 7fbd56678700 1 -- 172.21.15.155:0/2963472677 --> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd500fef60 con 0x7fbd3806ce60 2023-12-16T06:04:10.143 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:10.141+0000 7fbd4cff9700 1 -- 172.21.15.155:0/2963472677 <== mgr.34104 v2:172.21.15.155:6800/3958499733 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fbd500fef60 con 0x7fbd3806ce60 2023-12-16T06:04:10.143 INFO:teuthology.orchestra.run.smithi155.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T06:04:10.143 INFO:teuthology.orchestra.run.smithi155.stdout:alertmanager.smithi155 smithi155 *:9093,9094 running (5m) 2m ago 13m 29.5M - 0.25.0 c8568f914cd2 e1da85d6fc09 2023-12-16T06:04:10.144 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi155 smithi155 running (4m) 2m ago 13m 7470k - 19.0.0-191-g6d933094 a29c258b5d6f 6599d6adc8fa 2023-12-16T06:04:10.144 INFO:teuthology.orchestra.run.smithi155.stdout:crash.smithi156 smithi156 running (4m) 89s ago 12m 7448k - 19.0.0-191-g6d933094 a29c258b5d6f 8129878ae56e 2023-12-16T06:04:10.144 INFO:teuthology.orchestra.run.smithi155.stdout:grafana.smithi155 smithi155 *:3000 running (5m) 2m ago 13m 83.3M - 9.4.12 a0ea5e3c46d9 a16c84704784 2023-12-16T06:04:10.144 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.bzsxjw smithi155 running (9m) 2m ago 9m 4746M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 6bcabf94a5c3 2023-12-16T06:04:10.144 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi155.vicpis smithi155 running (9m) 2m ago 9m 669M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 afa64e1ef8da 2023-12-16T06:04:10.144 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.fasing smithi156 running (9m) 89s ago 9m 539M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 7d97160bda7c 2023-12-16T06:04:10.144 INFO:teuthology.orchestra.run.smithi155.stdout:mds.cephfs.smithi156.qvgmfj smithi156 running (9m) 89s ago 9m 5969M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4018b2f2e27e 2023-12-16T06:04:10.144 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi155.maowdn smithi155 *:8443,9283,8765 running (6m) 2m ago 14m 513M - 19.0.0-191-g6d933094 a29c258b5d6f ee39089d18d3 2023-12-16T06:04:10.144 INFO:teuthology.orchestra.run.smithi155.stdout:mgr.smithi156.pclong smithi156 *:8443,9283,8765 running (6m) 89s ago 12m 449M - 19.0.0-191-g6d933094 a29c258b5d6f 673376e357e8 2023-12-16T06:04:10.144 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi155 smithi155 running (4m) 2m ago 14m 67.4M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 19eb23d9f064 2023-12-16T06:04:10.144 INFO:teuthology.orchestra.run.smithi155.stdout:mon.smithi156 smithi156 running (4m) 89s ago 12m 51.0M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 62dacb4d7a17 2023-12-16T06:04:10.144 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi155 smithi155 *:9100 running (6m) 2m ago 13m 15.7M - 1.5.0 0da6a335fe13 6f0f1f68f191 2023-12-16T06:04:10.144 INFO:teuthology.orchestra.run.smithi155.stdout:node-exporter.smithi156 smithi156 *:9100 running (6m) 89s ago 12m 19.0M - 1.5.0 0da6a335fe13 c4595a7b1707 2023-12-16T06:04:10.144 INFO:teuthology.orchestra.run.smithi155.stdout:osd.0 smithi155 running (3m) 2m ago 12m 122M 1568M 19.0.0-191-g6d933094 a29c258b5d6f f5b1d720ac4f 2023-12-16T06:04:10.144 INFO:teuthology.orchestra.run.smithi155.stdout:osd.1 smithi155 running (3m) 2m ago 11m 125M 1568M 19.0.0-191-g6d933094 a29c258b5d6f badaf737af87 2023-12-16T06:04:10.145 INFO:teuthology.orchestra.run.smithi155.stdout:osd.2 smithi155 running (2m) 2m ago 11m 12.6M 1568M 19.0.0-191-g6d933094 a29c258b5d6f 9a08b6ae1253 2023-12-16T06:04:10.145 INFO:teuthology.orchestra.run.smithi155.stdout:osd.3 smithi156 running (2m) 89s ago 11m 139M 2592M 19.0.0-191-g6d933094 a29c258b5d6f 3a04979138d3 2023-12-16T06:04:10.145 INFO:teuthology.orchestra.run.smithi155.stdout:osd.4 smithi156 running (119s) 89s ago 10m 125M 2592M 19.0.0-191-g6d933094 a29c258b5d6f a4a0224a1f37 2023-12-16T06:04:10.145 INFO:teuthology.orchestra.run.smithi155.stdout:osd.5 smithi156 running (91s) 89s ago 10m 12.0M 2592M 19.0.0-191-g6d933094 a29c258b5d6f 8687b2c89107 2023-12-16T06:04:10.145 INFO:teuthology.orchestra.run.smithi155.stdout:prometheus.smithi155 smithi155 *:9095 running (6m) 2m ago 13m 66.6M - 2.43.0 a07b618ecd1d 26bb7cfc1b8b 2023-12-16T06:04:10.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:10.143+0000 7fbd56678700 1 -- 172.21.15.155:0/2963472677 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fbd3806ce60 msgr2=0x7fbd3806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:10.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:10.143+0000 7fbd56678700 1 --2- 172.21.15.155:0/2963472677 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fbd3806ce60 0x7fbd3806f310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbd40006fd0 tx=0x7fbd40008040 comp rx=0 tx=0).stop 2023-12-16T06:04:10.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:10.143+0000 7fbd56678700 1 -- 172.21.15.155:0/2963472677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd50101af0 msgr2=0x7fbd500fdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:10.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:10.143+0000 7fbd56678700 1 --2- 172.21.15.155:0/2963472677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd50101af0 0x7fbd500fdc50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400b3b0 tx=0x7fbd44009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:10.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:10.143+0000 7fbd56678700 1 -- 172.21.15.155:0/2963472677 shutdown_connections 2023-12-16T06:04:10.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:10.143+0000 7fbd56678700 1 --2- 172.21.15.155:0/2963472677 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fbd3806ce60 0x7fbd3806f310 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:10.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:10.143+0000 7fbd56678700 1 --2- 172.21.15.155:0/2963472677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd500fbb30 0x7fbd500fd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:10.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:10.143+0000 7fbd56678700 1 --2- 172.21.15.155:0/2963472677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd50101af0 0x7fbd500fdc50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:10.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:10.143+0000 7fbd56678700 1 -- 172.21.15.155:0/2963472677 >> 172.21.15.155:0/2963472677 conn(0x7fbd500f7690 msgr2=0x7fbd50065ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:10.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:10.143+0000 7fbd56678700 1 -- 172.21.15.155:0/2963472677 shutdown_connections 2023-12-16T06:04:10.146 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:10.143+0000 7fbd56678700 1 -- 172.21.15.155:0/2963472677 wait complete. 2023-12-16T06:04:10.532 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph versions' 2023-12-16T06:04:10.797 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T06:04:11.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:11 smithi155 ceph-mon[217407]: pgmap v178: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:04:11.326 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:11 smithi155 ceph-mon[217407]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:04:11.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:11 smithi156 ceph-mon[182000]: pgmap v178: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:04:11.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:11 smithi156 ceph-mon[182000]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T06:04:11.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.861+0000 7fbb1f1bd700 1 -- 172.21.15.155:0/1223651721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb180fdb90 msgr2=0x7fbb180fdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:11.866 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.861+0000 7fbb1f1bd700 1 --2- 172.21.15.155:0/1223651721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb180fdb90 0x7fbb180fdf60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c004940 tx=0x7fbb0c009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:11.867 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.861+0000 7fbb1f1bd700 1 -- 172.21.15.155:0/1223651721 shutdown_connections 2023-12-16T06:04:11.867 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.861+0000 7fbb1f1bd700 1 --2- 172.21.15.155:0/1223651721 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb180fe530 0x7fbb18106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:11.867 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.861+0000 7fbb1f1bd700 1 --2- 172.21.15.155:0/1223651721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb180fdb90 0x7fbb180fdf60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:11.867 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.861+0000 7fbb1f1bd700 1 -- 172.21.15.155:0/1223651721 >> 172.21.15.155:0/1223651721 conn(0x7fbb180f7600 msgr2=0x7fbb180f9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.861+0000 7fbb1f1bd700 1 -- 172.21.15.155:0/1223651721 shutdown_connections 2023-12-16T06:04:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.861+0000 7fbb1f1bd700 1 -- 172.21.15.155:0/1223651721 wait complete. 2023-12-16T06:04:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.861+0000 7fbb1f1bd700 1 Processor -- start 2023-12-16T06:04:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.861+0000 7fbb1f1bd700 1 -- start start 2023-12-16T06:04:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.862+0000 7fbb1f1bd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb180fdb90 0x7fbb18113590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.862+0000 7fbb1f1bd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb180fe530 0x7fbb18113ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.862+0000 7fbb1f1bd700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb18114120 con 0x7fbb180fe530 2023-12-16T06:04:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.862+0000 7fbb1f1bd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1810d450 con 0x7fbb180fdb90 2023-12-16T06:04:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.862+0000 7fbb17fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb180fe530 0x7fbb18113ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.862+0000 7fbb17fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb180fe530 0x7fbb18113ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59658/0 (socket says 172.21.15.155:59658) 2023-12-16T06:04:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.862+0000 7fbb17fff700 1 -- 172.21.15.155:0/2839483199 learned_addr learned my addr 172.21.15.155:0/2839483199 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:04:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.862+0000 7fbb1cf59700 1 --2- 172.21.15.155:0/2839483199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb180fdb90 0x7fbb18113590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.862+0000 7fbb17fff700 1 -- 172.21.15.155:0/2839483199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb180fdb90 msgr2=0x7fbb18113590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:11.869 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.862+0000 7fbb17fff700 1 --2- 172.21.15.155:0/2839483199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb180fdb90 0x7fbb18113590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:11.869 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.862+0000 7fbb17fff700 1 -- 172.21.15.155:0/2839483199 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c005040 con 0x7fbb180fe530 2023-12-16T06:04:11.869 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.862+0000 7fbb1cf59700 1 --2- 172.21.15.155:0/2839483199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb180fdb90 0x7fbb18113590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T06:04:11.869 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.862+0000 7fbb17fff700 1 --2- 172.21.15.155:0/2839483199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb180fe530 0x7fbb18113ad0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c830 tx=0x7fbb04004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:11.869 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.863+0000 7fbb157fa700 1 -- 172.21.15.155:0/2839483199 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb0400a760 con 0x7fbb180fe530 2023-12-16T06:04:11.869 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.863+0000 7fbb1f1bd700 1 -- 172.21.15.155:0/2839483199 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1810d730 con 0x7fbb180fe530 2023-12-16T06:04:11.869 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.863+0000 7fbb157fa700 1 -- 172.21.15.155:0/2839483199 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbb0400ad70 con 0x7fbb180fe530 2023-12-16T06:04:11.869 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.863+0000 7fbb157fa700 1 -- 172.21.15.155:0/2839483199 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb040113a0 con 0x7fbb180fe530 2023-12-16T06:04:11.869 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.863+0000 7fbb1f1bd700 1 -- 172.21.15.155:0/2839483199 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1810dc70 con 0x7fbb180fe530 2023-12-16T06:04:11.870 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.863+0000 7fbb1f1bd700 1 -- 172.21.15.155:0/2839483199 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb18104180 con 0x7fbb180fe530 2023-12-16T06:04:11.870 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.864+0000 7fbb157fa700 1 -- 172.21.15.155:0/2839483199 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7fbb04012400 con 0x7fbb180fe530 2023-12-16T06:04:11.870 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.864+0000 7fbb157fa700 1 --2- 172.21.15.155:0/2839483199 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fbb0806ce60 0x7fbb0806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:11.870 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.864+0000 7fbb157fa700 1 -- 172.21.15.155:0/2839483199 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fbb0408c2c0 con 0x7fbb180fe530 2023-12-16T06:04:11.870 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.865+0000 7fbb1cf59700 1 --2- 172.21.15.155:0/2839483199 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fbb0806ce60 0x7fbb0806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:11.871 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.865+0000 7fbb1cf59700 1 --2- 172.21.15.155:0/2839483199 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fbb0806ce60 0x7fbb0806f310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c004f90 tx=0x7fbb0c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:11.871 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:11.869+0000 7fbb157fa700 1 -- 172.21.15.155:0/2839483199 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fbb04059d00 con 0x7fbb180fe530 2023-12-16T06:04:12.149 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:12.146+0000 7fbb1f1bd700 1 -- 172.21.15.155:0/2839483199 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbb18064770 con 0x7fbb180fe530 2023-12-16T06:04:12.150 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:12.147+0000 7fbb157fa700 1 -- 172.21.15.155:0/2839483199 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+725 (secure 0 0 0) 0x7fbb04059890 con 0x7fbb180fe530 2023-12-16T06:04:12.150 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-12-16T06:04:12.150 INFO:teuthology.orchestra.run.smithi155.stdout: "mon": { 2023-12-16T06:04:12.150 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T06:04:12.150 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:04:12.150 INFO:teuthology.orchestra.run.smithi155.stdout: "mgr": { 2023-12-16T06:04:12.150 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T06:04:12.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:04:12.151 INFO:teuthology.orchestra.run.smithi155.stdout: "osd": { 2023-12-16T06:04:12.151 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 6 2023-12-16T06:04:12.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:04:12.151 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2023-12-16T06:04:12.151 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T06:04:12.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-12-16T06:04:12.151 INFO:teuthology.orchestra.run.smithi155.stdout: "overall": { 2023-12-16T06:04:12.151 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4, 2023-12-16T06:04:12.151 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 10 2023-12-16T06:04:12.151 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-12-16T06:04:12.151 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-12-16T06:04:12.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:12.149+0000 7fbb1f1bd700 1 -- 172.21.15.155:0/2839483199 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fbb0806ce60 msgr2=0x7fbb0806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:12.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:12.149+0000 7fbb1f1bd700 1 --2- 172.21.15.155:0/2839483199 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fbb0806ce60 0x7fbb0806f310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c004f90 tx=0x7fbb0c009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:12.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:12.149+0000 7fbb1f1bd700 1 -- 172.21.15.155:0/2839483199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb180fe530 msgr2=0x7fbb18113ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:12.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:12.149+0000 7fbb1f1bd700 1 --2- 172.21.15.155:0/2839483199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb180fe530 0x7fbb18113ad0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c830 tx=0x7fbb04004470 comp rx=0 tx=0).stop 2023-12-16T06:04:12.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:12.149+0000 7fbb1f1bd700 1 -- 172.21.15.155:0/2839483199 shutdown_connections 2023-12-16T06:04:12.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:12.149+0000 7fbb1f1bd700 1 --2- 172.21.15.155:0/2839483199 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fbb0806ce60 0x7fbb0806f310 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:12.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:12.149+0000 7fbb1f1bd700 1 --2- 172.21.15.155:0/2839483199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb180fdb90 0x7fbb18113590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:12.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:12.149+0000 7fbb1f1bd700 1 --2- 172.21.15.155:0/2839483199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb180fe530 0x7fbb18113ad0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:12.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:12.149+0000 7fbb1f1bd700 1 -- 172.21.15.155:0/2839483199 >> 172.21.15.155:0/2839483199 conn(0x7fbb180f7600 msgr2=0x7fbb18101300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:12.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:12.149+0000 7fbb1f1bd700 1 -- 172.21.15.155:0/2839483199 shutdown_connections 2023-12-16T06:04:12.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:12.149+0000 7fbb1f1bd700 1 -- 172.21.15.155:0/2839483199 wait complete. 2023-12-16T06:04:12.539 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2023-12-16T06:04:12.804 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/mon.smithi155/config 2023-12-16T06:04:13.277 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:12 smithi155 ceph-mon[217407]: pgmap v179: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:04:13.277 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:12 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/2839483199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:04:13.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:12 smithi156 ceph-mon[182000]: pgmap v179: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:04:13.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:12 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/2839483199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:04:13.837 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.834+0000 7f6da1058700 1 -- 172.21.15.155:0/1119925196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d9c102c20 msgr2=0x7f6d9c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:13.837 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.834+0000 7f6da1058700 1 --2- 172.21.15.155:0/1119925196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d9c102c20 0x7f6d9c102ff0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6d84004940 tx=0x7f6d84009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:13.837 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.834+0000 7f6da1058700 1 -- 172.21.15.155:0/1119925196 shutdown_connections 2023-12-16T06:04:13.837 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.834+0000 7f6da1058700 1 --2- 172.21.15.155:0/1119925196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d9c065390 0x7f6d9c065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:13.837 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.834+0000 7f6da1058700 1 --2- 172.21.15.155:0/1119925196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d9c102c20 0x7f6d9c102ff0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:13.837 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.834+0000 7f6da1058700 1 -- 172.21.15.155:0/1119925196 >> 172.21.15.155:0/1119925196 conn(0x7f6d9c0719b0 msgr2=0x7f6d9c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:13.837 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.834+0000 7f6da1058700 1 -- 172.21.15.155:0/1119925196 shutdown_connections 2023-12-16T06:04:13.837 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.834+0000 7f6da1058700 1 -- 172.21.15.155:0/1119925196 wait complete. 2023-12-16T06:04:13.839 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.835+0000 7f6da1058700 1 Processor -- start 2023-12-16T06:04:13.839 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.835+0000 7f6da1058700 1 -- start start 2023-12-16T06:04:13.839 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.835+0000 7f6da1058700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d9c065390 0x7f6d9c113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:13.839 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.835+0000 7f6da1058700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d9c102c20 0x7f6d9c113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:13.839 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.835+0000 7f6da1058700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c114220 con 0x7f6d9c102c20 2023-12-16T06:04:13.839 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.835+0000 7f6da1058700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c10d570 con 0x7f6d9c065390 2023-12-16T06:04:13.839 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.835+0000 7f6d9a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d9c102c20 0x7f6d9c113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:13.840 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.835+0000 7f6d9a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d9c102c20 0x7f6d9c113bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59688/0 (socket says 172.21.15.155:59688) 2023-12-16T06:04:13.840 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.835+0000 7f6d9a59c700 1 -- 172.21.15.155:0/2628167602 learned_addr learned my addr 172.21.15.155:0/2628167602 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:04:13.840 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.835+0000 7f6d9ad9d700 1 --2- 172.21.15.155:0/2628167602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d9c065390 0x7f6d9c113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:13.840 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.835+0000 7f6d9a59c700 1 -- 172.21.15.155:0/2628167602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d9c065390 msgr2=0x7f6d9c113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:13.840 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.835+0000 7f6d9a59c700 1 --2- 172.21.15.155:0/2628167602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d9c065390 0x7f6d9c113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:13.840 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.835+0000 7f6d9a59c700 1 -- 172.21.15.155:0/2628167602 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d84005040 con 0x7f6d9c102c20 2023-12-16T06:04:13.840 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.835+0000 7f6d9ad9d700 1 --2- 172.21.15.155:0/2628167602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d9c065390 0x7f6d9c113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T06:04:13.840 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.835+0000 7f6d9a59c700 1 --2- 172.21.15.155:0/2628167602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d9c102c20 0x7f6d9c113bd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00c8c0 tx=0x7f6d8c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:13.840 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.835+0000 7f6d937fe700 1 -- 172.21.15.155:0/2628167602 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d8c00a980 con 0x7f6d9c102c20 2023-12-16T06:04:13.840 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.836+0000 7f6d937fe700 1 -- 172.21.15.155:0/2628167602 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6d8c00ce60 con 0x7f6d9c102c20 2023-12-16T06:04:13.840 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.836+0000 7f6da1058700 1 -- 172.21.15.155:0/2628167602 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9c10d850 con 0x7f6d9c102c20 2023-12-16T06:04:13.840 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.836+0000 7f6d937fe700 1 -- 172.21.15.155:0/2628167602 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d8c0113a0 con 0x7f6d9c102c20 2023-12-16T06:04:13.840 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.836+0000 7f6da1058700 1 -- 172.21.15.155:0/2628167602 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9c10dd90 con 0x7f6d9c102c20 2023-12-16T06:04:13.840 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.836+0000 7f6da1058700 1 -- 172.21.15.155:0/2628167602 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9c0fff40 con 0x7f6d9c102c20 2023-12-16T06:04:13.841 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.837+0000 7f6d937fe700 1 -- 172.21.15.155:0/2628167602 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f6d8c012400 con 0x7f6d9c102c20 2023-12-16T06:04:13.841 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.837+0000 7f6d937fe700 1 --2- 172.21.15.155:0/2628167602 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f6d8806ce60 0x7f6d8806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:13.841 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.837+0000 7f6d937fe700 1 -- 172.21.15.155:0/2628167602 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f6d8c08c270 con 0x7f6d9c102c20 2023-12-16T06:04:13.841 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.837+0000 7f6d9ad9d700 1 --2- 172.21.15.155:0/2628167602 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f6d8806ce60 0x7f6d8806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:13.842 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.838+0000 7f6d9ad9d700 1 --2- 172.21.15.155:0/2628167602 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f6d8806ce60 0x7f6d8806f310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6d84004f90 tx=0x7f6d84009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:13.844 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:13.842+0000 7f6d937fe700 1 -- 172.21.15.155:0/2628167602 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f6d8c059d50 con 0x7f6d9c102c20 2023-12-16T06:04:14.121 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.118+0000 7f6da1058700 1 -- 172.21.15.155:0/2628167602 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6d9c0734d0 con 0x7f6d9c102c20 2023-12-16T06:04:14.121 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.118+0000 7f6d937fe700 1 -- 172.21.15.155:0/2628167602 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+725 (secure 0 0 0) 0x7f6d8c0598e0 con 0x7f6d9c102c20 2023-12-16T06:04:14.123 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.120+0000 7f6da1058700 1 -- 172.21.15.155:0/2628167602 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f6d8806ce60 msgr2=0x7f6d8806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:14.123 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.120+0000 7f6da1058700 1 --2- 172.21.15.155:0/2628167602 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f6d8806ce60 0x7f6d8806f310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6d84004f90 tx=0x7f6d84009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:14.123 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.120+0000 7f6da1058700 1 -- 172.21.15.155:0/2628167602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d9c102c20 msgr2=0x7f6d9c113bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:14.123 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.120+0000 7f6da1058700 1 --2- 172.21.15.155:0/2628167602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d9c102c20 0x7f6d9c113bd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00c8c0 tx=0x7f6d8c0044c0 comp rx=0 tx=0).stop 2023-12-16T06:04:14.123 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.121+0000 7f6da1058700 1 -- 172.21.15.155:0/2628167602 shutdown_connections 2023-12-16T06:04:14.123 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.121+0000 7f6da1058700 1 --2- 172.21.15.155:0/2628167602 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f6d8806ce60 0x7f6d8806f310 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:14.123 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.121+0000 7f6da1058700 1 --2- 172.21.15.155:0/2628167602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d9c065390 0x7f6d9c113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:14.124 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.121+0000 7f6da1058700 1 --2- 172.21.15.155:0/2628167602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d9c102c20 0x7f6d9c113bd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:14.124 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.121+0000 7f6da1058700 1 -- 172.21.15.155:0/2628167602 >> 172.21.15.155:0/2628167602 conn(0x7f6d9c0719b0 msgr2=0x7f6d9c0fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:14.124 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.121+0000 7f6da1058700 1 -- 172.21.15.155:0/2628167602 shutdown_connections 2023-12-16T06:04:14.124 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.121+0000 7f6da1058700 1 -- 172.21.15.155:0/2628167602 wait complete. 2023-12-16T06:04:14.133 INFO:teuthology.orchestra.run.smithi155.stdout:false 2023-12-16T06:04:14.537 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T06:04:14.538 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi155 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-16T06:04:14.619 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a0518258ecac457ab2d6d922aa902811 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi155 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-16T06:04:14.623 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-16T06:04:14.637 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-16T06:04:14.637 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-16T06:04:14.637 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T06:04:14.673 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-16T06:04:14.673 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T06:04:14.733 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T06:04:14.896 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.891+0000 7f7afd2fc700 1 -- 172.21.15.155:0/1225953454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7af80fb970 msgr2=0x7f7af80fbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:14.896 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.891+0000 7f7afd2fc700 1 --2- 172.21.15.155:0/1225953454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7af80fb970 0x7f7af80fbd40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7aec004940 tx=0x7f7aec009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:14.896 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.891+0000 7f7afd2fc700 1 -- 172.21.15.155:0/1225953454 shutdown_connections 2023-12-16T06:04:14.896 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.891+0000 7f7afd2fc700 1 --2- 172.21.15.155:0/1225953454 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7af80fc280 0x7f7af8108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:14.897 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.891+0000 7f7afd2fc700 1 --2- 172.21.15.155:0/1225953454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7af80fb970 0x7f7af80fbd40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:14.897 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.891+0000 7f7afd2fc700 1 -- 172.21.15.155:0/1225953454 >> 172.21.15.155:0/1225953454 conn(0x7f7af80f7660 msgr2=0x7f7af80f9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:14.897 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.891+0000 7f7afd2fc700 1 -- 172.21.15.155:0/1225953454 shutdown_connections 2023-12-16T06:04:14.897 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.891+0000 7f7afd2fc700 1 -- 172.21.15.155:0/1225953454 wait complete. 2023-12-16T06:04:14.897 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.892+0000 7f7afd2fc700 1 Processor -- start 2023-12-16T06:04:14.897 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.892+0000 7f7afd2fc700 1 -- start start 2023-12-16T06:04:14.897 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.892+0000 7f7afd2fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7af80fb970 0x7f7af8115530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:14.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.892+0000 7f7afd2fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7af80fc280 0x7f7af8115a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:14.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.892+0000 7f7afd2fc700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af81160c0 con 0x7f7af80fc280 2023-12-16T06:04:14.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.892+0000 7f7afd2fc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af810f600 con 0x7f7af80fb970 2023-12-16T06:04:14.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.892+0000 7f7af67fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7af80fc280 0x7f7af8115a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:14.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.892+0000 7f7af67fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7af80fc280 0x7f7af8115a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59700/0 (socket says 172.21.15.155:59700) 2023-12-16T06:04:14.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.892+0000 7f7af67fc700 1 -- 172.21.15.155:0/330962059 learned_addr learned my addr 172.21.15.155:0/330962059 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:04:14.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.892+0000 7f7af6ffd700 1 --2- 172.21.15.155:0/330962059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7af80fb970 0x7f7af8115530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:14.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.893+0000 7f7af67fc700 1 -- 172.21.15.155:0/330962059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7af80fb970 msgr2=0x7f7af8115530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:14.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.893+0000 7f7af67fc700 1 --2- 172.21.15.155:0/330962059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7af80fb970 0x7f7af8115530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:14.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.893+0000 7f7af67fc700 1 -- 172.21.15.155:0/330962059 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec005040 con 0x7f7af80fc280 2023-12-16T06:04:14.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.893+0000 7f7af67fc700 1 --2- 172.21.15.155:0/330962059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7af80fc280 0x7f7af8115a70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8002a50 tx=0x7f7ae80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:14.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.893+0000 7f7adf7fe700 1 -- 172.21.15.155:0/330962059 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ae8007cc0 con 0x7f7af80fc280 2023-12-16T06:04:14.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.893+0000 7f7afd2fc700 1 -- 172.21.15.155:0/330962059 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af810f8e0 con 0x7f7af80fc280 2023-12-16T06:04:14.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.893+0000 7f7adf7fe700 1 -- 172.21.15.155:0/330962059 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7ae800f040 con 0x7f7af80fc280 2023-12-16T06:04:14.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.893+0000 7f7adf7fe700 1 -- 172.21.15.155:0/330962059 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ae800d9c0 con 0x7f7af80fc280 2023-12-16T06:04:14.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.893+0000 7f7afd2fc700 1 -- 172.21.15.155:0/330962059 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af810fe20 con 0x7f7af80fc280 2023-12-16T06:04:14.900 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.894+0000 7f7afd2fc700 1 -- 172.21.15.155:0/330962059 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af8106710 con 0x7f7af80fc280 2023-12-16T06:04:14.900 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.894+0000 7f7adf7fe700 1 -- 172.21.15.155:0/330962059 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f7ae800db20 con 0x7f7af80fc280 2023-12-16T06:04:14.901 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.895+0000 7f7adf7fe700 1 --2- 172.21.15.155:0/330962059 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f7ae006ce60 0x7f7ae006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:14.901 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.895+0000 7f7af6ffd700 1 --2- 172.21.15.155:0/330962059 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f7ae006ce60 0x7f7ae006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:14.901 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.895+0000 7f7adf7fe700 1 -- 172.21.15.155:0/330962059 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f7ae808bfb0 con 0x7f7af80fc280 2023-12-16T06:04:14.901 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.895+0000 7f7af6ffd700 1 --2- 172.21.15.155:0/330962059 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f7ae006ce60 0x7f7ae006f310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7aec004f90 tx=0x7f7aec009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:14.902 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:14.899+0000 7f7adf7fe700 1 -- 172.21.15.155:0/330962059 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f7ae8059970 con 0x7f7af80fc280 2023-12-16T06:04:15.095 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.093+0000 7f7afd2fc700 1 -- 172.21.15.155:0/330962059 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7af8063ea0 con 0x7f7af80fc280 2023-12-16T06:04:15.097 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.094+0000 7f7adf7fe700 1 -- 172.21.15.155:0/330962059 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16350 (secure 0 0 0) 0x7f7ae8059500 con 0x7f7af80fc280 2023-12-16T06:04:15.097 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T06:04:15.097 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":77,"fsid":"d344784e-9bd6-11ee-95a5-87774f69a715","created":"2023-12-16T05:49:39.805571+0000","modified":"2023-12-16T06:02:45.955545+0000","last_up_change":"2023-12-16T06:02:44.953506+0000","last_in_change":"2023-12-16T05:53:25.098236+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T05:52:48.744538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-16T05:54:24.832362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-16T05:54:25.116129+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f9fdb2e-99ba-4298-973a-70c36ba678ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":47,"up_from":51,"up_thru":76,"down_at":48,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3240639912},{"type":"v1","addr":"172.21.15.155:6803","nonce":3240639912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3240639912},{"type":"v1","addr":"172.21.15.155:6805","nonce":3240639912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3240639912},{"type":"v1","addr":"172.21.15.155:6809","nonce":3240639912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3240639912},{"type":"v1","addr":"172.21.15.155:6807","nonce":3240639912}]},"public_addr":"172.21.15.155:6803/3240639912","cluster_addr":"172.21.15.155:6805/3240639912","heartbeat_back_addr":"172.21.15.155:6809/3240639912","heartbeat_front_addr":"172.21.15.155:6807/3240639912","state":["exists","up"]},{"osd":1,"uuid":"6b941218-a4cb-423c-82a7-4f5825269d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":52,"up_from":56,"up_thru":76,"down_at":53,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":4157136377},{"type":"v1","addr":"172.21.15.155:6811","nonce":4157136377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":4157136377},{"type":"v1","addr":"172.21.15.155:6813","nonce":4157136377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4157136377},{"type":"v1","addr":"172.21.15.155:6817","nonce":4157136377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":4157136377},{"type":"v1","addr":"172.21.15.155:6815","nonce":4157136377}]},"public_addr":"172.21.15.155:6811/4157136377","cluster_addr":"172.21.15.155:6813/4157136377","heartbeat_back_addr":"172.21.15.155:6817/4157136377","heartbeat_front_addr":"172.21.15.155:6815/4157136377","state":["exists","up"]},{"osd":2,"uuid":"ea6b309e-b3ba-4e72-8977-9d4915cb68ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":57,"up_from":61,"up_thru":76,"down_at":58,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2046101839},{"type":"v1","addr":"172.21.15.155:6819","nonce":2046101839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2046101839},{"type":"v1","addr":"172.21.15.155:6821","nonce":2046101839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2046101839},{"type":"v1","addr":"172.21.15.155:6825","nonce":2046101839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2046101839},{"type":"v1","addr":"172.21.15.155:6823","nonce":2046101839}]},"public_addr":"172.21.15.155:6819/2046101839","cluster_addr":"172.21.15.155:6821/2046101839","heartbeat_back_addr":"172.21.15.155:6825/2046101839","heartbeat_front_addr":"172.21.15.155:6823/2046101839","state":["exists","up"]},{"osd":3,"uuid":"ae32e77a-1c79-47d0-802b-ff70099c3126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":25,"last_clean_end":62,"up_from":66,"up_thru":76,"down_at":63,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":915698953},{"type":"v1","addr":"172.21.15.156:6801","nonce":915698953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":915698953},{"type":"v1","addr":"172.21.15.156:6803","nonce":915698953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":915698953},{"type":"v1","addr":"172.21.15.156:6807","nonce":915698953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":915698953},{"type":"v1","addr":"172.21.15.156:6805","nonce":915698953}]},"public_addr":"172.21.15.156:6801/915698953","cluster_addr":"172.21.15.156:6803/915698953","heartbeat_back_addr":"172.21.15.156:6807/915698953","heartbeat_front_addr":"172.21.15.156:6805/915698953","state":["exists","up"]},{"osd":4,"uuid":"f61396ce-8004-49ee-aa87-98c96fc7d35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":67,"up_from":71,"up_thru":76,"down_at":68,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":373103962},{"type":"v1","addr":"172.21.15.156:6809","nonce":373103962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":373103962},{"type":"v1","addr":"172.21.15.156:6811","nonce":373103962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":373103962},{"type":"v1","addr":"172.21.15.156:6815","nonce":373103962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":373103962},{"type":"v1","addr":"172.21.15.156:6813","nonce":373103962}]},"public_addr":"172.21.15.156:6809/373103962","cluster_addr":"172.21.15.156:6811/373103962","heartbeat_back_addr":"172.21.15.156:6815/373103962","heartbeat_front_addr":"172.21.15.156:6813/373103962","state":["exists","up"]},{"osd":5,"uuid":"f58d8355-9752-4ea8-b051-93a14b7f1091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":72,"up_from":76,"up_thru":76,"down_at":73,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3510805402},{"type":"v1","addr":"172.21.15.156:6817","nonce":3510805402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3510805402},{"type":"v1","addr":"172.21.15.156:6819","nonce":3510805402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3510805402},{"type":"v1","addr":"172.21.15.156:6823","nonce":3510805402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3510805402},{"type":"v1","addr":"172.21.15.156:6821","nonce":3510805402}]},"public_addr":"172.21.15.156:6817/3510805402","cluster_addr":"172.21.15.156:6819/3510805402","heartbeat_back_addr":"172.21.15.156:6823/3510805402","heartbeat_front_addr":"172.21.15.156:6821/3510805402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:52:07.086653+0000","dead_epoch":47},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:52:26.710074+0000","dead_epoch":52},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:52:46.466497+0000","dead_epoch":57},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:53:04.226908+0000","dead_epoch":62},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:53:21.851522+0000","dead_epoch":67},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:53:39.341732+0000","dead_epoch":72}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:0/2721988222":"2023-12-17T05:59:20.111919+0000","172.21.15.155:0/4047114346":"2023-12-17T05:59:20.111919+0000","172.21.15.155:6800/1257988911":"2023-12-17T05:59:20.111919+0000","172.21.15.155:0/2787224311":"2023-12-17T05:50:04.441832+0000","172.21.15.156:0/1379404485":"2023-12-17T05:57:20.581878+0000","172.21.15.155:0/4153694391":"2023-12-17T05:51:16.444340+0000","172.21.15.155:0/199787032":"2023-12-17T05:59:20.111919+0000","172.21.15.155:6801/2821498015":"2023-12-17T05:51:16.444340+0000","172.21.15.155:0/3422132632":"2023-12-17T05:50:04.441832+0000","172.21.15.155:0/1549816722":"2023-12-17T05:59:20.111919+0000","172.21.15.155:0/3953524373":"2023-12-17T05:50:04.441832+0000","172.21.15.155:6800/1287353594":"2023-12-17T05:50:28.085105+0000","172.21.15.155:0/3875666728":"2023-12-17T05:56:13.042777+0000","172.21.15.156:0/3731780003":"2023-12-17T05:57:20.581878+0000","172.21.15.155:6800/2821498015":"2023-12-17T05:51:16.444340+0000","172.21.15.155:0/1378946609":"2023-12-17T05:56:13.042777+0000","172.21.15.155:0/3544820495":"2023-12-17T05:50:28.085105+0000","172.21.15.156:0/936282644":"2023-12-17T05:57:20.581878+0000","172.21.15.155:0/1934861149":"2023-12-17T05:56:13.042777+0000","172.21.15.156:0/3085059928":"2023-12-17T05:57:20.581878+0000","172.21.15.156:0/2049972358":"2023-12-17T05:57:20.581878+0000","172.21.15.156:6828/1939402353":"2023-12-17T05:57:20.581878+0000","172.21.15.155:0/2867995431":"2023-12-17T05:50:28.085105+0000","172.21.15.155:6801/291007537":"2023-12-17T05:50:04.441832+0000","172.21.15.155:0/669103637":"2023-12-17T05:50:28.085105+0000","172.21.15.156:0/1198167350":"2023-12-17T05:57:20.581878+0000","172.21.15.155:6800/3642837048":"2023-12-17T05:56:13.042777+0000","172.21.15.155:6801/1257988911":"2023-12-17T05:59:20.111919+0000","172.21.15.155:6801/1287353594":"2023-12-17T05:50:28.085105+0000","172.21.15.155:6800/291007537":"2023-12-17T05:50:04.441832+0000","172.21.15.156:6829/1939402353":"2023-12-17T05:57:20.581878+0000","172.21.15.155:0/2339263885":"2023-12-17T05:51:16.444340+0000","172.21.15.155:6801/3642837048":"2023-12-17T05:56:13.042777+0000","172.21.15.155:0/2852700903":"2023-12-17T05:56:13.042777+0000","172.21.15.155:0/2967908456":"2023-12-17T05:51:16.444340+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T06:04:15.099 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.096+0000 7f7afd2fc700 1 -- 172.21.15.155:0/330962059 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f7ae006ce60 msgr2=0x7f7ae006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:15.099 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.096+0000 7f7afd2fc700 1 --2- 172.21.15.155:0/330962059 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f7ae006ce60 0x7f7ae006f310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7aec004f90 tx=0x7f7aec009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:15.099 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.096+0000 7f7afd2fc700 1 -- 172.21.15.155:0/330962059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7af80fc280 msgr2=0x7f7af8115a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:15.100 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.096+0000 7f7afd2fc700 1 --2- 172.21.15.155:0/330962059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7af80fc280 0x7f7af8115a70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8002a50 tx=0x7f7ae80046b0 comp rx=0 tx=0).stop 2023-12-16T06:04:15.100 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.096+0000 7f7afd2fc700 1 -- 172.21.15.155:0/330962059 shutdown_connections 2023-12-16T06:04:15.100 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.096+0000 7f7afd2fc700 1 --2- 172.21.15.155:0/330962059 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f7ae006ce60 0x7f7ae006f310 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:15.100 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.096+0000 7f7afd2fc700 1 --2- 172.21.15.155:0/330962059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7af80fb970 0x7f7af8115530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:15.100 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.096+0000 7f7afd2fc700 1 --2- 172.21.15.155:0/330962059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7af80fc280 0x7f7af8115a70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:15.100 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.096+0000 7f7afd2fc700 1 -- 172.21.15.155:0/330962059 >> 172.21.15.155:0/330962059 conn(0x7f7af80f7660 msgr2=0x7f7af80f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:15.100 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.097+0000 7f7afd2fc700 1 -- 172.21.15.155:0/330962059 shutdown_connections 2023-12-16T06:04:15.100 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.097+0000 7f7afd2fc700 1 -- 172.21.15.155:0/330962059 wait complete. 2023-12-16T06:04:15.112 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T05:52:48.744538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-16T05:54:24.832362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-16T05:54:25.116129+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T06:04:15.112 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T06:04:15.236 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.232+0000 7f1fcf872700 1 -- 172.21.15.155:0/905428572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fc81025e0 msgr2=0x7f1fc80fbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:15.236 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.232+0000 7f1fcf872700 1 --2- 172.21.15.155:0/905428572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fc81025e0 0x7f1fc80fbc50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4004940 tx=0x7f1fc4009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:15.236 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.232+0000 7f1fcf872700 1 -- 172.21.15.155:0/905428572 shutdown_connections 2023-12-16T06:04:15.236 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.232+0000 7f1fcf872700 1 --2- 172.21.15.155:0/905428572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fc81025e0 0x7f1fc80fbc50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:15.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.232+0000 7f1fcf872700 1 --2- 172.21.15.155:0/905428572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fc8101c40 0x7f1fc8102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:15.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.232+0000 7f1fcf872700 1 -- 172.21.15.155:0/905428572 >> 172.21.15.155:0/905428572 conn(0x7f1fc80f7790 msgr2=0x7f1fc80f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:15.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.232+0000 7f1fcf872700 1 -- 172.21.15.155:0/905428572 shutdown_connections 2023-12-16T06:04:15.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.232+0000 7f1fcf872700 1 -- 172.21.15.155:0/905428572 wait complete. 2023-12-16T06:04:15.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.232+0000 7f1fcf872700 1 Processor -- start 2023-12-16T06:04:15.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.232+0000 7f1fcf872700 1 -- start start 2023-12-16T06:04:15.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.232+0000 7f1fcf872700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fc8101c40 0x7f1fc810e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:15.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.232+0000 7f1fcf872700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fc81025e0 0x7f1fc810ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:15.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.232+0000 7f1fcf872700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc810f0f0 con 0x7f1fc8101c40 2023-12-16T06:04:15.238 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.232+0000 7f1fcf872700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc810f230 con 0x7f1fc81025e0 2023-12-16T06:04:15.238 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.233+0000 7f1fcd60e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fc8101c40 0x7f1fc810e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:15.238 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.233+0000 7f1fcd60e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fc8101c40 0x7f1fc810e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59720/0 (socket says 172.21.15.155:59720) 2023-12-16T06:04:15.238 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.233+0000 7f1fcd60e700 1 -- 172.21.15.155:0/2774923244 learned_addr learned my addr 172.21.15.155:0/2774923244 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:04:15.238 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.233+0000 7f1fcce0d700 1 --2- 172.21.15.155:0/2774923244 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fc81025e0 0x7f1fc810ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:15.238 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.233+0000 7f1fcd60e700 1 -- 172.21.15.155:0/2774923244 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fc81025e0 msgr2=0x7f1fc810ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:15.238 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.233+0000 7f1fcd60e700 1 --2- 172.21.15.155:0/2774923244 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fc81025e0 0x7f1fc810ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:15.238 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.233+0000 7f1fcd60e700 1 -- 172.21.15.155:0/2774923244 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc4005040 con 0x7f1fc8101c40 2023-12-16T06:04:15.238 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.233+0000 7f1fcd60e700 1 --2- 172.21.15.155:0/2774923244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fc8101c40 0x7f1fc810e670 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8002a50 tx=0x7f1fb80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:15.239 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.233+0000 7f1fbdffb700 1 -- 172.21.15.155:0/2774923244 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fb8007cc0 con 0x7f1fc8101c40 2023-12-16T06:04:15.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.233+0000 7f1fbdffb700 1 -- 172.21.15.155:0/2774923244 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1fb800f040 con 0x7f1fc8101c40 2023-12-16T06:04:15.240 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.233+0000 7f1fbdffb700 1 -- 172.21.15.155:0/2774923244 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fb8009540 con 0x7f1fc8101c40 2023-12-16T06:04:15.241 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.233+0000 7f1fcf872700 1 -- 172.21.15.155:0/2774923244 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc81176e0 con 0x7f1fc8101c40 2023-12-16T06:04:15.241 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.233+0000 7f1fcf872700 1 -- 172.21.15.155:0/2774923244 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc8117b60 con 0x7f1fc8101c40 2023-12-16T06:04:15.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.234+0000 7f1fcf872700 1 -- 172.21.15.155:0/2774923244 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc8104110 con 0x7f1fc8101c40 2023-12-16T06:04:15.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.235+0000 7f1fbdffb700 1 -- 172.21.15.155:0/2774923244 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f1fb80096a0 con 0x7f1fc8101c40 2023-12-16T06:04:15.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.235+0000 7f1fbdffb700 1 --2- 172.21.15.155:0/2774923244 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f1fb406ce60 0x7f1fb406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:15.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.235+0000 7f1fbdffb700 1 -- 172.21.15.155:0/2774923244 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f1fb808bf90 con 0x7f1fc8101c40 2023-12-16T06:04:15.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.235+0000 7f1fcce0d700 1 --2- 172.21.15.155:0/2774923244 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f1fb406ce60 0x7f1fb406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:15.242 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.235+0000 7f1fcce0d700 1 --2- 172.21.15.155:0/2774923244 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f1fb406ce60 0x7f1fb406f310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400b3b0 tx=0x7f1fc4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:15.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.239+0000 7f1fbdffb700 1 -- 172.21.15.155:0/2774923244 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f1fb8055f40 con 0x7f1fc8101c40 2023-12-16T06:04:15.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:15 smithi156 ceph-mon[182000]: pgmap v180: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:04:15.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:15 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/2628167602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:04:15.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:15 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/330962059' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T06:04:15.431 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.428+0000 7f1fcf872700 1 -- 172.21.15.155:0/2774923244 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1fc8108bd0 con 0x7f1fc8101c40 2023-12-16T06:04:15.431 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.428+0000 7f1fbdffb700 1 -- 172.21.15.155:0/2774923244 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1fb8059560 con 0x7f1fc8101c40 2023-12-16T06:04:15.431 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2023-12-16T06:04:15.433 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.430+0000 7f1fcf872700 1 -- 172.21.15.155:0/2774923244 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f1fb406ce60 msgr2=0x7f1fb406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:15.433 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.430+0000 7f1fcf872700 1 --2- 172.21.15.155:0/2774923244 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f1fb406ce60 0x7f1fb406f310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400b3b0 tx=0x7f1fc4009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:15.433 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.430+0000 7f1fcf872700 1 -- 172.21.15.155:0/2774923244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fc8101c40 msgr2=0x7f1fc810e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:15.433 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.430+0000 7f1fcf872700 1 --2- 172.21.15.155:0/2774923244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fc8101c40 0x7f1fc810e670 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8002a50 tx=0x7f1fb80046b0 comp rx=0 tx=0).stop 2023-12-16T06:04:15.433 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.430+0000 7f1fcf872700 1 -- 172.21.15.155:0/2774923244 shutdown_connections 2023-12-16T06:04:15.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.430+0000 7f1fcf872700 1 --2- 172.21.15.155:0/2774923244 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f1fb406ce60 0x7f1fb406f310 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:15.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.430+0000 7f1fcf872700 1 --2- 172.21.15.155:0/2774923244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fc8101c40 0x7f1fc810e670 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:15.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.430+0000 7f1fcf872700 1 --2- 172.21.15.155:0/2774923244 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fc81025e0 0x7f1fc810ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:15.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.430+0000 7f1fcf872700 1 -- 172.21.15.155:0/2774923244 >> 172.21.15.155:0/2774923244 conn(0x7f1fc80f7790 msgr2=0x7f1fc80f93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:15.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.430+0000 7f1fcf872700 1 -- 172.21.15.155:0/2774923244 shutdown_connections 2023-12-16T06:04:15.434 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.430+0000 7f1fcf872700 1 -- 172.21.15.155:0/2774923244 wait complete. 2023-12-16T06:04:15.444 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:15 smithi155 ceph-mon[217407]: pgmap v180: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-16T06:04:15.444 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:15 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/2628167602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T06:04:15.444 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:15 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/330962059' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T06:04:15.446 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-16T06:04:15.569 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.565+0000 7f4f7b285700 1 -- 172.21.15.155:0/3503386106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f74101ac0 msgr2=0x7f4f74101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:15.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.565+0000 7f4f7b285700 1 --2- 172.21.15.155:0/3503386106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f74101ac0 0x7f4f74101e90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4f64004940 tx=0x7f4f64009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:15.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.565+0000 7f4f7b285700 1 -- 172.21.15.155:0/3503386106 shutdown_connections 2023-12-16T06:04:15.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.565+0000 7f4f7b285700 1 --2- 172.21.15.155:0/3503386106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f741023d0 0x7f4f740fba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:15.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.565+0000 7f4f7b285700 1 --2- 172.21.15.155:0/3503386106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f74101ac0 0x7f4f74101e90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:15.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.565+0000 7f4f7b285700 1 -- 172.21.15.155:0/3503386106 >> 172.21.15.155:0/3503386106 conn(0x7f4f74071970 msgr2=0x7f4f74071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:15.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.565+0000 7f4f7b285700 1 -- 172.21.15.155:0/3503386106 shutdown_connections 2023-12-16T06:04:15.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.565+0000 7f4f7b285700 1 -- 172.21.15.155:0/3503386106 wait complete. 2023-12-16T06:04:15.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.566+0000 7f4f7b285700 1 Processor -- start 2023-12-16T06:04:15.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.566+0000 7f4f7b285700 1 -- start start 2023-12-16T06:04:15.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.566+0000 7f4f7b285700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f74101ac0 0x7f4f74112240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:15.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.566+0000 7f4f7b285700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f741023d0 0x7f4f74112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:15.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.566+0000 7f4f7b285700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f74112dd0 con 0x7f4f741023d0 2023-12-16T06:04:15.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.566+0000 7f4f7b285700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7410c2f0 con 0x7f4f74101ac0 2023-12-16T06:04:15.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.566+0000 7f4f78820700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f741023d0 0x7f4f74112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:15.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.566+0000 7f4f78820700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f741023d0 0x7f4f74112780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59744/0 (socket says 172.21.15.155:59744) 2023-12-16T06:04:15.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.566+0000 7f4f78820700 1 -- 172.21.15.155:0/2905309709 learned_addr learned my addr 172.21.15.155:0/2905309709 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:04:15.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.566+0000 7f4f79021700 1 --2- 172.21.15.155:0/2905309709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f74101ac0 0x7f4f74112240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:15.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.566+0000 7f4f78820700 1 -- 172.21.15.155:0/2905309709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f74101ac0 msgr2=0x7f4f74112240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:15.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.566+0000 7f4f78820700 1 --2- 172.21.15.155:0/2905309709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f74101ac0 0x7f4f74112240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:15.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.566+0000 7f4f78820700 1 -- 172.21.15.155:0/2905309709 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f64005040 con 0x7f4f741023d0 2023-12-16T06:04:15.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.566+0000 7f4f79021700 1 --2- 172.21.15.155:0/2905309709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f74101ac0 0x7f4f74112240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T06:04:15.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.567+0000 7f4f78820700 1 --2- 172.21.15.155:0/2905309709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f741023d0 0x7f4f74112780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4f70002a50 tx=0x7f4f70004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:15.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.567+0000 7f4f69ffb700 1 -- 172.21.15.155:0/2905309709 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f70007cc0 con 0x7f4f741023d0 2023-12-16T06:04:15.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.567+0000 7f4f69ffb700 1 -- 172.21.15.155:0/2905309709 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4f7000f040 con 0x7f4f741023d0 2023-12-16T06:04:15.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.567+0000 7f4f7b285700 1 -- 172.21.15.155:0/2905309709 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7410c5d0 con 0x7f4f741023d0 2023-12-16T06:04:15.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.567+0000 7f4f69ffb700 1 -- 172.21.15.155:0/2905309709 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f7000d9a0 con 0x7f4f741023d0 2023-12-16T06:04:15.573 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.567+0000 7f4f7b285700 1 -- 172.21.15.155:0/2905309709 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7410cb90 con 0x7f4f741023d0 2023-12-16T06:04:15.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.568+0000 7f4f7b285700 1 -- 172.21.15.155:0/2905309709 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f740fece0 con 0x7f4f741023d0 2023-12-16T06:04:15.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.568+0000 7f4f69ffb700 1 -- 172.21.15.155:0/2905309709 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f4f7000dc60 con 0x7f4f741023d0 2023-12-16T06:04:15.574 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.569+0000 7f4f69ffb700 1 --2- 172.21.15.155:0/2905309709 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f4f6006ce60 0x7f4f6006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:15.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.569+0000 7f4f69ffb700 1 -- 172.21.15.155:0/2905309709 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f4f7008c0f0 con 0x7f4f741023d0 2023-12-16T06:04:15.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.569+0000 7f4f79021700 1 --2- 172.21.15.155:0/2905309709 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f4f6006ce60 0x7f4f6006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:15.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.569+0000 7f4f79021700 1 --2- 172.21.15.155:0/2905309709 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f4f6006ce60 0x7f4f6006f310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4f64004560 tx=0x7f4f64009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:15.575 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.573+0000 7f4f69ffb700 1 -- 172.21.15.155:0/2905309709 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f4f70059ab0 con 0x7f4f741023d0 2023-12-16T06:04:15.767 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.764+0000 7f4f7b285700 1 -- 172.21.15.155:0/2905309709 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f4f74064730 con 0x7f4f741023d0 2023-12-16T06:04:15.767 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.764+0000 7f4f69ffb700 1 -- 172.21.15.155:0/2905309709 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v77) v1 ==== 107+0+11 (secure 0 0 0) 0x7f4f70059640 con 0x7f4f741023d0 2023-12-16T06:04:15.767 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2023-12-16T06:04:15.770 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.767+0000 7f4f7b285700 1 -- 172.21.15.155:0/2905309709 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f4f6006ce60 msgr2=0x7f4f6006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:15.770 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.767+0000 7f4f7b285700 1 --2- 172.21.15.155:0/2905309709 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f4f6006ce60 0x7f4f6006f310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4f64004560 tx=0x7f4f64009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:15.770 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.767+0000 7f4f7b285700 1 -- 172.21.15.155:0/2905309709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f741023d0 msgr2=0x7f4f74112780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:15.770 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.767+0000 7f4f7b285700 1 --2- 172.21.15.155:0/2905309709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f741023d0 0x7f4f74112780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4f70002a50 tx=0x7f4f70004600 comp rx=0 tx=0).stop 2023-12-16T06:04:15.770 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.767+0000 7f4f7b285700 1 -- 172.21.15.155:0/2905309709 shutdown_connections 2023-12-16T06:04:15.770 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.767+0000 7f4f7b285700 1 --2- 172.21.15.155:0/2905309709 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f4f6006ce60 0x7f4f6006f310 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:15.771 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.767+0000 7f4f7b285700 1 --2- 172.21.15.155:0/2905309709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f74101ac0 0x7f4f74112240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:15.771 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.767+0000 7f4f7b285700 1 --2- 172.21.15.155:0/2905309709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f741023d0 0x7f4f74112780 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:15.771 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.767+0000 7f4f7b285700 1 -- 172.21.15.155:0/2905309709 >> 172.21.15.155:0/2905309709 conn(0x7f4f74071970 msgr2=0x7f4f740faf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:15.771 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.767+0000 7f4f7b285700 1 -- 172.21.15.155:0/2905309709 shutdown_connections 2023-12-16T06:04:15.771 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.767+0000 7f4f7b285700 1 -- 172.21.15.155:0/2905309709 wait complete. 2023-12-16T06:04:15.781 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-16T06:04:15.904 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.900+0000 7f21b6f79700 1 -- 172.21.15.155:0/3058672797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b01034e0 msgr2=0x7f21b00fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:15.905 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.900+0000 7f21b6f79700 1 --2- 172.21.15.155:0/3058672797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b01034e0 0x7f21b00fcb50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f21a0004940 tx=0x7f21a0009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:15.905 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.900+0000 7f21b6f79700 1 -- 172.21.15.155:0/3058672797 shutdown_connections 2023-12-16T06:04:15.905 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.900+0000 7f21b6f79700 1 --2- 172.21.15.155:0/3058672797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b01034e0 0x7f21b00fcb50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:15.905 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.900+0000 7f21b6f79700 1 --2- 172.21.15.155:0/3058672797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21b0102b40 0x7f21b0102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:15.905 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.900+0000 7f21b6f79700 1 -- 172.21.15.155:0/3058672797 >> 172.21.15.155:0/3058672797 conn(0x7f21b00f86d0 msgr2=0x7f21b00faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:15.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.900+0000 7f21b6f79700 1 -- 172.21.15.155:0/3058672797 shutdown_connections 2023-12-16T06:04:15.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.900+0000 7f21b6f79700 1 -- 172.21.15.155:0/3058672797 wait complete. 2023-12-16T06:04:15.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.901+0000 7f21b6f79700 1 Processor -- start 2023-12-16T06:04:15.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.901+0000 7f21b6f79700 1 -- start start 2023-12-16T06:04:15.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.901+0000 7f21b6f79700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21b0102b40 0x7f21b0113320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:15.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.901+0000 7f21b6f79700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b01034e0 0x7f21b0113860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:15.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.901+0000 7f21b6f79700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b0113eb0 con 0x7f21b01034e0 2023-12-16T06:04:15.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.901+0000 7f21b6f79700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b010d3d0 con 0x7f21b0102b40 2023-12-16T06:04:15.907 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.901+0000 7f21a7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b01034e0 0x7f21b0113860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:15.907 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.901+0000 7f21a7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b01034e0 0x7f21b0113860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59752/0 (socket says 172.21.15.155:59752) 2023-12-16T06:04:15.907 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.901+0000 7f21a7fff700 1 -- 172.21.15.155:0/1621689075 learned_addr learned my addr 172.21.15.155:0/1621689075 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:04:15.907 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.901+0000 7f21b4d15700 1 --2- 172.21.15.155:0/1621689075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21b0102b40 0x7f21b0113320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:15.907 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.901+0000 7f21a7fff700 1 -- 172.21.15.155:0/1621689075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21b0102b40 msgr2=0x7f21b0113320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:15.907 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.901+0000 7f21a7fff700 1 --2- 172.21.15.155:0/1621689075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21b0102b40 0x7f21b0113320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:15.908 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.901+0000 7f21a7fff700 1 -- 172.21.15.155:0/1621689075 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a0005040 con 0x7f21b01034e0 2023-12-16T06:04:15.908 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.902+0000 7f21a7fff700 1 --2- 172.21.15.155:0/1621689075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b01034e0 0x7f21b0113860 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f21a0009380 tx=0x7f21a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:15.908 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.902+0000 7f21a57fa700 1 -- 172.21.15.155:0/1621689075 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21a000e040 con 0x7f21b01034e0 2023-12-16T06:04:15.908 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.902+0000 7f21a57fa700 1 -- 172.21.15.155:0/1621689075 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f21a0013420 con 0x7f21b01034e0 2023-12-16T06:04:15.908 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.902+0000 7f21a57fa700 1 -- 172.21.15.155:0/1621689075 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21a001c630 con 0x7f21b01034e0 2023-12-16T06:04:15.908 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.902+0000 7f21b6f79700 1 -- 172.21.15.155:0/1621689075 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b010d650 con 0x7f21b01034e0 2023-12-16T06:04:15.908 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.902+0000 7f21b6f79700 1 -- 172.21.15.155:0/1621689075 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b010db90 con 0x7f21b01034e0 2023-12-16T06:04:15.914 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.903+0000 7f21b6f79700 1 -- 172.21.15.155:0/1621689075 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b0105010 con 0x7f21b01034e0 2023-12-16T06:04:15.914 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.903+0000 7f21a57fa700 1 -- 172.21.15.155:0/1621689075 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f21a0013590 con 0x7f21b01034e0 2023-12-16T06:04:15.914 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.903+0000 7f21a57fa700 1 --2- 172.21.15.155:0/1621689075 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f219806ce60 0x7f219806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:15.914 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.904+0000 7f21a57fa700 1 -- 172.21.15.155:0/1621689075 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f21a008d4c0 con 0x7f21b01034e0 2023-12-16T06:04:15.914 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.904+0000 7f21b4d15700 1 --2- 172.21.15.155:0/1621689075 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f219806ce60 0x7f219806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:15.914 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.904+0000 7f21b4d15700 1 --2- 172.21.15.155:0/1621689075 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f219806ce60 0x7f219806f310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f21ac007b20 tx=0x7f21ac009e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:15.915 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:15.908+0000 7f21a57fa700 1 -- 172.21.15.155:0/1621689075 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f21a005af00 con 0x7f21b01034e0 2023-12-16T06:04:16.106 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.103+0000 7f21b6f79700 1 -- 172.21.15.155:0/1621689075 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f21b0064730 con 0x7f21b01034e0 2023-12-16T06:04:16.106 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.104+0000 7f21a57fa700 1 -- 172.21.15.155:0/1621689075 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v77) v1 ==== 107+0+11 (secure 0 0 0) 0x7f21a005aa90 con 0x7f21b01034e0 2023-12-16T06:04:16.107 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2023-12-16T06:04:16.109 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.106+0000 7f21b6f79700 1 -- 172.21.15.155:0/1621689075 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f219806ce60 msgr2=0x7f219806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:16.109 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.106+0000 7f21b6f79700 1 --2- 172.21.15.155:0/1621689075 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f219806ce60 0x7f219806f310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f21ac007b20 tx=0x7f21ac009e20 comp rx=0 tx=0).stop 2023-12-16T06:04:16.109 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.106+0000 7f21b6f79700 1 -- 172.21.15.155:0/1621689075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b01034e0 msgr2=0x7f21b0113860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:16.109 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.106+0000 7f21b6f79700 1 --2- 172.21.15.155:0/1621689075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b01034e0 0x7f21b0113860 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f21a0009380 tx=0x7f21a0009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:16.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.106+0000 7f21b6f79700 1 -- 172.21.15.155:0/1621689075 shutdown_connections 2023-12-16T06:04:16.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.106+0000 7f21b6f79700 1 --2- 172.21.15.155:0/1621689075 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f219806ce60 0x7f219806f310 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:16.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.106+0000 7f21b6f79700 1 --2- 172.21.15.155:0/1621689075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21b0102b40 0x7f21b0113320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:16.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.106+0000 7f21b6f79700 1 --2- 172.21.15.155:0/1621689075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b01034e0 0x7f21b0113860 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:16.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.106+0000 7f21b6f79700 1 -- 172.21.15.155:0/1621689075 >> 172.21.15.155:0/1621689075 conn(0x7f21b00f86d0 msgr2=0x7f21b00fa210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:16.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.106+0000 7f21b6f79700 1 -- 172.21.15.155:0/1621689075 shutdown_connections 2023-12-16T06:04:16.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.106+0000 7f21b6f79700 1 -- 172.21.15.155:0/1621689075 wait complete. 2023-12-16T06:04:16.122 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T06:04:16.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.238+0000 7fbb118b5700 1 -- 172.21.15.155:0/3838128814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb0c102bb0 msgr2=0x7fbb0c102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:16.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.238+0000 7fbb118b5700 1 --2- 172.21.15.155:0/3838128814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb0c102bb0 0x7fbb0c102f80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbafc004940 tx=0x7fbafc009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:16.243 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.238+0000 7fbb118b5700 1 -- 172.21.15.155:0/3838128814 shutdown_connections 2023-12-16T06:04:16.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.238+0000 7fbb118b5700 1 --2- 172.21.15.155:0/3838128814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb0c064bb0 0x7fbb0c065000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:16.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.238+0000 7fbb118b5700 1 --2- 172.21.15.155:0/3838128814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb0c102bb0 0x7fbb0c102f80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:16.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.238+0000 7fbb118b5700 1 -- 172.21.15.155:0/3838128814 >> 172.21.15.155:0/3838128814 conn(0x7fbb0c071970 msgr2=0x7fbb0c071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:16.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.238+0000 7fbb118b5700 1 -- 172.21.15.155:0/3838128814 shutdown_connections 2023-12-16T06:04:16.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.238+0000 7fbb118b5700 1 -- 172.21.15.155:0/3838128814 wait complete. 2023-12-16T06:04:16.244 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.239+0000 7fbb118b5700 1 Processor -- start 2023-12-16T06:04:16.245 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.239+0000 7fbb118b5700 1 -- start start 2023-12-16T06:04:16.245 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.239+0000 7fbb118b5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb0c064bb0 0x7fbb0c0fbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:16.245 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.239+0000 7fbb118b5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb0c102bb0 0x7fbb0c0fc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:16.245 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.239+0000 7fbb118b5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0fc5b0 con 0x7fbb0c064bb0 2023-12-16T06:04:16.245 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.239+0000 7fbb118b5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0fc6f0 con 0x7fbb0c102bb0 2023-12-16T06:04:16.245 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.239+0000 7fbb0affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb0c064bb0 0x7fbb0c0fbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:16.246 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.239+0000 7fbb0affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb0c064bb0 0x7fbb0c0fbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59772/0 (socket says 172.21.15.155:59772) 2023-12-16T06:04:16.246 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.239+0000 7fbb0affd700 1 -- 172.21.15.155:0/131526697 learned_addr learned my addr 172.21.15.155:0/131526697 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:04:16.246 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.239+0000 7fbb0a7fc700 1 --2- 172.21.15.155:0/131526697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb0c102bb0 0x7fbb0c0fc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:16.246 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.239+0000 7fbb0affd700 1 -- 172.21.15.155:0/131526697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb0c102bb0 msgr2=0x7fbb0c0fc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:16.246 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.239+0000 7fbb0affd700 1 --2- 172.21.15.155:0/131526697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb0c102bb0 0x7fbb0c0fc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:16.247 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.239+0000 7fbb0affd700 1 -- 172.21.15.155:0/131526697 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbafc005040 con 0x7fbb0c064bb0 2023-12-16T06:04:16.247 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.239+0000 7fbb0affd700 1 --2- 172.21.15.155:0/131526697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb0c064bb0 0x7fbb0c0fbb30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbafc00b3b0 tx=0x7fbafc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:16.247 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.239+0000 7fbaf37fe700 1 -- 172.21.15.155:0/131526697 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbafc00e040 con 0x7fbb0c064bb0 2023-12-16T06:04:16.247 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.240+0000 7fbb118b5700 1 -- 172.21.15.155:0/131526697 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0c0fc970 con 0x7fbb0c064bb0 2023-12-16T06:04:16.247 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.240+0000 7fbaf37fe700 1 -- 172.21.15.155:0/131526697 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbafc01c430 con 0x7fbb0c064bb0 2023-12-16T06:04:16.247 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.240+0000 7fbaf37fe700 1 -- 172.21.15.155:0/131526697 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbafc013640 con 0x7fbb0c064bb0 2023-12-16T06:04:16.248 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.240+0000 7fbb118b5700 1 -- 172.21.15.155:0/131526697 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0c119a90 con 0x7fbb0c064bb0 2023-12-16T06:04:16.248 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.240+0000 7fbb118b5700 1 -- 172.21.15.155:0/131526697 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb0c064730 con 0x7fbb0c064bb0 2023-12-16T06:04:16.249 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.241+0000 7fbaf37fe700 1 -- 172.21.15.155:0/131526697 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7fbafc01c5a0 con 0x7fbb0c064bb0 2023-12-16T06:04:16.249 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.241+0000 7fbaf37fe700 1 --2- 172.21.15.155:0/131526697 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fbaf406ce60 0x7fbaf406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:16.250 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.241+0000 7fbaf37fe700 1 -- 172.21.15.155:0/131526697 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fbafc08cd90 con 0x7fbb0c064bb0 2023-12-16T06:04:16.250 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.241+0000 7fbb0a7fc700 1 --2- 172.21.15.155:0/131526697 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fbaf406ce60 0x7fbaf406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:16.250 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.242+0000 7fbb0a7fc700 1 --2- 172.21.15.155:0/131526697 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fbaf406ce60 0x7fbaf406f310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0fd320 tx=0x7fbb0000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:16.250 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.246+0000 7fbaf37fe700 1 -- 172.21.15.155:0/131526697 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fbafc056df0 con 0x7fbb0c064bb0 2023-12-16T06:04:16.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:16 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/2774923244' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T06:04:16.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:16 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/2905309709' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T06:04:16.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:16 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/1621689075' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T06:04:16.453 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.451+0000 7fbb118b5700 1 -- 172.21.15.155:0/131526697 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbb0c109ab0 con 0x7fbb0c064bb0 2023-12-16T06:04:16.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.451+0000 7fbaf37fe700 1 -- 172.21.15.155:0/131526697 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v77) v1 ==== 81+0+2096 (secure 0 0 0) 0x7fbafc05a410 con 0x7fbb0c064bb0 2023-12-16T06:04:16.454 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/2721988222 2023-12-17T05:59:20.111919+0000 2023-12-16T06:04:16.454 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/4047114346 2023-12-17T05:59:20.111919+0000 2023-12-16T06:04:16.454 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:6800/1257988911 2023-12-17T05:59:20.111919+0000 2023-12-16T06:04:16.455 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/2787224311 2023-12-17T05:50:04.441832+0000 2023-12-16T06:04:16.455 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.156:0/1379404485 2023-12-17T05:57:20.581878+0000 2023-12-16T06:04:16.455 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/4153694391 2023-12-17T05:51:16.444340+0000 2023-12-16T06:04:16.455 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/199787032 2023-12-17T05:59:20.111919+0000 2023-12-16T06:04:16.455 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:6801/2821498015 2023-12-17T05:51:16.444340+0000 2023-12-16T06:04:16.455 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/3422132632 2023-12-17T05:50:04.441832+0000 2023-12-16T06:04:16.455 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/1549816722 2023-12-17T05:59:20.111919+0000 2023-12-16T06:04:16.455 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/3953524373 2023-12-17T05:50:04.441832+0000 2023-12-16T06:04:16.456 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:6800/1287353594 2023-12-17T05:50:28.085105+0000 2023-12-16T06:04:16.456 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/3875666728 2023-12-17T05:56:13.042777+0000 2023-12-16T06:04:16.456 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.156:0/3731780003 2023-12-17T05:57:20.581878+0000 2023-12-16T06:04:16.456 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:6800/2821498015 2023-12-17T05:51:16.444340+0000 2023-12-16T06:04:16.456 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/1378946609 2023-12-17T05:56:13.042777+0000 2023-12-16T06:04:16.456 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/3544820495 2023-12-17T05:50:28.085105+0000 2023-12-16T06:04:16.456 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.156:0/936282644 2023-12-17T05:57:20.581878+0000 2023-12-16T06:04:16.456 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/1934861149 2023-12-17T05:56:13.042777+0000 2023-12-16T06:04:16.457 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.156:0/3085059928 2023-12-17T05:57:20.581878+0000 2023-12-16T06:04:16.457 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.156:0/2049972358 2023-12-17T05:57:20.581878+0000 2023-12-16T06:04:16.457 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.156:6828/1939402353 2023-12-17T05:57:20.581878+0000 2023-12-16T06:04:16.457 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/2867995431 2023-12-17T05:50:28.085105+0000 2023-12-16T06:04:16.457 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:6801/291007537 2023-12-17T05:50:04.441832+0000 2023-12-16T06:04:16.457 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/669103637 2023-12-17T05:50:28.085105+0000 2023-12-16T06:04:16.457 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.156:0/1198167350 2023-12-17T05:57:20.581878+0000 2023-12-16T06:04:16.457 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:6800/3642837048 2023-12-17T05:56:13.042777+0000 2023-12-16T06:04:16.457 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:6801/1257988911 2023-12-17T05:59:20.111919+0000 2023-12-16T06:04:16.458 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:6801/1287353594 2023-12-17T05:50:28.085105+0000 2023-12-16T06:04:16.458 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:6800/291007537 2023-12-17T05:50:04.441832+0000 2023-12-16T06:04:16.458 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.156:6829/1939402353 2023-12-17T05:57:20.581878+0000 2023-12-16T06:04:16.458 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/2339263885 2023-12-17T05:51:16.444340+0000 2023-12-16T06:04:16.458 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:6801/3642837048 2023-12-17T05:56:13.042777+0000 2023-12-16T06:04:16.458 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/2852700903 2023-12-17T05:56:13.042777+0000 2023-12-16T06:04:16.458 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/2967908456 2023-12-17T05:51:16.444340+0000 2023-12-16T06:04:16.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.453+0000 7fbb118b5700 1 -- 172.21.15.155:0/131526697 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fbaf406ce60 msgr2=0x7fbaf406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:16.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.453+0000 7fbb118b5700 1 --2- 172.21.15.155:0/131526697 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fbaf406ce60 0x7fbaf406f310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0fd320 tx=0x7fbb0000b040 comp rx=0 tx=0).stop 2023-12-16T06:04:16.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.453+0000 7fbb118b5700 1 -- 172.21.15.155:0/131526697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb0c064bb0 msgr2=0x7fbb0c0fbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:16.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.453+0000 7fbb118b5700 1 --2- 172.21.15.155:0/131526697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb0c064bb0 0x7fbb0c0fbb30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbafc00b3b0 tx=0x7fbafc009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:16.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.453+0000 7fbb118b5700 1 -- 172.21.15.155:0/131526697 shutdown_connections 2023-12-16T06:04:16.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.453+0000 7fbb118b5700 1 --2- 172.21.15.155:0/131526697 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fbaf406ce60 0x7fbaf406f310 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:16.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.453+0000 7fbb118b5700 1 --2- 172.21.15.155:0/131526697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb0c064bb0 0x7fbb0c0fbb30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:16.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.453+0000 7fbb118b5700 1 --2- 172.21.15.155:0/131526697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb0c102bb0 0x7fbb0c0fc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:16.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.453+0000 7fbb118b5700 1 -- 172.21.15.155:0/131526697 >> 172.21.15.155:0/131526697 conn(0x7fbb0c071970 msgr2=0x7fbb0c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:16.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.453+0000 7fbb118b5700 1 -- 172.21.15.155:0/131526697 shutdown_connections 2023-12-16T06:04:16.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.453+0000 7fbb118b5700 1 -- 172.21.15.155:0/131526697 wait complete. 2023-12-16T06:04:16.460 INFO:teuthology.orchestra.run.smithi155.stderr:listed 35 entries 2023-12-16T06:04:16.467 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:16 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/2774923244' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T06:04:16.467 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:16 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/2905309709' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T06:04:16.467 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:16 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/1621689075' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T06:04:16.468 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-16T06:04:16.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T06:04:16.469 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-16T06:04:16.506 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2023-12-16T06:04:16.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T06:04:16.506 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-16T06:04:16.605 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-12-16T06:04:16.605 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T06:04:16.698 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-12-16T06:04:16.698 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T06:04:16.757 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T06:04:16.888 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.884+0000 7f3887091700 1 -- 172.21.15.155:0/2010387473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38800fbac0 msgr2=0x7f38800fbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:16.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.884+0000 7f3887091700 1 --2- 172.21.15.155:0/2010387473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38800fbac0 0x7f38800fbf30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f386c004940 tx=0x7f386c009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:16.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.884+0000 7f3887091700 1 -- 172.21.15.155:0/2010387473 shutdown_connections 2023-12-16T06:04:16.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.884+0000 7f3887091700 1 --2- 172.21.15.155:0/2010387473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38800fbac0 0x7f38800fbf30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:16.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.884+0000 7f3887091700 1 --2- 172.21.15.155:0/2010387473 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3880101b00 0x7f3880101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:16.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.884+0000 7f3887091700 1 -- 172.21.15.155:0/2010387473 >> 172.21.15.155:0/2010387473 conn(0x7f38800f7660 msgr2=0x7f38800f9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:16.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.884+0000 7f3887091700 1 -- 172.21.15.155:0/2010387473 shutdown_connections 2023-12-16T06:04:16.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.884+0000 7f3887091700 1 -- 172.21.15.155:0/2010387473 wait complete. 2023-12-16T06:04:16.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.884+0000 7f3887091700 1 Processor -- start 2023-12-16T06:04:16.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.884+0000 7f3887091700 1 -- start start 2023-12-16T06:04:16.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.885+0000 7f3887091700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38800fbac0 0x7f388010e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:16.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.885+0000 7f3887091700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880101b00 0x7f388010e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:16.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.885+0000 7f3887091700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388010ed50 con 0x7f3880101b00 2023-12-16T06:04:16.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.885+0000 7f3887091700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388010ee90 con 0x7f38800fbac0 2023-12-16T06:04:16.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.885+0000 7f387ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880101b00 0x7f388010e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:16.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.885+0000 7f387ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880101b00 0x7f388010e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41652/0 (socket says 172.21.15.155:41652) 2023-12-16T06:04:16.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.885+0000 7f387ffff700 1 -- 172.21.15.155:0/4211999526 learned_addr learned my addr 172.21.15.155:0/4211999526 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:04:16.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.885+0000 7f3884e2d700 1 --2- 172.21.15.155:0/4211999526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38800fbac0 0x7f388010e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:16.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.885+0000 7f387ffff700 1 -- 172.21.15.155:0/4211999526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38800fbac0 msgr2=0x7f388010e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:16.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.885+0000 7f387ffff700 1 --2- 172.21.15.155:0/4211999526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38800fbac0 0x7f388010e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:16.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.885+0000 7f387ffff700 1 -- 172.21.15.155:0/4211999526 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c005040 con 0x7f3880101b00 2023-12-16T06:04:16.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.885+0000 7f387ffff700 1 --2- 172.21.15.155:0/4211999526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880101b00 0x7f388010e810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f386c00b3b0 tx=0x7f386c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:16.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.885+0000 7f387d7fa700 1 -- 172.21.15.155:0/4211999526 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f386c00e040 con 0x7f3880101b00 2023-12-16T06:04:16.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.886+0000 7f387d7fa700 1 -- 172.21.15.155:0/4211999526 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f386c01c430 con 0x7f3880101b00 2023-12-16T06:04:16.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.886+0000 7f3887091700 1 -- 172.21.15.155:0/4211999526 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f388010f110 con 0x7f3880101b00 2023-12-16T06:04:16.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.886+0000 7f387d7fa700 1 -- 172.21.15.155:0/4211999526 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f386c013640 con 0x7f3880101b00 2023-12-16T06:04:16.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.886+0000 7f3887091700 1 -- 172.21.15.155:0/4211999526 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3880117740 con 0x7f3880101b00 2023-12-16T06:04:16.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.886+0000 7f3887091700 1 -- 172.21.15.155:0/4211999526 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3880063ea0 con 0x7f3880101b00 2023-12-16T06:04:16.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.887+0000 7f387d7fa700 1 -- 172.21.15.155:0/4211999526 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f386c01c5a0 con 0x7f3880101b00 2023-12-16T06:04:16.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.887+0000 7f387d7fa700 1 --2- 172.21.15.155:0/4211999526 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f387006ce60 0x7f387006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:16.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.887+0000 7f387d7fa700 1 -- 172.21.15.155:0/4211999526 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f386c08cd90 con 0x7f3880101b00 2023-12-16T06:04:16.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.887+0000 7f3884e2d700 1 --2- 172.21.15.155:0/4211999526 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f387006ce60 0x7f387006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:16.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.888+0000 7f3884e2d700 1 --2- 172.21.15.155:0/4211999526 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f387006ce60 0x7f387006f310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3874004f40 tx=0x7f387400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:16.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:16.892+0000 7f387d7fa700 1 -- 172.21.15.155:0/4211999526 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f386c056df0 con 0x7f3880101b00 2023-12-16T06:04:17.085 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.083+0000 7f3887091700 1 -- 172.21.15.155:0/4211999526 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3880108a80 con 0x7f3880101b00 2023-12-16T06:04:17.088 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.084+0000 7f387d7fa700 1 -- 172.21.15.155:0/4211999526 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16350 (secure 0 0 0) 0x7f386c05a410 con 0x7f3880101b00 2023-12-16T06:04:17.089 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-16T06:04:17.089 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":77,"fsid":"d344784e-9bd6-11ee-95a5-87774f69a715","created":"2023-12-16T05:49:39.805571+0000","modified":"2023-12-16T06:02:45.955545+0000","last_up_change":"2023-12-16T06:02:44.953506+0000","last_in_change":"2023-12-16T05:53:25.098236+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T05:52:48.744538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-16T05:54:24.832362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-16T05:54:25.116129+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f9fdb2e-99ba-4298-973a-70c36ba678ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":47,"up_from":51,"up_thru":76,"down_at":48,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3240639912},{"type":"v1","addr":"172.21.15.155:6803","nonce":3240639912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3240639912},{"type":"v1","addr":"172.21.15.155:6805","nonce":3240639912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3240639912},{"type":"v1","addr":"172.21.15.155:6809","nonce":3240639912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3240639912},{"type":"v1","addr":"172.21.15.155:6807","nonce":3240639912}]},"public_addr":"172.21.15.155:6803/3240639912","cluster_addr":"172.21.15.155:6805/3240639912","heartbeat_back_addr":"172.21.15.155:6809/3240639912","heartbeat_front_addr":"172.21.15.155:6807/3240639912","state":["exists","up"]},{"osd":1,"uuid":"6b941218-a4cb-423c-82a7-4f5825269d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":52,"up_from":56,"up_thru":76,"down_at":53,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":4157136377},{"type":"v1","addr":"172.21.15.155:6811","nonce":4157136377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":4157136377},{"type":"v1","addr":"172.21.15.155:6813","nonce":4157136377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":4157136377},{"type":"v1","addr":"172.21.15.155:6817","nonce":4157136377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":4157136377},{"type":"v1","addr":"172.21.15.155:6815","nonce":4157136377}]},"public_addr":"172.21.15.155:6811/4157136377","cluster_addr":"172.21.15.155:6813/4157136377","heartbeat_back_addr":"172.21.15.155:6817/4157136377","heartbeat_front_addr":"172.21.15.155:6815/4157136377","state":["exists","up"]},{"osd":2,"uuid":"ea6b309e-b3ba-4e72-8977-9d4915cb68ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":57,"up_from":61,"up_thru":76,"down_at":58,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":2046101839},{"type":"v1","addr":"172.21.15.155:6819","nonce":2046101839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2046101839},{"type":"v1","addr":"172.21.15.155:6821","nonce":2046101839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2046101839},{"type":"v1","addr":"172.21.15.155:6825","nonce":2046101839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":2046101839},{"type":"v1","addr":"172.21.15.155:6823","nonce":2046101839}]},"public_addr":"172.21.15.155:6819/2046101839","cluster_addr":"172.21.15.155:6821/2046101839","heartbeat_back_addr":"172.21.15.155:6825/2046101839","heartbeat_front_addr":"172.21.15.155:6823/2046101839","state":["exists","up"]},{"osd":3,"uuid":"ae32e77a-1c79-47d0-802b-ff70099c3126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":25,"last_clean_end":62,"up_from":66,"up_thru":76,"down_at":63,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":915698953},{"type":"v1","addr":"172.21.15.156:6801","nonce":915698953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":915698953},{"type":"v1","addr":"172.21.15.156:6803","nonce":915698953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":915698953},{"type":"v1","addr":"172.21.15.156:6807","nonce":915698953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":915698953},{"type":"v1","addr":"172.21.15.156:6805","nonce":915698953}]},"public_addr":"172.21.15.156:6801/915698953","cluster_addr":"172.21.15.156:6803/915698953","heartbeat_back_addr":"172.21.15.156:6807/915698953","heartbeat_front_addr":"172.21.15.156:6805/915698953","state":["exists","up"]},{"osd":4,"uuid":"f61396ce-8004-49ee-aa87-98c96fc7d35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":67,"up_from":71,"up_thru":76,"down_at":68,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":373103962},{"type":"v1","addr":"172.21.15.156:6809","nonce":373103962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":373103962},{"type":"v1","addr":"172.21.15.156:6811","nonce":373103962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":373103962},{"type":"v1","addr":"172.21.15.156:6815","nonce":373103962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":373103962},{"type":"v1","addr":"172.21.15.156:6813","nonce":373103962}]},"public_addr":"172.21.15.156:6809/373103962","cluster_addr":"172.21.15.156:6811/373103962","heartbeat_back_addr":"172.21.15.156:6815/373103962","heartbeat_front_addr":"172.21.15.156:6813/373103962","state":["exists","up"]},{"osd":5,"uuid":"f58d8355-9752-4ea8-b051-93a14b7f1091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":72,"up_from":76,"up_thru":76,"down_at":73,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3510805402},{"type":"v1","addr":"172.21.15.156:6817","nonce":3510805402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3510805402},{"type":"v1","addr":"172.21.15.156:6819","nonce":3510805402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3510805402},{"type":"v1","addr":"172.21.15.156:6823","nonce":3510805402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3510805402},{"type":"v1","addr":"172.21.15.156:6821","nonce":3510805402}]},"public_addr":"172.21.15.156:6817/3510805402","cluster_addr":"172.21.15.156:6819/3510805402","heartbeat_back_addr":"172.21.15.156:6823/3510805402","heartbeat_front_addr":"172.21.15.156:6821/3510805402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:52:07.086653+0000","dead_epoch":47},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:52:26.710074+0000","dead_epoch":52},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:52:46.466497+0000","dead_epoch":57},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:53:04.226908+0000","dead_epoch":62},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:53:21.851522+0000","dead_epoch":67},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T05:53:39.341732+0000","dead_epoch":72}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:0/2721988222":"2023-12-17T05:59:20.111919+0000","172.21.15.155:0/4047114346":"2023-12-17T05:59:20.111919+0000","172.21.15.155:6800/1257988911":"2023-12-17T05:59:20.111919+0000","172.21.15.155:0/2787224311":"2023-12-17T05:50:04.441832+0000","172.21.15.156:0/1379404485":"2023-12-17T05:57:20.581878+0000","172.21.15.155:0/4153694391":"2023-12-17T05:51:16.444340+0000","172.21.15.155:0/199787032":"2023-12-17T05:59:20.111919+0000","172.21.15.155:6801/2821498015":"2023-12-17T05:51:16.444340+0000","172.21.15.155:0/3422132632":"2023-12-17T05:50:04.441832+0000","172.21.15.155:0/1549816722":"2023-12-17T05:59:20.111919+0000","172.21.15.155:0/3953524373":"2023-12-17T05:50:04.441832+0000","172.21.15.155:6800/1287353594":"2023-12-17T05:50:28.085105+0000","172.21.15.155:0/3875666728":"2023-12-17T05:56:13.042777+0000","172.21.15.156:0/3731780003":"2023-12-17T05:57:20.581878+0000","172.21.15.155:6800/2821498015":"2023-12-17T05:51:16.444340+0000","172.21.15.155:0/1378946609":"2023-12-17T05:56:13.042777+0000","172.21.15.155:0/3544820495":"2023-12-17T05:50:28.085105+0000","172.21.15.156:0/936282644":"2023-12-17T05:57:20.581878+0000","172.21.15.155:0/1934861149":"2023-12-17T05:56:13.042777+0000","172.21.15.156:0/3085059928":"2023-12-17T05:57:20.581878+0000","172.21.15.156:0/2049972358":"2023-12-17T05:57:20.581878+0000","172.21.15.156:6828/1939402353":"2023-12-17T05:57:20.581878+0000","172.21.15.155:0/2867995431":"2023-12-17T05:50:28.085105+0000","172.21.15.155:6801/291007537":"2023-12-17T05:50:04.441832+0000","172.21.15.155:0/669103637":"2023-12-17T05:50:28.085105+0000","172.21.15.156:0/1198167350":"2023-12-17T05:57:20.581878+0000","172.21.15.155:6800/3642837048":"2023-12-17T05:56:13.042777+0000","172.21.15.155:6801/1257988911":"2023-12-17T05:59:20.111919+0000","172.21.15.155:6801/1287353594":"2023-12-17T05:50:28.085105+0000","172.21.15.155:6800/291007537":"2023-12-17T05:50:04.441832+0000","172.21.15.156:6829/1939402353":"2023-12-17T05:57:20.581878+0000","172.21.15.155:0/2339263885":"2023-12-17T05:51:16.444340+0000","172.21.15.155:6801/3642837048":"2023-12-17T05:56:13.042777+0000","172.21.15.155:0/2852700903":"2023-12-17T05:56:13.042777+0000","172.21.15.155:0/2967908456":"2023-12-17T05:51:16.444340+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T06:04:17.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.086+0000 7f3887091700 1 -- 172.21.15.155:0/4211999526 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f387006ce60 msgr2=0x7f387006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:17.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.086+0000 7f3887091700 1 --2- 172.21.15.155:0/4211999526 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f387006ce60 0x7f387006f310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3874004f40 tx=0x7f387400b040 comp rx=0 tx=0).stop 2023-12-16T06:04:17.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.086+0000 7f3887091700 1 -- 172.21.15.155:0/4211999526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880101b00 msgr2=0x7f388010e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:17.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.086+0000 7f3887091700 1 --2- 172.21.15.155:0/4211999526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880101b00 0x7f388010e810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f386c00b3b0 tx=0x7f386c009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:17.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.087+0000 7f3887091700 1 -- 172.21.15.155:0/4211999526 shutdown_connections 2023-12-16T06:04:17.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.087+0000 7f3887091700 1 --2- 172.21.15.155:0/4211999526 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f387006ce60 0x7f387006f310 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:17.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.087+0000 7f3887091700 1 --2- 172.21.15.155:0/4211999526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38800fbac0 0x7f388010e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:17.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.087+0000 7f3887091700 1 --2- 172.21.15.155:0/4211999526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880101b00 0x7f388010e810 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:17.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.087+0000 7f3887091700 1 -- 172.21.15.155:0/4211999526 >> 172.21.15.155:0/4211999526 conn(0x7f38800f7660 msgr2=0x7f38800f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:17.092 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.087+0000 7f3887091700 1 -- 172.21.15.155:0/4211999526 shutdown_connections 2023-12-16T06:04:17.092 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.087+0000 7f3887091700 1 -- 172.21.15.155:0/4211999526 wait complete. 2023-12-16T06:04:17.103 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T05:52:48.744538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-16T05:54:24.832362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-16T05:54:25.116129+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T06:04:17.104 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T06:04:17.227 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.223+0000 7f0c3885c700 1 -- 172.21.15.155:0/2536242719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c34101ac0 msgr2=0x7f0c34101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:17.228 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.223+0000 7f0c3885c700 1 --2- 172.21.15.155:0/2536242719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c34101ac0 0x7f0c34101e90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c004940 tx=0x7f0c1c009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:17.228 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.223+0000 7f0c3885c700 1 -- 172.21.15.155:0/2536242719 shutdown_connections 2023-12-16T06:04:17.228 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.223+0000 7f0c3885c700 1 --2- 172.21.15.155:0/2536242719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c340fba80 0x7f0c340fbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:17.228 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.223+0000 7f0c3885c700 1 --2- 172.21.15.155:0/2536242719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c34101ac0 0x7f0c34101e90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:17.228 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.223+0000 7f0c3885c700 1 -- 172.21.15.155:0/2536242719 >> 172.21.15.155:0/2536242719 conn(0x7f0c340f7600 msgr2=0x7f0c340f9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:17.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.223+0000 7f0c3885c700 1 -- 172.21.15.155:0/2536242719 shutdown_connections 2023-12-16T06:04:17.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.223+0000 7f0c3885c700 1 -- 172.21.15.155:0/2536242719 wait complete. 2023-12-16T06:04:17.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.223+0000 7f0c3885c700 1 Processor -- start 2023-12-16T06:04:17.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.223+0000 7f0c3885c700 1 -- start start 2023-12-16T06:04:17.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.224+0000 7f0c3885c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c340fba80 0x7f0c34113370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:17.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.224+0000 7f0c3885c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c34101ac0 0x7f0c341138b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:17.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.224+0000 7f0c3885c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c34113f00 con 0x7f0c340fba80 2023-12-16T06:04:17.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.224+0000 7f0c3885c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3410d420 con 0x7f0c34101ac0 2023-12-16T06:04:17.230 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.224+0000 7f0c3259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c340fba80 0x7f0c34113370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:17.230 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.224+0000 7f0c3259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c340fba80 0x7f0c34113370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41660/0 (socket says 172.21.15.155:41660) 2023-12-16T06:04:17.230 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.224+0000 7f0c3259c700 1 -- 172.21.15.155:0/3461217859 learned_addr learned my addr 172.21.15.155:0/3461217859 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:04:17.230 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.224+0000 7f0c31d9b700 1 --2- 172.21.15.155:0/3461217859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c34101ac0 0x7f0c341138b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:17.230 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.224+0000 7f0c3259c700 1 -- 172.21.15.155:0/3461217859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c34101ac0 msgr2=0x7f0c341138b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:17.230 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.224+0000 7f0c3259c700 1 --2- 172.21.15.155:0/3461217859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c34101ac0 0x7f0c341138b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:17.230 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.224+0000 7f0c3259c700 1 -- 172.21.15.155:0/3461217859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1c005040 con 0x7f0c340fba80 2023-12-16T06:04:17.230 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.224+0000 7f0c3259c700 1 --2- 172.21.15.155:0/3461217859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c340fba80 0x7f0c34113370 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009fd0 tx=0x7f0c1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:17.230 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.224+0000 7f0c2affd700 1 -- 172.21.15.155:0/3461217859 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c1c00e040 con 0x7f0c340fba80 2023-12-16T06:04:17.231 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.224+0000 7f0c2affd700 1 -- 172.21.15.155:0/3461217859 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0c1c00bc50 con 0x7f0c340fba80 2023-12-16T06:04:17.231 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.224+0000 7f0c3885c700 1 -- 172.21.15.155:0/3461217859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3410d6a0 con 0x7f0c340fba80 2023-12-16T06:04:17.231 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.224+0000 7f0c2affd700 1 -- 172.21.15.155:0/3461217859 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c1c013ea0 con 0x7f0c340fba80 2023-12-16T06:04:17.231 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.224+0000 7f0c3885c700 1 -- 172.21.15.155:0/3461217859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3410dc60 con 0x7f0c340fba80 2023-12-16T06:04:17.231 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.225+0000 7f0c3885c700 1 -- 172.21.15.155:0/3461217859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c34063ea0 con 0x7f0c340fba80 2023-12-16T06:04:17.232 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.226+0000 7f0c2affd700 1 -- 172.21.15.155:0/3461217859 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f0c1c013420 con 0x7f0c340fba80 2023-12-16T06:04:17.232 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.226+0000 7f0c2affd700 1 --2- 172.21.15.155:0/3461217859 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f0c2006ce70 0x7f0c2006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:17.232 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.226+0000 7f0c2affd700 1 -- 172.21.15.155:0/3461217859 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f0c1c08d7c0 con 0x7f0c340fba80 2023-12-16T06:04:17.232 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.226+0000 7f0c31d9b700 1 --2- 172.21.15.155:0/3461217859 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f0c2006ce70 0x7f0c2006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:17.232 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.227+0000 7f0c31d9b700 1 --2- 172.21.15.155:0/3461217859 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f0c2006ce70 0x7f0c2006f320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0c3410ec10 tx=0x7f0c24009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:17.233 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.231+0000 7f0c2affd700 1 -- 172.21.15.155:0/3461217859 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f0c1c05b180 con 0x7f0c340fba80 2023-12-16T06:04:17.421 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.418+0000 7f0c3885c700 1 -- 172.21.15.155:0/3461217859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c3410de80 con 0x7f0c340fba80 2023-12-16T06:04:17.422 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.419+0000 7f0c2affd700 1 -- 172.21.15.155:0/3461217859 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c1c05ad10 con 0x7f0c340fba80 2023-12-16T06:04:17.422 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2023-12-16T06:04:17.423 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.421+0000 7f0c3885c700 1 -- 172.21.15.155:0/3461217859 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f0c2006ce70 msgr2=0x7f0c2006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:17.424 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.421+0000 7f0c3885c700 1 --2- 172.21.15.155:0/3461217859 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f0c2006ce70 0x7f0c2006f320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0c3410ec10 tx=0x7f0c24009ee0 comp rx=0 tx=0).stop 2023-12-16T06:04:17.424 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.421+0000 7f0c3885c700 1 -- 172.21.15.155:0/3461217859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c340fba80 msgr2=0x7f0c34113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:17.424 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.421+0000 7f0c3885c700 1 --2- 172.21.15.155:0/3461217859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c340fba80 0x7f0c34113370 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009fd0 tx=0x7f0c1c009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:17.424 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.421+0000 7f0c3885c700 1 -- 172.21.15.155:0/3461217859 shutdown_connections 2023-12-16T06:04:17.424 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.421+0000 7f0c3885c700 1 --2- 172.21.15.155:0/3461217859 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f0c2006ce70 0x7f0c2006f320 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:17.424 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.421+0000 7f0c3885c700 1 --2- 172.21.15.155:0/3461217859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c340fba80 0x7f0c34113370 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:17.424 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.421+0000 7f0c3885c700 1 --2- 172.21.15.155:0/3461217859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c34101ac0 0x7f0c341138b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:17.424 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.421+0000 7f0c3885c700 1 -- 172.21.15.155:0/3461217859 >> 172.21.15.155:0/3461217859 conn(0x7f0c340f7600 msgr2=0x7f0c340658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:17.425 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.421+0000 7f0c3885c700 1 -- 172.21.15.155:0/3461217859 shutdown_connections 2023-12-16T06:04:17.425 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.421+0000 7f0c3885c700 1 -- 172.21.15.155:0/3461217859 wait complete. 2023-12-16T06:04:17.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:17 smithi156 ceph-mon[182000]: pgmap v181: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:04:17.429 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:17 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/131526697' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-16T06:04:17.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:17 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/4211999526' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T06:04:17.434 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:17 smithi155 ceph-mon[217407]: pgmap v181: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-16T06:04:17.434 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:17 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/131526697' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-16T06:04:17.434 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:17 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/4211999526' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T06:04:17.435 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-16T06:04:17.557 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.553+0000 7f69bf5e9700 1 -- 172.21.15.155:0/2335284308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69b81034d0 msgr2=0x7f69b80fcb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:17.557 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.553+0000 7f69bf5e9700 1 --2- 172.21.15.155:0/2335284308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69b81034d0 0x7f69b80fcb40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f69b4004940 tx=0x7f69b4009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:17.558 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.553+0000 7f69bf5e9700 1 -- 172.21.15.155:0/2335284308 shutdown_connections 2023-12-16T06:04:17.558 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.553+0000 7f69bf5e9700 1 --2- 172.21.15.155:0/2335284308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69b81034d0 0x7f69b80fcb40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:17.558 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.553+0000 7f69bf5e9700 1 --2- 172.21.15.155:0/2335284308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f69b8102b30 0x7f69b8102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:17.558 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.553+0000 7f69bf5e9700 1 -- 172.21.15.155:0/2335284308 >> 172.21.15.155:0/2335284308 conn(0x7f69b80f8680 msgr2=0x7f69b80faa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:17.558 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.553+0000 7f69bf5e9700 1 -- 172.21.15.155:0/2335284308 shutdown_connections 2023-12-16T06:04:17.558 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.553+0000 7f69bf5e9700 1 -- 172.21.15.155:0/2335284308 wait complete. 2023-12-16T06:04:17.558 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.553+0000 7f69bf5e9700 1 Processor -- start 2023-12-16T06:04:17.558 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.554+0000 7f69bf5e9700 1 -- start start 2023-12-16T06:04:17.559 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.554+0000 7f69bf5e9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f69b8102b30 0x7f69b8113390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:17.559 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.554+0000 7f69bf5e9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69b81034d0 0x7f69b81138d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:17.559 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.554+0000 7f69bf5e9700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b8113fb0 con 0x7f69b81034d0 2023-12-16T06:04:17.559 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.554+0000 7f69bf5e9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b810d440 con 0x7f69b8102b30 2023-12-16T06:04:17.559 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.554+0000 7f69bcb84700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69b81034d0 0x7f69b81138d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:17.559 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.554+0000 7f69bcb84700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69b81034d0 0x7f69b81138d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41670/0 (socket says 172.21.15.155:41670) 2023-12-16T06:04:17.559 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.554+0000 7f69bcb84700 1 -- 172.21.15.155:0/3595119465 learned_addr learned my addr 172.21.15.155:0/3595119465 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:04:17.559 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.554+0000 7f69bcb84700 1 -- 172.21.15.155:0/3595119465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f69b8102b30 msgr2=0x7f69b8113390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:17.559 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.554+0000 7f69bcb84700 1 --2- 172.21.15.155:0/3595119465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f69b8102b30 0x7f69b8113390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:17.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.554+0000 7f69bcb84700 1 -- 172.21.15.155:0/3595119465 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b4005040 con 0x7f69b81034d0 2023-12-16T06:04:17.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.554+0000 7f69bcb84700 1 --2- 172.21.15.155:0/3595119465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69b81034d0 0x7f69b81138d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009fd0 tx=0x7f69b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:17.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.554+0000 7f69adffb700 1 -- 172.21.15.155:0/3595119465 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69b400e040 con 0x7f69b81034d0 2023-12-16T06:04:17.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.555+0000 7f69adffb700 1 -- 172.21.15.155:0/3595119465 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f69b400bc50 con 0x7f69b81034d0 2023-12-16T06:04:17.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.555+0000 7f69bf5e9700 1 -- 172.21.15.155:0/3595119465 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b810d660 con 0x7f69b81034d0 2023-12-16T06:04:17.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.555+0000 7f69adffb700 1 -- 172.21.15.155:0/3595119465 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69b401c3f0 con 0x7f69b81034d0 2023-12-16T06:04:17.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.555+0000 7f69bf5e9700 1 -- 172.21.15.155:0/3595119465 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b810dba0 con 0x7f69b81034d0 2023-12-16T06:04:17.561 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.556+0000 7f69bf5e9700 1 -- 172.21.15.155:0/3595119465 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b8063ea0 con 0x7f69b81034d0 2023-12-16T06:04:17.561 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.556+0000 7f69adffb700 1 -- 172.21.15.155:0/3595119465 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7f69b4013420 con 0x7f69b81034d0 2023-12-16T06:04:17.562 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.556+0000 7f69adffb700 1 --2- 172.21.15.155:0/3595119465 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f69a406ce60 0x7f69a406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:17.562 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.557+0000 7f69adffb700 1 -- 172.21.15.155:0/3595119465 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f69b408d6e0 con 0x7f69b81034d0 2023-12-16T06:04:17.562 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.557+0000 7f69bd385700 1 --2- 172.21.15.155:0/3595119465 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f69a406ce60 0x7f69a406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:17.562 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.557+0000 7f69bd385700 1 --2- 172.21.15.155:0/3595119465 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f69a406ce60 0x7f69a406f310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f69a8006fd0 tx=0x7f69a8006db0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:17.564 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.561+0000 7f69adffb700 1 -- 172.21.15.155:0/3595119465 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f69b405b080 con 0x7f69b81034d0 2023-12-16T06:04:17.752 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.750+0000 7f69bf5e9700 1 -- 172.21.15.155:0/3595119465 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f69b810ddc0 con 0x7f69b81034d0 2023-12-16T06:04:17.753 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.750+0000 7f69adffb700 1 -- 172.21.15.155:0/3595119465 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v77) v1 ==== 107+0+11 (secure 0 0 0) 0x7f69b405ac10 con 0x7f69b81034d0 2023-12-16T06:04:17.753 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2023-12-16T06:04:17.755 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.752+0000 7f69bf5e9700 1 -- 172.21.15.155:0/3595119465 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f69a406ce60 msgr2=0x7f69a406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:17.755 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.752+0000 7f69bf5e9700 1 --2- 172.21.15.155:0/3595119465 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f69a406ce60 0x7f69a406f310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f69a8006fd0 tx=0x7f69a8006db0 comp rx=0 tx=0).stop 2023-12-16T06:04:17.755 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.752+0000 7f69bf5e9700 1 -- 172.21.15.155:0/3595119465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69b81034d0 msgr2=0x7f69b81138d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:17.755 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.752+0000 7f69bf5e9700 1 --2- 172.21.15.155:0/3595119465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69b81034d0 0x7f69b81138d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009fd0 tx=0x7f69b4009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:17.755 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.752+0000 7f69bf5e9700 1 -- 172.21.15.155:0/3595119465 shutdown_connections 2023-12-16T06:04:17.756 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.752+0000 7f69bf5e9700 1 --2- 172.21.15.155:0/3595119465 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7f69a406ce60 0x7f69a406f310 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:17.756 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.752+0000 7f69bf5e9700 1 --2- 172.21.15.155:0/3595119465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f69b8102b30 0x7f69b8113390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:17.756 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.752+0000 7f69bf5e9700 1 --2- 172.21.15.155:0/3595119465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69b81034d0 0x7f69b81138d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:17.756 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.752+0000 7f69bf5e9700 1 -- 172.21.15.155:0/3595119465 >> 172.21.15.155:0/3595119465 conn(0x7f69b80f8680 msgr2=0x7f69b80fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:17.756 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.752+0000 7f69bf5e9700 1 -- 172.21.15.155:0/3595119465 shutdown_connections 2023-12-16T06:04:17.756 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.752+0000 7f69bf5e9700 1 -- 172.21.15.155:0/3595119465 wait complete. 2023-12-16T06:04:17.767 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-16T06:04:17.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.884+0000 7fc919f8d700 1 -- 172.21.15.155:0/1227101349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9141034d0 msgr2=0x7fc9140fcb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:17.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.884+0000 7fc919f8d700 1 --2- 172.21.15.155:0/1227101349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9141034d0 0x7fc9140fcb40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc908004940 tx=0x7fc908009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:17.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.884+0000 7fc919f8d700 1 -- 172.21.15.155:0/1227101349 shutdown_connections 2023-12-16T06:04:17.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.884+0000 7fc919f8d700 1 --2- 172.21.15.155:0/1227101349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9141034d0 0x7fc9140fcb40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:17.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.884+0000 7fc919f8d700 1 --2- 172.21.15.155:0/1227101349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc914102b30 0x7fc914102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:17.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.884+0000 7fc919f8d700 1 -- 172.21.15.155:0/1227101349 >> 172.21.15.155:0/1227101349 conn(0x7fc9140f8680 msgr2=0x7fc9140faa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:17.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.884+0000 7fc919f8d700 1 -- 172.21.15.155:0/1227101349 shutdown_connections 2023-12-16T06:04:17.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.885+0000 7fc919f8d700 1 -- 172.21.15.155:0/1227101349 wait complete. 2023-12-16T06:04:17.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.885+0000 7fc919f8d700 1 Processor -- start 2023-12-16T06:04:17.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.885+0000 7fc919f8d700 1 -- start start 2023-12-16T06:04:17.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.885+0000 7fc919f8d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc914102b30 0x7fc914113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:17.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.885+0000 7fc919f8d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9141034d0 0x7fc9141137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:17.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.885+0000 7fc919f8d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc914113e00 con 0x7fc914102b30 2023-12-16T06:04:17.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.885+0000 7fc919f8d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91410d320 con 0x7fc9141034d0 2023-12-16T06:04:17.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.885+0000 7fc9137fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc914102b30 0x7fc914113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:17.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.886+0000 7fc9137fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc914102b30 0x7fc914113270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41692/0 (socket says 172.21.15.155:41692) 2023-12-16T06:04:17.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.886+0000 7fc9137fe700 1 -- 172.21.15.155:0/4521442 learned_addr learned my addr 172.21.15.155:0/4521442 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:04:17.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.886+0000 7fc912ffd700 1 --2- 172.21.15.155:0/4521442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9141034d0 0x7fc9141137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:17.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.886+0000 7fc9137fe700 1 -- 172.21.15.155:0/4521442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9141034d0 msgr2=0x7fc9141137b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:17.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.886+0000 7fc9137fe700 1 --2- 172.21.15.155:0/4521442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9141034d0 0x7fc9141137b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:17.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.886+0000 7fc9137fe700 1 -- 172.21.15.155:0/4521442 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc908005040 con 0x7fc914102b30 2023-12-16T06:04:17.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.886+0000 7fc9137fe700 1 --2- 172.21.15.155:0/4521442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc914102b30 0x7fc914113270 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc90400eb40 tx=0x7fc90400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:17.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.886+0000 7fc8fbfff700 1 -- 172.21.15.155:0/4521442 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc904007cc0 con 0x7fc914102b30 2023-12-16T06:04:17.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.886+0000 7fc919f8d700 1 -- 172.21.15.155:0/4521442 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc91410d5a0 con 0x7fc914102b30 2023-12-16T06:04:17.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.886+0000 7fc8fbfff700 1 -- 172.21.15.155:0/4521442 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc90400f040 con 0x7fc914102b30 2023-12-16T06:04:17.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.886+0000 7fc8fbfff700 1 -- 172.21.15.155:0/4521442 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc904009570 con 0x7fc914102b30 2023-12-16T06:04:17.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.886+0000 7fc919f8d700 1 -- 172.21.15.155:0/4521442 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91410db60 con 0x7fc914102b30 2023-12-16T06:04:17.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.887+0000 7fc919f8d700 1 -- 172.21.15.155:0/4521442 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc914105000 con 0x7fc914102b30 2023-12-16T06:04:17.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.888+0000 7fc8fbfff700 1 -- 172.21.15.155:0/4521442 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7fc9040096d0 con 0x7fc914102b30 2023-12-16T06:04:17.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.888+0000 7fc8fbfff700 1 --2- 172.21.15.155:0/4521442 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fc8fc06ce60 0x7fc8fc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:17.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.888+0000 7fc8fbfff700 1 -- 172.21.15.155:0/4521442 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc90408bf40 con 0x7fc914102b30 2023-12-16T06:04:17.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.888+0000 7fc912ffd700 1 --2- 172.21.15.155:0/4521442 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fc8fc06ce60 0x7fc8fc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:17.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.888+0000 7fc912ffd700 1 --2- 172.21.15.155:0/4521442 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fc8fc06ce60 0x7fc8fc06f310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc91410eb10 tx=0x7fc908009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:17.895 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:17.892+0000 7fc8fbfff700 1 -- 172.21.15.155:0/4521442 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fc9040bf300 con 0x7fc914102b30 2023-12-16T06:04:18.085 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.082+0000 7fc919f8d700 1 -- 172.21.15.155:0/4521442 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fc914063ea0 con 0x7fc914102b30 2023-12-16T06:04:18.085 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.082+0000 7fc8fbfff700 1 -- 172.21.15.155:0/4521442 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v77) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc9040599b0 con 0x7fc914102b30 2023-12-16T06:04:18.085 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2023-12-16T06:04:18.088 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.085+0000 7fc919f8d700 1 -- 172.21.15.155:0/4521442 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fc8fc06ce60 msgr2=0x7fc8fc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:18.088 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.085+0000 7fc919f8d700 1 --2- 172.21.15.155:0/4521442 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fc8fc06ce60 0x7fc8fc06f310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc91410eb10 tx=0x7fc908009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:18.088 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.085+0000 7fc919f8d700 1 -- 172.21.15.155:0/4521442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc914102b30 msgr2=0x7fc914113270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:18.088 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.085+0000 7fc919f8d700 1 --2- 172.21.15.155:0/4521442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc914102b30 0x7fc914113270 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc90400eb40 tx=0x7fc90400b040 comp rx=0 tx=0).stop 2023-12-16T06:04:18.088 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.085+0000 7fc919f8d700 1 -- 172.21.15.155:0/4521442 shutdown_connections 2023-12-16T06:04:18.088 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.085+0000 7fc919f8d700 1 --2- 172.21.15.155:0/4521442 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fc8fc06ce60 0x7fc8fc06f310 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:18.088 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.085+0000 7fc919f8d700 1 --2- 172.21.15.155:0/4521442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc914102b30 0x7fc914113270 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:18.088 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.085+0000 7fc919f8d700 1 --2- 172.21.15.155:0/4521442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9141034d0 0x7fc9141137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:18.089 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.085+0000 7fc919f8d700 1 -- 172.21.15.155:0/4521442 >> 172.21.15.155:0/4521442 conn(0x7fc9140f8680 msgr2=0x7fc9140fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:18.089 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.085+0000 7fc919f8d700 1 -- 172.21.15.155:0/4521442 shutdown_connections 2023-12-16T06:04:18.089 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.085+0000 7fc919f8d700 1 -- 172.21.15.155:0/4521442 wait complete. 2023-12-16T06:04:18.099 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T06:04:18.223 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.218+0000 7fc78a292700 1 -- 172.21.15.155:0/2709822403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc784101ac0 msgr2=0x7fc784101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:18.223 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.218+0000 7fc78a292700 1 --2- 172.21.15.155:0/2709822403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc784101ac0 0x7fc784101e90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc774004940 tx=0x7fc774009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:18.223 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.218+0000 7fc78a292700 1 -- 172.21.15.155:0/2709822403 shutdown_connections 2023-12-16T06:04:18.223 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.218+0000 7fc78a292700 1 --2- 172.21.15.155:0/2709822403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7841023d0 0x7fc7840fba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:18.223 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.218+0000 7fc78a292700 1 --2- 172.21.15.155:0/2709822403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc784101ac0 0x7fc784101e90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:18.223 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.218+0000 7fc78a292700 1 -- 172.21.15.155:0/2709822403 >> 172.21.15.155:0/2709822403 conn(0x7fc784071970 msgr2=0x7fc784071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:18.224 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.218+0000 7fc78a292700 1 -- 172.21.15.155:0/2709822403 shutdown_connections 2023-12-16T06:04:18.224 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.219+0000 7fc78a292700 1 -- 172.21.15.155:0/2709822403 wait complete. 2023-12-16T06:04:18.224 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.219+0000 7fc78a292700 1 Processor -- start 2023-12-16T06:04:18.224 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.219+0000 7fc78a292700 1 -- start start 2023-12-16T06:04:18.224 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.219+0000 7fc78a292700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc784101ac0 0x7fc784102890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:18.224 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.219+0000 7fc78a292700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7841023d0 0x7fc784102dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:18.224 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.219+0000 7fc78a292700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc784103310 con 0x7fc784101ac0 2023-12-16T06:04:18.224 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.219+0000 7fc78a292700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc784103450 con 0x7fc7841023d0 2023-12-16T06:04:18.224 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.219+0000 7fc783fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc784101ac0 0x7fc784102890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:18.225 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.220+0000 7fc783fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc784101ac0 0x7fc784102890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41722/0 (socket says 172.21.15.155:41722) 2023-12-16T06:04:18.225 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.220+0000 7fc783fff700 1 -- 172.21.15.155:0/1987741343 learned_addr learned my addr 172.21.15.155:0/1987741343 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-16T06:04:18.225 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.220+0000 7fc7837fe700 1 --2- 172.21.15.155:0/1987741343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7841023d0 0x7fc784102dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:18.225 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.220+0000 7fc783fff700 1 -- 172.21.15.155:0/1987741343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7841023d0 msgr2=0x7fc784102dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:18.225 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.220+0000 7fc783fff700 1 --2- 172.21.15.155:0/1987741343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7841023d0 0x7fc784102dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:18.225 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.220+0000 7fc783fff700 1 -- 172.21.15.155:0/1987741343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc774005040 con 0x7fc784101ac0 2023-12-16T06:04:18.225 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.220+0000 7fc7837fe700 1 --2- 172.21.15.155:0/1987741343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7841023d0 0x7fc784102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T06:04:18.225 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.220+0000 7fc783fff700 1 --2- 172.21.15.155:0/1987741343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc784101ac0 0x7fc784102890 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc774008d80 tx=0x7fc774009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:18.225 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.220+0000 7fc780ff9700 1 -- 172.21.15.155:0/1987741343 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc77400e030 con 0x7fc784101ac0 2023-12-16T06:04:18.226 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.220+0000 7fc78a292700 1 -- 172.21.15.155:0/1987741343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7841036d0 con 0x7fc784101ac0 2023-12-16T06:04:18.226 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.220+0000 7fc780ff9700 1 -- 172.21.15.155:0/1987741343 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc77401c400 con 0x7fc784101ac0 2023-12-16T06:04:18.226 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.220+0000 7fc780ff9700 1 -- 172.21.15.155:0/1987741343 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc77400b650 con 0x7fc784101ac0 2023-12-16T06:04:18.226 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.220+0000 7fc78a292700 1 -- 172.21.15.155:0/1987741343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc784119a40 con 0x7fc784101ac0 2023-12-16T06:04:18.227 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.221+0000 7fc78a292700 1 -- 172.21.15.155:0/1987741343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc784064730 con 0x7fc784101ac0 2023-12-16T06:04:18.227 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.221+0000 7fc780ff9700 1 -- 172.21.15.155:0/1987741343 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 90940+0+0 (secure 0 0 0) 0x7fc77401c9e0 con 0x7fc784101ac0 2023-12-16T06:04:18.227 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.222+0000 7fc780ff9700 1 --2- 172.21.15.155:0/1987741343 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fc76c06ce70 0x7fc76c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:04:18.227 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.222+0000 7fc780ff9700 1 -- 172.21.15.155:0/1987741343 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc77408dbe0 con 0x7fc784101ac0 2023-12-16T06:04:18.227 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.222+0000 7fc7837fe700 1 --2- 172.21.15.155:0/1987741343 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fc76c06ce70 0x7fc76c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T06:04:18.227 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.222+0000 7fc7837fe700 1 --2- 172.21.15.155:0/1987741343 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fc76c06ce70 0x7fc76c06f320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc778004600 tx=0x7fc77800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T06:04:18.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.226+0000 7fc780ff9700 1 -- 172.21.15.155:0/1987741343 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fc774057b90 con 0x7fc784101ac0 2023-12-16T06:04:18.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:18 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/3461217859' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T06:04:18.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:18 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/3595119465' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T06:04:18.430 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:18 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/4521442' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T06:04:18.435 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.432+0000 7fc78a292700 1 -- 172.21.15.155:0/1987741343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc784108a10 con 0x7fc784101ac0 2023-12-16T06:04:18.435 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.433+0000 7fc780ff9700 1 -- 172.21.15.155:0/1987741343 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v77) v1 ==== 81+0+2096 (secure 0 0 0) 0x7fc77405b1b0 con 0x7fc784101ac0 2023-12-16T06:04:18.436 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/2721988222 2023-12-17T05:59:20.111919+0000 2023-12-16T06:04:18.436 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/4047114346 2023-12-17T05:59:20.111919+0000 2023-12-16T06:04:18.436 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:6800/1257988911 2023-12-17T05:59:20.111919+0000 2023-12-16T06:04:18.436 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/2787224311 2023-12-17T05:50:04.441832+0000 2023-12-16T06:04:18.436 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.156:0/1379404485 2023-12-17T05:57:20.581878+0000 2023-12-16T06:04:18.436 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/4153694391 2023-12-17T05:51:16.444340+0000 2023-12-16T06:04:18.436 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/199787032 2023-12-17T05:59:20.111919+0000 2023-12-16T06:04:18.437 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:6801/2821498015 2023-12-17T05:51:16.444340+0000 2023-12-16T06:04:18.437 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/3422132632 2023-12-17T05:50:04.441832+0000 2023-12-16T06:04:18.437 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/1549816722 2023-12-17T05:59:20.111919+0000 2023-12-16T06:04:18.437 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/3953524373 2023-12-17T05:50:04.441832+0000 2023-12-16T06:04:18.437 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:6800/1287353594 2023-12-17T05:50:28.085105+0000 2023-12-16T06:04:18.437 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/3875666728 2023-12-17T05:56:13.042777+0000 2023-12-16T06:04:18.437 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.156:0/3731780003 2023-12-17T05:57:20.581878+0000 2023-12-16T06:04:18.437 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:6800/2821498015 2023-12-17T05:51:16.444340+0000 2023-12-16T06:04:18.438 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/1378946609 2023-12-17T05:56:13.042777+0000 2023-12-16T06:04:18.438 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/3544820495 2023-12-17T05:50:28.085105+0000 2023-12-16T06:04:18.438 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.156:0/936282644 2023-12-17T05:57:20.581878+0000 2023-12-16T06:04:18.438 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/1934861149 2023-12-17T05:56:13.042777+0000 2023-12-16T06:04:18.438 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.156:0/3085059928 2023-12-17T05:57:20.581878+0000 2023-12-16T06:04:18.438 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.156:0/2049972358 2023-12-17T05:57:20.581878+0000 2023-12-16T06:04:18.438 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.156:6828/1939402353 2023-12-17T05:57:20.581878+0000 2023-12-16T06:04:18.438 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/2867995431 2023-12-17T05:50:28.085105+0000 2023-12-16T06:04:18.438 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:6801/291007537 2023-12-17T05:50:04.441832+0000 2023-12-16T06:04:18.439 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/669103637 2023-12-17T05:50:28.085105+0000 2023-12-16T06:04:18.439 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.156:0/1198167350 2023-12-17T05:57:20.581878+0000 2023-12-16T06:04:18.439 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:6800/3642837048 2023-12-17T05:56:13.042777+0000 2023-12-16T06:04:18.439 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:6801/1257988911 2023-12-17T05:59:20.111919+0000 2023-12-16T06:04:18.439 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:6801/1287353594 2023-12-17T05:50:28.085105+0000 2023-12-16T06:04:18.439 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:6800/291007537 2023-12-17T05:50:04.441832+0000 2023-12-16T06:04:18.440 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.156:6829/1939402353 2023-12-17T05:57:20.581878+0000 2023-12-16T06:04:18.440 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/2339263885 2023-12-17T05:51:16.444340+0000 2023-12-16T06:04:18.440 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:6801/3642837048 2023-12-17T05:56:13.042777+0000 2023-12-16T06:04:18.440 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/2852700903 2023-12-17T05:56:13.042777+0000 2023-12-16T06:04:18.440 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155:0/2967908456 2023-12-17T05:51:16.444340+0000 2023-12-16T06:04:18.441 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.435+0000 7fc78a292700 1 -- 172.21.15.155:0/1987741343 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fc76c06ce70 msgr2=0x7fc76c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:18.441 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.435+0000 7fc78a292700 1 --2- 172.21.15.155:0/1987741343 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fc76c06ce70 0x7fc76c06f320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc778004600 tx=0x7fc77800b040 comp rx=0 tx=0).stop 2023-12-16T06:04:18.441 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.435+0000 7fc78a292700 1 -- 172.21.15.155:0/1987741343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc784101ac0 msgr2=0x7fc784102890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T06:04:18.441 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.435+0000 7fc78a292700 1 --2- 172.21.15.155:0/1987741343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc784101ac0 0x7fc784102890 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc774008d80 tx=0x7fc774009e30 comp rx=0 tx=0).stop 2023-12-16T06:04:18.442 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.435+0000 7fc78a292700 1 -- 172.21.15.155:0/1987741343 shutdown_connections 2023-12-16T06:04:18.442 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.435+0000 7fc78a292700 1 --2- 172.21.15.155:0/1987741343 >> [v2:172.21.15.155:6800/3958499733,v1:172.21.15.155:6801/3958499733] conn(0x7fc76c06ce70 0x7fc76c06f320 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:18.442 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.435+0000 7fc78a292700 1 --2- 172.21.15.155:0/1987741343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc784101ac0 0x7fc784102890 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:18.442 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.435+0000 7fc78a292700 1 --2- 172.21.15.155:0/1987741343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7841023d0 0x7fc784102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:04:18.442 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.435+0000 7fc78a292700 1 -- 172.21.15.155:0/1987741343 >> 172.21.15.155:0/1987741343 conn(0x7fc784071970 msgr2=0x7fc784064be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T06:04:18.442 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.435+0000 7fc78a292700 1 -- 172.21.15.155:0/1987741343 shutdown_connections 2023-12-16T06:04:18.442 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-16T06:04:18.435+0000 7fc78a292700 1 -- 172.21.15.155:0/1987741343 wait complete. 2023-12-16T06:04:18.442 INFO:teuthology.orchestra.run.smithi155.stderr:listed 35 entries 2023-12-16T06:04:18.449 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:18 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/3461217859' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T06:04:18.449 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:18 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/3595119465' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T06:04:18.449 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:18 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/4521442' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T06:04:18.450 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-16T06:04:18.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T06:04:18.450 DEBUG:teuthology.orchestra.run.smithi156:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-16T06:04:18.501 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi156.front.sepia.ceph.com 2023-12-16T06:04:18.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T06:04:18.502 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-16T06:04:18.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T06:04:18.576 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-12-16T06:04:18.683 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-16T06:04:18.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T06:04:18.683 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T06:04:18.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T06:04:18.758 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2023-12-16T06:04:18.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T06:04:18.832 DEBUG:teuthology.orchestra.run.smithi156:> ip netns list 2023-12-16T06:04:18.852 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-16T06:04:18.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T06:04:18.852 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-16T06:04:18.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T06:04:18.955 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link delete ceph-brx 2023-12-16T06:04:19.045 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-12-16T06:04:19.058 INFO:tasks.cephadm:Teardown begin 2023-12-16T06:04:19.058 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-16T06:04:19.088 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-16T06:04:19.116 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-12-16T06:04:19.116 DEBUG:teuthology.orchestra.run.smithi155:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-16T06:04:19.146 DEBUG:teuthology.orchestra.run.smithi156:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-16T06:04:19.174 INFO:tasks.cephadm:Stopping all daemons... 2023-12-16T06:04:19.175 INFO:tasks.cephadm.mon.smithi155:Stopping mon.smithi155... 2023-12-16T06:04:19.175 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-d344784e-9bd6-11ee-95a5-87774f69a715@mon.smithi155 2023-12-16T06:04:19.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:19 smithi156 ceph-mon[182000]: pgmap v182: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2023-12-16T06:04:19.180 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:19 smithi156 ceph-mon[182000]: from='client.? 172.21.15.155:0/1987741343' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-16T06:04:19.389 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:19 smithi155 ceph-mon[217407]: pgmap v182: 65 pgs: 65 active+clean; 284 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2023-12-16T06:04:19.389 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:19 smithi155 ceph-mon[217407]: from='client.? 172.21.15.155:0/1987741343' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-16T06:04:19.390 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:19 smithi155 systemd[1]: Stopping Ceph mon.smithi155 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T06:04:19.810 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:19 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-mon-smithi155[217384]: 2023-12-16T06:04:19.397+0000 7ff542861700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi155 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T06:04:19.810 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:19 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-mon-smithi155[217384]: 2023-12-16T06:04:19.397+0000 7ff542861700 -1 mon.smithi155@0(leader) e3 *** Got Signal Terminated *** 2023-12-16T06:04:20.076 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Dec 16 06:04:19 smithi155 bash[255118]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715-mon-smithi155 2023-12-16T06:04:20.170 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d344784e-9bd6-11ee-95a5-87774f69a715@mon.smithi155.service' 2023-12-16T06:04:20.213 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T06:04:20.214 INFO:tasks.cephadm.mon.smithi155:Stopped mon.smithi155 2023-12-16T06:04:20.214 INFO:tasks.cephadm.mon.smithi156:Stopping mon.smithi156... 2023-12-16T06:04:20.214 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-d344784e-9bd6-11ee-95a5-87774f69a715@mon.smithi156 2023-12-16T06:04:20.583 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:20 smithi156 systemd[1]: Stopping Ceph mon.smithi156 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T06:04:20.883 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:20 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-mon-smithi156[181977]: 2023-12-16T06:04:20.580+0000 7f8aebafc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi156 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T06:04:20.883 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:20 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-mon-smithi156[181977]: 2023-12-16T06:04:20.580+0000 7f8aebafc700 -1 mon.smithi156@1(peon) e3 *** Got Signal Terminated *** 2023-12-16T06:04:21.179 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Dec 16 06:04:20 smithi156 bash[212410]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715-mon-smithi156 2023-12-16T06:04:21.233 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d344784e-9bd6-11ee-95a5-87774f69a715@mon.smithi156.service' 2023-12-16T06:04:21.326 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T06:04:21.326 INFO:tasks.cephadm.mon.smithi156:Stopped mon.smithi156 2023-12-16T06:04:21.326 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-12-16T06:04:21.327 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.0 2023-12-16T06:04:21.826 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:04:21 smithi155 systemd[1]: Stopping Ceph osd.0 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T06:04:21.827 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:04:21 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-0[231777]: 2023-12-16T06:04:21.546+0000 7f1f19105700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T06:04:21.827 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:04:21 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-0[231777]: 2023-12-16T06:04:21.546+0000 7f1f19105700 -1 osd.0 77 *** Got signal Terminated *** 2023-12-16T06:04:21.827 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:04:21 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-0[231777]: 2023-12-16T06:04:21.546+0000 7f1f19105700 -1 osd.0 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T06:04:27.326 INFO:journalctl@ceph.osd.0.smithi155.stdout:Dec 16 06:04:27 smithi155 bash[255276]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-0 2023-12-16T06:04:28.291 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.0.service' 2023-12-16T06:04:28.331 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T06:04:28.332 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-12-16T06:04:28.332 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-12-16T06:04:28.332 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.1 2023-12-16T06:04:28.576 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:04:28 smithi155 systemd[1]: Stopping Ceph osd.1 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T06:04:28.856 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:04:28 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-1[238558]: 2023-12-16T06:04:28.576+0000 7f01e3330700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T06:04:28.856 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:04:28 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-1[238558]: 2023-12-16T06:04:28.576+0000 7f01e3330700 -1 osd.1 77 *** Got signal Terminated *** 2023-12-16T06:04:28.856 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:04:28 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-1[238558]: 2023-12-16T06:04:28.576+0000 7f01e3330700 -1 osd.1 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T06:04:34.327 INFO:journalctl@ceph.osd.1.smithi155.stdout:Dec 16 06:04:34 smithi155 bash[255535]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-1 2023-12-16T06:04:35.307 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.1.service' 2023-12-16T06:04:35.347 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T06:04:35.347 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-12-16T06:04:35.347 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-12-16T06:04:35.347 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.2 2023-12-16T06:04:35.576 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:04:35 smithi155 systemd[1]: Stopping Ceph osd.2 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T06:04:36.076 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:04:35 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-2[245242]: 2023-12-16T06:04:35.594+0000 7f72caf45700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T06:04:36.076 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:04:35 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-2[245242]: 2023-12-16T06:04:35.594+0000 7f72caf45700 -1 osd.2 77 *** Got signal Terminated *** 2023-12-16T06:04:36.076 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:04:35 smithi155 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-2[245242]: 2023-12-16T06:04:35.594+0000 7f72caf45700 -1 osd.2 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T06:04:41.576 INFO:journalctl@ceph.osd.2.smithi155.stdout:Dec 16 06:04:41 smithi155 bash[255799]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-2 2023-12-16T06:04:42.439 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.2.service' 2023-12-16T06:04:42.479 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T06:04:42.480 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-12-16T06:04:42.480 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-12-16T06:04:42.480 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.3 2023-12-16T06:04:42.770 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:04:42 smithi156 systemd[1]: Stopping Ceph osd.3 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T06:04:43.180 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:04:42 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-3[193702]: 2023-12-16T06:04:42.766+0000 7f3b1f950700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T06:04:43.180 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:04:42 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-3[193702]: 2023-12-16T06:04:42.766+0000 7f3b1f950700 -1 osd.3 77 *** Got signal Terminated *** 2023-12-16T06:04:43.180 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:04:42 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-3[193702]: 2023-12-16T06:04:42.766+0000 7f3b1f950700 -1 osd.3 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T06:04:47.930 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:04:47 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[200660]: 2023-12-16T06:04:47.575+0000 7faa0a5de700 -1 osd.4 77 heartbeat_check: no reply from 172.21.15.155:6806 osd.0 since back 2023-12-16T06:04:24.498283+0000 front 2023-12-16T06:04:24.498256+0000 (oldest deadline 2023-12-16T06:04:47.298688+0000) 2023-12-16T06:04:48.930 INFO:journalctl@ceph.osd.3.smithi156.stdout:Dec 16 06:04:48 smithi156 bash[212557]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-3 2023-12-16T06:04:48.930 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:04:48 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[200660]: 2023-12-16T06:04:48.579+0000 7faa0a5de700 -1 osd.4 77 heartbeat_check: no reply from 172.21.15.155:6806 osd.0 since back 2023-12-16T06:04:24.498283+0000 front 2023-12-16T06:04:24.498256+0000 (oldest deadline 2023-12-16T06:04:47.298688+0000) 2023-12-16T06:04:49.813 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:04:49 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[200660]: 2023-12-16T06:04:49.608+0000 7faa0a5de700 -1 osd.4 77 heartbeat_check: no reply from 172.21.15.155:6806 osd.0 since back 2023-12-16T06:04:24.498283+0000 front 2023-12-16T06:04:24.498256+0000 (oldest deadline 2023-12-16T06:04:47.298688+0000) 2023-12-16T06:04:49.820 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.3.service' 2023-12-16T06:04:49.861 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T06:04:49.861 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-12-16T06:04:49.861 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-12-16T06:04:49.861 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.4 2023-12-16T06:04:50.130 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:04:49 smithi156 systemd[1]: Stopping Ceph osd.4 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T06:04:50.430 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:04:50 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:04:50.344+0000 7f08d1452700 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.155:6806 osd.0 since back 2023-12-16T06:04:25.979830+0000 front 2023-12-16T06:04:25.979696+0000 (oldest deadline 2023-12-16T06:04:49.479466+0000) 2023-12-16T06:04:50.430 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:04:50 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[200660]: 2023-12-16T06:04:50.126+0000 7faa0dfe3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T06:04:50.430 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:04:50 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[200660]: 2023-12-16T06:04:50.126+0000 7faa0dfe3700 -1 osd.4 77 *** Got signal Terminated *** 2023-12-16T06:04:50.430 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:04:50 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[200660]: 2023-12-16T06:04:50.126+0000 7faa0dfe3700 -1 osd.4 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T06:04:50.929 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:04:50 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[200660]: 2023-12-16T06:04:50.563+0000 7faa0a5de700 -1 osd.4 77 heartbeat_check: no reply from 172.21.15.155:6806 osd.0 since back 2023-12-16T06:04:24.498283+0000 front 2023-12-16T06:04:24.498256+0000 (oldest deadline 2023-12-16T06:04:47.298688+0000) 2023-12-16T06:04:51.681 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:04:51 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[200660]: 2023-12-16T06:04:51.582+0000 7faa0a5de700 -1 osd.4 77 heartbeat_check: no reply from 172.21.15.155:6806 osd.0 since back 2023-12-16T06:04:24.498283+0000 front 2023-12-16T06:04:24.498256+0000 (oldest deadline 2023-12-16T06:04:47.298688+0000) 2023-12-16T06:04:51.681 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:04:51 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:04:51.347+0000 7f08d1452700 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.155:6806 osd.0 since back 2023-12-16T06:04:25.979830+0000 front 2023-12-16T06:04:25.979696+0000 (oldest deadline 2023-12-16T06:04:49.479466+0000) 2023-12-16T06:04:52.679 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:04:52 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[200660]: 2023-12-16T06:04:52.560+0000 7faa0a5de700 -1 osd.4 77 heartbeat_check: no reply from 172.21.15.155:6806 osd.0 since back 2023-12-16T06:04:24.498283+0000 front 2023-12-16T06:04:24.498256+0000 (oldest deadline 2023-12-16T06:04:47.298688+0000) 2023-12-16T06:04:52.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:04:52 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:04:52.361+0000 7f08d1452700 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.155:6806 osd.0 since back 2023-12-16T06:04:25.979830+0000 front 2023-12-16T06:04:25.979696+0000 (oldest deadline 2023-12-16T06:04:49.479466+0000) 2023-12-16T06:04:53.680 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:04:53 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[200660]: 2023-12-16T06:04:53.538+0000 7faa0a5de700 -1 osd.4 77 heartbeat_check: no reply from 172.21.15.155:6806 osd.0 since back 2023-12-16T06:04:24.498283+0000 front 2023-12-16T06:04:24.498256+0000 (oldest deadline 2023-12-16T06:04:47.298688+0000) 2023-12-16T06:04:53.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:04:53 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:04:53.315+0000 7f08d1452700 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.155:6806 osd.0 since back 2023-12-16T06:04:25.979830+0000 front 2023-12-16T06:04:25.979696+0000 (oldest deadline 2023-12-16T06:04:49.479466+0000) 2023-12-16T06:04:54.680 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:04:54 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4[200660]: 2023-12-16T06:04:54.514+0000 7faa0a5de700 -1 osd.4 77 heartbeat_check: no reply from 172.21.15.155:6806 osd.0 since back 2023-12-16T06:04:24.498283+0000 front 2023-12-16T06:04:24.498256+0000 (oldest deadline 2023-12-16T06:04:47.298688+0000) 2023-12-16T06:04:54.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:04:54 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:04:54.299+0000 7f08d1452700 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.155:6806 osd.0 since back 2023-12-16T06:04:25.979830+0000 front 2023-12-16T06:04:25.979696+0000 (oldest deadline 2023-12-16T06:04:49.479466+0000) 2023-12-16T06:04:55.653 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:04:55 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:04:55.262+0000 7f08d1452700 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.155:6806 osd.0 since back 2023-12-16T06:04:25.979830+0000 front 2023-12-16T06:04:25.979696+0000 (oldest deadline 2023-12-16T06:04:49.479466+0000) 2023-12-16T06:04:55.929 INFO:journalctl@ceph.osd.4.smithi156.stdout:Dec 16 06:04:55 smithi156 bash[212821]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-4 2023-12-16T06:04:56.430 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:04:56 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:04:56.248+0000 7f08d1452700 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.155:6806 osd.0 since back 2023-12-16T06:04:25.979830+0000 front 2023-12-16T06:04:25.979696+0000 (oldest deadline 2023-12-16T06:04:49.479466+0000) 2023-12-16T06:04:56.902 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.4.service' 2023-12-16T06:04:56.943 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T06:04:56.944 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-12-16T06:04:56.944 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-12-16T06:04:56.944 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.5 2023-12-16T06:04:57.179 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:04:57 smithi156 systemd[1]: Stopping Ceph osd.5 for d344784e-9bd6-11ee-95a5-87774f69a715... 2023-12-16T06:04:57.679 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:04:57 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:04:57.203+0000 7f08d765c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T06:04:57.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:04:57 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:04:57.203+0000 7f08d765c700 -1 osd.5 77 *** Got signal Terminated *** 2023-12-16T06:04:57.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:04:57 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:04:57.203+0000 7f08d765c700 -1 osd.5 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T06:04:57.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:04:57 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:04:57.255+0000 7f08d1452700 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.155:6806 osd.0 since back 2023-12-16T06:04:25.979830+0000 front 2023-12-16T06:04:25.979696+0000 (oldest deadline 2023-12-16T06:04:49.479466+0000) 2023-12-16T06:04:57.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:04:57 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:04:57.255+0000 7f08d1452700 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.155:6814 osd.1 since back 2023-12-16T06:04:31.780400+0000 front 2023-12-16T06:04:31.780444+0000 (oldest deadline 2023-12-16T06:04:56.480281+0000) 2023-12-16T06:04:58.679 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:04:58 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:04:58.289+0000 7f08d1452700 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.155:6806 osd.0 since back 2023-12-16T06:04:25.979830+0000 front 2023-12-16T06:04:25.979696+0000 (oldest deadline 2023-12-16T06:04:49.479466+0000) 2023-12-16T06:04:58.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:04:58 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:04:58.289+0000 7f08d1452700 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.155:6814 osd.1 since back 2023-12-16T06:04:31.780400+0000 front 2023-12-16T06:04:31.780444+0000 (oldest deadline 2023-12-16T06:04:56.480281+0000) 2023-12-16T06:04:59.679 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:04:59 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:04:59.247+0000 7f08d1452700 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.155:6806 osd.0 since back 2023-12-16T06:04:25.979830+0000 front 2023-12-16T06:04:25.979696+0000 (oldest deadline 2023-12-16T06:04:49.479466+0000) 2023-12-16T06:04:59.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:04:59 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:04:59.247+0000 7f08d1452700 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.155:6814 osd.1 since back 2023-12-16T06:04:31.780400+0000 front 2023-12-16T06:04:31.780444+0000 (oldest deadline 2023-12-16T06:04:56.480281+0000) 2023-12-16T06:05:00.679 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:05:00 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:05:00.218+0000 7f08d1452700 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.155:6806 osd.0 since back 2023-12-16T06:04:25.979830+0000 front 2023-12-16T06:04:25.979696+0000 (oldest deadline 2023-12-16T06:04:49.479466+0000) 2023-12-16T06:05:00.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:05:00 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:05:00.218+0000 7f08d1452700 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.155:6814 osd.1 since back 2023-12-16T06:04:31.780400+0000 front 2023-12-16T06:04:31.780444+0000 (oldest deadline 2023-12-16T06:04:56.480281+0000) 2023-12-16T06:05:01.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:05:01 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:05:01.197+0000 7f08d1452700 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.155:6806 osd.0 since back 2023-12-16T06:04:25.979830+0000 front 2023-12-16T06:04:25.979696+0000 (oldest deadline 2023-12-16T06:04:49.479466+0000) 2023-12-16T06:05:01.680 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:05:01 smithi156 ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5[206865]: 2023-12-16T06:05:01.197+0000 7f08d1452700 -1 osd.5 77 heartbeat_check: no reply from 172.21.15.155:6814 osd.1 since back 2023-12-16T06:04:31.780400+0000 front 2023-12-16T06:04:31.780444+0000 (oldest deadline 2023-12-16T06:04:56.480281+0000) 2023-12-16T06:05:03.180 INFO:journalctl@ceph.osd.5.smithi156.stdout:Dec 16 06:05:02 smithi156 bash[213082]: ceph-d344784e-9bd6-11ee-95a5-87774f69a715-osd-5 2023-12-16T06:05:03.960 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d344784e-9bd6-11ee-95a5-87774f69a715@osd.5.service' 2023-12-16T06:05:04.000 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T06:05:04.001 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-12-16T06:05:04.001 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d344784e-9bd6-11ee-95a5-87774f69a715 --force --keep-logs 2023-12-16T06:05:20.237 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d344784e-9bd6-11ee-95a5-87774f69a715 --force --keep-logs 2023-12-16T06:05:34.024 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-16T06:05:34.062 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-16T06:05:34.093 INFO:tasks.cephadm:Archiving crash dumps... 2023-12-16T06:05:34.096 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/crash to /home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493606/remote/smithi155/crash 2023-12-16T06:05:34.096 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/crash -- . 2023-12-16T06:05:34.132 INFO:teuthology.orchestra.run.smithi155.stderr:tar: /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/crash: Cannot open: No such file or directory 2023-12-16T06:05:34.132 INFO:teuthology.orchestra.run.smithi155.stderr:tar: Error is not recoverable: exiting now 2023-12-16T06:05:34.133 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/crash to /home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493606/remote/smithi156/crash 2023-12-16T06:05:34.134 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/crash -- . 2023-12-16T06:05:34.160 INFO:teuthology.orchestra.run.smithi156.stderr:tar: /var/lib/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/crash: Cannot open: No such file or directory 2023-12-16T06:05:34.160 INFO:teuthology.orchestra.run.smithi156.stderr:tar: Error is not recoverable: exiting now 2023-12-16T06:05:34.161 INFO:tasks.cephadm:Checking cluster log for badness... 2023-12-16T06:05:34.161 DEBUG:teuthology.orchestra.run.smithi155:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-16T06:05:34.205 INFO:teuthology.orchestra.run.smithi155.stderr:grep: /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph.log: No such file or directory 2023-12-16T06:05:34.207 INFO:tasks.cephadm:Compressing logs... 2023-12-16T06:05:34.207 DEBUG:teuthology.orchestra.run.smithi155:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T06:05:34.250 DEBUG:teuthology.orchestra.run.smithi156:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T06:05:34.275 INFO:teuthology.orchestra.run.smithi155.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-16T06:05:34.275 INFO:teuthology.orchestra.run.smithi155.stderr:: No such file or directory 2023-12-16T06:05:34.276 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mon.smithi155.log 2023-12-16T06:05:34.277 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-16T06:05:34.277 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mon.smithi155.log: gzip -5 --verbose -- /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-osd.2.log 2023-12-16T06:05:34.277 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-osd.0.log 2023-12-16T06:05:34.277 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-volume.log: /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mgr.smithi155.maowdn.log 2023-12-16T06:05:34.278 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi155.vicpis.log 2023-12-16T06:05:34.279 INFO:teuthology.orchestra.run.smithi156.stderr:find: ‘/var/log/rbd-target-api’: No such file or directorygzip 2023-12-16T06:05:34.279 INFO:teuthology.orchestra.run.smithi156.stderr:-5 --verbose -- /var/log/ceph/cephadm.log 2023-12-16T06:05:34.279 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-16T06:05:34.279 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mon.smithi156.log 2023-12-16T06:05:34.280 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-osd.3.log 2023-12-16T06:05:34.280 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mon.smithi156.log: gzip -5 --verbose -- /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mgr.smithi156.pclong.log 2023-12-16T06:05:34.280 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi156.qvgmfj.log 2023-12-16T06:05:34.280 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mgr.smithi156.pclong.log: /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi156.qvgmfj.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-16T06:05:34.280 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-osd.4.log 2023-12-16T06:05:34.280 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-osd.5.log 2023-12-16T06:05:34.287 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-osd.0.log: /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mgr.smithi155.maowdn.log: /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi155.vicpis.log: 91.0% -- replaced with /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-16T06:05:34.287 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi155.bzsxjw.log 2023-12-16T06:05:34.287 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-osd.1.log 2023-12-16T06:05:34.289 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-osd.4.log: /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi156.fasing.log 2023-12-16T06:05:34.289 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi156.fasing.log: 91.0% -- replaced with /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-16T06:05:34.289 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi155.bzsxjw.log: /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-osd.1.log: 90.5% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-16T06:05:34.325 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mgr.smithi156.pclong.log.gz 2023-12-16T06:05:34.563 INFO:teuthology.orchestra.run.smithi155.stderr: 88.4% -- replaced with /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mgr.smithi155.maowdn.log.gz 2023-12-16T06:05:34.576 INFO:teuthology.orchestra.run.smithi156.stderr: 92.5% -- replaced with /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mon.smithi156.log.gz 2023-12-16T06:05:35.077 INFO:teuthology.orchestra.run.smithi155.stderr: 90.9% -- replaced with /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mon.smithi155.log.gz 2023-12-16T06:05:37.639 INFO:teuthology.orchestra.run.smithi156.stderr: 95.0% -- replaced with /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi156.fasing.log.gz 2023-12-16T06:05:37.936 INFO:teuthology.orchestra.run.smithi155.stderr: 93.4% -- replaced with /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-osd.2.log.gz 2023-12-16T06:05:38.351 INFO:teuthology.orchestra.run.smithi156.stderr: 93.4% -- replaced with /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-osd.4.log.gz 2023-12-16T06:05:38.426 INFO:teuthology.orchestra.run.smithi155.stderr: 95.1% -- replaced with /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi155.vicpis.log.gz 2023-12-16T06:05:39.037 INFO:teuthology.orchestra.run.smithi155.stderr: 93.4% -- replaced with /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-osd.0.log.gz 2023-12-16T06:05:40.476 INFO:teuthology.orchestra.run.smithi155.stderr: 93.5% -- replaced with /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-osd.1.log.gz 2023-12-16T06:05:40.551 INFO:teuthology.orchestra.run.smithi156.stderr: 93.4% -- replaced with /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-osd.5.log.gz 2023-12-16T06:05:40.981 INFO:teuthology.orchestra.run.smithi156.stderr: 93.4% -- replaced with /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-osd.3.log.gz 2023-12-16T06:06:11.513 INFO:teuthology.orchestra.run.smithi155.stderr: 93.1% -- replaced with /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi155.bzsxjw.log.gz 2023-12-16T06:06:11.515 INFO:teuthology.orchestra.run.smithi155.stderr: 2023-12-16T06:06:11.515 INFO:teuthology.orchestra.run.smithi155.stderr:real 0m37.250s 2023-12-16T06:06:11.516 INFO:teuthology.orchestra.run.smithi155.stderr:user 0m55.108s 2023-12-16T06:06:11.516 INFO:teuthology.orchestra.run.smithi155.stderr:sys 0m1.921s 2023-12-16T06:06:19.663 INFO:teuthology.orchestra.run.smithi156.stderr: 93.0% -- replaced with /var/log/ceph/d344784e-9bd6-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi156.qvgmfj.log.gz 2023-12-16T06:06:19.665 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-12-16T06:06:19.665 INFO:teuthology.orchestra.run.smithi156.stderr:real 0m45.399s 2023-12-16T06:06:19.665 INFO:teuthology.orchestra.run.smithi156.stderr:user 1m3.912s 2023-12-16T06:06:19.666 INFO:teuthology.orchestra.run.smithi156.stderr:sys 0m2.162s 2023-12-16T06:06:19.666 INFO:tasks.cephadm:Archiving logs... 2023-12-16T06:06:19.666 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493606/remote/smithi155/log 2023-12-16T06:06:19.667 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T06:06:27.982 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493606/remote/smithi156/log 2023-12-16T06:06:27.983 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T06:06:37.670 INFO:tasks.cephadm:Removing cluster... 2023-12-16T06:06:37.670 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d344784e-9bd6-11ee-95a5-87774f69a715 --force 2023-12-16T06:06:38.191 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d344784e-9bd6-11ee-95a5-87774f69a715 --force 2023-12-16T06:06:38.963 INFO:tasks.cephadm:Removing cephadm ... 2023-12-16T06:06:38.963 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-16T06:06:38.986 DEBUG:teuthology.orchestra.run.smithi156:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-16T06:06:39.004 INFO:tasks.cephadm:Teardown complete 2023-12-16T06:06:39.005 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-16T06:06:39.017 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-16T06:06:39.017 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-16T06:06:39.029 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-16T06:06:39.126 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-16T06:06:39.139 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-16T06:06:39.140 DEBUG:teuthology.orchestra.run.smithi155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T06:06:39.143 DEBUG:teuthology.orchestra.run.smithi156:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T06:06:39.160 INFO:teuthology.orchestra.run.smithi156.stderr:bash: ntpq: command not found 2023-12-16T06:06:39.161 INFO:teuthology.orchestra.run.smithi155.stderr:bash: ntpq: command not found 2023-12-16T06:06:39.164 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T06:06:39.164 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2023-12-16T06:06:39.164 INFO:teuthology.orchestra.run.smithi156.stdout:^+ hv01.front.sepia.ceph.com 2 8 377 129 +468us[ +352us] +/- 78ms 2023-12-16T06:06:39.164 INFO:teuthology.orchestra.run.smithi156.stdout:^* hv02.front.sepia.ceph.com 3 6 377 3 -587us[ -668us] +/- 73ms 2023-12-16T06:06:39.164 INFO:teuthology.orchestra.run.smithi156.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 -75us[ -156us] +/- 83ms 2023-12-16T06:06:39.165 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T06:06:39.166 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T06:06:39.166 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2023-12-16T06:06:39.166 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 5 +533us[ +533us] +/- 79ms 2023-12-16T06:06:39.166 INFO:teuthology.orchestra.run.smithi155.stdout:^* hv02.front.sepia.ceph.com 3 6 377 6 -474us[ -458us] +/- 73ms 2023-12-16T06:06:39.166 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 +31us[ +47us] +/- 83ms 2023-12-16T06:06:39.167 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T06:06:39.168 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-16T06:06:39.181 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-16T06:06:39.182 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-16T06:06:39.205 DEBUG:teuthology.orchestra.run.smithi155:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-16T06:06:39.313 DEBUG:teuthology.orchestra.run.smithi156:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-16T06:06:39.410 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T06:06:39.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T06:06:39.444 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T06:06:39.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T06:06:39.477 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-16T06:06:39.489 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-16T06:06:39.528 INFO:teuthology.task.internal:Duration was 5033.434383 seconds 2023-12-16T06:06:39.529 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-16T06:06:39.562 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-16T06:06:39.562 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-16T06:06:39.564 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-16T06:06:39.609 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T06:06:39.610 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T06:06:40.086 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-16T06:06:40.087 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi155.front.sepia.ceph.com 2023-12-16T06:06:40.087 DEBUG:teuthology.orchestra.run.smithi155:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-16T06:06:40.109 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi156.front.sepia.ceph.com 2023-12-16T06:06:40.110 DEBUG:teuthology.orchestra.run.smithi156:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-16T06:06:40.133 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-16T06:06:40.133 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-16T06:06:40.152 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-16T06:06:40.224 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-16T06:06:40.224 DEBUG:teuthology.orchestra.run.smithi155:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-16T06:06:40.226 DEBUG:teuthology.orchestra.run.smithi156:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-16T06:06:40.348 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-16T06:06:40.362 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-16T06:06:40.362 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-16T06:06:40.390 DEBUG:teuthology.orchestra.run.smithi156:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-16T06:06:40.418 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-16T06:06:40.431 DEBUG:teuthology.orchestra.run.smithi155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-16T06:06:40.433 DEBUG:teuthology.orchestra.run.smithi156:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-16T06:06:40.458 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = core 2023-12-16T06:06:40.485 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = core 2023-12-16T06:06:40.499 DEBUG:teuthology.orchestra.run.smithi155:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-16T06:06:40.527 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T06:06:40.528 DEBUG:teuthology.orchestra.run.smithi156:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-16T06:06:40.556 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T06:06:40.556 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-16T06:06:40.568 INFO:teuthology.task.internal:Transferring archived files... 2023-12-16T06:06:40.569 DEBUG:teuthology.misc:Transferring archived files from smithi155:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493606/remote/smithi155 2023-12-16T06:06:40.570 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T06:06:40.613 DEBUG:teuthology.misc:Transferring archived files from smithi156:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493606/remote/smithi156 2023-12-16T06:06:40.613 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T06:06:40.654 INFO:teuthology.task.internal:Removing archive directory... 2023-12-16T06:06:40.655 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-16T06:06:40.657 DEBUG:teuthology.orchestra.run.smithi156:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-16T06:06:40.706 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-16T06:06:40.720 INFO:teuthology.task.internal:Not uploading archives. 2023-12-16T06:06:40.720 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-16T06:06:40.737 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-16T06:06:40.738 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-16T06:06:40.740 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-16T06:06:40.755 INFO:teuthology.orchestra.run.smithi155.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 16 06:06 /home/ubuntu/cephtest 2023-12-16T06:06:40.763 INFO:teuthology.orchestra.run.smithi156.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 16 06:06 /home/ubuntu/cephtest 2023-12-16T06:06:40.764 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-16T06:06:40.777 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-16T06:06:40.837 INFO:teuthology.nuke:Checking targets against current locks 2023-12-16T06:06:40.865 DEBUG:teuthology.nuke:shortname: smithi155 2023-12-16T06:06:40.866 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T06:06:40.888 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493606', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 04:33:27.292889', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOMkydQCkJLkBa3m7klGd46IeIMkjeyvjvTeGZaZ66uu3Ervpm1istTNbW7PasmJLW5qfbgJKI858l9uG+J+MEE='} 2023-12-16T06:06:40.894 DEBUG:teuthology.nuke:shortname: smithi156 2023-12-16T06:06:40.895 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T06:06:40.916 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:10:43-orch-main-distro-default-smithi/7493606', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 04:33:27.294423', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCBKXIbLQws+ln0RSxAZ9MqXuxsUCmPuqqdUJts1uv1ysq9nfXJI01FfCJNfpdeqKKADLLHmDzdSV8IPjYAzKaQ='} 2023-12-16T06:06:40.938 INFO:teuthology.orchestra.console.smithi155:Power off 2023-12-16T06:06:40.938 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T06:06:40.965 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-12-16T06:06:40.965 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T06:06:40.983 INFO:teuthology.orchestra.console.smithi156:Power off 2023-12-16T06:06:40.984 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T06:06:40.993 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-12-16T06:06:41.005 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-12-16T06:06:41.005 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T06:06:41.028 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-12-16T06:06:44.994 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T06:06:45.029 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T06:06:45.105 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-12-16T06:06:45.141 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-12-16T06:06:49.109 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T06:06:49.142 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T06:06:49.221 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-12-16T06:06:49.252 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-12-16T06:06:49.322 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-12-16T06:06:49.353 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-12-16T06:06:49.459 INFO:teuthology.run:Summary data: description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 5033.434382677078 failure_reason: 'Command failed on smithi155 with status 1: ''sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d344784e-9bd6-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c \''ceph versions | jq -e \''"\''"\''.overall | length == 1\''"\''"\''\''''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a0518258ecac457ab2d6d922aa902811 status: fail success: false 2023-12-16T06:06:49.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:06:49.552 INFO:teuthology.run:FAIL